*** brlogger has joined #baserock | 01:06 | |
*** brlogger has joined #baserock | 01:32 | |
*** rdale has quit IRC | 02:17 | |
*** SotK has quit IRC | 02:22 | |
*** SotK has joined #baserock | 02:25 | |
*** gtristan has quit IRC | 05:33 | |
*** rdale has joined #baserock | 06:25 | |
*** gtristan has joined #baserock | 06:29 | |
*** paulw has joined #baserock | 07:03 | |
*** ctbruce has joined #baserock | 07:37 | |
*** toscalix has joined #baserock | 08:03 | |
*** ssam2 has joined #baserock | 08:25 | |
*** ChanServ sets mode: +v ssam2 | 08:25 | |
*** jonathanmaw has joined #baserock | 08:32 | |
*** jude has joined #baserock | 09:29 | |
*** ctbruce has quit IRC | 10:35 | |
*** ctbruce has joined #baserock | 10:35 | |
*** ssam2 has quit IRC | 10:42 | |
paulsherwood | jjardon: sorry to bug you... did you manage to figure out what broke the gnome build i was trying? | 10:53 |
---|---|---|
jjardon | paulsherwood: didn't manage to reproduce, I was planning to try again with several instances: how many are you using? | 10:57 |
paulsherwood | 4 | 10:59 |
jjardon | ok, thanks, lets see how it goes: https://gitlab.com/baserock/definitions/pipelines/7927739 | 11:03 |
gtristan | jjardon, is that CI using YBD master ? | 11:09 |
jjardon | yes | 11:10 |
gtristan | strange that it would pass, and it's building from scratch right ? | 11:10 |
gtristan | not reusing any artifact server ? | 11:10 |
ironfoot | my guess is that this problem becomes visible with more than one instance | 11:11 |
gtristan | I think that is still by pure chance | 11:12 |
gtristan | the "fix" though, I've said before, is to make all things in build-essential stage3 depend on fhs-dirs | 11:12 |
jjardon | running this in parallel with default number of instances (1) https://gitlab.com/baserock/definitions/pipelines/7927706 | 11:13 |
paulsherwood | i guess i can just try that on my machine | 11:13 |
jjardon | gtristan: every branch that gets merged in ybd needs to build build-essential before from scratch (without using kbas) | 11:14 |
paulsherwood | gtristan: how come builstream does the gnome image successfully, if this is a definitions issue? | 11:17 |
gtristan | paulsherwood, build-essential was a manual conversion for several reasons, the conversion script rebases any definitions against an already made "base" | 11:28 |
gtristan | So, I handled that myself, wondered if it way my own problem, ended up ensuring that things in stage3 depend on fhs-dirs | 11:29 |
gtristan | that was in a second (manual) conversion which took into account the /usr merge stuff | 11:29 |
gtristan | was not needed pre /usr merge since the symlinks were not there | 11:30 |
ironfoot | right, then patch should be simple | 11:30 |
gtristan | jjardon, fwiw building build-essential by itself is not enough to catch this | 11:30 |
gtristan | jjardon, it's once you start staging the output of build-essential that symlinks try to stomp on non-empty directories at random | 11:31 |
gtristan | ironfoot, yes, it's an easy fix, just build-depend on fhs-dirs for any of the last stage build-essential | 11:31 |
jjardon | sorry, its building the minimal system, not only build-essential | 11:32 |
jjardon | gtristan: but minimal = build-essential + bsp, so maybe not enough to catch that | 11:32 |
gtristan | that should fail honestly, the only reason I can think of it consistently passing, is if with instances = 1, then staging order becomes the order listed in the build-essential stratum (which *happens* to have fhs-dirs first) | 11:33 |
gtristan | jjardon, well, true... actually it will only trigger an error once you reach a package which has a build script that explicitly says #!/bin/bash | 11:33 |
gtristan | not all of core does this, but some do | 11:34 |
gtristan | running a shell in PATH tends to work | 11:34 |
ironfoot | simple fix! anyone? :) | 11:34 |
gtristan | Oh look | 11:37 |
gtristan | it looks like I *did* push a fix for the gcc issue | 11:37 |
gtristan | 2bf01667c7ef1f79a6b94693bb796a457f837b2b should fix that for the runners with gcc 6 host tool | 11:37 |
* jjardon is amazed how many things works by pure coincidence | 11:37 | |
jjardon | gtristan: yup, I stole your patch from here and put it in a MR :P | 11:38 |
gtristan | Ah | 11:40 |
gtristan | looks like it only needs linux-api-headers to depend on fhs-dirs | 11:40 |
* gtristan kicks off a local build | 11:40 | |
gtristan | (because glibc depends on linux-api-headers, and everything else in stage 3 depends on glibc in some way) | 11:42 |
gtristan | well, that does reduce at least the random possibilities | 11:42 |
paulsherwood | gtristan: like this? https://gitlab.com/baserock/definitions/commit/ef6a124911dc2b821e163a6254992f1bc8be215a | 11:42 |
gtristan | it's only once out of all stage3 chunks that it could randomly stage fhs-dirs *after* | 11:42 |
gtristan | paulsherwood, nope | 11:43 |
gtristan | well, I wonder if stage2 needs any fixing | 11:43 |
gtristan | it might | 11:43 |
paulsherwood | my build agrees with you ... failed | 11:43 |
gtristan | what I am trying is, only add fhs-dirs as a dependency of linux-api-headers | 11:44 |
gtristan | (not stage1 or stage2, only in the third stage) | 11:44 |
gtristan | stage2-gcc and ticking... will be another 20min I guess before I know | 11:49 |
gtristan | I think there may still be a bug | 12:04 |
gtristan | building in stage 3 and I get some messages I wouldnt expect: | 12:04 |
gtristan | 3 17-04-28 00:01:03 [1/57/72] [UTILS] WARNING: Ignoring symlink "/store/BASEROCK/build/tmp/tmpiVikBB/lib" which purges non-empty directory | 12:04 |
gtristan | Although, it _only_ happens with /lib | 12:05 |
* gtristan sees build-essential stage3 fly by at lightning speed with instances: 4 | 12:05 | |
gtristan | nice | 12:05 |
gtristan | Ok... so which chunks are known to fail ? | 12:14 |
* gtristan is now building core.morph chunks | 12:14 | |
* gtristan did get more suspicious symlink warnings about /sbin and the like, though | 12:15 | |
gtristan | so it's a bit worrying, not sure if this fixed it | 12:15 |
gtristan | oh but, now that I'm in core, they are not happening anymore | 12:16 |
* gtristan is building file, cmake, libexpat... | 12:17 | |
gtristan | and gettext-tarball, still no errors | 12:17 |
gtristan | There you go: https://gitlab.com/baserock/definitions/merge_requests/35 | 12:20 |
gtristan | On a silver platter | 12:20 |
gtristan | even more shiny one than the platter I handed over yesterday, with MR and all :) | 12:20 |
ironfoot | shiny | 12:21 |
gtristan | usually breaks in core.morph right ? | 12:22 |
* gtristan is still building core.morph with no problem, and I expect the CI will do it too | 12:22 | |
gtristan | nope | 12:22 |
gtristan | the CI only did 'validate-all-definitions' and called it a day | 12:23 |
ironfoot | heh | 12:23 |
ironfoot | errors reported by paulsherwood were from flac | 12:23 |
gtristan | core completed | 12:24 |
* gtristan launches foundation | 12:24 | |
ironfoot | also linux-x86-64-generic failed for him | 12:24 |
gtristan | yeah, that certainly fixed it | 12:24 |
gtristan | no more symlink warnings at all | 12:24 |
gtristan | just some overlapping paths | 12:24 |
ironfoot | multiple instances? | 12:25 |
gtristan | 4 | 12:25 |
ironfoot | golden platter | 12:25 |
* gtristan has diff, sed and tar currently building | 12:25 | |
gtristan | and even there, have processing to spare | 12:26 |
gtristan | even 4 instances does not use enough of my resources :-/ | 12:26 |
gtristan | well, I guess there is a lot of I/O, I need faster SSD ! | 12:27 |
gtristan | heh | 12:27 |
gtristan | ok that's all for today | 12:27 |
gtristan | Seeee ya ! | 12:27 |
ironfoot | thanks gtristan!! | 12:27 |
* paulsherwood fails again, with http://paste.baserock.org/ugowesaduh | 12:27 | |
paulsherwood | make: /bin/sh: Command not found | 12:28 |
ironfoot | paulsherwood: this is the fix that is working for gtristan - https://gitlab.com/baserock/definitions/commit/913944e4c8730d6454751b94f98ef7c4ff356784 | 12:29 |
bjdooks | wi/win 15 | 12:29 |
ironfoot | paulsherwood: so what you did, but without removing stage2-fhs-dirs dep | 12:29 |
*** gtristan has quit IRC | 12:31 | |
paulsherwood | ironfoot: tvm, trying now | 12:42 |
ironfoot | paulsherwood: please, if that doesn't work, note it here: https://gitlab.com/baserock/definitions/merge_requests/35 | 12:43 |
paulsherwood | ack | 12:43 |
*** ssam2 has joined #baserock | 14:02 | |
*** ChanServ sets mode: +v ssam2 | 14:02 | |
jjardon | paulsherwood: mmm, still not able to reproduce with 4 instances: https://gitlab.com/baserock/definitions/builds/15242422 in what component it normally fails? | 14:05 |
paulsherwood | jjardon: i'm tempted to say, let's not worry about it... | 14:05 |
paulsherwood | my build with the fhs-dirs commit seems ot be proceeding fine | 14:05 |
paulsherwood | well, everything built except the system itself... http://paste.baserock.org/usenurusor | 15:31 |
paulsherwood | but i notice that ybd 4 instances *took longer* than buildstream (147 minutes vs 140 minutes) | 15:33 |
paulsherwood | sorry, 167 vs 160 | 15:37 |
paulsherwood | however it may be that this is not apples vs apples... maybe bst hasn't built completely from scratch? | 15:38 |
*** toscalix has quit IRC | 15:49 | |
*** paulw has joined #baserock | 16:09 | |
*** jonathanmaw has quit IRC | 16:40 | |
*** ssam2 has quit IRC | 17:02 | |
*** jude is now known as Guest14844 | 17:29 | |
*** persia has quit IRC | 17:30 | |
jjardon | paulsherwood: reproduced with several instances: https://gitlab.com/baserock/definitions/builds/15242422 | 17:58 |
*** CTtpollard has quit IRC | 18:42 | |
*** gtristan has joined #baserock | 19:01 | |
*** rdale has quit IRC | 21:44 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!