*** zoli__ has quit IRC | 02:21 | |
*** zoli__ has joined #baserock | 02:21 | |
*** zoli__ has quit IRC | 04:13 | |
*** zoli__ has joined #baserock | 04:15 | |
*** zoli__ has quit IRC | 04:20 | |
*** petefoth has joined #baserock | 05:30 | |
*** petefoth has quit IRC | 05:42 | |
*** paulw has joined #baserock | 06:24 | |
*** mdunford has quit IRC | 06:57 | |
*** mdunford has joined #baserock | 07:15 | |
*** gary_perkins has quit IRC | 07:34 | |
*** gary_perkins has joined #baserock | 07:39 | |
*** mariaderidder has joined #baserock | 07:47 | |
*** bashrc has joined #baserock | 08:03 | |
*** mdunford has quit IRC | 08:13 | |
*** mdunford has joined #baserock | 08:18 | |
*** ssam2 has joined #baserock | 08:30 | |
*** ChanServ sets mode: +v ssam2 | 08:30 | |
*** bashrc has quit IRC | 08:49 | |
*** bashrc has joined #baserock | 08:51 | |
ssam2 | "NameError: name 'True' is not defined" | 08:52 |
---|---|---|
ssam2 | that can't be good | 08:52 |
ssam2 | ha! it's because I managed to set __builtins__ to None | 08:52 |
ssam2 | Python certainly is a dynamic language. | 08:52 |
paulsherwood | lol | 09:01 |
*** bashrc has quit IRC | 09:10 | |
*** mariaderidder has quit IRC | 09:12 | |
*** bashrc has joined #baserock | 09:12 | |
*** mdunford has quit IRC | 09:23 | |
*** mariaderidder has joined #baserock | 09:26 | |
*** mariaderidder has quit IRC | 09:29 | |
*** mariaderidder has joined #baserock | 09:29 | |
*** mdunford has joined #baserock | 09:38 | |
*** wschaller has joined #baserock | 10:17 | |
*** mdunford has quit IRC | 10:38 | |
paulsherwood | has anyone here tried deploying a baserock system to aws? | 10:48 |
pedroalvarez | i don't think so | 10:57 |
doffm | Don't we need PV-GRUB to make aws images work? | 10:57 |
doffm | I was under the impression we needed to add a modified grub bootloader. | 10:57 |
paulsherwood | erk. maybe i'll not go that way, then | 10:58 |
pedroalvarez | I remember someone (Kinnison?) telling me something like that, so you might be right | 10:58 |
*** mdunford has joined #baserock | 10:59 | |
doffm | http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/UserProvidedKernels.html | 10:59 |
ssam2 | i guess you could build a normal VM image, boot it, then build and install PVGRUB inside that | 11:00 |
ssam2 | as a first step to getting *something* in AWS | 11:01 |
ssam2 | but we kind of have extlinux hardcoded in the deployment logic, current, which is far from ideal | 11:01 |
pedroalvarez | hm.. although I believe there are some variables already in place to modify what bootloader you want to install | 11:02 |
pedroalvarez | althought there is only one choice atm | 11:02 |
*** petefoth has joined #baserock | 11:17 | |
*** wschaller has quit IRC | 11:22 | |
*** petefoth has quit IRC | 11:58 | |
*** petefoth has joined #baserock | 12:02 | |
*** wschaller has joined #baserock | 12:10 | |
paulsherwood | nowster: thanks for the splitting pr | 12:20 |
paulsherwood | nowster: one thing... why have perl default cmds changed? | 12:20 |
nowster | they haven't... they were missing continuation "\" characters | 12:22 |
nowster | originally there was a string concatenation, but this didn't get translated into the yaml form | 12:23 |
paulsherwood | ah | 12:23 |
nowster | I blame ssam2 :) | 12:23 |
paulsherwood | i think i found a couple of things in the defaults yaml too | 12:24 |
paulsherwood | nowster: http://paste.baserock.org/yovazoniyi | 12:24 |
paulsherwood | (running on clusters/ci.morph) | 12:24 |
nowster | Ah... is there a DEFAULTS file in your definitions now? | 12:26 |
paulsherwood | yup | 12:26 |
paulsherwood | ah, no | 12:27 |
paulsherwood | hold on | 12:27 |
nowster | ah... a fix was missed in rebasing. | 12:28 |
paulsherwood | pls send the fix :) | 12:29 |
nowster | already was doing | 12:29 |
paulsherwood | nowster: i'm assuming this changes meta format now? | 12:30 |
nowster | yes. | 12:30 |
nowster | Meta format is pure yaml | 12:30 |
nowster | It will fail to work correctly if you have existing cached assets | 12:31 |
paulsherwood | erk. fail to work *at all*? | 12:32 |
* paulsherwood has blown away artifacts, but other users might not be so tolerant | 12:32 | |
*** zoli__ has joined #baserock | 12:41 | |
nowster | it warns, IIRC, then doesn't split | 12:46 |
nowster | app.log(name, 'WARNING: problem loading metadata', metafile) | 12:46 |
paulsherwood | yup, saw that | 12:47 |
paulsherwood | ci.morph using 6 parallel instances of ybd on an aws machine (gits already available) 15-08-20 12:45:45 [303/661/661] [TOTAL] Elapsed time 01:50:51 | 12:48 |
*** zoli__ has quit IRC | 12:50 | |
ssam2 | nice! | 13:31 |
*** franred has joined #baserock | 13:31 | |
ssam2 | did you do that in a Baserock reference system or some other OS ? | 13:31 |
paulsherwood | it's on a standard AMI | 13:33 |
pedroalvarez | that reminds me: why didn't we push towards using baserock in docker? | 13:59 |
paulsherwood | i did, but no-one here seemed interested iirc | 14:00 |
paulsherwood | but now you mention it, maybe that would be a way forward on aws | 14:00 |
pedroalvarez | aha! here we go, you are the man behind baserock in hub.docker.com: https://hub.docker.com/u/baserock/ | 14:02 |
paulsherwood | yup | 14:02 |
pedroalvarez | I feel like I'm months late for this party, but I also think the party might not be over | 14:02 |
paulsherwood | agreed :) | 14:03 |
paulsherwood | i feel the same | 14:03 |
* paulsherwood notices that baserock has been pulled on docker a few times, even without him waving the flag | 14:03 | |
pedroalvarez | straycat: patches for lorry merged, if we update the ref in definitions we can upgrade g.b.o in few minutes | 14:26 |
straycat | pedroalvarez, that would be really cool thanks :) | 14:30 |
*** paulw has quit IRC | 14:34 | |
*** paulw has joined #baserock | 14:34 | |
paulsherwood | nowster: it seems to be building ok :) | 14:43 |
nowster | great! | 14:49 |
paulsherwood | nowster: have you compared any sizes vs morph results? are they the same? | 14:49 |
* paulsherwood vaguely remembers nowster saying something was different | 14:49 | |
nowster | the metadata will be different | 14:54 |
paulsherwood | but all the other contents the same? | 14:54 |
nowster | /etc/os-release wasn't made | 14:54 |
nowster | and for some reason morph missed a file! | 14:55 |
paulsherwood | what is /etc/os-release please? | 14:56 |
*** paulw has quit IRC | 15:03 | |
*** paulw has joined #baserock | 15:04 | |
*** mdunford has quit IRC | 15:14 | |
nowster | It's a file that morph makes. | 15:16 |
pedroalvarez | nowster: what file missed morph? | 15:16 |
nowster | -etc/os-release | 15:17 |
nowster | +etc/nsswitch.conf | 15:17 |
nowster | For some reason nsswitch.conf didn't make it to the morph tarball | 15:17 |
* pedroalvarez notices that nsswitch.conf is in a separate artifact 'glibc-nss' | 15:19 | |
nowster | ...which is included by build-essential-minimal | 15:24 |
jmacs | "build-essential-minimal"? | 15:27 |
paulsherwood | quite :) | 15:27 |
*** mdunford has joined #baserock | 15:28 | |
nowster | jmacs: an artifact created by build-essential | 15:29 |
* pedroalvarez confirms that nsswitch.conf is not present in the minimal system | 15:31 | |
nowster | It is if built by ybd! | 15:33 |
paulsherwood | :-) | 15:33 |
jmacs | The "products" section is new to me, but apparently it's been in there a long time | 15:37 |
paulsherwood | jmacs: i ignored it for ybd til recently, but for tiny systems we need to remove lots of stuff | 15:38 |
paulsherwood | nowster: what's the size of one of the typical openwrt systems? | 15:39 |
jmacs | That's fine, my only concern was that "essential-minimal" is a tautology | 15:39 |
paulsherwood | i think build-essential is a misnomer, myself | 15:40 |
pedroalvarez | well, the nsswitch.conf is in the right chunk artifact, but not in the stratum artifact :/ | 15:41 |
pedroalvarez | it is in build-essential-runtime instead | 15:42 |
paulsherwood | ybd's parallel instances are still tripping over each other occasionally :( http://sprunge.us/XTHG | 15:44 |
pedroalvarez | ok, I think I don't understand the syntax of stratum splitting | 15:46 |
paulsherwood | nowster: any idea what the gcc error might be? (bearing in mind that only one instance fails on it) | 15:51 |
paulsherwood | ([3/662/662] [stage1-gcc] Error:) | 15:52 |
pedroalvarez | oh well, I have to say that ybd and morph are right when building build-essential-minimal | 15:52 |
pedroalvarez | an that is the actual definition of build-essential what is wrong :) | 15:53 |
pedroalvarez | glibc-nss is being included in b-e-minimal **and** in b-e-runtime. This creates some conflicts in the definition, and depending on the build tool you will have different results | 15:54 |
paulsherwood | i think that the syntax needs to be simplified | 15:54 |
nowster | pedroalvarez: right... with morph one will claim over the other... with ybd, both can claim it? | 15:54 |
ssam2 | I'm impressed that nobody spotted until now that the syntax actually allows you to specify the same thing in two different places | 15:55 |
nowster | paulsherwood: You'd have to look in /src/artifacts/stage1-gcc.53687a18c4d5992c2ada2b6e3c95b1f07712315c32de33b36e94691ddaf40a1f.build-log.1 | 15:56 |
nowster | ah.. it's this: | 15:56 |
nowster | make[2]: x86_64-bootstrap-linux-gnu-ranlib: Command not found | 15:56 |
paulsherwood | nowster: the tail of that (200 lines) follows the error msg | 15:56 |
nowster | Looks like stage1-gcc doesn't have a build-depends on something | 15:57 |
paulsherwood | how could that happen for one, but not an other? | 15:57 |
nowster | (possibly binutils) | 15:57 |
nowster | paulsherwood: build order randomization | 15:57 |
nowster | morph implicitly builds in order of definitions | 15:58 |
paulsherwood | thing is i've never seen this on a single instance... only parallel ones | 15:58 |
paulsherwood | i'm not discounting your theory, just a bit skeptical | 15:58 |
nowster | hmm... gcc BUILDS ranlib | 15:59 |
nowster | that probably implies linker error in that case | 15:59 |
paulsherwood | would the full log help? | 16:00 |
nowster | probably not | 16:00 |
nowster | Hmm.... 0 15-08-20 14:07:04 [1/662/662] [stage1-binutils] Bah! I raced and rebuilt stage1-binutils.dac85c48b260aa710b7910ab871bf5b5cce1e27910bf090b4b60bf2dc35fbbbb | 16:03 |
paulsherwood | nowster: that's expected | 16:03 |
nowster | and it means? | 16:03 |
paulsherwood | it means that 6 instances start, all of them try to build stage1-binutils, only one of them gets to publish the artifact | 16:04 |
nowster | ugh | 16:04 |
paulsherwood | i think it's quite elegant | 16:05 |
*** jonathanmaw has quit IRC | 16:05 | |
nowster | do they get separate build trees? | 16:05 |
paulsherwood | yup | 16:06 |
paulsherwood | i see 61 instances of racing, in 662 jobs it's not too bad. room for optimisation i'm sure, but certainly this leads to a faster overall result than the same machine running the jobs serially | 16:07 |
paulsherwood | so i don't *think* the problem is that, but it might be | 16:07 |
nowster | so... this['sandbox'] is unique to each instance? | 16:08 |
nowster | (ie. one can't overwrite the entry in defs for another instance?) | 16:08 |
*** lmackenzie_2015 has joined #baserock | 16:17 | |
*** mariaderidder has quit IRC | 16:22 | |
*** paulw has quit IRC | 16:32 | |
*** franred has quit IRC | 16:39 | |
*** bashrc has quit IRC | 16:56 | |
pedroalvarez | Here there is a draft for a possible release this week: http://wiki.baserock.org/releases/baserock-15.34/ | 17:30 |
pedroalvarez | All comments are welcome | 17:30 |
*** ssam2 has quit IRC | 17:40 | |
*** wschaller has quit IRC | 18:02 | |
*** lmackenzie_2015 has quit IRC | 18:17 | |
SotK | pedroalvarez: looks fine to me at a glance, though I've not been keeping up with changes so don't know if anything is missing | 19:13 |
*** persia_ has quit IRC | 19:28 | |
*** radiofree has quit IRC | 21:17 | |
*** radiofree has joined #baserock | 21:19 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!