| *** edcragg has quit IRC | 00:11 | |
| *** rdale_ct_ has quit IRC | 03:33 | |
| *** gtristan has quit IRC | 06:17 | |
| *** gtristan has joined #baserock | 06:25 | |
| *** CTtpollard has joined #baserock | 07:56 | |
| *** locallycompact has joined #baserock | 08:04 | |
| *** ctbruce has joined #baserock | 08:27 | |
| *** bashrc has joined #baserock | 09:02 | |
| *** toscalix has joined #baserock | 09:22 | |
| *** tiagogomes has joined #baserock | 09:26 | |
| SotK | paulsherwood, pedroalvarez: IIRC the deployment stuff I wrote did support subsystems, but it was a long time ago and I haven't checked | 09:36 |
|---|---|---|
| paulsherwood | ack | 09:36 |
| pedroalvarez | if it's supported, then my guess is that the subsystem is deployed after the system is deployed | 09:43 |
| pedroalvarez | making the check of that extension fail | 09:44 |
| * pedroalvarez yawns | 09:44 | |
| pedroalvarez | good morning baserock! | 09:44 |
| *** jonathanmaw has joined #baserock | 09:45 | |
| *** franred has joined #baserock | 09:54 | |
| *** edcragg has joined #baserock | 10:01 | |
| *** franred has quit IRC | 10:05 | |
| *** ssam2 has joined #baserock | 10:07 | |
| *** ChanServ sets mode: +v ssam2 | 10:07 | |
| *** franred has joined #baserock | 10:21 | |
| *** jonathanmaw_ has joined #baserock | 11:10 | |
| *** jonathanmaw has quit IRC | 11:13 | |
| *** franred has quit IRC | 11:14 | |
| *** gtristan has quit IRC | 11:16 | |
| *** jonathanmaw_ has quit IRC | 11:24 | |
| *** jonathanmaw has joined #baserock | 11:24 | |
| *** franred has joined #baserock | 11:26 | |
| *** ctbruce has quit IRC | 11:49 | |
| *** gtristan has joined #baserock | 12:00 | |
| jjardon | benbrown_: Hi, about https://gerrit.baserock.org/#/c/1990/; what the reason to add that stratum the to the build- and devel- systems? | 12:10 |
| pedroalvarez | jjardon: it's a ybd dependency | 12:11 |
| benbrown_ | jjardon: primarly due to ybd depending on it | 12:11 |
| benbrown_ | ^ | 12:11 |
| jjardon | is ybd in the build or devel systems? | 12:12 |
| jjardon | or do you plan to add it? | 12:12 |
| pedroalvarez | that's actually a good point, although I take they are planning using it from git | 12:13 |
| benbrown_ | I have no current plans to add ybd to Baserock, if someone else feels like that should be done then they can go ahead and do that. | 12:13 |
| benbrown_ | I just found it surprising that I couldn't clone ybd into the build image from wiki.b.o and run it. | 12:14 |
| jjardon | benbrown_: sure, can you put the reason in the commit message? I will merge after that | 12:15 |
| benbrown_ | jjardon: will do | 12:15 |
| *** N-a-N has quit IRC | 12:16 | |
| benbrown_ | jjardon: done | 12:18 |
| jjardon | benbrown_: merged, thanks! | 12:19 |
| benbrown_ | jjardon: Thanks! | 12:19 |
| benbrown_ | And thanks for the reviews all! ( ssam2 pedroalvarez franred ) | 12:20 |
| pedroalvarez | keep baserocking! :D | 12:20 |
| jjardon | pedroalvarez: Im curious, how did you detect https://gerrit.baserock.org/#/c/1992/ ? Ive never had a build problem with libical | 12:21 |
| pedroalvarez | jjardon: I'm kind of building every commit of definitions for 3 architectures and one of them in 2 times | 12:22 |
| pedroalvarez | (all the mason instances we maintain :) | 12:23 |
| pedroalvarez | let me find the log | 12:23 |
| jjardon | pedroalvarez: don't worry, I trust you :) | 12:24 |
| pedroalvarez | jjardon: here https://mason-x86-64.baserock.org/log/78e75e303a8d599907563f54f17bd10cad073aeb--2016-03-12%2016:46:54.log | 12:24 |
| pedroalvarez | warning, huge log. Libical builds twice (because a distbuild bug) one of them it succeeds, and the other fails | 12:25 |
| pedroalvarez | s/it// | 12:25 |
| pedroalvarez | Everytime I see red in Mason, I try to figure out why | 12:26 |
| pedroalvarez | I'm also trying to fix wayland-ivi-extension race condition, already contacted upstream | 12:26 |
| pedroalvarez | although if anybody fancies taking a look at their CMake, I think it's small enough to be easy to fix | 12:27 |
| * CTtpollard would be happy if that got fixed upstream | 12:31 | |
| pedroalvarez | jjardon: heh, I see now the upgrade to libical 2.0.0 :) I didn't have time to test the upgrade to fix the problem this way | 12:33 |
| jjardon | pedroalvarez: :) | 12:34 |
| pedroalvarez | jjardon: from commit log history "libical 1.0.1 is required to build gnome-calendar" | 12:36 |
| jjardon | pedroalvarez: thats the minimum version yes | 12:37 |
| pedroalvarez | cool, just double checking | 12:37 |
| jjardon | pedroalvarez: I have gnome calendar with libical 2 instaled here | 12:37 |
| pedroalvarez | reviewed, (note added, just in case :P) | 12:38 |
| jjardon | pedroalvarez: sure, thanks! | 12:38 |
| jjardon | is there a way to use chunk to build and then completely remove it from the system? Im thinking on busybox here | 12:43 |
| pedroalvarez | yes | 12:44 |
| pedroalvarez | but involves splitting rules, so I'm not going to be able to give you useful input :( | 12:45 |
| paulsherwood | jjardon: in ybd, it should be possible to have it as a build-depend only | 12:45 |
| paulsherwood | (i haven't tried that though...) | 12:45 |
| pedroalvarez | warning: busybox is in build-essentials | 12:46 |
| paulsherwood | build-essential would need to change ... | 12:46 |
| paulsherwood | eg create a new stratum for-build-only, make that a build depend of systems, not in contents | 12:46 |
| pedroalvarez | which also has "runtime-essentials" :) | 12:46 |
| paulsherwood | :) | 12:47 |
| pedroalvarez | it should be possible to do this also with artifact-splitting | 12:49 |
| paulsherwood | yup | 12:49 |
| * pedroalvarez runs from build-essential discussions | 12:50 | |
| gtristan | systemd takes soooo loooong to compile :'( | 12:51 |
| paulsherwood | really? | 12:51 |
| paulsherwood | < 5 mins on most of the things i use | 12:53 |
| gtristan | very long... | 12:55 |
| gtristan | and its distributing over distccd, just verified | 12:55 |
| pedroalvarez | > 20 minutes in the things I use | 12:56 |
| paulsherwood | ci.scaleway.armv7lhf.log:15-09-06 02:47:58 [84/698/698] [systemd] Elapsed time for build of systemd.aa4aabb8e707287a0324aff9c09b5374f583b4a47d32bca89f5ae508f7df6f42 00:41:45 | 12:56 |
| gtristan | yeah, 41min looks probably right ... I think bandwidth is the main issue with this setup though | 12:57 |
| paulsherwood | ci.15.44.log:3 15-10-28 00:42:05 [23/792/792] [systemd] Elapsed time for build of systemd.c6e3e772136afd70d070cefaa349a64150ed0d2d8c582841c08d4d88cc1e24dc 00:01:57 | 12:58 |
| paulsherwood | it does seem to vary widely though | 12:58 |
| gtristan | for some reason I'm seeing the host 3 files ahead of what distccd is compiling | 12:58 |
| paulsherwood | do you have a new video ? :) | 12:58 |
| gtristan | well, armv7lhf is gonna be slower isnt it ? | 12:58 |
| gtristan | not worth a new video, have to run a recompile everything again | 12:59 |
| gtristan | fwiw, it took ~16hrs to get up to the beginnings of foundation last night... | 13:00 |
| gtristan | but I havent started optimizing yet, really need to get the virtio networking | 13:00 |
| gtristan | even though the bottleneck is *mostly* configure, it's not really for larger code bases | 13:00 |
| gtristan | gcc & glibc for instance take hours, and they could be improved greatly with a faster network | 13:01 |
| * gtristan discovered interesting oddities with gcc today | 13:01 | |
| gtristan | fixed a couple things, first... ccwrap.c in aboriginal needs to recognize the -pthread option... | 13:05 |
| gtristan | -pthread implies -lpthread, but does not when -nostdlib is there | 13:05 |
| gtristan | it also implies preprocessor frobnication | 13:05 |
| gtristan | which happens to be -D_REENTRANT, but we forward -pthread along and let gcc decide that part, while forcing the extra -lpthread in the case -pthread was asked for | 13:06 |
| gtristan | but also I noticed that gcc -dM -E - < /dev/null... behaves _differently_ when -nostdinc is passed | 13:06 |
| gtristan | which is gross | 13:07 |
| gtristan | basically... gcc loves to know what libc it's compiling for, and hardcodes stuff in itself for the libc it's compiling for (if a libc is present) | 13:07 |
| gtristan | so it has these things in gcc/config/... if an eccentric corner case libc happens to be there that it knows about... like glibc for instance... then it has this function which makes it include "stdc-predefs.h" | 13:08 |
| gtristan | which is a file that comes with glibc, that gcc presumes to know itself that it should include | 13:09 |
| gtristan | yuck | 13:09 |
| gtristan | so, I've added an extra env var to control ccwrap, CCWRAP_PREDEF... if it's set then we can tell the compiler to include that | 13:09 |
| gtristan | everything seems to work without the extra things from stdc-predef.h, but for correctness, I will rebuild everything | 13:10 |
| gtristan | oh and also the lto stuff... when you configure gcc with --disable-lto, it *still* produces the binutils wrappers gcc-nm, gcc-ar and gcc-ranlib, which wont run without an lto plugin | 13:11 |
| robtaylor | gtristan: an option to speed up configure is to use cache files https://www.gnu.org/software/autoconf/manual/autoconf-2.65/html_node/Cache-Files.html | 13:11 |
| gtristan | systemd enjoys the lto plugin, prefers the gcc-${prog} binutils wrapers, and breaks | 13:11 |
| *** bruce_ has joined #baserock | 13:12 | |
| robtaylor | ah yeah, lto hurts | 13:13 |
| * paulsherwood wishes he understood even 5% of what tristan is doing | 13:13 | |
| gtristan | robtaylor, thats interesting, havent gotten to optimizing yet but basically... that means that configure results from one package can be reused by configure scripts in another package ? | 13:13 |
| robtaylor | gtristan: one other potetnial next step is to use cross-linking | 13:13 |
| gtristan | robtaylor, I did some reading on that, and not sure it's possible or will be a significant optimization | 13:14 |
| robtaylor | gtristan: which you can do thanks to virtfs. | 13:14 |
| robtaylor | it'll be big for LTO | 13:14 |
| gtristan | oh well, with virtfs indeed, it would be interesting | 13:14 |
| gtristan | because then you dont jam up the network | 13:14 |
| gtristan | but still doesnt work with our virtfs model | 13:14 |
| gtristan | robtaylor, remember on the host, all files are -rw-------- user:user | 13:15 |
| gtristan | it's sneaky/dangerous to start man-handling them from the host side | 13:15 |
| gtristan | possibly doable though, if you have a qemu-kvm dedicated to cross-linking with it's own mount of the same share hehe | 13:16 |
| robtaylor | gtristan: yep, i was just about to say that ;) | 13:16 |
| gtristan | tbh, I have --disable-lto just because the cross compiler builds fail without it, and I ran out of weeks to try and get it to build with lto :) | 13:17 |
| gtristan | cross-linking is a very interesting thing all of a sudden... but it's not up there at the top of the list of bottlenecks, though | 13:18 |
| robtaylor | gtristan: yeah, lto can actually result in running out of memeory on 32bit builds.. | 13:18 |
| gtristan | first configure and virtio networking | 13:18 |
| * gtristan has 1GB swap for each sandbox vm, probably overkill but better to be safe | 13:19 | |
| robtaylor | gtristan: i hear firefox linking takes > 4G.. | 13:19 |
| gtristan | reallllly ? ouch | 13:20 |
| gtristan | webkit might take a lot too | 13:20 |
| robtaylor | yep | 13:20 |
| gtristan | well, we have 256MB of ram limit, so it will have to be swap once we get that high in the stack | 13:20 |
| robtaylor | ah, you can probably get linkinhg wins just by upping that | 13:21 |
| gtristan | (at least for armv5l, probably the armv7 / aarch64 have higher limits) | 13:21 |
| robtaylor | thats too small for most LTO linking | 13:21 |
| gtristan | I'm not doing LTO though | 13:21 |
| gtristan | anyway, all that aside, linking, really isnt the bottleneck, even if it takes 15min to link webkit it will not be high on the list | 13:22 |
| *** jonathanmaw has quit IRC | 13:24 | |
| robtaylor | gtristan: ack, on that front, any plans for instrumenting the builds? | 13:27 |
| gtristan | ummm, use an accordian or a harmonica ? ... sorry bad joke... how do you mean instrumenting them exactly ? | 13:30 |
| gtristan | measure performance ? | 13:30 |
| gtristan | not yet at this time, I think the top priority is to actually make a deployment | 13:30 |
| robtaylor | gtristan: *nod* | 13:31 |
| paulsherwood | ybd can output to riemann, i believe | 13:31 |
| gtristan | Them of course we already have ybd's build timers, that doesnt tell us where the bottlenecks are but is a general measure | 13:31 |
| pedroalvarez | I'd be interested on qtwebkit build times for armv7lhf :P | 13:31 |
| gtristan | *then | 13:31 |
| CTtpollard | pedroalvarez: are you feeling ok? | 13:32 |
| pedroalvarez | hah, why | 13:32 |
| robtaylor | yeah its the individual parts of a build - which parts dominate the time, is parallism being used effectivly, etc | 13:32 |
| gtristan | from what I'm seeing, the lack of virtio, due to my incompetence in actually calling qemu-system-arm -net nic,model=virtio -net user and it actually working... is a big bottleneck | 13:33 |
| gtristan | not for the lack of trying it, of course... | 13:33 |
| robtaylor | hmm, does it just fail silently? | 13:34 |
| gtristan | ifconfig eth0 10.0.2.15 fails with an ioctl no such device error | 13:34 |
| gtristan | that part of the setup is done in the aboriginal /init script | 13:35 |
| robtaylor | gtristan: it may be that virtio nic doesnt work with system-arm | 13:36 |
| gtristan | here: https://github.com/gtristan/aboriginal/blob/master/sources/root-filesystem/sbin/init.sh#L31 | 13:36 |
| robtaylor | gtristan: have you tried the qemu dev list? | 13:36 |
| gtristan | not yet, mostly poking around in #qemu irc so far | 13:36 |
| *** jonathanmaw has joined #baserock | 13:36 | |
| robtaylor | its notable that in https://gmplib.org/~tege/qemu.html virtio is used in the aarch64 lines, but not in the arm lines | 13:37 |
| gtristan | havent taken the time yet... but from googling about, I've not seen an example of virtio networking in conjunction with the simple -net user setup | 13:37 |
| jjardon | pedroalvarez: probably similar to webkitgtk: ~5h I think | 13:37 |
| * gtristan keeps a tab open on tege's page | 13:38 | |
| *** jonathanmaw has quit IRC | 13:43 | |
| *** jonathanmaw has joined #baserock | 13:43 | |
| gtristan | before I run off... I should also mention regarding bottlenecks | 13:47 |
| gtristan | landley mentioned that he was able to get a 20% performance gain in configure with statically linked busybox | 13:48 |
| gtristan | due to how qemu handles memory paging | 13:48 |
| gtristan | I think it's possible to also compile coreutils as one fat static binary with symlinks, not sure but I think I saw that | 13:49 |
| gtristan | of course you wouldnt get the shell & coreutils into the same blob | 13:49 |
| gtristan | but could help | 13:50 |
| robtaylor | interesting | 13:51 |
| robtaylor | gtristan: have a good evening! | 13:51 |
| gtristan | good afternoon :) | 13:53 |
| *** gtristan has quit IRC | 14:00 | |
| *** jonathanmaw_ has joined #baserock | 14:24 | |
| *** gtristan has joined #baserock | 14:25 | |
| *** bashrc has quit IRC | 14:25 | |
| *** edcragg has quit IRC | 14:26 | |
| *** jonathanmaw has quit IRC | 14:26 | |
| *** franred has quit IRC | 14:26 | |
| *** CTtpollard has quit IRC | 14:27 | |
| *** ssam2 has quit IRC | 14:27 | |
| *** CTtpollard has joined #baserock | 14:30 | |
| *** ssam2 has joined #baserock | 14:31 | |
| *** ChanServ sets mode: +v ssam2 | 14:31 | |
| *** franred has joined #baserock | 14:40 | |
| *** ssam2 has quit IRC | 14:40 | |
| *** bashrc has joined #baserock | 14:42 | |
| *** edcragg has joined #baserock | 14:42 | |
| *** ssam2 has joined #baserock | 14:47 | |
| *** ChanServ sets mode: +v ssam2 | 14:47 | |
| *** tiagogomes has quit IRC | 14:53 | |
| robtaylor | gtristan: something for tomorrow - have you checked you have the virtio nic kernel drivers built-in? (CONFIG_VIRTIO_NET i think) | 15:03 |
| robtaylor | gtristan: also try out -net user -device virtio-net-device,vlan=0 | 15:05 |
| robtaylor | gtristan: if you've got telnet running in there, you could also try -net user,hostfwd=tcp::2023-:23 -device virtio-net-device,vlan=0 | 15:06 |
| robtaylor | gtristan: which should allow you to telnet to localhost:2023 to connect to telnet in the guest | 15:06 |
| *** tiagogomes has joined #baserock | 15:11 | |
| *** CTtpollard has quit IRC | 16:44 | |
| *** edcragg has quit IRC | 17:16 | |
| *** edcragg has joined #baserock | 17:16 | |
| *** franred has quit IRC | 17:24 | |
| gtristan | robtaylor, thanks for the tips I'll try that out... yeah I'm sure I have VIRTIO_NET | 17:28 |
| gtristan | interestingly toybox has an experimental/unfinished telnet, so I might be able to have that too | 17:29 |
| paulsherwood | :) | 17:31 |
| paulsherwood | do you *never sleep* gtristan ? | 17:31 |
| *** franred has joined #baserock | 17:34 | |
| gtristan | heh, I am shifted to a strange schedule, I usually go to gym from 11pm - 1am, then eat afterwards, sleep by 5, start the day in the afternoon | 17:34 |
| gtristan | so yeah I sleep regularly... but would probably be a good idea to get more sunlight | 17:34 |
| *** franred has quit IRC | 17:59 | |
| *** fay_ has quit IRC | 18:00 | |
| *** bashrc has quit IRC | 18:03 | |
| *** ssam2 has quit IRC | 18:03 | |
| *** jonathanmaw_ has quit IRC | 18:04 | |
| *** radiofree has quit IRC | 18:16 | |
| *** radiofree has joined #baserock | 18:17 | |
| *** toscalix has quit IRC | 19:05 | |
| *** edcragg has quit IRC | 19:16 | |
| *** bruce_ has quit IRC | 19:51 | |
| *** locallycompact has quit IRC | 23:34 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!