| *** zoli__ has joined #baserock | 07:09 | |
| *** edcragg has joined #baserock | 07:13 | |
| *** a1exhughe5 has joined #baserock | 07:15 | |
| *** Albert has joined #baserock | 07:29 | |
| *** paulw has joined #baserock | 07:32 | |
| *** mariaderidder has joined #baserock | 07:55 | |
| *** jonathanmaw has joined #baserock | 08:01 | |
| *** bashrc has joined #baserock | 08:04 | |
| *** gary_perkins has joined #baserock | 08:10 | |
| pedroalvarez | <SotK> I'm seeing an error from Babel when I try to get a list of the running jobs from Zuul: http://paste.baserock.org/calukuluza | 08:23 |
|---|---|---|
| pedroalvarez | I hit the same error yesterday | 08:23 |
| pedroalvarez | SotK: do you have any plan? | 08:23 |
| SotK | I didn't formulate a plan, and I no longer have time to do so for a while I'm afraid :( | 08:24 |
| SotK | I was probably just going to commit the zip file or something | 08:25 |
| straycat | if self.app.settings['upgrade']: | 08:27 |
| straycat | raise cliapp.AppException( | 08:27 |
| straycat | 'Running `morph upgrade --upgrade` does not make sense.') | 08:27 |
| * straycat doesn't really see the harm in accepting upgrade --upgrade | 08:27 | |
| * SotK thinks we should get rid of one of the two paths, but I don't mind which | 08:28 | |
| straycat | yeah it's a ui thing that i don't really have an opinion on, personally i use deploy --upgrade | 08:29 |
| SotK | me too | 08:29 |
| SotK | because in my head I'm "deploying an upgrade" | 08:30 |
| pedroalvarez | the few times I try an upgrade I always do `morph deploy` | 08:56 |
| *** ssam2 has joined #baserock | 09:00 | |
| *** ChanServ sets mode: +v ssam2 | 09:00 | |
| straycat | ssam2, http://sprunge.us/UGOD - short paste of discussion you just missed, which you might have an opinion on | 09:06 |
| ssam2 | thanks for that | 09:07 |
| ssam2 | I don't really have a strong opinion, some people seem to prefer one and some the other | 09:08 |
| ssam2 | accepting `morph upgrade --upgrade` may be harmless, catching stuff like that can be helpful though because it may be a sign of a user mis-paste or something | 09:09 |
| * straycat isn't against keeping both deploy --upgrade and upgrade | 09:10 | |
| richard_maw | merry systemd release everyone | 09:11 |
| richard_maw | we can actually use a released version in our OpenStack now | 09:11 |
| Kinnison | yay | 09:11 |
| * richard_maw is just a bit annoyed that he couldn't get any patches to sort out the nspawn command-line parsing in in time | 09:12 | |
| * richard_maw is saddened that it can't handle file paths with : in for bind mounts or overlayfs mounts, and overlayfs mounts can't handle anything with a , in | 09:13 | |
| ssam2 | SotK: is how to use `morph deploy --partial` documented anywhere ? | 09:13 |
| SotK | ssam2: I thought I'd documented it in `morph help deploy`, but I may well be mistaken | 09:14 |
| SotK | I didn't, because I'm an idiot :) | 09:16 |
| SotK | I think then that the only documentation is the brief instructions in the commit message (https://gerrit.baserock.org/#/c/539/4) | 09:16 |
| ssam2 | ok | 09:17 |
| ssam2 | a section at http://wiki.baserock.org/guides/arm-howtos/ would be really useful! | 09:17 |
| SotK | sure thing | 09:18 |
| *** lachlanmackenzie has joined #baserock | 09:19 | |
| *** Krin has joined #baserock | 09:38 | |
| SotK | ssam2: http://wiki.baserock.org/guides/arm-howtos/#index4h2 | 09:46 |
| pedroalvarez | Ok, Babel needs Unicode CLDR to be built, and they suggest to run `python setup.py import_cldr` wich downloads a zip, uncompress it and then imports the files needed | 09:47 |
| pedroalvarez | I was going to just commit the zip file, but it looked ugly | 09:47 |
| pedroalvarez | I think I can make CLDR a submodule, so that I don't need to put a zip in the repo, would that be ok? | 09:48 |
| SotK | that sounds sensible to me | 09:48 |
| ssam2 | Sotk: thank you!! | 09:48 |
| franred | pedroalvarez, sounds ok to me | 09:51 |
| * richard_maw submitted https://gerrit.baserock.org/702 and https://gerrit.baserock.org/703 to deal with some interesting corner cases in subsystem deployment | 09:51 | |
| pedroalvarez | SotK, franred: Although the CLDR svn repo is going to be too big just to solve this case :/ | 09:59 |
| SotK | :( | 09:59 |
| pedroalvarez | 150M so far, and it's still lorrying 2005 | 10:02 |
| pedroalvarez | should I go and lorry the CLDR tarball? or should I just commit the files needed into babel? | 10:03 |
| pedroalvarez | or just lorry the babel tarball? | 10:03 |
| ssam2 | do you have any idea how often the tarball changes? | 10:04 |
| ssam2 | one of the main issues with tarballs is we have to manually update them | 10:04 |
| ssam2 | but if it changes rarely, that's no issue | 10:05 |
| pedroalvarez | every 3 months | 10:06 |
| ssam2 | ok. seems reasonable to have a tarball of it then | 10:07 |
| pedroalvarez | I'm starting to dislike my CLDR as submodule idea | 10:07 |
| pedroalvarez | :) | 10:07 |
| *** Krin has quit IRC | 10:12 | |
| *** Blacksnow has joined #baserock | 10:13 | |
| pedroalvarez | grrr.. lorry tarball import doesn't have 'zip' support | 10:40 |
| Kinnison | Correct | 10:42 |
| Kinnison | zips are not streamable | 10:42 |
| pedroalvarez | -pPrint to stdout | 10:43 |
| Kinnison | the converter is a stream converter from tarball to git-fast-import stream | 10:43 |
| * pedroalvarez sighs | 10:43 | |
| Kinnison | if you have a tool which converts a zip to a tar stream, we could add support | 10:43 |
| Kinnison | (without unpacking) | 10:43 |
| franred | pedroalvarez, ....svn.... :/ | 10:44 |
| pedroalvarez | 250M to get cldr data to fix babel build, doesn't sound too nice to me | 10:44 |
| pedroalvarez | commiting a zip file into babel repo neither | 10:44 |
| straycat | DavePage, rjek, others, I'm planning to lorry in a bunch of cpan modules from gitpan so we get their history, couldn't find an obvious upstream repo for most of them, does this seem reasonable? | 10:45 |
| pedroalvarez | tarball import of babel? | 10:45 |
| franred | ummm, we are importing a lot of tarballs lately when one of our aims are building from source... | 10:46 |
| franred | and not rely in other people builds, AFAIK | 10:46 |
| *** fay__ has quit IRC | 10:47 | |
| pedroalvarez | franred: then, what do you reckon is the best solution? | 10:47 |
| pedroalvarez | note that with a tarball import we still build from source | 10:47 |
| *** fay_ has joined #baserock | 10:48 | |
| DavePage | The solution is to get all upstreams to use publically-accessible git with proper tags ;) | 10:48 |
| straycat | that doesn't really seem to happen with cpan stuff, from what i've seen? | 10:48 |
| franred | pedroalvarez, I don't see the problem with the 250 M of svn repo, tbf | 10:49 |
| straycat | alright, lorrying from GitPan unless someone suggests something better | 10:50 |
| pedroalvarez | franred: the problem with tath solution is that I still need to tweak babel.git to have the cldr repo as a submodule | 10:51 |
| pedroalvarez | s/tath/that/ :) | 10:51 |
| Kinnison | pedroalvarez: Sadly, right now, there's not much of a better option | 10:51 |
| pedroalvarez | Kinnison: I take that you think that lorrying the svn repo, and tweaking babel to get cldr from there is a better option than commiting the files needed into babel | 10:52 |
| Kinnison | Unless cldr rarely moves, yes | 10:53 |
| pedroalvarez | cldr releases every 3 months | 10:54 |
| pedroalvarez | cldr version used in babel hasn't changed ever | 10:54 |
| pedroalvarez | lie, it changed 2 years ago | 10:55 |
| Kinnison | Hmm | 10:55 |
| Kinnison | how often does babel change? | 10:55 |
| pedroalvarez | latest release 22 months ago | 10:56 |
| pedroalvarez | latest change in master 12 months ago | 10:57 |
| Kinnison | hrm | 10:57 |
| Kinnison | That's on the boundary | 10:57 |
| Kinnison | I can't recommend the lorrying approach becauase it's not changing a lot, nor can I recommend the 'add the files' approach because it clearly does change | 10:57 |
| Kinnison | Go with your gut | 10:57 |
| Kinnison | :) | 10:57 |
| * Kinnison <- least useful helper today | 10:58 | |
| pedroalvarez | Kinnison: it was useful :) | 10:58 |
| * Kinnison shall have to try less hard | 10:58 | |
| *** bfletcher has left #baserock | 11:12 | |
| *** bfletcher has joined #baserock | 11:12 | |
| *** pacon has joined #baserock | 11:17 | |
| *** zoli___ has joined #baserock | 11:32 | |
| *** zoli__ has quit IRC | 11:32 | |
| pedroalvarez | Ok, i think this is the easiest approach: http://git.baserock.org/cgi-bin/cgit.cgi/delta/babel.git/commit/?h=baserock/1.3-50-g246996b&id=603e77ae0e43b6ecdb3f3a8ea7988f7e7c83e867 | 11:42 |
| ssam2 | seems reasonable | 11:55 |
| *** Blacksnow has quit IRC | 12:15 | |
| *** Blacksnow has joined #baserock | 12:19 | |
| jonathanmaw | is there any way to make `morph deploy` more verbose? It seems to be hanging for me. | 12:32 |
| SotK | jonathanmaw: Does --debug or --verbose help? | 12:32 |
| SotK | If it's hanging during an extension being run I don't think they will help though. | 12:33 |
| jonathanmaw | hrm, --debug hasn't helped much, not seeing anything new when it gets to 'Populating "orig" subvolume', which is where it hangs | 12:34 |
| SotK | that step can sometimes take a while, how long was it stuck for? | 12:35 |
| jonathanmaw | I left it running over lunch at one stage, though the target may have been too small tha ttime | 12:35 |
| jonathanmaw | deployment has been running for at least 12 minutes, with no signs of activity on the target | 12:46 |
| jonathanmaw | i.e. no sign of increased disk usage | 12:46 |
| SotK | what deployment type is it? | 12:46 |
| jonathanmaw | ssh-rsync upgrade | 12:46 |
| jonathanmaw | `ps -ef` indicates that it's in the middle of an rsync command-line | 12:53 |
| straycat | ssam2, good spot, sorry about that (ssh_runcmd) | 13:10 |
| franred | pedroalvarez, it is not ideal, but meh | 13:10 |
| franred | pedroalvarez, go ahead with it | 13:11 |
| pedroalvarez | franred: svn lorry is taking 1h and 30m already | 13:11 |
| pedroalvarez | 400M | 13:11 |
| franred | o.O no comments (and they are only xml files as far as I saw) | 13:12 |
| tiagogomes_ | pedroalvarez what are you snv'ing? Are you using trunk? | 13:12 |
| tiagogomes_ | s/snv/svn/ | 13:12 |
| * pedroalvarez is tempted to maintain some git mirrors of some projects | 13:13 | |
| pedroalvarez | tiagogomes_: unicode cldr, trunk, branches, and tags | 13:13 |
| pedroalvarez | tiagogomes_: note, I'm converting it to git, using lorry | 13:14 |
| tiagogomes_ | pedroalvarez have you tried to lorry only trunk and the branch/tag that you need? | 13:15 |
| pedroalvarez | tiagogomes_: I haven't, because when I think of lorrying svn repos, I think that we should lorry everything | 13:16 |
| tiagogomes_ | If they occupy 400Mb and still haven't finished, maybe that's not a good idea | 13:18 |
| *** pacon has quit IRC | 13:19 | |
| *** a1exhughe5 has quit IRC | 13:24 | |
| *** a1exhughe5 has joined #baserock | 13:29 | |
| *** zoli___ has quit IRC | 13:34 | |
| *** franred has quit IRC | 13:42 | |
| *** franred has joined #baserock | 13:57 | |
| straycat | ssam2, biff | 13:59 |
| *** zoli__ has joined #baserock | 13:59 | |
| *** mariaderidder has quit IRC | 14:02 | |
| *** a1exhughe5 has quit IRC | 14:04 | |
| radiofree | what happens when your patch has two +1's on gerrit? | 14:06 |
| richard_maw | it hsa two +1s on gerrit, not a lot else | 14:07 |
| richard_maw | the plan is for Zuul to then test and if that passes +2 and merge | 14:07 |
| richard_maw | currently the set of mergers need to review patches that have two +1s and decide whether to +2 and merge | 14:07 |
| radiofree | ah ok | 14:08 |
| edcragg | is it OK to use URLs for repositories used in definitions where not available on g.b.o, or are they supposed to all be lorried? | 14:09 |
| Kinnison | If it's for definitions aimed at g.b.o's baserock:definitions then we prefer everything be lorried | 14:09 |
| Kinnison | If it's for something else, there's no need to pre-lorry | 14:10 |
| edcragg | ok | 14:11 |
| edcragg | Kinnison: but aren't all definitions going to end up on baserock:definitions? | 14:12 |
| Kinnison | Not necessarily -- e.g. the baserock infra definitions don't | 14:13 |
| edcragg | ah, ok | 14:13 |
| *** mariaderidder has joined #baserock | 14:17 | |
| *** a1exhughe5 has joined #baserock | 14:18 | |
| straycat | radiofree, take it https://gerrit.baserock.org/#/c/706/ is tested? | 14:25 |
| radiofree | yep | 14:28 |
| straycat | ok | 14:28 |
| Zara | bit confused-- I made a system that was just 'build-essential-minimal' on x86 and on an armv5 chroot (cross bootstrap system on jetson). on x86, can deploy with a size of 16M (btrfs doesn't let me go smaller). on armv5, need at least 80M. | 14:43 |
| pedroalvarez | is this minimal system identical? | 14:44 |
| Zara | I'll pastebin, the names are different but I doubt that'd make a difference :P | 14:45 |
| Zara | http://paste.baserock.org/ekeyobidur vs http://paste.baserock.org/vokacagobe | 14:46 |
| Zara | so different arch, but otherwise seem identical at the system level | 14:46 |
| pedroalvarez | Zara: hmm no idea | 14:47 |
| pedroalvarez | you can take a look at the rootfs artifact of both and see what's inside | 14:47 |
| Zara | okay, how would I do that? (I also checked the build-essential strata; they look the same) | 14:52 |
| pedroalvarez | if you build the system, morph will tell you the where its rootfs artifact is | 14:55 |
| pedroalvarez | you can uncompress that, and look inside | 14:55 |
| pedroalvarez | (I don'k know a better way for getting the artifact name of the rootfs) | 14:56 |
| SotK | `morph list-artifacts . HEAD $system | grep *.system.*` in your definitions checkout | 14:56 |
| Zara | okay, I'll have a look around, thanks :) | 14:57 |
| SotK | list-artifacts may print the rootfs name last anyway actually, not sure though | 14:57 |
| *** Albert has quit IRC | 15:00 | |
| Zara | hehe, already I can see that one compressed rootfs is 71.0M, the other is 6.6M | 15:00 |
| straycat | ssam2, biff, again (reworks) | 15:07 |
| *** fay_ has quit IRC | 15:07 | |
| Zara | how do I uncompress the rootfs artifact? | 15:08 |
| *** Albert has joined #baserock | 15:08 | |
| SotK | Zara: `tar -C $uncompressed_location -xf $artifact_path` | 15:09 |
| Zara | ah, I was trying tar -xzvf without success | 15:09 |
| Zara | it told me 'invalid magic' which wasn't helpful | 15:09 |
| flatmush | "magic" is the identifier at the beginning of a file | 15:10 |
| flatmush | which means the tar file is either corrupt or not a tar file | 15:10 |
| DavePage | Or in this case, not a zipped file? | 15:10 |
| SotK | Zara: you don't need the z, I don't think we use gzip on them | 15:10 |
| DavePage | I think invalid magic means you need more of richard_maw's hat | 15:11 |
| richard_maw | DavePage: you say that like I only have 1 wizard hat | 15:11 |
| Zara | ah, tar -xf worked (I'd already cd'd to the directory I wanted it). Thanks for the explanations! | 15:12 |
| Zara | usr is the culprit! :0 will pastebin output of du -h because this might warrant further investigation | 15:18 |
| *** a1exhughe5 has quit IRC | 15:18 | |
| DavePage | richard_maw: Maybe you could lend one to Zara | 15:19 |
| Zara | x86: http://paste.baserock.org/abegoxobam armv5: http://paste.baserock.org/osaqusuwaz | 15:19 |
| pedroalvarez | she is doing pretty well without any hat :) | 15:20 |
| Zara | :D | 15:21 |
| pedroalvarez | Zara: I'd like to see what's inside /usr/bin and /usr/lib | 15:21 |
| pedroalvarez | (and their size) | 15:22 |
| pedroalvarez | `ls -alh /usr/bin` | 15:22 |
| Zara | okay, these are both off the bigger system since that seems to be the weird one: usr/bin: http://paste.baserock.org/lezonudawa and usr/lib: http://paste.baserock.org/sizefajeza | 15:26 |
| richard_maw | Zara: which two morphologies are you using? | 15:28 |
| richard_maw | because your usr/bin contains parts of gcc | 15:29 |
| Zara | richard_maw: if you mean which strata, it should just be build-essential, but I'm not sure which morphologies you mean | 15:31 |
| richard_maw | I mean the system morphologies, it's the minimal.*armv5l vs x86 right? | 15:31 |
| Zara | richard_maw: no, this is a customised system that should *only* build build-essential (so I don't expect the end product to work or anything) | 15:32 |
| richard_maw | well, for minimal, you also need to list `artifacts:\n-build-essential-minimal` in your system morphology | 15:33 |
| richard_maw | otherwise it includes gcc | 15:33 |
| Zara | 15:46 < Zara> http://paste.baserock.org/ekeyobidur vs | 15:33 |
| Zara | http://paste.baserock.org/vokacagobe | 15:33 |
| Zara | there they are :) | 15:33 |
| richard_maw | but you're doing that | 15:33 |
| richard_maw | hmm | 15:33 |
| Zara | yeah, I was wondering if this could be some cross-bootstrap weirdness which is making it ignore artifacts being specified, since the size of the bigger one looked like the size of the smaller one before I remembered to list artifacts. | 15:35 |
| *** Albert has quit IRC | 15:35 | |
| richard_maw | cross-bootstrap is not expected to produce a minimal system | 15:35 |
| richard_maw | ok, your libs are understandable if unfortunately large, but your bins includes stuff from binutils | 15:35 |
| richard_maw | I can only assume that it's cross-bootstrap not handling artifact splitting that's causing your result to contain binutils | 15:37 |
| *** petefoth_ has joined #baserock | 15:40 | |
| Zara | yeah, I'm building in a devel system that was originally created via cross-bootstrap so that sounds probable | 15:41 |
| *** petefoth has quit IRC | 15:41 | |
| *** petefoth_ is now known as petefoth | 15:41 | |
| paulsherwood | Exception Exception AttributeError: "'NoneType' object hasAttributeError no: " at'NtronibeTutype e''p oatbjh'ec" in t h<function _remove at 0x7f2997cec758> ignored | 15:52 |
| Zara | richard_maw: why would the libs be so big, ooi? on the x86 system those are also much smaller, so I'm guessing those are where the armv5 arch makes things bigger | 15:52 |
| paulsherwood | i assume that means i've recursed out of memory someohw? | 15:52 |
| rjek | paulsherwood: It looks like a threading race condition! | 15:52 |
| rjek | Or perhaps part of the error is in Klingon? | 15:53 |
| paulsherwood | :) | 15:53 |
| Zara | richard_maw: (output for x86: http://paste.baserock.org/sigilifula) | 15:54 |
| *** CTtpollard has quit IRC | 15:54 | |
| richard_maw | Zara: you can have bigger libs on arm because x86 has more support in the cpu for those operations | 15:56 |
| richard_maw | e.g. division | 15:56 |
| Zara | I see-- though they just seem so *much* bigger I'm suspicious (120K vs 15M) | 15:59 |
| *** jonathanmaw has quit IRC | 15:59 | |
| pedroalvarez | tiagogomes_: biff https://gerrit.baserock.org/#/c/707/1 | 16:00 |
| tiagogomes_ | pedroalvarez that happens when you copy from one with wrong indentation as well | 16:01 |
| pedroalvarez | :) yes, the same has happened to me when copying from others | 16:01 |
| pedroalvarez | wow, straycat fixed it, thanks! | 16:04 |
| straycat | :) | 16:09 |
| *** mariaderidder has quit IRC | 16:28 | |
| *** franred has quit IRC | 16:30 | |
| *** Blacksnow has quit IRC | 16:47 | |
| Zara | I don't know enough about what libs should be in here, but I'm wondering if there are some extra things here, too. will look into it some more on Tues | 16:57 |
| Zara | (biggest ones: http://paste.baserock.org/pabovanaba ) | 16:58 |
| Zara | some of these look suspicious to me. :P | 17:00 |
| *** bashrc has quit IRC | 17:00 | |
| *** tiagogomes_ has quit IRC | 17:23 | |
| *** ssam2 has quit IRC | 17:43 | |
| *** gary_perkins has quit IRC | 18:03 | |
| *** edcragg has quit IRC | 18:08 | |
| *** lachlanmackenzie has quit IRC | 18:26 | |
| *** pacon has joined #baserock | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!