| *** gtristan has quit IRC | 02:10 | |
| *** edcragg has quit IRC | 02:17 | |
| *** gtristan has joined #baserock | 02:45 | |
| *** radiofree has quit IRC | 04:45 | |
| *** gtristan has quit IRC | 07:06 | |
| *** gtristan has joined #baserock | 07:53 | |
| pedroalvarez | I will try that | 08:02 |
|---|---|---|
| pedroalvarez | though, they are not merged right? | 08:02 |
| *** radiofree has joined #baserock | 08:03 | |
| gtristan | Any idea why this line: https://github.com/CodethinkLabs/sandboxlib/blob/master/sandboxlib/chroot.py#L234 should cause: | 08:05 |
| gtristan | LookupError: unknown encoding: string-escape | 08:05 |
| gtristan | ? | 08:05 |
| gtristan | it would seem someone is trying to decode the stderr/stdout coming from a subprocess through a pipe, instead of just printing it raw, but I'm not seeing where | 08:06 |
| *** ssam2 has joined #baserock | 08:26 | |
| *** ChanServ sets mode: +v ssam2 | 08:26 | |
| *** toscalix has joined #baserock | 08:31 | |
| *** ssam2 has quit IRC | 08:33 | |
| *** ssam2 has joined #baserock | 08:33 | |
| *** ChanServ sets mode: +v ssam2 | 08:33 | |
| paulsherwood | ssam2: ^^ | 08:43 |
| *** jonathanmaw has joined #baserock | 08:45 | |
| paulsherwood | gtristan: so i'm guessing your issue is an uncaught exception? | 08:47 |
| *** bruce_ has joined #baserock | 08:48 | |
| gtristan | paulsherwood, not really... that helped btw, catching the exceptions help | 08:49 |
| paulsherwood | cool | 08:49 |
| paulsherwood | ideally ybd shouldn't eat them anyway... but the retry logic is relying on exceptions. it needs a re-write | 08:50 |
| gtristan | my issue is the chroot environment I'm trying to setup doesnt work, and I have no way to tell what went wrong if I reach it through ybd | 08:50 |
| paulsherwood | ack, so we still need the interactive option | 08:51 |
| gtristan | so, right now I'm trying to do the chroot entirely ybdless, I have a sort of hacky branch which tries to setup the environment 'just right', but I'll try to get it right first without that | 08:51 |
| gtristan | I'm not sure the interactive option is feasible for sandboxlib itself, it requires knowledge of the setup | 08:51 |
| gtristan | i.e. you have to know where the shell is installed | 08:51 |
| paulsherwood | not if we could put the shell command in definitions? | 08:52 |
| gtristan | right now, chroot /sandbox /path/to/sh... reports "No such file or directory", even though I know I have the mounts setup, so that is odd | 08:52 |
| gtristan | putting the shell command in definitions would only technically let you run the shell once you get to the point where the shell is built, i.e. you are running the shell in the context of a package which already depends on the shell being there | 08:53 |
| paulsherwood | true | 08:54 |
| paulsherwood | iirc richard_maw calls this the 'crowbar inside the box problem' | 08:54 |
| gtristan | what I am trying on the other hand... is to set it up so that the base aboriginal system is fully mounted under '/base' in the given sandbox, and setting up environment variables to get the host tools to run | 08:55 |
| paulsherwood | good luck -) | 08:56 |
| gtristan | it should work | 08:56 |
| gtristan | then you get a '/' populated only with artifacts, and pull some extra goodies out of '/base'... | 08:57 |
| *** jonathanmaw has quit IRC | 08:59 | |
| *** jonathanmaw has joined #baserock | 08:59 | |
| tiagogomes__ | gtristan if there isn't yet a shell in the staging area, we are talking about chunks in build essential, and those don't use a chroot to be built as they need host tools | 09:00 |
| *** jonathanmaw_ has joined #baserock | 09:00 | |
| paulsherwood | good point, tiagogomes__ :) | 09:01 |
| gtristan | tiagogomes__, yeah, but I'm trying to ditch that part at least for this exercise | 09:01 |
| gtristan | maybe I should build those first, but it seems pointless, they have to be built anyway on the image, all the way up to python and git at least | 09:02 |
| gtristan | well, maybe the image doesnt need git technically | 09:02 |
| gtristan | depending on how you slice it, you could slave the image to ybd on the outside, and have ybd prepare the checkouts and stage the artifacts outside of the build VM | 09:03 |
| *** jonathanmaw has quit IRC | 09:04 | |
| *** rdale has joined #baserock | 09:04 | |
| *** bashrc_ has joined #baserock | 09:06 | |
| *** bashrc_ has quit IRC | 09:10 | |
| *** bashrc_ has joined #baserock | 09:10 | |
| *** CTtpollard has quit IRC | 09:10 | |
| tiagogomes__ | Ansible 2.0 was released yesterday. | 09:15 |
| *** CTtpollard has joined #baserock | 09:16 | |
| *** bashrc__ has joined #baserock | 09:17 | |
| *** bashrc_ has quit IRC | 09:18 | |
| *** bashrc__ has quit IRC | 09:18 | |
| *** bashrc_ has joined #baserock | 09:18 | |
| ssam2 | hooray! much nicer tools for working with OpenStack in Ansible 2.0 | 09:18 |
| *** jonathanmaw_ is now known as jonathanmaw | 09:32 | |
| gtristan | ah, progress... the shell is at least working :D | 09:46 |
| paulsherwood | w00t! :) | 09:47 |
| *** gtristan has quit IRC | 09:52 | |
| *** gtristan has joined #baserock | 10:14 | |
| *** edcragg has joined #baserock | 10:16 | |
| *** Lachlan1975 has joined #baserock | 10:23 | |
| pedroalvarez | ssam2: finally released? yay! | 10:24 |
| *** jonathanmaw has quit IRC | 10:39 | |
| *** jonathanmaw has joined #baserock | 10:40 | |
| *** gtristan has quit IRC | 11:09 | |
| *** jonathanmaw has quit IRC | 11:14 | |
| *** jonathanmaw has joined #baserock | 11:14 | |
| *** jonathanmaw_ has joined #baserock | 11:14 | |
| *** jonathanmaw has quit IRC | 11:18 | |
| *** gtristan has joined #baserock | 11:20 | |
| *** jonathanmaw_ is now known as jonathanmaw | 11:25 | |
| paulsherwood | rdale: i see elsewhere you now understand how ybd assembly works :) | 11:28 |
| rdale | i like to think i do at least | 11:28 |
| paulsherwood | unfortunately i think some stratum-specific and system-specific logic has crept in. ideally things should be generic | 11:29 |
| paulsherwood | in my imaginary world, component could have component-specific processing, whether component is chunk, stratum, system, cluster | 11:30 |
| rdale | yes, in my stand up notes i made a point about nowster's patch only special casing build-depends for a 'system' when i think it should be generalised | 11:30 |
| rdale | yes, all of those things a part of the same recursive call tree to do a build afaik | 11:30 |
| paulsherwood | i had a syntax for this, but it will require migrating definitions and i wanted to hold off on that until ybd is functionally sufficient, deterministic and bulletproof :) | 11:31 |
| rdale | i agree with 'contents' being a better name for a list of sub components | 11:31 |
| rdale | hmm | 11:31 |
| paulsherwood | rdale: if you can fix the splitting stuff, i believe that would allow us to tick the functionally sufficient box | 11:32 |
| rdale | yes, i think i can but you need to get the overall picture before it seems 'simple' which has taken me a few days and it still doesn't quite seem 'simple' yet | 11:33 |
| paulsherwood | i agree... this is not simple | 11:34 |
| rdale | also to verify the you've done the right thing is quite hard - it could be tests, or it could be a better visualation of what is going on | 11:34 |
| paulsherwood | ack | 11:36 |
| *** CTtpollard has quit IRC | 11:39 | |
| *** CTtpollard has joined #baserock | 11:39 | |
| rdale | i had to wait some time before the 'light bulb' moment and it happened yesterday, and now i wait for the 'hacking frenzy' moment | 11:39 |
| paulsherwood | lol | 11:42 |
| paulsherwood | rdale: to verify you've done the right thing, can't you just run against something in definitions? anything from stage1-binutils to ci.morph should work | 11:45 |
| paulsherwood | i agree that some tests would be beneficial, though | 11:46 |
| paulsherwood | (and a bit more documentation) | 11:46 |
| rdale | i'm thinking of 'fake sandbox' tests where a set of files come in .build, and a set of files come out in .inst without really building anything | 11:50 |
| paulsherwood | ah yes... that would be useful | 11:51 |
| *** jonathanmaw has quit IRC | 11:51 | |
| *** jonathanmaw has joined #baserock | 11:53 | |
| radiofree | hmm.. any reason why ybd would stop on the deploy cluster stage after checking cache keys? | 13:21 |
| radiofree | i don't get any error | 13:22 |
| radiofree | (and it worked yesterday) | 13:22 |
| radiofree | nope never mind... the architecture is *not* armv7lhfr..... | 13:23 |
| *** ssam2 has quit IRC | 13:53 | |
| *** ssam2 has joined #baserock | 13:59 | |
| *** ChanServ sets mode: +v ssam2 | 13:59 | |
| pedroalvarez | erroring in that situation might be wise :) | 14:15 |
| *** tiagogomes has joined #baserock | 15:06 | |
| *** tiagogomes__ has quit IRC | 15:06 | |
| * paulsherwood wonders if rdale is frenzied yet | 16:15 | |
| rdale | no, not quite - i'm still thinking it through. i written a couple of functions to dump the definitions after they've been loaded, which is useful | 16:17 |
| paulsherwood | ack | 16:18 |
| rdale | http://paste.baserock.org/udokehobit | 16:19 |
| paulsherwood | cool | 16:20 |
| rdale | i don't like file paths in the definitions, and i agree with turning them into names | 16:22 |
| paulsherwood | i went down that road initially, but it breaks because definitions has always had non-unique names | 16:23 |
| rdale | so you don't use the file paths converted to names? | 16:24 |
| paulsherwood | oh, yes, ybd does. it's keyed on that | 16:24 |
| rdale | right, that was what i was agreeing with then | 16:24 |
| paulsherwood | ack | 16:25 |
| paulsherwood | explanation is in _fix_keys... " Some definitions have a 'morph' field which is a relative path. Others | 16:25 |
| paulsherwood | only have a 'name' field, which has no directory part. A few do not | 16:25 |
| paulsherwood | have a 'name' | 16:25 |
| paulsherwood | This sets our key to be 'path', and fixes any missed 'name' to be | 16:25 |
| paulsherwood | the same as 'path' but replacing '/' by '-' | 16:25 |
| paulsherwood | " | 16:25 |
| rdale | right, having file paths makes it hard to serialize into another format | 16:25 |
| rdale | there seem to be two conditions to me: 1. artifact is not built yet, in which case use build-depends, 2. artifact is built, ignore build-depends and apply splitting rules | 16:27 |
| rdale | as far as i can see if you apply those rules consistently at every level in heirarchy of components, it should be correct | 16:29 |
| paulsherwood | rdale: but iiuc the only time we need to split is deploy time, ie this is processing on a built artifact? | 16:29 |
| rdale | i think the file system in the artifact at the top level should be correct before deploy time | 16:31 |
| *** toscalix has quit IRC | 16:31 | |
| rdale | ie the splitting rules and build-depends rules should have all be applied according to my 2 cases | 16:31 |
| rdale | otherwise you need to recurse through the whole thing all over again at deploy time, which seems unecessary to me | 16:36 |
| paulsherwood | i think it's not unnecessary, but i may be wrong | 16:37 |
| paulsherwood | i'd prefer the spltting to be done at system creation time or artifact deploy time, not at build time | 16:38 |
| rdale | yes, i'm saying it shouldn't be done at build time, only the generation of the yaml in the .meta files with split file lists as per nowster's patch | 16:39 |
| paulsherwood | ok, i think i should shut up and let you hack in a frenzy :) | 16:40 |
| tiagogomes | I really prefer using file paths | 16:40 |
| tiagogomes | But that's an old argument | 16:41 |
| rdale | yes | 16:41 |
| paulsherwood | tiagogomes: in effect ybd is using filepaths... but converting '/' to '-' because it gets used in the cache artifact name | 16:42 |
| tiagogomes | paulsherwood, why to you need the converted filepath in the artifact name? | 16:43 |
| pedroalvarez | if they are names, then the tool has to load them all before starting | 16:45 |
| paulsherwood | tiagogomes: because humans sometimes look at artifact caches | 16:45 |
| paulsherwood | morph folks and i disagreed about this - morph sticks the name at the end, ybd at the front. i personally find ybd's naming standard easier to grok/debug | 16:47 |
| pedroalvarez | but even with the name at the front you still need to know the cache key | 16:48 |
| tiagogomes | Probably putting the name on the front would be better. But I don't know why still want the artifact file path there. It seems wrong to me that an artifact depends on the location of its source in definitions | 16:49 |
| rdale | isn't that what is wrong with using file paths in the first place? | 16:50 |
| tiagogomes | Here we go again... | 16:52 |
| paulsherwood | tiagogomes: because some definitions don't *have* names, for example. | 16:52 |
| paulsherwood | but yes, an old discussion | 16:52 |
| *** CTtpollard has quit IRC | 17:10 | |
| *** jonathanmaw has quit IRC | 17:21 | |
| radiofree | oooh morphs progress bars are lovely | 17:23 |
| radiofree | partitioning support worked for jetson (after a few attempts), will test it didn't break x86 and submit | 17:24 |
| richard_maw | radiofree: you can thank ripsum (whatever he calls himself now) for that | 17:24 |
| rjek | richard_maw: I think he calls himself Richard. | 17:24 |
| *** ssam2 has quit IRC | 17:41 | |
| *** bashrc_ has quit IRC | 18:03 | |
| *** jjardon has quit IRC | 18:08 | |
| *** lachlanmackenzie has quit IRC | 18:08 | |
| *** jjardon has joined #baserock | 18:23 | |
| *** lachlanmackenzie has joined #baserock | 18:27 | |
| *** bruce_ has quit IRC | 18:29 | |
| *** rdale has quit IRC | 18:33 | |
| *** edcragg has quit IRC | 18:40 | |
| *** edcragg has joined #baserock | 19:10 | |
| *** Lachlan1975 has quit IRC | 19:48 | |
| *** edcragg has quit IRC | 19:48 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!