*** gtristan has joined #baserock | 05:01 | |
*** gtristan has quit IRC | 06:29 | |
*** gtristan has joined #baserock | 07:05 | |
*** ctbruce has joined #baserock | 07:34 | |
*** toscalix has joined #baserock | 07:49 | |
*** rdale has joined #baserock | 08:11 | |
pedroalvarez | SotK: nice1 | 08:14 |
---|---|---|
pedroalvarez | oneoneone | 08:14 |
pedroalvarez | I mean: nice! | 08:15 |
*** gtristan has quit IRC | 08:26 | |
*** jjardon_matrix has quit IRC | 08:54 | |
*** jjardon_matrix has joined #baserock | 09:07 | |
*** gtristan has joined #baserock | 09:12 | |
paulsherwood | merged | 09:17 |
paulsherwood | i guess we should have a wholesale conversion of lorries to yaml soon? | 09:17 |
SotK | \o/ thanks paulsherwood, franred | 09:17 |
* SotK would like that, I can send a patch which does it later if people want one? | 09:18 | |
paulsherwood | yes please... but how will we test it? would be a shame to bork gbo by accident | 09:19 |
pedroalvarez | there are quite a few, and some of them are pointing to deprecated repos | 09:19 |
paulsherwood | sorry, quite a few what? | 09:20 |
pedroalvarez | lorries in json | 09:20 |
* SotK will turn his vm into a trove and test it there | 09:20 | |
franred | SotK, given that you can use lorry to lorry locally, even if it is a huge task, could you create something that lorries them, one by one into a VM and mark them as succeed or failure? | 09:20 |
pedroalvarez | "they are" maybe worked better | 09:20 |
franred | SotK, yeah, same idea :) | 09:21 |
paulsherwood | pedroalvarez: ack. my concern was/is that we could apply the change, and maybe not notice some subtle fail, eg svn conversion no longer getting the right branches or similar | 09:23 |
*** locallycompact has joined #baserock | 09:23 | |
pedroalvarez | yes, that's my concern too | 09:27 |
pedroalvarez | and it would be very easy to miss a failure given that they are too many | 09:28 |
gtristan | leeming, since you've been looking into sandboxlib stuff of late, I had an idea that I've been pondering which might be of use | 09:28 |
pedroalvarez | I guess that if we prove that python loads the same information from json and yml after the conversion, then we are good to go | 09:28 |
gtristan | leeming, I asked last week about this I think in #python on freenode, if I wanted to ensure that all python code was loaded and in memory at some point, for the purpose of running code in a chroot where either a.) there is no python environment installed or b.) we dont want to trust/mix with the python environment in that chroot | 09:29 |
gtristan | the answer was that I should look into this thing called virtualenv https://virtualenv.pypa.io/en/stable/ | 09:29 |
gtristan | such an approach where one might push a relocatable trusted python environment onto a mount point in a sandbox would allow running more complex python code in the sandbox, without horrible hacks like the one here: https://github.com/CodethinkLabs/sandboxlib/blob/master/sandboxlib/chroot.py#L229 | 09:31 |
gtristan | leeming, possibly it's pie in the sky, but just wanted to hand that idea over | 09:31 |
paulsherwood | pedroalvarez: that sounds like a good idea. so maybe run lorry on all json lorries, dump the resulting dicts (sorted) to a yaml output file. Then repeat on the yaml lorries, and diff the output files? | 09:37 |
SotK | that sounds faster than turning my VM into a trove :) | 09:37 |
pedroalvarez | :) | 09:37 |
paulsherwood | :-) | 09:39 |
paulsherwood | i've used a similar approach for checking how ybd parses definitions | 09:40 |
* tiagogomes would prefer to see an admin page on the trove to add new lorries than YAMLizing lorries | 09:40 | |
tiagogomes | rather than | 09:41 |
paulsherwood | why can't we have both? | 09:41 |
SotK | why not both? | 09:41 |
paulsherwood | and tiagogomes please feel free to create one :) | 09:41 |
tiagogomes | You can have both. But my point was more about lorries being added through a web page, instead of committing directly in a git repo | 09:44 |
SotK | I somewhat like the fact that we enforce review on new lorries | 09:45 |
pedroalvarez | of course | 09:45 |
pedroalvarez | I can't imagine what could happend | 09:45 |
pedroalvarez | -d | 09:45 |
SotK | to reduce the chance of duplicate lorries, or lorrying half the world on someone's whim | 09:46 |
pedroalvarez | also, the admin interface should only be available to the infra team | 09:46 |
tiagogomes | Yep, but is it really necessary to review lorries? An user would just ask an admin to add the lorry | 09:46 |
paulsherwood | actually, it would be better if there was a CI as part of the lorry review, to a) run lorry on it and b) highlight any similar names/content from gbo | 09:47 |
SotK | that seems a more annoying process than just sending a patch | 09:47 |
pedroalvarez | tiagogomes: send a patch to admin | 09:47 |
paulsherwood | a) would be trivial in gitlab i think | 09:47 |
tiagogomes | SotK there wouldn't be duplicate worries, because we would have input validation... | 09:47 |
paulsherwood | and would avoid some of the broken lorries i've 'reviewed' in the past :) | 09:47 |
tiagogomes | that ^ | 09:47 |
paulsherwood | tiagogomes: SotK's comment still stands, we wouldn't want to start lorrying the world on a whim | 09:48 |
locallycompact | I'd prefer editing definitions in a webview as well | 09:49 |
tiagogomes | definitions are different, because it is something that you will use locally | 09:50 |
tiagogomes | paulsherwood, the administrators can veto the request | 09:51 |
* SotK still doesn't see how pestering a person to make a change is any smoother than sending a patch to make the change yourself | 09:52 | |
paulsherwood | 10:50 < tiagogomes> definitions are different, because it is something that you will use locally | 09:52 |
paulsherwood | tiagogomes: not necessarily. i think some folks here don't realise that definitions are for centralised projects too, not just local ones | 09:52 |
* paulsherwood agrees with SotK on this. a web page for adding lorries to downstream troves would be useful, but in practice i think gbo would still perfer patch review (after CI validataion) | 09:54 | |
SotK | +1 | 09:54 |
franred | remember that it is difficult for svn projects for example. they do not have standard way to describe where branches and trunk live | 09:55 |
paulsherwood | franred: i don't care about them much... git ftw :) | 09:55 |
paulsherwood | but you're right of course | 09:55 |
tiagogomes | Ok. I don't have a strong opinion about this. Just food for thought :) | 09:56 |
locallycompact | This is the view I want for definitions http://js.cytoscape.org/demos/59e38e9f20e25a293e44/ | 09:56 |
paulsherwood | tiagogomes: ack, and thanks for the input | 09:56 |
jmacs | I like the seizure-inducing juddering as it starts up, locallycompact | 09:56 |
locallycompact | me too | 09:57 |
locallycompact | that would have arrows in V10 version | 09:57 |
locallycompact | lines are dependencies, boxes are assemblages | 09:57 |
leeming | gtristan, interesting. I did wonder what the tradeoff is between having a mounted python env vs having it in memory... my simplistic view of this is to just have some trusted python bundled up on the host, (ideally contained within a common directory structure) and set that as an extra mount [ro] | 10:03 |
*** franred_ has joined #baserock | 10:04 | |
locallycompact | python is printing out the stdout from executor.run_sandox() as "b'checking build system type... x86_64-unknown-linux-gnu\nchecking host system type" | 10:06 |
locallycompact | with \n and b | 10:06 |
locallycompact | how do I render that better | 10:06 |
*** franred has quit IRC | 10:07 | |
tiagogomes | locallycompact thestring.decode('unicode-escape') | 10:08 |
locallycompact | tiagogomes, worked, thanks! | 10:09 |
*** toscalix has quit IRC | 10:24 | |
*** toscalix has joined #baserock | 10:58 | |
*** CTtpollard has quit IRC | 11:29 | |
*** toscalix has quit IRC | 11:36 | |
*** toscalix has joined #baserock | 11:39 | |
gtristan | leeming, my python-foo is not very existent especially in terms of how it's implemented under the hood, but after having made some inquiries I'm relatively sure one cannot just assert that "after this point, everything my program will access via import statements etc is loaded into memory, and no disk access will be required", if that's what you mean by having it in memory | 12:15 |
gtristan | which is why I thought the virtualenv thing might help, however; it's only really needed once you want to do complex things in your chroot environment; the existing sandboxlib code with it's ugly hack is enough to run shell commands | 12:16 |
*** franred_ has quit IRC | 12:20 | |
*** franred has joined #baserock | 12:51 | |
leeming | im not sure if i actually copied that ugly hack into the bwrap implementation | 13:05 |
*** toscalix has quit IRC | 13:10 | |
*** gtristan has quit IRC | 13:10 | |
locallycompact | What would make a suitable assemblage name for the non-bsp parts of minimal-system | 13:41 |
locallycompact | i.e reuse of build-essential. core, etc | 13:42 |
*** toscalix has joined #baserock | 13:50 | |
* paulsherwood does not understand the question | 13:58 | |
leeming | does anyone know what is used in /dev inside the sandbox when running ybd? Not sure if it needs to map to the host /dev or if just a directory called /dev that is treated as a normal dir? | 13:59 |
leeming | as i am currently getting permission errors when mounting host /dev | 13:59 |
paulsherwood | it shouldn't need host /dev, beyond stage1 and stage2, iirc | 13:59 |
paulsherwood | maybe not even then | 14:00 |
leeming | ybd source disagrees | 14:00 |
leeming | oh sorry, after bootstrap | 14:00 |
locallycompact | paulsherwood, base-system-x86_32-generic would not be able to include minimal-system-x86_64-generic as a component, because of the bsp. What do we call the collection of minimal strata sans any bsp, so that it may be a base collection contained in all systems | 14:01 |
leeming | hmm so during bootstrap, it is using host /dev... else it creates a sandbox wr /dev | 14:01 |
*** ctbruce has quit IRC | 14:03 | |
* paulsherwood hasn't tried bootstrap, so doesn't know about that path | 14:08 | |
leeming | ok, will play around wiht it to see what works | 14:09 |
paulsherwood | locallycompact: i was hoping (and proposed, a couple of years ago) that we'd get to (say) base-system.morph, which would include various target: options (iincluding say jetson:, wandboard: x86_generic: - and have the specific bsps defined there) | 14:10 |
paulsherwood | this doesn't answer your question i guess. could we create a new name, eg base-stack? | 14:11 |
paulsherwood | and then base-system = base-stack + arch-specific stuff? | 14:11 |
* locallycompact goes with that | 14:12 | |
locallycompact | sent, have at it | 14:16 |
*** toscalix_ has joined #baserock | 14:16 | |
*** ctbruce has joined #baserock | 14:19 | |
*** toscalix has quit IRC | 14:20 | |
paulsherwood | tvm | 14:21 |
*** jjardon has quit IRC | 14:22 | |
*** tardyp has quit IRC | 14:22 | |
*** jjardon has joined #baserock | 14:26 | |
*** tardyp has joined #baserock | 14:30 | |
leeming | what exactly does lstat doing? I am getting permission errors https://docs.python.org/2/library/os.html#os.stat | 14:39 |
leeming | it is trying to set the st_mode to 8576 | 14:39 |
leeming | which, looking at the man pages, suggests the '8' isn't a valid setting anyway | 14:40 |
leeming | as 7 is the max OR of the 3bit options | 14:40 |
jmacs | There's bits in file permissions other than the 3x3 permission bits | 14:42 |
leeming | but isn't the left most, the 'sticky bit' etc for directories? but maxes at 7 also | 14:43 |
leeming | S_ISUID 04000 set-user-ID bit | 14:43 |
leeming | S_ISGID 02000 set-group-ID bit (see below) | 14:43 |
leeming | S_ISVTX 01000 sticky bit (see below) | 14:43 |
jmacs | Yeah, I don't know what 08000 is | 14:44 |
leeming | man page doesn't mention it | 14:44 |
leeming | but clearly is reserved for something | 14:44 |
jmacs | It's not in the linux 3.16 headers either | 14:45 |
jmacs | No, wait, it's S_IFREG, I think | 14:46 |
jmacs | No :) S_IFIFO | 14:46 |
jmacs | Damn octal | 14:47 |
leeming | ah, named pipe? | 14:47 |
jmacs | When you said st_mode was 8576, is that really in octal? | 14:48 |
leeming | i wonder if that is the bit that is causing permission errors then | 14:48 |
leeming | i assumed it was | 14:48 |
jmacs | '8' isn't usually an octal digit... | 14:48 |
leeming | true | 14:48 |
jmacs | I'd check that first | 14:50 |
*** toscalix_ has quit IRC | 15:00 | |
*** ctbruce has quit IRC | 15:07 | |
*** toscalix_ has joined #baserock | 15:17 | |
paulsherwood | any objection to merging https://gerrit.baserock.org/#/c/1713/ ? | 15:36 |
paulsherwood | it's a new extension, won't hurt any existing definitions afaict | 15:36 |
*** lachlanmackenzie has quit IRC | 15:48 | |
*** toscalix_ has quit IRC | 15:51 | |
*** toscalix_ has joined #baserock | 15:51 | |
*** locallycompact has quit IRC | 16:33 | |
*** rdale has quit IRC | 16:38 | |
*** rdale has joined #baserock | 16:39 | |
*** franred has quit IRC | 16:48 | |
*** rdale has quit IRC | 17:04 | |
*** anahuelamo_ has joined #baserock | 17:05 | |
*** anahuelamo__ has joined #baserock | 17:07 | |
*** anahuelamo_ has quit IRC | 17:07 | |
*** anahuelamo_ has joined #baserock | 17:08 | |
*** anahuelamo__ has quit IRC | 17:11 | |
*** tiagogomes has quit IRC | 17:11 | |
*** lachlanmackenzie has joined #baserock | 17:55 | |
*** lachlanmackenzie has quit IRC | 18:15 | |
*** locallycompact has joined #baserock | 18:42 | |
*** locallycompact has quit IRC | 18:56 | |
*** anahuelamo_ has quit IRC | 18:56 | |
*** JPohlmann has quit IRC | 18:57 | |
*** bfletcher has quit IRC | 18:57 | |
*** JPohlman1 has joined #baserock | 18:57 | |
*** locallycompact has joined #baserock | 18:57 | |
*** anahuelamo_ has joined #baserock | 18:57 | |
*** bfletcher has joined #baserock | 19:05 | |
*** locallycompact has quit IRC | 19:08 | |
*** jjardon has quit IRC | 19:08 | |
*** jjardon has joined #baserock | 19:16 | |
*** toscalix_ has quit IRC | 19:18 | |
*** tardyp has quit IRC | 19:18 | |
*** radiofree has quit IRC | 19:19 | |
*** radiofree has joined #baserock | 19:19 | |
*** toscalix_ has joined #baserock | 19:19 | |
*** tardyp has joined #baserock | 19:27 | |
*** toscalix_ has quit IRC | 19:28 | |
*** persia has quit IRC | 19:32 | |
*** persia has joined #baserock | 19:32 | |
*** jjardon_matrix has quit IRC | 19:33 | |
*** faybrocklebank has quit IRC | 19:33 | |
*** JasonA has quit IRC | 19:33 | |
*** faybrocklebank has joined #baserock | 19:33 | |
*** JasonA has joined #baserock | 19:33 | |
*** jjardon_matrix has joined #baserock | 19:43 | |
*** leeming has quit IRC | 19:47 | |
*** juergbi has quit IRC | 19:47 | |
*** rjek has quit IRC | 19:47 | |
*** anahuelamo has quit IRC | 19:47 | |
*** bjdooks has quit IRC | 19:47 | |
*** _longines has quit IRC | 19:47 | |
*** malinus has quit IRC | 19:48 | |
*** cyndis has quit IRC | 19:48 | |
*** paulsherwood has quit IRC | 19:48 | |
*** perryl has quit IRC | 19:48 | |
*** malinus has joined #baserock | 19:48 | |
*** juergbi has joined #baserock | 19:48 | |
*** leeming has joined #baserock | 19:48 | |
*** _longines has joined #baserock | 19:48 | |
*** perryl has joined #baserock | 19:48 | |
*** cyndis has joined #baserock | 19:48 | |
*** anahuelamo has joined #baserock | 19:48 | |
*** paulsherwood has joined #baserock | 19:48 | |
*** malinus is now known as Guest42525 | 19:48 | |
*** jjardon has quit IRC | 19:49 | |
*** rjek has joined #baserock | 19:50 | |
* SotK grumbles about the lack of a --dry-run or similar for lorry | 19:51 | |
SotK | are folk happy with me running the .lorry files through a script which replicates the loading part of lorry/lorry-controller instead of lorrying everything in g.b.o? | 19:53 |
*** bjdooks has joined #baserock | 19:53 | |
*** vgrade has quit IRC | 19:56 | |
*** vgrade has joined #baserock | 19:56 | |
*** jjardon has joined #baserock | 19:59 | |
*** anahuelamo_ has quit IRC | 20:05 | |
*** brlogger has joined #baserock | 20:11 | |
*** persia_ has quit IRC | 20:22 | |
*** pedroalvarez has quit IRC | 20:22 | |
*** dabukalam has quit IRC | 20:22 | |
*** pedroalvarez has joined #baserock | 20:22 | |
*** ChanServ sets mode: +v pedroalvarez | 20:22 | |
*** dabukalam has joined #baserock | 20:23 | |
*** persia_ has joined #baserock | 20:23 | |
*** locallycompact has joined #baserock | 20:26 | |
*** jjardon has quit IRC | 20:30 | |
*** jjardon has joined #baserock | 20:30 | |
*** locallycompact has quit IRC | 20:32 | |
*** dabukalam has quit IRC | 20:33 | |
*** benbrown_ has quit IRC | 20:33 | |
*** cosm has quit IRC | 20:33 | |
*** vgrade has quit IRC | 20:33 | |
*** juergbi has quit IRC | 20:33 | |
*** Guest42525 has quit IRC | 20:33 | |
*** JasonA has quit IRC | 20:33 | |
*** perryl has quit IRC | 20:33 | |
*** leeming has quit IRC | 20:33 | |
*** jjardon_matrix has quit IRC | 20:33 | |
*** bfletcher has quit IRC | 20:33 | |
*** jjardon has quit IRC | 20:33 | |
*** cyndis has quit IRC | 20:33 | |
*** _longines has quit IRC | 20:33 | |
*** persia has quit IRC | 20:33 | |
*** JPohlman1 has quit IRC | 20:33 | |
*** inara` has quit IRC | 20:33 | |
*** rjek has quit IRC | 20:33 | |
*** jjardon has joined #baserock | 20:38 | |
*** cyndis has joined #baserock | 20:38 | |
*** _longines has joined #baserock | 20:38 | |
*** persia has joined #baserock | 20:38 | |
*** JPohlman1 has joined #baserock | 20:38 | |
*** perryl has joined #baserock | 20:39 | |
*** leeming has joined #baserock | 20:39 | |
*** jjardon_matrix has joined #baserock | 20:39 | |
*** bfletcher has joined #baserock | 20:39 | |
*** dabukalam has joined #baserock | 20:39 | |
*** benbrown_ has joined #baserock | 20:39 | |
*** cosm has joined #baserock | 20:39 | |
*** vgrade has joined #baserock | 20:39 | |
*** juergbi has joined #baserock | 20:39 | |
*** Guest42525 has joined #baserock | 20:39 | |
*** JasonA has joined #baserock | 20:39 | |
*** inara` has joined #baserock | 20:40 | |
*** rjek has joined #baserock | 20:40 | |
* SotK sends https://gerrit.baserock.org/#/c/2313/ and https://gerrit.baserock.org/#/c/2314/ | 21:15 | |
SotK | we shouldn't merge the second one without first merging the lorry-controller patch (https://gerrit.baserock.org/#/c/2312/) and updating git.b.o though | 21:16 |
SotK | (on pain of everything breaking horribly) | 21:16 |
*** zoli_ has joined #baserock | 21:21 | |
*** gtristan has joined #baserock | 21:40 | |
*** jjardon has quit IRC | 21:52 | |
*** jjardon has joined #baserock | 21:58 | |
*** jjardon has quit IRC | 22:03 | |
*** jjardon has joined #baserock | 22:11 | |
*** jjardon has quit IRC | 23:00 | |
*** jjardon has joined #baserock | 23:21 | |
*** gtristan has quit IRC | 23:33 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!