IRC logs for #buildstream for Wednesday, 2020-02-26

*** mohan43u has quit IRC00:30
*** phildawson-ct has quit IRC00:30
*** rdale has quit IRC00:30
*** tpollard has quit IRC00:30
*** phildawson has quit IRC00:30
*** robjh has quit IRC00:30
*** valentind has quit IRC00:30
*** douglaswinship has quit IRC00:30
*** coldtom has quit IRC00:30
*** benbrown has quit IRC00:30
*** phildawson-ct has joined #buildstream00:31
*** rdale has joined #buildstream00:31
*** tpollard has joined #buildstream00:31
*** phildawson has joined #buildstream00:31
*** robjh has joined #buildstream00:31
*** valentind has joined #buildstream00:31
*** douglaswinship has joined #buildstream00:31
*** coldtom has joined #buildstream00:31
*** benbrown has joined #buildstream00:31
*** mohan43u has joined #buildstream00:31
*** narispo has joined #buildstream00:35
*** coldtom has quit IRC00:51
*** coldtom has joined #buildstream00:52
*** tristan has joined #buildstream03:38
*** coldtom has quit IRC03:51
*** phildawson-ct has quit IRC03:51
*** rdale has quit IRC03:51
*** tpollard has quit IRC03:51
*** phildawson has quit IRC03:51
*** robjh has quit IRC03:51
*** valentind has quit IRC03:51
*** douglaswinship has quit IRC03:51
*** benbrown has quit IRC03:51
*** coldtom has joined #buildstream03:57
*** phildawson-ct has joined #buildstream03:57
*** rdale has joined #buildstream03:57
*** tpollard has joined #buildstream03:57
*** phildawson has joined #buildstream03:57
*** robjh has joined #buildstream03:57
*** valentind has joined #buildstream03:57
*** douglaswinship has joined #buildstream03:57
*** benbrown has joined #buildstream03:57
*** coldtom has quit IRC04:03
*** phildawson-ct has quit IRC04:03
*** rdale has quit IRC04:03
*** tpollard has quit IRC04:03
*** phildawson has quit IRC04:03
*** robjh has quit IRC04:03
*** valentind has quit IRC04:03
*** douglaswinship has quit IRC04:03
*** benbrown has quit IRC04:03
*** coldtom has joined #buildstream04:07
*** phildawson-ct has joined #buildstream04:07
*** rdale has joined #buildstream04:07
*** tpollard has joined #buildstream04:07
*** phildawson has joined #buildstream04:07
*** robjh has joined #buildstream04:07
*** valentind has joined #buildstream04:07
*** douglaswinship has joined #buildstream04:07
*** benbrown has joined #buildstream04:07
*** coldtom has quit IRC04:10
*** phildawson-ct has quit IRC04:10
*** rdale has quit IRC04:10
*** tpollard has quit IRC04:10
*** phildawson has quit IRC04:10
*** robjh has quit IRC04:10
*** valentind has quit IRC04:10
*** douglaswinship has quit IRC04:10
*** benbrown has quit IRC04:10
*** coldtom has joined #buildstream04:11
*** phildawson-ct has joined #buildstream04:11
*** rdale has joined #buildstream04:11
*** tpollard has joined #buildstream04:11
*** phildawson has joined #buildstream04:11
*** robjh has joined #buildstream04:11
*** valentind has joined #buildstream04:11
*** douglaswinship has joined #buildstream04:11
*** benbrown has joined #buildstream04:11
*** coldtom has quit IRC04:16
*** phildawson-ct has quit IRC04:16
*** rdale has quit IRC04:16
*** tpollard has quit IRC04:16
*** phildawson has quit IRC04:16
*** robjh has quit IRC04:16
*** valentind has quit IRC04:16
*** douglaswinship has quit IRC04:16
*** benbrown has quit IRC04:16
*** coldtom has joined #buildstream04:19
*** phildawson-ct has joined #buildstream04:19
*** rdale has joined #buildstream04:19
*** tpollard has joined #buildstream04:19
*** phildawson has joined #buildstream04:19
*** robjh has joined #buildstream04:19
*** valentind has joined #buildstream04:19
*** douglaswinship has joined #buildstream04:19
*** benbrown has joined #buildstream04:19
*** coldtom has quit IRC04:23
*** phildawson-ct has quit IRC04:23
*** rdale has quit IRC04:23
*** tpollard has quit IRC04:23
*** phildawson has quit IRC04:23
*** robjh has quit IRC04:23
*** valentind has quit IRC04:23
*** douglaswinship has quit IRC04:23
*** benbrown has quit IRC04:23
*** coldtom has joined #buildstream04:33
*** phildawson-ct has joined #buildstream04:33
*** rdale has joined #buildstream04:33
*** tpollard has joined #buildstream04:33
*** phildawson has joined #buildstream04:33
*** robjh has joined #buildstream04:33
*** valentind has joined #buildstream04:33
*** douglaswinship has joined #buildstream04:33
*** benbrown has joined #buildstream04:33
*** coldtom has quit IRC04:36
*** phildawson-ct has quit IRC04:36
*** rdale has quit IRC04:36
*** tpollard has quit IRC04:36
*** phildawson has quit IRC04:36
*** robjh has quit IRC04:36
*** valentind has quit IRC04:36
*** douglaswinship has quit IRC04:36
*** benbrown has quit IRC04:36
*** coldtom has joined #buildstream04:52
*** phildawson-ct has joined #buildstream04:52
*** rdale has joined #buildstream04:52
*** tpollard has joined #buildstream04:52
*** phildawson has joined #buildstream04:52
*** robjh has joined #buildstream04:52
*** valentind has joined #buildstream04:52
*** douglaswinship has joined #buildstream04:52
*** benbrown has joined #buildstream04:52
*** narispo has quit IRC04:55
*** coldtom has quit IRC04:55
*** phildawson-ct has quit IRC04:55
*** rdale has quit IRC04:55
*** tpollard has quit IRC04:55
*** phildawson has quit IRC04:55
*** robjh has quit IRC04:55
*** valentind has quit IRC04:55
*** douglaswinship has quit IRC04:55
*** benbrown has quit IRC04:55
*** coldtom has joined #buildstream04:56
*** phildawson-ct has joined #buildstream04:56
*** rdale has joined #buildstream04:56
*** tpollard has joined #buildstream04:56
*** phildawson has joined #buildstream04:56
*** robjh has joined #buildstream04:56
*** valentind has joined #buildstream04:56
*** douglaswinship has joined #buildstream04:56
*** benbrown has joined #buildstream04:56
*** coldtom has quit IRC05:00
*** phildawson-ct has quit IRC05:00
*** rdale has quit IRC05:00
*** tpollard has quit IRC05:00
*** phildawson has quit IRC05:00
*** robjh has quit IRC05:00
*** valentind has quit IRC05:00
*** douglaswinship has quit IRC05:00
*** benbrown has quit IRC05:00
*** coldtom has joined #buildstream05:01
*** phildawson-ct has joined #buildstream05:01
*** rdale has joined #buildstream05:01
*** tpollard has joined #buildstream05:01
*** phildawson has joined #buildstream05:01
*** robjh has joined #buildstream05:01
*** valentind has joined #buildstream05:01
*** douglaswinship has joined #buildstream05:01
*** benbrown has joined #buildstream05:01
*** narispo has joined #buildstream05:17
*** mohan43u has quit IRC06:20
*** mohan43u has joined #buildstream06:23
*** mohan43u has quit IRC07:34
*** mohan43u has joined #buildstream07:36
*** traveltissues has joined #buildstream07:40
gitlab-br-botjuergbi opened MR !1825 (juerg/reapi-readonly->master: _sandboxreapi.py: Support read-only root) on buildstream https://gitlab.com/BuildStream/buildstream/-/merge_requests/182509:14
*** bochecha has joined #buildstream09:33
*** santi has joined #buildstream09:42
*** jonathanmaw has joined #buildstream09:47
*** santi has quit IRC10:34
*** santi has joined #buildstream10:34
*** tme5 has joined #buildstream11:28
*** santi has quit IRC11:29
*** santi has joined #buildstream11:29
*** santi has quit IRC13:11
*** santi has joined #buildstream13:47
gitlab-br-botjuergbi merged MR !1822 (willsalmon/directorynote->master: Add doc note about directories) on buildstream https://gitlab.com/BuildStream/buildstream/-/merge_requests/182214:37
*** bochecha has quit IRC15:54
*** phildawson_ has joined #buildstream16:12
*** tmew5 has joined #buildstream16:12
*** CTtpollard has joined #buildstream16:12
*** phil has joined #buildstream16:12
*** coldtom0 has joined #buildstream16:13
*** tme5 has quit IRC16:13
*** coldtom has quit IRC16:13
*** phildawson-ct has quit IRC16:13
*** rdale has quit IRC16:13
*** tpollard has quit IRC16:13
*** phildawson has quit IRC16:13
*** robjh has quit IRC16:13
*** valentind has quit IRC16:13
*** douglaswinship has quit IRC16:13
*** benbrown has quit IRC16:13
*** rdale has joined #buildstream16:15
*** benbrown has joined #buildstream16:15
*** douglaswinship has joined #buildstream16:15
*** robjh has joined #buildstream16:15
*** valentind has joined #buildstream16:17
WSalmonhttps://manpages.debian.org/testing/ostree/rofiles-fuse.1.en.html juergbi i presume i cant use this in side the standard bwrap sandbox but can i use it in any of the buildbox sandboxes?16:24
juergbiWSalmon: it might not work in either. why do you think there is a difference in this regard?16:26
WSalmoni thought brap did not like you runnign fuss inside it, or is that only for pre buildbox brap16:26
WSalmoni thought brap did not like you runnig fuss inside it, or is that only for pre buildbox brap16:26
juergbiFUSE traditionally requires a setuid root helper binary (fusermount). this is normally not available inside a sandbox (at least not setuid to the real root)16:27
juergbiwith recent kernels, FUSE is also supported without special host privileges inside a user namespace16:27
juergbihowever, besides the kernel requirement, it might also require a change in the FUSE filesystem and/or libfuse to handle the mount a bit differently16:28
WSalmonso this is a oneday thing not a cant thing? and is all that true for arm atm?16:29
juergbithe default/recommended buildbox-run implementation on linux also uses bwrap, so the actual sandboxing mechanism is virtually identical16:30
juergbiyes, at least with recent kernels it should theoretically be possible but it may not work out of the box yet16:30
juergbiI don't think any of this is ISA-specific, so ARM and x86-64 should behave the same16:30
*** tmew5 has quit IRC16:32
juergbiWSalmon: another potential issue is that bubblewrap by default doesn't allow sandboxed commands to mount anything. granting this via --cap-add would also be required for the FUSE mount inside the sandbox16:33
juergbithat said, it surprises me a bit that you want to work with an OStree repo inside a buildstream element/sandbox16:35
WSalmonhttps://fosdem.org/2020/schedule/event/deployment_to_hardware/ we make the full disk image for the robot in bst. and ostree is a really nice way to OTA update, or any other type of update16:37
WSalmonmaking the ostree element takes 10min16:37
WSalmoni would like to commit all the cuda bits first and then glue them together  in a later bst element16:38
WSalmonhttps://ostree.readthedocs.io/en/latest/manual/buildsystem-and-repos/16:38
WSalmoni tried making diffrent trees and then adding them up and it ended up taking loads longer than just building them16:38
WSalmonhttps://ostree.readthedocs.io/en/latest/manual/buildsystem-and-repos/ dosnt *"need"* ROFILES-FUSE i wonder if i can do something a bit cleverer as im not running a intergration command as such16:40
WSalmonactually given that bst has done the intergration bits its self maybe i can *just* runt the bits that dont need rofiles-fuse16:43
juergbiWSalmon: the contents of the OSTree branch at time of rofiles-fuse are originally from BuildStream?16:44
WSalmonjuergbi, currently i just do a single commit of fullfilesystem element16:45
juergbiI'm a bit confused what exactly you want to achieve in that rofiles-fuse-using element16:45
*** santi has quit IRC16:45
abderrahim[m]WSalmon: I'm interested in improving ostree performance. Please CC me if you find something interesting16:45
juergbias I understand it, the purpose of rofiles-fuse is to manipulate a OSTree branch using regular commands16:46
WSalmoncurrently i do https://gitlab.com/celduin/crash/jetbot-system-bst/-/blob/master/elements/boards/minimal-systemd-nano-ostree-repo.bst the final line takes 10min16:46
abderrahim[m]I was thinking a buildstream plugin can somehow cheat to improve performance16:46
juergbiyes, at least theoretically, exporting from CAS to OSTree should be doable fairly efficiently16:47
WSalmonwell, that would be cool but i have not got my head round it16:47
juergbiWSalmon: we don't have a OSTree deployment plugin yet, I guess (I haven't been following OSTree recently)16:48
juergbithat's the direction I would go for16:48
WSalmoni was thinking of making ostree commits of some of the bst elements so that ostree did not have to recompute everything every time. but a more direct approch would be better16:48
juergbidrop the ostree part of the script, i.e., first just produce the desired contents as regular buildstream element output16:49
juergbiand then create a second element whose only purpose is to export to OSTree16:49
juergbiand do the magic in the code of that element plugin16:49
*** santi has joined #buildstream16:49
WSalmonim trying to rember the new plugin api16:50
*** narispo has quit IRC16:55
*** coldtom0 is now known as coldtom16:56
*** narispo has joined #buildstream16:56
coldtomwoah, can you just pull a CAS into a build sandbox now?!16:56
WSalmonno i dont think you can atm16:57
coldtomah, i'd really like to see that feature16:58
WSalmonbut it might be less effort to add that to bst than get fuse to work16:58
WSalmonjuergbi, would we need to add to the casbaseddirectory object a checkout a sub set of cas as cas rather than a dir17:05
WSalmonalso it might just be a case of making some new casdirs and the odd file, can i make a plugin that dosent even invoke a sand box17:07
juergbiWSalmon: I think we rather want to avoid exposing CAS details to plugins, if we can17:08
juergbiWSalmon: yes, that's what I was thinking of. an element plugin that exports from CAS to OSTree without invoking any commands, and thus not involving a sandbox17:08
WSalmonbut all this needs to do is add a file and some dirs to the cas and then say to buildstream thats the base of my artifact?17:09
juergbi(you'll still have a sandbox object but you don't have to run anything in it)17:09
WSalmonfair17:09
juergbinot sure what you mean by adding a file and some dirs17:10
WSalmona ostree repo is a cas + ref file17:10
WSalmonas far as i can tell17:10
juergbiok, we have to be careful about terminology now. CAS is ambiguous, unfortunately17:11
WSalmonindeed17:11
juergbiit's a general concept that is used by OSTree, git and REAPI CAS17:11
WSalmoni need to go check quite a few of my assumtions17:11
juergbiOSTree is indeed a (generic) CAS + ref file, very similar to git17:11
juergbithe CAS part is not fully compatible with REAPI CAS, though17:12
WSalmonah yes you would need to make a cas to live in a cas...17:12
WSalmonhaha17:12
WSalmontricky but this is a good line of thought, thanks juergbi got to go now17:13
juergbiwe currently use the same hash algorithm for files (SHA-256), so it's fairly close, except for the different directory structure17:13
juergbi(+ OSTree commit objects)17:13
juergbihowever, hash algorithm in REAPI CAS is theoretically not fixed17:13
juergbiok, have a nice evening17:13
*** traveltissues has quit IRC17:55
*** santi has quit IRC18:04
*** jonathanmaw has quit IRC18:08
*** benschubert has quit IRC20:58
*** narispo has quit IRC21:38
*** narispo has joined #buildstream21:40
*** narispo has quit IRC21:43
*** narispo has joined #buildstream21:44
*** narispo has quit IRC22:44
*** narispo has joined #buildstream22:44
*** juergbi has quit IRC22:56
*** narispo has quit IRC23:35
*** narispo has joined #buildstream23:35
*** narispo has quit IRC23:48
*** narispo has joined #buildstream23:49

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!