IRC logs for #buildstream for Thursday, 2017-11-09

*** tristan has quit IRC06:59
*** tristan has joined #buildstream07:09
gitlab-br-botpush on buildstream@sam/compose-log-splits (by Tristan Van Berkom): 3 commits (last: Refactor: Move context.py -> _context.py) https://gitlab.com/BuildStream/buildstream/commit/213d9072b684d2dff78d8b4f1c7cfa9d6335b0d008:30
gitlab-br-botbuildstream: merge request (sam/compose-log-splits->master: Log details of artifact splitting when building 'compose' elements) #140 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/14008:30
gitlab-br-botpush on buildstream@master (by Tristan Van Berkom): 1 commit (last: git.py source plugin: Prune remote-tracking branches when fetching) https://gitlab.com/BuildStream/buildstream/commit/794e73cb4469c30bd830b333597a6932da1254f109:14
gitlab-br-botbuildstream: merge request (sam/git-fetch-prune->master: git.py source plugin: Prune remote-tracking branches when fetching) #146 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/14609:14
gitlab-br-botbuildstream: Sam Thursfield deleted branch sam/git-fetch-prune09:14
*** givascu has joined #buildstream09:31
*** valentind has joined #buildstream09:42
*** jonathanmaw has joined #buildstream09:48
*** ssam2 has joined #buildstream10:13
gitlab-br-botbuildstream: merge request (97-apply-pep-3102-to-all-public-api-surfaces->master: WIP: Resolve "Apply pep 3102 to all public API surfaces") #127 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/12710:17
gitlab-br-botpush on buildstream@97-apply-pep-3102-to-all-public-api-surfaces (by Jonathan Maw): 20 commits (last: Refactoring: Move exceptions module to be private) https://gitlab.com/BuildStream/buildstream/commit/27aac095bdb6b0025c989572789a1f98d8d89b3c10:17
tristanvalentind, I'm going to step out early, I think the compose patch is great, and I've also blocked https://gitlab.com/BuildStream/buildstream/merge_requests/140 on it (because exposing the API you need is an all around better solution than exposing the other API proposed on 140)10:27
tristanBut, I would *really* want to change that test for an integration test10:28
tristantlater, I think I'm going to kick off early today10:29
tristanif you have thoughts on my comments on the regression fix... I think now is better10:29
tlatertristan: Alright, I'll need a few minutes, didn't notice them10:31
tlatertristan: Why can we assume that an element is recursing if it has been visited in the same scope before?10:36
valentindtristan, I am fine with your comments.10:37
tlaterAh, nevermind, I understand now. The last commend on not returning something that has been visited actually makes this work.11:01
*** givascu has quit IRC11:03
tristantlater, great, yeah I *think* my proposed solution to this is going to work well11:03
tristantlater, it is admittedly, a very tricky function; it's primary use case is stable walking of the tree; staging order11:04
tristanI dont think you'll achieve a combined staging order walk with your approach, but I dont think that is the goal either (build plan is where that counts most, and in any case we have the planner which does that)11:05
tristani.e.: bst show will only show correct staging order when only one element is specified; but that is quite alright I think11:06
* tristan prepares himself to press "Send" on the d-d-l announcement !11:10
tlaterdotted duckbill lovers?11:12
ssam2https://mail.gnome.org/mailman/listinfo/desktop-devel-list11:15
tristanhttps://mail.gnome.org/archives/desktop-devel-list/2017-November/msg00032.html11:22
tristan:D11:22
tlater\o/11:23
*** valentind has quit IRC11:29
*** tristan has quit IRC11:37
gitlab-br-botpush on buildstream@97-apply-pep-3102-to-all-public-api-surfaces (by Jonathan Maw): 1 commit (last: element.py: Change node_subst_member's 'default_value' field to 'default') https://gitlab.com/BuildStream/buildstream/commit/a776d94f1c9d2478e29f9dbb811389049bf6500e11:42
gitlab-br-botbuildstream: merge request (97-apply-pep-3102-to-all-public-api-surfaces->master: WIP: Resolve "Apply pep 3102 to all public API surfaces") #127 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/12711:42
gitlab-br-botbuildstream: merge request (git-element-origin->master: WIP: Change origin to point at source repo) #143 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/14311:53
gitlab-br-botbuildstream: merge request (git-element-origin->master: Change origin to point at source repo) #143 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/14311:53
*** adds68_ has joined #buildstream12:55
*** adds68 has quit IRC12:56
ssam2seems the `local` element doesn't consider file permissions part of the cache key13:04
ssam2that must be a bug, if the only way to set permissions is by setting the equivalent permissions on the source files13:04
tlaterssam2: https://gitlab.com/BuildStream/buildstream/issues/8413:14
ssam2ah, thanks13:15
tlateriirc the discussion ended with 'We'll support execute permissions at some point'13:16
ssam2i'm still not convinced that Git remembers any permissions other than +x13:16
ssam2i guess this needs to be researched fully13:16
ssam2bah, i really thought i was going to get a bootable VM today13:17
tlater:(13:17
ssam2but it fails to boot because the /init script isn't +x13:17
ssam2(obviously i could work around this, but that's not the point :-)13:17
ssam2this could be quite tricky to do in fact13:21
ssam2i am more or less against Tristan's idea to rely on the filesystem for permissions in the first place13:25
ssam2as not all filesystems preserve modes correctly13:25
ssam2so putting project files on a FAT-formatted USB stick would break everything13:26
ssam2and yes, Git only stores either 0755 or 064413:31
tlaterssam2: It's hard to know what permissions mean exactly then. Linux permissions just don't make sense everywhere.13:31
ssam2I think we can assume BuildStream is always producing UNIX-like systems13:32
ssam2that doesn't limit us from producing filesystems that are less expressive, e.g. FAT13:32
ssam2it would limit us from producing a type of system that has a richer permissions model stored at the filesystem level, but i don't know of one that would matter13:33
ssam2xattrs are an interesting one of course; and are another argument in favour of not relying on the filesystem to provide such info13:33
*** WSalmon has joined #buildstream13:34
tlaterssam2: On the other hand, would it be enough to just store 0755/0644 like git does?13:35
ssam2for a first cut, I think that's OK13:35
ssam2it does mean that if you want to set permissions like 0600 then you need to do it manually with `chmod` as a build or integration command13:36
ssam2but that can be second issue13:36
ssam2*a separate issue13:36
* ssam2 finally boots into his VM13:53
ssam2which is 17MB in size! that's good going, at least13:53
ssam2except the disk image is 1.4GB, which seems a bit wrong13:54
ssam2swap-size defaults to 1G, I see13:55
* ssam2 forsees some patches to the x86image element13:57
gitlab-br-botpush on buildstream@97-apply-pep-3102-to-all-public-api-surfaces (by Jonathan Maw): 8 commits (last: git.py source plugin: Prune remote-tracking branches when fetching) https://gitlab.com/BuildStream/buildstream/commit/794e73cb4469c30bd830b333597a6932da1254f114:19
gitlab-br-botbuildstream: merge request (97-apply-pep-3102-to-all-public-api-surfaces->master: WIP: Resolve "Apply pep 3102 to all public API surfaces") #127 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/12714:19
gitlab-br-botbuildstream: merge request (incremental-build->master: Add support for doing incremental builds) #126 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/12614:25
* tlater seems to be too stupid to implement this, unless tristan overlooked that we have the special use case of not recursing the full tree.14:39
gitlab-br-botpush on buildstream@except_intersections (by Tristan Maat): 2 commits (last: load.py: Migrate to new test style) https://gitlab.com/BuildStream/buildstream/commit/f8f3db8661c06f5f63142664d4e4bfa3a504730314:53
gitlab-br-botpush on buildstream@except_intersections (by Tristan Maat): 8 commits (last: load.py: Migrate to new test style) https://gitlab.com/BuildStream/buildstream/commit/d9a876eb2565497b463f0df876a6d48bf18e95e615:13
gitlab-br-botpush on buildstream@except_intersections (by Tristan Maat): 5 commits (last: main.py: Fix app initialization) https://gitlab.com/BuildStream/buildstream/commit/633b25b500cbb51e93d48cf7e272ae036a0528c115:14
*** anahuelamo has quit IRC15:21
*** anahuelamo has joined #buildstream15:22
*** tristan has joined #buildstream15:45
*** jonathanmaw has quit IRC15:45
paulsherwoodhow do changes to https://wiki.gnome.org/Newcomers/BuildSystemComponentBst happen, please?15:47
ssam2the gnome wiki has this rather annoying anti-spam mechanism in place15:47
ssam2once you have an account, you need to ask someone to add your username to https://wiki.gnome.org/TrustedEditorGroup so that you can edit15:47
* paulsherwood has been triggered by the tristan apostrophe15:47
ssam2creating an account is easy, and then anyone who already has write access to the wiki can edit that page for you15:48
paulsherwoodperhaps tristrophe should be a word :)15:48
tristanwhat what, people getting picky about how it's written again, with all it's tristophracies ?15:50
paulsherwoodquite15:50
* tristan updates, but reflects that the world will eventually have to accept that it's just not a problem :)15:51
paulsherwoodtristan: would you mind adding paulsherwood to the list of folks who can edit that page?15:52
*** anahuelamo has quit IRC15:53
* tristan doesnt think he has the rights15:53
paulsherwoodalso, is there a good reason that https://gnome7.codethink.co.uk/gnome-modulesets.git is at codethink, rather than gitlab?15:53
tristanits not a page local thing, I think jjardon[m] gave me access originally15:54
tristanas I hadnt modified the wiki in years15:54
ssam2i have added you15:55
ssam2anyone with edit permissions for the wiki can edit that page15:56
*** tristan has quit IRC15:57
jjardon[m]I've suggested to use https://git.gnome.org//browse/gnome-modulesets instead16:00
paulsherwoodssam2: tvm16:01
*** tristan has joined #buildstream16:01
tristanoops, /me seems to have had an internet hiccup, not sure that the relevant part about modulesets on gnome7 got through16:02
paulsherwoodit did not16:02
tristan<tristan> paulsherwood, yes there is a good reason; it cannot be an editable repository, and it's generated as a part of a process of migrating jhbuild modulesets16:03
tristan<tristan> which happens on gnome716:03
tristan<tristan> so basically, until we hit "switch", it will remain something that is generated from modifying jhbuild modulesets16:03
tristan:)16:03
tristanso basically how it works is we keep modifying the 3.28 modulesets at https://git.gnome.org/browse/jhbuild/tree/modulesets16:04
tristanand every 10 minutes, https://gnome7.codethink.co.uk/gnome-modulesets.git is updated16:04
tristanthere is a blog post linked in the announcement email which describes the process in detail16:04
tristanthat will continue to happen so that the transition is not aggressive, until at least end of 2017, but we will create a permanent repo in advance of 3.28 stable release16:05
paulsherwoodok... maybe update the wiki page to say this is special modulesets temporarily at codethink? (just seems a bit odd to see a codethink service in gnome instructions)16:06
tristanYeah, the wiki page is also a work in progress but understood16:06
tristanI'll add some notes about that first thing tomorrow16:07
tristanmaybe a small note with a link to that blog post will be good16:08
* ssam2 wonders why modifying a .yaml file in the bst-external repo seems to have no effect on my build ...16:15
ssam2i have done `pip3 install --user .` in the bst-external repo, so would expect this to just work16:15
ssam2oh16:15
ssam2i meant to add `-e` :-)16:15
* tristan seems to recall there was an issue with `pip install --user -e`16:16
ssam2yeah... it still doesn't work16:16
tristanbut maybe it's fixed, you'd have to check with jonathan and tlater16:16
tlaterHi16:16
tristantlater, using plugins - installed with `pip3 install --user -e .`16:17
ssam2argh, turns out one of my changes that was merged is totally broken16:17
ssam2and i never noticed because of this other issue16:17
* tlater is fairly sure that is supposed to have been fixed16:17
ssam2it appears not16:18
tlaterI'll check the issue for that again, can't quite remember what that was about16:18
tlaterssam2: That's a new issue, the old one was a stacktrace16:20
ssam2ah right16:20
tlaterFor reference: https://gitlab.com/BuildStream/buildstream/issues/11016:21
tlaterThough I doubt it's related at all16:21
ssam2an integration test for the x86image plugin would be pretty useful, i guess it has so many dependencies though that its tricky16:22
ssam2although we are going to start using it in Baserock really soon, which will at least catch future breakages16:22
ssam2presumably whatever the problem is with plugin loading, it's in that same code that !107 touched16:23
* tlater hopes that python doesn't garbage collect loaded files now16:24
gitlab-br-botpush on buildstream@migrate_pipeline_load (by Tristan Maat): 1 commit (last: Remove DummyElement hack) https://gitlab.com/BuildStream/buildstream/commit/b35bd94bd2b01853b0096dea6e3bf5404d79b1e916:49
gitlab-br-botbuildstream: merge request (migrate_pipeline_load->master: Migrate `tests/pipeline/load.py`) #145 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/14516:49
gitlab-br-botpush on buildstream@except_intersections (by Tristan Maat): 6 commits (last: Remove DummyElement hack) https://gitlab.com/BuildStream/buildstream/commit/b35bd94bd2b01853b0096dea6e3bf5404d79b1e917:11
*** tpollard has quit IRC17:59
gitlab-br-botpush on buildstream@tracking-changes (by Tristan Maat): 20 commits (last: Refactoring: Move exceptions module to be private) https://gitlab.com/BuildStream/buildstream/commit/27aac095bdb6b0025c989572789a1f98d8d89b3c18:01
gitlab-br-botbuildstream: merge request (tracking-changes->master: WIP: Tracking changes) #119 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/11918:01
*** ssam2 has quit IRC19:05
*** adds68__ has joined #buildstream19:27
*** adds68_ has quit IRC19:28
*** tlater has quit IRC20:17
*** benbrown has quit IRC20:17
*** laurenceurhegyi has quit IRC20:17
*** paulsherwood has quit IRC20:17
*** laurenceurhegyi has joined #buildstream20:19
*** tlater has joined #buildstream20:20
*** benbrown has joined #buildstream20:22
*** paulsherwood has joined #buildstream20:22
*** valentind has joined #buildstream21:16
valentindtristan, mocks are common practice in testing.21:20
valentindFor contributors it is nice to have lots of simple tests to make sure we do not break anything before submitting a PR.21:21
valentindYou do what you want of course. But see the point of view of contributors who do not have a full overview of the project. I would have not felt comfortable submitting if I did not write those tests.21:22
tristanvalentind, you happen to catch me at 6 am before sleeping - yes they are common, the integration test is better, it runs automatically on gitlab, and it's less stuff to maintain21:22
valentindSorr21:22
valentindI just wanted to explain my point of view.21:22
valentindAll I wanted to say.21:22
valentindHave a good sleep.21:23
hergertmeis there a wiki page i can look at with how to get started using the buildstream stuff for building modules?21:23
hergertmei should start playing with it soon so i can get it integrated into Builder at some point21:23
hergertme(as a side note, > .75 cycles notification from my side would have been appreciated, being that now i have to change my development timeline for 3.28 to compensate and doing buildstream work)21:24
tristanhergertme, right now there is only https://wiki.gnome.org/Newcomers/BuildSystemComponentBst and http://buildstream.gitlab.io/buildstream/21:25
hergertmebasically, this leaves our contributors using Builder out to hang unless i can somehow find a way to fit this into 3.28, which is already going to be tight.21:26
* tristan is burning at 200% and approaching nervous breakdown territory21:26
hergertmeim sympathetic, ive been running on that since 2014. maybe choose a less aggressive timeline?21:27
tristanthis is the wrong time for me to be on irc :-/21:27
tristanhergertme, this is something we've planned since GUADEC, I'm sorry we didnt announce before it was really, really ready to test21:28
tristanIf we push back, that means flatpak and booting images push back 6 more months, or crazy shit happens with autoconverting modulesets21:28
tristanthis timeline fwiw, also does not effect flatpacks21:29
hergertmepeople use Builder for more than just flatpaks though, we have full jhbuild integration too21:29
tristanI cant even *start* make that stuff happens, until we cut off jhbuild.21:29
hergertmewe all knew "build stream was coming", but most of us plan our cycles ... you know, before the cycle starts21:29
hergertmeso by doing this (we're already 1 month into development, and 2 months before freezes start)21:30
tristanOk, I wont discuss this at 6:30 am, sorry I appeared at all21:30
tristanthis is exactly the wrong kind of discussion for me to have in the middle of the night21:30
tristansorry21:30
hergertmei can email, its fine21:30
*** tristan has quit IRC21:34
*** valentind has quit IRC23:36

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!