IRC logs for #buildstream for Friday, 2019-11-22

*** mohan43u has quit IRC02:35
*** mohan43u has joined #buildstream02:38
*** mohan43u has quit IRC03:03
*** tiagogomes has joined #buildstream03:26
*** tiagogomes has quit IRC03:33
*** tiagogomes has joined #buildstream03:34
*** tiagogomes has quit IRC03:35
gitlab-br-botBenjaminSchubert approved MR !1722 (valentindavid/compose-integration-commands->master: compose: Allow compose elements to run integration commands) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/172209:36
*** phildawson has joined #buildstream10:07
benschubertAnyone waiting on reviews from me? Or needing a review?10:07
*** lachlan has joined #buildstream10:29
*** lachlan has quit IRC10:40
tlater[m]benschubert: I assume you have no new comments on !171810:44
tlater[m]?10:44
* tlater[m] is about to translate the benchmarking10:46
*** lachlan has joined #buildstream10:46
benschuberttlater[m]: just interested in the benchmarks results, but otherwise everythign seems sane and will help me for my next improvement :)10:47
tlater[m]Oooh, what's the next improvement?10:47
aevribenschubert: if you're in the market for reviews, this guy could do with a final approval - !163810:48
gitlab-br-botMR !1638: cascache: refactor, extract CASDProcessManager and CASDConnection https://gitlab.com/BuildStream/buildstream/merge_requests/163810:48
benschuberttlater[m]: removiing `get_consistency` and having `is_cached` only, and assume `consistenyt means has_ref`, which then allows to stop calling `get_consistency` in every part of the pipeline that is not workspace operations, which could save 2/3rd of the loading time in git cases (and potentially others)10:51
tlater[m]Yup, that sounds about right10:52
benschuberttlater[m]: stable is bst 1.4 right?11:18
tlater[m]1.211:18
tlater[m]I believe the benchmark target for stable hasn't been updated in a while.11:19
*** lachlan has quit IRC11:19
benschuberttlater[m]: i'm surprised there is no benefits? Or is this just because we havent started the optimisations there?11:20
tlater[m]benschubert: You mean compared to stable?11:20
benschubertto master :)11:21
tlater[m]stable is a lot quicker than master, yeah11:21
tlater[m]Oh, we're about 5 seconds faster on startup time11:21
benschubertI mean master vs your branch11:21
* tlater[m] thinks the changes don't affect build time much11:21
benschubertThen I'm not sure how to read the benchmarks11:22
tlater[m]Startup time (a) for master is 0.37 but 0.33 for track-cleanup11:22
tlater[m]It'd help figuring out what that means if I knew what (a) is, but the results don't really tell me :(11:23
tlater[m]But yeah, not a severe improvement to overall build time.11:23
benschubertwait, .05 s not 5s right?11:25
tlater[m]Oh, you're right11:25
* tlater[m] isn't sure how his mind went to 5s there11:26
benschubertand the big show is slower11:27
tlater[m]I made no changes after that benchmark, so those numbers are what we have.11:27
tlater[m]I'm not sure about the last one, stddev 3x what it is on the previous run11:27
tlater[m]So I'd suspect something environment related. We don't do a warmup run there, so the data is pretty noisy11:28
tlater[m]No, not 3x11:29
*** lachlan has joined #buildstream11:29
* tlater[m] clearly hasn't properly woken up yet11:29
tlater[m]But it's certainly within stddev11:29
* tlater[m] could benchmark locally and hope for slightly more accurate results11:30
benschubertIf you have time that might be better, I'm surprised that the initial thing would be quicker but not that :)11:32
tlater[m]The initial benchmark wasn't quicker either11:33
tlater[m]That one was, in fact, slower, because I accidentally regressed a previous optimization11:34
tlater[m]But it was within measurement error, as well...11:34
* tlater[m] wonders if our benchmarks are just too generic11:34
benschubertpossibly11:37
benschubertok, it cleans up the code anyways, let's go for it, if we can optimize let's do after?11:37
tlater[m]That makes sense, yeah11:37
tlater[m]traveltissues won't respond today, but we discussed that comment and I think I can tick that one off too, so yeah, let's merge!11:38
tlater[m]benschubert: Mind approving on gitlab so I don't look too narcisstic? ;)11:39
benschubertsure11:40
gitlab-br-botBenjaminSchubert approved MR !1718 (tlater/track-cleanup->master: Simplify the codebase using post-tracking removal simplicity of the pipeline) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/171811:40
*** lachlan has quit IRC11:56
*** lachlan has joined #buildstream12:09
*** bochecha_ has joined #buildstream12:09
*** bochecha has quit IRC12:12
*** bochecha_ is now known as bochecha12:12
jjardonCan I have review of https://gitlab.com/BuildStream/buildstream/merge_requests/1727/diffs please?12:37
gitlab-br-botjjardon opened (was WIP) MR !1728 (jjardon/fedora-31->master: Use fedora31 instead older versions) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/172812:56
jjardonalso ^12:58
*** lachlan has quit IRC13:01
gitlab-br-botmarge-bot123 closed issue #1199 (Follow-up from "skip tracking elements without trackable sources") on buildstream https://gitlab.com/BuildStream/buildstream/issues/119913:03
gitlab-br-botmarge-bot123 closed issue #1194 (Remove `Element.__tracking_scheduled`) on buildstream https://gitlab.com/BuildStream/buildstream/issues/119413:03
gitlab-br-botmarge-bot123 closed issue #1195 (Resolve FIXME from "skip tracking elements without trackable sources") on buildstream https://gitlab.com/BuildStream/buildstream/issues/119513:03
gitlab-br-botmarge-bot123 closed issue #1193 (Split `Stream._load` for target types) on buildstream https://gitlab.com/BuildStream/buildstream/issues/119313:03
gitlab-br-botmarge-bot123 merged MR !1718 (tlater/track-cleanup->master: Simplify the codebase using post-tracking removal simplicity of the pipeline) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/171813:03
*** traveltissues has joined #buildstream13:41
benschubertjjardon: regarding !1727, that would mean dropping our last tests for python 3.5. I personnally would be happy to stop supporting 3.5, but do we still need it? If yes, then we should add some python3.5 as part of the same MR :) (Maybe named explictely 3.5?)13:51
gitlab-br-botMR !1727: .gitlab-ci.yml: Use Debian10 instead Debian9 https://gitlab.com/BuildStream/buildstream/merge_requests/172713:51
jjardonbenschubert: happy to keep Debian9 and add Debian10 if you want13:53
jjardonbut remember this is for the current master, stable branch will keep testing with debian 913:53
*** phoenix has joined #buildstream13:58
gitlab-br-botjjardon opened (was WIP) MR !1728 (jjardon/fedora-31->master: Use fedora31 instead older versions) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/172814:04
benschubertjjardon: right, but do we expect bst2 to be distributed on debian 9? or want it?14:04
jjardonbenschubert: no, it will not happen14:05
jjardonnot even debian 10, actually, as it is stable now14:06
benschubertOh ok, then let's drop python 3.5 on master :)14:06
benschubertDoes it need a ML message?14:06
jjardonmmm, we still have centos rigth? what version of python centos uses?14:07
benschubert3.614:08
jjardonbenschubert: I can improve docs etc with the MR to clarify we depend on python 3.6 from now on, to make it more explicit?14:13
jjardonmmm, why did we remove the installation instructions from master? the installation instructions differ quite a lot between versions ....14:22
* jjardon ponders adding them back14:23
*** phildawson has quit IRC14:28
*** phildawson has joined #buildstream14:30
juergbijjardon: what is missing on the website? buildbox install instructions for master are linked14:50
juergbiiirc, the idea was to have separate install instructions for the different branches on the website, but not readd them to the repo14:51
*** phoenix has quit IRC14:53
juergbihaving install instructions both in the repo and on the website is not ideal, imo, as one of the two will likely get outdated14:53
juergbiunless they are automatically synced14:53
jjardonjuergbi: absolutely agree, but why not leave them in the repo where natureally is going to be better maintained as they are close to the code?14:55
jjardonwe even have this separation here now: https://docs.buildstream.build/14:57
juergbiright, maybe we can include it in the already versioned documentation14:58
juergbibut we should make sure it's easy to find from the main web page14:58
jjardonactually, we have installation instructions in 3 different locations? https://docs.buildstream.build/ , https://buildstream.build/install.html and https://buildstream.gitlab.io/buildstream/ XD14:59
jjardonI'd suggest make  https://buildstream.build/install.html point to  https://docs.buildstream.build/  are we are done15:00
juergbiah, in 1.4 it's already in docs15:00
juergbibut not in master15:00
jjardonyeah, it got removed, for some reason15:01
juergbihttps://gitlab.com/BuildStream/buildstream/merge_requests/87215:01
juergbisome discussion here https://gitlab.com/BuildStream/buildstream/merge_requests/83515:01
*** lachlan has joined #buildstream15:03
jjardonwell, maybe the intentions were good but the result is way more confusing IMHO, and incorrect as well. buildstream dependencies in the stable branche are very different from master15:04
*** lachlan has quit IRC15:09
gitlab-br-bottlater approved MR !1728 (jjardon/fedora-31->master: Use fedora31 instead older versions) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/172815:12
*** phildawson has quit IRC15:19
*** phildawson has joined #buildstream15:22
*** swick has quit IRC15:24
gitlab-br-botmarge-bot123 merged MR !1728 (jjardon/fedora-31->master: Use fedora31 instead older versions) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/172815:24
jjardontlater[m]: are you going to do that mailing announcement or am I suppose to do it?15:25
*** swick has joined #buildstream15:25
tlater[m]jjardon: You're proposing the change, though I can do it if you like15:26
jjardonI proposing update the docker images, not sure I can announce we do not support python 3.5 anymore :) but I do not mind doing it15:27
tlater[m]jjardon: Hrm, debian 9 doesn't look to be EOL yet15:28
tlater[m]jjardon: In that case, I think I'd rather you keep the debian 9 jobs and we'll think about deprecating debian 9/python3.5 when that rolls around15:29
jjardontlater[m]: but why? bst2 will never be packaged in debian 9, not even debian 1015:29
tlater[m]But then you know more about debian release cycles than I do ;)15:30
tlater[m]It will be installed there15:30
* tlater[m] knows several people who install BuildStream despite its lack of distro support15:30
tlater[m]If we drop support for the platform now we'll have a couple of months of confused people attempting to use master but failing15:31
* tlater[m] doesn't like that15:31
*** lachlan has joined #buildstream15:33
jjardonOnly people using debian old-stable though . But sure I will keep it if you think is going to cause a lot of disruption15:35
jjardonthanks for the reviews!15:39
tlater[m]jjardon: Marge didn't like merging both your branches ;p15:41
tlater[m]Ta for the patches :)15:41
jjardonIS the diagram at https://docs.buildstream.build/master/arch_remote_execution.html up-to-date now that casd is a depency?15:46
*** lachlan has quit IRC15:47
*** lachlan has joined #buildstream15:48
tlater[m]jjardon: pretty much. The "Local artifact cache" is now just a buildbox-casd instance.15:55
tlater[m]Oh, actually...15:55
jjardonI see15:55
jjardonbut is not buildboc who talk with the remote?15:56
jjardonbuildbox*15:56
tlater[m]Hm, no, still correct.15:56
tlater[m]I don't think so15:56
tlater[m]But juergbi would know better15:56
juergbiif we consider buildbox-casd to be 'Local artifact cache' it looks correct15:57
juergbithat should probably be made explicit, though15:58
tlater[m]ta for the work on CASDProcessManager aevri16:05
tlater[m]Shame marge is being useless16:05
*** lachlan has quit IRC16:09
*** cs-shadow has quit IRC16:12
*** bochecha has quit IRC16:12
*** bochecha has joined #buildstream16:16
*** lachlan has joined #buildstream16:25
*** lachlan has quit IRC16:35
*** rdale has joined #buildstream16:38
*** rdale has quit IRC16:41
gitlab-br-botmarge-bot123 merged MR !1727 (jjardon/debian-10->master: .gitlab-ci.yml: Use Debian10 instead Debian9) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/172716:51
benschubert^ :( I was looking forward to no more python3.516:59
tlater[m]benschubert: Yeah, it's almost time for that though17:03
tlater[m]EOL happens ~2020, so another month or two :)17:04
benschubertThen we could drop it now17:04
benschubertmaster is not meant to be release before then17:04
benschuberthttps://www.irccloud.com/pastebin/7qR9gSAt/17:04
tlater[m]That's true. I'd feel dirty doing so, though, given that we don't drop support for fedora-30 either17:05
tlater[m]Might be worth it for the async work.17:05
*** cs-shadow has joined #buildstream17:09
benschubertwell, debian 9 will never update buildstream, I don't know for fedora :)17:10
*** phildawson has quit IRC17:11
*** wberrier has joined #buildstream17:25
*** bochecha has quit IRC17:30
*** lachlan has joined #buildstream17:54
aevritlater: Welcome! Thanks for trying to set Marge back on track18:00
*** swick has quit IRC18:22
*** lachlan has quit IRC18:33
gitlab-br-botmarge-bot123 merged MR !1638 (aevri/casdprocessmanager->master: cascache: refactor, extract CASDProcessManager and CASDConnection) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/163818:40
*** swick has joined #buildstream18:47
*** lachlan has joined #buildstream19:07
*** lachlan has quit IRC19:11
*** bochecha has joined #buildstream21:03
*** bochecha has quit IRC21:42

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!