IRC logs for #buildstream for Wednesday, 2018-10-31

*** catonano has quit IRC00:03
*** xjuan has quit IRC00:17
*** xjuan has joined #buildstream00:19
*** catonano has joined #buildstream00:20
*** catonano has quit IRC00:21
*** catonano has joined #buildstream00:22
*** catonano has quit IRC00:26
*** catonano has joined #buildstream00:26
*** xjuan has quit IRC00:52
*** slaf has joined #buildstream01:00
*** slaf has joined #buildstream01:01
*** catonano has quit IRC01:37
*** bochecha has quit IRC01:51
*** berendt_ has joined #buildstream02:36
*** WSalmon has quit IRC02:42
*** WSalmon has joined #buildstream02:42
*** Prince781 has quit IRC03:34
*** Prince781 has joined #buildstream04:03
*** Prince781 has quit IRC05:19
*** Prince781 has joined #buildstream05:32
*** catonano has joined #buildstream06:54
*** catonano has quit IRC07:03
*** spacecase has joined #buildstream07:13
*** tristan has joined #buildstream08:26
*** Aexoden has joined #buildstream08:27
*** alatiera_ has joined #buildstream08:44
*** tiagogomes has joined #buildstream09:06
*** catonano has joined #buildstream09:24
*** catonano has quit IRC09:30
*** toscalix has joined #buildstream09:45
toscalix[10:46] <toscalix> If you have any interesting reference about buildstream from ELCE 2018, please add it to this ticket: https://gitlab.com/BuildStream/nosoftware/communication/issues/2809:49
*** jonathanmaw has joined #buildstream09:58
*** raoul has joined #buildstream10:06
*** bochecha has joined #buildstream10:11
*** lachlan has joined #buildstream10:29
valentindWell gitlab is down or something.10:40
toscalixworking fine here10:41
valentindjuergbi, I have made the fixes for the cache server. It is on top of MR !830. Maybe a quick review before I deploy on Freedesktop SDK to look at the performence would be nice.10:41
juergbivalentind: great, will take a look10:43
valentindjuergbi, there is a race condition case where we remove objects that has since been touched. So the client needs to support missing blobs. I also fixed that.10:43
valentindUnfortunately we cannot unlink atomically a file to the condition the mtime has not been changed.10:44
juergbiwe could theoretically use a mutex as it's all in one process10:45
valentindYes. But it might slow down things.10:45
valentindWell, there is this reader/writer lock we could use. I do not remember what it is called.10:46
valentindjuergbi, Although, we do have 2 processes.10:46
juergbiyes, that has to be considered but an uncontended mutex is much faster than a syscall10:46
valentindOne with push and one without.10:46
valentindBoth update mtimes now.10:46
valentindOn the objects.10:46
juergbiah right10:47
*** lachlan has quit IRC10:47
*** jonathanmaw_ has joined #buildstream10:58
*** jonathanmaw has quit IRC10:58
*** ChunkyPuffs has joined #buildstream11:05
*** tristan has quit IRC11:06
*** tristan has joined #buildstream11:14
*** lachlan has joined #buildstream11:15
*** ChunkyPuffs has quit IRC11:16
*** ChunkyPuffs has joined #buildstream11:32
*** lachlan has quit IRC11:37
*** catonano has joined #buildstream11:53
*** lachlan has joined #buildstream12:00
*** lachlan has quit IRC12:11
*** lachlan has joined #buildstream12:19
toscalixtristan: I added the release schedule in this ticket so you can review it before making a communication through the list: https://gitlab.com/BuildStream/nosoftware/communication/issues/2312:21
toscalixthese are the notes I took from our meeting but please review12:21
*** pekster has joined #buildstream12:31
*** jonathanmaw_ is now known as jonathanmaw12:38
*** ChanServ sets mode: +o tristan12:47
tristantoscalix, Oh thanks ! I was in the middle of summing up our discussion on the targets we agreed on for 1.412:47
tristanjuergbi, On that topic, do you recall the detail about requesting execution environments which is important because it avoids breaking changes in the future ?12:48
jonathanmawtlater[m]: I'm looking to refactor Project._ensure_project_dir, and it seems to be copied in buildstream/_frontend/cli.py12:48
jonathanmawdo you know if there's any reason why importing utils would be prohibited?12:49
tristanjonathanmaw, to speed up completions12:49
jonathanmawi.e. I generalise the logic and move it to utils, am I forbidden from importing utils in cli.py?12:49
tristanjonathanmaw, however, iirc we do some on-demand imports in order to avoid loading everything at completion time12:50
tristanso that might be a way around this12:50
jonathanmawtristan: okay, so while 'from utils import foo' is generally discouraged, it makes sense here?12:51
jonathanmawor does that not make any difference, and I should just 'import utils'?12:51
skullmanjonathanmaw: inside the function that's calling it12:51
tristanjonathanmaw, No, I believe that will have the same impact12:51
jonathanmawah, okay12:51
tristanjonathanmaw, as skullman says :)12:51
*** jonathanmaw_ has joined #buildstream12:54
*** jonathanmaw has quit IRC12:54
juergbitristan: I'm planning to write this up tomorrow12:56
*** lachlan has quit IRC12:59
*** inhortte has joined #buildstream13:34
tristanjuergbi, no worry13:37
tristanwhew, ok mail out... that took longer than expected but is quite detailed13:51
* tristan goes to catch the last available pizza...13:51
tpollardmmm pizza13:55
*** tristan has quit IRC13:57
*** lachlan has joined #buildstream14:03
*** realist has joined #buildstream14:08
*** tristan has joined #buildstream14:24
*** lachlan has quit IRC14:34
*** lachlan has joined #buildstream15:05
benschubertCould I get a maintainer look at https://gitlab.com/BuildStream/buildstream/merge_requests/886 ? Since I'm changing some dependencies (removing pytest-runner) thanks!15:08
toscalixvalentind: I lost track of this task. Can you tell me if it is still pending?15:18
toscalixhttps://gitlab.com/BuildStream/nosoftware/alignment/issues/36 ?15:19
valentindtoscalix, the only thing I have done was to move some files from gnome7 to DO's buildstream account.15:29
*** finn_ has joined #buildstream15:29
valentindtiagogomes has documented what we use in https://wiki.gnome.org/Projects/BuildStream/Infrastructure15:30
valentindwe are still waiting on 2 things from operations to fix.15:31
tpollardjonathanmaw_: I've rebased and pushed changes to https://gitlab.com/BuildStream/buildstream/merge_requests/786/ to handle !869, please could you check it's as expected?15:39
toscalixthanks valentind15:39
tpollardThere's an api addition landing in a separate MR to handle extracting the buildtree instead of a full artifact which will land after, at the point I'll refactor15:39
valentindtoscalix, once operations will be done I will update the wiki.15:41
*** jonathanmaw_ is now known as jonathanmaw15:43
jonathanmawtpollard: ok, I'll have a look15:43
tpollardjonathanmaw: cheers :)15:46
*** Prince781 has joined #buildstream15:54
*** lachlan has quit IRC15:57
jonathanmawtpollard: it works as expected16:05
jonathanmawthanks16:05
tpollardthe main point of contention is where and when functionality lands to try and pull buildtrees automatically16:06
tpollardas it stands, conditions such as this just fall back to old behaviour16:07
jonathanmawtpollard: like the pull queue when `bst build` is invoked?16:12
tpollardyep16:13
tpollardan example of where it could be partially pulled is when trying to push an artifact that is missing the buildtree16:14
tpollardthe initial behaviour will be just to skip pushing it16:14
tpollard!869 being another example16:14
jonathanmawtpollard: and the current behaviour seems to be to always push buildtrees16:16
jonathanmawthough this'll get complicated if we pull from one artifact cache (without buildtree), then push it to another artifact cache :/16:17
jonathanmawI'm not sure what to do there16:18
tiagogomesIs this expected "[--:--:--][3020a43f][ push:bootstrap-junction.bst:bootstrap-dev-extract.bst] INFO    Pushed artifact 3020a43f -> https://cache.trustable.io:110022? We are pulling artifacts from a junctioned project, and then pushing them to the subproject cache server16:19
tpollardjonathanmaw: yep, pushing a non complete artifact will not be allowed16:19
*** catonano has quit IRC16:20
tpollardif you want to push it to a new cache, you have to do a partial pull on the buildtree, then push16:20
*** finn has quit IRC16:22
*** ChunkyPuffs has quit IRC16:23
*** ChunkyPuffs has joined #buildstream16:23
*** toscalix has quit IRC16:34
*** catonano has joined #buildstream16:40
*** lachlan has joined #buildstream17:13
*** xjuan has joined #buildstream17:14
*** abderrahim1 has joined #buildstream17:22
*** abderrahim has quit IRC17:24
*** catonano has quit IRC17:28
*** tjf has joined #buildstream17:36
*** Prince781 has quit IRC17:54
*** tiagogomes has quit IRC18:10
*** jonathanmaw has quit IRC18:12
*** raoul has quit IRC18:38
*** tiagogomes has joined #buildstream19:37
*** Prince781 has joined #buildstream19:38
*** tiagogomes has quit IRC20:12
*** catonano has joined #buildstream20:14
*** benschubert has quit IRC20:45
*** alatiera_ has quit IRC20:47
*** lachlan has quit IRC20:50
*** Incepti0n has joined #buildstream21:29
*** Prince781 has quit IRC22:16
*** tristan has quit IRC22:48
*** catonano has quit IRC22:50
*** brlogger has joined #buildstream23:25

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!