IRC logs for #buildstream for Thursday, 2019-10-17

*** narispo has quit IRC00:44
*** ikerperez has joined #buildstream06:56
*** traveltissues has joined #buildstream07:40
gitlab-br-bottraveltissues opened MR !1648 (traveltissues/undofilesareannoying->master: .gitignore: ignore undo files) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/164808:04
gitlab-br-bottpollard approved MR !1648 (traveltissues/undofilesareannoying->master: .gitignore: ignore undo files) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/164808:06
juergbitraveltissues: shouldn't you rather add this to your global git ignore?08:14
juergbinot sure what's considered best practice in this regard08:14
benschubertYeah, I don't think we want to end up with all editors files ignored there or it will become a mess :/08:14
benschubertespecially since we don't have any other such files currently :)08:21
traveltissueswell tbf you could make the same argument for all the currently ignored files08:22
traveltissuesbut i understand your point08:23
benschuberttraveltissues: the currently ignored files are files generated by the project itself, not files generated by people08:24
*** santix has joined #buildstream08:41
*** tiagogomes has joined #buildstream08:41
*** adds68 has joined #buildstream08:53
*** jonathanmaw has joined #buildstream09:05
benschuberthttps://gitlab.com/BuildStream/bst-plugins-experimental/merge_requests/48 to update bst-plugins-experimental with the latest breaking changes on the yaml side09:06
benschubertif someone has time to review09:06
gitlab-br-bottraveltissues opened issue #1172 (mypy failing on master from tempfile api change) on buildstream https://gitlab.com/BuildStream/buildstream/issues/117209:28
*** qinusty has joined #buildstream09:29
*** lachlan has joined #buildstream09:33
*** akvilebirgelyte has quit IRC09:56
*** akvilebirgelyte has joined #buildstream09:56
gitlab-br-bottraveltissues closed MR !1648 (traveltissues/undofilesareannoying->master: .gitignore: ignore undo files) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/164810:02
gitlab-br-botcs-shadow opened issue #1173 (Tests fail with Python 3.8) on buildstream https://gitlab.com/BuildStream/buildstream/issues/117310:05
*** lachlan has quit IRC10:09
*** lachlan has joined #buildstream10:11
*** lachlan has quit IRC10:15
*** lachlan has joined #buildstream10:20
tlater[m]Anyone else seeing this with mypy? https://gitlab.com/BuildStream/buildstream/-/jobs/32360417610:23
tlater[m]That line hasn't been touched, and the variable is definitely supposed to be an Optional[string].10:24
* tlater[m] can't reproduce it locally either - did something in the test image change? Surely it couldn't have, I haven't rebased on top of master in a while...10:26
benschubertmypy version maybe?10:27
tpollardtraveltissues raised an issue about mypy I think10:27
traveltissues#117210:27
benschubertif you tox -r -e mypy?10:27
tlater[m]Heh, I've been running it manually because I didn't realize we had an env for it10:28
* tlater[m] tries that command10:28
tlater[m]No, doesn't show anything locally10:28
tlater[m]Yeah, https://gitlab.com/BuildStream/buildstream/issues/1172 is showing the exact same thing10:29
tlater[m]Ta traveltissues10:29
* tlater[m] wonders how the test issue changed overnight, though10:29
tlater[m]s/issue/image10:29
*** akvilebirgelyte has quit IRC10:47
*** akvilebirgelyte has joined #buildstream10:48
cs-shadowtlater[m]: we don't pin mypy version11:03
cs-shadowso tox pulls in the latest at runtime11:03
tlater[m]cs-shadow: From the issue it seems that the tox version changed11:04
cs-shadowah! then I'm not sure how that would've happened11:04
gitlab-br-bottraveltissues opened MR !1649 (traveltissues/1172->master: tox.ini: pin mypy 0.730) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/164911:20
juergbibenschubert: I'd appreciate feedback on my comment in #112611:56
gitlab-br-botIssue #1126: Cache resolution is slow https://gitlab.com/BuildStream/buildstream/issues/112611:56
*** narispo has joined #buildstream12:05
benschubertjuergbi: I'll have a look12:20
*** santix has quit IRC12:20
gitlab-br-botcs-shadow approved MR !1649 (traveltissues/1172->master: tox.ini: pin mypy 0.730) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/164912:20
gitlab-br-botmarge-bot123 closed issue #1172 (mypy failing on master from tempfile.mkstemp) on buildstream https://gitlab.com/BuildStream/buildstream/issues/117212:25
gitlab-br-botmarge-bot123 merged MR !1649 (traveltissues/1172->master: tox.ini: pin mypy 0.730) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/164912:25
*** santix has joined #buildstream12:38
*** narispo has quit IRC13:07
*** narispo has joined #buildstream13:09
*** santix has quit IRC13:12
*** santix has joined #buildstream13:24
gitlab-br-botaevri opened (was WIP) MR !1650 (aevri/enable_spawn_ci->master: Enable a subset of `tests-spawn-multiprocessing-start-method`) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/165013:26
*** santix has quit IRC13:44
*** mohan43u has quit IRC13:48
*** mohan43u has joined #buildstream13:49
*** santix has joined #buildstream13:52
*** narispo has quit IRC14:12
*** narispo has joined #buildstream14:12
*** santix is now known as santi14:15
tlater[m]Does tracking not change source keys?15:01
* tlater[m] is tracing through what _update_state still does15:04
tlater[m]And it seems to update elements when they finish tracking - I'd expect source keys to change, and that change to be reflected in update_cache_keys()15:04
tlater[m]But update_cache_keys() only seems to update the part of the key that's dictated by dependencies15:04
* tlater[m] is a little confused about this15:04
juergbitlater[m]: for elements that are pending tracking, the source key is calculated only after tracking is done15:05
juergbii.e., it's not changing from one key to another15:05
tlater[m]juergbi: I assume that applies to the *whole* cache key then?15:06
juergbiyes, cache key can only be calculated when the source key is available15:06
tlater[m]Awesome, ta juergbi15:06
* tlater[m] wonders if we could calculate cache keys lazily15:07
*** santi has quit IRC15:07
tlater[m]And then circumvent this whole thing...15:07
juergbitlater[m]: as the cache key dependencies can be pretty deep, I don't think lazy calculation makes sense15:09
juergbialso, availability of a cache key may trigger further actions such as building15:09
juergbiour plan is to rather have a fine-grained push-based model15:10
* tlater[m] is roughly aware of this, but struggles seeing where that is going15:12
juergbiwhenever something happens that may affect state, we update everything that can / needs to be updated15:12
juergbiin contrast to calling update_state() from all these points, we want to only trigger state updates that are relevant to the event15:13
tlater[m]Yup, that makes sense, but I don't really see much more opportunity for that15:14
tlater[m]Although I admittedly haven't  finished reading through the code15:14
*** santi has joined #buildstream15:15
juergbitlater[m]: a possible next step could be to directly call __update_source_state() instead of _update_state() from 'event handlers' that may have an influence on source state15:16
gitlab-br-bottraveltissues opened (was WIP) MR !1653 (traveltissues/notes->master: workspaces via sourcecache MR2.5) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/165315:16
juergbitlater[m]: and then call _update_state() from __update_source_state() if anything has changed15:16
juergbiand later replace further _update_state() calls with e.g. __update_cache_keys() or whatever else more specific thing that should be updated15:18
juergbi(and change __update_cache_keys() to trigger further updates as needed)15:18
tlater[m]I've actually started playing with this15:19
tlater[m]Hrm, I suppose I've just not been through all handlers yet and I'll find things that don't need `__update_source_state()` when I dig far enough15:19
gitlab-br-bottraveltissues opened (was WIP) MR !1651 (traveltissues/1161->master: remove some private api from workspace plugin) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/165115:20
tlater[m]`_schedule_assemble()` seems to be an example of that15:20
juergbiyes, it's not always straight forward to see what depends on what15:21
juergbitlater[m]: you probably do this anyway but due to this tricky dependencies, please try to keep each commit as small as possible15:21
tlater[m]juergbi: Yeah, I've not even started committing anything yet15:22
tlater[m]Just pulling a wire here and there and seeing what breaks15:22
juergbisure, makes sense15:23
tpollardthat's a good metaphor for working on update_state15:23
tlater[m]Hehe15:24
* tlater[m] approaches most of BuildStream like this, tbf15:24
traveltissuesi'd appreciate someone taking a look at !165315:30
traveltissuesbenschubert, will you please have a look at !1651 when you have a chance15:31
benschubertsure15:32
traveltissuesty15:33
*** santi has quit IRC15:46
*** santi has joined #buildstream15:53
*** bochecha has quit IRC15:56
aevriIf anyone else is excited about getting the spawn tests back on track, !1650 is ready for review. There's a small queue of small changes forming behind that one :)16:08
gitlab-br-botMR !1650: Enable a subset of `tests-spawn-multiprocessing-start-method` https://gitlab.com/BuildStream/buildstream/merge_requests/165016:08
* tlater[m] is brimming with excitement16:09
aevrihehe16:10
tlater[m]... partially because I think I'm done fighting with _update_state for the day ;p16:10
aevriWhile those are cooking, I'll probably get back to that casdprocessmanager change you wanted16:10
aevriaha, I hear it doesn't fight fair :)16:11
tlater[m]It has about 5 similarly-named friends who jump in once you think you've grokked it.16:12
* tlater[m] is thankful others have handled its old form though.16:12
tpollardI think python needs ___$method16:13
tlater[m]Hah!16:14
aevriI think I've been out of the loop a little while - does thumbs up on a review mean 'approved', or is it a general 'yay for this sort of thing'?16:31
aevriI've another review with some thumbs up but no explicit approval, I'm not sure if that means it's good to go :)16:31
*** lachlan has quit IRC16:32
* cs-shadow personally uses it for 'yay for this sort of thing'16:36
juergbiI don't think we've defined this in the project, so I suspect it's used in different ways16:39
aevriAlrighty, I'll press for explicit approval in those cases then, thanks!16:41
traveltissuesmarge is broken?16:48
traveltissueshttps://gitlab.com/BuildStream/buildstream/merge_requests/1653#note_23203170316:48
*** tiagogomes has quit IRC16:52
traveltissuesthe runner seems to be falling over16:56
traveltissueshttps://gitlab.com/BuildStream/buildstream/-/jobs/32373666416:56
traveltissues`fatal: unable to access 'https://gitlab.com/BuildStream/bst-plugins-experimental.git/': `16:57
gitlab-br-botBenjaminSchubert opened MR !1656 (bschubert/bump-bst-experimental-version->master: .gitlab-ci.yml: Update bst-plugins-experimental version) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/165617:00
*** jonathanmaw has quit IRC17:05
*** santi has quit IRC17:13
*** traveltissues has quit IRC17:13
gitlab-br-botcs-shadow approved MR !1656 (bschubert/bump-bst-experimental-version->master: .gitlab-ci.yml: Update bst-plugins-experimental version) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/165617:34
*** slaf has quit IRC17:35
*** slaf has joined #buildstream17:42
*** slaf has joined #buildstream17:42
*** slaf has joined #buildstream17:42
*** slaf has joined #buildstream17:43
*** slaf has joined #buildstream17:43
*** slaf has joined #buildstream17:43
*** slaf has joined #buildstream17:44
*** slaf has joined #buildstream17:44
*** slaf has joined #buildstream17:44
*** slaf has joined #buildstream17:45
benschubertDoes someone has access to  marge? It is confused17:46
gitlab-br-botjjardon opened issue #1174 (overnigth test are failing: AttributeError: 'buildstream.node.SequenceNode' object has no attribute '_strip_node_info') on buildstream https://gitlab.com/BuildStream/buildstream/issues/117418:50
*** narispo has quit IRC18:53
*** narispo has joined #buildstream18:54
*** narispo has quit IRC19:14
*** narispo has joined #buildstream19:14
*** narispo has quit IRC19:17
*** narispo has joined #buildstream19:17
*** narispo has quit IRC19:38
*** narispo has joined #buildstream19:38
*** narispo has quit IRC22:04
*** narispo has joined #buildstream22:05
*** narispo has quit IRC22:54
*** narispo has joined #buildstream22:54

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!