IRC logs for #buildstream for Friday, 2019-10-25

*** narispo has quit IRC00:04
*** narispo has joined #buildstream00:05
*** narispo has quit IRC00:29
*** narispo has joined #buildstream00:29
*** narispo has quit IRC00:43
*** narispo has joined #buildstream00:43
*** narispo has quit IRC01:01
*** narispo has joined #buildstream01:01
*** narispo has quit IRC01:15
*** narispo has joined #buildstream01:15
*** narispo has quit IRC01:30
*** narispo has joined #buildstream01:31
*** narispo has quit IRC05:32
*** narispo has joined #buildstream05:36
*** narispo has quit IRC05:58
*** narispo has joined #buildstream05:59
gitlab-br-botBenjaminSchubert approved MR !1667 (juerg/casd-connect->master: cascache.py: Defer attempt to connect to casd until socket file exists) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/166707:45
*** bochecha has joined #buildstream08:02
*** tiagogomes has joined #buildstream08:38
*** santi has joined #buildstream08:59
*** lachlan has joined #buildstream09:30
*** jonathanmaw has joined #buildstream09:31
*** lachlan has quit IRC09:51
*** traveltissues has joined #buildstream09:58
*** lachlan has joined #buildstream10:01
*** lachlan has quit IRC10:11
*** lachlan has joined #buildstream10:16
*** lachlan has quit IRC10:22
*** lachlan has joined #buildstream10:27
*** lachlan has quit IRC10:37
*** lachlan has joined #buildstream10:48
*** lachlan has quit IRC11:03
*** lachlan has joined #buildstream11:10
* tlater[m] wonders what happened to the buildbox-casd output in test outptu11:10
tlater[m]*output11:11
tlater[m]It doesn't seem to show anymore...11:11
tlater[m]bst-artifact-server output, even11:11
*** phildawson_ has quit IRC11:21
tlater[m]juergbi: I'm getting a StatusCode.UNIMPLEMENTED when trying to FetchTree11:21
tlater[m]Is the binary version on buildstream.build up-to-date?11:22
*** rdale has quit IRC11:22
*** rdale has joined #buildstream11:30
*** phoenix has joined #buildstream11:39
*** narispo has quit IRC11:43
*** narispo has joined #buildstream11:43
*** phoenix has quit IRC11:46
tpollardI've updated https://gitlab.com/BuildStream/buildstream/merge_requests/1666 with a snapshot of what the widget looks like with the changes, would appreciate and feedback/review11:46
* tpollard ponders if it makes sense to change the complete-name of the build queue to Elements Built, as that is the criteria for done()11:49
*** lachlan has quit IRC12:01
*** rdale has quit IRC12:02
*** lachlan has joined #buildstream12:03
gitlab-br-botcs-shadow opened MR !1668 (chandan/release-1.91.2->master: Prepare NEWS for 1.91.2 snapshot release) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/166812:07
*** santi has quit IRC12:12
*** rdale has joined #buildstream12:17
*** phoenix has joined #buildstream12:20
*** lachlan has quit IRC12:35
juergbitlater[m]: no, FetchTree supporthas been merged to buildbox-casd master a while ago but the static binary / CI images haven't been updated yet12:35
juergbiI could build an updated static binary12:36
benschubertjuergbi: I have the results for #1126, marginal improvments on medium projects :(12:43
gitlab-br-botIssue #1126: Cache resolution is slow https://gitlab.com/BuildStream/buildstream/issues/112612:43
juergbibenschubert: that's with roughly how many elements?12:45
benschubertroughly 3 thousand12:46
juergbihm, so 30ms average per package, that's indeed pretty slow12:47
juergbibenschubert: could you quickly also provide a profile for bst show with python3 -m cProfile?12:47
benschubertwith everything cached?12:47
juergbiyes12:47
juergbiwell, nothing cached also seems way too slow, so profile of that would also be interesting12:48
juergbibenschubert: was bst show nothing cached'12:49
juergbi'bst show nothing cachec' also much faster before partial CAS / casd?12:49
*** santi has joined #buildstream12:49
benschubertspends 15s loading elements ;)12:50
benschubertso it's reading and finding files on disk that is taking that long12:50
juergbihow many elements big is our debian test stack?12:50
benschubertif I had a stack referencing everything, would be around 10s12:50
benschubert75000, but we don't run `bst show`, we do `bst show debian-stack.bst`12:50
juergbion warm dentry cache, finding 3k files shouldn't take long at all12:52
benschubertthat is fine, the parsing of it we do afterwards is not12:53
juergbidebian base-files.bst references 6k elements and takes around 6s for complete bst show12:55
juergbidon't understand why it would take 24s for a 3k project12:55
juergbithe parsing is done in either case12:56
benschubertnot the parsing sorry12:58
benschubertbut how we process each target12:58
benschubertthat slows down many parts of the code for nothing12:58
*** rdale has quit IRC12:58
benschubertI believe we should remove targets that are included in another one, but that might be tricky to make12:58
tlater[m]juergbi: I recall you saying something about a buildstream project for this12:59
tlater[m]Any chance I could get my filthy fingers on it?12:59
juergbibenschubert: ah, didn't realize that this had such a big impact12:59
benschubertit does :) hence why we built a stack on the debian project12:59
juergbitlater[m]: https://gitlab.com/BuildGrid/buildbox/buildbox-integration12:59
benschuberttry doing a 'bst show' in it :)13:00
tlater[m]ta juergbi !13:00
juergbitlater[m]: i'm still using bst 1.4 to build that, though13:01
*** rdale has joined #buildstream13:01
tlater[m]juergbi: Not bootstrapped yet? ;p13:01
*** rdale has quit IRC13:02
* tlater[m] 's buildstream-for-building is also still 1.4, because no real projects are supported by master yet13:02
*** rdale has joined #buildstream13:05
*** santi has quit IRC13:08
*** rdale has quit IRC13:12
*** phildawson has joined #buildstream13:14
gitlab-br-bottpollard approved MR !1668 (chandan/release-1.91.2->master: Prepare NEWS for 1.91.2 snapshot release) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/166813:14
*** santi has joined #buildstream13:26
gitlab-br-botmarge-bot123 merged MR !1668 (chandan/release-1.91.2->master: Prepare NEWS for 1.91.2 snapshot release) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/166813:27
gitlab-br-bottraveltissues approved MR !1666 (tpollard/render_task_group->master: _frontend/status.py: Complete names when rendering dynamic queue status) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/166613:30
*** phoenix has quit IRC13:31
gitlab-br-bottraveltissues approved MR !1654 (aevri/enable_spawn_ci_3->master: pickle `first_pass_config` factories) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/165413:31
gitlab-br-bottraveltissues opened (was WIP) MR !1651 (traveltissues/1161->master: extend source api and remove private use from workspace plugin) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/165113:41
*** tpollard has quit IRC13:43
*** tpollard has joined #buildstream13:43
gitlab-br-bottraveltissues opened issue #1181 (resolve workspaces stages only once test failure for multiprocessing run) on buildstream https://gitlab.com/BuildStream/buildstream/issues/118113:45
benschubertjuergbi: cleaning up the profile to make it publicly available might be quite annoying :/ I can give pointers however13:48
*** traveltissues has quit IRC13:50
juergbiah, I see13:52
gitlab-br-bottlater opened MR !1670 (tlater/plugin-documentation-improvement->master: format_project.rst: De-obfuscate element/package differences) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/167013:52
*** rdale has joined #buildstream13:53
*** narispo has quit IRC13:53
gitlab-br-bottpollard approved MR !1670 (tlater/plugin-documentation-improvement->master: format_project.rst: De-obfuscate element/package differences) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/167013:56
*** narispo has joined #buildstream13:59
*** narispo has quit IRC14:02
*** narispo has joined #buildstream14:02
*** lachlan has joined #buildstream14:07
*** lachlan has quit IRC14:37
*** lachlan has joined #buildstream14:40
*** santi has quit IRC14:42
*** lachlan has quit IRC14:43
*** lachlan has joined #buildstream14:44
*** jonathanmaw has quit IRC14:45
gitlab-br-botmarge-bot123 merged MR !1654 (aevri/enable_spawn_ci_3->master: pickle `first_pass_config` factories) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/165415:02
*** santi has joined #buildstream15:10
*** lachlan has quit IRC15:29
*** lachlan has joined #buildstream15:37
*** narispo has quit IRC15:54
*** narispo has joined #buildstream15:54
*** tpollard has quit IRC16:08
*** bochecha has quit IRC16:25
gitlab-br-botmarge-bot123 merged MR !1666 (tpollard/render_task_group->master: _frontend/status.py: Complete names when rendering dynamic queue status) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/166616:27
*** santi has quit IRC16:28
*** tiagogomes has quit IRC17:21
gitlab-br-botmarge-bot123 merged MR !1670 (tlater/plugin-documentation-improvement->master: format_project.rst: De-obfuscate element/package differences) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/167017:31
*** narispo has quit IRC17:36
*** narispo has joined #buildstream17:37
*** narispo has quit IRC17:54
*** narispo has joined #buildstream17:54
*** rdale has quit IRC19:51
*** lachlan has quit IRC20:04
*** cs-shadow has quit IRC20:35
*** narispo has quit IRC20:39
*** narispo has joined #buildstream20:41
*** narispo has quit IRC22:00
*** narispo has joined #buildstream23:49
*** narispo has quit IRC23:49
*** narispo has joined #buildstream23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!