IRC logs for #buildstream for Monday, 2017-10-09

*** tristan has joined #buildstream07:01
*** semanticdesign has joined #buildstream07:42
*** tiagogomes has joined #buildstream08:47
*** tiagogomes has quit IRC08:49
*** tiagogomes has joined #buildstream08:51
*** bochecha has joined #buildstream09:15
*** tlater has joined #buildstream09:17
gitlab-br-botbuildstream: merge request (102-run-ci-as-non-root-user->master: Resolve "Run CI as non-root user") #104 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/10409:25
tlaterI keep trying and failing to run this integration test: https://gitlab.com/BuildStream/buildstream/pipelines/1240735409:27
tlaterIt just always goes over the 1 hour mark09:27
tlaterI had to clear the cache, since its permissions changed, but that means that it has fetch now...09:27
gitlab-br-botbuildstream: merge request (102-run-ci-as-non-root-user->master: WIP: Resolve "Run CI as non-root user") #104 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/10409:28
*** ssam2 has joined #buildstream09:34
*** semanticdesign has quit IRC09:54
*** semanticdesign has joined #buildstream09:57
gitlab-br-botpush on buildstream@48-incorrect-pipeline-total-element-count-for-bst-track (by Tristan Maat): 20 commits (last: setup.py: Make setup.py work on non-linux) https://gitlab.com/BuildStream/buildstream/commit/e8beece45b7de0ee0de4db2254a4e40b44bc8b5810:08
tlaterHm, is it normal for buildstream to take ~2 hours to do 'checking'?10:26
paulsherwoodabsolutely not10:26
tlaterRunning `bst build --track` works round it, it's something about calling `element._cached()` on my specific project.10:46
gitlab-br-botbuildstream: issue #109 ("Add 'flatpak' element to allow generating flatpak apps and runtimes") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/10911:26
tristantlater, that has to be a regression11:35
tristantlater, and is most certainly some kind of network related hang11:35
tlaterThat's possible, given that the gnome modulesets repository seems to be gone11:35
tristanthat's a point, if you depend on gnome711:36
tristanmaybe we need a general tracking bug for various source implementations to ensure they dont hang11:37
tristanalthough I'm not sure how exactly, that you tell git what timeout it should employ for network activity (for example)11:37
tristantlater, however of course; that has to be completely unrelated to element._cached()11:38
tristan(because _cached() checks for presence in local artifact cache, nothing to do with sources on gnome7)11:39
tlaterBuildstream does run with 99.9% CPU usage while trying to compute *something*11:39
tristanalso, it's marginally possible that you think it has to do with _cached() while it has more to do with that initial check for connectivity11:39
tristanand the download of the summary11:39
tlaterI doubt network connections could push this to that high.11:40
tristantlater, anything variants related in whatever project you are building ?11:40
* tristan expects not11:40
tlatertristan: I don't *think* so, I'm not using them at least...11:40
tristanyeah they dont appear in any project I know of except the guadec demo11:41
tristanand they will disappear tomorrow11:41
tristan(and that's the only computationally difficult part I can think of)11:41
tristananyway11:41
tristantlater, assuming you've used the profiling stuff, you probably already know which function call is taking 90% of that time11:42
* tlater forgot about python profiling11:42
tlaterThat looks like a plan x)11:42
tristanso you shouldnt have to know about python specifically11:42
tristanyou should just know about what is in buildstream/_profile.py11:43
tristanset an env var, reproduce, read report11:43
tlaterHm, this only works if it completes, right?11:51
* tlater has not successfully completed a run yet, as it seems to take exponentially more time. Hopefully 6-8 hours.11:54
tristantlater, you sure it's doing something ?11:57
tristanif so, run it on a one, two, three element pipeline11:57
tlatertop thinks it is... But this only seems to happen in this specific project.11:57
tristanso reduce until it's small enough to reproduce ?11:58
tlaterIt's a little very big, but I'll try.11:59
tristanOr alternaltively hack around the profile stuff, add a new domain; make dumps for a more granular subject11:59
tristanyeah well, the question is just running `bst build` with lower level elements until you have something that is A.) small and B.) still reproduces the problem12:00
tristanif the situation cannot be reproduced without the hundreds of elements, that would be unfortunate12:00
tristanharder to profile and figure out12:00
tristanof course you can also sprinkle tracing here and there to find out exactly where you're locking up / what loop is taking time12:01
*** tristan has quit IRC12:05
*** tristan has joined #buildstream12:28
gitlab-br-botpush on buildstream@sam/ci-update-docker-image (by Sam Thursfield): 1 commit (last: Removing ostree was taking fuse-libs with it) https://gitlab.com/BuildStream/buildstream/commit/b53ca14e5dd626d6010a58a4127128050259977b14:27
gitlab-br-botpush on buildstream@sam/ci-update-docker-image (by Sam Thursfield): 1 commit (last: I am dumb) https://gitlab.com/BuildStream/buildstream/commit/b69db57243118aef695ee0ee70af7eaf58cc905c14:36
tlaterssam2: How did the CI ever succeed without fuse?14:38
tlater*fuse-libs ;P14:38
ssam2it was based on an older fedora image14:38
ssam2having loads of faff with dnf in this new one14:38
*** tlater has quit IRC14:47
*** tlater has joined #buildstream14:53
*** jude has quit IRC15:30
gitlab-br-botpush on buildstream@sam/ci-update-docker-image (by Sam Thursfield): 4 commits (last: Remove Dockerfile) https://gitlab.com/BuildStream/buildstream/commit/2a9f4d7daa07ff217bfba3ef3580260e0862ae2b15:47
gitlab-br-botbuildstream: merge request (sam/ci-update-docker-image->master: .gitlab-ci.yml: Follow latest BuildStream Docker image) #105 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/10515:50
*** tlater has quit IRC15:52
*** tlater has joined #buildstream15:54
*** laurenceurhegyi is now known as ltu16:37
*** ssam2 has quit IRC17:04
*** tlater has quit IRC17:31
*** jude has joined #buildstream20:07
*** jude has quit IRC21:31
*** semanticdesign has quit IRC22:06
*** semanticdesign has joined #buildstream22:06
*** semanticdesign has quit IRC23:06
*** semanticdesign has joined #buildstream23:06
*** semanticdesign has quit IRC23:16

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!