IRC logs for #buildstream for Thursday, 2018-08-16

*** inigomartinez has joined #buildstream00:01
*** cgmcintyre[m] has joined #buildstream00:11
*** mattiasb has joined #buildstream00:32
*** m_22[m] has joined #buildstream00:39
*** awacheux[m] has joined #buildstream01:24
*** segfault3[m] has joined #buildstream02:32
*** krichter[m] has joined #buildstream02:43
*** connorshea[m] has joined #buildstream02:56
*** waltervargas[m] has joined #buildstream03:36
*** leopi has joined #buildstream03:41
*** ptomato[m] has joined #buildstream04:06
*** leopi has quit IRC05:26
*** leopi has joined #buildstream05:28
*** dineshdb[m] has joined #buildstream05:34
*** tristan has joined #buildstream05:36
*** bethwhite_ has joined #buildstream06:09
*** bethwhite_ has quit IRC06:09
*** tristan has quit IRC06:46
*** leopi has quit IRC07:02
*** ptomato[m] has quit IRC07:02
*** waltervargas[m] has quit IRC07:02
*** krichter[m] has quit IRC07:02
*** segfault3[m] has quit IRC07:02
*** awacheux[m] has quit IRC07:02
*** m_22[m] has quit IRC07:02
*** mattiasb has quit IRC07:02
*** theawless[m] has quit IRC07:02
*** oknf[m] has quit IRC07:02
*** jjardon has quit IRC07:02
*** mablanch has quit IRC07:02
*** tintou has quit IRC07:02
*** gitlab-br-bot has quit IRC07:02
*** tiagogomes has quit IRC07:02
*** mohan43u has quit IRC07:02
*** milloni has quit IRC07:02
*** aiden has quit IRC07:02
*** jmac has quit IRC07:02
*** tiagogomes_ has quit IRC07:02
*** jennis has quit IRC07:02
*** adds68 has quit IRC07:02
*** lantw44 has quit IRC07:02
*** qinusty has quit IRC07:02
*** coldtom has quit IRC07:02
*** Trevinho has quit IRC07:02
*** dineshdb[m] has quit IRC07:02
*** connorshea[m] has quit IRC07:02
*** cgmcintyre[m] has quit IRC07:02
*** inigomartinez has quit IRC07:02
*** persia has quit IRC07:02
*** albfan[m] has quit IRC07:02
*** ssssam[m] has quit IRC07:02
*** abderrahim[m] has quit IRC07:02
*** TingPing has quit IRC07:02
*** kailueke[m] has quit IRC07:02
*** skullman has quit IRC07:02
*** tlater has quit IRC07:02
*** finn_ has quit IRC07:02
*** csoriano has quit IRC07:02
*** cs-shadow has quit IRC07:02
*** Nexus has quit IRC07:02
*** ironfoot has quit IRC07:02
*** bethw has quit IRC07:02
*** rafaelff[m] has quit IRC07:02
*** Demos[m] has quit IRC07:02
*** jjardon[m] has quit IRC07:02
*** pro[m] has quit IRC07:02
*** alatiera has quit IRC07:02
*** asingh_[m] has quit IRC07:02
*** jjardon has joined #buildstream07:02
*** mablanch has joined #buildstream07:02
*** tintou has joined #buildstream07:02
*** gitlab-br-bot has joined #buildstream07:02
*** tiagogomes has joined #buildstream07:02
*** milloni has joined #buildstream07:02
*** aiden has joined #buildstream07:02
*** jmac has joined #buildstream07:02
*** tiagogomes_ has joined #buildstream07:02
*** jennis has joined #buildstream07:02
*** lantw44 has joined #buildstream07:02
*** adds68 has joined #buildstream07:02
*** coldtom has joined #buildstream07:02
*** qinusty has joined #buildstream07:02
*** Trevinho has joined #buildstream07:02
*** dineshdb[m] has joined #buildstream07:02
*** connorshea[m] has joined #buildstream07:02
*** cgmcintyre[m] has joined #buildstream07:02
*** inigomartinez has joined #buildstream07:02
*** persia has joined #buildstream07:02
*** albfan[m] has joined #buildstream07:02
*** ssssam[m] has joined #buildstream07:02
*** abderrahim[m] has joined #buildstream07:02
*** TingPing has joined #buildstream07:02
*** kailueke[m] has joined #buildstream07:02
*** skullman has joined #buildstream07:02
*** tlater has joined #buildstream07:02
*** csoriano has joined #buildstream07:02
*** finn_ has joined #buildstream07:02
*** cs-shadow has joined #buildstream07:02
*** Nexus has joined #buildstream07:02
*** ironfoot has joined #buildstream07:02
*** bethw has joined #buildstream07:02
*** rafaelff[m] has joined #buildstream07:02
*** Demos[m] has joined #buildstream07:02
*** jjardon[m] has joined #buildstream07:02
*** pro[m] has joined #buildstream07:02
*** alatiera has joined #buildstream07:02
*** asingh_[m] has joined #buildstream07:02
*** mohan43u has joined #buildstream07:02
*** ptomato[m] has joined #buildstream07:37
gitlab-br-botbuildstream: merge request (valentindavid/fallback_mirror_ostree->master: Fix ostree repository mirroring) #658 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/65807:43
*** waltervargas[m] has joined #buildstream07:48
*** krichter[m] has joined #buildstream07:49
*** bochecha has joined #buildstream07:52
*** segfault3[m] has joined #buildstream07:54
gitlab-br-botbuildstream: merge request (tristan/notifications->master: _frontend/app.py: Notify session completions) #672 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/67207:56
*** tpollard has joined #buildstream07:56
*** tristan has joined #buildstream07:56
gitlab-br-botbuildstream: merge request (tristan/notifications-1.2->bst-1.2: _frontend/app.py: Notify session completions) #673 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/67307:58
gitlab-br-botbuildstream: merge request (Qinusty/531-fetch-retries-on-terminate->master: Prevent jobs retrying on terminate) #662 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/66208:18
gitlab-br-botbuildstream: merge request (Qinusty/531-fetch-retries-on-terminate->master: WIP: Prevent jobs retrying on terminate) #662 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/66208:18
*** awacheux[m] has joined #buildstream08:18
*** rdale has joined #buildstream08:19
*** mattiasb has joined #buildstream08:34
gitlab-br-botbuildstream: merge request (valentindavid/fallback_mirror_git-1.2->bst-1.2: Delay refreshing git submodule until we have a clone) #666 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/66608:37
*** m_22[m] has joined #buildstream08:38
*** leopi has joined #buildstream08:43
gitlab-br-botbuildstream: merge request (tristan/notifications->master: _frontend/app.py: Notify session completions) #672 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/67208:53
gitlab-br-botbuildstream: merge request (tristan/notifications-1.2->bst-1.2: _frontend/app.py: Notify session completions) #673 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/67308:53
gitlab-br-botbuildstream: issue #538 ("ostree mirror fallback breaks assertion") changed state ("closed") https://gitlab.com/BuildStream/buildstream/issues/53808:54
gitlab-br-botbuildstream: merge request (valentindavid/fallback_mirror_ostree->master: Fix ostree repository mirroring) #658 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/65808:54
gitlab-br-botbuildstream: issue #538 ("ostree mirror fallback breaks assertion") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/53808:55
gitlab-br-botbuildstream: merge request (tpollard/483->master: plugins/git.py: Warn if ref is not in given track) #564 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/56408:56
*** theawless[m] has joined #buildstream08:56
gitlab-br-botbuildstream: merge request (tristan/notifications->master: _frontend/app.py: Notify session completions) #672 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/67208:57
*** oknf[m] has joined #buildstream08:57
*** jonathanmaw has joined #buildstream09:03
tiagogomesWe also might need to thing about cleaning up sources directory. An imported sysroot tarball consumes a considerable amount of space09:34
*** dtf has joined #buildstream09:37
gitlab-br-botbuildstream: merge request (willsalmon/CacheExpiryTest->master: Trying to mitigate a file system issue) #595 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/59509:40
*** WSalmon_ is now known as WSalmon09:42
*** tristan has quit IRC09:43
*** tristan has joined #buildstream09:43
tiagogomesadds68, which python3 version you used to reproduce https://gitlab.com/BuildStream/buildstream/issues/577 ?09:53
gitlab-br-botbuildstream: merge request (willsalmon/CacheExpiryTest->master: Trying to mitigate a file system issue) #595 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/59509:53
adds68tiagogomes, 3.7.009:53
tiagogomesthanks09:54
*** ernestask has joined #buildstream09:55
tiagogomesadds68, you are too much into the future09:55
*** ernestask has left #buildstream09:55
adds68tiagogomes, haha!09:56
*** leopi has quit IRC09:59
*** alatiera_ has joined #buildstream10:01
gitlab-br-botbuildstream: merge request (tiagogomes/issue-577->master: cascache: use errno module) #674 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/67410:06
coldtomwill includes be in 1.210:08
qinusty*coughs*10:08
gitlab-br-botbuildstream: merge request (tiagogomes/issue-577-backport->bst-1.2: cascache: use errno module) #675 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/67510:10
*** valentind has quit IRC10:11
*** jennis has quit IRC10:11
*** tiagogomes_ has quit IRC10:11
*** aiden has quit IRC10:11
*** milloni has quit IRC10:11
*** mablanch has quit IRC10:11
*** bethw has quit IRC10:11
*** Nexus has quit IRC10:11
*** WSalmon has quit IRC10:11
*** finn_ has quit IRC10:11
*** tlater has quit IRC10:11
*** jonathanmaw has quit IRC10:11
*** ChanServ sets mode: +o tristan10:11
tristanWe're back !10:12
tpollardty nickserv \o/10:12
* tristan pets nickserv10:12
*** phildawson has quit IRC10:12
*** flatmush has quit IRC10:12
*** tiagogomes has quit IRC10:12
*** johnward has quit IRC10:12
*** laurence has quit IRC10:13
tristanWe're still getting errors from the autotools download from the new mirror :-S10:15
tristanError mirroring https://ftpmirror.gnu.org/gnu/automake/automake-1.16.tar.gz: <urlopen error [SSL: SSLV3_ALERT_HANDSHAKE_FAILURE] sslv3 alert handshake failure (_ssl.c:720)>10:15
tristanhttps://gitlab.com/BuildStream/buildstream/-/jobs/8972199710:16
tristanspurious now10:16
*** leopi has joined #buildstream10:17
*** aiden has joined #buildstream10:20
*** tiagogomes has joined #buildstream10:20
*** phildawson has joined #buildstream10:20
*** jonathanmaw has joined #buildstream10:20
*** tlater has joined #buildstream10:20
*** phildawson has quit IRC10:24
*** jonathanmaw has quit IRC10:24
*** tiagogomes has quit IRC10:24
*** WSalmon has joined #buildstream10:24
*** phildawson has joined #buildstream10:24
*** jonathanmaw has joined #buildstream10:24
*** tlater has quit IRC10:26
*** aiden has quit IRC10:26
WSalmonis everything fixed? is the chanel back up?10:26
*** valentind has joined #buildstream10:26
*** flatmush has joined #buildstream10:26
*** aiden has joined #buildstream10:26
*** jonathanmaw has quit IRC10:26
*** phildawson has quit IRC10:26
*** WSalmon has quit IRC10:26
*** tiagogomes has joined #buildstream10:26
*** laurence has joined #buildstream10:27
qinustyIndeed tristan, we observed that yesterday. ftp.gnu.org had 0% success though. I guess we should disable the autotools and junctions tests for now?10:27
*** WSalmon has joined #buildstream10:27
*** phildawson has joined #buildstream10:27
*** jonathanmaw has joined #buildstream10:27
*** flatmush has joined #buildstream10:28
*** phildawson has quit IRC10:28
*** jonathanmaw has quit IRC10:28
*** WSalmon has quit IRC10:28
tristanqinusty, I'm starting to think we should host one in the gitlab group10:29
*** flatmush has joined #buildstream10:29
*** tiagogomes has joined #buildstream10:29
*** WSalmon has joined #buildstream10:29
*** jonathanmaw has joined #buildstream10:29
qinustyThat's a point though. Can sources specify a fallback url?10:29
qinustywe could just do that10:29
*** flatmush has joined #buildstream10:30
*** WSalmon has quit IRC10:31
*** tiagogomes has quit IRC10:31
*** jonathanmaw has quit IRC10:31
*** WSalmon has joined #buildstream10:31
*** phildawson has joined #buildstream10:31
*** jonathanmaw has joined #buildstream10:31
*** aiden has quit IRC10:31
*** valentind has quit IRC10:31
*** laurence has quit IRC10:31
*** valentind has joined #buildstream10:33
*** aiden has joined #buildstream10:33
*** laurence has joined #buildstream10:33
*** jonathanmaw has quit IRC10:33
*** phildawson has quit IRC10:33
*** WSalmon has quit IRC10:33
*** phildawson has joined #buildstream10:34
*** WSalmon has joined #buildstream10:34
*** jonathanmaw has joined #buildstream10:34
*** flatmush has joined #buildstream10:35
*** flatmush has joined #buildstream10:36
*** flatmush has joined #buildstream10:36
*** flatmush has joined #buildstream10:36
*** laurence has quit IRC10:37
*** aiden has quit IRC10:37
*** valentind has quit IRC10:37
*** laurence has joined #buildstream10:38
*** aiden has joined #buildstream10:38
*** flatmush has joined #buildstream10:38
*** mablanch has joined #buildstream10:38
*** WSalmon has quit IRC10:38
*** flatmush has quit IRC10:38
*** jonathanmaw has quit IRC10:38
*** phildawson has quit IRC10:38
*** phildawson has joined #buildstream10:38
*** WSalmon has joined #buildstream10:38
*** jonathanmaw has joined #buildstream10:38
*** flatmush has joined #buildstream10:39
*** laurence has quit IRC10:41
*** mablanch has quit IRC10:41
*** aiden has quit IRC10:41
*** flatmush has joined #buildstream10:42
*** flatmush has joined #buildstream10:43
*** valentind has joined #buildstream10:43
*** laurence has joined #buildstream10:43
*** aiden has joined #buildstream10:43
*** flatmush has joined #buildstream10:43
*** flatmush has joined #buildstream10:44
*** Nexus has joined #buildstream10:46
*** flatmush has joined #buildstream10:47
*** milloni has joined #buildstream10:48
*** flatmush has joined #buildstream10:48
*** mablanch has joined #buildstream10:48
*** tiagogomes has joined #buildstream10:49
*** johnward has joined #buildstream10:49
*** tlater has joined #buildstream10:50
tiagogomesThere are a scary number of opened MRs. 45!10:50
*** bethw has joined #buildstream10:50
*** Nexus has joined #buildstream10:51
tristantiagogomes, indeed; although that number is conflated with completely irrelevant side branches marked WIP, which even tend to get opened way before significant code is on the branch, probably some existing abandoned WIPs in there too10:53
Nexusthere seems to be a limit to what you can set the "soft limit" on a mac using `resource.setrlimit()` which is (for some reason) 4915210:58
Nexusand that isn't the hard limit, because that's ~9e+1810:58
Nexusany thoughts on what i shoulddo for this?10:58
qinustyThere are a few WIP branches which have been dropped and forgotten about. Maybe we need a tidy up at some point11:01
gitlab-br-botbuildstream: merge request (willsalmon/CacheExpiryTest->master: Trying to mitigate a file system issue) #595 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/59511:01
tristanqinusty, that, and a ton of branches which were either abandoned, or people forgot to press the "Delete source branch after merge" button11:01
qinustyYeah, I wasn't ever sure what the process was for that :D I'm doing it now, can we not set it as a default?11:02
tristanwould be really nice to get rid of those, it's more tricky when people forget to prefix the branch names with a recognizable "username/"11:02
tristanqinusty, maybe, if we hosted the gitlab instance11:02
* tristan checks the dashboard just incase11:02
tristanqinusty, https://gitlab.com/gitlab-org/gitlab-ce/issues/3288411:04
* qinusty notes that his .bst file just got reformatted during track on a branch off master.11:06
*** milloni has quit IRC11:06
*** flatmush has quit IRC11:06
*** mablanch has quit IRC11:06
*** tiagogomes has quit IRC11:06
*** johnward has quit IRC11:06
*** tlater has quit IRC11:06
*** bethw has quit IRC11:06
*** Nexus has quit IRC11:06
*** Nexus has joined #buildstream11:06
qinustyvalentind, this patch got merged right?11:06
*** flatmush has joined #buildstream11:06
*** persia has quit IRC11:06
*** persia has joined #buildstream11:06
valentindqinusty, Which one?11:06
qinusty^ yaml reformatting on track11:06
*** flatmush has joined #buildstream11:07
*** flatmush has joined #buildstream11:07
valentindqinusty, I do not think so. Let me check11:07
*** WSalmon has quit IRC11:07
*** phildawson has quit IRC11:07
*** jonathanmaw has quit IRC11:07
valentindI do not remember getting a review.11:07
*** mablanch has joined #buildstream11:08
*** bethw has joined #buildstream11:08
*** WSalmon has joined #buildstream11:08
*** phildawson has joined #buildstream11:08
*** tiagogomes has joined #buildstream11:08
*** jonathanmaw has joined #buildstream11:08
*** flatmush has joined #buildstream11:08
*** milloni has joined #buildstream11:09
valentindqinusty, !622 is not merged. Had not review.11:09
*** johnward has joined #buildstream11:09
qinustytristan, I'm working on the message api rework that tlaater started on, it might require a lot of work to have "every commit passes master" unless I squash a few commits, the rebase was pretty big.11:09
gitlab-br-botbuildstream: merge request (tiagogomes/issue-500->master: Handle gracefully files of type socket) #570 changed state ("closed"): https://gitlab.com/BuildStream/buildstream/merge_requests/57011:09
*** tlater has joined #buildstream11:09
qinustyCheers valentind, I was just concerned about a regression. Hopefully we can get that bugfix in for 1.2?11:09
valentindqinusty, sure. If it gets a review.11:10
*** Nexus has joined #buildstream11:11
tiagogomesWasn't this fixed:11:11
tiagogomes[00:00:02][02115d18][fetch:hello.bst                     ] FAILURE Fetching https://ftpmirror.gnu.org/gnu/automake/automake-1.16.tar.gz11:11
tiagogomes[00:00:02][02115d18][fetch:hello.bst                     ] FAILURE tar source at hello.bst [line 16 column 2]: Error mirroring https://ftpmirror.gnu.org/gnu/automake/automake-1.16.tar.gz: <urlopen error [SSL: SSLV3_ALERT_HANDSHAKE_FAILURE] sslv3 alert handshake failure (_ssl.c:720)>11:11
tristantiagogomes, was about to mention that, again...11:11
tristanhttps://gitlab.com/BuildStream/buildstream/-/jobs/89721997 <-- I've got that like 6 times in a row for a debian 9 suite11:11
tiagogomesThought the problem might be the SSL, not the server being down11:12
tiagogomes*though11:12
* qinusty thinks disabling the tests is our best bet for now11:12
tiagogomesAh, it it fails only on Debian…11:12
tristanI think it's possible that this is a legitimate BuildStream, or maybe debian 9 dependency related issue, indeed11:12
tiagogomesI prefer using http instead of https11:12
tristantiagogomes, have you seen it fail elsewhere ?11:12
tiagogomesJust on a Debian job11:13
tristanyes, in fact I think we probably should be doing that; seeing as we do assert the sha256sum after, anyway11:13
tristanme too, ok; so lets change that to http ?11:13
tristanit's also potentially more optimized, we can have potentially cached requests11:14
gitlab-br-botbuildstream: merge request (valentindavid/fallback_mirror_git-1.2->bst-1.2: Delay refreshing git submodule until we have a clone) #666 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/66611:14
*** phildawson has quit IRC11:15
tiagogomesOk. I am going to do that11:16
tiagogomesBut it is weird that it doesn't fail for the other https fetches11:17
gitlab-br-botbuildstream: merge request (valentindavid/fallback_mirror_ostree-1.2->bst-1.2: Fix ostree repository mirroring) #667 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/66711:18
gitlab-br-botbuildstream: merge request (tiagogomes/disable-https-gnu-repo->master: Use http instead of https for the gnu ftp mirror) #676 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/67611:20
paulsherwoodjonathanmaw: does bst need to care about round tripping for *reading* yaml?11:37
*** tristan has quit IRC11:39
gitlab-br-botbuildstream: issue #520 ("Race condition when calculating disk usage") changed state ("closed") https://gitlab.com/BuildStream/buildstream/issues/52011:43
*** tpollard has quit IRC11:47
jonathanmawpaulsherwood: I don't think so. Are you suggesting we use a different yaml parser when we're invoking buildstream in a way that's not going to write back any elements?11:48
persiaGiven the number of undefined behaviours in the YAML standard, that strikes me as being potentially risky (although it does mean users will be forced to stick to lowest-common-denominator YAML)11:50
skullmanplus even fast yaml parsers are slow compared to a format designed to be fast for machine parsing11:51
persiaAs having human-readable files is a requirement, I'm not sure we can go that way.  The idea of "compiled BST" or similar strikes me as risky in lots of ways.11:52
skullmanpersia: I understood the point was that we could cache the parsing in a "compiled BST" format11:53
persiaYes.  I'm just expressing the opinion that this may be risky (much as beginning students sometimes get confused when they edit a C file and the behaviour of their program doesn't change).11:55
persiaIt may be that the benefit outweighs the risk, of course.11:55
valentindskullman, do you know the reason why yaml is bad for parsing?11:55
skullmanvalentind: I've not investigated it myself, just second-hand from other projects that parsing lots of yaml files was their bottleneck.11:57
*** tristan has joined #buildstream11:57
*** ChanServ sets mode: +o tristan12:01
gitlab-br-botbuildstream: merge request (tiagogomes/disable-https-gnu-repo-backport->bst-1.2: Use http instead of https for the gnu ftp mirror) #677 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/67712:05
valentindYaml looks to me LL(1). But I might be wrong. I really do not see what is difficult in the parsing. I suspect in the case of ruamel, it is building the data structure that is painful.12:08
*** phildawson has joined #buildstream12:32
gitlab-br-botbuildstream: merge request (tiagogomes/disable-https-gnu-repo->master: Use http instead of https for the gnu ftp mirror) #676 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/67612:33
qinustyIs it trivial to spin up one of our test docker instances to run my tests locally? Rather than using my system dependencies? The whole pylint issues with certain installations is slightly irritating12:41
gitlab-br-botbuildstream: merge request (valentindavid/workspace_reverse_dependencies->master: Invalidate reverse dependencies to scheduled element with workspace) #669 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/66912:43
phildawsonqinusty, pretty much you just need to install buildstream itself inside the container12:43
qinustyWell I'd need a copy of my directory as it currently stands12:43
qinustydocker volumes?12:44
gitlab-br-botbuildstream: merge request (valentindavid/fix-broken-indentation-after-track->master: Fix broken indentation after track) #622 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/62212:44
skullmanqinusty: take a look at the bst-here script in contrib/12:44
qinustybst-here is for running buildstream rather than testing though, I assume adaptation is required?12:44
* skullman runs it in a directory above his buildstream checkout and `cd buildstream && pip3 install --update .`12:45
qinustyseems to the job skullman, ty12:50
qinustyAlso, I might have to rethink the test skullman, https://gitlab.com/BuildStream/buildstream/merge_requests/662 seems to fail on CI 100% of the time but not locally.12:52
Nexusjuergbi: would you be able to cast your mind back to february and 0e0990c5557f3b454f54f412d3c28c4bd4b4aaf7 and look at buildstream/_frontend/app.py +125 for me please?12:56
Nexusi'm having issues dur to MacOSX not supporting setting your soft limit that high12:57
gitlab-br-botbuildstream: merge request (tiagogomes/disable-https-gnu-repo-backport->bst-1.2: Use http instead of https for the gnu ftp mirror) #677 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/67712:58
gitlab-br-botbuildstream: merge request (Qinusty/message-helpers->master: WIP: Continued work on improving BuildStream messaging API) #670 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/67013:01
*** leopi has quit IRC13:05
*** leopi has joined #buildstream13:06
*** leopi has quit IRC13:10
*** leopi has joined #buildstream13:10
qinustyFew minor points on the indentation fix valentind, other than that it looks good to go.13:10
*** xjuan has joined #buildstream13:19
WSalmonlots of stuff ends up in ~/.cache/buildstream but then workspace stuff ends up in each projects .bst, i can guess why it would be like this but are there any good places to find the discussion as to why?13:20
qinustyIs there a reason our CI doesnt run with --addopts "-s"? The prints the stderr and stdout of the tests.13:28
juergbiNexus: I don't know why this approach doesn't work on macOS. however, as per commit message, it's only needed for SafeHardlinks FUSE, which is not needed for remote execution13:32
juergbishould only be requires when we actually want to build native macOS applications, which is not on the immediate roadmap13:33
Nexusjuergbi: no, but it breaks a lot of tests which are otherwise fine13:33
juergbiNexus: we could simply add a conditional to disable this on macOS13:35
Nexusshould we?13:35
juergbiI don't see a better way to handle this at the moment13:36
Nexuskk13:36
juergbibtw: with the new FUSE layer (BuildBox), this is not that important anymore, it can deal with limited number of open fds13:36
gitlab-br-botbuildstream: merge request (valentindavid/fallback_mirror_ostree-1.2->bst-1.2: Fix ostree repository mirroring) #667 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/66713:37
qinustyCan anyone assist me with what could be causing this issue with my new test? https://paste.gnome.org/phjkjpe5313:39
gitlab-br-botbuildstream: merge request (valentindavid/fix-broken-indentation-after-track->master: Fix broken indentation after track) #622 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/62213:39
qinustybwrap permissions to create namespaces13:39
qinustywithin docker13:39
qinustye.g. CI environment13:40
gitlab-br-botbuildstream: merge request (tiagogomes/disable-https-gnu-repo->master: Use http instead of https for the gnu ftp mirror) #676 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/67613:43
Nexusshouldn't the docker be root anyway?13:47
qinustyCI runs tests under the buildstream user13:47
qinustyanyway, it turns out the fix in the error message worked. But this leaves me no closer to understanding why the CI fails but it doesn't locally13:48
qinustyCI doesn't produce stdout from the tests, so I can't see what's going wrong13:48
qinustys/stdout/"stdout/stderr"13:48
gitlab-br-botbuildstream: merge request (Qinusty/531-fetch-retries-on-terminate->master: WIP: Prevent jobs retrying on terminate) #662 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/66213:49
Nexustry making a CI run with CI_DEBUG_TRACE set to true?13:49
qinustyHow does one do that? Push with a change to .gitlab-ci.yaml?13:50
qinustyThe issue is the lack of `-s` param in our call to ./setup.py test --addopts13:51
Nexusin the CI/CD option, you can select a branch to run and theres a variables field, though i've never used it13:51
gitlab-br-botbuildstream: merge request (Qinusty/531-fetch-retries-on-terminate->master: WIP: Prevent jobs retrying on terminate) #662 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/66213:52
gitlab-br-botbuildstream: merge request (tiagogomes/issue-577->master: cascache: use errno module) #674 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/67413:55
gitlab-br-botbuildstream: merge request (tiagogomes/issue-577-backport->bst-1.2: cascache: use errno module) #675 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/67513:55
gitlab-br-botbuildstream: merge request (Qinusty/531-fetch-retries-on-terminate->master: WIP: Prevent jobs retrying on terminate) #662 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/66213:56
*** tpollard has joined #buildstream13:56
gitlab-br-botbuildstream: merge request (valentindavid/fix-broken-indentation-after-track->master: Fix broken indentation after track) #622 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/62214:08
WSalmonnow that build stream passes on standard CI is it worth setting up a single test like tests-unix that runs on the standard CI? or did you abandon them a good reason? https://gitlab.com/willsalmon/buildstream/pipelines/2803804514:12
WSalmonif its cost or something then we could just have it run now and again, it seem that supporting the free tier runners would be a good thing, to incurage new people?14:14
WSalmonjust a thought14:14
tristanWSalmon, fwiw we invite everyone to ask for developer access and push their branches directly in our repo, using our CI setup is one of the reasons14:17
tristan(note this is different from commit access; we always hand out developer status to anyone who asks)14:17
WSalmonfair, i presume you dont have any secrets then, i presumed that anyone with developer could alter the .gitlab-ci.yml to pull them out?14:21
gitlab-br-botbuildstream: merge request (Qinusty/message-helpers->master: WIP: Continued work on improving BuildStream messaging API) #670 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/67014:21
tristanWSalmon, well, that is a fair point; but nothing really sensitive at this point no14:22
WSalmoncool, thanks14:23
gitlab-br-botbuildstream: merge request (tristan/notifications->master: _frontend/app.py: Notify session completions) #672 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/67214:26
gitlab-br-botbuildstream: merge request (tristan/notifications-1.2->bst-1.2: _frontend/app.py: Notify session completions) #673 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/67314:26
tristanqinusty, it would be really nice to avoid `-s` in CI; alternatively, it would be nice if we could get pytest to put that output in a log file, and create an artifact for it14:29
tristan(a "gitlab artifact")14:29
* qinusty will look into what that entails. 14:31
qinustyMy current fix is just enabling -s in a commit for this single build I'm trying to debug14:31
tristanoh yeah I see14:33
tristanqinusty, I'd just rather not have it by default; its really hard to read :)14:33
qinustyI agree14:33
tristanqinusty, if there is a way to tell pytest to put it in a file though; we can have the best of both worlds14:33
* tristan is resolving a page with an example14:34
tristanqinusty, e.g., for the gitlab side at least: https://gitlab.gnome.org/GNOME/gnome-build-meta/blob/master/.gitlab-ci.yml#L6414:35
tristanthat will create a browsable/downloadable folder with whatever you put in it, regardless of whether the job passed or failed14:35
tristan(of course, you still have to wait for the job to finish failing in order to view the log)14:36
gitlab-br-botbuildstream: merge request (valentindavid/fallback_mirror_ostree-1.2->bst-1.2: Fix ostree repository mirroring) #667 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/66714:36
gitlab-br-botbuildstream: merge request (tristan/notifications-1.2->bst-1.2: _frontend/app.py: Notify session completions) #673 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/67314:38
valentindI think you can add a handler to the logger that write into files. I have done that in the past. But it has to do with python's logging.14:38
valentindAh yes, you need to do something for stdout and stderr as well. But there are hooks in pytest you can setup capture.14:40
gitlab-br-botbuildstream: issue #577 ("Unhandled exception when build reports "bug"") changed state ("closed") https://gitlab.com/BuildStream/buildstream/issues/57715:00
gitlab-br-botbuildstream: merge request (tiagogomes/issue-577->master: cascache: use errno module) #674 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/67415:00
gitlab-br-botbuildstream: merge request (tiagogomes/issue-577-backport->bst-1.2: cascache: use errno module) #675 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/67515:00
gitlab-br-botbuildstream: merge request (tiagogomes/issue-573->master: Reduce IO overhead caused by artifact cache size calculation) #671 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/67115:01
tristanvalentind, sounds like inviting disaster, since we already have a delicate dance going on with the pytest capturing of bst invocations15:02
* qinusty is very confused at the outcome of his test15:12
qinustyCan I borrow someones head to potentially tell me I'm being stupid. I just can't see where the issue is arising from.15:13
jmacqinusty: What's up? Did you link something above?15:26
qinustyCan link now15:26
qinustyPatch is https://gitlab.com/BuildStream/buildstream/merge_requests/662/diffs. Basically, interrupts.py attempts to fetch an element with a custom source (it just delays). This source is defined in delayed.py, and delaymock.bst sets the kind of the source.15:28
qinustyhttps://paste.gnome.org/pj28v1ql2 is the output I'm getting, According to this it is loaded the source defined in consistencybug.py which isn't even in my DATA_DIR.15:29
qinustyIt fails on CI, but not locally.15:30
gitlab-br-botbuildstream: merge request (tristan/notifications-1.2->bst-1.2: _frontend/app.py: Notify session completions) #673 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/67315:36
gitlab-br-botbuildstream: merge request (Qinusty/message-helpers->master: Continued work on improving BuildStream messaging API) #670 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/67015:37
gitlab-br-botbuildstream: merge request (Qinusty/531-fetch-retries-on-terminate->master: WIP: Prevent jobs retrying on terminate) #662 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/66215:39
gitlab-br-botbuildstream: merge request (Qinusty/531-fetch-retries-on-terminate->master: WIP: Prevent jobs retrying on terminate) #662 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/66215:45
*** ChanServ sets mode: +o jjardon15:45
jjardonHI, I trying to build a minimal system but I'm getting this error about my elements not having defined the "ref:" . This is in 1.1.6. In 1.1.5 it crashes15:46
jjardonI've just tried latest bst-1.2 and it seems to work without issues15:46
jjardonso I guess the problem is solved but, could we have a new release soon, please?15:47
tiagogomesWhat is the error?15:51
persiaEven if it was fixed, if it wasn't fixed intentionally, it would make a good test case.15:53
jmacqinusty: Sorry, no idea about that15:54
qinustyNo worries, it's a mystery15:54
qinustyjmac, I have an inkling that its something to do with the multiprocessing. I configured CI to just run that test and it passed. However when ran in the full sequence, it fails. The reason I think I've made a stupid mistake is that I used consistencybug.py as an example for my delayed.py, however I can't see any reference or ANYTHING that would link15:57
qinusty the interruptions.py test or delayed.py source to the consistencybug.py source... Mystery15:57
*** dtf has quit IRC16:06
gitlab-br-botbuildstream: issue #590 ("An unhandled exception occured when building: OSError: [Errno 39] Directory not empty") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/59016:08
jjardontiagogomes: I have talked too soon: https://gitlab.com/BuildStream/buildstream/issues/59016:09
jjardonalso, I'm getting a weird warning about "WARNING Ignoring redundant source references", any idea why that would happen?16:11
tiagogomesjjardon, that's a dup of 57716:11
tiagogomes#57316:13
tiagogomesargh, #577 is the right one16:13
gitlab-br-botbuildstream: issue #590 ("An unhandled exception occured when building: OSError: [Errno 39] Directory not empty") changed state ("closed") https://gitlab.com/BuildStream/buildstream/issues/59016:14
jjardontiagogomes: ah sorry, I though it was closed but the 1.2 backport is one its way: https://gitlab.com/BuildStream/buildstream/merge_requests/67516:15
tiagogomesI don't know why is not merged yet, as the pipeline succeeded16:16
*** solid_black has quit IRC16:16
jjardontiagogomes: any idea if the cache-key has changed again since 1.1.6? My pipeline is trying to build instead getting stuff from the cache16:19
gitlab-br-botbuildstream: merge request (tiagogomes/issue-577-backport->bst-1.2: cascache: use errno module) #675 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/67516:20
tiagogomesah finally ^16:21
jjardontiagogomes: you need to rebase before merge16:21
tiagogomesjjardon the only think I am aware is the deterministic staging work done by valentind changed the cache keys, but that seem to have landed in 1.1.616:22
jjardonok, maybe I'm doing something wrong here then16:22
tpollardthere were a couple of bumps in _version.py yesterday I think16:24
tpollardI'm not sure if those could be relevant at all16:24
gitlab-br-botbuildstream: merge request (jjardon/doc_releases->master: Add section about current releases) #661 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/66116:31
*** tpollard has quit IRC16:39
jjardonAny idea why I'm getting this "Ignoring redundant source references" warning?16:40
jjardonIt only happens with the linux.bst file I'm using16:41
gitlab-br-botbuildstream: merge request (willsalmon/580-backport->bst-1.2: Add warning to git track if track and ref are not present) #621 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/62116:41
qinustyare you using project.refs jjardon?16:43
jjardonqinusty: junction.refs , ues16:43
jjardonyes16:43
qinustyWhat sources does linux.bst use? kinds?16:43
jjardonqinusty: I have tried with tar and git16:43
jjardonsame problem16:44
qinustyBasically, is the ref in the .bst AND the project.refs?16:44
jmacGetting a weird build error for buildbox now, https://paste.gnome.org/pnq30mxj516:47
jmacThis builds absolutely fine on my other Ubuntu machine16:48
jjardonqinusty: nope16:50
* qinusty is absolutely baffled with his CI issue *Shrugs*16:50
qinustyjjardon, not too sure then. Is it fixed in bst-1.2?16:50
jjardonqinusty: oh waiy16:50
jjardona file was there, if I remove the warning is gone, but now I get16:51
jjardonhttps://www.irccloud.com/pastebin/pEWNRoSW/16:51
jjardonadds68: I think I'm hitting the same or similar issue you report? ^16:52
adds68jjardon, yea that is what i got16:52
jjardonhttps://gitlab.com/BuildStream/buildstream/issues/576? but I'm not using workspaces at all!16:53
adds68jjardon, a workspace must still be open for linux-msm ?16:53
jjardonnope16:53
adds68jjardon, try and close it just to make sure?16:53
jjardonI've never use workspaces16:53
adds68bst workspace close linux-msm.bst16:53
jjardonhttps://www.irccloud.com/pastebin/sUpAyeQl/16:54
adds68jjardon, have you tried tacking the element?16:55
jjardonadds68: no16:56
jjardonlet's try and see what happen16:57
jjardonadds68: well, same warning but it generated a project.ref17:00
adds68jjardon, hmm that is strange then, as tack is supposed to correct the ref and stop that error17:02
jjardonadds68: the error is gone, but the warning is still there. also why we need to do this at all? I'm specifying the ref in the linux.bst file already!17:03
* jjardon is so confused17:03
adds68jjardon, yea i was confused by it also17:04
gitlab-br-botbuildstream: merge request (tiagogomes/issue-577-backport->bst-1.2: cascache: use errno module) #675 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/67517:11
*** jonathanmaw has quit IRC17:24
jjardonIs there a way to execute buildstream as my user (so it can download stuff from restricted git repos). Or if not, is there any way to configure it to use specific credentials?17:30
jjardonah! of course it was my fault17:38
jjardonI was using "ref-storage: project.refs" and of course it was looking for that file instead the ref in the element17:38
tristanadds68, track does not delete possibly valuable refs which you have left dangling in your element .bst files, just because you have suddenly changed your ref-storage option17:49
tristaninstead; we list all of the refs which are in the bst files which will be ignored17:49
tristanin the case that you have a project which specifies ref-storage: project.refs, but happen to have refs lying around in your .bst files17:50
tristanthere is another candidate for a CoreWarning which could be marked fatal, now that I think of it17:51
gitlab-br-botbuildstream: merge request (tingping/custom-properties->master: Allow custom property names prefixed with x-) #659 changed state ("closed"): https://gitlab.com/BuildStream/buildstream/merge_requests/65918:40
*** mohan43u has quit IRC18:59
*** mohan43u has joined #buildstream20:15
*** rdale has quit IRC20:21
*** xjuan has quit IRC20:22
*** cs-shadow has quit IRC20:33
*** leopi has quit IRC21:04
gitlab-br-botbuildstream: merge request (valentindavid/fix-broken-indentation-after-track->master: Fix broken indentation after track) #622 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/62221:49

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!