IRC logs for #buildstream for Wednesday, 2018-08-29

*** leopi has quit IRC00:02
*** coldtom has joined #buildstream04:59
*** tristan has joined #buildstream06:01
*** ChanServ sets mode: +o tristan06:12
*** leopi has joined #buildstream06:22
gitlab-br-botbuildstream: merge request (tristan/docs-version-badge->master: WIP: Release badges) #742 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/74206:40
*** noisecell has joined #buildstream07:08
*** tristan has quit IRC07:17
*** adds68 has joined #buildstream07:33
*** tristan has joined #buildstream07:46
*** ChanServ sets mode: +o tristan07:47
*** toscalix has joined #buildstream07:53
*** finn has joined #buildstream08:03
*** qinusty has joined #buildstream08:04
gitlab-br-botbuildstream: issue #516 ("BuildStream can not build from non-numeric tags") changed state ("closed") https://gitlab.com/BuildStream/buildstream/issues/51608:09
gitlab-br-botbuildstream: merge request (537-mirror-fallback-does-not-work-for-git->master: WIP: Resolve "Mirror fallback does not work for git") #618 changed state ("closed"): https://gitlab.com/BuildStream/buildstream/merge_requests/61808:10
gitlab-br-botbuildstream: issue #537 ("Mirror fallback does not work for git") changed state ("closed") https://gitlab.com/BuildStream/buildstream/issues/53708:10
gitlab-br-botbuildstream: issue #584 ("Slow cache, 25 seconds before anything is printed") changed state ("closed") https://gitlab.com/BuildStream/buildstream/issues/58408:12
*** rdale has joined #buildstream08:16
gitlab-br-botbuildstream: issue #603 ("CI takes a very long time: ~1h , ideally should complete in 15min") changed state ("closed") https://gitlab.com/BuildStream/buildstream/issues/60308:32
*** tiagogomes has joined #buildstream08:49
*** bochecha has joined #buildstream08:51
*** jonathanmaw has joined #buildstream09:08
*** tristan has quit IRC09:13
*** tiagogomes has quit IRC09:14
*** tiagogomes has joined #buildstream09:16
valentindjjardon, cas.prune() does not seem to be called on the server. So the refs are removed, but the objects are probably never removed.09:21
valentindNo I was wrong.09:25
*** tristan has joined #buildstream09:26
*** ChanServ sets mode: +o tristan09:27
gitlab-br-botbuildstream: merge request (tristan/docs-version-badge->master: WIP: Release badges) #742 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/74209:36
gitlab-br-botbuildstream: merge request (tristan/docs-version-badge->master: WIP: Release badges) #742 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/74209:36
gitlab-br-botbuildstream: merge request (Qinusty/597-non-alias-url-fix->master: Fix ValueError traceback for URL without alias or URI scheme) #700 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/70009:43
*** dtf has quit IRC09:46
*** dtf has joined #buildstream09:46
*** tlater[m] has joined #buildstream09:47
gitlab-br-botbuildstream: merge request (Qinusty/597-non-alias-url-fix->master: Fix ValueError traceback for URL without alias or URI scheme) #700 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/70009:50
gitlab-br-botbuildstream: merge request (tpollard/591->master: buildstream/_project.py: Report if project.conf is missing name) #680 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/68009:55
*** finn_ has joined #buildstream09:57
*** finn has quit IRC09:59
gitlab-br-botbuildstream: merge request (jonathan/expose-downloadablefilesource->master: Make DownloadableFileSource publically accessible) #743 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/74309:59
gitlab-br-botbuildstream: merge request (tpollard/591->master: buildstream/_project.py: Report if project.conf is missing name) #680 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/68009:59
gitlab-br-botbuildstream: merge request (tpollard/591->master: buildstream/_project.py: Report if project.conf is missing name) #680 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/68010:05
qinustyDoes anyone have experience with pytest.mark.timeout?10:08
tristanqinusty, good idea10:14
tpollardjjardon: could you spare any time to review or comment on this please? https://gitlab.com/BuildStream/buildstream/merge_requests/564 I know part of your usecase would be having it backported10:15
gitlab-br-botbuildstream: merge request (Qinusty/597-non-alias-url-fix->master: Fix ValueError traceback for URL without alias or URI scheme) #700 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/70010:17
gitlab-br-botbuildstream: merge request (tristan/docs-version-badge->master: WIP: Release badges) #742 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/74210:20
gitlab-br-botbuildstream: merge request (tpollard/483->master: plugins/git.py: Warn if ref is not in given track) #564 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/56410:21
gitlab-br-botbuildstream: merge request (tristan/docs-version-badge->master: WIP: Release badges) #742 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/74210:21
jjardontpollard: sure, sorry I missed that ping in the MR10:22
gitlab-br-botbuildstream: merge request (tristan/docs-version-badge->master: WIP: Release badges) #742 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/74210:24
gitlab-br-botbuildstream: merge request (tristan/docs-version-badge->master: Release badges) #742 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/74210:24
gitlab-br-botbuildstream: merge request (mac_fixes->master: WIP: Resolve "os.sched_getaffinity() not supported on MacOSX Blocks #411") #726 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/72610:26
qinustyI quickly reviewed it tpollard :D10:27
qinustytristan, with pytest-timeout. It kills the test session rather than failing the test...10:27
qinustyWhich seems pretty extreme for what we're after10:28
tpollardqinusty: cheers10:29
tristanqinusty, I thought it was for the test of recursive variable resolution, to avoid a hanging pipeline and fail10:30
qinustyIt is, It'd bail the entire test sequence10:30
tristanAhh, it kills the *whole session*10:30
tristanyikes10:30
qinustyjust tests/format/variables.py::test_cyclic_variables<NEWLINE>10:30
qinustyexit10:30
tristanwell, I'm not fussed even if the failing test hangs10:30
qinustyBut it has SOME configuration10:30
qinustyI'll take a look into it a bit deeper10:30
tristanAs long as we do have a test, hanging is an undesirable failure mode for the test suite but it is certainly much better than not having a test10:31
tristanqinusty, arguably, just because it failed by hanging in the past, doesnt mean it will fail the same way in the future10:32
qinustyAgreed10:32
tristanqinusty, and the same goes for any other test we do have, maybe in the future they might fail with a hang10:32
* tristan is going to merge the version badges now10:33
qinustynice!10:33
tristanI've tinkered too much with them already, there are drawbacks I dont like, but meh10:33
gitlab-br-botbuildstream: merge request (mac_fixes->master: WIP: Resolve "os.sched_getaffinity() not supported on MacOSX Blocks #411") #726 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/72610:33
qinustyAlso, there was a patch a while back which overwrote and undid a change from another MR. We should be a little careful about what we're committing when dealing with merge conflicts10:34
tristanqinusty, indeed, did that one get fixed ?10:34
qinustyYeah I reviewed and merged the refix10:34
tristanGood, I think that kind of thing is quite unlikely to happen - developers should rebase their branches frequently to minimize the diffs10:36
Nexusi'm having a problem with pytest==3.7 if gives me a "AttributeError: 'Pep8Item' object has no attribute '_collectfile'" error10:36
qinusty3.7.?10:37
tristanNexus, the solution to that locally, is to `pip upgrade` your pep8 package, the solution at a larger scale would be to pin pep8 to a specific version in dev-requirements.txt10:37
tristanjjardon, is currently working on migrating from the pep8 checker to it's renamed package pycodestyle, too10:38
tristanso it would be good to make sure it's pinned with that change as well10:38
Nexusqinusty: 3.7.010:38
tristanpep8 (or pycodestyle) falls under the same category of pylint: It should have an exact version, because it's unacceptable that CI starts to fail because of external factors (linters growing new checks)10:39
Nexustristan: upgrading my pep8 to 1.7.1 didn't fix it :/10:39
gitlab-br-botbuildstream: merge request (valentindavid/post_tracking_errors->master: Report processing errors from tracking) #747 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/74710:41
tristanNexus, and maybe pytest-pep8 also10:41
tristanI suppose it would be pytest-pep8 which claims to have intimate knowledge of a Pep8Item10:41
tristanand having those out of sync would be bad10:41
Nexusstill didnt fix it10:42
*** solid_black has quit IRC10:44
tristanNexus, please let us know when you find out what is causing this... in the meantime, a dump of the versions of things in dev-requirements.txt you are using in an issue would be a good start10:44
gitlab-br-botbuildstream: merge request (jjardon/pycodestyle_fixes->master: Some pycodestyle (PEP8) fixes) #746 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/74610:45
gitlab-br-botbuildstream: merge request (tristan/docs-version-badge->master: Release badges) #742 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/74210:46
tristanNexus, sorry I forgot to ask first... I canceled a pipeline that you had running, because it was not the latest pipeline running for your branch10:48
Nexusnp10:48
tristanunless you had intentionally been testing things in subsequent commits, all should be fine :)10:49
Nexushttps://github.com/pytest-dev/pytest/issues/374210:49
Nexusseems to be a known problem with 3.710:49
Nexushasn't been fixed in the latest version yet10:49
tristanNice10:50
tristanHmmm, strange though, how come it doesnt happen in CI ?10:50
tristanWe use pytest >= 3.7 there10:50
Nexusodd10:51
Nexusfixed it locally with a workaround, but am confused about the error10:55
gitlab-br-botbuildstream: merge request (Qinusty/600-recursive-variables->master: Add cyclic check within variable resolution) #712 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/71210:55
gitlab-br-botbuildstream: merge request (mac_fixes->master: WIP: Resolve "os.sched_getaffinity() not supported on MacOSX Blocks #411") #726 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/72611:01
tristanNexus, how did you fix it ?11:01
tristanpin something ?11:02
Nexussure 1 min11:02
tristanI wonder if the best is to just wait for pytest 3.7.1 ultimately, but would be good to know for now11:02
tristan(I expect they release often enough, but am not sure)11:02
Nexusit's currently on 3.7.3 and not fixed yet11:03
tristanewww11:03
Nexusyup11:03
*** cs-shadow has joined #buildstream11:03
gitlab-br-botbuildstream: merge request (jjardon/pycodestyle->master: WIP:  Use pycodestyle instead pep8 python module) #638 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/63811:04
Nexusi'm not sure how to make this nicer11:07
Nexushttps://hastebin.com/jafexenisu.rb11:07
Nexusi added " # <---- Replaced `root` with `self`"11:07
Nexusat each point where it needed to be done11:07
Nexusthe workaround on the thread wasn't enough11:07
gitlab-br-botbuildstream: merge request (chandan/pypi-badge->master: README.rst: Add status badges for PyPI release and Python versions) #719 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/71911:08
tristanEeek, so you patched the code11:09
tristanNexus, rather than that; we should repeat the process we did to fix the pylint issues; I think that if you push a test branch to CI which prints the versions of things installed there, you can try pinning them locally in dev-requirements.txt, and one of the combinations is sure to work11:11
tristanNexus, in fact, after confirming with bochecha, it will be fine to pin everything in dev-requirements.txt to an exact version and that will not interfere with the packaging story11:11
gitlab-br-botbuildstream: merge request (jjardon/pycodestyle->master: WIP:  Use pycodestyle instead pep8 python module) #638 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/63811:13
gitlab-br-botbuildstream: merge request (tristan/docs-version-badge->master: Release badges) #742 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/74211:14
tristancs-shadow, any idea why the PyPI badges are broken ? maybe we're missing some package metadata for it to work ?11:14
tristani.e. https://gitlab.com/BuildStream/buildstream/tree/chandan/pypi-badge shows "invalid json response", although I seem to recall it worked last week11:15
cs-shadowtristan: No idea why. Looking into that at the moment.11:15
cs-shadowI could've sworn i saw the first badge working, the python version one isn't supposed to work until we add "py_requires"11:15
tristanyeah I saw the PyPI badge work for sure11:15
cs-shadowfunnily enough it works at a different badge provider: https://badge.fury.io/for/py/BuildStream11:16
tristanAn didn't see the python one, I wonder if showing the minimal python dependency in a badge (is that what it does ?) is really of any value, though11:16
tristanI mean, we could add a badge for every dependency then, but that would just be clutter11:17
gitlab-br-botbuildstream: merge request (valentindavid/roundtripping_only_when_modified->master: Disable round-tripping when element is not modified) #748 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/74811:17
cs-shadowtristan: the version badge will add something like https://img.shields.io/pypi/pyversions/Django.svg I included it in the MR just because i was experimenting with badges.11:18
tristancs-shadow, eww, that badge provider does something crazy haha :)11:19
tristancs-shadow, did you look at the content ? it's an svg with javascript11:19
tristancs-shadow, wait for the pipeline on master (https://gitlab.com/BuildStream/buildstream/pipelines/28943003) to complete, and see new custom badges :D11:20
valentindqinusty, I added !748 to deal with not round tripping unmodified files. Maybe you can have a look. It is a very small patch.11:22
tristancs-shadow, looking at the django example, I think that it requires that BuildStream be precompiled for each python version (are those wheels ?)... I think we opted out of that and wanted to ensure that setup.py runs on each host and asserts the deps, isn't it ?11:23
tristancs-shadow, another random question; all that text from the README on the PyPI site; is it automatically extracted from the latest dist tarball's README ? or is it redundant ?11:24
cs-shadowtristan: reg. wheels, yeah we are not publishing them but I'm not sure if the python versions is supposed to reflect that. I thought it was about supported versions but I'll need to check11:25
cs-shadowThe text is generated from the long_description field of setup.py, which in turn is read from README: https://gitlab.com/BuildStream/buildstream/blob/master/setup.py#L23211:26
cs-shadowI'll look a bit more into why the badges are coming back with invalid json response and report back11:26
gitlab-br-botbuildstream: merge request (chandan/setup.py-metadata->master: WIP: setup.py: Add more metadata useful for PyPI) #718 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/71811:31
tristancs-shadow, good to know about the README, was worried we had another thing to maintain :D11:35
cs-shadowtristan: yeah, that would've been a pain11:36
gitlab-br-botbuildstream: merge request (Qinusty/600-recursive-variables->master: Add cyclic check within variable resolution) #712 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/71211:38
gitlab-br-botbuildstream: merge request (chandan/setup.py-metadata->master: WIP: setup.py: Add more metadata useful for PyPI) #718 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/71811:40
gitlab-br-botbuildstream: merge request (tpollard/483->master: plugins/git.py: Warn if ref is not in given track) #564 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/56411:48
gitlab-br-botbuildstream: merge request (chandan/setup.py-metadata->master: setup.py: Add more metadata useful for PyPI) #718 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/71811:48
gitlab-br-botbuildstream: merge request (tpollard/483->master: plugins/git.py: Warn if ref is not in given track) #564 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/56411:49
gitlab-br-botbuildstream: merge request (tpollard/483->master: plugins/git.py: Warn if ref is not in given track) #564 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/56411:49
gitlab-br-botbuildstream: merge request (tpollard/591->master: buildstream/_project.py: Report if project.conf is missing name) #680 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/68011:52
gitlab-br-botbuildstream: merge request (tpollard/591->master: buildstream/_project.py: Report if project.conf is missing name) #680 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/68011:53
gitlab-br-botbuildstream: merge request (chandan/setup.py-metadata->master: setup.py: Add more metadata useful for PyPI) #718 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/71812:13
gitlab-br-botbuildstream: merge request (tristan/setup.py-metadata-1.2->bst-1.2: setup.py: Add more metadata useful for PyPI) #749 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/74912:24
tristancs-shadow, !749 is backporting your !718 btw12:25
tristancs-shadow, anything else we might be missing in bst-1.2 ?12:25
tristanregarding PyPI I mean :)12:25
cs-shadowtristan: thanks! i was about to do that myself but you beat me to it :D12:26
cs-shadowthe only other thing that I think is not backported are the docs. But I guess that's not needed?12:27
tristanNah we've been leaving them behind12:28
tristanWe could do a post release effort but it's rather unimportant; the docs are currently only published from master12:28
tristanI might do it one weekend, the result will be that the docs packages delivered from bst-1.2 releases on distros will be more up to date12:29
persiaFor folk following master, that's probably fine.  As 1.3 diverges from 1.2, it might make sense to put together 1.2 docs, but I suspect users will provide guidance on whether that is necessary (if only by being confused).12:29
tristanpersia, essentially I agree, but we are blocked by https://gitlab.com/BuildStream/buildstream/issues/17812:30
cs-shadowslightly tangential, have we considered hosting our docs on https://readthedocs.org/ instead of GitLab that supports multiple versions?12:31
tristancs-shadow, yeah12:31
tristancs-shadow, I remember that the process of considering that was quite a headache, too12:31
cs-shadowtristan: I see, I also missed Sam's notes from earlier: https://gitlab.com/BuildStream/buildstream/issues/178#note_5872652512:32
tristancs-shadow, yeah they have "their own way" anyway12:32
tristanas I read that comment, I recall looking at the upstream issue - its basically another case of "You should all do it our way"12:33
cs-shadowfair enough12:33
cs-shadowI'll try https://robpol86.github.io/sphinxcontrib-versioning/v2.2.1/index.html and see if that works12:33
tristanoh yeah I think jjardon provided a link to that before12:34
* cs-shadow should finish reading issues :)12:35
tristancs-shadow, Not sure what it'll do though, I think we do want to keep using our gitlab pages automated approach, and I suppose in any case it means checking out the latest of each release branch in a loop12:35
tristanWe could do that directly in our .gitlab-ci.yml, I guess12:35
tristanOr maybe we'd want "Latest release tag for every release line... plus master"12:36
tristanMeh12:36
gitlab-br-botbuildstream: merge request (chandan/setup.py-metadata->master: setup.py: Add more metadata useful for PyPI) #718 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/71812:37
gitlab-br-botbuildstream: merge request (Qinusty/597-non-alias-url-fix->master: Fix ValueError traceback for URL without alias or URI scheme) #700 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/70012:38
cs-shadowlooping over release branches doesn't sound too bad12:39
*** alatiera_ has joined #buildstream12:42
gitlab-br-botbuildstream: merge request (tristan/setup.py-metadata-1.2->bst-1.2: setup.py: Add more metadata useful for PyPI) #749 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/74912:44
gitlab-br-botbuildstream: merge request (mac_fixes->master: WIP: Resolve "os.sched_getaffinity() not supported on MacOSX Blocks #411") #726 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/72612:45
gitlab-br-botbuildstream: merge request (coldtom/strip-rules->master: Upstream freedesktop-sdk strip rules) #750 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/75012:49
tristantpollard, that wont work :)12:52
tristantpollard, strip-fail-on-error is a variable, not a project option12:52
tristantpollard, Anyway, lets consider this for master but I think we wont do it this week12:53
tristanTo be honest, we're probably leaning towards removing the strip-binaries completely in a later release, due to it being too linux specific12:54
tpollardwrong tom I presume heh12:55
tpollardcoldtom ^12:55
tristanOhhhh sorry coldtom ^^^12:58
coldtomtristan: ah, it should work with %{} around it in the (?) directive though right?13:00
tristancoldtom, nope13:01
*** noisecell has quit IRC13:01
gitlab-br-botbuildstream: merge request (Qinusty/597-backport-ValueError-fix->bst-1.2: Backport !700:  Prevent ValueError on URLs without an alias) #751 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/75113:01
tristancoldtom, It will work only by checking it expanded in the shell, using shell conditionals13:01
gitlab-br-botbuildstream: merge request (Qinusty/597-backport-ValueError-fix->bst-1.2: Backport !700:  Prevent ValueError on URLs without an alias) #751 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/75113:02
tristancoldtom, That said, it will also be better I think to not do one single switch and duplicate the huge script, but rather only check it at the exit points13:02
tristancoldtom, Here is a nice little hack... The variable is called "non-fatal-strip", and it's default is "true" (note that it's default is not "True", it is "true")13:03
tristancoldtom, then, *during the script*, the commands which can be fatal, you just append "|| %{non-fatal-strip}" to those13:03
gitlab-br-botbuildstream: issue #597 ("Git url without alias causes ValueError") changed state ("closed") https://gitlab.com/BuildStream/buildstream/issues/59713:03
gitlab-br-botbuildstream: merge request (Qinusty/597-non-alias-url-fix->master: Fix ValueError traceback for URL without alias or URI scheme) #700 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/70013:04
coldtomtristan: thanks, i'll work on doing that instead :)13:04
tristancoldtom, that will result in "possiblyfatalthing || true" if non-fatal, and "possiblyfatalthing || false" if it would be fatal13:04
qinustytristan, re: Adding a new item to devrequirements.txt. CI is failing because --index-url is invalid://uri. How do I get the CI to have all of the dev requirements installed?13:09
tpollardtiagogomes: are you happy for this to be merged for your issue? https://gitlab.com/BuildStream/buildstream/merge_requests/680 it has an approval13:12
tpollardNexus raises a good point on the tests not being specific enough however, as it didn't catch the issue in the first place. Although that's more directed towards provenance13:15
NexusDoes anyone recognise this error? https://hastebin.com/sadadaxiko.cs13:19
tristanqinusty, that is intentional... Why do you want to pin a version to something that is not already in the CI docker images ?13:20
tristanqinusty, or, it's a completely new dependency ?13:20
qinustyNot pin, to add pytest-timeout13:20
tristanAhhh, right... for the moment that requires participation from cs-shadow13:20
qinustyI can sort the docker images if needed tristan13:21
qinustyVia gitlab, but not via Dockerhub13:21
qinustyUnless gitlab CI pushes to dockerhub13:21
tristanAlternatively, we could go the other way, pin *everything* in dev-requirements.txt, and allow the CI to download them13:21
tristanbut that is a bit more risky, because of inadvertent side effects from implicit dependencies13:22
qinustyLeaving it to the docker images seems fine, as long as we can modify the images13:22
tristanqinusty, I think it does push to dockerhub automatically, after that BuildStream's explicit refs to the docker images need an update13:22
qinustyI'll give it a go13:22
tristani.e. in BuildStream's .gitlab-ci.yml13:23
qinustyyup13:23
tristanjuergbi, I'm going to roll out a 1.3.1 this weekend, along with 1.2.013:24
tristanjuergbi, I don't really expect it to be ready for testing, mostly a matter of unbreaking the links to the latest dev snapshot13:25
juergbiok13:25
gitlab-br-botbuildstream: issue #597 ("Git url without alias causes ValueError") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/59713:27
qinustyhttps://asciinema.org/a/DNd8LkfJySps518w84zgwkHk5 needs to make its mind up13:30
* tpollard had forgotten about asciinema13:33
qinustyCan't push to buildstream docker images :( Perhaps jjardon can help?13:52
tristancs-shadow, can you give qinusty a hand adding a new dep to the CI images please ?13:53
cs-shadowtristan: sure, just got back to my desk13:55
tristancs-shadow, thanks :D13:55
cs-shadowqinusty: the CI should push it automatically13:55
cs-shadowlet me add you as a collaborator13:55
qinustyCheers13:55
tristancoldtom, so we can close 604 !13:57
tristanI will close now13:57
cs-shadowqinusty: added you now, please try again :)13:57
gitlab-br-botbuildstream: issue #604 ("Cache not storing objects, but storing refs") changed state ("closed") https://gitlab.com/BuildStream/buildstream/issues/60413:57
qinustyPushed :D cs-shadow, what's the review process with the docker images repo? I've only added a dependency so I'm sure it's fine :)13:58
* paulsher1ood wonders when and why we started allowing application of .patch files in bst14:00
cs-shadowqinusty: It's more free-form than the main repo since the number of changes were relatively small. For now, someone with maintainer rights should take a look in a reasonable time.14:01
paulsher1oodtristan: ^^14:01
cs-shadowfor this one, I've marked it to land when the CI passes14:01
qinustysounds good, cheers cs-shadow14:02
cs-shadowqinusty: Once the MR lands and the CI passes on master, you'll need to submit another MR to buildstream repo to update the tags of the testsuite images in .gitlab-ci.yml14:02
qinustyYup, I assume the tag will be generated once the CI passes?14:02
* paulsher1ood is looking at things like https://gitlab.com/freedesktop-sdk/freedesktop-sdk/commit/31d4cd88b48d0e771f6e609b0906bf6250670312#8bdfc19d592cd0e84a58eea04244544c4e04dafe14:03
cs-shadowqinusty: yeah, it's not exported anywhere so we need to look into the pipeline to find it. For example, https://gitlab.com/BuildStream/buildstream-docker-images/-/jobs/93014671 has something like "Pushing image buildstream/testsuite-fedora:28-master-116-5d508779"14:04
tristanpaulsher1ood, since forever, there is nothing about BuildStream which forces you to work with or without patches; we don't dictate terms14:05
paulsher1oodlet me try this in the other direction then...14:07
paulsher1oodvalentind: why would we choose to apply a huge patch, rather than starting with a desired state/branch from git?14:07
gitlab-br-botbuildstream: issue #597 ("Git url without alias causes ValueError") changed state ("closed") https://gitlab.com/BuildStream/buildstream/issues/59714:08
gitlab-br-botbuildstream: merge request (Qinusty/597-backport-ValueError-fix->bst-1.2: Backport !700:  Prevent ValueError on URLs without an alias) #751 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/75114:09
gitlab-br-botbuildstream: merge request (valentindavid/roundtripping_only_when_modified->master: Disable round-tripping when element is not modified) #748 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/74814:11
valentindpaulsher1ood, this is not upstreamed.14:17
valentindIt is based on the patch that Debian uses. But all distribution have their own patch to version symbols of openssl 1.014:17
valentindOther distributions also have clear patch files for what is not upstreamed.14:20
gitlab-br-botbuildstream: issue #612 ("Warn users when using a URL without an alias") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/61214:22
toscalixtiagogomes: do you have what you need already?14:24
tiagogomesFor the moment yes14:25
gitlab-br-botbuildstream: issue #613 ("Buildstream should exit early if an unknown alias is used within a URL") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/61314:30
qinustytoscalix I have raised https://gitlab.com/BuildStream/buildstream/issues/612, https://gitlab.com/BuildStream/buildstream/issues/613 to follow up on issues I noticed during my work on https://gitlab.com/BuildStream/buildstream/issues/59714:30
toscalixqinusty: thanks14:36
*** noisecell has joined #buildstream14:39
qinustyOkay tristan, I'm gonna do something I've wanted to do for a while which is throw together a page about buildstream UI14:43
gitlab-br-botbuildstream: merge request (valentindavid/roundtripping_only_when_modified->master: Disable round-tripping when element is not modified) #748 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/74814:43
qinustyMainly for my benefit, but it benefits the release too I guess. I don't know what everything even means14:44
tristanqinusty, what do you have in mind ?14:44
qinustyAn image of a build in progress perhaps, with some of the UI elements highlighted and described in a sort of glossary below the image14:45
toscalixjuergbi: thanks for paying attention as requested in the bug. Just saw it has been closed (won't fix).14:45
qinustye.g. The Fetched: x y z at the bottom14:45
qinustyBuilt: x y z14:45
tristanqinusty, note that http://buildstream.gitlab.io/buildstream/using_commands.html is ready to add custom explanations to each command, that might help14:45
tristanqinusty, right, I guess that could be interesting, would be good to have it auto generated like the examples (but would be tricky to get a snapshot of the statusbar)14:47
tristanA glossary is a popular request, but I think that is separate14:47
qinustyWell, by glossary I mean14:47
qinustyIf I label parts of the UI14:47
qinustyI'll describe them below14:47
qinustyby label14:47
qinustyIn https://i.imgur.com/gjrXaOp.png, we can see a fairly straight forward view of the bst build output14:48
tristanqinusty, yeah; maintainability is a bit worrisome though, how do you regenerate the stuff when we tweak/improve the UI ?14:49
qinustyThe tricky bits for me coming in, were understanding what the message output is [duration][hash key][job:element??] ACTION message?14:49
tristanI guess maybe that doesnt happen too often at this point at least14:49
qinustyWell I imagine we would tweak and not exactly change massively14:49
tristanindeed; but it means any tweak has a consequence in docs now14:50
qinustyBut I do think regardless of what we do going forward, we want something out there for release which just gives people a glimpse before they install/run buildstream14:50
tristanqinusty, I think it's just something to keep in mind, maybe an autogenerated output with some text below explaining the above, so that text is the only part which needs updating14:50
tristanrather than having to open up photoshop14:51
qinustyI agree, But we can still label the individual elements, Even if we describe them differently14:51
toscalixqinusty: I like it14:54
qinustyAnd maybe a slightly contentious point but... Perhaps we want an image of buildstream in some shape or form in our README.14:54
toscalixqinusty: definetly on the website14:54
toscalixshowing key features14:55
toscalixor something that clearly differentiate us from Yocto14:55
jjardonqinusty:  are you sorted?14:56
qinustyTo me, when I open a project. I feel slightly more comfortable after seeing what I'm getting before I install. The information in the text is obviously the deciding factor. But if Buildstream is shared around on release and people open the page for a quick glimpse14:56
toscalixan output with colours, a self explanatory command....14:56
qinustyYeah I'm good jjardon :D14:56
toscalixqinusty: you are right14:56
toscalixwe have a page in the web called feature page14:57
toscalixexplaining what we are releasing14:57
toscalixthat page should have a couple of those14:57
jjardonqinusty: so about the logs of the cache server in gnome-build-meta; what do you need exactly?14:58
* qinusty isn't certain they're logged to file14:59
toscalixand by adding them to than page, which is release version specific, the maintenance point brought up by tristan does not apply, which was an important one14:59
toscalixso qinustythink about them and get a couple, with a one or two lines explanation of what we are seing, and we add them to the feature page14:59
qinustyhttps://gitlab.com/BuildStream/buildstream/blob/master/buildstream/_artifactcache/casserver.py#L368 logs messages regarding the outcome of the clean up code. This is what I'm after jjardon.15:01
jjardonqinusty: abderrahim[m] is waiting to purge the server so we can keep building; any idea if something useful would be in the journald logs?15:02
* jjardon checks15:02
jjardonqinusty: would that be logged to the journal?15:02
qinustyI'm not sure, I can't even see where the logging is initialised within the project.15:03
jjardonjuergbi: do you know? ^15:04
juergbijjardon: when run via systemd it might indeed end up in the journal, however, I haven't verified this15:05
jjardonabderrahim[m]: do you remember the IP of the cache server? I will try to take a look around15:06
jjardonah wait I can look for it in our CI15:06
qinustyhttps://stackoverflow.com/questions/34588421/how-to-log-to-journald-systemd-via-python By the looks of it, you need to configure journald logging15:06
*** tristan has quit IRC15:06
qinustyI'd like to recreate this issue anyway but had trouble creating a docker contain with a restricted storage size15:06
qinustys/contain/container15:07
*** leopi has quit IRC15:08
*** leopi has joined #buildstream15:08
*** tristan has joined #buildstream15:15
*** ChanServ sets mode: +o tristan15:15
jjardonqinusty: something is logged, but none of the messages you linked15:15
jjardonhttps://www.irccloud.com/pastebin/vDGXnfqo/15:16
jjardonthis is the backtrace of the first time it failed:15:17
jjardonhttps://www.irccloud.com/pastebin/ZTYRLUkm/15:17
gitlab-br-botbuildstream: merge request (coldtom/strip-rules->master: Upstream freedesktop-sdk strip rules) #750 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/75015:20
qinustycheers jjardon, guess we'll have to try and reproduce this issue15:29
jjardonabderrahim[m]: feel free to empty the server, please: I think stop cas-pullpush.service and remove /home/artifacts/artifacts/* would do it?15:31
gitlab-br-botbuildstream: merge request (Qinusty/600-recursive-variables->master: Add cyclic check within variable resolution) #712 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/71215:36
*** jjardon sets mode: -M 15:39
*** xjuan has joined #buildstream15:44
gitlab-br-botbuildstream: merge request (bschubert/log-missed-cache->master: Log not-found objects in the cache as SKIPPED) #729 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/72915:51
gitlab-br-botbuildstream: merge request (bschubert/log-missed-cache->master: Log not-found objects in the cache as SKIPPED) #729 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/72915:51
*** dtf has joined #buildstream15:55
qinustybenschubert, reviewed your MR for logging skipped PULL jobs. If we can get that patched and backported before Friday that'd be good :D15:55
benschubertqinusty: Sure, let me split the commit and push again!15:56
qinustyNo worries :D Remember to rebase to origin/master15:56
gitlab-br-botbuildstream: merge request (bschubert/log-missed-cache->master: Log not-found objects in the cache as SKIPPED) #729 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/72916:01
benschubertqinusty: here you go! Is that good for you?16:01
qinustyYeah looks good :) Are you able to merge on pipeline success?16:02
benschubertNo, I don't have that level of permission :(16:03
qinusty:( maybe tristan or jjardon can add you to the list since this is your second patch going into Builstream.16:04
qinustyI've flagged it to merge though16:05
benschubertthanks!16:05
gitlab-br-botbuildstream: merge request (Qinusty/600-recursive-variables->master: Add cyclic check within variable resolution) #712 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/71216:13
gitlab-br-botbuildstream: merge request (Qinusty/600-recursive-variables->master: Add cyclic check within variable resolution) #712 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/71216:13
gitlab-br-botbuildstream: merge request (bschubert/log-missed-cache->master: Log not-found objects in the cache as SKIPPED) #729 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/72916:25
*** leopi has quit IRC16:29
gitlab-br-botbuildstream: merge request (Qinusty/600-recursive-variables->master: Add cyclic check within variable resolution) #712 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/71216:34
*** leopi has joined #buildstream16:37
benschubertqinusty: should I open a cherry-pick MR for this to bst-1.2? Is that what you were looking for?16:43
qinustyWhen I backport 1-2 commit patches, I usually just branch from origin/bst-1.2 and cherry pick the commits16:44
qinustyThen target your merge request onto bst-1.216:44
benschubertsure, 1.2 was the branch you wanted the backport in right?16:45
qinustyYup, backport it to 1.2. I'll get tristan to have a final say, but I'm pretty sure it's good to go in there. It's just extra information for the user16:46
qinustys/I'll/I'd16:46
qinustyDoes anyone know where the entry point for bst-artifact-server is?16:53
* qinusty actually looks and finds it *facepalm*16:54
toscalixwebsite repo moved. I explained the reasons in the mailing list16:55
toscalixgood progress today on this front16:55
*** toscalix has quit IRC16:57
gitlab-br-botbuildstream: merge request (Qinusty/600-recursive-variables->master: Add cyclic check within variable resolution) #712 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/71216:58
gitlab-br-botbuildstream: merge request (bschubert/backport-log-missed-cache->bst-1.2: Bschubert/backport log missed cache) #752 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/75217:00
gitlab-br-botbuildstream: issue #614 ("Follow-up from "Bschubert/backport log missed cache"") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/61417:22
gitlab-br-botbuildstream: merge request (bschubert/backport-log-missed-cache->bst-1.2: Bschubert/backport log missed cache) #752 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/75217:24
*** jonathanmaw has quit IRC17:45
*** leopi has quit IRC18:54
*** xjuan has quit IRC20:32
gitlab-br-botbuildstream: issue #615 ("bst build seems to be stuck forever, not downloading anything") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/61520:43
*** alatiera_ has quit IRC21:32
*** tristan has quit IRC21:50
bochechabst 1.1.7 is so much faster to start! big thanks to whoever made that happen :)22:49
*** rdale has quit IRC23:07

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!