IRC logs for #buildstream for Wednesday, 2018-07-18

*** bochecha has quit IRC00:11
gitlab-br-botbuildstream: merge request (135-expire-artifacts-in-local-cache->master: WIP: Resolve "Expire artifacts in local cache") #347 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/34700:12
gitlab-br-botbuildstream: merge request (135-expire-artifacts-in-local-cache->master: WIP: Resolve "Expire artifacts in local cache") #347 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/34700:16
gitlab-br-botbuildstream: merge request (135-expire-artifacts-in-local-cache->master: WIP: Resolve "Expire artifacts in local cache") #347 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/34700:19
gitlab-br-botbuildstream: merge request (135-expire-artifacts-in-local-cache->master: WIP: Resolve "Expire artifacts in local cache") #347 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/34700:41
*** tristan has joined #buildstream04:58
*** jsgrant has joined #buildstream05:00
*** cs_shadow has quit IRC05:26
*** jsgrant has quit IRC06:08
*** ernestask has joined #buildstream06:14
*** paulsherwood has joined #buildstream06:34
*** paulsherwood has joined #buildstream06:34
* laurence wonders if anyone has strong opinions on automating gitlab to send patches to the ML 07:57
tristanlaurence, I feel strongly against it to be frank07:59
tristanI think we discussed setting up gitlab to ensure the email notifications it *does* send (if you decided to subscribe), do contain the patches07:59
tristanlaurence, If we want emails for everything which lands in master, there is precedence for that in other projects, and it involves using a separate list08:00
tristanif we want people to subscribe and participate in the mailing list discussions, we should not spam the main list with patches08:01
*** finn has joined #buildstream08:01
laurencetristan, have you seen the ML post from Agustin?08:04
tristanlaurence, I dont have time for the mailing list honestly today08:04
tristanI've seen some headlines which worry me about that08:04
laurencetristan, leave with me then08:05
laurencei'll make time08:05
tristanthanks a lot !08:05
*** bochecha has joined #buildstream08:13
*** jonathanmaw has joined #buildstream08:19
*** Nexus has joined #buildstream08:37
PhilAnyone know of a python library that can be used to apply patches to files (as per the patch command line utility)?08:46
PhilIt would make testing the workspaces walkthrough much neater08:47
KinnisonPhil: Are you allowed to depend on the patch cmdline tool?08:47
KinnisonPhil: If so, writing a class which wrappers it up with subprocess should be fairly easy08:47
KinnisonPhil: If not, then https://github.com/techtonik/python-patch comes up in a first cut search08:48
PhilOk, I'm not really sure how to do that so I thought I'd check first. I saw that library but it came with an unstable api warning  so is probably not something we want to depend on.08:50
noisecelldoes someone has some spare time to look at https://gitlab.com/BuildStream/buildstream/merge_requests/537 ?08:52
KinnisonIf this is just for tests, then you could submodule a specific release?08:52
KinnisonPhil: ^08:52
KinnisonPhil: though the most recent commits failed on python 308:53
Kinnisonblech08:53
KinnisonPhil: If you're okay doing so, I'd suggest the wrapper of the patch cmdline tool :-)08:53
KinnisonHas anyone done work into building Rust software in Buildstream?08:55
PhilKinnison, That looks like the better option i think. Is the "right" way to do this  to write a class which  uses subprocess.call to run the command line utility?08:56
KinnisonPhil: I'd say that's a good starting point, yes.  Whether it's right or not for this project I don't know because I've not yet reached the point of learning how the test suites work in Buildstream :-)08:57
KinnisonPhil: It's worth ensuring that early in the test cycle if patch is unavailable the test is either flagged as unable to be run, or the suite is stopped *cleanly*08:58
* Kinnison has had no end of problems with software whose test suite dependencies are not clear and not checked08:58
tristanKinnison, we have plans for rust, and I had a nasty workaround for it... I'm unfortunately too swamped today to walk through it though :-S08:58
Kinnisontristan: s'okay, I was just wondering :-)08:58
* Kinnison has no immediate plans to need it08:59
tristanKinnison, this is part of the workaround: https://gitlab.com/BuildStream/cargo-fetcher08:59
Kinnisontristan: thanks08:59
Phil thanks Kinnison :)09:00
tristanit involved a continuous process of "vendoring" dependencies into a repo which could be used in the build environment09:00
* Kinnison nods09:00
tristanKinnison, check the mailing list for talk about SourceTransform for future plans for rust/go/python/js,... languages which like to fetch their deps from the internets09:00
* Kinnison makes a note09:01
*** Nexus has quit IRC09:05
*** Nexus has joined #buildstream09:08
jonathanmawnoisecell: I'll have a look at it now09:14
noisecelljonathanmaw, thank you09:14
jonathanmawcode seems fine, just running through the way to reproduce the bug now09:14
tiagogomeshttps://gitlab.com/BuildStream/buildstream/merge_requests/546 needs reviewing as well if it is wanted on the incoming release09:15
*** bethw has joined #buildstream09:17
tristantiagogomes, it wont be in 1.1.4, but I expect to cherry pick it into the bst-1.2 branch before feature freeze09:20
tristanI know it's unusual, but I have to end up branching like, today09:21
coldtomis it possible to disable looking at the cache for a single element? i.e. for all dependencies pull from cache but rebuild the element itself09:21
tristanso there are a few of the less complicated things which will have to land in bst-1.2 separately09:21
tristancoldtom, currently no; sounds like a reasonable request though, would be nice to file an issue stating the reason why you would need that (I can think of a good reason...)09:22
tristancoldtom, i.e. the solution might not come in the form of a way to specify exactly that, we should focus on what the user needs to do09:23
tlatertristan: Did you manage to make time for artifact expiry?09:40
tlaterAh, I just noticed the comment09:41
tlaterEugh09:41
* tlater checks to see if he can figure out why that happens09:41
tristantlater, I'm hot on the trail, and will have a couple questions for you...09:42
tristantlater, since you turned up... where did the matching MessageType.START messages go ?09:42
tristanit looks like you have ElementJob doing that separately, I don't see how the timers are coherent anymore, and where the matching START messages are for the other jobs09:43
gitlab-br-botbuildstream: issue #477 ("Allow rebuilding of a single element") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/47709:43
gitlab-br-botbuildstream: merge request (tiagogomes/tarball_checkout->master: Add support for creating artifact tarballs) #546 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/54609:43
tlatertristan: When we discussed the other jobs we said that they would not display START messages09:44
tlaterAnd generally be very minimal in logging09:44
tristanEeek09:44
tristanHmm09:44
tristanYeah, esthetically that is fine... having "things being done differently" is not... especially having the corresponding START message in another area of the code completely, I think is pretty intolerable09:45
tristantlater, that would have to be a feature that the Job abstract class exposes to the subclasses, i.e. if there are different ways to log the overall task, the subclass should politely tell the parent how it would like it to be done09:45
tlaterHm, alright - it's a lot harder to centralize that if half of the jobs aren't supposed to display them. Maybe have a do_logging thing?09:46
tristanRight now I'm going to make sure they come back overall, at the cost of more verbose logging09:46
tristanTo enhance that, it needs to be a contract between the Job and it's subclasses09:47
tristanbut we dont have time for that today...09:47
tlaterYep, that seems fine - I'll have a look at making that optional in a separate MR.09:47
*** qinusty has joined #buildstream09:59
tristantlater, alright... can you please take a look at the tristan/local-cache-expiry branch and see if you think I've broken anything ?10:00
tristantlater, I think I'm at the point where tests are passing again, and am currently building freedesktop-sdk10:00
*** jonathanmaw has quit IRC10:00
*** Phil has quit IRC10:01
tristantlater, also, I'd like it if you look at the last two commits and understand what I did, and why I did it10:01
*** Phil has joined #buildstream10:01
tristanAsides from the obvious:10:03
tristan  9 files changed, 193 insertions(+), 319 deletions(-)10:03
*** jonathanmaw has joined #buildstream10:16
tristantiagogomes, took a look while things build and test... patch is very nice... added just a couple comments10:25
tiagogomestristan I should have probably added something to the commit message, but the stdout test is disabled10:28
tiagogomesCapturing binary data is not working for some reason, even If I changed to use FDCaptureBinary10:29
tlatertristan: Sorry, got caught by a meeting10:32
tlaterHmm, maybe I can sort of peek at it on my phone...10:33
gitlab-br-botbuildstream: merge request (relative_workspaces->master: WIP: Patch for issue #191 support relative workspaces) #504 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/50410:33
valentindtristan, I am trying to cleanup the composition of includes. I was wondering. Should we have an order of composition when we have several includes in a list? Or should we merge without composition before compositing into the main node?10:35
valentindFor example if we have: "(@): ['a.yml', 'b.yml']"10:35
* paulsherwood notices this discussion, and wonders if this is the time to remind bst folks that if the schema is changed, bst should continue to support the old schema(s)10:37
valentindpaulsherwood, There is no include yet. It is a new feature. Older project.conf file will work the same way.10:38
valentindAnd .bst file too.10:39
paulsherwoodok cool. i was a user of a previous project which kept bumping its data format, then forcing users to upgrade by only supporting current + current -110:42
paulsherwoodsome users went elsewhere, rather than suffer the upgrades10:42
tristantiagogomes, yesterday I noticed a comment on IRC and ended up at https://docs.pytest.org/en/latest/_modules/_pytest/capture.html10:45
tristantiagogomes, not sure if that helps, you probably ended up there too... looks like the gist of it is in the snap() method10:45
tristanwhich our default one does some unicode decoding on10:46
tristanvalentind, I believe the strict order of composition is also discussed in the email thread, isn't it ?10:46
tristanvalentind, it may be a part of juergbi's concerns in his reply10:47
tlatertristan: were the last two commits the only thing you changed?10:47
valentindOK. let me check10:47
tristantlater, no, the other things I changed were part of my nitpick comments I left for you yesterday and I just squashed those into yours10:48
tristantlater, those include A.) Fixing the NEWS entries so they are a part of 1.1.4, and keep consistent empty lines between features10:48
tristantlater, and B.) Fixing Job class to not use the underscore prefix for public methods (public because those are shared with subclasses)10:49
tristanI started with that, and then did the two commit10:49
tlaterAh, alright - were those first two comments on the MR? I must have missed them.10:49
tristanyeah, no worry, I can see you and juergbi had a bit of a struggle10:50
tristanreally appreciate it :)10:50
tlaterThanks for fixing this...10:51
tlaterI'll land an MR on which you have nothing to fix one day ;)10:51
tristanI'm sure you have10:51
valentindtristan, Ok I found it. "the effect is that every subsequent include overrides the result of the previous include"10:55
tristanvalentind, that sounds like what I would expect yes... followed by the main including fragment overriding the said composition of includes10:56
*** Phil has quit IRC10:57
*** Phil has joined #buildstream10:57
gitlab-br-botbuildstream: issue #478 ("Buildstream's Confusing Terminal Output") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/47811:11
tristantlater, ok so tests are passing and I'm about ~160 builds into a full build of epiphany (still in freedesktop-sdk)11:12
tristantlater, however I have yet to see any cachesize job show up11:12
tlatertristan: Is it *just* builds?11:13
tristantlater, I'm not connected to an artifact server, so there are no pull attempts... as such I'm not sure if I was *supposed* to see any cachesize calculation jobs11:13
tlatertristan: Cache size calculation jobs are avoided as much as possible - if you have a lot of disk space it might take a long time before you see any11:13
tristanRight11:14
tlaterEssentially, cache calculation only happens if the total size of built artifacts (before adding them to the cache) exceeds the cache quota11:14
tristanI expected as much, just that since I was pulling yesterday (before the rebase), I wasn't sure if there was some regression11:14
tristanseems like there is no regression11:14
tristantlater, in any case I suppose you are confident in your test cases passing for this ?11:15
tristanI guess this should be pretty much covered, if they werent spawning then tests would certainly break11:15
tlaterYes, I am :) Just not quite as confident about concurrency, but that seems to be working too.11:15
tristanyeah I have a feeling that the resources.py API contract could be improved/simplified too, but this is not too worrisome11:17
tristanit's nice and self contained11:17
tristanalright, I suppose it's about time to trigger11:17
* tlater isn't sure if he's glad or scared11:18
tristantlater, are you still in a meeting ? it would be better if you could look through the final copy11:18
tlaterOut of the meeting, just had a look at your branch11:18
tlaterWant me to take a look at the MR as well?11:18
tristanI didnt post an MR for the branch yet11:19
tristanbut not sure what that buys you11:19
tristanif you want to "see the diffs on gitlab", I would recommend against it... it will take all week11:19
tlaterHaha, fair enough11:19
tristanwith the current gitlab JS payload ;-)11:19
tlaterYes, I've seen the final package in a nice emacs buffer ;)11:19
* tristan opens an MR for the bookkeeping11:22
tristanweird, it looks like with the sluggishness, a second click on the "Comment" button perhaps on my part resulted in the eventual double posting of the same comment :-S11:24
tristantlater, there is another regression, which seems to be a good one11:24
tristantlater, I suppose you have a much different OS and dependencies than I do... since you are most certainly running tests11:25
tristan(not sure if this is a regression from this or CAS yesterday actually)11:25
tristanBut... at least on my computer, it is now impossible to run the full tests11:25
tlatertristan: I think that's a regression from CAS11:25
tlaterSame thing happened to me after I'd rebased.11:25
tristanThe infamous spuriously failing "tests/artifactcache/junctions.py::test_push_pull" test now hangs every single time11:25
tlaterIt's something with the CAS server, right?11:25
tlaterYep, that breaks for me, too...11:26
tlaterIt seems to be happy in CI though, so I didn't dig deeper.11:26
tristanWell, somehow this passes on gitlab... but at least we have something reproducible to chase11:26
tristan(hence, this is in fact a happy regression)11:26
tristanworse than this actually... the test_push_pull now fails with SIGINT blocked it seems11:27
tristanjuergbi, ^^^11:27
tlatertristan: I tend to debug that by running it once and then manually running buildstream in the debris11:28
tristanyup, it is nice though when you can hit ^C and see the failure11:29
tristanthe test will at least show you the exact bst invocation it failed/hung on11:29
tristannow it just blocks and you have to do the detective work11:29
tlaterYeah... I found a pytest plugin that might help with this: https://gitlab.com/BuildStream/buildstream/issues/42011:29
tlaterSince hangs are actually rather frequent, I think it might be handy to actually get that into our test suite.11:30
gitlab-br-botbuildstream: merge request (tristan/local-cache-expiry->master: Expire artifacts in the local cache) #548 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/54811:32
juergbitristan: hm, it fails for you locally, i.e., outside Docker? it works fine here11:33
juergbitlater mentioned an issue but that seemed to be Docker-specific11:34
tristanI've still never used docker11:34
* tristan considers himself one of the lucky ones11:34
gitlab-br-botbuildstream: merge request (franred/fix-except-argument-in-source-bundle->master: source-bundle: Enable --except option) #537 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/53711:35
tristanjuergbi, well I expect then I'll end up spending time debugging that, it shouldn't be hard now that it hangs like 100% of the time11:35
juergbiI'm also not using Docker. It works fine here with native Python 3.611:35
gitlab-br-botbuildstream: merge request (franred/fix-except-argument-in-source-bundle->master: source-bundle: Enable --except option) #537 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/53711:35
tristanand *must* have something to do with some dependency... at least some dependency is causing it to be frequent or not11:36
tristanjuergbi, ah 3.6 is something I don't have :)11:36
* tristan is with 3.5.311:36
juergbihave you installed grpcio via pip?11:37
juergbisetup.py has a relatively recent grpcio as minimum version, so we shouldn't have to deal with outdated distro packages11:38
* juergbi has grpcio 1.13.0 in ~/.local/lib/python3.6/site-packages/ (installed via pip)11:38
juergbiCI tests pass with Python 3.4 and 3.5, so it shouldn't be a Python version issue11:39
tristanI had to reinstall this morning so yes11:39
tristanjuergbi, i.e. it's installed by `pip3 install --user -e .` in the buildstream checkout11:40
juergbiyes, that's how I install it as well (well, -U to force upgrades)11:40
tristanin the *buildstream* checkout11:41
tristanjust to make sure :)11:41
tristanI.e. I am not putting it in a user-wide or system-wide location, BuildStream's install will yank it from the internets and shove it into .eggs/ or such as a result of it not being installed already11:41
juergbihm, here pip3 install --user -e . puts dependencies in ~/.local/lib/python3.6. or maybe I'm mixing something up11:42
* juergbi reinstalls11:42
tristanjuergbi, oh scratch that... I didnt expect it to do that11:42
tristanbut it seems I have the grpc stuff in ~/.local/lib/python3.5/site-packages now11:43
juergbiok, what version? just to verify11:43
tristangrpcio-1.13.011:45
juergbiok, so that's fine11:46
gitlab-br-botbuildstream: merge request (tristan/local-cache-expiry->master: Expire artifacts in the local cache) #548 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/54811:49
tristantlater, I pulled the trigger11:50
tristanAnd will post merge land a fix to your FIXME comment in _stream.py...11:50
tristanhmmm, llvm does take a long time to build when you keep building ~3 other modules at the same time...11:51
tlater\o/ I'll take a look at reducing the verbosity11:52
gitlab-br-botbuildstream: merge request (135-expire-artifacts-in-local-cache->master: WIP: Resolve "Expire artifacts in local cache") #347 changed state ("closed"): https://gitlab.com/BuildStream/buildstream/merge_requests/34711:53
tristantlater, I'd like you to add the necessary API description comment blocks which are missing in resources.py, though11:55
tristanand fix the regression would also be good11:56
* tristan opens an issue for it11:56
gitlab-br-botbuildstream: issue #479 ("Incorrect summary when terminating builds") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/47912:01
* tristan hands tlater https://gitlab.com/BuildStream/buildstream/issues/47912:02
tlaterThanks!12:02
noisecelljonathanmaw, thanks for looking into the MR12:02
*** bethw has quit IRC12:06
gitlab-br-botbuildstream: merge request (dp0/453/import-order->master: Reorder app.py imports) #526 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/52612:08
tristanjuergbi, minor logistic point with branching... I have a choice here...12:09
tristanI should release 1.1.4 from the bst-1.2 branch, that much is clear12:09
tristanBut I'd rather not release 1.3.0 at the same time12:09
tristan*however*, we need there to be a tag12:09
tristanWhich would make the first 1.3.x release be 1.3.1, if we tag 1.3.0 (so that `bst --version` shows people the right thing)12:10
juergbithe other side of git describe? ;)12:10
tristanthe dark side12:10
juergbiif we do this, we need to make sure that the commit that we tag with 1.3.0 is not on the 1.2 branch12:11
juergbii.e., there needs to be at least one non-1.2 change already12:12
juergbicreating a 1.3.0 tag without spinning a tarball etc. is fine with me, although a bit unusual12:12
tristanOh interesting... does it ?12:14
juergbiwell, otherwise going along the 1.2 branch will jump from 1.1 to 1.3 and then back to 1.212:14
tristanI feel like semantically that shouldnt be12:15
tristanbut the implementation might have that effect indeed12:15
juergbithe other option would be to lead by example and no longer use git describe ;)12:16
tristanjuergbi, how about this... while doing the 1.1.4 release, I will anyway have to update the man pages12:16
tristanthat will only be on the bst-1.2 branch12:16
tristanthen I tag 1.3.0 on master12:16
juergbimaster still being at the branch point?12:17
Nexus /wc12:17
Nexus:I12:17
*** Nexus has left #buildstream12:17
juergbiit might work in practice but to me it still feels odd to have 1.3.x tag on the bst-1.2 branch12:17
*** Nexus has joined #buildstream12:17
tristanjuergbi, no no, 1.3.0 tag would be on master12:17
tristannot on the bst-1.2 branch12:17
tristanof course12:17
juergbiright but if there have been no merges to master since the bst-1.2 branch point, master HEAD will be on the bst-1.2 branch as well12:18
tristanA.) create bst-1.2 branch... B.) add release related commit... C.) tag 1.1.4 there12:18
tristanD.) Tag *master* with 1.3.012:18
juergbiif there has been no merge to master between A and D, master will still point to a commit that is also in the bst-1.2 branch12:18
tristanjuergbi, semantically my gut disagrees with you... without knowing the internals of git... I think a tag on master is a tag on master, not a tag on bst-1.2 just because the tree shas may happen to match12:19
juergbia tag applies to a commit, not to a branch12:19
tristanI see what you mean12:19
juergbia tag is just a name for a commit12:19
tristanSo, it's not such a bad thing12:20
tristanactually, 1.3.0 will point to a commit in bst-1.2's history12:20
juergbiexactly, that's what I would like to avoid12:20
juergbias this could be confusing12:20
juergbiwe could just wait until master gets at least one commit and then tag it12:20
tristanSure12:21
KinnisonSurely there's no point tagging 1.3.0 until there's a material difference between it and the basis of 1.2 anyway?12:21
juergbigit describe is used to create a version number12:21
tristanKinnison, the point is strictly for git describe12:21
tristanyeah12:21
* Kinnison is still not entirely sure how no material difference should result in a different version number, but hey :-)12:22
tristanso devs and users are aware they are using 1.3.x12:22
juergbibranches will be merged to master before the first 1.3.x dev release12:22
tristanTechnically, they need not know that until there *is* a material difference12:22
juergbiif we don't tag 1.3.0 early on, the generated version number will be misleading with these new features12:22
tristanIt's just one more thing to remember to do, outside of the scope of this branching activity12:22
*** bochecha has quit IRC12:28
tristanjuergbi, ignoring for now, but click_man barfs when trying to generate man pages for bst-artifact-server, probably a bad docstring or such12:30
juergbioh, maybe I can take a look at this later today12:30
valentindtristan, However something is not clear. Let's say I include in a list a.yml and b.yml. a.yml has "test: {'(>)': ["second"]}" and b.yml has "test: ["first"]". Should the "second" in a.yml be ignored? Or should it be composed into the result?12:32
gitlab-br-botbuildstream: merge request (coldtom/275->master: Indicate where artifacts are going to and coming from in the log) #518 changed state ("closed"): https://gitlab.com/BuildStream/buildstream/merge_requests/51812:37
*** toscalix has joined #buildstream12:44
tristanvalentind, I don't have the head for this today, sending out two emails and going to dinner12:45
valentindtristan, OK.12:45
tristanvalentind, the list append/prepend directives should really be handled transparently by composition12:45
valentindtristan, I will try to make something sensible and make it ready for review for tomorrow.12:45
tristanand a final pass ensures there is nothing left uncomposited12:46
valentindI will add tests so it is obvious.12:46
tristanok 1.1.4 is out !12:47
*** ChanServ sets mode: +o tristan12:47
*** tristan changes topic to "/BuildStream 1.1.4 is out ! | https://gitlab.com/BuildStream/buildstream | Docs: https://buildstream.gitlab.io/buildstream | IRC logs: https://irclogs.baserock.org/buildstream | Roadmap: https://wiki.gnome.org/Projects/BuildStream/Roadmap"12:47
tristanbst-1.2 branch is up, and in protected state like bst-1.0 and master12:48
tristanmaster is now open for 1.3 material12:48
laurenceace :)12:52
laurencejust seen the mail12:52
*** laurence has left #buildstream12:55
*** laurence has joined #buildstream12:55
gitlab-br-botbuildstream: issue #453 ("Testing locally fails due to wrong import order") changed state ("closed") https://gitlab.com/BuildStream/buildstream/issues/45312:58
gitlab-br-botbuildstream: merge request (dp0/453/import-order->master: Reorder app.py imports) #526 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/52612:58
*** bethw has joined #buildstream13:00
*** jennis__ has joined #buildstream13:00
*** jennis2 has quit IRC13:01
tristanAlright all emails sent :)13:01
laurenceenjoy the dinner :)13:02
tristanThat leaves us with includes and the integration commands thing I have to bang out... and then whichever minor/safe things we can backport from master before feature freeze13:02
tristanlaurence, I will !13:03
laurenceI emailed Agustin privately to delay any implementation of automating gitlab to sent patches to the ML, btw13:04
*** jonathanmaw has quit IRC13:04
laurencedidn't do so on the public list since i personally have no strong feelings myself13:04
tristanthanks laurence13:12
tristanIf everybody wants specifically *that* instead of a separate mailing list or separate channel of communication, I wont push back, but I don't think this decision was well thought out13:12
tristanOur public facing infrastructure should be optimized for low barrier of entry and occasional participants, such that we are a pleasant place to participate in13:13
tristanand I think that spaming the public discussion mailing list, even if "people can setup filters", is counter productive in that sense13:14
tristangiven that level of traffic of a mailing list is often the deciding factor in whether someone decides to remain subscribed to a mailing list13:14
Nexustristan: do you have a few minutes, i 'm try to fix a bug and would like your input13:16
*** toscalix has quit IRC13:18
*** tristan has quit IRC13:19
qinustyI'm looking to pickup https://gitlab.com/BuildStream/buildstream/issues/275 after the CAS cache changes. I'm unable to self assign the issue though (permissions I assume).13:35
juergbitristan: fyi, I've merged a first tiny MR to master, in case you want to tag 1.3.013:37
Nexustristan re: #449, workspace open force functionality, i looked in the _stream.py workspace open function, force is never actually used, like the functionality just doesn't exist. Do you happen to know A) how this happened, and B) what it was originally intended to do?13:42
jjardonqinusty: what is you id in gitlab13:43
qinustyQinusty13:43
Nexusqinusty:13:43
jjardonqinusty: done13:45
jjardonIs there a way to indicate bst to not take in account a element for the overlaps13:49
jjardon?13:49
jjardonif not everything is going to overlap with our base element: /usr/bin/file: files-stage1.bst is not permitted to overlap other elements, order files-stage1.bst above dependencies/base-sdk-image.bst13:50
jjardon            /usr/share/misc/magic.mgc: files-stage1.bst is not permitted to overlap other elements, order files-stage1.bst above dependencies/base-sdk-image.bst13:50
juergbijjardon: there is https://buildstream.gitlab.io/buildstream/format_public.html#overlap-whitelist13:51
jjardonyup, but what we want here is to say to bst that "base-sdk-image can be overlapped", not patch all the other elements (as I do not want them to overlap between them). I know is a corner case but not sure how to solve it13:53
qinustyCheers jjardon, Also submitting an issue for a failing example? I can't seem to find any issues which match the problem I'm seeing.13:55
gitlab-br-botbuildstream: issue #480 ("doc/examples/flatpak-autotools Unhandled exception") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/48013:56
juergbijjardon: this might not be possible. maybe jonathanmaw could answer this better when he's back as he implemented it13:57
juergbiin my bootstrap tests, I completely avoided any overlaps, so I didn't need any exceptions13:58
juergbi(i.e., I didn't mix binaries from different bootstrapping stages in a single hierarchy)13:58
jjardonok, thanks juergbi14:00
*** jonathanmaw has joined #buildstream14:50
*** bochecha has joined #buildstream14:52
gitlab-br-botbuildstream: merge request (tiagogomes/tarball_checkout->master: Add support for creating artifact tarballs) #546 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/54614:54
qinustyHi guys, does anyone have any bst projects which push/pull artifacts so I can reproduce https://gitlab.com/BuildStream/buildstream/issues/275 locally?14:57
juergbiqinusty: for pushing you need write/push access to a artifact server. this is often only granted to CI systems / limited set of users14:59
juergbithe pull part should be easier. however, the switch to CAS is extremely recent, so projects likely haven't migrated yet14:59
juergbi(freedesktop-sdk has a CAS test server, though)14:59
tlaterqinusty: "extremely recent" means two days ago ;)15:00
juergbiit is possible to set up your own CAS server (locally), though: https://buildstream.gitlab.io/buildstream/install_artifacts.html15:00
juergbiand if you set it up locally without public access, you can skip the authorization/key generation part, making it pretty simple15:02
qinustyAlright, I was just wondering what the current state of that issue is. Since the CAS change, I wonder what the current output information displayed is.15:02
qinustyI'll set up my own instance and see what we're currently showing and update the issue appropriately15:03
coldtomcould I get this reviewed please https://gitlab.com/BuildStream/bst-external/merge_requests/3515:04
gitlab-br-botbuildstream: merge request (bst_workspace_open_force_does_nothing->master: _stream.py: Added functionality for workspace open -f) #549 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/54915:08
gitlab-br-botbuildstream: merge request (franred/fix-except-argument-in-source-bundle->master: source-bundle: Enable --except option) #537 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/53715:15
gitlab-br-botbuildstream: merge request (chandan/use-testsuite-fedora->master: .gitlab-ci.yml: Use testsuite images for running tests) #531 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/53115:18
gitlab-br-botbuildstream: merge request (chandan/use-testsuite-fedora->master: WIP: .gitlab-ci.yml: Use testsuite images for running tests) #531 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/53115:20
*** ernestask has quit IRC15:21
gitlab-br-botbuildstream: merge request (chandan/use-testsuite-fedora->master: WIP: .gitlab-ci.yml: Use testsuite images for running tests) #531 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/53115:22
gitlab-br-botbuildstream: merge request (chandan/use-testsuite-fedora->master: WIP: .gitlab-ci.yml: Use testsuite images for running tests) #531 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/53115:23
*** jennis__ has quit IRC15:29
*** jennis__ has joined #buildstream15:29
*** jennis__ is now known as jennis15:38
laurencetpollard, Kinnison, qinusty, are you guys members of the BuildStream group on gitlab?16:18
laurenceHere's the link to request it if not - https://gitlab.com/groups/BuildStream/-/group_members16:18
* Kinnison is not, but doesn't see how that link helps him request access16:19
bethwhttps://gitlab.com/BuildStream --> "Request Access" button16:20
*** jonathanmaw has quit IRC16:21
tpollarddone16:22
gitlab-br-botbuildstream: issue #480 ("doc/examples/flatpak-autotools Unhandled exception") changed state ("closed") https://gitlab.com/BuildStream/buildstream/issues/48016:30
gitlab-br-botbuildstream: merge request (valentindavid/331_include->master: WIP: Add support for include in project.conf) #471 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/47116:38
gitlab-br-botbuildstream: merge request (valentindavid/331_include->master: Add support for include in project.conf) #471 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/47116:41
gitlab-br-botbuildstream: merge request (phil/437-junction-tutorial->master: WIP Phil/437 junction tutorial) #550 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/55016:42
gitlab-br-botbuildstream: merge request (bst_workspace_open_force_does_nothing->master: _stream.py: Added functionality for workspace open -f) #549 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/54916:43
gitlab-br-botbuildstream: issue #481 ("Misleading SUCCESS status when artifact push is skipped") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/48116:45
*** thomascoldrick has joined #buildstream16:49
*** coldtom has quit IRC16:49
*** leopi has joined #buildstream16:50
*** thomascoldrick has quit IRC16:53
*** finn_ has joined #buildstream16:54
*** qinusty has quit IRC16:56
*** bethw has quit IRC17:11
*** Prince781 has joined #buildstream17:12
*** leopi has quit IRC17:26
gitlab-br-botbuildstream: merge request (chandan/use-testsuite-fedora->master: WIP: .gitlab-ci.yml: Use testsuite images for running tests) #531 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/53117:47
*** tristan has joined #buildstream17:54
gitlab-br-botbuildstream: merge request (chandan/use-testsuite-fedora->master: WIP: .gitlab-ci.yml: Use testsuite images for running tests) #531 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/53117:56
gitlab-br-botbuildstream: merge request (chandan/use-testsuite-fedora->master: .gitlab-ci.yml: Use testsuite images for running tests) #531 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/53118:01
gitlab-br-botbuildstream: merge request (chandan/use-testsuite-fedora->master: .gitlab-ci.yml: Use testsuite images for running tests) #531 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/53118:03
*** cs_shadow has joined #buildstream18:10
*** leopi has joined #buildstream18:30
*** leopi has quit IRC19:09
*** tristan has quit IRC20:27
*** bochecha has quit IRC23:14

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!