IRC logs for #buildstream for Friday, 2018-08-03

*** barlas has joined #buildstream00:55
*** bochecha has quit IRC01:03
*** leopi has joined #buildstream03:04
*** leopi has quit IRC03:25
*** codex2064 has joined #buildstream03:55
*** leopi has joined #buildstream04:33
*** mohan43u has joined #buildstream05:11
*** leopi has quit IRC05:48
*** noisecell has joined #buildstream05:56
*** Peetz0r has joined #buildstream06:00
*** tristan has joined #buildstream06:05
*** leopi has joined #buildstream06:31
*** toscalix has joined #buildstream07:28
gitlab-br-botbuildstream: issue #331 ("Project configuration required is too much") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/33107:59
gitlab-br-botbuildstream: issue #195 ("Errors are needed when referring to local things outside of the project") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/19507:59
*** tiagogomes_ has joined #buildstream08:01
*** mohan43u has quit IRC08:01
toscalixLInk to the board we are working with in the meeting: https://gitlab.com/BuildStream/buildstream/boards/580466?milestone_title=BuildStream_v1.2&=&label_name[]=Blocker08:05
*** coldtom has joined #buildstream08:06
toscalixfeel free to join: https://appear.in/toscalix08:06
toscalixwe are going to discuss how the tasks related with the freeze are going08:07
gitlab-br-botbuildstream: issue #195 ("Errors are needed when referring to local things outside of the project") changed state ("closed") https://gitlab.com/BuildStream/buildstream/issues/19508:14
coldtomis it possible to connect to the network through bst shell?08:18
toscalixboard with Urgent tickets https://gitlab.com/groups/BuildStream/-/boards?=&label_name[]=Bug08:19
jmacAs far as I know, the sandbox is meant to isolate that, coldtom08:19
coldtomsomething similar to flatpak run --share=[substystem] would be very handy for troubleshooting08:20
coldtomcurrently i'm waiting ~3 hours for llvm6 to build to test an issue with openssl in freedesktop-sdk08:20
Kinnisoncoldtom: Would weak rebuilds help your cycle speed?08:21
coldtomKinnison: that doesn't rebuild elements if dependencies change right?08:22
coldtombecause if so, yes08:22
Kinnisoncoldtom: It only rebuilds elements if their sources, or their dependency chain *shape* changes afaict08:23
Kinnisoncoldtom: not if a dependency rebuilds08:23
Kinnisoncoldtom: --no-strict might be your friend08:23
coldtomKinnison: this probably solves my issue, ty08:23
*** leopi has quit IRC08:28
*** finn_ has joined #buildstream08:36
*** leopi has joined #buildstream08:38
*** finn has quit IRC08:38
* qinusty is looking for issue suggestions08:38
*** mohan43u has joined #buildstream08:46
gitlab-br-botbuildstream: issue #550 ("pulling from the cache doesn't honor the fetchers setting") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/55008:54
*** tiagogomes_ has quit IRC09:06
*** tiagogomes_ has joined #buildstream09:08
gitlab-br-botbuildstream: merge request (dp0/513/cas-cache-client-certs->master: WIP: Support dynamic client certificates for CAS cache) #594 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/59409:12
gitlab-br-botbuildstream: merge request (dp0/513/cas-cache-client-certs->master: WIP: Support dynamic client certificates for CAS cache) #594 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/59409:12
laurenceI think I will send a mail to the ML re back-porting to 1.2.09:26
qinustyI'm not too familiar with the process of backporting. I assume you're just rebasing a bunch of commits from an MR onto the 1.2 branch and adding the necessary commits that're missing?09:32
tiagogomes_qinusty: yes. You rebase, fix eventual conflicts and then create another merge request but this time targeting the bst-1.2 branch09:38
*** mohan43u has quit IRC09:50
laurenceRe notification emails from gitlab, there's always been a 'view it on gitlab' link on the ones i receive09:55
laurencebut it does not seem to be there anymore09:55
laurenceanyone else?09:56
jmacHmm, you're right09:56
jmacBut I have emails from yesterday which do have the link09:57
jmacAnd one today which doesn't09:57
gitlab-br-botbuildstream: merge request (tiagogomes/issue-500->master: Handle gracefully files of type socket) #570 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/57009:58
laurenceah well at least it's not just me - will see if it's been reported to gitlab upstream09:58
tristanlaurence, as I receive those in gmail, which I dont know if it's munging the messages in some way; I have always had to look at the first email in the thread which I received from gitlab to see that link10:00
tristanit's become a habit for me to click the first email in the thread to get at that link10:00
tristannot sure if that has regressed / changed10:00
laurenceI use thunderbird and10:00
laurencewoops - and they're usually on every mail10:01
tristancoldtom, regarding bst shell and network; in fact we reversed the default of that quite a while back, and added the `--isolate` option to differentiate10:02
tristancoldtom, in a build, network is always disabled, but for `bst shell`, it seems more popularly used to test a built application, as such we default to allowing networking there10:03
jmacYeah, GitLab have broken the HTML version of their email10:03
tristaninterestingly also, running `make distcheck` in a `bst shell --build` normally breaks without network access10:04
jmac`Reply to this email directly or <a href="https://gitlab.com/BuildGrid/buildgrid/merge_requests/34#note_92306915">view it on GitLab</a&gt`10:04
tristanjmac, indeed, I'm seeing the yuck right now10:05
tristanin my inbox :-S10:06
*** mohan43u has joined #buildstream10:07
laurenceI'll raise an issue on gitlab/production10:24
laurencehttps://gitlab.com/gitlab-com/production/issues/38910:28
*** coldtom has quit IRC10:30
toscalixtristan https://gitlab.com/BuildStream/nosoftware/communication/issues/1210:33
toscalixshould I add anything else?10:33
toscalixhummm, maybe the link to the previous communication, for reference10:34
jjardontristan: would it be possible to tag when we know there is a possibility we are breaking stuff? It would make our work easier to know what version to use and prepare for possible breackage10:36
jjardonfor example, the patch that now makes bst to fail when there are stuff outside the project folder, or when there is a change in the cache-key calculation10:37
tristanjjardon, I think there is an issue blocking such things10:40
tristanjjardon, i.e. I am perfectly fine with making symbolic tags, I think we need that10:40
tristanjjardon, but we need to make versioneer cope with it first, that was fallout from the last time we tried it10:40
jjardontristan: issue where? in buildstream?10:41
tristanyes10:41
tristanjjardon, remember you asked for a pre-cas tag, and then it started failing ?10:41
tristanthat resulted in an issue, I dont know off hand where it's filed; we aught to make sure it's filed and being addressed, though10:41
jjardonah ok, so this was already requested10:42
jjardonI will search the buildstream issue tracker10:42
jjardontristan: what started failing exactly?10:42
tristanWell, the specific tag you mean is not requested, but I have always presumed the ability to make symbolic tags, not all tags are release tags after all10:42
tristanjjardon, bst fails to derive it's version when the latest tag in history is not a numeric version tag10:43
tristanwhich... sucks10:43
tristanand causes pretty much any bst invocation to break10:43
jjardontristan: oops, well a (numeric) tag with a little description about why is done would help a lot. Only to have a reference10:44
tristanjjardon, that would not be ideal, because numeric tags, like 1.2.0 for instance, are release tags; if we tagged an arbitrary number and it caused BuildStream to not "fail", it would still cause BuildStream to report an incorrect version10:45
tristanalso, it would not convey the meaning of the symbolic tag in the tag name, which also sucks10:45
tristanfound it10:46
tristanjjardon, https://gitlab.com/BuildStream/buildstream/issues/51610:46
paulsherwoodnot sure if it's relevant, but ybd calculates its version using some git magic https://gitlab.com/baserock/ybd/blob/master/ybd/repos.py#L7510:47
paulsherwood(but ybd expects always to be run from git)10:47
jjardontristan: I only suggesting to tag more often: 1.1.3, 1.1.4, 1.1.5 and specially when we know there is a possibility to break stuff (the explanation can go in the tag body message)10:47
tristanpaulsherwood, what we do is similar, but there is a bug in that code10:47
paulsherwoodthere is?10:48
tristanwe use this versioneer thing to do that, it has a bug10:48
paulsherwoodhmmm... i thought you meant a bug in the ybd code. it's been working for several years10:48
tristanjjardon, understood, but I still think we should fix 516, it's probably not *that* hard to fix, probably easier than sitting around and discussing the issue :)10:48
tristanpaulsherwood, yeah it's not a bug in YBD, what we do which is similar (but also encodes the correct version in the package info when generating a dist tarball), has a bug10:49
paulsherwoodack... drop versioneer, then :)10:52
paulsherwood"you had one job..."10:52
tristanpaulsherwood, I dropped the last thing because it didnt do it's job properly (it needed an additional ./setup.py install --user -e invocation to update it's version)10:53
tristanFixing it is not a huge deal; this code which is in our repo, is doing a list of the tags in chronological order, it just needs to skip tags it doesnt understand as a release tag10:54
tristanThat is probably also easier than "dropping it"10:54
tristanit also serves an important purpose; whether or not humans consume release tarballs, package maintainers will either consume the tarballs, or need to rely on that so that BuildStream knows it's correct version when deployed via a distro10:55
tristantoscalix, reading through https://gitlab.com/BuildStream/nosoftware/communication/issues/12, I'm not sure what the purpose of all of that is. I was most certainly already going to mail the list and announce feature freeze along with the 1.1.5 beta, and have additionally confirmed that I will announce it in our meeting this morning11:01
tristantoscalix, maybe this issue is leading towards some documentation about our process, rather than a big issue about a mail I have to send out on monday ?11:02
tristanif the latter, I understand the purpose of it11:02
tristantoscalix, there is also some other material I have regarding the routine involved in making releases which could go into some useful documentation somewhere11:03
*** wizonesolutions12 has joined #buildstream11:05
tristanqinusty, do I have another moderated message from you ? or is that another notification from the message you posted before having joined the list ?11:12
tristanah, this appears to be the original message, since you have already subscribed and sent it, I will delete it from the moderation queue11:13
WSalmonif i checkout a non numeric tag then i get a error saying that it cant turn the tag name in to a int11:15
WSalmoni was gona make a issue but do we want it to suport this or just have a more graceful error message11:15
tristanWSalmon, I posted the exact issue for that above, recently11:20
tristanWSalmon, it needs to be fixed, plain and simple11:20
noisecellWSalmon, tristan, there is an issue open already for this: https://gitlab.com/BuildStream/buildstream/issues/51611:27
tristannoisecell, that is the one I'm referring to yes11:28
*** mohan43u has quit IRC11:30
*** mohan43u has joined #buildstream11:34
*** tristan has quit IRC11:40
WSalmonso i can wrap the int('s in try and have a nice message saying please version me better? or do we want to beable to suport these tags some how?12:07
gitlab-br-botbuildstream: merge request (tiagogomes/includes-1.12-backport->bst-1.2: Add support for include in project.conf) #599 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/59912:08
noisecellWSalmon, for my discussion with tristan, we would like to make versioner to understand release and not release tags, and if it is a no release tag (as the non numerical are at the moment) continue using the previous tag12:12
noisecellat least that is what I understood of what it is written in #51612:12
*** toscalix has quit IRC12:16
*** toscalix has joined #buildstream12:16
toscalixtristan beta is august 6th12:46
toscalixtogether with freeze12:47
toscalixI am just documenting the release12:47
toscalixassuming freeze and beta does not need to be the same day12:47
toscalixso for the next release I just need to copy the tickets12:47
gitlab-br-botbuildstream: merge request (tiagogomes/includes-1.12-backport->bst-1.2: Add support for include in project.conf) #599 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/59912:48
toscalixin the original plan freeze and beta were not the same day. It is do to a delay. I will make a note in the comments about this once I finish the creation of the beta communication ticket12:49
qinustytoscalix, tristan isn't connected via bouncer. He'll miss that message12:53
*** toscalix has quit IRC12:54
*** toscalix has joined #buildstream12:54
tiagogomes_If one issue is blocked by another issue, how that should be marked. Through "Related Issues" or is there a better way?12:57
qinustyI'd argue related with a comment in the description saying something about how #<blocker> needs to be addressed first12:58
laurenceRelated Issues and also a note in the description is the only thing you can do, sadly12:58
*** bochecha has joined #buildstream13:03
toscalixtristan https://gitlab.com/BuildStream/nosoftware/communication/issues/1313:07
jjardonHey, only coming here to say we see massive improvements with the new CAS server (much less CPU usage, and most important, no timeout failures anymore). Congrats everyone juergbi  and everyone involved! :)13:08
qinustytoscalix, tristan is not currently connected and won't see backscroll13:08
toscalixqinusty: I know, but he will probably read the logs on Monday13:09
juergbijjardon: good to hear, thanks for the feedback13:09
toscalixI will send him a mail though, with the full explanation. Thanks for poointing13:09
toscalixgreat to hear13:09
toscalixgood news on friday afternoon....13:10
noisecellqinusty, the channel is logged, so everyone can read the backscroll, though -- https://irclogs.baserock.org/buildstream13:11
noisecelljjardon, these are great news13:12
qinustyTIL13:12
qinustyty noisecell13:12
bochechajjardon: I had a timeout failure today13:13
qinustyHow do people raise warnings to the interface when the message handler isn't initialized?13:19
tiagogomes_sys.stderr.write maybe13:20
WSalmonnoisecell tristan, i can fix this by changing line 242 in _version.py but it looks like the file is auto generated or has something to do with versioner. do i need to try and resolve this upstream in versioner so we can continue to upgrade versioner or can i just submit a change to bst with this small change to bst's copy of _version.py?13:23
tiagogomes_I am trying to build freedesktop sdk, and there are a lot of these messages@13:23
tiagogomes_[00:00:00][][] SUCCESS cache_size.15157.log13:23
tiagogomes_[--:--:--][][] START   cache_size.15159.log13:23
noisecellWSalmon, regarding ttps://gitlab.com/BuildStream/buildstream/issues/516 (last paragraph) -- we would like to solve that in versioneer if possible13:29
noisecelland if it does involve big effort, open an issue and create a workaround in our code13:30
jjardonbochecha: do you have a link to the logs?13:34
bochechajjardon: https://gitlab.com/freedesktop-sdk/freedesktop-sdk/pipelines/27064115/builds13:35
bochechajjardon: 3 out of 4 timed out13:35
bochechajjardon: it's building a lot straight from bootstrap though, so now that I think about it, it probably had nothing to do with the new cache13:35
jjardonbochecha: no related with CAS really13:35
jjardonsimply the build took more than 20h, which is the current limit13:35
jjardonmaybe we should increase it13:36
bochechaI've relaunched it, let's see if this time it hits the cache and builds less, and thus faster :)13:36
*** xjuan has joined #buildstream14:00
gitlab-br-botbuildstream: merge request (relative_workspaces->master: WIP: Patch for issue #191 support relative workspaces) #504 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/50414:02
WSalmonCould some one have a quick look at https://gitlab.com/BuildStream/buildstream/merge_requests/595 at some point, thanks14:21
*** jennis2 is now known as jennis14:22
*** coldtom has joined #buildstream14:23
*** toscalix has quit IRC14:38
*** toscalix has joined #buildstream14:39
*** noisecell has quit IRC14:53
*** leopi has quit IRC14:54
gitlab-br-botbuildstream: merge request (tiagogomes/issue-520->master: Fix race condition when calculating disk usage) #600 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/60015:04
gitlab-br-botbuildstream: merge request (willsalmon/versionTagRegrex->master: Search for tags with the *.*.* patten for version) #601 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/60115:10
tiagogomes_WSalmon: commented on the PR15:14
gitlab-br-botbuildstream: merge request (Qinusty/491->master: Cache quota is now restricted to available disk space) #563 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/56315:20
*** Ragnor has joined #buildstream15:20
WSalmonSo following up on #516 I have made !601 noisecell tristan15:20
gitlab-br-botbuildstream: merge request (Qinusty/502->master: cascache.py: Raise ArtifactError on grpc error) #576 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/57615:21
gitlab-br-botbuildstream: merge request (Qinusty/275->master: Indicate where artifacts are going to and coming from in the log) #553 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/55315:22
gitlab-br-botbuildstream: merge request (relative_workspaces->master: WIP: Patch for issue #191 support relative workspaces) #504 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/50415:23
qinustytiagogomes_, If I'm looking to rebase for a backport. I assume I'm checking out 1.2 and cherry picking my commits from the relevant MR?15:26
WSalmonyou may consider "git rebase --onto 1.2.x commitBefore commitTo" if you just want a few and dont want to cherry pick each one15:31
tiagogomes_I normally cherry-pick it is only one or two commits. Otherwise I do a git rebase instead15:33
*** toscalix has quit IRC15:33
gitlab-br-botbuildstream: merge request (Qinusty/backport-576->bst-1.2: Backport unhandled exception fix in cascache.py) #602 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/60215:34
*** leopi has joined #buildstream15:35
*** leopi has quit IRC15:43
qinustyAlright, I've got a few I'll do monday as rebases15:43
qinustyWhat is the merge policy onto 1.2? I've made a MR https://gitlab.com/BuildStream/buildstream/merge_requests/60215:44
gitlab-br-botbuildstream: merge request (willsalmon/versionTagRegrex->master: Search for tags with the *.*.* patten for version) #601 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/60115:45
tiagogomes_qinusty: I think the unofficial policy is that if was approved in master and it makes sense to backport it to 1.2, you can create a merge request and set it to merge automatically when the CI passes15:51
gitlab-br-botbuildstream: merge request (willsalmon/trackWarning->master: Add warning to git track if track and ref are not present) #580 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/58015:58
*** rdale has quit IRC16:02
phildawsonThe aarch64 runnner that bst-docker-images uses seems to be down. jjardon do you know anything about this?16:11
*** tiagogomes_ has quit IRC16:22
*** tiagogomes_ has joined #buildstream16:22
*** tiagogomes_ has quit IRC16:28
gitlab-br-botbuildstream: merge request (Qinusty/backport-576->bst-1.2: Backport unhandled exception fix in cascache.py) #602 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/60216:30
gitlab-br-botbuildstream: merge request (jmac/cas_virtual_directory->master: WIP: CAS-backed virtual directory implementation) #481 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/48116:37
*** rdale has joined #buildstream16:41
gitlab-br-botbuildstream: merge request (jmac/cas_virtual_directory->master: WIP: CAS-backed virtual directory implementation) #481 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/48116:50
gitlab-br-botbuildstream: merge request (jmac/cas_virtual_directory->master: WIP: CAS-backed virtual directory implementation) #481 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/48116:54
gitlab-br-botbuildstream: merge request (jmac/cas_virtual_directory->master: WIP: CAS-backed virtual directory implementation) #481 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/48116:57
*** mohan43u has quit IRC17:06
*** Pici has joined #buildstream17:10
*** mohan43u has joined #buildstream17:10
*** rdale has quit IRC17:11
gitlab-br-botbuildstream: merge request (toscalix->master: removed space in task template so checkboxes work as expected) #588 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/58817:29
*** xjuan has quit IRC18:54
*** leopi has joined #buildstream19:16
*** lantw44 has quit IRC19:55
*** cs_shadow has quit IRC20:23
*** beaver has joined #buildstream21:50
*** bochecha has quit IRC21:59
*** Dan_au has joined #buildstream22:05
*** Hello71 has joined #buildstream22:10
*** tristan has joined #buildstream22:13
*** Welcome has joined #buildstream22:35
*** leopi has quit IRC22:50
*** tristan has quit IRC22:56
*** pelegreno______ has joined #buildstream23:30
*** justyns has joined #buildstream23:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!