IRC logs for #buildstream for Friday, 2020-01-10

*** delli3 has quit IRC06:50
*** delli3 has joined #buildstream06:50
*** traveltissues has joined #buildstream08:35
*** traveltissues has quit IRC08:38
*** tiagogomes has joined #buildstream09:55
*** phildawson_ has joined #buildstream10:07
*** jonathanmaw has joined #buildstream10:27
*** lachlan has joined #buildstream10:36
*** lachlan has quit IRC10:47
*** lachlan has joined #buildstream10:49
*** lachlan has quit IRC10:51
*** lachlan has joined #buildstream11:27
*** lachlan has quit IRC11:30
*** traveltissues has joined #buildstream11:42
*** lachlan has joined #buildstream12:00
*** lachlan has quit IRC12:55
*** traveltissues has quit IRC12:56
*** traveltissues has joined #buildstream13:41
gitlab-br-bottraveltissues opened (was WIP) MR !1761 (traveltissues/1216->master: mtime support) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/176113:51
*** traveltissues has quit IRC13:54
*** traveltissues has joined #buildstream13:55
tpollardhmmm, can't manually instantiate traceback objects until 3.714:26
*** lachlan has joined #buildstream14:28
tpollard^ that makes !1788 a bit trickier juergbi14:28
gitlab-br-botMR !1788: scheduler.py: Handle exceptions that are caught under the event loop https://gitlab.com/BuildStream/buildstream/merge_requests/178814:28
*** lachlan has quit IRC14:34
*** lachlan has joined #buildstream14:34
*** lachlan has quit IRC14:38
juergbitpollard: we could just None for the tb14:39
juergbishould probably prefix the message with something to make clear that it's from the asyncio exception handler14:40
juergbitraceback.format_exception() seems to accept None as tb14:40
*** lachlan has joined #buildstream14:57
*** lachlan has quit IRC15:11
tpollardyep it does, should be fine with we tell mypy to ignore that call to the excepthook15:11
tpollardas it can't tell that we've overriden it globally with a method that doesn't type check the parameters15:11
*** lachlan has joined #buildstream15:16
*** lachlan has quit IRC15:20
douglaswinshipHuh, project.get_alias_uris() behaves strangely.15:26
douglaswinshipor rather, behaves strangely when there are no alias uris to return.15:26
douglaswinshipI'd have expected it to return an empty list15:26
douglaswinshipInstead it gives a list with "None" as the only element in the list.15:27
douglaswinshipso I had a loop that starts "for thing in project.get_alias_uris():" and I got some strange errors.15:30
*** lachlan has joined #buildstream15:30
douglaswinshipI suppose the function isn't ever expected to be called with an invalid alias, so it's not supposed to come up. Still, seems odd.15:31
tpollardI've not touched that area of the code, but on the face of it I agree that seems odd15:31
benschubertcan you open an issue or investigate a bit more? I agree it looks like a bug there15:32
douglaswinshipbenschubert: this might sound silly, but i'm not confident enough to raise that sort of issue, especially on a project i'm not directly involved in.15:33
*** lachlan has quit IRC15:34
douglaswinshipI'm still such a new/inexperienced programmer, and I keep imagining i'm blundering into things I shouldn't be using, or using them wrong.15:34
douglaswinshipso raising an issue would be kind of intimidating15:35
*** traveltissues has joined #buildstream15:36
tlater[m]Hm, someone seems to have snuck in a patch that doesn't respect tox formatting15:40
benschubertNot silly at all, I understand and guess we are many who have come through this. And starting in a new project is always something challenging.15:44
benschubertWhat I learned with time is that many project don't have enough bandwidth to check everything and when they get sufficientely large, it becomes hard to follow everything and find all those problems and that opening an issue to at least ask for clarification is always helpful, because it will in the worst case document the problem :) (I would recommend looking a bit in the issues first to ensure that there is not already15:44
benschubertone)15:44
benschubertFor what I know around the issue there: https://gitlab.com/BuildStream/buildstream/blob/master/src/buildstream/_project.py#L431 is the culprit, and seems to be done on purpose. I would expect that many tests would fail if that was changed.15:44
benschubertMaybe jonathanmaw would have more information around this? But it's a long time ago :'D15:44
benschubertdouglaswinship: (One approach I usually do though is I start with one issue on a project and see how people react there, and if it's welcome I continue ;), always depends on the project)15:44
douglaswinshipbenschubert: good advice. I'll try and buck up the courage to do that, in future.15:47
benschuberttlater[m]: I believe I'm done with !1739 if you have time to have a look at it :) I'm just re-running benchmarks and will unwip + send the ML post as soon as I have them done, TLDR: 1m30 to 15-17s for a 'bst show' on an internal project :D15:47
gitlab-br-botMR !1739: WIP: Optimize consistency and state handling https://gitlab.com/BuildStream/buildstream/merge_requests/173915:47
douglaswinshipfor now, it seems like this has a good reason for being there. (or at least a good reason for us to change it now).15:48
benschubertdouglaswinship: gets easier every time and I personally have found very few communities not welcoming more help :D15:48
tlater[m]benschubert: Well, you happen to catch me on some down time...15:48
douglaswinshipNow i know about it, i can just sanitize the outputs15:48
benschuberttlater[m]: figured it out since you were there ;)15:49
benschubertdouglaswinship: are you working on a plugin?15:49
douglaswinshipno, a script, which i'll be posting soon and asking for advice on.15:50
benschubertok!15:50
cs-shadowtlater[m]: is black complaning at the moment?15:50
*** lachlan has joined #buildstream15:50
tlater[m]cs-shadow: If I run tox -e format it reformats some files I didn't change15:50
tlater[m]Though in retrospect, this is on a branch I rebased against another15:51
tlater[m]So it might just be that that branch contains something unblack15:51
tlater[m]It's been marked as non-WIP, so I assumed it was right, but that's no guarantee ;)15:51
benschuberttlater[m]: I don't have a problem on my branch that I just rebased on master :)15:55
tlater[m]Right, then nevermind me15:55
tlater[m]Though that'll probably mean my CI will fail again :|15:55
benschuberttlater[m]: also for 1739, does the 'breakage' seems fair to you? (In user-behavior, in the description)15:56
tlater[m]benschubert: You mean the one in the NEWS entry?15:56
benschubertno, https://gitlab.com/BuildStream/buildstream/merge_requests/1739#breaking-behaviors15:57
benschubert(which I actually forgot to put in the NEWS)15:57
tlater[m]Huh, it didn't even show me that15:58
tlater[m]Let me read...15:59
benschuberttlater[m]: just updated the NEWS so if you refresh that should be fine15:59
tlater[m]benschubert: Mind adding a recommendation to use `bst source delete`, assuming we have that?16:01
benschubertI'm not sure it's a good thing advertising before we have it :/16:01
tlater[m]If we don't, I think I'd rather not see this patch without a command to also do that.16:01
tlater[m]Hmm16:01
tlater[m]I'd just like to see that workflow documented properly, and I'm a little worried we forget if we don't do it now.16:02
tlater[m]But the breakage itself seems fine.16:02
benschubertthe problem with 'source delete' is that sources would need implementing it no?16:03
cs-shadowtlater[m]: sometimes that can also be because of a new black release. But it hasn't changed since 28 Oct16:03
tlater[m]benschubert: Would they? Couldn't we just purge the specific entry from the cas?16:04
tlater[m]Sources are in cas now, right?16:04
benschubertthey are both local and in cas16:05
tlater[m]Hm, in either case, I'm really hestitant to introduce anything that forces users to manually blow up their cache after that one guadec.16:06
tlater[m]It's not really acceptable workflow16:06
benschubertand I wonder whether bst source delete $element seems right16:06
benschubertI mean, it's only if they want to check again for the warning16:07
benschubertand if they want to fix the warning, that also means modifying the source ref16:07
benschubertso it will need to be re-imported16:07
benschubertno?16:07
tlater[m]Ah, and I suppose in that case it will show up anyway16:08
tlater[m]benschubert: Right, in that case I think the news entry just needs to clarify that it's the same _exact_ source16:08
*** lachlan has quit IRC16:08
benschubertmmh actually the comment in the NEWS is wrong yep16:08
benschubertah shoot, it is dependent on 'get_unique_key'16:10
*** lachlan has joined #buildstream16:10
benschubertwhich might not be fine16:10
benschuberteven though the git plugin does it correctly for example16:11
coldtomwould there be interest in having this plugin in bst-plugins-experimental? It produces python wheels https://gitlab.com/celduin/burn-sdk/tree/coldtom/add-bgd/plugins/elements16:11
tlater[m]benschubert: I think `get_unique_key` has to be guaranteed to actually be unique on the plugin end16:12
tlater[m]Otherwise this is a bug on the plugin end16:12
persiaI think so.  While some folk use buildstream to compose full systems, using it to produce packages in various formats seems like a sensible use case.16:12
tlater[m]benschubert: In what sort of case do you expect that to be a problem, outside of broken plugins?16:13
benschubertcoldtom: what about making it more flexible and allowing source packages too? :)16:13
benschuberttlater[m]: none16:14
benschubertthat I can think off16:14
tlater[m]Maybe check with traveltissues that this doesn't break workspaces16:14
tlater[m]Because I can't quite remember how those handle `get_unique_key`16:14
benschuberttlater[m]: as far as the tests go, it doesn't16:14
tlater[m]But outside of that, LGTM16:15
tlater[m]I'll approve whenever you mark it as non-WIP16:15
benschubertthanks!16:15
*** lachlan has quit IRC16:17
cs-shadowcoldtom: yes, i think it will be great to have a generic `python_package` plugin, that can build both source distributions as well as binary wheels.16:17
cs-shadowfor later, I think we can also look into doing something for producing `manylinux` wheels as that's the only thing PyPI accepts for Linux16:17
coldtomgreat! i'll work on making it more general and upstreaming it at some point then16:18
*** phildawson-ct has joined #buildstream16:19
*** phildawson_ has quit IRC16:21
*** lachlan has joined #buildstream16:32
*** lachlan has quit IRC16:39
tpollardjuergbi: can you check that you agree with 1788 now? I'd like to get it over the line without too much wrangling16:51
juergbiah, you needed special code in the handler after all?16:53
*** lachlan has joined #buildstream16:54
juergbitpollard: commented with one possible simplification but overall makes sense to me16:58
juergbiI don't know whether benschubert wants to take another look16:58
benschubertI'm fine with the code now :)17:01
*** lachlan has quit IRC17:02
*** lachlan has joined #buildstream17:05
tpollardjuergbi: replied :)17:16
*** lachlan has quit IRC17:20
tpollardta!17:21
* tpollard merges17:25
gitlab-br-bottpollard closed issue #1245 (Install asyncio exception handler) on buildstream https://gitlab.com/BuildStream/buildstream/issues/124517:25
gitlab-br-bottpollard merged MR !1788 (tpollard/loop_exception->master: scheduler.py: Handle exceptions that are caught under the event loop) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/178817:25
benschubertjuergbi: if you have time would you mind having a look at !1739 see if I missed something? It's around state handling so...17:36
gitlab-br-botMR !1739: WIP: Optimize consistency and state handling https://gitlab.com/BuildStream/buildstream/merge_requests/173917:36
*** tpollard has quit IRC17:45
*** lachlan has joined #buildstream17:46
*** phildawson-ct has quit IRC17:49
juergbibenschubert: can't take a look right now. will probably have to wait until Monday17:51
benschubertSure, thanks a lot17:51
*** lachlan has quit IRC17:52
gitlab-br-botBenjaminSchubert opened (was WIP) MR !1757 (bschubert/standardized-tests->master: introduce cross-repo standardized source tests) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/175718:04
*** jonathanmaw has quit IRC18:42
*** lachlan has joined #buildstream18:50
*** tiagogomes has quit IRC18:52
*** lachlan has quit IRC18:59
*** lachlan has joined #buildstream19:04
*** lachlan has quit IRC19:13
*** lachlan has joined #buildstream20:00
*** lachlan has quit IRC20:06
*** lachlan has joined #buildstream20:15

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!