IRC logs for #buildstream for Wednesday, 2021-01-27

*** tristan has quit IRC02:46
*** tristan has joined #buildstream02:58
*** ChanServ sets mode: +o tristan02:58
tristannanonyme, yes, but there is no incentive to start worrying about it until we can get more serious about a 2.0 timeline03:00
tristanI think that the buildbox & friends part is currently "mostly stable", except for buildbox-common, so there might be a question of whether to distribute that dynamic or do static linking or whatnot03:01
* tristan not 100% clear but that is the story afair03:01
tristanjuergbi, fwiw, the orphaned casd instances from one test run I ran last night are still lingering on today03:17
tristanI'll see if I can figure out which tests are causing this03:20
* tristan is wondering if he can consolidate more code across the AssetCache derived classes...04:19
tristanI wonder what is the justification for such wildly diverting APIs04:19
tristanSourceCache has commit(), how come ArtifactCache has no commit() ?04:21
tristanIt looks to me that the only thing these subclasses do that is special, is the translation of data model objects to protos and back04:22
tristanand asides from this, the base AssetCache class can take care of loading/storing to local CAS and pushing/pulling from remotes04:22
tristanAlso seems strange that ElementSources is taking care of putting the Source.get_kind() into it's own ElementSources.get_unique_key() implementation, rather than the Source._get_unique_key() wrapper04:26
tristanWe would not otherwise need Source._get_source_name(), we could just use Source._get_unique_key() for the keys in SourceCache04:27
*** tristan has quit IRC07:29
*** tristan has joined #buildstream07:31
*** ChanServ sets mode: +o tristan07:31
tristanjuergbi, I have a nice idea on how to abolish *both* of those obnoxious junction attributes which were used to say "download from junctioned project caches" and "upload artifacts to this project's server even if they come from junctioned projects"07:59
tristanHere, https://lists.apache.org/thread.html/rf2da9830e2fa918357f99a6021e55fc43df876f0b19d43f68802f083%40%3Cdev.buildstream.apache.org%3E I suggest removing "pull-subproject-artifacts" completely, since user config can make a blanket statement08:00
tristanBut I think an elegant way to have full straight forward control, is to change the "push" attribute08:00
tristanSo instead of a boolean "push", we could have an enum "action", and it's value can be "push"/"pull" or "both"08:01
tristanWith this, user configuration is very straight forward, you can decide globally where to push and pull, and also override it on a per-project-name basis in the buildstream.conf08:02
* tristan wonders if he forgot something08:02
tristanmy branch currently untangles all the mess of AssetCache poking it's nose in the parsing/decision making process, and results in removing about 250 loc08:03
tristanHmmm indeed I think I missed something, I think there is a use case where we want to specify push remotes in the buildstream.conf without discarding fetch remotes recommended by project configuration08:04
tristanMaybe that is just one switch08:07
tristan"augment-or-override project recommended cache servers when building this project as a toplevel"08:07
*** santi has joined #buildstream09:46
*** tristan has quit IRC11:25
*** tristan has joined #buildstream11:37
*** ChanServ sets mode: +o tristan11:37
*** tristan has quit IRC12:19
*** tristan has joined #buildstream12:19
*** ChanServ sets mode: +o tristan12:19
*** tristan has quit IRC12:41
*** tristan has joined #buildstream12:41
*** ChanServ sets mode: +o tristan12:41
*** tristan has quit IRC12:58
*** lchlan has quit IRC16:37
*** jward has quit IRC16:38
*** lchlan has joined #buildstream16:39
*** jward has joined #buildstream16:40
*** jward has joined #buildstream16:43
*** jward has quit IRC16:44
*** jward has joined #buildstream16:45
*** jward has quit IRC16:46
*** jward has joined #buildstream16:48
*** jward has quit IRC16:49
*** jward has joined #buildstream16:50
*** jward has quit IRC16:51
*** jward has joined #buildstream16:56
*** jward has quit IRC17:17
*** jward has joined #buildstream17:19
*** jward has quit IRC17:20
*** jward has joined #buildstream17:29
*** jward has quit IRC17:30
*** jward has joined #buildstream17:34
*** jward has quit IRC17:35
*** jward has joined #buildstream17:35
*** jward has joined #buildstream17:36
*** jward has quit IRC17:37
*** jward has joined #buildstream17:56
*** jward has quit IRC17:57
*** jward has joined #buildstream17:57
*** jward has quit IRC18:13
*** jward has joined #buildstream18:18
*** jward has quit IRC18:19
*** jward has joined #buildstream18:19
*** jward has quit IRC18:20
*** jward has joined #buildstream18:20
*** jward has quit IRC18:25
*** jward has joined #buildstream18:32
*** jward has quit IRC18:54
*** jward has joined #buildstream18:59
*** jward has quit IRC19:00
*** jward has joined #buildstream19:05
*** jward has quit IRC19:08
*** jward has joined #buildstream19:13
*** santi has quit IRC19:26
*** jward has quit IRC19:39
*** jward has joined #buildstream19:41
nanonymeHmm, I wonder if the running out of fd's with bst1 could also be related to refactoring in Python 3.819:41
*** jward has quit IRC19:42
*** jward has joined #buildstream19:43
nanonymehttps://bugs.python.org/issue3369519:44
nanonymeIf Python ends up keeping fd's open longer than before, it might have resulted in further fd leakage19:44
*** jward has quit IRC19:44
nanonymeI wonder if there's any tools to debug fd leaks19:45
*** jward has joined #buildstream19:46
*** jward has quit IRC19:47
*** jward has joined #buildstream19:48
*** jward has quit IRC19:49
*** jward has joined #buildstream19:51
*** jward has quit IRC19:52
*** jward has joined #buildstream19:53
*** jward has quit IRC19:54
*** jward has joined #buildstream19:54
*** jward has quit IRC19:55
*** jward has joined #buildstream19:55
*** jward has quit IRC19:56
*** jward has joined #buildstream19:56
*** jward has quit IRC19:57
*** jward has joined #buildstream19:57
*** jward has joined #buildstream19:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!