IRC logs for #buildstream for Thursday, 2019-12-05

*** narispo has quit IRC00:27
*** narispo has joined #buildstream00:27
*** narispo has quit IRC00:31
*** narispo has joined #buildstream00:34
*** narispo has quit IRC01:10
*** narispo has joined #buildstream01:10
*** phoenix has joined #buildstream05:54
*** narispo has quit IRC05:55
*** narispo has joined #buildstream05:55
*** phoenix has quit IRC06:17
*** tristan has quit IRC06:37
*** juergbi has quit IRC06:51
*** juergbi has joined #buildstream06:58
*** juergbi has quit IRC07:27
*** juergbi has joined #buildstream07:31
*** traveltissues has joined #buildstream07:37
*** tpollard has joined #buildstream09:08
*** santi has joined #buildstream09:29
*** santi has quit IRC09:31
*** santi has joined #buildstream09:33
benschubertOur aarch64 tests seem to more or less always be failing: https://gitlab.com/BuildStream/buildstream/-/jobs/369697841 is someone still interested in those tests and can fix the runners?09:46
gitlab-br-botBenjaminSchubert approved MR !1706 (chandan/interactive-tests->master: Add tests for interactive BuildStream operations) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/170609:54
*** jonathanmaw has joined #buildstream09:54
gitlab-br-botBenjaminSchubert approved MR !1725 (1211-stop-using-non-posix-features-in-small-test-suite-tests-to-avoid-fake-test-failures->master: Resolve "Stop using non-POSIX features in small test suite tests to avoid fake test failures") on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/172510:01
benschubertcoldtom: any plan to work on !1607 ? Or would you mind me taking it over?10:10
gitlab-br-botMR !1607: WIP: Run standardised source tests from external plugins https://gitlab.com/BuildStream/buildstream/merge_requests/160710:10
coldtombenschubert: i don't think i'll have time any time soon, feel free to get it over the line10:11
benschubertSure, thanks!10:12
*** phildawson has joined #buildstream10:14
*** tme5 has joined #buildstream10:26
*** lachlan has joined #buildstream10:31
gitlab-br-botjuergbi opened MR !1748 (juerg/runcli-unused-parameter->master: testing/runcli.py: Remove unused configure parameter from run() methods) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/174810:47
gitlab-br-botBenjaminSchubert approved MR !1748 (juerg/runcli-unused-parameter->master: testing/runcli.py: Remove unused configure parameter from run() methods) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/174810:49
gitlab-br-botjuergbi opened MR !1749 (juerg/cas-directory-reset->master: _sandboxreapi.py: Reset CasBasedDirectory instead of recreating it) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/174910:50
*** lachlan has quit IRC10:56
*** cs-shadow has joined #buildstream11:24
*** rdale has joined #buildstream11:31
*** lachlan has joined #buildstream11:37
*** lachlan has quit IRC11:41
gitlab-br-botjuergbi merged MR !1748 (juerg/runcli-unused-parameter->master: testing/runcli.py: Remove unused configure parameter from run() methods) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/174811:46
*** narispo has quit IRC11:51
juergbibenschubert: are you happy with my reply? https://gitlab.com/BuildStream/buildstream/merge_requests/1749#note_25510597011:52
*** narispo has joined #buildstream11:52
benschubertyep thanks!11:52
cs-shadowquick q - is marge healthy these days, or should I merge things manually?12:28
*** lachlan has joined #buildstream12:30
*** lachlan has quit IRC12:36
tme5i've run into a bit of a catch-22 with my work on the git source plugin. there's not much documentation on it, but Source.get_source_fetchers is supposed to iterate over all sources we will be fetching from12:38
tme5however, I can't make that list complete without actually doing the fetching.. which seems like it might be problematic12:38
*** toscalix has joined #buildstream12:44
*** narispo has quit IRC12:52
*** narispo has joined #buildstream12:53
tme5do I understand that correctly? is there any harm in not implementing get_source_fetchers?12:54
tme5it seems to be only used in source.py and in one function12:55
coldtomtme5: the docs here suggest it's optional https://docs.buildstream.build/1.4.1/buildstream.source.html#abstract-methods12:56
coldtom...unless you're using SourceFetchers, like the git plugin does12:57
* coldtom should read better 12:57
tme5I had read the docs, it says "This only *needs* to be implemented for sources that need to download from multiple URLs while fetching"12:57
tme5but i don't know all those URLs before fetching12:58
*** lachlan has joined #buildstream12:58
*** lachlan has quit IRC12:59
gitlab-br-botjuergbi merged MR !1749 (juerg/cas-directory-reset->master: _sandboxreapi.py: Reset CasBasedDirectory instead of recreating it) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/174913:00
*** santi has quit IRC13:14
*** narispo has quit IRC13:23
*** narispo has joined #buildstream13:24
*** toscalix has quit IRC13:32
*** toscalix has joined #buildstream13:33
benschuberttme5: Why wouldn't you know? The sources should have been tracked at fetch time, so you'll have a ref, and know all the submodules that are present right?13:48
*** santi has joined #buildstream13:50
coldtombenschubert: i think tme5 is trying to recursively submodule13:56
coldtomsome projects may rely on their submodules' submodules13:57
benschubertcoldtom: you _should_ still have all urls at fetch time no? Your source is meant to be fully resolved once you fetch13:57
benschubertSo we might have a problem that the git source base doesn't handle recursive submodules in the metadata, which we could fix13:57
coldtomah, i think we have  crossed wires on source fetchers/sources perhaps13:58
coldtomin which case, yes, everything needed _should_ be there13:59
*** lachlan has joined #buildstream14:07
tme5benschubert, my understanding based on the name is that SourceFetchers are only useful for fetching sources14:13
tme5so it stood to reason that i should assume my source is not fetched when thinking about them14:13
*** lachlan has quit IRC14:14
tme5is this not correct?14:14
benschubertThat seems a correct assumption14:15
cs-shadowthere's a difference between not having sources fetched and not knowing what to fetch. source fetchers can assume that sources aren't fetched locally, but they should still know that what they need to fetch without fetching it14:18
tme5but my issue is that I can't know completely what I need to fetch without fetching anything14:18
tme5because i'm adding recursion to submodule checkout14:19
*** lachlan has joined #buildstream14:20
cs-shadowI understand that you need to clone one repo to find out about its submodules and so on, but all of this should happen at track time. Once we've finished tracking we should know exactly what needs to be fetched on subsequent runs14:20
tme5i'm not sure i understand14:21
tme5what do you mean by 'track' ? I thought 'tracking' was automatically updating the refs in an element file. Isn't that an optional stage?14:22
benschuberttme5: it's optional in the sense that you don't _need_ to do it if your element already has a ref (or you can set the ref manually)14:23
cs-shadowyeah, automatically updating the refs is optional, having the refs is not optional at all14:23
cs-shadowso, what I'm saying is that the ref should contain enough information to be able to fetch everything that it needs to fetch at that revision14:24
tme5in the singular, parent repo? that's not correct as far as i know14:24
cs-shadownot sure if I understand - what's not correct?14:25
tme5"the ref should contain enough information to be able to fetch everything that needs to fetch at that revision [of the git repo]"14:25
tme5afaik a git repo only stores its immediate submodules, it doesn't know anything about its subsubmodules, etc.14:27
cs-shadowah, I see what you mean. I meant "should" as in what should happen ideally. our current handling of submodules certainly needs work14:28
tme5but i'm not sure the Source class really has the vocabulary to deal with what git needs to do14:30
*** lachlan has quit IRC14:30
cs-shadowwhat do you think we need extra?14:32
cs-shadowTo me recursive submodules sounds very similar to the pip source, where you can list some packages as direct dependencies, but don't know all transitive deps beforehand. At track time, we figure out the full set of dependencies and store them as the ref for the source.14:32
cs-shadowCan't we do the same in this case? i.e. fetch everything recursively at track time, and then record the version information the refer?14:32
cs-shadow*and then record the version information in the ref field14:33
tme5i suppose we could, that would change how the source works in this case quite a lot14:39
tme5to be honest, though, looking at __do_fetch it looks like get_source_fetchers is just a convenience method in the absence of an actual fetch method on the source14:42
tme5so if I implement fetch myself I don't have to worry about this problem14:42
tme5i think, anyway..14:43
*** lachlan has joined #buildstream14:54
*** lachlan has quit IRC14:59
tme5all green on the git test suite!15:08
*** narispo has quit IRC15:19
*** narispo has joined #buildstream15:20
*** narispo has quit IRC15:32
*** lachlan has joined #buildstream15:32
*** narispo has joined #buildstream15:33
*** lachlan has quit IRC15:36
gitlab-br-botcs-shadow merged MR !1706 (chandan/interactive-tests->master: Add tests for interactive BuildStream operations) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/170615:42
benschuberto/15:42
tpollardnice15:42
cs-shadownext, I need to add some docs on this topic :)15:42
*** lachlan has joined #buildstream15:51
*** lachlan has quit IRC15:54
*** phildawson_ has joined #buildstream16:10
*** phildawson has quit IRC16:10
*** toscalix has quit IRC16:20
*** toscalix has joined #buildstream16:21
*** toscalix has quit IRC16:24
*** santi has quit IRC16:29
gitlab-br-botjuergbi opened MR !1751 (juerg/buildbox-run-userchroot->master: Add CI job to test buildbox-run-userchroot) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/175116:31
gitlab-br-botjuergbi opened MR !1752 (juerg/buildbox-run-bubblewrap->master: Add CI job to test buildbox-run-bubblewrap and buildbox-fuse) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/175216:39
*** toscalix has joined #buildstream16:42
*** traveltissues has quit IRC16:44
*** toscalix has quit IRC16:45
*** toscalix_ has joined #buildstream16:45
*** toscalix_ has quit IRC16:45
*** toscalix has joined #buildstream16:46
gitlab-br-botjuergbi opened (was WIP) MR !1738 (juerg/buildbox-run->master: Add buildbox-run sandboxing backend) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/173816:47
gitlab-br-botcs-shadow opened MR !1754 (chandan/fix-manifest->master: Minor packaging-related fixups) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/175416:49
gitlab-br-botBenjaminSchubert approved MR !1754 (chandan/fix-manifest->master: Minor packaging-related fixups) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/175416:50
gitlab-br-bottpollard opened (was WIP) MR !1745 (tpollard/messagerate->master: Make message & status rendering be tick driven by default) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/174517:04
*** santi has joined #buildstream17:12
*** tpollard has quit IRC17:13
*** lachlan has joined #buildstream17:21
*** lachlan has quit IRC17:24
*** toscalix has quit IRC17:27
*** slaf has quit IRC17:29
*** slaf has joined #buildstream17:36
*** slaf has joined #buildstream17:36
*** slaf has joined #buildstream17:36
*** slaf has joined #buildstream17:37
*** slaf has joined #buildstream17:37
*** slaf has joined #buildstream17:37
*** phildawson_ has quit IRC17:37
*** slaf has joined #buildstream17:38
*** slaf has joined #buildstream17:38
*** slaf has joined #buildstream17:38
*** slaf has joined #buildstream17:38
*** slaf has joined #buildstream17:39
*** slaf has joined #buildstream17:39
*** slaf has joined #buildstream17:39
*** santi has quit IRC17:46
*** tme5 has quit IRC17:47
gitlab-br-botcs-shadow merged MR !1754 (chandan/fix-manifest->master: Minor packaging-related fixups) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/175417:52
*** lachlan has joined #buildstream17:54
*** narispo has quit IRC17:56
*** narispo has joined #buildstream17:56
*** lachlan has quit IRC17:58
*** tiagogomes has quit IRC18:24
*** jonathanmaw has quit IRC18:39
*** narispo has quit IRC19:13
*** narispo has joined #buildstream21:25
*** cs-shadow has quit IRC21:39
*** traveltissues has joined #buildstream21:43
*** narispo has quit IRC22:22
*** narispo has joined #buildstream22:25
*** narispo has quit IRC22:32
*** traveltissues has quit IRC22:34
*** narispo has joined #buildstream22:35

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!