IRC logs for #buildstream for Wednesday, 2018-12-12

*** xjuan has quit IRC00:23
*** nimish has joined #buildstream01:59
*** kapil___ has joined #buildstream01:59
*** lsfranco has joined #buildstream02:01
*** lsfranco has quit IRC02:16
*** lsfranco has joined #buildstream02:17
*** thinkl33t has quit IRC03:10
*** nimish has quit IRC03:14
*** juergbi has quit IRC03:16
*** juergbi has joined #buildstream03:17
*** thinkl33t has joined #buildstream03:19
*** lsfranco has quit IRC03:41
*** tristan has joined #buildstream03:50
*** juergbi has quit IRC04:36
*** juergbi has joined #buildstream04:37
*** kapil___ has quit IRC05:39
*** juergbi has quit IRC05:49
*** juergbi has joined #buildstream05:49
*** brlogger has joined #buildstream06:04
*** tristan has quit IRC06:54
*** slaf has quit IRC08:50
*** slaf has joined #buildstream08:53
*** toscalix has joined #buildstream08:58
*** tristan has joined #buildstream09:08
*** ikerperez has joined #buildstream09:11
*** jennis has joined #buildstream09:17
*** phildawson has joined #buildstream09:20
*** tiagogomes has joined #buildstream09:23
*** alatiera has joined #buildstream09:44
*** raoul has joined #buildstream09:54
*** alatiera has quit IRC09:54
*** alatiera has joined #buildstream09:58
phildawsonjuergbi, I've resolved your final points on !959. Are you happy for me to merge once the pipeline has passed?10:00
gitlab-br-botMR !959: Retire bst source bundle command https://gitlab.com/BuildStream/buildstream/merge_requests/95910:00
*** alatiera_ has joined #buildstream10:00
*** alatiera_ is now known as alatiera10:02
*** jonathanmaw has joined #buildstream10:03
*** tpollard has joined #buildstream10:08
toscalixlaurence: can you take a look at https://gitlab.com/BuildStream/nosoftware/communication/merge_requests/510:10
juergbiphildawson: looks good to merge now. commented on two minor nits in case you want to do another rebase10:19
gitlab-br-botjuergbi approved MR !959 (phil/source-checkout-options->master: Retire bst source bundle command) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/95910:19
phildawsonthanks juergbi!10:20
juergbiclarification, the first comment should really be fixed. the second one is just a tiny nit10:22
phildawsonI'll fix them both, it's not like it'll take long10:22
laurencetoscalix, sure, will find some time soon10:29
toscalixlaurence: thansk10:30
*** lachlan has joined #buildstream10:31
*** lachlan has joined #buildstream10:32
*** tiagogomes has quit IRC10:35
NexusMy gitlab isn't updating for some reason. I've pushed updates but my gitlab isn't showing the latest sha10:44
toscalixthanks valentind for the review10:45
jonathanmawHi folks, does anyone have free time to look at !954 ?11:09
gitlab-br-botMR !954: Guess the element when running commands in a workspace https://gitlab.com/BuildStream/buildstream/merge_requests/95411:09
Nexusjonathanmaw: i'll swap you for !925 ?11:19
gitlab-br-botMR !925: Added default element and show all functionality to `bst show` https://gitlab.com/BuildStream/buildstream/merge_requests/92511:19
juergbiboth of these are also on my list for today11:19
*** kapil___ has joined #buildstream11:19
* jonathanmaw will have a gander11:19
Nexusalso for some reason !926 won't update after i pushed11:20
gitlab-br-botMR !926: Added default element build all functionality to `bst build` https://gitlab.com/BuildStream/buildstream/merge_requests/92611:20
tpollarddoes the cli claim it's pushed an update?11:25
Nexusno11:25
Nexusit took 20 minutes last time i pushed11:25
Nexusgitlab may just be being slow11:26
Nexusi like that it's called "guess_element" like you have no faith in its ability to get it right11:27
*** juergbi has quit IRC11:39
*** juergbi has joined #buildstream11:40
benschubertHey tristan, not urgent but if you have time to review !702, I would appreciate to finally merge it and be able to run all tests on my laptop :)11:47
gitlab-br-botMR !702: Mock storage space checks for tests. https://gitlab.com/BuildStream/buildstream/merge_requests/70211:47
*** lsfranco has joined #buildstream11:52
*** lsfranco has joined #buildstream11:52
*** abderrahim has quit IRC11:54
*** abderrahim has joined #buildstream11:54
*** lsfranco has quit IRC11:57
*** nimish has joined #buildstream11:58
*** lsfranco has joined #buildstream11:58
*** avar has joined #buildstream12:04
jonathanmawNexus: I've finished my review of !92512:05
Nexusthanks :)12:05
gitlab-br-botphildawson opened (was WIP) MR !959 (phil/source-checkout-options->master: Retire bst source bundle command) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/95912:26
toscalixvalentind: laurence this RM needs love. When you can, a review and approval is welcome: https://gitlab.com/BuildStream/nosoftware/communication/merge_requests/612:29
toscalixMR12:29
laurencetoscalix, I am drowning at the moment12:29
laurenceI have the graphs open and ready to review, but i can't do it right now12:29
laurencemaybe i'll do it before bedtime12:29
laurencesorry - please hang on12:30
*** lsfranco has quit IRC12:53
*** lsfranco has joined #buildstream12:53
valentindtoscalix, sorry, libreoffice hanged twice my GPU, had to hard reset. I figured I had to remove OpenCL drivers to be able to open the file from the MR.13:02
*** nimish has quit IRC13:02
*** nimish has joined #buildstream13:03
*** nimish has quit IRC13:13
*** nimish has joined #buildstream13:13
*** lsfranco has quit IRC13:18
*** lsfranco has joined #buildstream13:18
*** lsfranco has joined #buildstream13:19
Nexusmy tests are failing on CI but not locally >:(13:26
cs-shadowNexus: that might due to difference in the versions of the deps installed13:27
tpollardgot a link to the ci job?13:29
Nexushttps://gitlab.com/BuildStream/buildstream/-/jobs/13349814813:30
Nexuscs-shadow: possibly, i'm currently a few commits behind13:30
tpollard'Error mirroring https://bst-integration-test-images.ams3.cdn.digitaloceanspaces.com/integration-tests-base.v1.x86_64.tar.xz: HTTP Error 500: Internal Server Error'13:31
tpollardWho controls that?13:33
tpollardalso it's coming from integration/build-tree.py, which I believe jonathanmaw authored13:36
valentindtpollard, I do.13:38
jonathanmawtpollard: that sounds like it's caused by testutils.create_artifact_share13:38
valentindtpollard, it downloads fine for me. there was probably downtime in digital ocean.13:38
* jonathanmaw doesn't know much about how the ArtifactShares actually work13:38
tpollardyeh works locally for me too13:39
tpollardhopefully it was just a hiccup Nexus13:39
*** kapil___ has quit IRC13:39
valentindNexus, just rebuild.13:39
Nexusrebuild what?13:40
valentindThe job.13:41
Nexuskk13:41
tpollardit's hit other MR's too13:42
gitlab-br-botjuergbi approved MR !954 (jonathan/workspace-fragment-guess-element->master: Guess the element when running commands in a workspace) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/95413:42
*** nimish has quit IRC13:43
*** nimish has joined #buildstream13:43
gitlab-br-botjonathanmaw merged MR !954 (jonathan/workspace-fragment-guess-element->master: Guess the element when running commands in a workspace) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/95413:44
*** lsfranco has quit IRC13:44
*** lsfranco has joined #buildstream13:44
adds68Is there any way to force rebuild an element yet?13:48
tpollardnot via the cli, afaik13:49
*** nimish has quit IRC13:53
*** nimish has joined #buildstream13:54
*** tiagogomes has joined #buildstream14:00
juergbijmac: I still don't understand the fast import issue14:05
juergbiisn't ordering only relevant when merging two directories?14:05
juergbii.e,, I'd hope that importing a CasBasedDirectory as a new subdirectory into a CasBasedDirectory never changes anything in that directory, even in the slow path14:08
*** kapil___ has joined #buildstream14:12
jmacjuergbi: The directory produced by fast_directory_import might then be used in a further merge14:22
jmacIt's not the order of anything in the directory you're importing into, but the order of files/directories/symlinks in the thing being imported that changes14:22
juergbijmac: that seems like an extremely subtle difference from an API point of view. and fast import fallback would result in a different order14:25
juergbiI don't think we should expose something like this in the public API14:26
juergbican't we fix this with some relatively cheap sorting somewhere to align the two code paths?14:26
jmacNo, sorting will break everything14:27
jmacYes, fast import fallback would result in a different order, but *only* import_files makes the guarantee of ordering14:28
juergbijmac: e.g., can't we ensure that any changes in a CasBasedDirectory will be equivalent to exporting to the local filesystem and then importing it into a new CasBasedDirectory?14:28
juergbi(we shouldn't actually do that, of course, but can't we do things in an equivalent way?)14:28
jmacjuergbi: Ensuring that is exactly what import_files already does14:28
juergbiI mean for all changes14:28
jmacIt's also very complicated14:28
jmacYou have to iterate over all of the directory tree to do it, that's why it's not fast14:29
juergbiI think I need a concrete example to really think about this14:30
jmacRight, I understand that14:30
juergbihowever, in any case, I don't think we should add this to the stable public API as is14:30
juergbii.e., if we can't hide this difference, I think this should be internal API only14:30
jmacThat puts !952 back several weeks14:30
gitlab-br-botMR !952: WIP: Remote-execution instance configuration support https://gitlab.com/BuildStream/buildstream/merge_requests/95214:30
jmacSorry, !99114:30
gitlab-br-botMR !991: Cache artifacts with virtual directories instead of filesystem. https://gitlab.com/BuildStream/buildstream/merge_requests/99114:30
juergbijmac: the MR doesn't require it to be public API, right?14:31
jmacI don't want to make it internal API when the only user of it is outside the API14:31
juergbibut the only user is still in BuildStream core, i.e., not in a plugin14:31
jmacRight, sorry... your definition of internal vs external still makes no sense tome14:31
juergbiyes, internal, not private14:31
juergbiI think we need to find a better solution long term and so I don't want to expose this in the stable plugin API14:32
juergbiand to improve performance, we currently don't have to14:32
jmacI'm not happy with it either, but I'm under a lot of pressure to get this feature in. I realise this doesn't make a good argument for including it.14:33
jmacIf I make it "private", as in with an underscore on the method and not in Directory, is that OK?14:33
juergbiyes, it could even be in Directory, as long as there is a leading underscore14:33
juergbiincluding a performance improvement with a not perfect internal API is much less of an issue than rushing a public API14:34
juergbiit would be great to open a corresponding issue about this, ideally with a concrete example (possibly add example later if it's not easy to come up with one)14:35
toscalixvalentind: thanks14:35
jmacFully agree with that juergbi, I've had trouble convincing other people that ordering is important14:36
juergbiok, I definitely agree that ordering is important as it can influence the staging and thus the build and the artifact14:37
juergbiI still hope that we can simplify the whole ordering issue at some point but that's another discussion14:38
*** nimish has quit IRC14:39
*** nimish has joined #buildstream14:39
*** nimish has quit IRC14:49
*** nimish has joined #buildstream14:50
*** nimish has quit IRC14:50
*** nimish has joined #buildstream14:50
*** nimish has quit IRC14:55
*** nimish has joined #buildstream14:55
*** lachlan has quit IRC14:59
*** nimish has quit IRC15:00
*** nimish has joined #buildstream15:01
*** nimish has quit IRC15:06
*** nimish has joined #buildstream15:06
*** lachlan has joined #buildstream15:10
*** nimish has quit IRC15:11
*** nimish has joined #buildstream15:11
gitlab-br-botBenjaminSchubert opened MR !1006 (bschubert/fix-unbound-variable-exception->master: element.py: fix unbounded variable in nested python exception) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/100615:15
*** lsfranco has quit IRC15:19
*** lsfranco has joined #buildstream15:20
*** nimish has quit IRC15:21
*** nimish has joined #buildstream15:22
gitlab-br-botjuergbi approved MR !920 (richardmaw/artifact-log->master: Add artifact log command) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/92015:31
gitlab-br-botjmacarthur opened issue #817 (We need examples showing the importance of file import ordering) on buildstream https://gitlab.com/BuildStream/buildstream/issues/81715:37
jmacjuergbi: ^ #817 attempts to capture the discussion we've just had15:38
juergbithanks15:38
juergbijmac: btw: I still need to think about the absolute symlink conversion commit in 919 to make sure there aren't issues if any of the path components are directory symlinks15:41
jmac919?15:41
*** nimish has quit IRC15:42
*** nimish has joined #buildstream15:42
* jmac will assume 99115:43
juergbieh, yes, sorry15:43
*** nimish has joined #buildstream15:43
gitlab-br-botphildawson closed issue #672 (Retire `source-bundle` command) on buildstream https://gitlab.com/BuildStream/buildstream/issues/67215:45
gitlab-br-botphildawson merged MR !959 (phil/source-checkout-options->master: Retire bst source bundle command) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/95915:45
*** lsfranco has quit IRC16:10
*** lsfranco has joined #buildstream16:10
*** Bitcoin has joined #buildstream16:10
*** tiagogomes has quit IRC16:11
*** tiagogomes has joined #buildstream16:12
*** Bitcoin has quit IRC16:14
gitlab-br-botjonathanmaw approved MR !925 (issue-638-validate-all-files->master: Added default element and show all functionality to `bst show`) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/92516:15
Nexusjuergbi: did ypu have a chance to look at my 2 mrs?16:24
juergbinot yet. last time I checked tests were failing and there were quite a few pending review comments16:25
juergbibut I can take a look nowish16:25
*** lsfranco has quit IRC16:25
*** lsfranco has joined #buildstream16:26
*** nimish has quit IRC16:38
*** nimish has joined #buildstream16:38
*** alatiera has quit IRC16:44
juergbiNexus: CI is actually still failing. you should generally fix this before asking for review16:50
gitlab-br-botcs-shadow approved MR !1006 (bschubert/fix-unbound-variable-exception->master: element.py: fix unbounded variable in nested python exception) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/100617:00
*** lsfranco has quit IRC17:06
*** lsfranco has joined #buildstream17:06
*** lsfranco has quit IRC17:21
*** lsfranco has joined #buildstream17:21
gitlab-br-botaevri opened (was WIP) MR !973 (aevri/contributing_e2e_tests->master: contributing: more clarity on testing) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/97317:33
*** nimish has quit IRC17:43
*** nimish has joined #buildstream17:44
*** lachlan has quit IRC17:48
*** toscalix has quit IRC17:49
adds68Hi, i am working on the collect_manifest plugin here: https://gitlab.com/BuildStream/bst-external/merge_requests/6018:00
gitlab-br-botrichardmaw-codethink merged MR !920 (richardmaw/artifact-log->master: Add artifact log command) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/92018:01
adds68I am trying to find a sane thing to return from get_unique_key()18:01
*** lachlan has joined #buildstream18:01
adds68This plugin generates a manifest from the sources of all defined dependencies, however returning dep.sources() is only going to be addressing that specific dependency18:02
adds68the plugin can handle multiple, so i am wondering if there is a more sensible way to say "all the sources that this element depends on" ?>18:02
*** tiagogomes has quit IRC18:12
*** jonathanmaw has quit IRC18:18
*** nimish has quit IRC18:19
*** nimish has joined #buildstream18:19
*** nimish has quit IRC18:29
*** nimish has joined #buildstream18:30
*** lsfranco has quit IRC18:31
*** lsfranco has joined #buildstream18:32
*** raoul has quit IRC18:37
valentindadds68, you do not have to do anything in get_unique_key() about dependencies. Dependencies are added to the key automatically. What you need in get_unique_key() is to take anything from the configuration node of the plugin that affects the resulting artifact.18:39
*** juergbi has quit IRC18:51
*** lsfranco has quit IRC19:02
*** lsfranco has joined #buildstream19:02
*** xjuan has joined #buildstream19:04
*** kapil___ has quit IRC19:21
*** nimish has quit IRC19:25
*** nimish has joined #buildstream19:25
*** lachlan has quit IRC19:48
*** tristan has quit IRC19:52
*** lachlan has joined #buildstream19:55
*** nimish has quit IRC20:01
*** lsfranco has quit IRC20:09
*** juergbi has joined #buildstream20:21
*** mohan43u has quit IRC20:34
*** mohan43u has joined #buildstream20:37
*** lachlan has quit IRC20:56
*** mohan43u has quit IRC21:22
*** mohan43u has joined #buildstream21:25
*** mohan43u has quit IRC21:28
*** mohan43u has joined #buildstream21:32
*** mohan43u has quit IRC21:43
*** mohan43u has joined #buildstream21:48
*** mohan43u has quit IRC21:51
*** mohan43u has joined #buildstream21:55
*** mohan43u has quit IRC22:08
*** mohan43u has joined #buildstream22:30
*** mohan43u has quit IRC22:48
*** mohan43u has joined #buildstream22:52
*** mohan43u has quit IRC22:58
*** mohan43u has joined #buildstream23:09
*** mohan43u has quit IRC23:12
*** mohan43u has joined #buildstream23:15
*** mohan43u has quit IRC23:18
*** mohan43u has joined #buildstream23:21

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!