IRC logs for #buildstream for Wednesday, 2017-10-25

*** tristan has quit IRC00:58
*** tristan has joined #buildstream01:02
*** tristan has quit IRC06:55
*** jude has joined #buildstream06:58
*** tristan has joined #buildstream07:25
*** valentind has joined #buildstream08:22
adds68Hi, would anybody know what option in buildstream would map to this option in the flatpak builder >> https://github.com/flatpak/freedesktop-sdk-images/blob/344108d97b33f95a39f0d8aae801714515d29362/org.freedesktop.Sdk.json.in#L2463 ?08:25
*** jonathanmaw has joined #buildstream08:34
*** semanticdesign has joined #buildstream08:48
*** semanticdesign_ has joined #buildstream08:48
tristanadds68, config-opts ?08:53
tristanis that what you mean ?08:53
adds68tiagogomes, hey, yea08:53
adds68tristan, **08:53
adds68tristan, i'm looking at https://buildstream.gitlab.io/buildstream/format.html#kind 'configure-commands'08:53
adds68would that be correct?08:53
tristanadds68, I assume you've got a checkout of flatpak-builder, but to know the correct answer, it's around here: https://github.com/flatpak/flatpak-builder/blob/master/src/builder-module.c#L130108:55
tristanadds68, for an autotools element (i.e. https://buildstream.gitlab.io/buildstream/elements/autotools.html#module-elements.autotools)08:56
tristan(that page is reachable via the top page -> Builtin Plugins -> autotools)08:56
tristanadds68, you probably want to just convert to an autotools element which sets the %{conf-extra} variable08:57
tristanadds68, that way you just tell the regular/default configure-commands to add those extra options08:57
tristanadds68, of course, according to flatpak-builder source code, it might be slightly different depending on the type of build system being used (cmake, meson, etc)08:57
adds68tristan, ahh that is where the confusion is for me, do i use 'conf-args' or 'configure-commands'08:57
tristaneverything is a possibility08:58
tristanbut conf-args are there for this sort of convenience08:58
adds68tristan, yea sam suggested that, so i'm just assuming autotools for now08:58
adds68tristan, awesome thanks, i shall try this for the first pass08:58
tristanbuilder-module.c should reveal which build system you need to care about for what you are parsing :)08:58
adds68tristan, as i'm only parsing the json data i sadly don't seem to have that information atm08:59
tristanI'm not sure what "simple" means in there, looks like a fairly recent addition08:59
tristanadds68, of course you do, in flatpak json it's "buildsystem"09:00
tristanI think autotools must be the default so it's not listed for that particular one you linked09:00
tristanadds68, look at "openal" in that same json, it uses "buildsystem" : "cmake"09:00
tristanadds68, in builder-module.c, it does some conditional stuff based on the build system, which you would need to take into account to decide what element kind to generate and such09:01
adds68tristan, ah!09:03
adds68tristan, how did i miss that! Well i've designed the parser based on classes which map to buildstream elements09:04
adds68so i can just create some more classes to do with these build systems09:04
tristanSo now you know how to decide which class to use :)09:04
adds68tristan, awesome, thanks :)09:04
tristanindeed, it's quite convertible stuff09:04
adds68tristan, i must say buildstream definitions are so much easier to read/understand than the json/flatpak builder stuff09:05
*** tlater has joined #buildstream09:10
*** ssam2 has joined #buildstream09:18
gitlab-br-botpush on buildstream@tracking-changes (by Tristan Maat): 5 commits (last: Issue #113: Split tracking and saving in `bst build`) https://gitlab.com/BuildStream/buildstream/commit/9fa7a1a9557a13c37976b45716937a335c5d818d09:27
gitlab-br-botbuildstream: merge request (tracking-changes->master: WIP: Tracking changes) #119 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/11909:27
tlater:O gitlab-br-bot is back09:27
tlatertristan: This may be a slightly stupid question, but I'm assuming we want to track Scope.ALL for recursive elements?09:33
gitlab-br-botbuildstream: merge request (sam/artifacts-url-fix->master: _pipeline.py: Give the correct artifact pull URL in remote ticker) #120 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/12009:33
gitlab-br-botpush on buildstream@sam/artifacts-url-fix (by Tristan Van Berkom): 2 commits (last: Issue #124: Add test for staging to element build directory) https://gitlab.com/BuildStream/buildstream/commit/35d7051a07451e0647f60963d0485908b1d0139a09:33
tristantlater, that's a good question, indeed I think so - which means that it would expand on the default pipeline for building09:34
tristanAlso, please use your imagination, I think right now there are a *lot* of proposed new tracking options to `bst build`, I like the recursive/except semantic for users (more practical than listing individual elements)...09:35
tristantlater, but what I mean by imagination is, we want to ideally support all the things which have been proposed, but with the most convenient CLI semantics (and least CLI options) as possible09:36
tristannot sure the current proposed options achieves that, maybe it does, dont have time to think about it myself right now though.09:36
* tlater has not seen all proposals yet, but will have a read09:36
tristantlater, it may sound tempting to add a subcommand to `bst build` for tracking specifics, but I worry that it may make something else I want to do impossible09:37
tristantlater, i.e., now that we've ditched variants, it will be possible for all of the `bst <options> command <options> ELEMENT` to instead become `bst <options> command <options> ELEMENT [ELEMENT2 [ELEMENT3...]]`09:38
tlaterHm, yeah, if we had a subcommand that won't work too well09:39
tristanAnd I wanna do that, transform every command that currently takes a single TARGET option, to make it an unlimited number of TARGETS on the same invocation09:39
ssam2great idea09:39
* tristan should file it so it's on the map09:41
gitlab-br-botbuildstream: issue #129 ("Allow specifying multiple target elements in ever command") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/12909:44
tlatertristan: Are the proposals for build tracking accumulated somewhere? I can't find any on the ML09:45
tlaterOr is it just what's listed on #117?09:46
tristantlater, just in the issue tracking afaik09:49
tristangah !09:50
tristanunacceptable TLS cert on gnome709:50
tlatertristan: I'm pretty sure that TLS cert caused me to run into #128, so not too bad ;)09:53
tristanany ideas how to enable http on a reverse proxied apache server ?09:54
* tristan wants to solve this immediately, not on Dave Page's schedule09:54
ssam2do you control the reverse proxy ?09:54
tristanI do09:54
tristanI just have no clue, whatsoever, about anything like that09:54
ssam2is port 80 forwarded ?09:54
* tristan opens config09:54
ssam2i could have a look if you want09:54
tristanI have <VirtualHost *:80> for the forwarding of every sled09:55
tristanI might assume that to mean "yes"09:55
tristanbut, I suppose it actually means "no"09:55
tristan(everything open *except* port 80 ?)09:56
tristanweird09:56
tristanssam2, still have creds to log into jumpserv.colo.codethink.co.uk ?09:56
ssam2seems I do09:57
tristanssam2, I know about /etc/apache2/sites-available/gnome-proxy.conf09:57
tristanthere might be more in this monster of configuration stuff that I dont know about09:57
ssam2i'll have a dig09:57
tlatertristan: A final little annoyance from me before I try to finish up the tracking MR - would you like the implicit tracking option to be part of this or of the - future - tracking domains? I think it would make a lot of sense to just have 'bst build --fix-my-bloody-pipeline' as well as more fine grained control.10:00
tristantlater, right now what is blocking is that with the current options, we're stuck with recursive tracking on --track, and that will be permanent if it slips passed 1.010:01
tristanBut we do *need* a recursive option10:01
tristantlater, and it's not really acceptable to chose another approach that does not consider the end game, and again paints us into an undesirable corner10:02
tristanSo, to be clear; not everything needs to be implemented to close it10:02
tristanBut, the design has to be perfect and satisfy all the cases we might think up, without adding *too many* options in the future10:02
tristanUnderstand ?10:02
tlatertristan: Yup, I do10:03
tristantlater, just in case you missed it, there are 2 related issues which should be interlinked somehow10:05
tristanI think you need both issues to see the whole picture10:05
tlater#113 and #117?10:05
tristanmaybe10:05
tlater--track-save and --track-recurse/--track?10:06
tlaterx)10:06
* tristan sees if he can fix the (<) replacing configure commands when specified in project.conf element overrides bug while Sam fixes http10:06
tristantlater, yep that's it10:06
*** bochecha has quit IRC10:14
gitlab-br-botbuildstream: merge request (sam/artifacts-url-fix->master: _pipeline.py: Give the correct artifact pull URL in remote ticker) #120 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/12010:17
gitlab-br-botpush on buildstream@master (by Tristan Van Berkom): 1 commit (last: _pipeline.py: Give the correct artifact pull URL in remote ticker) https://gitlab.com/BuildStream/buildstream/commit/9285f004162efeb09b4622ffe28edeeeb43f426210:17
gitlab-br-botbuildstream: Sam Thursfield deleted branch sam/artifacts-url-fix10:17
jonathanmawtristan: How would you like the documentation for bst-external to be served? looking at the repo's Settings -> Pages page, I can define a domain, and then get CI runners to push to there10:19
jonathanmawshould I endeavour to have bst-external shared to the same domain as buildstream, or create my own domain and have buildstream's docs link to it?10:19
tristanjonathanmaw, I dont know what a "domain" is in this context, but I presume that if your project is called 'bst-external', and lives in the BuildStream gitlab group... and if you do "pretty much exactly the same thing"...10:24
tristanThen the docs will land at http://buildstream.gitlab.io/bst-external10:24
tristanbeside buildstream main docs at http://buildstream.gitlab.io/buildstream - which sounds sensible to me, right ?10:25
jonathanmawtristan: ok, I'll give that a go10:25
*** sstriker has joined #buildstream10:27
*** valentind has quit IRC10:42
ssam2i can't figure out the https issue, sorry10:51
ssam2dave says he will "get to it soon"10:51
ssam2i suspect there's something outside our control going on, as the jumpserver doesn't contain that SSL cert as far as I can see10:52
tristan:-S10:54
tristancrap10:54
*** sstriker has quit IRC11:02
ssam2tlater, there's an interesting exception in https://gitlab.com/baserock/definitions/-/jobs/3756713411:04
tlaterssam2: We already have a branch that fixes that11:05
ssam2ah, cool11:05
* tlater would like to add a MR for it, but I'm not 100% sure it's unrelated to #12811:05
gitlab-br-botpush on buildstream@master (by Tristan Van Berkom): 2 commits (last: project.py: Fetch element type overrides before assertions) https://gitlab.com/BuildStream/buildstream/commit/b648bcab88340ea470098c9d2af60d3f556a51d611:06
gitlab-br-botbuildstream: issue #127 ("Error when trying to use list prepend to replace pre-* commands in project.conf") changed state ("closed") https://gitlab.com/BuildStream/buildstream/issues/12711:07
tlaterMind you, it would be nice if someone could confirm #128. ssam2, do you think you could `bst build --track apps.bst` in gnome-modulesets and check if the second counters keep running? If they do, we could merge a fix for that exception :)11:08
ssam2i'll give it a go11:09
ssam2breaks because of CA cert errors pulling the debian ostree repo :-(11:11
tristanfrak11:11
ssam2i don't know if there's an ostree equivalent to GIT_SSL_NO_VERIFY11:11
tlaterssam2: That's actually useful in this case11:11
tlaterJust 'continue'11:12
tlaterI expect it's related to that11:12
ssam2ah, ok11:12
ssam2time does seem to be moving forwards11:12
tlaterssam2: In the normal 1s intervals or does it happen to update whenever a message appears?11:13
ssam2ah11:13
ssam2only when a message appears11:13
ssam2yeah they have all stopped now11:13
tlater\o/ So yeah, that's a bug11:13
gitlab-br-botbuildstream: issue #130 ("Interactive prompts requiring full words is annoying") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/13011:14
*** jude has quit IRC11:45
*** jude has joined #buildstream11:46
*** bochecha has joined #buildstream12:06
tlatertristan: How should something like `bst --track-recursive top-level.bst --track-except dependency.bst --track-recursive dependency-of-dependency.bst` behave?12:12
tlaterAtm it seems impossible to re-include a dependency of a dependency once it's excepted12:12
tlaterThat seems wrong, but it also seems overkill to add some way around that.12:13
tristanI would ignore anything to do with ordering on the command line and expect an error12:16
tristantelling me about it, I guess12:16
tristan"Explicitly asked for 'dependency-of-dependency.bst', which is already excepted by 'dependency.bst'"12:17
tristantlater, OR - consider toplevel targets as orthogonal dependencies12:18
tristantlater, i.e. the expected semantics of --except is already to trim the elements of a pipeline _only_ if they are not orthogonally depended on by other elements no --except'ed12:19
tristantlater, so in that case, the best actually is probably to just to ahead and track top-level.bst and dependency-of-dependency.bst12:19
tristanbut not dependency.bst12:20
tristanSeems the natural answer12:20
tristan(its the natural answer if you consider explicitly asking --track-recurse as a *separate* dependency on that element which cannot be ignored)12:20
*** bochecha has quit IRC12:21
tristantlater, the same question arises for `bst track --except dependency.bst top-level.bst dependency-of-dependency.bst`12:21
tristan(I.e. when we allow multiple targets on all bst commands)12:21
tlaterGah, sorry, just missed that12:37
tlaterAlright, that makes sense.12:39
*** xjuan has joined #buildstream12:43
adds68In a buildstream source definition, what would happen if i left something blank?12:51
adds68i.e leaving url: blank in this example? https://buildstream.gitlab.io/buildstream/format.html#sources12:51
ssam2it depends on the field12:55
ssam2url is probably required, because you can't pull something if you don't know where it is12:55
ssam2but there are also optional fields in some contexts12:55
adds68ssam2, ok, it's just that the json files don't seem to enforce many rules so i'm kind of having to just take it as fact12:57
adds68ssam2, i'll just have to add some form of error checking before i write the file to avoid writing any blank dependencies and hope that the required sources are there for buildstream12:57
ssam2bear in mind that the thing you're converting is built fairly regularly12:58
ssam2so you can expect it to work, within reason12:58
gitlab-br-botpush on buildstream@jonathan/external-plugins (by Jonathan Maw): 3 commits (last: Remove dpkg and x86image elements) https://gitlab.com/BuildStream/buildstream/commit/d1e29e2015373d1558e595c8fc9ed138ddab790012:58
ssam2I think http://sdkbuilder1.gnome.org/logs/ has build logs for the SDK, and build failures also get announced by a bot in #flatpak13:00
adds68ssam2, yea javier mentioned that to me, i'm still working from the git json atm13:07
adds68ssam2, it's pretty much ready now, it's just i need to then add further classes for other modules that don't use Autotools etc13:08
adds68Although i'm still not sure what 'simple' means13:08
ssam2i think it means, do whatever is defined in "build-commands" and nothing more13:08
ssam2it's not documented that clearly ... but https://www.mankier.com/5/flatpak-manifest says of build-commands: "An array of commands to run during build (between make and make install if those are used). This is primarily useful when using the "simple" buildsystem."13:09
adds68ssam2, that guide is very useful, i didn't think to look in there13:17
gitlab-br-botbuildstream: merge request (jonathan/external-plugins->master: Remove and refer to elements that have been moved to bst-external) #122 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/12213:33
*** tristan has quit IRC14:45
*** tristan has joined #buildstream15:02
tristantlater, I dont get this often, but this might be helpful: https://bpaste.net/show/8bb969637fdc15:21
tlaterta tristan, hopefully I can track that down soon15:21
tlaterI'm assuming the final few lines were cut out by the status widget?15:23
tristantlater, yeah :-/15:25
tristanthat doesnt happen in you `bst command ... | cat`15:26
tristans/in/if15:26
* tristan gotta run15:26
tlatero/15:26
tristanmidnight video chat with family in canada15:26
tristanlaterz \o15:26
gitlab-br-botpush on buildstream@tracking-changes (by Tristan Maat): 3 commits (last: Make `bst build --track-recurse` specify the element to recurse) https://gitlab.com/BuildStream/buildstream/commit/ea9fc2fc493d7f007e8a5474cd4f030e6c5165f215:32
gitlab-br-botpush on buildstream@tracking-changes (by Tristan Maat): 8 commits (last: _pipeline.py: Give the correct artifact pull URL in remote ticker) https://gitlab.com/BuildStream/buildstream/commit/9285f004162efeb09b4622ffe28edeeeb43f426215:40
gitlab-br-botbuildstream: merge request (tracking-changes->master: WIP: Tracking changes) #119 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/11915:45
gitlab-br-botbuildstream: merge request (tracking-changes->master: WIP: Tracking changes) #119 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/11915:47
*** adds68 has quit IRC15:59
*** sstriker has joined #buildstream16:05
*** sstriker has quit IRC16:30
*** jonathanmaw has quit IRC16:31
gitlab-br-botpush on buildstream@107-failing-child-processes-when-tracking-missing-git-branches (by Tristan Maat): 4 commits (last: _pipeline.py: Give the correct artifact pull URL in remote ticker) https://gitlab.com/BuildStream/buildstream/commit/9285f004162efeb09b4622ffe28edeeeb43f426216:34
*** ssam2 has quit IRC16:38
gitlab-br-botbuildstream: Tristan Maat created branch 128-status-ticker-fails-to-update-periodically-on-some-builds17:07
gitlab-br-botbuildstream: merge request (128-status-ticker-fails-to-update-periodically-on-some-builds->master: WIP: Resolve "Status ticker fails to update periodically on some builds") #123 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/12317:07
*** jude has quit IRC17:20
*** tlater has quit IRC17:23
*** valentind has joined #buildstream17:50
*** xjuan has quit IRC19:52
*** semanticdesign_ has quit IRC22:09
*** semanticdesign has quit IRC22:09
*** adds68 has joined #buildstream22:34
*** adds68 has quit IRC23:00
*** adds68 has joined #buildstream23:10
*** adds68 has quit IRC23:15

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!