*** Guest45613 has joined #baserock | 00:19 | |
*** Guest45613 has quit IRC | 00:32 | |
*** gtristan has joined #baserock | 03:09 | |
*** ctbruce has joined #baserock | 07:53 | |
*** paulwaters_ has joined #baserock | 08:19 | |
*** rdale has joined #baserock | 08:37 | |
*** jonathanmaw has joined #baserock | 08:55 | |
paulsher1ood | gtristan: i approved https://gitlab.com/baserock/ybd/merge_requests/325 | 08:59 |
---|---|---|
paulsher1ood | could you take a look at https://gitlab.com/baserock/ybd/merge_requests/324 (and particularly, advise how buildstream will handle this usecase) | 08:59 |
*** toscalix has joined #baserock | 09:00 | |
gtristan | ohhh, ok so thats the thing... now I'll have to support migrations of it :-S | 09:21 |
gtristan | paulsher1ood, so binary inputs are supported already by buildstream from a long time, basically we support it by simply stating that you use an 'import' element, which can use any 'source' implementation to "put files into the artifact" | 09:22 |
gtristan | we only support currently ostree, git and 'local' source types (currently relying on ostree for the bases we've used so far) | 09:22 |
gtristan | iiuc, this requires some kind of artifactory source implementation ? | 09:23 |
gtristan | "YBD can now handle binary inputs from urls, as well as git inputs" this sounds very abstract | 09:23 |
gtristan | binary inputs can be tarballs, can be anything, most anything is retrieved by a url, including gits | 09:24 |
gtristan | usernames and passwords are better suited in user configuration, rather than project data (just a randomly related comment), hopefully they can be avoided, too | 09:25 |
*** rdale has quit IRC | 09:39 | |
*** rdale_ct has joined #baserock | 09:39 | |
paulsher1ood | i agree about the usernames and passwords... but rjek pointed out that there may be situations where multiple auths are required, per component | 09:49 |
paulsher1ood | (seems a bit daft to me, tbh) | 09:49 |
paulsher1ood | the implementation i've done is *supposed* to work with jrandom (un+)authorised url | 09:50 |
paulsher1ood | so not just artifactory | 09:50 |
rjek | Or multiple different artifactories | 09:50 |
gtristan | What we want from a source implementation (which is pretty much the same for any build input you'd want for YBD, plus one added feature) is basically: | 09:52 |
gtristan | o An alias-able url | 09:52 |
gtristan | o An exact identifier, usually implemented as a checksum | 09:52 |
paulsher1ood | we discussed checksums earlier, and concluded that we need to support up to two per component | 09:53 |
gtristan | o A symbolic tracking reference, allowing us to get the latest exact identifier for that tracking reference (usually a symbolic branch or tag name) | 09:53 |
gtristan | that last is more than what ybd normally supported, but I suppose is similar to what ybd now does with the 'sha'/'ref' distinction | 09:54 |
gtristan | A source should be able to fetch remotely the latest exact identifier on demand and return it (from Source.track()) and it should be able to set it onto a core provided dict with Source.set_ref() | 09:55 |
gtristan | core uses this to rewrite projects inline | 09:55 |
gtristan | So anyway... I think method of obtaining and mirroring sources should be implementation specific | 09:56 |
gtristan | meaning, we'd probably want one for artifactory and another for other things | 09:56 |
paulsher1ood | gtristan: no, this is for binaries - if we're downloading a blob, rjek argued that md5 is insufficient, so this new implementation supports md5 + sha256 | 09:56 |
gtristan | So this is download a data blob, much like what we'd do for the tarball source | 09:57 |
paulsher1ood | yup | 09:57 |
gtristan | except with no tar extract | 09:57 |
paulsher1ood | yup | 09:57 |
paulsher1ood | i expect that instructions on what to *do* with the blob are in *-commands | 09:58 |
gtristan | That I think is same for everything | 09:58 |
paulsher1ood | unclear how to checksum for case of url = foo.bar/latest/version/of/blob | 09:58 |
gtristan | I mean, when you get that blob, the way you currently use it... is I suppose it appears in the build dir | 09:58 |
paulsher1ood | yup | 09:59 |
gtristan | with a name | 09:59 |
*** CTtpollard has joined #baserock | 09:59 | |
* paulsher1ood is just commenting here, in case anything in this use-case is surprising for buildstream | 09:59 | |
gtristan | So with a Source, we either use it as a Source for a BuildElement derivative (where we'll use commands to manipulate it) | 09:59 |
gtristan | or we use an import (like a literal "put the content of this here" statement) | 09:59 |
paulsher1ood | ok | 10:00 |
paulsher1ood | (and checksumming?) | 10:00 |
gtristan | fwiw, in semi-related news, today the conversion gained support for the integration commands | 10:00 |
paulsher1ood | w00t :) | 10:00 |
gtristan | and a build of gnome passes, without requiring root at all, even with the system integration commands | 10:00 |
* gtristan thought there might have been chowns in there, but there are only groupadd/useradd) | 10:01 | |
paulsher1ood | whole of gnome, including build essential and device nodes? | 10:01 |
gtristan | paulsher1ood, right for the checksumming what we want for tarballs, is basically automatically update the exact identifier with an sha256 sum on demand (with bst track) | 10:02 |
gtristan | So the user doesnt have to memorize shas | 10:02 |
gtristan | and of course, no symbolic refs | 10:02 |
paulsher1ood | ack | 10:02 |
gtristan | paulsher1ood, device nodes are omitted in the base, that's a part of the manual port I needed to do for build-essential | 10:03 |
gtristan | so I still have to try to boot it, but it should not be a problem, udev or systemd will create the nodes | 10:03 |
* gtristan out for dinner, back in a bit... | 10:09 | |
* paulsher1ood looks forward to confirmation that it boots :) | 10:09 | |
* gtristan has to write the deployment for that... coming this week | 10:09 | |
gtristan | currently I've whipped something up for the splits | 10:09 |
gtristan | which, were a sort of a trainwreck imho | 10:10 |
gtristan | but still pertinent feature to have, wielded properly | 10:10 |
paulsher1ood | ack | 10:11 |
*** gtristan has quit IRC | 10:15 | |
*** tiagogomes has joined #baserock | 10:16 | |
*** tiagogomes has quit IRC | 10:18 | |
*** ssam2 has joined #baserock | 10:24 | |
*** ChanServ sets mode: +v ssam2 | 10:24 | |
*** tiagogomes has joined #baserock | 10:24 | |
*** jude__ has joined #baserock | 10:29 | |
*** jude_ has quit IRC | 10:30 | |
*** gtristan has joined #baserock | 10:48 | |
* ironfoot ponders the deprecation of gerrit.baserock.org, storyboard.baserock.org, and openid.baserock.org | 11:01 | |
paulsher1ood | hmmm | 11:09 |
paulsher1ood | you're right to raise this | 11:09 |
ironfoot | We are in the process of renovating the SSL certs, and I went through the services we currently have | 11:11 |
*** ctbruce has quit IRC | 11:14 | |
ssam2 | fine by me | 11:14 |
ssam2 | would be nice to dump the storyboard database somewhere for reference though | 11:14 |
ironfoot | Yeah, I was pondering only swiching them off, but I can try to extract that information first, yes | 11:15 |
ironfoot | Also, it looks like we won't need the database and mail VM's either | 11:16 |
ssam2 | indeed | 11:16 |
ironfoot | (we might if we decide to selfhost gitlab in the future) | 11:16 |
ssam2 | they're fully represented in the Ansible scripts in baserock-infrastructure.git so nothing to lose from destroying them now if we don't need them | 11:17 |
ssam2 | can redeploy within an hour or so from the Ansible scripts | 11:17 |
ironfoot | hehe yes, unless django package upgrades, and breaks openid | 11:18 |
ssam2 | if we need an OpenID provider, Ipsilon is probably better to use now | 11:19 |
ironfoot | yep | 11:19 |
ssam2 | although the docs are truly awful | 11:19 |
ironfoot | right, will start announcing changes soon via baserock-dev | 11:19 |
ssam2 | but I know the maintainer who says it is actually possible to link in a simpler password storage system than Kerberos or LDAP | 11:19 |
*** jude__ has quit IRC | 11:21 | |
*** ctbruce has joined #baserock | 11:26 | |
*** jude__ has joined #baserock | 11:35 | |
*** noisecell has joined #baserock | 11:47 | |
*** ssam2 has quit IRC | 13:22 | |
*** ssam2 has joined #baserock | 13:38 | |
*** ChanServ sets mode: +v ssam2 | 13:38 | |
*** ctbruce has quit IRC | 13:54 | |
*** ctbruce has joined #baserock | 13:55 | |
*** noisecell has quit IRC | 13:57 | |
*** noisecell has joined #baserock | 14:01 | |
*** gtristan has quit IRC | 14:59 | |
*** noisecell has quit IRC | 15:07 | |
*** gtristan has joined #baserock | 15:14 | |
*** noisecell has joined #baserock | 15:32 | |
*** tiagogomes has quit IRC | 15:48 | |
*** leeming has quit IRC | 15:48 | |
*** noisecell has quit IRC | 15:49 | |
*** ssam2 has quit IRC | 15:49 | |
*** CTtpollard has quit IRC | 15:49 | |
*** jude__ has quit IRC | 15:49 | |
*** jonathanmaw has quit IRC | 15:49 | |
*** ctbruce has quit IRC | 16:01 | |
*** jude__ has joined #baserock | 16:01 | |
*** CTtpollard has joined #baserock | 16:01 | |
*** ctbruce has joined #baserock | 16:01 | |
*** leeming has joined #baserock | 16:02 | |
*** ssam2 has joined #baserock | 16:02 | |
*** ChanServ sets mode: +v ssam2 | 16:02 | |
*** noisecell has joined #baserock | 16:02 | |
*** tiagogomes has joined #baserock | 16:02 | |
*** jonathanmaw has joined #baserock | 16:04 | |
*** jude__ has quit IRC | 16:12 | |
*** leeming has quit IRC | 16:26 | |
*** jude_ has joined #baserock | 16:32 | |
*** leeming has joined #baserock | 16:40 | |
*** jude_ has quit IRC | 16:41 | |
*** jude_ has joined #baserock | 16:46 | |
*** noisecell has quit IRC | 17:05 | |
*** toscalix_ has joined #baserock | 17:21 | |
*** toscalix has quit IRC | 17:23 | |
*** toscalix_ has quit IRC | 17:28 | |
*** jude_ has quit IRC | 17:43 | |
*** jonathanmaw has quit IRC | 18:01 | |
*** ctbruce has quit IRC | 18:38 | |
*** ssam2 has quit IRC | 18:57 | |
*** jude_ has joined #baserock | 19:04 | |
*** paulwaters_ has joined #baserock | 19:45 | |
*** gtristan has quit IRC | 21:19 | |
*** rdale_ct has quit IRC | 22:47 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!