IRC logs for #baserock for Friday, 2017-10-13

*** gtristan has quit IRC05:42
*** gtristan has joined #baserock06:05
*** toscalix has joined #baserock07:18
*** paulwaters_ has joined #baserock07:51
*** rdale has joined #baserock08:01
*** jonathanmaw has joined #baserock08:48
*** locallycompact has joined #baserock08:59
*** locallycompact has joined #baserock09:00
*** ssam2 has joined #baserock09:07
*** ChanServ sets mode: +v ssam209:07
*** adds68 has quit IRC09:22
*** adds68 has joined #baserock09:22
*** toscalix has quit IRC10:08
*** toscalix has joined #baserock10:25
gtristanssam2, jjardon... can you point me to the toolchain thing that you are currently converting with ?10:30
gtristanSo I can do the arches migration ?10:30
ssam2it's the elements/gnu-toolchain stack in definitions.git master10:30
ssam2the conversion is done from definitions.git master, wrapped by a script named 'convert'10:31
gtristandefinitions.git master... somewhere on gitlab.com I think10:31
gtristannot easily findable on the wiki, maybe good to have in the topic line here ?10:31
ssam2https://gitlab.com/baserock/definitions10:31
ssam2the wiki links to Gitlab on the front page, but yeah there is a lot of cruft10:32
gtristannice, so submit MR and will use latest buildstream master ?10:32
ssam2yeah should all work10:32
* gtristan means, to see the CI10:32
ssam2ah except the CI is broken10:32
ssam2kinda10:33
ssam2i tried to make caching work, and somehow made things even worse10:33
ssam2builds start at least10:33
gtristanssam2, but we get passed launching buildstream at least ?10:33
gtristanat least we'll know that the thing loads without the arches conditionals10:33
ssam2ah yeah it'll get that far10:33
ssam2it'll just probably run out of disk space at some point10:34
gtristanokay ! so I better not do this all at once...10:41
gtristanssam2, looks like the base-runtime and base-sdk in definitions is still using the old, misguided thing10:42
gtristanbecause I didnt know what the hell I was doing back then10:42
ssam2right, there's a merge request to rip that out10:42
gtristancan we merge it ?10:42
ssam2we could10:43
ssam2https://gitlab.com/baserock/definitions/merge_requests/5810:43
ssam2of course the CI doesn't pass because the CI doesn't work properly because i broke it10:43
ssam2oh, actually it's also blocked on https://gitlab.com/baserock/definitions/merge_requests/59/commits10:43
ssam2which we could merge10:43
ssam2but i basically ran out of time to finish this work off, and am tied up in other stuff now10:43
ssam2nobody is using the buildstream conversions, so i'm happy to be cavalier about merging stuff to it10:44
gtristanAh10:45
gtristanOk, we aught to get the CI running again though :-/10:46
jjardonssam2: what is broken? Is there a bug somewhere with the details? Maybe I can spend some time on the weekend10:46
ssam2https://gitlab.com/baserock/definitions/merge_requests/6210:47
ssam2somewhere a job failed with out of disk space, trying to find that10:47
ssam2https://gitlab.com/baserock/definitions/-/jobs/3509942610:48
ssam2the point I got up to was... i realised that if we store stuff in /cache, gitlab CI will just ignore it because it's outside the build directory10:48
jjardon8h20m0s -> is normal that it takes this long?10:48
gtristanjjardon, It seems the cache is somehow broken10:48
ssam2that's the problem I was trying to solve10:48
gtristanor not big enough10:48
ssam2which is that there was no caching of sources10:48
ssam2and never actually has been, even for YBD10:48
ssam2because everything was stored in /cache, which gitlab CI ignores10:49
ssam2it will have worked by chance when consecutive jobs execute on the same runner, but that's it10:49
ssam2so I tried to move the /cache volume to /builds, so we'd get enough disk space to store all the cache stuff in the build directory10:49
ssam2so that gitlab CI would actually upload it to the minio cache we set up10:50
ssam2which is now working10:50
ssam2but ... https://gitlab.com/baserock/definitions/-/jobs/35099426 shows gitlab CI running out of space *in the build dir* while preparing a .zip file to upload to the cache10:50
jjardonyou can add [ci skip] to the commit message and builds will be skipped, in case nobody have time to fix this10:51
jjardonssam2: gtristan ^10:51
ssam2might help10:51
* gtristan was actually hoping to *test* the arches change...10:57
benbrown_jjardon: where's the remote cache setup, ooi?10:57
jjardonsec10:58
jjardonbenbrown_: cant access from here, but if you go to digital ocean, the machine that says "cache" in the name10:59
ssam246.101.48.4810:59
benbrown_ta10:59
ssam2it's in a docker container on there10:59
ssam2the minio cache is exposed on port 900510:59
ssam2so you can do `ssh -L9000:localhost:9005 ...` and then browse to https://localhost:9000/11:00
ssam2you need an access code that can be found in `docker logs minio`11:00
gtristanssam2, shall we also change 'bst-arch' and 'bst-target-arch' thingies in the conversion script to be 'arch', 'target-arch' and such ?11:00
gtristanI think so11:01
ssam2sounds good to me11:01
gtristanOk so11:01
gtristanI think what I'm gonna do, is do it on my machine11:01
gtristanssam2, but you wanted that other bug to land first right ?11:01
gtristanfixes for "other arches" ?11:01
ssam2yeah that's pretty needed for armv8 and ppc64 to work11:02
ssam2so makes sense to base your work off that11:02
ssam2it's had months of testing, it's just CI blocking it11:02
ssam2i suggest basing off https://gitlab.com/baserock/definitions/merge_requests/58 too11:02
gtristanmkay, I'll locally setup a branch with those applied11:03
gtristanthen make my changes, which are local to the conversion stuff anyway11:03
gtristanAnd make sure it builds11:03
gtristanAnd then monday we can take a last look and just push it11:03
paulsherwood /win 1211:04
paulsherwoodgaaah11:04
gtristanwin win win !11:04
paulsherwoodi'm trying :)11:05
gtristanme too !11:21
benbrown_ssam2: There are a couple of runners that have been around for 9+ days, were you using these? Or should I nukify them?11:32
paulsherwooddo you hve to ask? :)11:33
benbrown_I'm unsure whether or not they were being used to get a picture of the filesystem11:34
* benbrown_ shall assume anything with "runner" in it's name that's this old needs to be destroyed11:35
benbrown_s/it\'/it/11:35
paulsherwoodi would, yes11:36
gtristanssam2, do we have a canonical list, with your patch MR 59 applied... of arches that are supported ?11:41
gtristanssam2, also, how does this work with elements/gnu-toolchain.bst ?11:41
* gtristan a bit confused, that only contains intel arches11:41
ssam2benbrown_, they would be useful for debugging probably11:42
ssam2did you delete already ?11:42
benbrown_ssam2: Any idea where this should be looking? https://gitlab.com/baserock/definitions/-/jobs/3614250611:42
ssam2that's a new one11:42
benbrown_Or should it be cloning buildstream instead of expecting it to be at a particular path?11:42
benbrown_ssam2: I did already delete11:43
ssam2ah11:43
ssam2it should be cloning buildstream, and already does AFAIK11:43
benbrown_I can't see anything in the yaml that does that11:43
ssam2in which branch?11:43
ssam2hmmm... i wonder if a line got deleted something11:44
benbrown_I'm working off sam/fix-ci, should I not be?11:44
ssam2hmm, seems in master that it doesn't actually clone buildstream11:44
ssam2weird11:45
ssam2ok, so probably the docker image changed underneath11:45
ssam2still, the stanza beginning "# Update to latest BuildStream" was intended to actually update to latest buildstream11:45
ssam2oh wait I know what i did11:46
ssam2and this is indeed very dumb11:46
ssam2but was relying on the docker image containing a git clone of buildstream.git in /root11:46
ssam2which it now doesn't11:46
ssam2to be honest, you could remove that whole stanza since the docker image is updated nightly anyway and contains buildstream11:46
benbrown_oh, ok11:46
* benbrown_ shall do that then11:46
*** gtristan has quit IRC11:52
*** CTtpollard has quit IRC12:00
*** CTtpollard has joined #baserock12:05
gitlab-br-botinfrastructure: merge request (sam/readme-in-gitlab->master: Rename README so it gets displayed in GitLab) #10 changed state ("opened"): https://gitlab.com/baserock/infrastructure/merge_requests/1012:12
gitlab-br-botinfrastructure: merge request (sam/readme-in-gitlab->master: Rename README so it gets displayed in GitLab) #10 changed state ("opened"): https://gitlab.com/baserock/infrastructure/merge_requests/1012:13
gitlab-br-botinfrastructure: merge request (sam/readme-in-gitlab->master: Rename README so it gets displayed in GitLab) #10 changed state ("merged"): https://gitlab.com/baserock/infrastructure/merge_requests/1012:13
ssam2thanks!12:13
*** gtristan has joined #baserock12:47
gitlab-br-botinfrastructure: merge request (sam/update-ca-certs->master: Update CA certs) #11 changed state ("opened"): https://gitlab.com/baserock/infrastructure/merge_requests/1112:48
ssam2baserock SSL certificates should be valid for another 3 months now12:48
ssam2i've shut doiwn the openid, storyboard and gerrit services12:50
ssam2*shut down12:50
ssam2as promised in https://listmaster.pepperfish.net/pipermail/baserock-dev-baserock.org/2017-September/013812.html12:50
jjardonssam2: cool, thanks12:51
gitlab-br-botdefinitions: merge request (staging/jjardon/ostree-upgrade->master: strata/ostree-core.morph: Update ostree to 2016.15) #24 changed state ("closed"): https://gitlab.com/baserock/definitions/merge_requests/2412:54
jjardonmmm, this can be useful: https://www.digitalocean.com/community/tutorials/an-introduction-to-digitalocean-spaces13:00
jjardonbenbrown_: ^13:00
*** toscalix has quit IRC13:10
benbrown_jjardon: interesting13:10
benbrown_jjardon: What're you running on that cache instance that gives us s3 like access?13:11
jjardonbenbrown_: minions13:12
jjardon:)13:12
jjardon https://github.com/minio/minio13:12
benbrown_oic13:13
benbrown_"A large ecosystem of S3-compatible tools and libraries can be used to manage your Space."13:15
gitlab-br-botybd: merge request (benbrown/exit-on-multiple-rpms->master: Exit should multiple files match the prebuilt rpm pattern) #392 changed state ("opened"): https://gitlab.com/baserock/ybd/merge_requests/39213:22
gitlab-br-botybd: merge request (benbrown/exit-on-multiple-rpms->master: Exit should multiple files match the prebuilt rpm pattern) #392 changed state ("opened"): https://gitlab.com/baserock/ybd/merge_requests/39213:25
gitlab-br-botybd: merge request (benbrown/exit-on-multiple-rpms->master: Exit should multiple files match the prebuilt rpm pattern) #392 changed state ("merged"): https://gitlab.com/baserock/ybd/merge_requests/39213:25
gitlab-br-botdefinitions: merge request (sam/fix-ci->master: Fix caching in CI) #62 changed state ("opened"): https://gitlab.com/baserock/definitions/merge_requests/6213:40
benbrown_jjardon: fyi, I have a branch: benbrown/sam/fix-ci13:40
*** CTtpollard has quit IRC13:41
*** CTtpollard has joined #baserock13:42
gitlab-br-botdefinitions: merge request (sam/fix-ci->master: Fix caching in CI) #62 changed state ("opened"): https://gitlab.com/baserock/definitions/merge_requests/6213:49
gitlab-br-botdefinitions: merge request (sam/fix-ci->master: Fix caching in CI) #62 changed state ("opened"): https://gitlab.com/baserock/definitions/merge_requests/6213:50
benbrown_jjardon: D:13:53
jjardonbenbrown_: uh, seems you branch is doing more thing than simply fixing the CI; I will stop now13:53
benbrown_tries to optimise stuff as well, sure13:54
benbrown_Given we're limited by space, it made sense to not pull in both ybd and bst caches into all jobs13:55
benbrown_And I think we saw some issues with artifacts and dependencies as well, so I've made sure we're explicit about which jobs have dependencies13:56
*** toscalix has joined #baserock13:56
*** toscalix has quit IRC13:56
*** toscalix has joined #baserock13:57
jjardonyeah, nice13:57
jjardonmy two little patches should be enough to actually fix the current CI, I think. But yeah better to apply your branch13:59
jjardonmmm, maybe not14:00
gitlab-br-botdefinitions: merge request (sam/fix-ci->master: Fix caching in CI) #62 changed state ("opened"): https://gitlab.com/baserock/definitions/merge_requests/6214:12
gitlab-br-botybd: merge request (benbrown/old-git-sha-contains->master: Use branch in place of for-each-ref) #393 changed state ("opened"): https://gitlab.com/baserock/ybd/merge_requests/39315:06
*** locallycompact has quit IRC15:13
*** toscalix has quit IRC15:23
*** CTtpollard has quit IRC15:28
gitlab-br-botybd: merge request (benbrown/old-git-sha-contains->master: Use branch in place of for-each-ref) #393 changed state ("opened"): https://gitlab.com/baserock/ybd/merge_requests/39315:40
gitlab-br-botybd: merge request (benbrown/old-git-sha-contains->master: Use branch in place of for-each-ref) #393 changed state ("merged"): https://gitlab.com/baserock/ybd/merge_requests/39315:40
gitlab-br-botdefinitions: merge request (benbrown/sam/fix-ci->master: Fix caching in CI and some other optimizations) #63 changed state ("opened"): https://gitlab.com/baserock/definitions/merge_requests/6316:21
gitlab-br-botdefinitions: merge request (sam/fix-ci->master: Fix caching in CI) #62 changed state ("closed"): https://gitlab.com/baserock/definitions/merge_requests/6216:22
*** tiagogomes has quit IRC16:22
*** jonathanmaw has quit IRC16:35
*** ssam2 has quit IRC16:57
*** jude_ has quit IRC17:08
*** jude_ has joined #baserock18:34
*** jude_ has quit IRC20:12
*** jude_ has joined #baserock20:22
*** jude_ has quit IRC20:29
*** rdale has quit IRC21:31
*** jude_ has joined #baserock22:21
*** jude_ has quit IRC22:54
*** jude_ has joined #baserock23:08
*** jude_ has quit IRC23:12

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!