| *** gtristan has quit IRC | 03:44 | |
| *** gtristan has joined #baserock | 04:14 | |
| *** noisecell has joined #baserock | 06:23 | |
| *** paulwaters_ has joined #baserock | 07:32 | |
| *** bruce has joined #baserock | 07:39 | |
| *** bruce is now known as Guest65567 | 07:40 | |
| *** toscalix has joined #baserock | 07:51 | |
| *** rdale has joined #baserock | 08:23 | |
| *** jonathanmaw has joined #baserock | 08:30 | |
| *** jude_ has joined #baserock | 08:37 | |
| *** Guest65567 has quit IRC | 08:49 | |
| *** ctbruce has joined #baserock | 08:55 | |
| *** ssam2 has joined #baserock | 09:14 | |
| *** ChanServ sets mode: +v ssam2 | 09:14 | |
| *** CTtpollard has joined #baserock | 09:28 | |
| *** locallycompact has joined #baserock | 09:55 | |
| benbrown_ | ironfoot: wai u no amend commit | 10:00 |
|---|---|---|
| ironfoot | benbrown_: gah! lack of time! | 10:00 |
| ironfoot | will do so in my next spare moment | 10:01 |
| benbrown_ | :) | 10:01 |
| ironfoot | benbrown_: thanks for reviewing! | 10:01 |
| *** locallycompact has quit IRC | 10:02 | |
| *** locallycompact has joined #baserock | 10:02 | |
| benbrown_ | ironfoot: Any idea if gbo is under a particularly high load? | 10:36 |
| * benbrown_ is wondering why this pipeline is taking so long https://gitlab.com/baserock/ybd/-/jobs/22313523 | 10:36 | |
| ssam2 | ~ # uptime | 10:36 |
| ssam2 | 10:36:52 up 4 days, 10:09, 2 users, load average: 4.83, 4.20, 3.90 | 10:36 |
| ssam2 | not too bad | 10:37 |
| benbrown_ | hrm | 10:37 |
| ironfoot | benbrown_: looking at the log, looks like the mirroring of repos is going fast | 10:38 |
| ironfoot | maybe the host running the CI is slow? | 10:38 |
| ironfoot | is being slow* (busy, etc) | 10:39 |
| benbrown_ | ironfoot: yup, turns out they were using the gitlab shared runners, which are apparently super slooow | 11:36 |
| ssam2 | anyone here want push access to the ostree.baserock.org repo for testing? | 11:47 |
| ssam2 | pm me your SSH private key if so | 11:47 |
| ssam2 | oops | 11:47 |
| ssam2 | don't do that | 11:48 |
| ssam2 | but send me your public key | 11:48 |
| *** noisecell has quit IRC | 11:48 | |
| * paulsher1ood will try once there's a web interface | 11:48 | |
| paulsher1ood | (nb... downstream users sometimes want to download a specific artifact) | 11:48 |
| paulsher1ood | (independent of the build tool.... hence kbas has wildcard search and offers links to click on) | 11:50 |
| ssam2 | i agree that it's needed, but have no scope in my current project to achieve it | 11:50 |
| paulsher1ood | ack | 11:51 |
| paulsher1ood | is there no way just to reuse the kbas bottle stuff? | 11:52 |
| * paulsher1ood still doesn't understand ostree in this context | 11:52 | |
| ssam2 | it might be a useful starting point | 11:52 |
| ssam2 | but the files are stored in a different way, they're not just tar files on disk | 11:52 |
| ssam2 | so providing a download link is more tricky | 11:53 |
| paulsher1ood | doesn't the build tool already download artifacts anyway? | 11:53 |
| ssam2 | yes, but using code from ostree | 11:54 |
| ssam2 | the same reason that you can't just put a .git directory on a web server and have people download all the files from a specific commit | 11:54 |
| ssam2 | cgit makes that possible, and I imagine it does so by doing `git archive` internally | 11:54 |
| paulsher1ood | ack | 11:54 |
| paulsher1ood | so... is the artifact cache one huge .git directory, then? | 11:55 |
| paulsher1ood | (for all artifacts) | 11:55 |
| ssam2 | in some ways, yes | 11:55 |
| ssam2 | the implementation is different, but the idea is similar | 11:55 |
| gtristan | ssam2, I think we can implement `bst pull` for pulling an artifact, and `bst push` for pushing artifacts which may have been built while offline (if that's desirable), in which case we could provide an interface through bst for downloading and checking out a specific artifact (if that's helpful) | 11:55 |
| paulsher1ood | gtristan: it's something, but there are situations where $user just needs artifact, has no bst | 11:56 |
| gtristan | paulsher1ood, indeed; similar to git, objects that are identical have the same checksum; so an artifact cache can handle a lot more before ever needing to be pruned or wiped (this becomes more true the more reproducible your builds are, too) | 11:56 |
| paulsher1ood | yes... that's the upside in choosing ostree style storage, downside is dealing with these pesky use-cases :) | 11:57 |
| gtristan | paulsher1ood, for a user who wants to download artifacts as tarballs from a web server; it's conceivable to have some function to extract and tar it up on the server | 11:57 |
| ssam2 | `ostree export` exists, we'd just need to hook it up to a web form | 11:58 |
| gtristan | ssam2, right, ever does it as tar iirc (so you keep your permissions and xattrs and such, and can do as regular user) | 11:58 |
| ssam2 | yeah | 11:59 |
| gtristan | s/ever/even, even | 11:59 |
| gtristan | in any case; we can have such a fancy web-app in the gitlab BuildStream group, I only hope to not have the tool/ecosystem depending on that (i.e. it's just added sugar for interfacing with a webpage) | 12:01 |
| ssam2 | yes... it could perhaps even be part of ostree | 12:01 |
| ssam2 | although that would likely be much more work as the scope would grow and grow | 12:01 |
| gtristan | nod | 12:01 |
| ssam2 | but we could keep that in mind | 12:01 |
| gtristan | ssam2, I'm a bit torn about putting too much work there too, ostree is a primary use case but we're going to have to figure out (very soon) how to work with platforms it just wont run on | 12:02 |
| ssam2 | agreed. i'm not committing any time right now :-) (although if it becomes a hard blocker for Baserock adopting BuildStream, there might be time left at the end of my project to do something) | 12:03 |
| paulsher1ood | can you not just allow kbas as an option? :) | 12:03 |
| * paulsher1ood gets his coat | 12:03 | |
| ssam2 | "just" | 12:03 |
| ssam2 | a tarball artifact cache is pretty much the plan for platforms where OSTree doesn't run though, so maybe | 12:04 |
| gtristan | ssam2, I mean, if we're going to have a web-app, we'd like to keep control of that too, because we'll want it to support non-ostree cases, or; we're not sure what happens when it comes to that | 12:04 |
| ssam2 | maybe... depends if multiple backends within a single artifact cache server is going to be useful for anyone | 12:04 |
| gtristan | ssam2, what would be interesting though, is have artifact cache shares just run on linux (with ostree), even if buildstream needs to download/upload as tar on some exotic platforms | 12:05 |
| ssam2 | i was just thinking that. if it can import and export tarballs then we're grand | 12:05 |
| ssam2 | although then BuildStream on those platforms depends on said webapp | 12:05 |
| gtristan | right, we lose some performance on upload/download on platforms without ostree (cause we cant just upload/download objects that are needed, we need to send a whooole tarball) | 12:06 |
| gtristan | but it's still something | 12:06 |
| ssam2 | a single cache server that has two caches in incompatible formats seems a bit pointless. I guess if you had a mix of Linux and non-Linux builds, the other option would be just have two different cache servers... an ostree one and a tar/kbas one | 12:06 |
| gtristan | ssam2, indeed, this is going to need some thought; we're going look at a PoC but I expect the first PoC to avoid concerns of artifact sharing | 12:07 |
| ssam2 | if it's different platforms then there's little advantage to sharing anyway | 12:07 |
| ssam2 | i.e. a Solaris machine has little use for prebuilt Linux artifacts | 12:07 |
| gtristan | ssam2, also a good point | 12:07 |
| jjardon | https://gitlab.com/baserock/definitions/-/jobs/22328856 seems trove (or something) is timeout every ~1m:10s | 12:13 |
| jjardon | for every single repo | 12:13 |
| jjardon | Is there trove very busy atm? | 12:14 |
| ssam2 | no | 12:14 |
| ssam2 | what tells you that it's timing out ? | 12:14 |
| ssam2 | i don't see any errors logged | 12:14 |
| ssam2 | and no errors in the journal on git.baserock.org so far | 12:15 |
| benbrown_ | "no tree from tree-server for 50893291621658f355bc5b4d450a8d06a563053d" | 12:15 |
| benbrown_ | isn't that part of morph-cache-server? | 12:15 |
| ssam2 | It used to be, certainly | 12:16 |
| ssam2 | nothing in the journal at all | 12:17 |
| benbrown_ | Has that recently been disabled? Or is it still going? | 12:17 |
| ssam2 | seems to be running | 12:17 |
| ssam2 | does the tree exist ? | 12:17 |
| benbrown_ | ybd wouldn't be able to generate the cache-key if it didn't | 12:18 |
| ssam2 | true | 12:18 |
| ssam2 | logging doesn't seem to be enabled for that service | 12:18 |
| ssam2 | i've tried restrating it | 12:18 |
| ssam2 | do you either of you want access to the server to debug further ? | 12:19 |
| jjardon | ssam2: notthing tell me that, but its a bit strange there is always a gap of ~1m:10s between cloning repos | 12:23 |
| ssam2 | possibly a 60 second timeout in the the client side code, and the server isn't responding at all ? | 12:24 |
| ssam2 | try calling the cache server AP manually with curl and see if you get a response | 12:24 |
| ssam2 | *API | 12:24 |
| *** deep-book-gk_ has joined #baserock | 13:34 | |
| *** deep-book-gk_ has left #baserock | 13:34 | |
| benbrown_ | ssam2: I'd appreciate access, if that's alright? Not got too much time to look into it right now though. | 13:52 |
| ssam2 | ok, if you send me your ssh key I can set it up | 13:53 |
| ssam2 | to the ostree cache you mean or git.baserock.org ? | 13:53 |
| benbrown_ | gbo :) | 13:53 |
| ssam2 | ok | 13:54 |
| benbrown_ | ostree cache will become useful to me later though, I'm sure, but I'll request access to that at a later point :) | 13:54 |
| ironfoot | benbrown_: did you find anything? | 15:07 |
| *** gtristan has quit IRC | 15:10 | |
| benbrown_ | ironfoot: I've yet to take a look | 15:16 |
| ironfoot | booo | 15:16 |
| ironfoot | NOTANISSUE | 15:16 |
| ironfoot | gbo is robust ;) | 15:16 |
| benbrown_ | lol | 15:16 |
| benbrown_ | busybox less makes me sad | 15:17 |
| benbrown_ | hitting end just seems to kill it | 15:19 |
| ironfoot | if you are looking at the journal is because it's taking time | 15:19 |
| benbrown_ | nah, morph-cache-server logs | 15:19 |
| ironfoot | they might be long too | 15:19 |
| benbrown_ | very long :) | 15:22 |
| *** gtristan has joined #baserock | 15:26 | |
| benbrown_ | "curl: (7) Failed to connect to git.baserock.org port 8080: Connection timed out" | 15:42 |
| ssam2 | oh........ I know the issue | 15:44 |
| ssam2 | sorry, all my fault | 15:44 |
| ironfoot | it's going through the haproxy? | 15:44 |
| ssam2 | I redid the security groups last night when doing the OStree artifact | 15:44 |
| ironfoot | oh!!!!! | 15:44 |
| ssam2 | and thought "port 8080 isn't needed any more because we're not running morph-cache-server" | 15:44 |
| ssam2 | forgetting that it serves trees as well as artifact | 15:44 |
| ssam2 | *artifacts | 15:44 |
| ssam2 | ok, will fix | 15:44 |
| ironfoot | ssam2: note that changes in infrastructure.git should go through gitlab | 15:45 |
| ironfoot | (if any) | 15:45 |
| ssam2 | https://gitlab.com/baserock/infrastructure/merge_requests :-) | 15:45 |
| ironfoot | tsk ironfoot, you didn't look | 15:46 |
| ssam2 | benbrown_, try now | 15:49 |
| benbrown_ | curl works, idk the API though, so I just get a server error :Þ | 15:50 |
| ssam2 | sounds like an improvement :-) | 15:50 |
| benbrown_ | indeed :) | 15:51 |
| benbrown_ | ssam2: Ty | 15:51 |
| gitlab-br-bot | ybd: issue #262 ("ybd should be able to generate -debug rpms") changed state ("opened") https://gitlab.com/baserock/ybd/issues/262 | 15:56 |
| gitlab-br-bot | infrastructure: merge request (sam/ostree->master: Add initial ostree.baserock.org definitions) #5 changed state ("opened"): https://gitlab.com/baserock/infrastructure/merge_requests/5 | 15:58 |
| gitlab-br-bot | infrastructure: merge request (sam/ostree->master: Add ostree.baserock.org definitions) #5 changed state ("opened"): https://gitlab.com/baserock/infrastructure/merge_requests/5 | 16:01 |
| gitlab-br-bot | ybd: issue #262 ("ybd should be able to generate -debug rpms") changed state ("closed") https://gitlab.com/baserock/ybd/issues/262 | 16:04 |
| *** ctbruce has quit IRC | 16:16 | |
| *** toscalix has quit IRC | 16:34 | |
| *** jonathanmaw has quit IRC | 17:40 | |
| *** locallycompact has quit IRC | 17:56 | |
| gitlab-br-bot | infrastructure: merge request (sam/ostree->master: Add ostree.baserock.org definitions) #5 changed state ("opened"): https://gitlab.com/baserock/infrastructure/merge_requests/5 | 18:02 |
| *** ssam2 has quit IRC | 18:03 | |
| gitlab-br-bot | infrastructure: merge request (sam/ostree->master: Add ostree.baserock.org definitions) #5 changed state ("merged"): https://gitlab.com/baserock/infrastructure/merge_requests/5 | 18:10 |
| *** locallycompact has joined #baserock | 18:41 | |
| gitlab-br-bot | lorries: merge request (pedro/lorry-controller-lorry->master: Add lorry-controller.git from Gitlab) #20 changed state ("opened"): https://gitlab.com/baserock/lorries/merge_requests/20 | 18:47 |
| gitlab-br-bot | lorries: merge request (pedro/lorry-controller-lorry->master: Add lorry-controller.git from Gitlab) #20 changed state ("opened"): https://gitlab.com/baserock/lorries/merge_requests/20 | 19:03 |
| gitlab-br-bot | lorries: merge request (pedro/lorry-controller-lorry->master: Add lorry-controller.git from Gitlab) #20 changed state ("merged"): https://gitlab.com/baserock/lorries/merge_requests/20 | 19:03 |
| gitlab-br-bot | lorries: merge request (pedro/lorry-lorry->master: Add lorry.git from Gitlab) #21 changed state ("opened"): https://gitlab.com/baserock/lorries/merge_requests/21 | 19:44 |
| ironfoot | benbrown_: thanks for the reviews! | 19:44 |
| ironfoot | you have merged our first lorry in YAML :) | 19:44 |
| *** locallycompact has quit IRC | 20:23 | |
| *** rdale has quit IRC | 23:23 | |
| *** gtristan has quit IRC | 23:37 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!