*** jude has quit IRC | 09:25 | |
*** jude has joined #buildstream | 09:25 | |
*** nexus_ has joined #buildstream | 09:37 | |
*** laurenceurhegyi has quit IRC | 09:38 | |
*** nexus has quit IRC | 09:38 | |
*** paulsherwood has quit IRC | 09:38 | |
*** bochecha has quit IRC | 09:38 | |
*** cs_shadow has quit IRC | 09:38 | |
*** hergertme has quit IRC | 09:38 | |
*** pro[m] has quit IRC | 09:38 | |
*** tlater has quit IRC | 09:38 | |
*** cgmcintyre[m] has quit IRC | 09:38 | |
*** mattiasb has quit IRC | 09:38 | |
*** inigomartinez has quit IRC | 09:38 | |
*** kailueke[m] has quit IRC | 09:38 | |
*** jjardon[m] has quit IRC | 09:38 | |
*** mrmcq2u[m] has quit IRC | 09:38 | |
*** waltervargas[m] has quit IRC | 09:38 | |
*** jude has quit IRC | 09:38 | |
*** tpollard has quit IRC | 09:38 | |
*** adds68_ has quit IRC | 09:38 | |
*** WSalmon has quit IRC | 09:38 | |
*** tristan has quit IRC | 09:38 | |
*** gitlab-br-bot has quit IRC | 09:38 | |
*** saxa has quit IRC | 09:38 | |
*** juergbi has quit IRC | 09:38 | |
*** paulsherwood has joined #buildstream | 09:39 | |
*** bochecha has joined #buildstream | 09:39 | |
*** jude has joined #buildstream | 09:39 | |
*** tpollard has joined #buildstream | 09:39 | |
*** adds68_ has joined #buildstream | 09:39 | |
*** WSalmon has joined #buildstream | 09:39 | |
*** tristan has joined #buildstream | 09:39 | |
*** gitlab-br-bot has joined #buildstream | 09:39 | |
*** cs_shadow has joined #buildstream | 09:39 | |
*** saxa has joined #buildstream | 09:39 | |
*** juergbi has joined #buildstream | 09:39 | |
*** hergertme has joined #buildstream | 09:39 | |
*** laurenceurhegyi has joined #buildstream | 09:40 | |
*** tlater has joined #buildstream | 09:42 | |
*** bethw has joined #buildstream | 09:45 | |
*** jonathanmaw has joined #buildstream | 09:52 | |
*** tpollard has quit IRC | 10:03 | |
*** tristan has quit IRC | 10:05 | |
*** tpollard has joined #buildstream | 10:05 | |
*** bethw has quit IRC | 10:05 | |
*** bethw has joined #buildstream | 10:05 | |
*** tristan has joined #buildstream | 10:12 | |
*** ssam2 has joined #buildstream | 10:14 | |
*** valentind has joined #buildstream | 10:18 | |
tlater | Huh... The baserock 'busybox' elements have always had the wrong 'track' for me - always 1_2_3_1 instead of 1_23_1, resulting in failed git clones. It seems that `bst track` changes the 'track' parameter. Is that supposed to happen? | 10:45 |
---|---|---|
*** kailueke[m] has joined #buildstream | 11:03 | |
*** kailueke[m] has quit IRC | 11:08 | |
*** WSalmon has quit IRC | 11:16 | |
juergbi | tlater: it changed it from 1_2_3_1 to 1_23_1 on its own? | 11:27 |
tlater | After a `bst track`, seemingly on its onw | 11:27 |
juergbi | that seems very odd | 11:28 |
juergbi | can you reproduce this? | 11:28 |
* tlater attempts | 11:28 | |
tristan | sounds quite impossible | 11:28 |
*** valentind has quit IRC | 11:28 | |
tristan | this is done through the get_ref() / set_ref() api paths, to pass just the ref from the child tracking process to the main process | 11:29 |
juergbi | ssam2, tristan: i'm now using multiprocessing instead of subprocess for pushreceive. seems the best way to get proper coverage (total should now be at 83%) | 11:29 |
juergbi | have to clean this change up, but i'll probably best postpone this until the multi cache branch is done | 11:30 |
tristan | w00t ! | 11:30 |
*** inigomartinez has joined #buildstream | 11:30 | |
tlater | Yup, I can reproduce it | 11:31 |
tristan | yeah that sounds a bit easier than launching the thing under coverage explicitly | 11:31 |
tristan | juergbi, what do you think, do we bother with deprecating the earlier hack and reduce the code paths for artifact sharing ? | 11:31 |
juergbi | ssam2: there is currently a behavior difference between local and ssh push urls (no failure on init of the remote in case of non-existing local repo) and the current pull tests seem to rely on that | 11:32 |
tlater | I simply copied the baserock project.conf and gnu-toolchain/busybox.bst into a separate repo, fixed the minor incompatibilites and that results in 1_23_1 -> 1_2_3_1 | 11:32 |
* tlater thinks this might be ruamel.yaml trying to escape something | 11:32 | |
juergbi | tristan: what i did was use pushreceive for local paths as well, essentially dropping the old local path special casing | 11:32 |
* tlater tries to minimize the files and set up an issue | 11:33 | |
tristan | juergbi, dropping the branchy special casing sounds good :) | 11:33 |
juergbi | it's slightly slower but this was anyway done only for testing | 11:33 |
juergbi | ssam2: one remaining difference between ssh/http and local (test) behavior is that with urls we can deduce whether we want push+pull (ssh) or just pull (http) from the uri scheme. with local paths we dont' have that distinction | 11:36 |
juergbi | so we can't really test that aspect but it's just a small point | 11:37 |
*** tristan has quit IRC | 11:40 | |
ssam2 | tlater, yeah, i think it's a ruamel corner case ... that library is not perfect at all | 11:46 |
ssam2 | i fixed a bunch of corner cases in it a few years ago | 11:46 |
ssam2 | which did get merged eventually, so it's worth sending patches | 11:46 |
ssam2 | juergbi, sounds fine to me | 11:47 |
tlater | I'll record it as an issue for now, and then perhaps move on to debugging it later - it's surprisingly hard to get this image to build ;-; | 11:47 |
ssam2 | really? it's worked in CI | 11:47 |
ssam2 | oh, buildstream has changed since then | 11:48 |
ssam2 | you should use an old version of buildstream for now | 11:48 |
ssam2 | i do have a branch to update things, but still WIP: https://gitlab.com/baserock/definitions/commits/sam/buildstream-artifact-cache-update | 11:48 |
ssam2 | if you look at the gitlab CI it logs what version of buildstream was used in the successful build | 11:48 |
ssam2 | juergbi, FWIW my sam/multiple-caches support is feature complete, just need to figure out why the tests hang | 11:49 |
ssam2 | and rebase | 11:49 |
tlater | Hm, I think I might move from your WIP branch, since this will be documentation, so I don't really want to record outdated information | 11:49 |
ssam2 | tlater, the stuff that changed isn't really related to image building | 11:49 |
ssam2 | tlater, mostly the decision to always run autoreconf for autotools modules which broke a lot of things | 11:50 |
ssam2 | juergbi, is your test suite branch pushed ? i'll try and rebase on top of it if so | 11:50 |
ssam2 | (and if i get time between meetings :/) | 11:50 |
tlater | I've seen those issues, yeah, but there are a lot of boilerplate elements that a lot of people will probably just copy when they attempt this | 11:51 |
* tlater thinks it's probably best to keep these things up-to-date | 11:51 | |
ssam2 | i'm confused what your goal is here ... | 11:53 |
ssam2 | surely not linking to the Baserock stuff directly ? | 11:54 |
tlater | I think that would result in the simplest tutorial? | 11:55 |
juergbi | ssam2: not pushed yet. we get a cyclic rebase problem ;) i can push it but it still contains a hack that i wanted to solve after rebasing on top of your updated branch | 11:55 |
ssam2 | tlater, hmm perhaps. not sure external deps for the docs makes sense though | 12:00 |
ssam2 | who knows whether baserock will be kept up to date in future | 12:00 |
ssam2 | juergbi, ok, i guess i have to figure out the hang myself then :-) | 12:00 |
*** mrmcq2u[m] has joined #buildstream | 12:02 | |
* tlater isn't sure about how he will document this yet, I'll see what I end up with - avoiding to link to external projects, of course :) | 12:04 | |
*** pro[m] has joined #buildstream | 12:08 | |
tlater | Is https://buildstream.gitlab.io/buildstream supposed to 404? | 12:09 |
*** tristan has joined #buildstream | 12:14 | |
tlater | Nvm, I guess gitlab just takes some time to deploy the pages | 12:16 |
gitlab-br-bot | buildstream: issue #166 ("bst sometimes modifies source `track` parameters") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/166 | 12:18 |
*** cgmcintyre[m] has joined #buildstream | 13:42 | |
*** mcatanzaro has joined #buildstream | 13:46 | |
*** tristan has quit IRC | 13:55 | |
*** kailueke[m] has joined #buildstream | 14:35 | |
*** waltervargas[m] has joined #buildstream | 14:40 | |
*** jjardon[m] has joined #buildstream | 14:46 | |
gitlab-br-bot | buildstream: merge request (juerg/recursive-pipelines->master: WIP: Junctions and subprojects) #160 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/160 | 14:56 |
juergbi | ssam2: i've pushed it to juerg/recursive-pipelines in case it's useful for your debugging but i don't expect it to be related | 14:57 |
ssam2 | ok, t | 14:57 |
ssam2 | ta | 14:57 |
juergbi | only the top two commits are relevant but they depend on earlier commits | 14:57 |
* juergbi starts merging simple preparatory refactoring patches from the start of my branch | 15:03 | |
*** tristan has joined #buildstream | 15:05 | |
*** mattiasb has joined #buildstream | 15:18 | |
*** jude has quit IRC | 15:22 | |
*** bethw has quit IRC | 15:45 | |
*** jude has joined #buildstream | 15:54 | |
* tlater finds it annoying that gitlab pulls our documentation off the net every time someone commits to master | 15:55 | |
gitlab-br-bot | buildstream: merge request (114-give-better-warnings-on-overlaps->master: WIP: Resolve "Give better warnings on overlaps") #165 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/165 | 16:07 |
tristan | tlater, why ? | 16:11 |
tlater | Well, our documentation's uptime will be awful this way | 16:12 |
tlater | And it seems unnecessary to wait for the full build when the actual deployment is probably just a few seconds | 16:12 |
tristan | tlater, the current problem with that right now is https://gitlab.com/gitlab-org/gitlab-ce/issues/35141 | 16:12 |
tristan | what ? | 16:12 |
tristan | why uptime awful, that part I dont understand | 16:13 |
tristan | tlater, the docs are always there, they are just "slightly" behind master, until they get updated | 16:13 |
tlater | tristan: From what I've seen they go offline for a short while until the build finishes | 16:13 |
tristan | I've never seen that | 16:13 |
tlater | "short" being the time it takes to test and build | 16:13 |
tristan | really never | 16:14 |
tlater | I've only been running into it today, maybe it's a regression? | 16:14 |
tristan | that is something new... but; yesterday or the day before it may have happened | 16:14 |
tristan | once | 16:14 |
tlater | I've seen it three times today | 16:14 |
tristan | because I changed the .gitlab-ci.yml once and screwed it up once | 16:14 |
tlater | Maybe I'm just very unlucky | 16:14 |
tristan | if there is a bug, there is a bug | 16:15 |
tristan | I havent seen it happen, but if it's happening, needs investigation I guess | 16:15 |
* tlater will be on the lookout and point it out if it happens again | 16:15 | |
tristan | really though, gitlab wont delete the pages, it will just deploy the pages quite atomically once it gets there | 16:16 |
tristan | tlater, there is *another* gitlab bug though we might be running into | 16:16 |
tristan | lemme see... | 16:16 |
tristan | we've managed to not run into this for a long time, it happened around 6 months ago and things got more stable | 16:17 |
tristan | here: https://gitlab.com/gitlab-org/gitlab-ce/issues/34899 | 16:17 |
tristan | what you're seeing *might* be related to that | 16:17 |
tristan | still, afaics you really *should* have the last version, the worst that can happen is a failed deploy and you have to retrigger a build to get the docs updated | 16:18 |
tlater | I get a gitlab 404 when it happens | 16:18 |
tristan | (whereas not updating them results only in not having up-to-date docs, not *lack* of docs) | 16:18 |
tlater | nexus_ confirmed it at some point today, because I was trying to point him to something in the docs | 16:18 |
nexus_ | +1 | 16:19 |
*** bethw has joined #buildstream | 16:20 | |
*** semanticdesign has joined #buildstream | 16:46 | |
ssam2 | this hang is one of those great ones that seems to be fixed by adding print() statements | 16:55 |
adds68_ | Hey | 16:55 |
nexus_ | hi | 16:56 |
adds68_ | When following install commands for debian stable, it points to an old version of ostree | 16:56 |
ssam2 | ah yes, nexus_ spotted the same thing :-( | 16:56 |
nexus_ | adds68_: yes, the current docs dont work :0 use docker instead for now | 16:56 |
nexus_ | OR | 16:56 |
adds68_ | I'm trying to install ostree from source, however my libostree version is out of date also | 16:56 |
nexus_ | use debian testing | 16:56 |
ssam2 | https://gitlab.com/BuildStream/buildstream/issues/159 | 16:56 |
ssam2 | libostree is ostree | 16:57 |
adds68_ | ssam2, which is what is confusing me :P | 16:57 |
adds68_ | ssam2, when i run ostree it says my libostree version is not up to date | 16:57 |
nexus_ | i believe libostree got removed in one of the updates... | 16:57 |
nexus_ | im not certain i cant rememeber | 16:57 |
adds68_ | yet i've compiled from the latest source | 16:57 |
ssam2 | i'll come have a look | 16:57 |
adds68_ | ssam2, \o/ | 16:57 |
nexus_ | if you sort it, let me know :() | 16:57 |
nexus_ | :)* | 16:57 |
*** jude has quit IRC | 16:58 | |
adds68_ | nexus_, aye i did ask what your solution was as i saw your issue | 16:58 |
juergbi | probably need to use stretch-backports similar to how it's required for jessie | 16:58 |
adds68_ | nexus_, i was hoping it wasn't Docker haha | 16:58 |
nexus_ | adds68_: yeah i say that a minute ago, for now, i used docker | 16:58 |
nexus_ | sowwy | 16:58 |
nexus_ | i think at one point, jonathanmaw gave me some files?? and that fixed it | 16:59 |
juergbi | or rather, jessie won't work anymore even with backports. buildstream ostree requirements was increased this summer or so | 16:59 |
nexus_ | but i did a clean install for the sake of documenting | 16:59 |
jonathanmaw | nexus_: i.e. I had a working source tree for ostree, but have lost the provenance of it | 17:00 |
* tlater wonders how long it will be until we can give installation instructions that only involve apt and python | 17:00 | |
nexus_ | tlater: as soon as current sid becomes stable | 17:00 |
juergbi | for debian stable, buster release, i suppose | 17:00 |
juergbi | for stretch i expect the official backports repo to work | 17:01 |
juergbi | we just need to verify and update the docu | 17:01 |
juergbi | https://backports.debian.org/Instructions/ | 17:02 |
nexus_ | juergbi: i'll look into that | 17:03 |
* nexus_ never got 2 people helping | 17:04 | |
* nexus_ cries favouritism | 17:04 | |
nexus_ | ... that worked? | 17:09 |
tlater | (Y) | 17:10 |
tlater | Erm no | 17:10 |
tlater | \o/ | 17:10 |
* tlater doesn't know where that (Y) came from | 17:10 | |
nexus_ | kk backports it is | 17:12 |
nexus_ | ssam2 seems to be working on something different with adds68_, lets see how that works out | 17:12 |
* nexus_ would rather not have to say "add backports" in the install docks | 17:12 | |
adds68_ | it seems the buildsteam setup.py checks for an ostree version | 17:16 |
adds68_ | which if you build from source doesnt get added to the ostree binary | 17:17 |
adds68_ | ssam2, is looking into why that could be | 17:17 |
ssam2 | this is weird as | 17:18 |
ssam2 | i just built v2017.13 and installed into a prefix, and YEAR_VERSION is right there | 17:19 |
ssam2 | you built commit ae61321046ad7f4148a5884c8c6c8b2594ff840e right ? | 17:19 |
juergbi | ssam2: maybe need to set GI_TYPELIB_PATH ? | 17:19 |
juergbi | if it's not in /usr | 17:19 |
ssam2 | i thought we did, but will double check | 17:19 |
ssam2 | missing 'export' :/ | 17:25 |
adds68_ | ssam2, as we don't install in /usr i cant get pip to install it as global command can i? | 17:29 |
adds68_ | ssam2, will i have to add bst to my path to call it? | 17:30 |
ssam2 | yeah I recommend `pip3 install --user` | 17:30 |
ssam2 | so bst goes in ~/.local/bin | 17:30 |
ssam2 | which you can add to your path if it's not present | 17:30 |
ssam2 | even better, `pip3 install --user -e` so that it runs the actual code from your git clone of buildstream.git | 17:31 |
ssam2 | saves you from having to reinstall after pulling or making changes | 17:31 |
nexus_ | is it working now? | 17:31 |
adds68_ | ssam2, awesome, thanks | 17:32 |
*** tiago has joined #buildstream | 17:35 | |
adds68_ | nexus_, yes this works | 17:35 |
nexus_ | \o/ | 17:35 |
nexus_ | ssam2, adds68_ what did you do? I'd like to have a look at it and see if it solved my problem | 17:35 |
nexus_ | :) | 17:35 |
adds68_ | nexus_, installed ostree from source, but not in /usr land, used /opt as ssam2 suggeted | 17:36 |
adds68_ | nexus_, installed ostree from source, but not in /usr land, used /opt as ssam2 suggested | 17:36 |
ssam2 | set GI_TYPELIB_PATH correctly so the .typelib file in /opt/ostree/lib/girepository-1.0 was picked up | 17:36 |
adds68_ | nexus_, also add that ^^ | 17:36 |
nexus_ | adds68_: which source did you use? | 17:37 |
adds68_ | tag 2017.13, but master should work also | 17:37 |
nexus_ | kk ty | 17:37 |
* nexus_ shall look into this | 17:37 | |
nexus_ | that sounds like a nicer fix than backports | 17:37 |
adds68_ | nexus_, ping me if you get blocked | 17:38 |
adds68_ | nexus_, aye defo | 17:38 |
nexus_ | adds68_: shall do | 17:38 |
*** bethw has quit IRC | 17:39 | |
gitlab-br-bot | buildstream: merge request (142-potentially-printing-provenance-more-than-once-in-loaderrors->master: Issue #142: Ensure we don't append provenances twice) #170 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/170 | 17:46 |
gitlab-br-bot | buildstream: issue #158 ("Support for lzip is missing") changed state ("closed") https://gitlab.com/BuildStream/buildstream/issues/158 | 17:48 |
gitlab-br-bot | buildstream: merge request (lzip->master: Add support for lzip in tar source) #162 changed state ("closed"): https://gitlab.com/BuildStream/buildstream/merge_requests/162 | 17:48 |
gitlab-br-bot | buildstream: merge request (142-potentially-printing-provenance-more-than-once-in-loaderrors->master: Issue #142: Ensure we don't append provenances twice) #170 changed state ("closed"): https://gitlab.com/BuildStream/buildstream/merge_requests/170 | 17:53 |
gitlab-br-bot | buildstream: issue #142 ("Potentially printing provenance more than once in LoadErrors") changed state ("closed") https://gitlab.com/BuildStream/buildstream/issues/142 | 17:54 |
gitlab-br-bot | buildstream: merge request (132-loading-external-plugins-works-without-explicit-requirement-in-project-conf->master: Resolve "Loading external plugins works without explicit requirement in project.conf") #125 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/125 | 17:54 |
tristan | ssam2, can you help me update the docker ? | 18:01 |
ssam2 | ok | 18:02 |
*** jonathanmaw has quit IRC | 18:10 | |
*** ssam2 has quit IRC | 18:24 | |
*** tristan has quit IRC | 18:31 | |
gitlab-br-bot | buildstream: issue #167 ("Workspaced element's cache keys are calculated 4 times during a build") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/167 | 18:42 |
*** valentind has joined #buildstream | 21:14 | |
gitlab-br-bot | buildstream: merge request (jjardon/configuration_parameters->master: WIP: buildstream/plugins/elements: Add *-global and *-local configuration variables) #171 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/171 | 21:31 |
*** bethw has joined #buildstream | 21:44 | |
gitlab-br-bot | buildstream: merge request (jjardon/configuration_parameters->master: WIP: buildstream/plugins/elements: Add *-global and *-local configuration variables) #171 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/171 | 21:45 |
gitlab-br-bot | buildstream: merge request (jjardon/configuration_parameters->master: WIP: buildstream/plugins/elements: Add *-global and *-local configuration variables) #171 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/171 | 21:45 |
gitlab-br-bot | buildstream: merge request (jjardon/configuration_parameters->master: WIP: buildstream/plugins/elements: Add *-global and *-local configuration variables) #171 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/171 | 21:45 |
gitlab-br-bot | buildstream: merge request (jjardon/configuration_parameters->master: buildstream/plugins/elements: Add *-global and *-local configuration variables) #171 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/171 | 21:51 |
gitlab-br-bot | buildstream: merge request (jjardon/configuration_parameters->master: WIP: buildstream/plugins/elements: Add *-global and *-local configuration variables) #171 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/171 | 21:52 |
gitlab-br-bot | buildstream: merge request (jjardon/configuration_parameters->master: WIP: buildstream/plugins/elements: Add *-global and *-local configuration variables) #171 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/171 | 21:58 |
gitlab-br-bot | buildstream: merge request (jjardon/configuration_parameters->master: buildstream/plugins/elements: Add *-global and *-local configuration variables) #171 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/171 | 22:02 |
gitlab-br-bot | buildstream: merge request (jjardon/configuration_parameters->master: buildstream/plugins/elements: Add *-global and *-local configuration variables) #171 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/171 | 22:03 |
gitlab-br-bot | buildstream: merge request (jjardon/configuration_parameters->master: buildstream/plugins/elements: Add *-global and *-local configuration variables) #171 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/171 | 22:05 |
*** bethw has quit IRC | 22:36 | |
*** cs_shadow has quit IRC | 22:53 | |
*** tristan has joined #buildstream | 22:57 | |
gitlab-br-bot | buildstream: merge request (jjardon/configuration_parameters->master: buildstream/plugins/elements: Add *-global and *-local configuration variables) #171 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/171 | 23:04 |
*** valentind has quit IRC | 23:32 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!