| *** CTtpollard has quit IRC | 00:54 | |
| *** jude_ has quit IRC | 03:21 | |
| *** jude_ has joined #baserock | 03:22 | |
| *** gtristan has joined #baserock | 04:03 | |
| *** fay_ has joined #baserock | 07:16 | |
| *** persia has quit IRC | 07:30 | |
| *** persia has joined #baserock | 07:33 | |
| *** ctbruce has joined #baserock | 07:38 | |
| *** rdale has joined #baserock | 07:50 | |
| *** mwilliams_ct has joined #baserock | 08:45 | |
| *** jjardon_matrix has quit IRC | 08:45 | |
| mwilliams_ct | Morning baserockers. SotK's advice worked a treat yesterday, so thanks again :). on a different note, is there a magic curl command that can be run to force a trove to do a remote trove scan immediately? | 08:46 |
|---|---|---|
| pedroalvarez | mwilliams_ct: I think that's done in the readconf service | 08:56 |
| pedroalvarez | (i don't know for sure, but at least that forces lorry controller to read the configuration) | 08:57 |
| *** jjardon_matrix has joined #baserock | 08:59 | |
| mwilliams_ct | pedroalvarez: I think that just reads and adds anything modified recently, but ls-troves.service seems like it should do what I need. I'd forgotten that the curl commands are called by systemd units, I'll look through them. thanks! | 08:59 |
| pedroalvarez | yes, that one sounds more likely | 09:00 |
| pedroalvarez | but it looks like is also a queue of jobs, and ls-troves won't do anything until the trove is at the top, and with the counter at 0 (or now) | 09:01 |
| paulsherwood | gtristan, others: http://paste.baserock.org/umukiboqib | 09:02 |
| paulsherwood | is that a clear enough break point? i'm plannign to write to the list also | 09:03 |
| gtristan | paulsherwood, That is clear enough, although I might be inclined to hold off on it | 09:07 |
| paulsherwood | gtristan: why? | 09:08 |
| *** locallycompact has joined #baserock | 09:09 | |
| * paulsherwood notes that it's about time we formalized that ybd upstream is no longer github (in the repo itself) | 09:09 | |
| gtristan | paulsherwood, right now I think we are to fork ybd and let the work materialize, at which point I would approach the baserock community and propose that they use the new tooling | 09:09 |
| gtristan | where baserock is ideally one of the hopefully many use cases for the tooling | 09:09 |
| paulsherwood | and that work will happen at gitlab/baserock, or elsewhere? | 09:10 |
| locallycompact | possible gotchas for https://gitlab.com/baserock/ybd/builds/5239746 anyone? | 09:12 |
| paulsherwood | which sandbox is this using? | 09:14 |
| paulsherwood | also, what's happened to the cache-key calculations? | 09:14 |
| locallycompact | They're happening silently | 09:15 |
| paulsherwood | fhs-dirs is the first non-bootstrap chunk, fwiw, so it's the first chunk that does an actual chroot iiuc | 09:15 |
| locallycompact | right | 09:15 |
| locallycompact | I don't get this problem in the python 3.6 docker image | 09:16 |
| locallycompact | it gets to autoconf and fails because it can't find automake | 09:16 |
| paulsherwood | and it creates device nodes | 09:16 |
| locallycompact | all other things equal it gets this far in docker | 09:16 |
| locallycompact | https://gitlab.com/baserock/ybd/builds/5188628 | 09:17 |
| locallycompact | can't chroot into debris beause there's no bash.. | 09:26 |
| locallycompact | hmm | 09:26 |
| * paulsherwood notes something is up with gitlab ci for ybd now | 09:27 | |
| paulsherwood | https://gitlab.com/baserock/ybd/builds/5270936 | 09:27 |
| locallycompact | sorry | 09:28 |
| locallycompact | go once more | 09:28 |
| paulsherwood | This build is stuck, because you don't have any active runners that can run this build. | 09:29 |
| locallycompact | public are back one | 09:30 |
| locallycompact | *on | 09:30 |
| paulsherwood | tvm | 09:30 |
| *** gtristan has quit IRC | 10:08 | |
| *** gtristan has joined #baserock | 10:15 | |
| *** gtristan has quit IRC | 10:21 | |
| * paulsherwood notes that the ybd cache server is down to 7GB of free space | 10:36 | |
| locallycompact | I set min-gigs to zero and ybd deleted all of my artifacts | 11:28 |
| * tiagogomes thinks it is very scary that ybd is deleting stuff as root | 11:30 | |
| locallycompact | I have no idea how to debug this fhs-dirs thing | 11:31 |
| locallycompact | two hours building and then ybd deletes my artifacts | 11:31 |
| tiagogomes | I wonder what happened of someone did `ln -s /usr ~/.cache/ybd/artifacts/foooooooooooooooo` | 11:32 |
| tiagogomes | Artifact splitting in ybd seems wrong. | 11:49 |
| paulsherwood | patches welcome | 11:55 |
| leeming | i wonder if it is what i was hitting locallycompact , related to the devices | 11:55 |
| leeming | minus the ybd deleting all your stuff:P) | 11:55 |
| *** leeming has quit IRC | 12:00 | |
| *** leeming has joined #baserock | 12:01 | |
| paulsherwood | locallycompact: afaict if you set min-gigs to 0 ybd should not delete anything. are you sure about your claim above? | 12:03 |
| paulsherwood | tiagogomes: i've been asking for help to make ybd run as non-root for over a year | 12:03 |
| tiagogomes | ahh, it is weird that in strata, you can chose which chunk artifacts will go to a stratum, through two different ways | 12:04 |
| * paulsherwood has to believe this is possible, since other build tools dont require root. | 12:04 | |
| * locallycompact doesn't know what's real anymore | 12:06 | |
| tiagogomes | paulsherwood, building is certainly possible without root. It may be possible that some write extension requires root though | 12:06 |
| locallycompact | checking for suffix of object files... configure: error: in `/root/ybd/tmp/tmp48yn3pqx/stage2-libstdc++.build/o': | 12:06 |
| locallycompact | configure: error: cannot compute suffix of object files: cannot compile | 12:06 |
| locallycompact | what | 12:06 |
| paulsherwood | locallycompact: well, maybe best not to heckle, if you're not sure? :) | 12:07 |
| locallycompact | It definitely deleted all of my artifacts | 12:07 |
| paulsherwood | locallycompact: do you have a log for that? | 12:07 |
| locallycompact | no that was hours ago | 12:08 |
| paulsherwood | tiagogomes: device nodes appear to be impossible without root so far, hence definitions which include device nodes seem to require that any tool attempting to build them (eg morph, ybd) needs to be root at the time | 12:10 |
| paulsherwood | s/appear to be impossible/have defeated us/ | 12:12 |
| tiagogomes | paulsherwood hence I suggested that instead of creating those devices nodes, they were bind mounted in the sandbox | 12:12 |
| tiagogomes | bubblewrap even has a command to only bind mount a sanitized list of devices nodes in the sandbox, instead of whole /dev | 12:12 |
| locallycompact | aren't they real "things" that need to "exist" in the resulting tarball though? | 12:13 |
| paulsherwood | tiagogomes: what locallycompact said | 12:13 |
| * edcragg thought they're mostly there when needed for a build | 12:13 | |
| tiagogomes | If devtempfs doesn't help and they need to go the final root fs, you could use fakeroot to create them - I tested this and it works. | 12:14 |
| persia | Some software only installs as root, and most software prefers to be installed as root. Doing this without granting root to the build system is usually done through some way to pretend to be root while in the chroot (e.g. fakeroot). | 12:15 |
| SotK | I vaguely remember some trouble with fakeroot when people were looking at bit-for-bit reproducibility, but may be mistaken | 12:16 |
| SotK | that was faketime, ignore me :) | 12:17 |
| paulsherwood | afaict the nodes we care about are /dev/console /dev/full /dev/null /dev/urandom /dev/zero - can we assume they are always present on any reasonable host? | 12:18 |
| paulsherwood | and would it always be ok (and non-leaking) to consume them from the host for builds? | 12:18 |
| tiagogomes | Or could also send a patch to bubblewrap that creates the device nodes instead of fakeroot :) | 12:18 |
| tiagogomes | Anyway. I think devtmpfs solves that problem. | 12:19 |
| tiagogomes | I don't know if it is configured for baserock kernels. Anyone has a running baserock os to check? | 12:20 |
| locallycompact | so I'm in the debris folder for this | 12:34 |
| locallycompact | https://gitlab.com/baserock/ybd/builds/5277684 | 12:34 |
| locallycompact | chroot in and I go | 12:34 |
| locallycompact | ~ # ls | 12:35 |
| locallycompact | /bin/sh: ls: not found | 12:35 |
| locallycompact | ~ # | 12:35 |
| locallycompact | oh wait | 12:35 |
| locallycompact | hmm yes no ls | 12:35 |
| locallycompact | bin is symlinked to tools/bin and there's an ls in there | 12:36 |
| locallycompact | what is setting the $PATH when I do a manual chroot in to a debris folder? | 12:38 |
| locallycompact | and what is symlinking tools/bin to bin and why | 12:41 |
| tiagogomes | hmm | 12:42 |
| tiagogomes | bin shouldn't be symlinked to tools/bin after the build-essential | 12:43 |
| tiagogomes | have you done any change in definitions? | 12:43 |
| locallycompact | V10 | 12:44 |
| locallycompact | https://gitlab.com/baserock/definitions/tree/lc/010 | 12:44 |
| locallycompact | I need to make it behave now so past behaviour may not indicate anything | 12:45 |
| locallycompact | why does /bin symlink? | 12:46 |
| locallycompact | and why does /bin not end up in the path for autoconf | 12:46 |
| tiagogomes | because autoconf, in your version is depending on boostrap chunks: stage2-busybox, stage2-binutils, … | 12:46 |
| tiagogomes | you got the dependencies wrong | 12:47 |
| locallycompact | maybe I'm not being clear | 12:48 |
| locallycompact | why does anything need to symlink /bin ever | 12:48 |
| locallycompact | and why is it not in the path | 12:48 |
| locallycompact | and how does manual chrooting pick up its path from | 12:49 |
| locallycompact | all I need is to make /bin in the path for autoconf the dependencies aren't important | 12:50 |
| tiagogomes | There is a symlink from /bin to tools so that after all build essential chunks are built, we can just remove the temporary stage 1 and stage 2 binaries that were installed on /tools, and they don't end up in the final root fs. | 12:50 |
| tiagogomes | If /bin is on $PATH, so /tools will be due the symlink | 12:51 |
| locallycompact | /bin isn't on path, that's the problem | 12:51 |
| locallycompact | /tools/bin is on path | 12:51 |
| tiagogomes | on path of what? The manual chroot or the ybd chroot | 12:51 |
| locallycompact | anything | 12:52 |
| locallycompact | https://gitlab.com/baserock/ybd/builds/5277684 | 12:52 |
| locallycompact | PATH=/usr/bin:/tools/bin:/usr/lib/ccache:/usr/bin:/bin:/usr/sbin:/sbin | 12:52 |
| tiagogomes | that looks +- correct, as it is /tools/bin that should be on $PATH and not /tools. | 12:53 |
| locallycompact | It's /bin that i need | 12:53 |
| locallycompact | that has autoreconf in it | 12:54 |
| locallycompact | no.. | 12:54 |
| locallycompact | sorry | 12:54 |
| locallycompact | /usr/bin/autoreconf | 12:54 |
| locallycompact | it's there | 12:54 |
| locallycompact | chroot doesn't find it | 12:54 |
| locallycompact | [root@sunwell tmppkbj1xt6]# chroot . | 12:55 |
| locallycompact | /usr/bin # ./autoreconf | 12:55 |
| locallycompact | /bin/sh: ./autoreconf: not found | 12:55 |
| locallycompact | but it's there | 12:55 |
| locallycompact | it executes outside of chroot | 12:55 |
| pedroalvarez | maybe missing libraries? | 12:56 |
| locallycompact | how does that follow? | 12:56 |
| tiagogomes | That's because what is not being found is /bin/sh, and not the autoreconf tool? | 12:57 |
| edcragg | it could be a kernel error code being reported back | 12:57 |
| locallycompact | ah | 12:57 |
| tiagogomes | Anyway, I suggest that you fix your dependencies. Like I said, autoreconf shouldn't depend on stage2 chunks | 12:57 |
| locallycompact | I don't see how that results in autoreconf not found, sorry | 12:58 |
| edcragg | you sometimes get not found because it can't find the libs, not the file | 12:59 |
| locallycompact | oh /bin is in that path | 13:00 |
| locallycompact | which libs? | 13:01 |
| mwilliams_ct | In another conversation, pedroalvarez has told me I've found a bug in Trove. Where do I collect my medal? | 13:01 |
| mwilliams_ct | Or more importantly, where do we report bugs these days? | 13:02 |
| SotK | mwilliams_ct: https://storyboard.baserock.org/#!/ | 13:02 |
| * mwilliams_ct shall do so | 13:02 | |
| tiagogomes | mwilliams_ct may I gift you with an oxo cube? | 13:03 |
| mwilliams_ct | tiagogomes: YES | 13:03 |
| * SotK wonders which bit of trove has the bug, since he just noticed we don't have a project in storyboard for the trove-setup repo | 13:04 | |
| mwilliams_ct | SotK: it's either lorry or lorry-controller | 13:05 |
| locallycompact | how does somehting look for libs exactly? | 13:07 |
| tiagogomes | You can find the libraries that a binary requires by running `ldd $binary` | 13:09 |
| locallycompact | $ not a dynamic executable | 13:09 |
| locallycompact | / # ldd /usr/bin/autoreconf | 13:09 |
| locallycompact | $ not a dynamic executable | 13:09 |
| tiagogomes | By that I take that autoreconf is a shell script | 13:10 |
| locallycompact | oh it's perl | 13:11 |
| locallycompact | and perl is not here for some reason | 13:11 |
| * locallycompact wonders how this ever worked without autoconf listing perl as a dependency | 13:16 | |
| locallycompact | also help2man | 13:16 |
| locallycompact | no it has help2man | 13:17 |
| locallycompact | but same error help2man: not found | 13:17 |
| *** edcragg has quit IRC | 14:05 | |
| *** edcragg has joined #baserock | 14:11 | |
| *** anahuelamo_ has joined #baserock | 14:11 | |
| *** anahuelamo has quit IRC | 14:12 | |
| *** CTtpollard has joined #baserock | 14:49 | |
| tiagogomes | There is the following problem with definitions, every system besides the minimal system, is not including the build-essential-minimal artifacts. | 15:13 |
| locallycompact | Anybody know this error in bison configure.ac:26: error: version 'UNKNOWN' doesn't follow Gnits standards | 15:15 |
| mwilliams_ct | has anyone used qt5 in a baserock system? | 15:23 |
| mwilliams_ct | we're having troubles dealing with its submodules http://git.baserock.org/cgit/delta/qt5.git/tree/.gitmodules?h=5.7.1 | 15:23 |
| SotK | mwilliams_ct: what form of trouble? | 15:24 |
| mwilliams_ct | fwiu, the upstream maintainers assume you are using their systems, and therefore have a variety of scripts that initialise submodules assuming their upstream (see eg http://git.baserock.org/cgit/delta/qt5.git/tree/init-repository?h=5.7.1 ) rather than trove | 15:24 |
| mwilliams_ct | the .gitmodules is assuming that access is available over ssh rather than https | 15:25 |
| locallycompact | you need to override the urls in definitions | 15:26 |
| SotK | indeed | 15:26 |
| locallycompact | grep definitions for submodules there's examples | 15:27 |
| mwilliams_ct | do we have any examples of that? | 15:27 |
| mwilliams_ct | ahh | 15:27 |
| mwilliams_ct | ok, thanks locallycompact SotK | 15:27 |
| *** CTtpollard has quit IRC | 16:03 | |
| *** fay_ has quit IRC | 16:04 | |
| *** ctbruce has quit IRC | 16:15 | |
| *** gtristan has joined #baserock | 16:25 | |
| locallycompact | anybody got any clue about this https://gitlab.com/baserock/ybd/builds/5289699 | 16:36 |
| pedroalvarez | configure.ac:26: error: version 'UNKNOWN' doesn't follow Gnits standards | 16:38 |
| locallycompact | does that clue also come with a solution? | 16:41 |
| pedroalvarez | nope, but google drops some results | 16:41 |
| locallycompact | do any of those results have a solution | 16:41 |
| tiagogomes | jjardon, anahuelamo_ I have mad the jjardon/usr-merge branch to build with success. | 16:41 |
| * pedroalvarez wonders if locallycompact has even tried to google the issue | 16:42 | |
| locallycompact | for hours | 16:42 |
| anahuelamo_ | that's great tiagogomes, thanks! | 16:42 |
| tiagogomes | There is a fix need for ybd, due not doing artifact splitting properly - or at least how morph does. | 16:42 |
| locallycompact | pedroalvarez, are you being entirely serious | 16:42 |
| *** anahuelamo_ is now known as anahuelamo | 16:42 | |
| pedroalvarez | first result, baserock irc logs with the same issue | 16:42 |
| pedroalvarez | seems like we had that in the past | 16:43 |
| rdale | artifact splitting in ybd appears to have regressed - it certainly worked until recently | 16:43 |
| locallycompact | yes, as usual baserock chat log results of problems without solutions | 16:43 |
| tiagogomes | rdale the gist is that the build-essential-minimal artifacts are not being included in any other system but the minimal-system | 16:44 |
| * pedroalvarez stops digging through the logs | 16:44 | |
| anahuelamo | tiagogomes, where can I take a look? | 16:44 |
| tiagogomes | anahuelamo is this blocking you? I still have to do more testing on this before I send a pull request. But if you are blocked by this at the moment, I can push a wip branch somewhere. | 16:47 |
| anahuelamo | tiagogomes, I started working on this today, after reading some documentation, so it's not blocking me at the moment | 16:48 |
| pedroalvarez | locallycompact: second google result points at: https://github.com/scfc/bison-php/issues/1#issuecomment-2888464 | 16:50 |
| pedroalvarez | and irc discussion points at: no git in the environment | 16:50 |
| pedroalvarez | commit c6b6225e4f5872ea749fde416bca8e6b89cb5424 in definitions seems to be related too | 16:51 |
| pedroalvarez | also 7c2bfac98e93e42ffcb23e0d43aee8f3d2c01c69 | 16:53 |
| pedroalvarez | I take that c6b6225e4f5872ea749fde416bca8e6b89cb5424 was missing the removal of "--no-git" | 16:55 |
| locallycompact | remove git and add the tarball echo? | 16:56 |
| locallycompact | or remove --no-git | 16:56 |
| pedroalvarez | we went to that direction and went back to add git | 16:57 |
| pedroalvarez | so, remove --no-git | 16:57 |
| locallycompact | trying | 16:57 |
| locallycompact | same | 16:57 |
| pedroalvarez | hm.. try echoing a tarball version file? | 16:58 |
| pedroalvarez | of course, the thing to investigate is why this is working in master of definitions | 16:59 |
| locallycompact | tarball version seesm to work | 17:02 |
| locallycompact | now with pkg-config | 17:04 |
| locallycompact | /usr/share/aclocal/ltversion.m4:12: warning: ill-formed serial number 'ltversion.m4', expecting a version string with only digits and dots | 17:04 |
| locallycompact | configure.ac:12: error: Libtool version 2.2 or higher is required | 17:04 |
| locallycompact | /usr/share/aclocal/libtool.m4:40: LT_PREREQ is expanded from... | 17:04 |
| locallycompact | configure.ac:12: the top level | 17:04 |
| locallycompact | autom4te: /usr/bin/m4 failed with exit status: 63 | 17:04 |
| locallycompact | aclocal: error: echo failed with exit status: 63 | 17:04 |
| locallycompact | autoreconf: aclocal failed with exit status: 63 | 17:04 |
| *** locallycompact has quit IRC | 17:15 | |
| jjardon | tiagogomes: nice! is the branch in gitlab? so you can run the ci through it? | 18:25 |
| jjardon | mwilliams_ct: the weston-qt system includes qt5 | 18:27 |
| jjardon | locallycompact seems the m4_esyscmd([build-aux/git-version-gen .tarball-version]) macro in configure.ac is not working; probably because bison is missing the git dependency | 18:34 |
| *** gtristan has quit IRC | 19:57 | |
| *** vgrade12 has joined #baserock | 20:32 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!