IRC logs for #baserock for Tuesday, 2016-09-06

*** rdale_ct has joined #baserock02:34
*** rdale has quit IRC02:34
*** leeming has joined #baserock06:56
*** fay has joined #baserock06:59
*** fay is now known as faybrocklebank06:59
*** franred has joined #baserock07:33
*** toscalix has joined #baserock07:43
*** gtristan has joined #baserock07:55
*** jude_ has joined #baserock08:04
*** jonathanmaw has joined #baserock08:40
*** jude_ has quit IRC09:09
*** jude_ has joined #baserock09:26
*** toscalix has quit IRC09:27
*** toscalix has joined #baserock09:29
*** toscalix has quit IRC09:32
*** locallycompact has quit IRC13:27
*** locallycompact has joined #baserock14:13
*** gtristan has quit IRC14:55
*** CTtpollard has quit IRC14:58
*** CTtpollard has joined #baserock14:58
jjardonHi, Have anyone here ever tried to bootstrap a baserock system not using busybox at all?15:09
*** jmacs_ is now known as jmacs15:09
rjekI have only ever heard of people replacing elements of busybox with elements of coreutils etc, not the whole lot15:10
richard_mawpaulsherwood may have tried with toybox at some point15:10
jjardonI meant using only gnu coreutils, not busybox/toybox15:11
rjekI'd like to see that, but coreutils doesn't cover everything we use in busybox15:12
rjekNone of the mkfs or mounts for a start, or many other POSIX-essential things like awk, ed etc15:13
rjekSo a lot more integration needed for that to be an option15:13
* rjek ponders a "posix" stratum15:13
* paulsherwood didn't succeed with toybox, iirc15:14
jjardonrjek: oh yeah, sorry; I meant coreutils, sed , diffutils ... my idea was to build without busybox/toybox15:14
paulsherwoodrichard_maw: while you're on i think i've got a workaround for the tar order issue with http://paste.baserock.org/emotidokeb15:14
paulsherwood(it appears to work, at least)15:15
rjekjjardon: Even if you used everything from coreutils, you'd still need busybox to fill in the missing bits you'd need for a working system, though15:15
rjekI would welcome movement in that direction though15:15
paulsherwoodrichard_maw: thanks for explaining it so many times :)15:16
jjardonrjek: what missing bits are you talking about exactly?15:16
rjek16:13:05 <rjek> None of the mkfs or mounts for a start, or many other POSIX-essential things like awk, ed etc15:17
rjekCross-reference https://github.com/goj/coreutils/tree/rm-d/src with all the links to busybox15:18
jjardonrjek: mkfs is part of util-linux and we build gawk in build-essential15:18
*** jude_ has quit IRC15:18
rjekjjardon: Right, but I'm saying I bet there are functions of busybox that we have built that are not offered by coreutils15:19
rjekThey're not fungible15:19
jjardonrjek: ok; do you know specifically of any?15:19
richard_mawpaulsherwood: how deep a directory tree have you tested this on?15:20
richard_mawI'm not sure why you're using glob.glob, when os.listdir should work and also includes files beginning with . which aren't . or ..15:21
rjekjjardon: All the mount helpers15:22
rjekFor a start15:22
paulsherwoodrichard_maw: i've tested on devel-system15:22
paulsherwoodi can switch to listdir15:22
jjardonrjek: mkfs.ext* is part of e2fsprogs, and mkfs.btrfs is part of btrfs-progs, which we build as well15:24
rjekjjardon: mount.*15:24
jjardonoops, sorry15:24
rjekjjardon: http://paste.baserock.org/iyoxenuyem15:24
rjek*lots* of this is not coreutils15:25
richard_mawit looks like tar is a little more forgiving when it comes to subdirectories than files then, since your program will do files in /, / itself, files in the first subdir of /, the first subdir of /, files in the second subdir of /…15:25
rjekjjardon: I'm not saying it's impossible, just more than building coreutils instead of busybox :)15:26
jjardonrjek: cheers. Yeah, I know, but that doesn't mean is not possible to build a system without busybox at all15:26
jjardonrjek: ok, seems we agree :)15:26
rjekjjardon: OOI, why do you want to build without busybox, even if it's only to fill in the gaps that coreutils does not?15:27
jjardonrjek: I do not want busybox in the final system at all. and I do not want to use busybox utils to build other chunks; I had compilation problems before15:28
rjekAh, because people's Makefiles assume GNU or Linux versions of tools?15:28
jjardonthas why Ive created strata/coreutils-common.morph , but I was wondering if a more radical aproach can be done15:29
rjekThere aren't many holes left to fill after using all of coreutils, mind15:29
* paulsherwood wonders why s/files = glob.glob(os.path.join(d, '*'))/files = os.listdir(d)/ fails completely15:29
jjardonrjek: yes, or the busybox tools doesnt support some parameters the "real" tools have15:29
richard_mawpaulsherwood: ah, it'll be because listdir returns just the file name, rather than the whole path including the `d` prefix15:29
paulsherwoodah15:29
paulsherwoodgood spot15:31
*** jjardon_matrix has quit IRC15:32
richard_mawfiles = [os.path.join(d, f) for f in os.listdir(d)]15:32
paulsherwoodooh :)15:32
richard_mawah, I've worked it out, the reason why this isn't complaining about making the directories top-down is that you're adding the directories multiple times15:33
paulsherwoodack15:34
richard_mawmy approach would have been: http://paste.baserock.org/gonigumeqe15:41
richard_mawdo the traversal top-down with reverse-sorted directories, then reverse that traversal15:41
paulsherwoodrichard_maw: thanks! i had already submitted though - https://gitlab.com/baserock/ybd/commit/766b244b87e86882d06ef88f55479773095960a715:57
paulsherwoodjjardon: as of that, it should be possible to do deploys15:57
* richard_maw normally takes "reviewed the code" as "reviewed it and had no problems with it"15:59
*** jjardon_matrix has joined #baserock15:59
* paulsherwood believes #241 is now actually, really, properly closed15:59
jjardonpaulsherwood: AWESOME15:59
* jjardon tests16:00
paulsherwoodrichard_maw: that's quite an assumption :) but ok i'll bear that in mind for future16:01
* richard_maw would make a note of the fact that this implementation adds directory entries twice, in case you get a later bug from tar about having the directories in twice16:01
paulsherwoodrichard_maw: i could apply your patch if you prefer :)16:01
richard_mawpaulsherwood: is it? I wouldn't normally bother mentioning a review if it didn't say "no problems"16:02
richard_mawpaulsherwood: I'd be interested in knowing how my version behaves in YBD, but if you're fine with duplicate directory entries in the tarball then I wouldn't worry about it.16:03
*** faybrocklebank has quit IRC16:14
*** jonathanmaw has quit IRC16:49
*** locallycompact has quit IRC16:53
jjardonpaulsherwood: seems it worked \o/, now we are limited by the btrfs dependency for the deployment: https://gitlab.com/baserock/definitions/builds/3799426#down-build-trace17:42
*** persia_ has quit IRC18:01
*** persia has quit IRC18:01
*** thrace has quit IRC18:01
*** toscalix has joined #baserock18:25
*** gtristan has joined #baserock18:26
*** toscalix has quit IRC18:33
*** toscalix has joined #baserock18:33
*** persia_ has joined #baserock19:27
*** persia has joined #baserock19:27
*** toscalix has quit IRC20:45
*** paulwaters_ has joined #baserock20:58
*** paulwaters_ has quit IRC21:08
*** toscalix has joined #baserock21:41
*** radiofree has quit IRC22:01
*** toscalix has quit IRC22:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!