| *** gtristan has quit IRC | 01:34 | |
| *** gtristan has joined #baserock | 01:41 | |
| *** gtristan has quit IRC | 02:14 | |
| *** gtristan has joined #baserock | 03:28 | |
| *** franred has joined #baserock | 07:05 | |
| *** CTtpollard has quit IRC | 07:07 | |
| *** CTtpollard has joined #baserock | 07:13 | |
| *** ssam2 has joined #baserock | 07:23 | |
| *** ChanServ sets mode: +v ssam2 | 07:23 | |
| *** tiagogomes has joined #baserock | 07:27 | |
| *** rdale has joined #baserock | 07:45 | |
| *** toscalix has joined #baserock | 07:46 | |
| *** paulwaters_ has joined #baserock | 07:51 | |
| *** jonathanmaw has joined #baserock | 07:59 | |
| *** anahuelamo has joined #baserock | 08:08 | |
| *** franred has quit IRC | 08:33 | |
| *** franred has joined #baserock | 08:48 | |
| *** locallycompact has joined #baserock | 09:15 | |
| *** Lachlan1975 has joined #baserock | 09:26 | |
| *** CTtpollard has quit IRC | 09:27 | |
| *** CTtpollard has joined #baserock | 09:30 | |
| *** Lachlan1975 has quit IRC | 09:48 | |
| *** franred_ has joined #baserock | 10:23 | |
| *** franred has quit IRC | 10:27 | |
| *** fay_ has joined #baserock | 12:04 | |
| paulsherwood | rdale: are you around? | 12:21 |
|---|---|---|
| paulsherwood | i'm on a voyage of discovery, trying to retrofit tests for splitting... | 12:22 |
| paulsherwood | and while exploring reproducibility i've noticed that i can end up with a different set of files in devel-system between one run and another | 12:25 |
| paulsherwood | the diff is http://paste.baserock.org/erozadiqom | 12:25 |
| paulsherwood | i'm wondering how host python might leak into a built artifact | 12:25 |
| richard_maw | how are you determining those to be from the host system? we do build all those for the openstack systems | 12:30 |
| paulsherwood | oh, maybe they're not from host, then | 12:30 |
| paulsherwood | on aws instance, these files are not added to the artifact ... on my laptop, they are | 12:31 |
| paulsherwood | same version of ybd, same checkout of definitions | 12:31 |
| richard_maw | if it turns out they are, assuming it still operates similarly enough to morph, the only way that could happen would be if something in the bootstrap process copied them in | 12:31 |
| ssam2 | it seems odd that only the setup_requires.txt files would appear | 12:34 |
| ssam2 | a python egg directory contains more than just setup_requires.txt | 12:34 |
| ssam2 | is there other stuff in usr/lib/python2.7/site-packages/cliff-1.10.1-py2.7.egg-info/ for example ? | 12:34 |
| paulsherwood | yup... http://paste.baserock.org/opowirazin | 12:36 |
| paulsherwood | that first paste was just the diff of `find . -type f` in the artifact on both machines | 12:37 |
| paulsherwood | 26 extra files in a set of 77thousand | 12:38 |
| * paulsherwood was *really* expecting to get the same list both times | 12:40 | |
| ssam2 | weird | 12:40 |
| paulsherwood | yup | 12:41 |
| paulsherwood | http://paste.baserock.org/giyuzipozi | 12:54 |
| *** franred has joined #baserock | 13:02 | |
| richard_maw | https://github.com/projectatomic/bubblewrap may be of interest here, enhanced descendant of linux-user-chroot | 13:04 |
| richard_maw | (which for some reason has a picture of a cat in bubblewrap in the Readme… which was taken from the flickr account of someone I share a house with) | 13:05 |
| *** franred_ has quit IRC | 13:05 | |
| paulsherwood | richard_maw: yup... jjardon has also suggested that | 13:06 |
| paulsherwood | but i remain confused about this case... i don't think it can be the sandboxing per-se | 13:06 |
| richard_maw | it's either that, or something badly broken in your artifact cache | 13:07 |
| ssam2 | richard_maw: what a perfect coincidence | 13:08 |
| ssam2 | (about the cat) | 13:08 |
| richard_maw | ☺ | 13:08 |
| ssam2 | the main advantage of bubblewrap over linux-user-chroot would be if it gets more widely packaged, so we can just use it everywhere | 13:08 |
| ssam2 | instead of having sandboxlib | 13:08 |
| rdale | paulsherwood: i'm around - i was going to send you what i'd done with splitting tests | 13:28 |
| paulsherwood | rdale: that would be lovely, thanks | 13:29 |
| rdale | ok, i'll go and find it | 13:29 |
| paulsherwood | rdale: did you ever test on anything bigger than minimal-system? eg devel? | 13:29 |
| rdale | no - a minimal system was best because in order to be minimal it needed a lot of splitting | 13:30 |
| *** tiagogomes has quit IRC | 13:33 | |
| paulsherwood | rdale: fine... however 77000 files in devel suggests that maybe it's not splitting anything? | 13:36 |
| rdale | that's quite possible if it is using entire strata to assemble a system, assuming the ybd bug about including build depends in a final system has remained fixed | 13:37 |
| rdale | is there anyway to revert a 'git add' command? | 13:40 |
| paulsherwood | git reset HEAD | 13:41 |
| rdale | will that lose local changes too? | 13:41 |
| paulsherwood | no | 13:41 |
| paulsherwood | reset --hard if you want to scrap the changes | 13:41 |
| paulsherwood | pls could you clarify what you mean by 'the ybd bug about including build depends in a final system has remained fixed | 13:42 |
| rdale | there was a bug where if you needed a stratum such as python 3.0 to build syslinux, then python 3.0 ended up in the final system even if it wasn't specified in the strata list for the system | 13:44 |
| paulsherwood | ok... and 'remained fixed' ? | 13:48 |
| *** ssam2 has quit IRC | 13:48 | |
| rdale | yes, ie didn't regress | 13:48 |
| paulsherwood | well... master can generate exactly the same files for minimal-system as your rdale/150-master-splitting branch, i think | 13:49 |
| paulsherwood | would the bug occur for that system? | 13:50 |
| rdale | ok sounds good - but i wouldn't expect a devel system to use any splitting rules | 13:50 |
| paulsherwood | aren't there default splitting rules? | 13:50 |
| rdale | yes, foo-runtime and foo-devel | 13:51 |
| rdale | but if you just specify the stratum you get both | 13:51 |
| rdale | and the splitting code isn't invoked | 13:51 |
| paulsherwood | ack | 13:52 |
| *** ssam2 has joined #baserock | 13:52 | |
| *** ChanServ sets mode: +v ssam2 | 13:52 | |
| *** gtristan has quit IRC | 14:00 | |
| *** tiagogomes has joined #baserock | 14:02 | |
| paulsherwood | is it possible to run morph outside of baserock now? if so, are there instructions anywhere? | 14:08 |
| ssam2 | no instructions that I know of | 14:18 |
| SotK | paulsherwood: http://git.baserock.org/cgit/baserock/baserock/morph.git/tree/README#n57 | 14:19 |
| SotK | disclaimer: I have no idea if it works | 14:19 |
| rdale | paulsherwood: just sent you a giant email, sorry | 14:23 |
| rjek | Big endian? | 14:25 |
| *** franred has quit IRC | 14:36 | |
| *** gtristan has joined #baserock | 14:47 | |
| *** franred has joined #baserock | 14:51 | |
| paulsherwood | rdale: rather than a tarball, don't you have a branch somewhere? | 15:15 |
| paulsherwood | (but thanks for the explanations, that's helpful) | 15:15 |
| paulsherwood | SotK: thanks! i confirm it appears to be working on AWS... | 15:16 |
| SotK | \o/ | 15:16 |
| * paulsherwood wonders why morph starts by cloning definitions, when it's being run in a definitions checkout | 15:16 | |
| SotK | it is too long since I worked on morph for me to give a reliable answer to that question | 15:17 |
| paulsherwood | :) | 15:17 |
| SotK | maybe to avoid including uncommitted changes by default? | 15:17 |
| *** jonathanmaw has quit IRC | 15:18 | |
| ssam2 | legacy really | 15:19 |
| rdale | paulsherwood: i did 'git add' and found it was adding bazillions of files, hence the question about how to revert a 'git add' command | 15:27 |
| rdale | so didn't push a branch in the end - it needs a bit more thought | 15:27 |
| rdale | also needs rebasing on ybd master and so | 15:27 |
| rdale | on | 15:27 |
| paulsherwood | weird :) | 15:31 |
| paulsherwood | never mind, then | 15:31 |
| paulsherwood | i can take it from there | 15:31 |
| rdale | there a loads of files that are generated by the test i think and i don't want to commit those, but i can't remeber exactly which ones yet | 15:33 |
| paulsherwood | rdale: it's fine. i think i understand your approach, and the 'mode' stuff i've added to ybd should make it doable now without the monkey-patching etc | 15:35 |
| rdale | ok | 15:36 |
| paulsherwood | https://github.com/devcurmudgeon/ybd/blob/master/docs/testing.md#check-splits | 15:37 |
| rdale | ok, that would check that splitting hasn't regressed - i'm trying to think what my test would do if you added some new splitting functionality and wanted to test it | 15:42 |
| paulsherwood | rdale: if we change splitting functionality, artifact-version needs to bump | 15:43 |
| rdale | i suppose i was trying to test without building everything for speed optimization | 15:44 |
| * paulsherwood is still working to verify that current splitting behaviour is deterministic, or at least close enough to be relied on | 15:44 | |
| paulsherwood | ack | 15:44 |
| rdale | as far as i know it should be - the build order shouldn't affect it | 15:45 |
| paulsherwood | rdale: hence my questions about the strange appearance of extra files above | 15:45 |
| paulsherwood | https://irclogs.baserock.org/%23baserock.2016-05-05.log.html#t2016-05-05T12:22:30 | 15:45 |
| rdale | are the .meta file different? | 15:46 |
| *** CTtpollard has quit IRC | 15:46 | |
| rdale | how are those two .txt files generated? | 15:48 |
| paulsherwood | yes, to the extent that they feature the extra setup_requires.txt files | 15:48 |
| paulsherwood | find . -type f | sort | 15:48 |
| rdale | ok - i think i would like to see how those files differ in the .meta files then | 15:49 |
| *** franred has quit IRC | 15:50 | |
| rdale | can they be build twice from two different chunks, like awk in busybox and gnu awk | 15:50 |
| paulsherwood | http://paste.baserock.org/erebovobay | 15:51 |
| paulsherwood | those lines are the total diff of all the .meta files (ie on aws, the .meta files don't contain any setup_requires.txt lines) | 15:52 |
| rdale | hmm egg meta data | 15:52 |
| *** ssam2 has quit IRC | 16:00 | |
| *** astrophys has quit IRC | 16:01 | |
| *** toscalix has quit IRC | 16:05 | |
| *** tiagogomes has quit IRC | 16:06 | |
| *** toscalix has joined #baserock | 16:08 | |
| *** toscalix has quit IRC | 16:10 | |
| *** gtristan has quit IRC | 16:44 | |
| *** gtristan has joined #baserock | 16:50 | |
| *** anahuelamo has quit IRC | 16:58 | |
| *** mwilliams_ct has quit IRC | 17:01 | |
| *** rdale has quit IRC | 17:44 | |
| *** rdale has joined #baserock | 17:56 | |
| *** locallycompact has quit IRC | 17:59 | |
| *** rdale_ct has joined #baserock | 18:15 | |
| *** rdale_ct_ has joined #baserock | 18:16 | |
| *** rdale_ct has quit IRC | 18:16 | |
| *** rdale has quit IRC | 18:18 | |
| *** rdale_ct_ has quit IRC | 18:33 | |
| *** locallycompact has joined #baserock | 18:47 | |
| *** gtristan has quit IRC | 19:50 | |
| *** fay_ has quit IRC | 21:00 | |
| *** tiagogomes has joined #baserock | 21:37 | |
| *** astrophys has joined #baserock | 21:40 | |
| paulsherwood | so... turns out in the sandbox on my mac, setuptools==7.0.dev0 - whereas on aws it ends up at setuptools==15.2 | 21:48 |
| *** gtristan has joined #baserock | 21:50 | |
| paulsherwood | in the former case, the extra file is being created by http://git.baserock.org/cgit/delta/python-setuptools-bitbucket.git/commit/?h=baserock/master&id=0aa6a4de5931d02876428388678802db2371fd37 | 21:51 |
| *** tiagogomes has quit IRC | 21:52 | |
| paulsherwood | in the latter, i have no idea how the sandbox ends up with that version of setuptools | 22:06 |
| *** astrophys has quit IRC | 22:51 | |
| *** astrophys has joined #baserock | 22:51 | |
| *** toscalix has joined #baserock | 22:53 | |
| *** toscalix has quit IRC | 23:03 | |
| *** toscalix has joined #baserock | 23:04 | |
| *** toscalix has quit IRC | 23:57 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!