*** gtristan has quit IRC | 04:20 | |
*** gtristan has joined #baserock | 04:37 | |
*** fay has joined #baserock | 06:48 | |
*** fay is now known as Guest21499 | 06:49 | |
*** rdale has joined #baserock | 07:04 | |
*** ctbruce has joined #baserock | 07:21 | |
*** locallycompact has joined #baserock | 07:37 | |
locallycompact | It's just this isn't it https://gitlab.com/baserock/definitions/tree/lc/009 | 07:54 |
---|---|---|
*** toscalix has joined #baserock | 07:54 | |
locallycompact | paulsherwood, | 07:55 |
*** CTtpollard has quit IRC | 07:55 | |
locallycompact | I'd like to get rid of kind in some capactiy because system and stratum have exactly the same fields now | 07:57 |
*** Guest21499 is now known as faybrocklebank | 07:57 | |
locallycompact | Now where we had chunks: List<Chunk> and strata: List<Stratum> we have instead contents: List<Either Stratum Chunk> | 07:59 |
*** CTtpollard has joined #baserock | 08:02 | |
locallycompact | Unless people would deeply deeply prefer contents: Either List<String> List<Chunk> | 08:12 |
locallycompact | *Either List<Stratum> List<Chunk> | 08:14 |
*** gtristan has quit IRC | 08:22 | |
*** locallycompact has quit IRC | 08:48 | |
*** CTtpollard has quit IRC | 09:10 | |
*** gtristan has joined #baserock | 09:11 | |
*** CTtpollard has joined #baserock | 09:12 | |
leeming | Stratum {union} Chunk, seems like a sensible thing to me. Although a little uneducated/experienced in the matter | 09:23 |
*** gtristan has quit IRC | 09:29 | |
*** locallycompact has joined #baserock | 09:32 | |
*** gtristan has joined #baserock | 09:42 | |
*** jjardon_matrix has quit IRC | 09:52 | |
* paulsherwood prefers List<Either Stratum Chunk> | 10:10 | |
* locallycompact too | 10:11 | |
paulsherwood | if by that you mean a list of things, here each thing can either be a single component, or a collection of single components | 10:11 |
locallycompact | right | 10:11 |
locallycompact | rather than homogenous lists | 10:11 |
paulsherwood | rather than one list of collections and one list of single components | 10:12 |
locallycompact | right | 10:12 |
* paulsherwood is spelling it out to make sure we fully understand each other | 10:12 | |
*** dabukalam has quit IRC | 10:19 | |
*** cphang has joined #baserock | 10:22 | |
*** jjardon_matrix has joined #baserock | 10:23 | |
cphang | Newbie baserock problem here: Built a dev system, but it's failing when I try to upgrade it. It's failing when I try to remove the remote mount point. Root has passwordless ssh access to 127.0.0.1 | 10:23 |
cphang | ERROR: ssh command `ssh root@127.0.0.1 -- env BASEROCK_SYSTEM_CONFIG_SYNC=/tmp/tmp.Gy4zd5/systems/devel21Sept/orig/usr/bin/baserock-system-config-sync /tmp/tmp.Gy4zd5/systems/devel21Sept/orig/usr/bin/system-version-manager deploy /systems/devel21Sept/orig` failed ERROR: extensions/ssh-rsync.write failed with code 1: | 10:23 |
pedroalvarez | wow | 10:26 |
pedroalvarez | that error is not useful at all | 10:26 |
pedroalvarez | is there anything else in the log? | 10:26 |
*** franred has joined #baserock | 10:27 | |
cphang | Nope, there's an additional function traceback, but nothing else. | 10:30 |
pedroalvarez | cphang: you could try to disable the cleanup in extensions/ssh-rsync.write and try to run the failed command manually | 10:33 |
pedroalvarez | hoping that doing that will give you more logs | 10:33 |
cphang | pedroalvarez: Okay I'll give that a go thanks! | 10:35 |
pedroalvarez | let us know if you need more help/pointers | 10:44 |
pedroalvarez | with more logs I'll be more useful | 10:44 |
pedroalvarez | cphang: oh btw, you may have some info in /var/log/baserock-system-config-sync.log | 10:46 |
cphang | pedroalvarez: Okay I had a look I could maybe do with some pointers. Couldn't find anything in config-sync.log apart from whether files were sync'd or not. Is there a flag for me to write in ssh-rsync.write, or to put in when I use morph upgrade, or in the cluster morphology file? Thanks for your help! :) | 11:07 |
pedroalvarez | hum.. not sure if --debug will help here, I dobut it | 11:11 |
pedroalvarez | what instructions are you following? I'll try to reproduce | 11:13 |
cphang | Just the baserock quickstart guide. Initially used the cycle.sh script to upgrade, when I got the error message I tried to use the morph upgrade on it's own as I could see the build was successful. | 11:16 |
locallycompact | paulsherwood, necessary that contents be specified in order? could we just allow this? https://gitlab.com/baserock/definitions/builds/4278101 | 11:20 |
pedroalvarez | cphang: hmm. it worked for me http://paste.baserock.org/uturonizam | 11:23 |
pedroalvarez | we need to figure out why it's failing in your case, how do you feel about going with my suggestion and stop the cleanup after failure and try to run the failing command manually? | 11:24 |
paulsherwood | locallycompact: sadly, order is significant for current *system* definitions, because we have overlaps in systems (ie multiple chunks contain their own versions of a given file... so system ends up with the last one installed) | 11:26 |
locallycompact | alright | 11:26 |
paulsherwood | order is not significant for chunks, so long as the transitive dependencies are carried through | 11:27 |
paulsherwood | locallycompact: i would strongly prefer that order is not significant... | 11:27 |
cphang | Sure. I've noticed a discrepency between your and my upgrade log. I think it's cleaning up, and then trying to remove the mount point? | 11:27 |
cphang | http://paste.baserock.org/kiqalinosi | 11:27 |
paulsherwood | but that leads back to yesterday's discussion, where we warn on all of the overlaps but choosing not to build the system is useless for the user | 11:28 |
pedroalvarez | cphang: exactly | 11:28 |
pedroalvarez | cphang: is there anything useful after that? | 11:28 |
pedroalvarez | (after the error message, i mean) | 11:28 |
cphang | pedroalvarez: Nope same as before, so Upon failure I'll try and run the command? I'm just wondering if cleanup of the tmp/ folders before removal of the mount point could be the problem? It means I can't run the command afterwards manually too. Apologies if I'm missing something! | 11:33 |
*** jonathanmaw has joined #baserock | 11:34 | |
pedroalvarez | cphang: the cleanup is a consequence of a failure, otherwise there is nothing to clean up | 11:36 |
pedroalvarez | what I mean is that, removing tmp/folders is not in this case the cause of the failure | 11:37 |
*** dabukalam has joined #baserock | 11:37 | |
pedroalvarez | cphang: so, if you go to extensions/ssh-rsync.write, there you will find all the upgrades code | 11:38 |
pedroalvarez | if you comment out the line 83 and 84 you will disable the cleanup | 11:39 |
pedroalvarez | and if you comment out the line 72, you will disable the removal of mount point | 11:40 |
pedroalvarez | and 62 to disable the removal of the folder of the mount point | 11:41 |
cphang | pedroalvarez: Ahh okay sorry, I didn't realise. I thought from the log the failure point was at removing the mount point, rather than it was coming to the end of a clean-up procedure. I'll do as you say and get back to you! Thanks again for your help | 11:41 |
pedroalvarez | :) | 11:41 |
*** dabukalam has quit IRC | 11:46 | |
*** dabukalam_ has joined #baserock | 12:07 | |
*** dabukalam_ has quit IRC | 12:14 | |
*** dabukalam_ has joined #baserock | 12:18 | |
*** dabukalam_ has quit IRC | 12:26 | |
locallycompact | paulsherwood, I changed it so it writes out all build-depends explicitly and then sorts, now it succeeds at parsing and resolving b-ds but doesn't seem to be staging build-essential into core | 12:50 |
locallycompact | https://gitlab.com/baserock/definitions/builds/4282350 | 12:50 |
*** dabukalam has joined #baserock | 13:06 | |
*** dabukalam has quit IRC | 13:12 | |
*** gtristan has quit IRC | 13:12 | |
*** dabukalam has joined #baserock | 13:22 | |
*** lachlanmackenzie has quit IRC | 13:22 | |
*** dabukalam has quit IRC | 13:23 | |
*** lachlanmackenzie has joined #baserock | 13:40 | |
*** CTtpollard has quit IRC | 14:04 | |
*** CTtpollard has joined #baserock | 14:06 | |
cphang | pedroalvarez: Apologies for the delay, had some other problems to sort out. So it looks like it's failing at the system-version-manager because it's not there in the first place. Coincidentally, to get to this stage by commenting out the cleanup, if I try it once more it fails at an earlier stage, even if I restore the original ssh-rsync file | 14:32 |
cphang | http://paste.baserock.org/mibatanavo | 14:33 |
pedroalvarez | cphang: does the folder '/tmp/tmp.GPd9bl/systems/2016-09-21/orig/usr/bin' exist? | 14:34 |
pedroalvarez | in that log it looks like it's failing at the same point | 14:35 |
cphang | No, the tmp.GPd9bl folder is completely empty | 14:35 |
richard_maw | it's used as a mount point, rather than putting things in it | 14:36 |
pedroalvarez | so maybe you haven't disabled the code that does the umounting | 14:37 |
cphang | Right. I thought I did, but I'll try and reproduce it again. | 14:39 |
*** locallycompact has quit IRC | 14:45 | |
cphang | pedroalvarez: okay so keeping the folder mounted, systems contains a default, devel and factory folder, but devel is empty. | 14:54 |
cphang | So calling the system-version-manager also fails | 14:55 |
cphang | http://paste.baserock.org/ozacuwoler | 14:55 |
pedroalvarez | aha, "devel" is the VERSION_LABEL, yes | 14:56 |
pedroalvarez | hmm | 14:56 |
pedroalvarez | true, there are more cleanups to disable | 14:58 |
pedroalvarez | lines 103 and 104 in this case | 14:59 |
cphang | Ahh okay. | 15:00 |
pedroalvarez | sorry, missed that | 15:01 |
cphang | Not a problem, again, thanks for all the help! | 15:01 |
*** locallycompact has joined #baserock | 15:04 | |
cphang | pedroalvarez: Seems to be another case of broken paths, I disabled the clean up in L129 as well just in case but it gave the same message. | 15:13 |
cphang | http://paste.baserock.org/mugulemihe | 15:13 |
pedroalvarez | uh? /etc/grub.d/15_ostree ? | 15:22 |
pedroalvarez | sorry, didn't know that file existed | 15:22 |
richard_maw | well it's crashing because it doesn't | 15:23 |
pedroalvarez | i don't really understand what's going on there | 15:24 |
*** ctbruce has quit IRC | 15:26 | |
* richard_maw no longer knows, but it's failing in merge-config, which tries to do a three-way diff for the contents of /etc for the two snapshots | 15:26 | |
richard_maw | perhaps the logic there doesn't handle the file not existing in one version of it properly | 15:27 |
cphang | Well I'm following the quick-start instructions to the letter, so is it something funky with the kvm setup perhaps? | 15:28 |
pedroalvarez | maybe is something funky with our code | 15:28 |
pedroalvarez | cphang: I would really like to see your /var/log/baserock-system-config-sync.log | 15:29 |
pedroalvarez | is that possible? | 15:29 |
*** gtristan has joined #baserock | 15:30 | |
cphang | pedroalvarez: http://paste.baserock.org/iweboloneb | 15:32 |
pedroalvarez | hm.. something is removing the files.. ? | 15:39 |
pedroalvarez | oh | 15:42 |
* pedroalvarez checks one thing | 15:42 | |
locallycompact | here's an example of something that should be possible with the new spec https://gitlab.com/baserock/definitions/blob/7eb3ada06f6facd4e6ce79c50bf0d02201692560/systems/devel-system-x86_64-generic.morph | 15:45 |
pedroalvarez | cphang: do you have " /etc/grub.d/15_ostree" in your current system? | 15:48 |
paulsherwood | locallycompact: have you taken into account the build-mode stuff? | 15:51 |
paulsherwood | (maybe that's what's causing the missing build-essential) | 15:52 |
locallycompact | I'm just using ybd as is with a small hack to let include-mode through | 15:52 |
cphang | yes I do | 15:52 |
cphang | pedroalvarez: yes I do | 15:52 |
locallycompact | it has all these contents fields internally so I just tried it, gets surprisingly far | 15:53 |
locallycompact | but something wierd with staging | 15:53 |
paulsherwood | locallycompact: if you set log-verbose: True it may give you more clues | 15:54 |
pedroalvarez | eugh, it's a symlink.. | 15:54 |
locallycompact | hmm there's no ybd conf in upstream | 15:55 |
paulsherwood | put it in your definitions dir? | 15:56 |
locallycompact | yea | 15:56 |
paulsherwood | what is 'upstream' in your context | 15:56 |
locallycompact | gitlab.com/baserock/definitions | 15:56 |
paulsherwood | oh, yes | 15:57 |
*** dabukalam has joined #baserock | 15:59 | |
*** jonathanmaw has quit IRC | 16:02 | |
*** faybrocklebank has quit IRC | 16:07 | |
pedroalvarez | ok I've got a theory | 16:19 |
pedroalvarez | facts: factory has the symlink, and new version has the symlink too, but the contents of the file have changed | 16:20 |
pedroalvarez | no no, sorry, that's not it | 16:21 |
cphang | pedroalvarez: Just to let you know as well, there are various builds now on system-version-manager, but I think again due to broken links they're not removable. I had to give them different names, otherwise the upgrade would fail when mounting | 16:30 |
cphang | http://paste.baserock.org/upokewapij | 16:31 |
pedroalvarez | yeah, makes sense | 16:31 |
pedroalvarez | I haven't figured out what is going on | 16:31 |
cphang | Should I try setting up with virt-manager or virtualbox instead? I don't understand the difference in behaviour between your and mine's use case | 16:35 |
pedroalvarez | cphang: what are you using at the moment? | 16:36 |
pedroalvarez | please send me a link to the instructions you are following and I'll try to reproduce from scratch | 16:36 |
cphang | KVM, QEMU | 16:37 |
cphang | http://wiki.baserock.org/guides/no-frills/ | 16:37 |
cphang | http://wiki.baserock.org/guides/vm-setup/ setup with KVM, using fallocate for the second drive | 16:37 |
locallycompact | paulsherwood, https://gitlab.com/baserock/definitions/builds/4294181 | 16:38 |
locallycompact | 16-09-21 00:02:21 [12/309/309] [gdbm] Installing dependencies | 16:38 |
locallycompact | [] | 16:38 |
paulsherwood | locallycompact: presuming you can repeat locally, you could try import pdb ; pdb.set_trace() to look around at the point you're expecting build-depends to be populated | 16:50 |
locallycompact | need to clone everything but yeah | 16:51 |
paulsherwood | locallycompact: can avoid that by setting mode: no-build | 16:51 |
paulsherwood | that will fudge all the cache-keys, still run the assembly process | 16:51 |
paulsherwood | (but as empty artifacts) | 16:52 |
locallycompact | that seemed to run through | 16:53 |
paulsherwood | yes, but with empty build-depends, so put in the debug to catch at the right point | 16:53 |
*** tiagogomes has quit IRC | 17:46 | |
*** toscalix has quit IRC | 17:59 | |
*** lachlanmackenzie has quit IRC | 18:24 | |
*** gtristan has quit IRC | 18:27 | |
*** lachlanmackenzie has joined #baserock | 18:31 | |
*** rdale has quit IRC | 18:41 | |
*** locallycompact has quit IRC | 19:03 | |
*** mwilliams_ct has quit IRC | 21:07 | |
*** vgrade has quit IRC | 21:34 | |
*** vgrade has joined #baserock | 21:34 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!