| *** edcragg has quit IRC | 01:06 | |
| *** gtristan has quit IRC | 05:29 | |
| *** gtristan has joined #baserock | 05:40 | |
| *** toscalix has joined #baserock | 07:40 | |
| *** CTtpollard has joined #baserock | 08:01 | |
| *** edcragg has joined #baserock | 08:12 | |
| paulsherwood | 16-02-19 06:57:51 [372/447/447] [WebKitGtk] Elapsed time for build of WebKitGtk.eb8b1b427036d5bfa18f1e82b554f3310815a238638ad122c170219cad89b03c 05:40:34 | 08:47 |
|---|---|---|
| paulsherwood | need moar cpu :) | 08:47 |
| *** edcragg has quit IRC | 09:09 | |
| *** tiagogomes_ has joined #baserock | 09:13 | |
| pedroalvarez | paulsherwood: ow, how fast is the machine you used to get that elapsed time? | 09:15 |
| pedroalvarez | just asking because a 2vcpu VM is getting the same elapsed time (i believe, I'll double check) | 09:16 |
| rjek | WebKit doesn't so much need more CPU, but less code :) | 09:16 |
| pedroalvarez | 2016-02-06 02:44:57 Started building WebKitGtk on mason-x86-64:3434 | 09:17 |
| pedroalvarez | 2016-02-06 07:35:56 Progress: Transferring WebKitGtk-misc to shared artifact cache | 09:17 |
| pedroalvarez | 2016-02-06 07:37:12 Finished building WebKitGtk on mason-x86-64:3434 | 09:17 |
| paulsherwood | mwilliams_ct: ^^ ? | 09:20 |
| mwilliams_ct | I assume this is running on c.b.o? | 09:21 |
| * mwilliams_ct will check specs | 09:21 | |
| paulsherwood | yup | 09:21 |
| pedroalvarez | chiken bacon and onion | 09:21 |
| pedroalvarez | hmmm | 09:21 |
| * pedroalvarez goes for a breakfast | 09:21 | |
| pedroalvarez | and for a missing "c" in chicken | 09:22 |
| gtristan | pedroalvarez, I hope it's organic :D | 09:22 |
| * gtristan goes for supper | 09:22 | |
| pedroalvarez | gtristan: always! | 09:23 |
| mwilliams_ct | the workers for Concourse are m3.large EC2 instances, https://aws.amazon.com/ec2/instance-types/ has the specs. 2vcpu, 7.5GiB ram, 32GB ssd storage | 09:23 |
| mwilliams_ct | we could easily spin up bigger machines if needed, it's just a quick tweak to the bosh manifest (though obviously that incurs a higher cost so we should be sure it will help) | 09:24 |
| pedroalvarez | and I take that the workers have to use docker to run the instructions of the pipeline, correct? | 09:25 |
| *** ssam2 has joined #baserock | 09:26 | |
| *** ChanServ sets mode: +v ssam2 | 09:26 | |
| mwilliams_ct | pedroalvarez: yes, everything runs in containers (I feel so hipster typing that) | 09:27 |
| pedroalvarez | call them "cans" and you will be allright | 09:27 |
| *** gtristan has quit IRC | 09:28 | |
| *** edcragg has joined #baserock | 09:30 | |
| pedroalvarez | Btw, yesterday I found an interesting bug in git-review.. | 09:34 |
| pedroalvarez | I reported it upstream, but I doesn't look like they really use the bug-tracker | 09:34 |
| pedroalvarez | If you try to send for review a branch that is already in gerrit repo, it will say that "submitting the change would be pointless" | 09:37 |
| ssam2 | ah, yeah | 09:37 |
| ssam2 | i'm not sure if it's quite a bug | 09:38 |
| ssam2 | definitely annoying & confusing though | 09:38 |
| pedroalvarez | who will push branches to gerrit? nobody, but we push to the trove, that gets mirrored into gerrit | 09:38 |
| edcragg | submission is futile | 09:39 |
| ssam2 | maybe if you pass --track or give the name of a target branch then it works correctly? | 09:40 |
| ssam2 | if not, definitely seems like a bug | 09:40 |
| pedroalvarez | oh, thanks | 09:43 |
| pedroalvarez | will try to use that | 09:43 |
| paulsherwood | mwilliams_ct: it would definitely help. but will they spin DOWN again when not in use? | 09:43 |
| * paulsherwood gets irritated when we leave all the lights on for no good reason | 09:44 | |
| mwilliams_ct | paulsherwood: no | 09:44 |
| paulsherwood | well, that's a bug :) | 09:44 |
| mwilliams_ct | they don't automatically spin down, and I still havent found a way to do that in bosh | 09:44 |
| paulsherwood | => concourse, bosh, the world? :) | 09:44 |
| pedroalvarez | no results for concourse+elastic+agents :( | 09:47 |
| mwilliams_ct | https://github.com/nttlabs/bosh-scaler might work, I could look into it | 09:48 |
| *** jonathanmaw has joined #baserock | 09:48 | |
| tiagogomes_ | Is everyone happy but me that the submodules on the emailing list is not generic enough to handle projects with multiple sources that aren't submodules? | 09:52 |
| * paulsherwood can't believe we're the only people in the world that don't want to throw money away :) | 09:52 | |
| paulsherwood | tiagogomes_: i don't understand, sorry | 09:52 |
| ssam2 | tiagogomes_: I'm happy that we're making some progress, and I don't think Dan's proposal blocks any future proposal to make things more general | 09:53 |
| paulsherwood | if it works for all of the things we currently have in definitions, i'd say it's worth having. | 09:53 |
| pedroalvarez | tiagogomes_: I think I'm with you, but din't have time to think deep about it | 09:53 |
| pedroalvarez | (or deeply) | 09:53 |
| paulsherwood | we've suffered previously from attempting to solve all cases when real-world requirements are specific | 09:54 |
| pedroalvarez | i remember doing some "hacks" in some chunks, like commiting all the sources of another repo, to make it work | 09:55 |
| jjardon | ssam2: +1 | 09:55 |
| tiagogomes_ | ssam2 right, but I'd favor a final solution than an intermediate solution which will require to be reworked in the future. If we change something and later on rechange the same thing, it gives me the idea that we haven't got a plan and we don't know where we are heading | 09:56 |
| paulsherwood | tiagogomes_: i think you're wrong in that | 09:57 |
| paulsherwood | as follows: | 09:57 |
| paulsherwood | 1) perfect is the enemy of the good | 09:57 |
| paulsherwood | 2) small steps roughly in the right direction are better than no steps while we think a lot about big steps | 09:57 |
| paulsherwood | 3) definitions are yaml - we can automate migration for any future work | 09:58 |
| paulsherwood | 4) "No plan survives contact with the enemy." | 09:58 |
| paulsherwood | oh, and 'final solution' is an overloaded phrase, best not used in polite company :) | 09:59 |
| *** rdale has joined #baserock | 10:02 | |
| tiagogomes_ | 1) I didn't mention anything about perfection, but we should handle the case of multi-sources which aren't submodules. 2) Is a step that you will need to redo at some point 3) It will still introduce extra cognitive work in the user to understand definitions 4) No comments. | 10:02 |
| paulsherwood | 1) do we actually have any? | 10:02 |
| paulsherwood | 2) we typically end up redoing things anyway :) | 10:02 |
| paulsherwood | 3) agreed | 10:02 |
| paulsherwood | tiagogomes_: are there any current/known cases of 'multi-sources which aren't submodules' ? | 10:04 |
| paulsherwood | (in definitions) | 10:04 |
| pedroalvarez | for 1) I found one case. we copy in rabbitmq-codegen.morph the sources to DESTDIR to use them later in rabbitmq-server | 10:05 |
| pedroalvarez | for gcc we commited the sources to the repo directly I believe | 10:05 |
| paulsherwood | ok | 10:05 |
| tiagogomes_ | paulsherwood, GCC for example, which depends in some math libraries: http://git.baserock.org/cgi-bin/cgit.cgi/delta/gcc-tarball.git/commit/?h=baserock/build-essential&id=b3c9b176c1f10ebeff5700eb3760e9511f23fa06 | 10:05 |
| paulsherwood | do we have any actual fix in mind for this? | 10:06 |
| paulsherwood | maybe locallycompact could be persuaded to improve/extend his soln | 10:06 |
| pedroalvarez | tiagogomes_: what I don't understand is why the submodules solution won't handle this cases too | 10:07 |
| pedroalvarez | I mean, the migration script won't, but that doesn't stop us from using the new feature to put more sources in the staging area | 10:08 |
| richard_1aw | AIUI submodules would work, but that requires more local changes to get things working, when the usual workflow for gcc is bring these sets of components together externally | 10:08 |
| *** richard_1aw is now known as richard_maw | 10:09 | |
| *** gtristan has joined #baserock | 10:12 | |
| *** tiagogomes_ has quit IRC | 10:13 | |
| edcragg | i had a bsp which required a set of scripts from one repo to be used on the source from another repo, for that i copied stuff to /tmp in one chunk, and copied it back in the build for the later chunk. probably an isolated example, seemed like a bit of a hack at the time | 10:20 |
| *** tiagogomes_ has joined #baserock | 10:22 | |
| pedroalvarez | "a bit of a hack" :) | 10:22 |
| edcragg | :) | 10:23 |
| *** Lachlan1975 has joined #baserock | 10:25 | |
| tiagogomes_ | pedroalvarez, I haven't looked at the patches closely. But then it shouldn't be called submodules. Also is it possible to have multiple top levels? | 10:34 |
| *** locallycompact has joined #baserock | 10:34 | |
| paulsherwood | locallycompact: ^^ ? | 10:35 |
| locallycompact | paulsherwood, ^^ to you too. | 10:35 |
| * locallycompact assumes there's context | 10:35 | |
| paulsherwood | locallycompact: https://irclogs.baserock.org/%23baserock.2016-02-19.log.html#t2016-02-19T09:52:24 | 10:36 |
| * edcragg can't see tiagogomes_'s last comment at the end of that log | 10:40 | |
| *** Lachlan1975 has quit IRC | 10:40 | |
| edcragg | seems to be there now | 10:40 |
| locallycompact | to be clear, this is *only* submodules, you can't use this for the gcc thing. It's translating submodules it finds in .gitmodules using the key values in definitions. | 10:42 |
| paulsherwood | edcragg: logging takes time ;) | 10:43 |
| pedroalvarez | that's the migration script, of course | 10:43 |
| locallycompact | pedroalvarez, no, that's the behaviour of ybd | 10:43 |
| pedroalvarez | oh, ok | 10:43 |
| locallycompact | if you add submodules to a project that doesn't have any it doesn't do anything | 10:44 |
| pedroalvarez | oh well | 10:44 |
| pedroalvarez | anyway, I'm not going to block this | 10:44 |
| pedroalvarez | looks useful to me | 10:44 |
| locallycompact | the gcc thing is quite out of my way. This change is so I can lorry things that have submodules and not have to worry about branching every time | 10:44 |
| paulsherwood | and +1 for this change, from me :) | 10:45 |
| ssam2 | I would prefer +1s and -1s on the mailing list | 10:46 |
| locallycompact | how do I clone the baserock wiki | 10:47 |
| locallycompact | nvm got it | 10:48 |
| paulsherwood | ssam2: done | 10:52 |
| edcragg | tiagogomes_: by multiple top levels, did you mean multiple clones per chunk by any chance? | 10:55 |
| *** Lachlan1975 has joined #baserock | 10:55 | |
| ssam2 | paulsherwood: thanks. I take it you implicitly support the proposal itself? | 10:56 |
| ssam2 | I would like us to consider the actual proposal as well as the code. Since the definitions format should exist independently of any tool's codebase | 10:56 |
| paulsherwood | yes, i do. i'm worried if this will break for morph users, though | 10:56 |
| ssam2 | it will if we migrate master of the reference systems to definitions version 8 before Morph can understand version 8 | 10:57 |
| tiagogomes_ | edcragg yes, something like this http://paste.baserock.org/cikakacihi | 10:57 |
| edcragg | tiagogomes_: exactly what i was thinking, i think something like that could be useful | 10:58 |
| locallycompact | If we migrate any actual versions of things that have submodules then it will break for morph, those changes by itself won't cause morph to fail iiuc | 10:59 |
| locallycompact | ? | 10:59 |
| ssam2 | what do you mean by "those changes" ? | 11:00 |
| locallycompact | my series | 11:00 |
| ssam2 | patch 2/2 would break Morph | 11:01 |
| locallycompact | how so? | 11:02 |
| paulsherwood | have we tried it? | 11:02 |
| ssam2 | ok, I haven't tried it | 11:02 |
| ssam2 | I will do | 11:02 |
| ssam2 | but it will say that it doesn't support definitions version | 11:02 |
| ssam2 | 8 | 11:02 |
| ssam2 | correctly | 11:02 |
| locallycompact | Oh right | 11:02 |
| locallycompact | gotcha | 11:02 |
| ssam2 | ideally we'd hold off on that part, and someone will soon add support for Morph to definitions v8 | 11:03 |
| ssam2 | if nobody does within a reasonable time then, I don't know, maybe Morph is dead | 11:04 |
| ssam2 | that would be a shame though, not just because it has useful features YBD lacks, but also because having 2 implementations of the definitions format catches a lot of problems | 11:07 |
| *** dabukalam has joined #baserock | 11:12 | |
| paulsherwood | ack | 11:18 |
| locallycompact | I think I successfully pushed to gerrit | 11:38 |
| locallycompact | Just the first part reformatted + the schema | 11:38 |
| paulsherwood | locallycompact: you've included fix to json-schema stratum was that intentional? | 11:40 |
| locallycompact | I believe that was what ssam2 asked for on list | 11:40 |
| paulsherwood | ok | 11:44 |
| paulsherwood | let's see if he's +1 too :) | 11:44 |
| jjardon | paulsherwood: sorry, forgot to tell, the fix is available here: https://gerrit.baserock.org/#/c/1867/ | 12:12 |
| jjardon | richard_maw: ok to remove your -1 in https://gerrit.baserock.org/#/c/1861/ ? | 12:20 |
| ssam2 | git.baserock.org will be down for a few minutes | 12:38 |
| ssam2 | ok, it's back and with added syntax highlighting :-) | 12:40 |
| locallycompact | it's doing a strange with the page links | 12:41 |
| ssam2 | what's wrong? | 12:42 |
| locallycompact | you don't see that? | 12:42 |
| locallycompact | sec i"ll screenshot it | 12:42 |
| locallycompact | http://i.imgur.com/yEhZtX3.png | 12:43 |
| ssam2 | oh, I see that | 12:43 |
| ssam2 | thanks | 12:44 |
| ssam2 | maybe a cgit bug | 12:44 |
| richard_maw | jjardon: better than that, I'll +2 | 12:52 |
| jjardon | richard_maw: thanks! :) | 12:53 |
| ssam2 | weird... /var/www/htdocs/cgit/cgit.css on git.baserock.org doesn't match the CSS file it's actually serving | 12:54 |
| ssam2 | hence the <li> elements are lacking the style that makes them all appear on the same line | 12:54 |
| ssam2 | restarting lighttpd-git.service has fixed it | 12:55 |
| ssam2 | I guess the lighttpd-git systemd service is missing a dependency on local-fs.target | 12:56 |
| pedroalvarez | phew | 12:57 |
| pedroalvarez | I was looking at the trove I did the testing on | 12:57 |
| pedroalvarez | it was ok in there | 12:57 |
| *** gtristan has quit IRC | 13:27 | |
| *** gtristan has joined #baserock | 13:36 | |
| jjardon | ssam2: pedroalvarez we are missing commits: gerrit said they are merged but it doesnt appear in git.baserock.org | 14:33 |
| jjardon | (python3-core patch for example) | 14:33 |
| ssam2 | ah, ok | 14:58 |
| ssam2 | thanks for spotting it | 14:58 |
| ssam2 | seems the commits are in gerrit's master branch but weren't replicated to git.baserock.org yet | 15:01 |
| jjardon | also, I m not sure im getting email notifications from gerrit anymore? | 15:03 |
| ssam2 | i am | 15:04 |
| paulsherwood | jjardon: i'm trusting you on https://gerrit.baserock.org/#/c/1867/ :) | 15:08 |
| ssam2 | gerrit-replication seems totally wedged, I'm going to try restarting gerrit, which takes a few minutes | 15:11 |
| jjardon | ssam2: too many patches? :) | 15:12 |
| jjardon | ssam2: or maybe we should stop mirroring to g.b.o and activate cgit in gerrit? | 15:16 |
| ssam2 | seems the ssh host keys for git.baserock.org have changed, which is a bit broken since I did an upgrade | 15:16 |
| ssam2 | well, not too difficult to change them back | 15:17 |
| pedroalvarez | paulsherwood: http://paste.baserock.org/ukelagogub | 15:21 |
| pedroalvarez | looks weird that ybd honours upgrade-type but not upgrade-location | 15:21 |
| paulsherwood | https://github.com/devcurmudgeon/ybd/blob/master/ybd/deployment.py#L64 | 15:24 |
| paulsherwood | so in theory it should | 15:25 |
| paulsherwood | i wonder what parent_location is | 15:26 |
| paulsherwood | SotK: ??? | 15:26 |
| richard_maw | paulsherwood: assuming it's got the same meaning as in morph, that's the location of the deployment it's a subdeployment of, so you can have a deployment deploy a file inside another deployment | 15:27 |
| richard_maw | e.g. making an initramfs | 15:27 |
| paulsherwood | ack | 15:28 |
| SotK | richard_maw is correct as far as I remember | 15:30 |
| gary_perkins | Hi! I have a ybd issue: I'm trying to perform an update to a trove. The update complained about no VERSION_LABEL, so I supplied "trove.VERSION_LABEL=2016-02-19" on the cmd line. ybd didn't like that, so I added VERSION_LABEL: 2016-02-19 to the cluster file, then... http://paste.baserock.org/oyehufipoq :( | 15:31 |
| gary_perkins | Has anyone had that before? | 15:31 |
| paulsherwood | gary_perkins: put quotes around it, please | 15:32 |
| paulsherwood | looks like python is converting that to a date | 15:33 |
| gary_perkins | paulsherwood: ahh! | 15:33 |
| paulsherwood | or use a jrandom string. it's a bug, though | 15:33 |
| pedroalvarez | paulsherwood: regarding upgrade-location, the line triggering the previous error is https://github.com/devcurmudgeon/ybd/blob/master/ybd/sandbox.py#L211 | 15:34 |
| gary_perkins | paulsherwood: thanks, it appears to be proceeding now :) | 15:34 |
| paulsherwood | pedroalvarez: yup, hence i was desperately clutching at SotK's ankles | 15:36 |
| * paulsherwood has never fully understood deployment | 15:36 | |
| paulsherwood | pedroalvarez: could you put in 'import pdb; pdb.set_trace()' at line 69 of deployment.py and see what things are being set to? | 15:39 |
| paulsherwood | nm, i'll have a play over the weekend | 15:46 |
| *** CTtpollard has quit IRC | 16:03 | |
| pedroalvarez | yeah better, because it wasn't happening to me :/ | 16:11 |
| *** brlogger has joined #baserock | 16:25 | |
| ssam2 | testing ircslogs | 16:25 |
| pedroalvarez | :D | 16:33 |
| gary_perkins | ok, the updated trove is booting into single-user-mode without nary an explaination as to why. The only error message I can see is about /etc/init.d/rcS not existing. But other troves don't have that file either! | 16:34 |
| gary_perkins | the journal has no entries either :( | 16:35 |
| gary_perkins | anyone had this before? | 16:35 |
| pedroalvarez | odd | 16:36 |
| pedroalvarez | I have never seen that error | 16:36 |
| radiofree | :/ | 16:36 |
| gary_perkins | looks like I'll have to revert back to the older configuration for now | 16:37 |
| pedroalvarez | I hope you can do that | 16:37 |
| ssam2 | fwiw, i've deployed two working troves from master of the reference system definitions.git | 16:37 |
| ssam2 | well, from infrastructure.git having merged master of definitions.git | 16:37 |
| * gary_perkins selects "factory" | 16:37 | |
| gary_perkins | it boots | 16:38 |
| ssam2 | i might be able to have a look in a bit, just need to get backups working again | 16:38 |
| radiofree | hasn't it been upgraded since initial deployment? | 16:38 |
| gary_perkins | ssam2: yeah, no worries, ta | 16:38 |
| pedroalvarez | radiofree: nope, first upgrade AFAIK | 16:38 |
| * gary_perkins nods | 16:38 | |
| ssam2 | s/deployed/upgraded/ in my comment | 16:39 |
| radiofree | /etc/init.d/rcS doesn't sound very systemdey | 16:41 |
| radiofree | also isn't there some issue in baserock where the journal doesn't give you anything? | 16:44 |
| radiofree | something to do with /var/run... or /run/var... | 16:44 |
| ssam2 | oh yeah, journal can be broken because /var is a subvolume | 16:45 |
| radiofree | that probably should be fixed... | 16:46 |
| richard_maw | it's fixable by making / (and hence /var) read-only at boot-time, so systemd spools its logs in /run until /var has been mounted properly | 16:48 |
| richard_maw | (note, Lennart wants to replace this logic with requiring the initramfs mount /var, but he's getting no traction) | 16:48 |
| radiofree | what's the default "storage" behaviour? | 16:49 |
| radiofree | shouldn't "persistent" fallback to /run/? | 16:49 |
| radiofree | ah sorry, that, misread your comment | 16:51 |
| ssam2 | all baserock.org infra should be up to date now, if you see anything wrong, please let me know | 17:00 |
| jjardon | \o/ | 17:01 |
| paulsherwood | w00t | 17:14 |
| *** franred has quit IRC | 17:43 | |
| *** ssam2 has quit IRC | 17:43 | |
| *** jonathanmaw has quit IRC | 17:43 | |
| *** tiagogomes_ has quit IRC | 17:54 | |
| *** rdale has quit IRC | 17:54 | |
| pedroalvarez | uhm,,,, | 18:02 |
| * pedroalvarez continues investigaing "raise RuntimeError("generator didn't stop")" error in --quiet mode | 18:03 | |
| pedroalvarez | so.. if a context manager has the yield in a loop, it becomes a generator.. right? | 18:07 |
| pedroalvarez | oh well... I don't understand why it fails in openstack.write and it doesn't in rawdisk.write | 18:12 |
| richard_maw | no, it becomes a faulty context manager | 18:12 |
| pedroalvarez | that's good to know | 18:12 |
| pedroalvarez | then maybe find_and_mount is one of those | 18:12 |
| richard_maw | context managers *must* only yield *once* | 18:12 |
| pedroalvarez | *find_and_mount_rootfs | 18:13 |
| *** edcragg has quit IRC | 18:13 | |
| pedroalvarez | thanks for the hint richard_maw | 18:17 |
| pedroalvarez | found the problem and "the solution" | 18:17 |
| pedroalvarez | http://paste.baserock.org/uyizupawoc.diff | 18:17 |
| pedroalvarez | I'll look into a nicer one when I have some time | 18:17 |
| richard_maw | +2 | 18:20 |
| *** bfletcher has quit IRC | 18:25 | |
| *** bjdooks has quit IRC | 18:25 | |
| *** cyndis has quit IRC | 18:25 | |
| *** JPohlmann has quit IRC | 18:25 | |
| *** mwilliams_ct has quit IRC | 18:25 | |
| *** JPohlmann has joined #baserock | 18:25 | |
| *** JPohlmann has joined #baserock | 18:25 | |
| *** bjdooks has joined #baserock | 18:25 | |
| *** mwilliams_ct has joined #baserock | 18:25 | |
| *** cyndis has joined #baserock | 18:25 | |
| *** rjek has quit IRC | 18:27 | |
| *** rjek has joined #baserock | 18:28 | |
| *** toscalix has quit IRC | 18:28 | |
| *** rjek has quit IRC | 18:31 | |
| *** rjek has joined #baserock | 18:31 | |
| *** locallycompact has quit IRC | 18:31 | |
| *** Lachlan1975 has quit IRC | 19:20 | |
| *** bfletcher has joined #baserock | 19:28 | |
| *** locallycompact has joined #baserock | 20:00 | |
| *** locallycompact has quit IRC | 21:57 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
