| *** inara [~inara@192.241.198.49] has quit [Ping timeout: 245 seconds] | 05:06 | |
| *** pedroalvarez [~quassel@ec2-54-191-112-126.us-west-2.compute.amazonaws.com] has quit [Quit: No Ping reply in 180 seconds.] | 05:06 | |
| *** pedroalvarez [~quassel@ec2-54-191-112-126.us-west-2.compute.amazonaws.com] has joined #baserock | 05:06 | |
| Mode #baserock +v pedroalvarez by ChanServ | 05:06 | |
| Mode #baserock +nt by sendak.freenode.net | 05:06 | |
| *** inara [~inara@192.241.198.49] has joined #baserock | 05:07 | |
| *** Kinnison [~dsilvers@gateway/shell/pepperfish/x-nstjdhyeqtnmozbx] has quit [Ping timeout: 258 seconds] | 05:46 | |
| *** Kinnison [~dsilvers@gateway/shell/pepperfish/x-jvfjkxmehqmxbxuk] has joined #baserock | 05:46 | |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has joined #baserock | 06:08 | |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has quit [Quit: petefoth] | 06:28 | |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has joined #baserock | 07:23 | |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has quit [Quit: petefoth] | 07:40 | |
| *** mike [~mike@82-70-136-246.dsl.in-addr.zen.co.uk] has joined #baserock | 07:41 | |
| mike is now known as Guest55362 | 07:42 | |
| *** bashrc [~motters@82-70-136-246.dsl.in-addr.zen.co.uk] has joined #baserock | 09:01 | |
| *** mariaderidder [~maria@82-70-136-246.dsl.in-addr.zen.co.uk] has joined #baserock | 09:03 | |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has joined #baserock | 09:32 | |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has quit [Quit: petefoth] | 09:41 | |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has joined #baserock | 09:51 | |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has quit [] | 09:55 | |
| radiofree | mason-arm still red :\ | 09:55 |
|---|---|---|
| persia | Why does it keep retrying the same CHA1? | 10:04 |
| persia | In any case, needs someone to investigate why glib can't be updated. Does anyone know if that can be done remotely, or does it require someone from the operations team? | 10:06 |
| persia | Looking at the log, it seems we ever cache the "SHA1_PREV": does this just not get compared to SHA1? | 10:07 |
| * radiofree has no idea how any of the mason stuff works | 10:16 | |
| radiofree | git clone git://cache.baserock.org/delta/glib works on my machine though | 10:17 |
| persia | Hmm. Probably needs operations then :( | 10:18 |
| radiofree | i think everyone is on holiday now | 10:19 |
| persia | Does mason being red affect anything other than mason? | 10:21 |
| radiofree | i don't think so | 10:21 |
| persia | Well, we can hope someone from operations fixes it, but if it doesn't affect anything, I'm not that worried. | 10:22 |
| persia | (well, I am, but more about how we got into this state, and what not being able to clone git implies about the reliability of git transport,than about mason being down) | 10:22 |
| radiofree | it's impossible to debug without better logs | 10:23 |
| radiofree | or access to the machine | 10:23 |
| petefoth2 | DavePage was visible (having a lonely standup) in #sysadmin a while back | 10:28 |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has joined #baserock | 10:29 | |
| *** benbrown_ [~benbrown@access.ducie-dc1.codethink.co.uk] has quit [Ping timeout: 240 seconds] | 11:00 | |
| *** benbrown_ [~benbrown@access.ducie-dc1.codethink.co.uk] has joined #baserock | 11:01 | |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has quit [Quit: petefoth] | 11:02 | |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has joined #baserock | 11:03 | |
| *** DavePage [~dpage@access.ducie-dc1.codethink.co.uk] has joined #baserock | 11:08 | |
| *** rdale [~quassel@102.red-80-26-167.adsl.dynamic.ccgg.telefonica.net] has joined #baserock | 12:11 | |
| *** cosm_ [~Unknown@host-78-148-235-178.as13285.net] has quit [Remote host closed the connection] | 12:15 | |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has quit [] | 12:23 | |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has joined #baserock | 12:40 | |
| pedroalvarez | ok, my debugging foo is finally getting some logs (at least...) | 12:52 |
| pedroalvarez | http://paste.baserock.org/jafabimomo | 12:52 |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has quit [Quit: petefoth] | 13:03 | |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has joined #baserock | 13:05 | |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has quit [] | 13:05 | |
| radiofree | Can you manually clone from cache.be.org? | 13:09 |
| pedroalvarez | yes | 13:11 |
| pedroalvarez | from the same machine and from different machines | 13:11 |
| persia | Do you have access to the logs from the machine that is resetting the connection? | 13:13 |
| pedroalvarez | I guess that is the git server (cache.baserock.org) | 13:14 |
| pedroalvarez | I was actually doing that. Try to connect to it and get logs | 13:15 |
| pedroalvarez | <pedroalvarez> I'm tempted to blame cache.baserock.org, which is the git server that mason-arm/distbuild-arm is using | 13:16 |
| pedroalvarez | :) | 13:16 |
| pedroalvarez | and here it is: http://paste.baserock.org/uhojerahos | 13:20 |
| pedroalvarez | this is what the journalctl shows everythime I run the git command in the previous paste | 13:20 |
| persia | Might be worth expanding that, but I don't understand why a loose object would cause that. | 13:23 |
| persia | Are there useful logs for the lorry attempts to update that repo? | 13:24 |
| pedroalvarez | that would be also interesting to debug | 13:38 |
| pedroalvarez | and indeed, it's failing to lorry, but groff and glib aren't, so I wonder if these are 2 problems instead of one | 13:41 |
| persia | I thought glib was the problem. | 13:42 |
| persia | Ah, lzo, hrm. | 13:42 |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has joined #baserock | 13:43 | |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has quit [Client Quit] | 13:45 | |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has joined #baserock | 13:47 | |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has quit [Quit: petefoth] | 13:54 | |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has joined #baserock | 13:58 | |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has quit [Ping timeout: 240 seconds] | 14:03 | |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has joined #baserock | 14:05 | |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has quit [Quit: petefoth] | 14:42 | |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has joined #baserock | 14:43 | |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has quit [Quit: petefoth] | 15:46 | |
| * pedroalvarez decides to switch to git.baserock.org. | 15:48 | |
| radiofree | won't that push temporary build branches? | 15:49 |
| pedroalvarez | when building things that are not present in g.b.o | 15:50 |
| pedroalvarez | mason only builds master, and also it doesn't have push access | 15:50 |
| radiofree | ah, cool | 15:54 |
| jmacs | Hmm, looks like a kernel panic in btrfs | 16:12 |
| persia | pedroalvarez: Does anything else have access to the distbuild cluster you are adjusting? | 16:17 |
| radiofree | no systemd cache from master :\ | 16:18 |
| *** mariaderidder [~maria@82-70-136-246.dsl.in-addr.zen.co.uk] has quit [Quit: Ex-Chat] | 16:34 | |
| *** bashrc [~motters@82-70-136-246.dsl.in-addr.zen.co.uk] has quit [Quit: Lost terminal] | 17:44 | |
| *** wdutch [~william@host-92-25-77-176.as13285.net] has joined #baserock | 18:34 | |
| pedroalvarez | radiofree: for arm or for x86? | 18:35 |
| pedroalvarez | radiofree: systemd for arm was being built when you said that there wasn't cache for it | 18:36 |
| *** Guest55362 [~mike@82-70-136-246.dsl.in-addr.zen.co.uk] has quit [Quit: Leaving] | 18:40 | |
| pedroalvarez | persia: I've tried to figure out the details of accessibility of this distbuild network, but the connection from spain to Datacentred is being really sloy today | 18:41 |
| *** wdutch [~william@host-92-25-77-176.as13285.net] has quit [Quit: Quit] | 19:26 | |
| persia | pedroalvarez: Heh, thanks for looking. My thought is only that if there is still unauthenticated access permitted to that distbuild network, it could cause commits to land at git.baserock.org, which commits we would not want to maintain. | 19:48 |
| persia | Given that they all appear in extra temporary branches, we could use low-level git commands to cause them not to exist, but this may involve a repack, which is bandwidth-expensive for anyone mirroring g.b.o repos. | 19:49 |
| *** petefoth [~petefoth@host-92-25-64-58.as13285.net] has joined #baserock | 21:41 | |
| *** rdale [~quassel@102.red-80-26-167.adsl.dynamic.ccgg.telefonica.net] has quit [Ping timeout: 240 seconds] | 23:29 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!