| *** zoli__ has joined #baserock | 03:40 | |
| *** zoli__ has quit IRC | 04:09 | |
| *** zoli__ has joined #baserock | 04:20 | |
| *** petefoth has joined #baserock | 05:39 | |
| *** zoli__ has quit IRC | 06:23 | |
| *** rdale has quit IRC | 07:04 | |
| *** zoli__ has joined #baserock | 07:06 | |
| *** zoli___ has joined #baserock | 07:08 | |
| *** zoli__ has quit IRC | 07:08 | |
| *** a1exhughe5 has joined #baserock | 07:22 | |
| *** mariaderidder has joined #baserock | 07:46 | |
| *** fay_ has joined #baserock | 07:53 | |
| *** bashrc_ has joined #baserock | 08:02 | |
| *** ssam2 has joined #baserock | 08:05 | |
| *** ChanServ sets mode: +v ssam2 | 08:05 | |
| * pedroalvarez thinks the performance of Mason is not acceptable | 08:07 | |
| pedroalvarez | It used to be | 08:07 |
|---|---|---|
| rjek | pedroalvarez: In what way? | 08:08 |
| pedroalvarez | It seems too slow to me | 08:08 |
| *** jonathanmaw has joined #baserock | 08:10 | |
| rjek | pedroalvarez: What is too slow? The builds? | 08:11 |
| * rjek has noticed it taking longer and longer to build Baserock on the few recent occations he's done it | 08:11 | |
| rjek | perhaps we need finer-grained strata to allow for more parallelisation. | 08:12 |
| SotK | how many workers does its distbuild network have? | 08:12 |
| SotK | if it only has one, then there will be no parallelisation at all | 08:12 |
| rjek | In that case, slowness would not be mason's fault :) | 08:14 |
| rjek | Or it would be mason's fault, depending on how you look at it. | 08:14 |
| rjek | Ideally for CI you want answers in minutes | 08:15 |
| pedroalvarez | rjek: the builds | 08:15 |
| pedroalvarez | I'm just saying that a local build in my devel machine would take less. | 08:15 |
| SotK | looking at the log, it only seems to be using one worker even if it has more than one | 08:16 |
| pedroalvarez | i might have more ram and cpu though | 08:16 |
| ssam2 | jmac had a devel system in this cloud recently and decided that a VM in his laptop was much faster | 08:16 |
| pedroalvarez | it only has one worker, so that's fine | 08:16 |
| rjek | pedroalvarez: Enterprise™ Cloud™ in being slow unshocker :) | 08:16 |
| ssam2 | it only has one worker | 08:16 |
| rjek | ISTR the IO being pretty poor there. | 08:16 |
| SotK | how much ram and cpu does it have? | 08:18 |
| *** rdale has joined #baserock | 08:18 | |
| ssam2 | 2GB ram, 2 VCPUs | 08:18 |
| SotK | I guess that explains why builds are faster on people's devel machines too then | 08:19 |
| rjek | That seems surprisingly puny. | 08:19 |
| rjek | Timing buffered disk reads: 36 MB in 3.10 seconds = 11.61 MB/sec | 08:20 |
| rjek | That won't be helping, either. | 08:20 |
| tlsa | mason used to build 1 system, now it builds 4. Also more stuff has been added to the systems. I think that's why its got slower | 08:25 |
| radiofree | how long is it taking to build a devel system these days | 08:26 |
| tlsa | radiofree: it builds all 4 at once, I think so you can't tell. Also it depends on how much is reusable from the last build | 08:27 |
| tlsa | also, it always took longer than a local build because of the devel system test. Dunno if it still does that, but it used to deploy the devel system after it built, and then get the deployed devel system to do a build | 08:29 |
| *** gary_perkins has joined #baserock | 08:31 | |
| pedroalvarez | no, sadly mason in baserock.org has never done the devel system test | 08:31 |
| tlsa | oh, right | 08:32 |
| perryl | argh...i kept testing a distbuild and wondering why it wasn't catching an error i'd purposely thrown in; then i realise /usr/bin/morph isn't set to use the version i'm working on...i need more coffee | 09:04 |
| pedroalvarez | :) | 09:05 |
| pedroalvarez | perryl: I've been testing distbuild recently using `scripts/run-distbuild` | 09:06 |
| pedroalvarez | I do recommend it | 09:06 |
| perryl | :D i'm using it myself, it's very handy! | 09:06 |
| pedroalvarez | it is | 09:07 |
| perryl | or...i was using it, now that i've changed morph to use my working version i keep getting a "permission denied" error when i try and run it :( | 09:07 |
| perryl | maybe if i also remember to set permissions for my new morph to executable it might :) | 09:08 |
| SotK | perryl: don't forget to do the same for /usr/bin/distbuild-helper :) | 09:09 |
| perryl | SotK: set permissions? | 09:11 |
| *** edcragg has joined #baserock | 09:11 | |
| * perryl debates going back to bed and starting the day over again | 09:11 | |
| SotK | set permissions and make it use the version you're working on | 09:12 |
| perryl | cool! i hadn't thought to change that one :) | 09:12 |
| * SotK has lost too much time forgetting that one in the past :) | 09:15 | |
| *** lachlanmackenzie has joined #baserock | 09:22 | |
| *** a1ex has joined #baserock | 10:02 | |
| *** a1exhughe5 has quit IRC | 10:06 | |
| *** zoli___ has quit IRC | 10:48 | |
| *** pacon has joined #baserock | 10:56 | |
| perryl | hmm, it appears that in order to create a database via sqlite3.connect you need to first create the directory that the database resides in | 10:59 |
| rjek | That wouldn't surprise me; SQLite's written mostly in ANSI C, which is directory-ignorant. | 10:59 |
| perryl | i wouldn't have considered it except the python docs mentioned sqlite3.connect('example.db') without a path, which got me thinking | 11:00 |
| rjek | ah :) | 11:00 |
| rjek | sqlite probably passes that string directly to fopen() | 11:01 |
| perryl | bit annoying that there's no given error message for that case; it just hangs indefinitely :( | 11:04 |
| * perryl wonders if python debugger may have helped her solve this quicker | 11:04 | |
| rjek | Is there a mkdir -p function in Python's stdlib you could call before hand? | 11:04 |
| perryl | there's os.mkdir but i don't know if it allows multilevel directory creation | 11:06 |
| perryl | it'd be good if there was, rather than a million "if os.path.exists(..........)" checks | 11:07 |
| CTtpollard | perryl: os.makedirs? | 11:08 |
| perryl | CTtpollard: just seen that, i'll give it a run through! :) | 11:09 |
| paulsher1ood | http://stackoverflow.com/questions/600268/mkdir-p-functionality-in-python | 11:10 |
| *** zoli__ has joined #baserock | 11:13 | |
| perryl | whoo, that works! thanks all! | 11:15 |
| *** a1ex has quit IRC | 11:19 | |
| *** a1exhughe5 has joined #baserock | 11:22 | |
| *** pacon has quit IRC | 12:18 | |
| ssam2 | it turns out CloudFoundry is pretty cool. it's like a free software version of Heroku | 12:22 |
| ssam2 | i managed to set up Etherpad-lite on Pivotal's private Cloud Foundry thing in less than half an hour | 12:23 |
| ssam2 | https://etherpad-lite-samthursfield.cfapps.io/p/hello | 12:23 |
| ssam2 | the downside is it's a 60 free trial only. but the upside is that perhaps in 60 days we can have figured out how to set up our own Cloud Foundry ;) | 12:24 |
| ssam2 | *60 day free trial | 12:25 |
| paulsher1ood | ssam2: w00t! next step, running on Baserock? :) | 12:48 |
| *** paulsher1ood is now known as paulsherwood | 13:46 | |
| paulsherwood | pedroalvarez: in terms of hardware, what do folks need at a minimum to try out a baserock openstack deployment? | 14:16 |
| pedroalvarez | 6G ram, a couple of cores, and you will be able to instanciate a vm with 512M of ram | 14:17 |
| rjek | ! | 14:18 |
| pedroalvarez | more VMs == more resources | 14:18 |
| rjek | pedroalvarez: Surely you can't be saying the OpenStack overhead is 5.5GB? | 14:18 |
| pedroalvarez | no, I think that 3G *might* be enough.. but I believe it starts crasing if you open horizon | 14:19 |
| paulsherwood | pedroalvarez: what if i wanted a cluster? can one machine do that? | 14:19 |
| * paulsherwood notices that the only machine he can get onto with enough memory may be a Moonshot... | 14:20 | |
| richard_maw | paulsherwood: by my understanding of the definition of cluster, you can't by definition. | 14:20 |
| paulsherwood | richard_maw: you may be right :) | 14:20 |
| pedroalvarez | paulsherwood: are you interested on testing openstack deployments? | 14:22 |
| pedroalvarez | I might have some hardware you can borrow | 14:22 |
| paulsherwood | pedroalvarez: yup! | 14:36 |
| pedroalvarez | paulsherwood: any experience deploying to kvm? | 14:41 |
| paulsherwood | how hard can it be, really? :) | 14:53 |
| pedroalvarez | well, deploying is easy, but I don't know how hard is going to be to see the kvm host for a mac user | 14:55 |
| pedroalvarez | paulsherwood: you can follow this video, and I can grant you access to the same machine I was using for deployments https://vimeo.com/130422225 | 14:56 |
| paulsherwood | ok, cool! i'd like to try it the ybd way if possible :) | 14:58 |
| *** a1exhughe5 has quit IRC | 15:43 | |
| rdale | master seems to have gone from binutils-redhat to binutils-tarball, which is a step backwards | 15:48 |
| rdale | ^is a^seems to be | 15:48 |
| * paulsherwood wonders what was the reason for that change? | 15:48 | |
| pedroalvarez | rdale: why? | 15:48 |
| rdale | there's no git history and only one version | 15:49 |
| pedroalvarez | the reason for that change was that we were building binnutils from a git repo, but with all the contents of a tarball commited | 15:49 |
| pedroalvarez | now is clearer that we are using a tarball | 15:49 |
| paulsherwood | so it's the same thing? | 15:49 |
| rdale | ah i see | 15:49 |
| paulsherwood | we need at some point to make lorry deal with shallow clones | 15:49 |
| paulsherwood | is there a story for that already? would be nice to be able to drop these several tarball things | 15:50 |
| pedroalvarez | paulsherwood: maybe, but this time, using a tarball is not related to the size of the git repo | 15:50 |
| paulsherwood | oh, really? why then? | 15:53 |
| Kinnison | because some projects have a large delta between a release tag and a dist tarball | 15:54 |
| *** zoli__ has quit IRC | 15:54 | |
| pedroalvarez | the main reason to use tarballs in build essential is that they need many dependencies to build from git that are not present when building build essential chunks | 15:55 |
| pedroalvarez | (correct me if I'm wrong) | 15:56 |
| tiagogomes_ | you are not wrong | 15:57 |
| rdale | ah i see - seems a bit like the language bootstrapping issues discussed yesterday | 16:01 |
| *** mariaderidder has quit IRC | 16:28 | |
| *** jonathanmaw has quit IRC | 16:36 | |
| *** ssam2 has quit IRC | 16:59 | |
| *** bashrc_ has quit IRC | 17:02 | |
| *** edcragg has quit IRC | 17:05 | |
| *** zoli__ has joined #baserock | 17:55 | |
| *** lachlanmackenzie has quit IRC | 18:16 | |
| *** gary_perkins has quit IRC | 18:54 | |
| *** zoli__ has quit IRC | 19:04 | |
| *** edcragg has joined #baserock | 19:20 | |
| *** pacon has joined #baserock | 22:01 | |
| *** pacon has quit IRC | 23:23 | |
| *** pacon has joined #baserock | 23:24 | |
| *** pacon has quit IRC | 23:26 | |
| *** edcragg has quit IRC | 23:48 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!