IRC logs for #buildstream for Friday, 2019-04-26

*** rdale has quit IRC00:35
*** slaf has quit IRC01:38
*** slaf has joined #buildstream01:41
*** slaf has joined #buildstream01:41
*** nimish2711 has joined #buildstream02:53
*** nimish2711 has quit IRC03:43
*** nimish2711 has joined #buildstream03:43
*** nimish2711 has quit IRC03:58
*** nimish2711 has joined #buildstream03:58
*** nimish2711 has quit IRC04:03
*** nimish2711 has joined #buildstream04:04
*** nimish2711 has quit IRC04:24
*** nimish2711 has joined #buildstream04:30
*** nimish2711 has quit IRC04:45
*** nimish2711 has joined #buildstream04:46
*** nimish2711 has quit IRC05:04
*** nimish2711 has joined #buildstream05:09
*** mohan43u has quit IRC05:18
*** mohan43u has joined #buildstream05:18
*** phildawson_ has joined #buildstream07:18
*** phildawson has quit IRC07:20
*** benbrown has quit IRC07:20
*** benbrown_ has joined #buildstream07:20
jennisLots of test suite problems over the last few days07:26
jennisI've seen tests/sources/zip.py::test_use_netrc[HTTP] hang for a few pipelines now07:26
jennisAnd lots of "Preparation failed", e.g.  https://gitlab.com/BuildStream/buildstream/-/jobs/20237222207:27
jennisDoes anyone have any idea what's going on?07:27
jenniss/test suite problems/CI problems07:29
*** toscalix has joined #buildstream07:29
*** bochecha has joined #buildstream07:59
*** nimish2711 has quit IRC08:16
*** nimish2711 has joined #buildstream08:17
*** nimish2711 has quit IRC08:30
*** nimish2711_ has joined #buildstream08:31
*** nimish2711_ is now known as nimish271108:31
*** rdale has joined #buildstream08:32
benschubertall jobs stuck because we don't have runners? wait what?https://gitlab.com/BuildStream/buildstream/-/jobs/20292292408:32
*** nimish2711 has quit IRC08:42
tpollard:S08:51
benschubertwho's responsible for runners?08:53
tpollardjjardon or valentind maybe?08:54
valentindLet me have a look.08:54
valentindDO runner seems down08:56
valentindgitlab-runner crashed.09:02
valentindI will cleanup all the runner images and then restart it.09:02
benschubertthanks valentind !09:02
tpollardcheers valentind09:03
valentindI do not know what happened. But I suppose some network issue at DO disconnected the runner from the builders.09:04
valentindStill not working09:06
*** jonathanmaw has joined #buildstream09:12
valentinddocker-machine has too many opened files09:12
valentindbenschubert, tpollard, it should be working now.09:15
valentindSomething wrong with docker-machine. There was a lot of processes for it that were hanging. I rebooted the runner.09:15
benschubertvalentind: thanks a lot for the quick fix!09:15
tpollardmaybe it will remedy the other intermittent failures too09:17
benschubertshould we have a periodic reboot of the runners? like once a week might actually "fix" some issues09:20
valentindbenschubert, just ping me when you get another issue so I look at it.09:21
benschubertsure, hope I won't need too ;)09:21
valentindI might decide to make periodic reboot like I do with the arm builders. But I will do it only if I know the reason.09:21
benschubertagreed09:21
gitlab-br-botjennis approved MR !1307 (phil/move-integration-cache-to-testing->master: Make Integration cache fixture available in testing package) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/130709:33
gitlab-br-botBenjaminSchubert approved MR !1307 (phil/move-integration-cache-to-testing->master: Make Integration cache fixture available in testing package) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/130709:34
*** bochecha has quit IRC09:52
*** phildawson_ has quit IRC09:52
*** hergertme has quit IRC09:52
*** bochecha_ has joined #buildstream09:52
*** bochecha_ is now known as bochecha09:52
tlater[m]o/ I'd like to set up a cache for the buildstream docs09:52
tlater[m]Do we have any sort of infrastructure that would be able to run that?09:52
*** phildawson_ has joined #buildstream09:52
*** hergertme has joined #buildstream09:53
tlater[m]See https://gitlab.com/BuildStream/buildstream/merge_requests/1300 for context :)09:53
benschubertvalentind: I thing I was too optimistic https://gitlab.com/BuildStream/buildstream/-/jobs/202922924 :/09:55
gitlab-br-bottpollard opened MR !1314 (tpollard/artifactmetadata->master: Simplify metadata within Artifact class) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/131410:06
gitlab-br-botjonathanmaw approved MR !1314 (tpollard/artifactmetadata->master: Simplify metadata within Artifact class) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/131410:27
tpollardcheers jonathanmaw10:31
valentindbenschubert, still have this too many open files issue.10:31
tpollardjuergbi: would you like to look at that MR before I marge it or not?10:32
valentindbenschubert, I have found where docker-machine keeps state. I have cleaned up. Now I am removing runners by hand, and I will then restart gitlab-runner10:37
valentindbenschubert, It is working now10:54
valentindbenschubert, you might need to restart jobs that are hanging. But wait a bit because builders are still being spawned so it might look that hanging, but it just takes time to start.10:54
valentindbenschubert, you should look at the duration before restarting a job. If has been less than 15 minutes, let it run a bit. If it is longer restart it.10:55
benschubertvalentind: thanks!10:56
*** tristan has joined #buildstream10:57
juergbitpollard: looks good to me at a quick glance11:11
tpollardjuergbi: great, will set it to marge!11:13
tlater[m]valentind: Are you the person to ask about buildstream runners?11:16
valentindtlater[m], yes11:16
*** toscalix has quit IRC11:17
tlater[m]Any chance we could fit another cache for documentation builds in there?11:18
tlater[m]We'd probably need a cache whose artifacts are always up-to-date with master, and one for the current stable release11:19
tlater[m]With the former being updated by CI11:20
tlater[m]Although, if it still simply maps cache keys, perhaps that's not necessary since we could simply retain old artifacts.11:22
gitlab-br-botmarge-bot123 merged MR !1314 (tpollard/artifactmetadata->master: Simplify metadata within Artifact class) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/131411:22
gitlab-br-botBenjaminSchubert approved MR !1313 (fixed-bug-for-pip-test->master: tests/testutil/python_repo.py: fixed executable path when running pip) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/131311:24
valentindtlater[m], I am not surw what documentation builds you are talking about.11:28
tlater[m]valentind: Essentially, an MR I'm currently writing is going to make the buildstream tutorial builds take a lot of time11:29
tlater[m]We don't want that, so we want to use a buildstream artifact cache for the buildstream docs tutorials11:29
valentindI could add a cache server on DO if you want.11:30
tlater[m]That would be great :)11:30
valentindAre the artifacts big?11:30
tlater[m]Let me check...11:30
valentindtlater[m], maybe create an issue and assigned to me. I am not sure  I will do that today. Maybe Monday.11:31
tlater[m]valentind: Sure - thanks in any case11:32
gitlab-br-bottlater opened issue #1011 (Create artifact cache for buildstream tutorial builds) on buildstream https://gitlab.com/BuildStream/buildstream/issues/101111:41
*** lachlan has joined #buildstream11:46
*** jjardon has quit IRC12:01
*** gokcennurlu has quit IRC12:01
*** albfan has quit IRC12:01
*** albfan has joined #buildstream12:03
*** gokcennurlu has joined #buildstream12:04
*** jjardon has joined #buildstream12:04
*** ChanServ sets mode: +o jjardon12:04
*** lachlan has quit IRC12:22
*** lachlan has joined #buildstream12:38
*** lachlan has quit IRC12:43
*** lachlan has joined #buildstream13:08
*** lachlan has quit IRC13:18
*** lachlan has joined #buildstream13:28
*** lachlan has quit IRC13:32
tpollarddo we have criteria for adding a new distro target to the CI?13:33
benschuberttpollard: I think we usually add if we find some problems with BuildStream on one distro13:35
* tlater[m] thinks the criteria were "someone wants to devote time to ensuring that BuildStream works on the distro"13:44
tlater[m]Usually that comes hand-in-hand with finding a problem on that distro13:45
tpollardI just wondered with us having 2 fedora releases13:45
tpollardI know quite a few people are jumping ship from ubuntu 18.04 to 19.04 (5.0 kernel, python3.7, new gnome etc)13:45
tlater[m]Ah, that's probably more of an artefact of the process by which the distros were added.13:46
tpollardbut I think it's fine to just target latest LTS13:46
benschuberttpollard: fedora doesn't do LTS, and has a 13 months support for every version. with a new version every 6 months, that means mainly 2 version to support :)13:46
tlater[m]We originally started testing fedora, and fedora only, because Sam Thursfield liked fedora.13:46
tlater[m]Hence it's been around the longest, and old versions simply haven't cycled out.13:46
tlater[m]Or we need to support both versions, I suppose (:13:47
benschuberttlater[m]: we cycled F27 or 28 if I remember correctly13:47
* tlater[m] didn't quite remember if that actually happened, but it was certainly discussed13:48
benschubertplus buildstream was apckaged for fedora, would be good not to break it but that's an aside13:48
tlater[m]I think we have packages for all tested distros. There's a pkgbuild for arch and a debian package.13:49
tlater[m]Well, "packages", I guess13:49
tpollardcool :)13:51
*** lachlan has joined #buildstream13:58
*** lachlan has quit IRC14:10
gitlab-br-botmarge-bot123 merged MR !1307 (phil/move-integration-cache-to-testing->master: Make Integration cache fixture available in testing package) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/130714:19
*** lachlan has joined #buildstream14:33
*** tristan has quit IRC14:42
* tlater[m] wonders if tox works with nested virtualenvs...14:53
tlater[m]It's a shame every piece of python tooling has its own virtualenv management14:53
*** tristan has joined #buildstream15:20
jenniscs-shadow, did you notice that the contrib script for showing dependency relationships was duplicating nodes?15:54
jennisHere's the output for a project of 5 'fanned' levels: https://ibb.co/yg58Byy15:56
*** tpollard has quit IRC15:58
cs-shadowjennis: didn't notice that. Would you be able to share the source for the project as well so that i can try it out?16:04
jennisyeah, it's just the bst benchmarks repo16:13
jennisone sec16:13
jenniscs-shadow: if you're able, install this tool: https://gitlab.com/BuildStream/benchmarks/tree/master/contrib/bstgen16:14
jennisand then I just did `bstgen fan -l 3 project` and that'll create a 'project' directory and write the project there16:15
cs-shadowthanks! Will try to see if i get the same thing. I remember deduplicating the nodes at some point but it's been a while since I looked at it last16:15
jennisAhh fair enough, it's a really cool little script though!16:16
jennisahh, i used `-l 5` to get that graph, not 316:17
*** lachlan has quit IRC16:21
*** lachlan has joined #buildstream16:26
lachlanFor info,  tpollard s changes under tpollard/artifactmetadata have made quite a differrence to one of the benchmarking tests https://buildstream.gitlab.io/buildstream-benchmarking/test-debian-like-project/public/average_kb_master_Show_of_Debian_like_project_for_x86_64_20190426-010809.html16:48
*** lachlan has quit IRC16:57
*** lachlan has joined #buildstream16:58
*** lachlan has quit IRC17:04
*** lachlan has joined #buildstream17:07
*** jjardon has quit IRC17:24
*** jjardon has joined #buildstream17:25
*** ChanServ sets mode: +o jjardon17:25
*** lachlan has quit IRC17:32
*** jonathanmaw has quit IRC17:34
*** lachlan has joined #buildstream18:04
*** lachlan has quit IRC18:24
*** nimish2711 has joined #buildstream18:45
*** nimish2711 has quit IRC18:49
*** nimish2711 has joined #buildstream18:50
*** nimish2711 has quit IRC18:55
*** nimish2711 has joined #buildstream18:55
*** lachlan has joined #buildstream19:04
*** nimish2711 has quit IRC19:05
*** nimish2711 has joined #buildstream19:11
*** nimish2711 has quit IRC19:21
*** nimish2711 has joined #buildstream19:22
*** lachlan has quit IRC19:25
*** rdale has quit IRC19:40
*** nimish2711 has quit IRC19:44
*** nimish2711 has joined #buildstream19:46
gitlab-br-botbochecha opened issue #1012 (Traceback when tracking an element) on buildstream https://gitlab.com/BuildStream/buildstream/issues/101219:57
*** nimish2711 has quit IRC20:21
*** cs-shadow has quit IRC21:12
*** bochecha has quit IRC23:45

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!