IRC logs for #buildstream for Friday, 2019-05-03

*** benschubert has quit IRC01:06
*** slaf has quit IRC01:39
*** slaf has joined #buildstream01:41
*** slaf has joined #buildstream01:41
*** nimish2711 has joined #buildstream01:42
*** slaf has joined #buildstream01:42
*** slaf has joined #buildstream01:42
*** slaf has joined #buildstream01:42
*** slaf has joined #buildstream01:42
*** slaf has joined #buildstream01:43
*** slaf has joined #buildstream01:43
*** slaf has joined #buildstream01:43
*** slaf has joined #buildstream01:43
*** slaf has joined #buildstream01:44
*** slaf has joined #buildstream01:44
*** slaf has joined #buildstream01:44
*** slaf has joined #buildstream01:44
*** tristan has joined #buildstream01:53
*** nimish2711 has quit IRC03:32
*** nimish2711 has joined #buildstream03:50
*** tristan has quit IRC05:15
*** tristan has joined #buildstream05:18
*** toscalix has joined #buildstream06:06
*** nimish2711 has quit IRC06:22
*** rdale has joined #buildstream06:33
*** nimish2711 has joined #buildstream06:37
*** bochecha has joined #buildstream07:47
jennisvalentind, the test passes and then hangs immediately after08:03
jennisand from what I've seen, since I've been paying more attention, it's always on that runner08:04
*** ChanServ sets mode: +o tristan08:09
tristan[00:00:01] FAILURE core/gdm.bst: Attempt to access unavailable artifact: [Errno 2] No such file or directory: '/home/tristan/.cache/buildstream/artifacts/cas/refs/heads/freedesktop-sdk/base-buildsystem-autotools/32ccb07d7a59aef1c8822115abd9b8e0f3f6955b3a0a32eadb4d8e527b5e3833'08:10
tristanI wanna cry :'(08:10
tristanPlus https://gitlab.com/BuildStream/buildstream/issues/101408:10
tristanPlus I ran into a case where I ran `bst build` today, and it built one element and then returned successfully without completing the pipeline "Yes sir ! I built it for you ! job done !"08:11
tristanThat unavailable artifact thing I ran into a couple weeks ago, and I wrote it off as an incompatibility of caches between bst1 and bst2, which I would have preferred to write off and only raise later on08:12
tristanbut this time it looks like a real bug08:12
tristanI think we're not regularly using --no-strict enough upstream08:12
tristanthese I think are all related to --no-strict in some way08:12
jennis<@tristan> I think we're not regularly using --no-strict enough upstream, that's definitely true08:17
tristanI am building a bootable VM image from freedesktop-sdk and gnome-build-meta... and let me tell you, --no-strict is *damn* useful08:18
jennisPerhaps we also need to parameterize more of the tests so that they also run with non-strict08:18
tristanlike, I have to tweak things at every level of the stack and rebuild VMs08:18
tristanwithout it, life would be near impossible (I would wait half a day between tests)08:18
jennisYeah, I bet08:18
abderrahim[m]even now, I have to wait more than 1h08:19
tristanYeah, we hope we can improve performance08:19
abderrahim[m](for the x86image one)08:19
tristanabderrahim[m], I think that we can cut the time of x86image in *half* without anything difficult08:19
tristanI think there is a part of it which does `mv /buildstream/sda.img /buildstream/install-root/sda.img` which takes half the time08:20
tristanand really, it's just legacy, from the waaaaay old days where /buildstream was "the directory with read-write access"08:20
tristanNow it's wasting our time passing through FUSE08:20
abderrahim[m]can't fuse optimize a mv call? or they are different mounts?08:21
tristandifferent mounts08:21
tristanthat's what changed, and x86image didnt change with it08:21
tristanok this sucks, I have to wipe my cache and shoot for a clean build08:23
jennisThe docs job is failing in bst-external: https://gitlab.com/BuildStream/bst-external/-/jobs/206523215 did we see something similar in BuildStream and pin sphinx because of it?08:25
tristanjennis, Yes08:25
jennisIt was that error?08:25
tristanjennis, I'm not sure08:25
jennisok, thanks08:26
tristanabderrahim[m], I think I'm close to a login screen, I was missing xwayland in the build and gdm trying to launch X because of that08:27
tristanAnyway08:27
tristanabderrahim[m], I will push my latest tristan/gnome-boot branch, and I will launch a clean build (reverting that webkit perversion which allows ninja to run rampant all over my cpus), and then go for dinner08:27
tristanabderrahim[m], I'd appreciate that you push a branch of whatever progress you have and drop me an email or something, so I can rebase/integrate and try them together over the weekend08:28
abderrahim[m]tristan: for xwayland, I found out that it was a build-only dependency of mutter while it should be runtime08:29
abderrahim[m]as well08:29
tristanOh, I'm using the one from freedesktop-sdk08:29
tristanI'd rather anyway08:29
abderrahim[m]it's fine. It's been merged already?08:30
tristannope, tristan/gnome-boot includes that branch in freedesktop-sdk08:31
abderrahim[m]t's fine either way, but I think it's better to merge things ASAP08:32
tristanit also includes a /var/run -> /var symlink08:32
tristanI agree08:32
abderrahim[m]yeah, I was doing that manually08:32
tristanabderrahim[m], but I think we might want to switch to master (not 18.08) before merging things08:32
*** tristan has quit IRC08:35
*** tristan_ has joined #buildstream08:35
abderrahim[m]Ok, I'll send my mr for freedesktop-sdk against master08:36
*** jonathanmaw has joined #buildstream08:37
jennisWould anyone be strongly opposed to perhaps having bst-external testsuite and bst-experimental testsuite images created by buildstream-docker-images? cs-shadow?08:39
*** tristan_ is now known as tritsan08:39
*** ChanServ sets mode: +o tritsan08:40
tritsanabderrahim[m], I'll rebase my everything against master too this weekend08:41
* tritsan gotta run08:41
* tritsan started a build that will take all day anyway08:41
juergbijonathanmaw: that was a bit early08:51
jonathanmawjuergbi: ah, that's what I get for reading E-mails before I've had my caffeine :/08:52
juergbiI've resolved all the previously open discussions as they were indeed resolved but there are aspects I haven't commented on yet08:53
juergbi(because I'm unsure about them)08:53
*** raoul has joined #buildstream08:55
juergbicommented on the two main blockers to clarify this even though I don't have a suggested improvement yet08:59
jennisjonathanmaw, would you be able to spare a second to review: https://gitlab.com/BuildStream/bst-external/merge_requests/85 it fixes our docs job in bst-external's CI09:05
* jonathanmaw has a poke09:05
jennista jonathanmaw09:08
*** tritsan has quit IRC09:19
*** nimish2711 has quit IRC09:33
*** lachlan has joined #buildstream09:38
abderrahim[m]tristan_: FTR, that last copy in x86image takes 11 min (out of 01h04m total)09:45
*** raoul has quit IRC09:48
*** lachlan has quit IRC09:51
*** lachlan has joined #buildstream09:55
*** lachlan has quit IRC09:59
*** lachlan has joined #buildstream10:35
cs-shadowjennis: hi, I don't see any issues per se however I'd like to understand what extra things they'll need10:38
*** toscalix has quit IRC10:39
*** lachlan has quit IRC10:41
jennisquilt is the main one10:48
jennisThen pytest, pytest-cov, pytest-datafiles etc10:49
*** nimish2711 has joined #buildstream10:52
jennisIt looks like we're expecting more tests for the external plugins to land, so it's likely that we're going to have to bundle more `dnf install`'s and `pip install`'s into .gitlab-ci.yml, if it's not much effort to produce testsuite docker images, this will be a nicer alternative (IMO)10:52
jennisjuergbi, jonathanmaw, even though juergbi unassigned marge from the MR, it looks as if she still tried to merge it10:55
jennisthat's not gd10:55
juergbiyes, good thing I opened the discussions10:56
jennisthankfull CI hung 😆10:56
jennisjuergbi, she didn't merge because CI was taking too long10:56
jennisNot sure whether open dicussions would have stopped that if CI passed, hopefully10:57
juergbimarge shouldn't have special privileges, so gitlab would have prevented that10:57
jennisvalentind, there's another example of that runner hanging: https://gitlab.com/BuildStream/buildstream/-/jobs/206554390 and another: https://gitlab.com/BuildStream/buildstream/-/jobs/206180762 and here is the same *post* test hanging on another runner: https://gitlab.com/BuildStream/buildstream/-/jobs/20632526910:58
jennisAnd another on bastion a334e492: https://gitlab.com/BuildStream/buildstream/-/jobs/20619402311:00
jennis^ bastion a334e492 is the runner I keep noticing11:01
*** benschubert has joined #buildstream11:09
*** nimish2711 has quit IRC11:11
valentindjennis, It is always the same place. So I suppose the test hangs.11:12
valentindWhat comes after tests/sources/zip.py::test_use_netrc[HTTP] ?11:13
valentindtests/sources/tar.py::test_netrc_already_specified_user[FTP]11:13
valentindThat is certainly a race condition while trying to terminate the test ftp server.11:16
*** lachlan has joined #buildstream11:17
valentindIt could be an error happening before sever.start() is called.11:18
valentindThough no. It should then not hang.11:18
*** lachlan has quit IRC11:28
*** lachlan has joined #buildstream11:44
*** lachlan has quit IRC12:02
*** nimish2711 has joined #buildstream12:06
*** jonathanmaw has quit IRC12:15
*** nimish2711 has quit IRC13:21
cs-shadowjennis: `dnf install` yes. For `pip install` shouldn't that be taken care of by `tox` ?13:22
*** lachlan has joined #buildstream13:42
*** lachlan has quit IRC13:57
*** lachlan has joined #buildstream14:01
jenniscs-shadow, right, wasn't sure if we bundled in the python deps14:04
*** lachlan has quit IRC14:04
*** lachlan has joined #buildstream14:25
cs-shadowjennis: `tox` will install things in a virtual env so bundling deps will be superfluous as it won't use them anyway14:27
*** lachlan has quit IRC14:29
jennisoh, of course, thanks15:16
*** nimish2711 has joined #buildstream15:55
*** bochecha has quit IRC16:01
*** lachlan has joined #buildstream16:09
*** nimish2711 has quit IRC16:18
*** lachlan has quit IRC16:22
*** lachlan has joined #buildstream16:36
*** nimish2711 has joined #buildstream16:39
*** lachlan has quit IRC16:44
*** lachlan has joined #buildstream17:41
*** lachlan has quit IRC17:48
*** lachlan has joined #buildstream17:51
*** lachlan has quit IRC17:59
*** lachlan has joined #buildstream18:06
*** lachlan has quit IRC18:11
*** lachlan has joined #buildstream18:14
*** lachlan has quit IRC18:19
*** lachlan has joined #buildstream18:22
*** nimish2711 has quit IRC18:25
*** lachlan has quit IRC18:25
*** nimish2711 has joined #buildstream18:31
*** lachlan has joined #buildstream18:38
*** lachlan has quit IRC18:43
*** lachlan has joined #buildstream18:51
*** lachlan has quit IRC18:54
*** cs-shadow has quit IRC19:20
*** lachlan has joined #buildstream19:25
*** lachlan has quit IRC19:29
*** rdale has quit IRC19:33
*** bochecha has joined #buildstream19:41
*** cs-shadow has joined #buildstream20:06
*** nimish2711 has quit IRC20:52
*** cs-shadow has quit IRC22:30
*** phildawson has quit IRC22:51
*** paulsherwood has quit IRC22:51
*** hergertme has quit IRC22:51
*** phildawson has joined #buildstream22:52
*** paulsherwood has joined #buildstream22:52
*** hergertme has joined #buildstream22:52
*** bochecha has quit IRC23:08
*** nimish2711 has joined #buildstream23:39

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!