IRC logs for #buildstream for Wednesday, 2018-10-17

« Tuesday, 2018-10-16 Index Thursday, 2018-10-18 »
gitlab-br-botbuildstream: merge request (chandan/bst-checkout-build->master: Add `--deps build` option to `bst checkout`) #819 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/81900:15
gitlab-br-botbuildstream: merge request (chandan/fix-checkout-none-1.2->bst-1.2: Ensure `--deps=none` option works for `bst checkout`) #828 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/82800:28
gitlab-br-botbuildstream: merge request (chandan/fix-checkout-none-1.2->bst-1.2: Ensure `--deps=none` option works for `bst checkout`) #828 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/82800:29
*** bochecha has quit IRC00:59
*** xjuan has quit IRC01:57
*** alatiera_ has joined #buildstream05:57
*** catonano has joined #buildstream06:08
*** catonano has quit IRC06:39
*** gitlab-br-bot has quit IRC06:57
*** ahmed89 has quit IRC06:58
*** toscalix has joined #buildstream07:34
*** tristan has quit IRC07:47
*** tpollard has joined #buildstream08:07
*** jonathanmaw has joined #buildstream08:16
*** WSalmon has joined #buildstream08:18
*** phildawson has joined #buildstream08:19
*** phildawson has quit IRC08:30
*** phildawson has joined #buildstream08:30
*** jonathanmaw_ has joined #buildstream08:31
*** jonathanmaw has quit IRC08:32
toscalixminutes https://docs.google.com/document/d/1SE4B-BZHlUXpsmBEQt9BmO34Ak2D8YBXTeEOJDOARkU/edit#08:39
*** tristan has joined #buildstream08:39
*** rdale has quit IRC08:41
*** tiagogomes has joined #buildstream08:47
*** catonano has joined #buildstream08:53
*** alatiera_ has quit IRC09:19
*** alatiera_ has joined #buildstream09:19
*** lachlan has joined #buildstream09:21
*** alatiera_ has quit IRC09:21
*** alatiera_ has joined #buildstream09:21
*** rdale has joined #buildstream09:27
*** catonano has quit IRC09:27
laurencegoogle doc for the notes for The Gathering - https://docs.google.com/document/d/1SE4B-BZHlUXpsmBEQt9BmO34Ak2D8YBXTeEOJDOARkU/edit#09:48
*** lachlan has quit IRC09:52
*** abderrahim1 has joined #buildstream09:53
*** abderrahim has quit IRC09:54
* tpollard found the overview of buildgrid interesting 09:55
*** lachlan has joined #buildstream09:59
*** rdale has quit IRC09:59
*** lachlan has quit IRC10:02
*** lachlan has joined #buildstream10:10
*** gitlab-br-bot has joined #buildstream10:10
*** lachlan has quit IRC10:20
*** bochecha has joined #buildstream10:21
*** toscalix has quit IRC10:23
*** catonano has joined #buildstream10:24
*** rdale has joined #buildstream10:26
*** tristan has quit IRC10:26
*** phildawson has quit IRC10:26
*** phildawson has joined #buildstream10:29
*** tristan has joined #buildstream10:30
*** gitlab-br-bot has quit IRC10:35
*** gitlab-br-bot has joined #buildstream10:35
*** lachlan has joined #buildstream10:35
*** toscalix has joined #buildstream10:38
*** lachlan has quit IRC10:41
*** alatiera_ has quit IRC10:46
*** bochecha has quit IRC10:48
*** ahmed89 has joined #buildstream10:51
*** tristan has quit IRC10:55
*** slaf_ has joined #buildstream10:59
*** slaf has quit IRC11:01
*** slaf_ is now known as slaf11:01
*** lachlan has joined #buildstream11:04
*** catonano has quit IRC11:08
*** abderrahim1 is now known as abderrahim11:23
*** WSalmon has quit IRC11:40
*** catonano has joined #buildstream11:41
Nexusi'm having an error where a build will hang if it gets a "Too many link" error, can anyone reproduce this?11:43
*** alatiera_ has joined #buildstream11:44
*** toscalix has quit IRC11:46
*** rdale has quit IRC11:47
jmacI've not seen that one, Nexus - can you give us a paste of the error11:54
Nexushttp://www.hatebin.com/cmwyaztecv11:55
jmacHmm.11:59
skullmanoh wow12:00
jmacYou've run out of hard links somehow, but I don't know how to diagnose this further without looking at your file system12:01
*** WSalmon has joined #buildstream12:01
Nexuswhut?12:01
Nexushow?12:01
skullmanthat… the link syscall's documentation says that limit is usually around 65k12:01
jmacskullman: Per file though, I thought12:02
* Nexus breaks things12:02
skullmanyeah, would mean he's enough artifacts sharing enough files that it's completely… wow12:02
jmacI notice you're checking out "project_409"... how many projects do you have?12:03
skullmanNexus: do you remember when you were doing stuff with stat? One of the fields in that is st_nlink, that's a per file counter you can use to tell how many links a file has. This means there's necessarily a limit on how many it can have since the filesystem has to track it. Can you run `stat -c %h home/phillipsmyth/.cache/buildstream/artifacts/cas/objects/6e/340b9cffb37a989ca544e6bb780a2c78901d3fb33738768511a30617afa01d` ?12:05
Nexus1000?12:05
skullmanand `findmnt -T home/phillipsmyth/.cache/buildstream/artifacts/cas/objects/6e/340b9cffb37a989ca544e6bb780a2c78901d3fb33738768511a30617afa01d` ?12:07
Nexusso such file/directory12:08
Nexusi'm assuming it was cleaned up after i ended the frozen job12:08
* skullman missed the / at the beginning of the file path12:08
Nexusoh12:08
Nexus1 sec12:08
Nexus6499112:08
Nexusstat -c %h12:09
Nexushome/phillipsmyth/.cache/buildstream/artifacts/cas/objects/6e/340b9cffb37a989ca544e6bb780a2c78901d3fb33738768511a30617afa01d12:09
skullmanwow, you're hitting file-system limits there12:09
NexusTARGET SOURCE                  FSTYPE OPTIONS12:09
Nexus     /dev/mapper/vg1269-root ext4   rw,relatime,errors=remount-ro,data=ordered12:09
Nexusyay?12:10
jmacIt could be one file that's so common it appears 64 times in a filesystem root, and with 1000 projects...12:10
skullmanyou see a lot of empty files…12:11
jmacIt's not empty; I recognise the sha256 of empty files now :)12:11
jmacNexus: How was "file_17" generated?12:12
Nexusbst gen from benchmarks `bstgen -n 1000 -f 1 -p 1000 -s dots tests/1712:19
Nexus1000 files per project, file size 1, 1000 projects12:20
jmacRight, so that's generated 1000 projects each containing 1000 identical files12:22
jmacand buildstream tried to export them all as hardlinks to one file in the CAS12:22
jmacI don't think there will be a quick fix for that one.12:24
skullmandoes bstgen have a way to make non-identical files?12:24
Nexusnot sure12:25
jmacDoesn't look like it, but it looks easy to modify12:25
jmacBy all means file that as a bug, but I don't know if we'll consider it a common enough case to fix12:25
Nexusso in 1000 prpjects, i can't have more than 64 identical files?12:32
Nexusthat are in all projects12:32
skullmanif all 1000 projects are identical, yeah12:32
Nexuskk12:32
Nexusgood to know12:32
skullmanit's an extraordinary edge case, I don't think anyone's likely to have enough storage to afford a retention policy that could trigger it under normal circumstances12:33
Nexusi should make that my nick "extraordinary_edge_case"12:36
gitlab-br-botdanielsilverstone-ct opened MR !878 (danielsilverstone-ct/report-loop->master: _loader/loader.py: Be more explanatory in CircDep exception) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/87813:00
*** lachlan has quit IRC13:15
gitlab-br-botphildawson opened MR !879 (phil/fix-readme-install-link->master: README.rst: Fix broken link to instalation instructions) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/87913:18
phildawson^MR to fix a broken link to the installation instructions13:20
*** WSalmon_ has joined #buildstream13:22
*** WSalmon has quit IRC13:23
KinnisonDoes anyone have five minutes to review https://gitlab.com/BuildStream/buildstream/merge_requests/878 ?13:25
jmacKinnison: I will13:26
Kinnisonjmac: thanks, it should be super-quick to review :-)13:26
gitlab-br-botphildawson closed MR !879 (phil/fix-readme-install-link->master: README.rst: Fix broken link to instalation instructions) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/87913:29
gitlab-br-botphildawson approved MR !876 (tiagogones/update-links-to-documentation->master: Update links to documentation website) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/87613:29
*** WSalmon_ has quit IRC13:34
jmacKinnison: Done. Couple of points, nothing major13:38
Kinnisonjmac: thanks, I've responded to them, if you still think it's worth the changes, I'm happy to make them, but I've given my reasoning for the approach I've taken13:41
*** rdale has joined #buildstream13:43
jmacDefault values being class level is very interesting13:43
KinnisonIt's possible my terminology isn't quite right, but they're definitely not reinstantiated per call13:44
gitlab-br-botjmacarthur approved MR !878 (danielsilverstone-ct/report-loop->master: _loader/loader.py: Be more explanatory in CircDep exception) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/87813:47
jmacYep, never noticed that before13:49
KinnisonThanks jmac13:51
KinnisonCould someone please merge (and remove source branch) if they're okay with the code and jmac's review?13:52
*** tristan has joined #buildstream13:52
*** WSalmon_ has joined #buildstream13:53
*** bochecha has joined #buildstream14:00
gitlab-br-botvalentindavid approved MR !875 (jjardon/use_freedesktop-sdk_18_08->master: doc/examples/flatpak-autotools: Use freedesktop-sdk 18.08) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/87514:09
*** toscalix has joined #buildstream14:13
*** lachlan has joined #buildstream14:14
gitlab-br-bottacgomes merged MR !876 (tiagogones/update-links-to-documentation->master: Update links to documentation website) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/87614:15
*** lachlan has quit IRC14:17
*** tristan has quit IRC14:21
*** lachlan has joined #buildstream14:32
*** tristan has joined #buildstream14:34
*** tpollard has quit IRC14:36
gitlab-br-botvalentindavid opened MR !880 (valentindavid/move_alpine_tarball->master: Change URL to the Alpine tarball) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/88014:37
*** lachlan has quit IRC14:37
*** tpollard has joined #buildstream14:38
*** rdale has quit IRC14:45
*** lachlan has joined #buildstream15:00
*** rdale has joined #buildstream15:03
gitlab-br-botjjardon merged MR !880 (valentindavid/move_alpine_tarball->master: Change URL to the Alpine tarball) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/88015:03
*** lachlan has quit IRC15:04
*** tristan has quit IRC15:04
*** lachlan has joined #buildstream15:19
*** lachlan has quit IRC15:23
gitlab-br-botvalentindavid opened MR !881 (valentindavid/move_alpine_tarball-1.2->bst-1.2: Change URL to the Alpine tarball) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/88115:23
*** lachlan has joined #buildstream15:31
flatmushIf anyone wants to see bug #645 (and is at the meetup), I've encountered it on my machine and can show you15:37
*** rdale has quit IRC15:38
*** rdale has joined #buildstream15:38
flatmushtoscalix: ^^15:39
gitlab-br-botjjardon merged MR !881 (valentindavid/move_alpine_tarball-1.2->bst-1.2: Change URL to the Alpine tarball (backport)) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/88115:43
*** lachlan has quit IRC15:44
Kinnisonflatmush: I imagine someone will be interested, but we are currently in a whole group discussion15:45
Kinnisonvalentind: if you are not intending to attend the 102 then perhaps it might be good to go see how flatmush is doing?15:50
flatmushthe only reason to see it on my laptop instead of in the bug report is if you can think of any live debugging of the issue that might be useful15:52
*** lachlan has joined #buildstream15:54
*** toscalix has quit IRC15:56
*** lachlan has quit IRC15:58
*** WSalmon_ has quit IRC16:00
*** rdale has quit IRC16:01
*** rdale has joined #buildstream16:02
*** phildawson has quit IRC16:03
*** phildawson has joined #buildstream16:03
*** WSalmon_ has joined #buildstream16:04
*** lachlan has joined #buildstream16:15
gitlab-br-botjuergbi opened MR !882 (juerg/cas-mtime->master: _artifactcache: Fix ref in update_mtime()) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/88216:26
juergbitlater[m]: review / sanity check of the above would be appreciated when you have time as you're familiar with this code16:30
gitlab-br-botvalentindavid approved MR !875 (jjardon/use_freedesktop-sdk_18_08->master: doc/examples/flatpak-autotools: Use freedesktop-sdk 18.08) on buildstream https://gitlab.com/BuildStream/buildstream/merge_requests/87516:43
*** catonano has quit IRC16:47
*** phildawson has quit IRC16:58
*** toscalix has joined #buildstream17:05
*** bochecha has quit IRC17:17
*** rdale has quit IRC17:22
*** jonathanmaw_ has quit IRC17:24
*** xjuan has joined #buildstream17:44
*** toscalix has quit IRC17:51
*** xjuan has quit IRC17:54
*** xjuan has joined #buildstream17:56
*** bochecha has joined #buildstream18:43
*** lachlan has quit IRC19:06
*** catonano has joined #buildstream19:08
*** lachlan has joined #buildstream19:50
*** alatiera_ has quit IRC19:56
*** catonano has quit IRC21:48
*** catonano has joined #buildstream22:08
*** tristan has joined #buildstream22:33
*** xjuan has quit IRC23:01
*** bochecha has quit IRC23:12
*** xjuan has joined #buildstream23:14
*** xjuan has quit IRC23:35
*** xjuan has joined #buildstream23:49
« Tuesday, 2018-10-16 Index Thursday, 2018-10-18 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!