IRC logs for #buildstream for Monday, 2018-06-11

*** Prince781 has quit IRC03:51
*** toscalix has joined #buildstream07:41
*** Phil has joined #buildstream08:00
*** jonathanmaw has joined #buildstream08:41
gitlab-br-botbuildstream: issue #307 ("Follow-up from "Add getting started section"") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/30708:51
*** Sebastian has joined #buildstream09:52
*** Phil has quit IRC09:59
*** Phil has joined #buildstream09:59
*** jonathanmaw has quit IRC10:02
*** jonathanmaw has joined #buildstream10:17
*** Sebastian has quit IRC10:22
gitlab-br-botbuildstream: merge request (reduce_history_in_cache->master: Reduce history in cache) #482 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/48210:32
*** cs_shadow has joined #buildstream10:33
*** Sebastian_ has joined #buildstream10:34
*** Sebastian_ has quit IRC10:36
*** Sebastian_ has joined #buildstream10:38
gitlab-br-botbuildstream: merge request (reduce_history_in_cache->master: Reduce history in cache) #482 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/48210:38
*** Phil has quit IRC10:40
*** Phil has joined #buildstream10:40
*** Sebastian_ has quit IRC10:47
*** Sebastian_ has joined #buildstream10:49
*** Sebastian_ has quit IRC10:51
*** Sebastian_ has joined #buildstream11:13
*** Sebastian_ has quit IRC11:16
*** Sebastian_ has joined #buildstream11:18
gitlab-br-botbuildstream: merge request (380-untagged-bst->master: Resolve "Uncaught ValueError when tags are not pulled into local repository") #491 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/49111:21
*** Sebastian_ has quit IRC11:42
*** Sebastian has joined #buildstream11:42
*** Sebastian has quit IRC11:46
*** Sebastian has joined #buildstream11:47
gitlab-br-botbuildstream: merge request (135-expire-artifacts-in-local-cache->master: WIP: Resolve "Expire artifacts in local cache") #347 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/34712:21
gitlab-br-botbuildstream: merge request (135-expire-artifacts-in-local-cache->master: WIP: Resolve "Expire artifacts in local cache") #347 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/34712:29
*** bethw has joined #buildstream12:38
gitlab-br-botbuildstream: merge request (135-expire-artifacts-in-local-cache->master: WIP: Resolve "Expire artifacts in local cache") #347 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/34712:46
gitlab-br-botbuildstream: merge request (135-expire-artifacts-in-local-cache->master: WIP: Resolve "Expire artifacts in local cache") #347 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/34712:50
gitlab-br-botbuildstream: merge request (328-support-for-downloading-sources-from-mirrors->master: WIP: Resolve "Support for downloading sources from mirrors") #404 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/40413:01
gitlab-br-botbuildstream: merge request (valentindavid/331_include->master: WIP: Add support for include in project.conf) #471 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/47113:14
gitlab-br-botbuildstream: merge request (valentindavid/331_include->master: WIP: Add support for include in project.conf) #471 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/47113:28
finnCompetition time13:31
finnWhat would you call the application side of BuildGrid i.e the cli13:31
finnAt the moment it's just called BuildGrid App but that's a bit boring13:31
* skullman would call it landis or gyr as a pun on the name of the company that makes my electricity meter and a pun on it being the power grid13:32
* tlater wonders if having more names just makes things confusing13:36
tlaterWe already have at least 3 applications here, do we really need to name another thing?13:36
*** xjuan has joined #buildstream13:39
*** Sebastian has quit IRC13:52
*** Sebastian has joined #buildstream13:53
gitlab-br-botbuildstream: merge request (328-support-for-downloading-sources-from-mirrors->master: Resolve "Support for downloading sources from mirrors") #404 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/40413:55
*** Sebastian has quit IRC13:56
jonathanmawvalentind: I've got my side of source mirroring in a complete solution (even if I doubt it'll be acceptable upstream in this state) now13:57
jonathanmawhttps://gitlab.com/BuildStream/buildstream/merge_requests/40413:57
*** Sebastian has joined #buildstream13:57
jonathanmawvalentind: have I accurately described your suggested API change to remove the need for hacks?13:58
finntlater, I've made a small cli for the BuildGrid library. When it launches, it currently just says "BuildGrid App" which I found a little bland13:58
finnbut I could just keep it as that13:58
* tlater thinks "BuildGrid App" will be best, if a bit bland, at least it doesn't add to the potential confusion between BuildStream/BuildGrid/BuildWhateverOurClientWillBeCalled13:59
* finn wants something exciting like BuildGrid Ultimate Dyson Sphere14:02
skullmanbg-cli14:02
valentindjonathanmaw, OK. I will have a look.14:03
finnbg-dyson14:04
jonathanmawta valentind14:05
tlaterfinn: Are we starting a collectible trading card build system?14:10
finntlater, adding it to BuildGrid issues now and assigning you14:11
tlaterHrm, my os.statvfs calls aren't returning the full struct they are supposed to according to the python documentation14:15
tlaterThey aren't even returning the struct `man` tells me they should14:15
tlaterBut *only* when I'm running the python test cases - running this in a shell manually on the same directory works just fine14:16
tlaterAny idea what could be causing this?14:16
*** Sebastian has quit IRC14:16
*** Sebastian has joined #buildstream14:18
*** Sebastian has quit IRC14:21
*** Sebastian has joined #buildstream14:23
*** Sebastian has quit IRC14:57
*** Phil has quit IRC14:58
*** Sebastian has joined #buildstream15:02
jonathanmawe]]15:16
jonathanmawoops15:16
* tlater really wonders how jonathanmaw produced that key stroke15:16
jonathanmawjennis: Can you try closing the merge request https://gitlab.com/BuildStream/bst-external/merge_requests/25 and try opening a new one?15:17
jennissure15:17
jonathanmawI was able to get the CI to work when I pushed a new branch https://gitlab.com/BuildStream/bst-external/commits/jonathan/test15:17
tlaterOh, if this sort of thing happens I suggest clearing the CI cache15:18
jennisjonathanmaw, done15:30
* jonathanmaw mashes button15:31
*** jennis has left #buildstream15:31
*** jennis has joined #buildstream15:32
adds68juergbi, hey if the bst-artifact-server fails to start, where is best to look for the logs?15:39
*** Prince781 has joined #buildstream15:39
juergbiadds68: I think it's all in stderr15:41
juergbionly warnings/errors, though. there is no access log or anything like that at the moment15:42
juergbibut if it fails to start, I would expect a message on stderr15:42
adds68juergbi, i am trying to start it via systemd, so don't get a very good error15:43
adds68Just "Failed to determine user credentials: No such process"15:44
juergbisystemd should redirect stderr to the journal15:44
juergbihm, that's a systemd error, might you be missing the user that you specified in the .service file?15:45
juergbinot sure why it says No such process, though15:45
tlateradds68: `journalctl -xe --unit <unit>.service` should help when debugging your unit15:45
tlaterIt should show exact errors15:46
adds68tlater, awesome thank you and juergbi  i will check that now15:46
adds68juergbi, correct, type in the user name :)15:47
adds68typo** haha!15:47
tlaterooi, is this a new fancy CAS server, or the old pushreceive script?15:48
tlaterDo you do some cute systemd-socket based thing to run that script when someone opens an ssh connection?15:49
adds68tlater, we did do that15:49
adds68tlater, oh no we just ran the script when someone sshd in :)15:50
adds68tlater, but this is the new shiny CAS15:50
tlaterAh, nice15:50
* tlater hadn't realized it landed15:50
tlaterRunning an actual daemon is so much nicer than that hack (:15:50
adds68juergbi, it starts now, however it complains of a missing repo argument, even though i pass it a path to a repo ?15:50
adds68tlater, ++15:50
tlateradds68: Might be helpful to share the exact command systemd ends up running15:51
adds68tlater, 2 ticks15:52
adds68tlater, juergbi http://termbin.com/q5g815:54
adds68That is my current systemd file15:54
juergbiyou don't specify a repo arg...15:54
adds68juergbi, i specify the repo as stated in the docs? https://gitlab.com/BuildStream/buildstream/blob/juerg/googlecas/doc/source/artifacts.rst15:55
adds68"Serve cache over HTTPS" section15:55
juergbithe systemd file doesn't have that argument15:55
juergbithe last one is the server cert15:55
tlateradds68: Note the repo isn't an option but just a file path at the end15:56
tlaterMight overlook it if you parse lines the way my mind does...15:57
adds68juergbi, tlater *sigh* how did i not spot that15:57
adds68I have 2 .service files and i'm comparing them both, one does have the option, the other doesn't15:57
tlaterCome to think of it, actually, maybe we'd like to distribute one of these service files with the server, juergbi?15:57
tlaterSome projects do, I always find it helpful when I try to run something without docker15:58
juergbiyes, this might indeed make sense given the prevalence of systemd15:58
tlateradds68: Can I create an issue and kindly ask you to contribute yours when you get a reasonably working one?15:58
juergbithat would be great15:58
adds68tlater, yes certainly :)15:58
*** Sebastian has quit IRC16:06
*** Sebastian has joined #buildstream16:09
gitlab-br-botbuildstream: issue #419 ("Distribute a systemd `.service` file with the new CAS server") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/41916:09
tlateradds68: Feel free to assign https://gitlab.com/BuildStream/buildstream/issues/419 to yourself16:10
* tlater finds the issue template a little awkward16:10
*** Sebastian has quit IRC16:11
adds68ta tlater16:11
tlateradds68: Thank *you* for bringing this up ;)16:12
*** Sebastian has joined #buildstream16:13
*** jennis has quit IRC16:18
adds68juergbi, i am now seeing permission error when the cache tried to read the cert.pm16:41
adds68The user that the process is running under belongs to a group that has read permissions on that file16:41
*** Sebastian has quit IRC16:42
adds68But it still sees permission denied16:42
tlateradds68: Long shot, but have you re-logged that user?16:42
juergbiadds68: maybe missing permission on containing directory?16:42
adds68tlater, erm no, i could reboot the server16:42
tlateradds68: Only necessary if that user is signed in and you changed their groups16:43
adds68juergbi, i set it to recurse and the cert.pem file has the correct group set16:43
* tlater always forgets16:43
juergbifor systemd started executable, relogin shouldn't be an issue16:44
* tlater thinks so too :)16:44
*** Sebastian has joined #buildstream16:45
adds68juergbi, a paste for more context:https://paste.gnome.org/pxc7jcnwo16:46
tlateradds68: I think the directory has to be executable by the group16:46
adds68tlater, oh really?16:46
juergbiyes16:47
* tlater reflexively uses 755 when permissioning directories for some reason, and assumes that this is PTSD from fighting this issue before 16:47
* adds68 tries that16:48
adds68No luck =/16:50
adds68It has been set, as i can see executable on the directory now16:50
tlateradds68: If you *really* want to debug this, use `su` to try and manually walk into that directory as that user16:50
tlaterThat should make it obvious which permission you don't have16:51
adds68tlater, oo ok, good idea16:51
tlaterAny parent directories will also need executable permissions and suchlike, so it's hard to tell from just an ls -l :)16:51
adds68tlater, hm yes it seems artifacts gets permission denied at certs/16:55
tlaterLemme guess, no g+x?16:55
adds68tlater, ah no it seems the directory above it does not have the group  set /o\16:56
tlaterOh, haha16:56
adds68tlater, \o/ :)16:57
*** tristan has joined #buildstream17:00
tlaterNexus: 2) Could you explain how exactly that error caused the hang?17:07
tlaterBecause we'd like to make sure this doesn't cause a situation in which debugging becomes difficult17:08
tlaterMaking a mistake and seeing an error is reasonable, not being able to see the error isn't.17:08
Nexustlater: So it seems that, if you attempt to change directory, to one that later may not exist, the test tries to do something like "os.getcwd()" and hangs17:10
Nexusin my case, i was changing the directory that i was in, when making a repo inside the buildstream/tmp/ dir. And left it there, when i told it do go back to its previous directory, the hang stopped17:10
tlaterNexus: Pretty sure that os.getcwd() doesn't cause the hang17:10
tlaterBut the fact that os.getcwd() raises an exception in an unfortunate context17:10
tlaterWhich then causes buildstream to wait for a child process until the heat death of the universe17:10
tlaterIf you can determine the exact unfortunate context in which that happens, we can maybe do something about the hang17:11
tlaterIf not, there's not much we can do.17:11
tlaterFrom my previous explorations into these test hangs, we can't do much but capture more and more corner cases around subprocesses17:11
tlaterThis isn't a front-end issue, luckily, so at worst causes a dev or two a bit of a headache for a while17:12
tlaterAnd mind-share on how to debug hangs is becoming better, so it's not as critical anymore17:13
* tlater wonders if there's a way to make pytest timeout on a test17:18
Nexusthat'd be nice17:19
tlaterWe might want to invest into this: https://pypi.org/project/pytest-timeout/17:20
tlaterIt would make hangs debuggable17:20
* tlater writes up another issue17:21
tlaterOne of those days...17:21
*** finn has quit IRC17:27
gitlab-br-botbuildstream: issue #420 ("Make hanging pytest tests more debuggable") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/42017:29
tlaterNexus: ^^ will be of interest :)17:30
*** bethw has quit IRC17:39
*** Sebastian has quit IRC17:54
*** Sebastian has joined #buildstream17:56
*** bethw has joined #buildstream18:08
gitlab-br-botbuildstream: merge request (tristan/untagged-bst->master: Resolve "Uncaught ValueError when tags are not pulled into local repository") #496 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/49618:12
*** bethw has quit IRC18:12
gitlab-br-botbuildstream: merge request (380-untagged-bst->master: Resolve "Uncaught ValueError when tags are not pulled into local repository") #491 changed state ("closed"): https://gitlab.com/BuildStream/buildstream/merge_requests/49118:14
*** toscalix has quit IRC18:16
*** toscalix has joined #buildstream18:16
gitlab-br-botbuildstream: merge request (tristan/untagged-bst->master: Resolve "Uncaught ValueError when tags are not pulled into local repository") #496 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/49618:17
*** toscalix has quit IRC18:18
tristanSo I have a cute little way to run `bst` commands, capture their stdout/stderr with colors forced enabled, mark it up with html, and include it in the docs18:24
tristanWonder if I should regenerate those html files every time we build the docs by running the said commands against the docs/examples projects18:24
*** bethw has joined #buildstream18:25
albfan[m]tristan: Nice18:27
*** bethw has quit IRC18:29
tristanalbfan[m], I think the ToC is less noisy now too: http://buildstream.gitlab.io/buildstream/18:40
gitlab-br-botbuildstream: issue #380 ("Uncaught ValueError when tags are not pulled into local repository") changed state ("closed") https://gitlab.com/BuildStream/buildstream/issues/38018:51
gitlab-br-botbuildstream: merge request (tristan/untagged-bst->master: Resolve "Uncaught ValueError when tags are not pulled into local repository") #496 changed state ("merged"): https://gitlab.com/BuildStream/buildstream/merge_requests/49618:51
*** Prince781 has quit IRC18:55
*** Prince781 has joined #buildstream18:55
*** tristan has quit IRC18:58
*** Sebastian has quit IRC19:00
*** Sebastian has joined #buildstream19:02
*** Sebastian has quit IRC19:03
*** Sebastian has joined #buildstream19:04
*** tristan has joined #buildstream19:05
*** Sebastian has quit IRC19:08
*** Sebastian has joined #buildstream19:09
albfan[m]tristan: Simple links, super!19:13
*** Prince781 has quit IRC19:14
*** Prince781 has joined #buildstream19:15
*** Prince781 has quit IRC19:18
*** Prince781 has joined #buildstream19:19
*** Prince781 has joined #buildstream19:21
*** jsgrant has quit IRC19:24
*** Prince781 has quit IRC19:25
*** Prince781 has joined #buildstream19:26
*** xjuan_ has joined #buildstream19:27
*** xjuan has quit IRC19:29
*** toscalix has joined #buildstream19:40
*** toscalix has quit IRC19:41
*** jonathanmaw has quit IRC19:45
*** Sebastian has quit IRC19:53
*** Sebastian has joined #buildstream19:54
*** finn has joined #buildstream20:34
*** xjuan_ has quit IRC20:56
*** Sebastian has quit IRC20:58
*** Sebastian has joined #buildstream21:01
*** Sebastian has quit IRC21:04
*** Sebastian has joined #buildstream21:06
*** tristan has quit IRC21:08
*** Prince781 has quit IRC21:14
*** Sebastian has quit IRC21:18
*** Sebastian has joined #buildstream21:21
*** tristan has joined #buildstream21:29
*** Sebastian has quit IRC21:46
*** Sebastian has joined #buildstream22:05
*** Sebastian has joined #buildstream22:08
*** Sebastian has quit IRC22:10
*** Sebastian has joined #buildstream22:11
*** Sebastian has quit IRC22:14
*** Sebastian has joined #buildstream22:15
gitlab-br-botbuildstream: merge request (jjardon/host_deps->master: Document Buildstream's plugins host packages dependencies) #495 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/49522:54
*** Sebastian has quit IRC23:14
*** Sebastian has joined #buildstream23:16
*** Sebastian has quit IRC23:19
*** Sebastian has joined #buildstream23:20
*** tristan has quit IRC23:32
*** cs_shadow has quit IRC23:35
*** tristan has joined #buildstream23:38

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!