IRC logs for #buildstream for Monday, 2017-09-04

*** tristan has joined #buildstream00:53
*** persia has quit IRC04:20
gitlab-br-botpush on buildstream@test-build (by Tristan Van Berkom): 15 commits (last: _scheduler module: Create an event loop instead of using the default) https://gitlab.com/BuildStream/buildstream/commit/84c871b8a60f7826392c35a36735ac52df29ef7406:45
*** jude has joined #buildstream08:05
gitlab-br-botbuildstream: Tristan Van Berkom deleted branch test-build08:16
gitlab-br-botpush on buildstream@master (by Tristan Van Berkom): 16 commits (last: _scheduler module: Create an event loop instead of using the default) https://gitlab.com/BuildStream/buildstream/commit/84c871b8a60f7826392c35a36735ac52df29ef7408:17
*** jonathanmaw has joined #buildstream08:37
*** ssam2 has joined #buildstream08:52
*** tiagogomes has joined #buildstream09:05
*** bochecha has joined #buildstream09:05
*** tlater has joined #buildstream09:16
*** tlater has left #buildstream09:21
*** tlater has joined #buildstream09:22
*** bochecha_ has joined #buildstream09:33
*** bochecha has quit IRC09:33
gitlab-br-botpush on buildstream@cross_platform (by Tristan Maat): 2 commits (last: Fix sandbox read-onlyness as discussed with tristan (GIVE THIS A) https://gitlab.com/BuildStream/buildstream/commit/32ed3ae50ee4b09ef9fa877cab421a49eb4750ad11:34
gitlab-br-botbuildstream: merge request (cross_platform->master: WIP: Cross platform) #81 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/8111:34
*** tlater has quit IRC12:13
*** bochecha has joined #buildstream12:18
*** bochecha_ has quit IRC12:20
*** tlater has joined #buildstream12:29
*** tlater has left #buildstream12:35
*** tlater has joined #buildstream12:35
gitlab-br-botpush on buildstream@cross_platform (by Tristan Maat): 1 commit (last: Fix sandbox output issues) https://gitlab.com/BuildStream/buildstream/commit/724bbcd3f15bbe13606c4be6314cd326ba1af13913:25
gitlab-br-botbuildstream: merge request (cross_platform->master: WIP: Cross platform) #81 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/8113:26
*** tlater has quit IRC13:55
*** tlater has joined #buildstream13:55
*** ChanServ sets mode: +o tristan14:40
tristantlater, are there any plans yet to run the CI on the platforms we support ?14:46
ssam2tricky to orchestrate as the only Solaris and AIX machines we have are provided by a 3rd party14:48
ssam2also GitLab CI on AIX looks like a real headache because the gitlab-ci-runner program is written in Go, and Go doesn't appear to support AIX14:48
tristan:'(14:49
tristanWell, I'm sure gitlab-ci-runner could run somewhere that is not AIX/Solaris14:50
tristanof course it's still 'tricky'14:50
ssam2yeah it could run as a proxy over SSH14:50
tristanthen gitlab-ci-runner could slave it out... but it needs what; docker everywhere I guess14:50
* ironfoot remembers email about gitlab-ci limitation14:50
ironfooti take that with our own runners we will not have problems?14:51
ssam2oh, you mean the "CI minutes" limit? yeah I think we're fine there14:51
ssam2BuildStream uses the GitLab-hosted runners, but I think they are only limited for private projects14:52
tlatertristan: Especially since some unit test things still require ostree support, it would be a bit hard to distinguish between things that should pass/fail14:52
tristantlater, of course fixing the tests to avoid them where not supported (and report excluded tests in the test output) is part of it14:53
tristanthere is a pytest decorator for that iirc14:53
tristanso you can enable/disable tests according to a var14:53
* tristan added a lot of tests yesterday14:54
tlaterHm, well, I can start on that while waiting for builds at any rate14:56
tristantlater, well hold on... ssam2's concerns need to addressed I think14:58
tlatertristan: Wouldn't tests be orthogonal to that anyway? They would be very useful just to confirm functionality on the platforms.14:59
tristanssam2, https://gitlab.com/gitlab-org/gitlab-ci-multi-runner/blob/master/docs/executors/virtualbox.md ?14:59
tristantlater, good point15:00
tristantlater, you should certainly be able to run ./setup.py test on other platforms15:00
tristantlater, see @pytest.mark.skipif() in tests/sources/bzr.py for example15:01
tristanI think I have to do similar but I have to figure out how to do it differently15:02
tlatertristan: You can use unittest.skipif, according to the pytest documentation15:19
tristantlater, not @pytest.skipif() ??15:21
tristanwait, why would you use unittest.skipif() ?15:21
tlatertristan: It's what the pytest documentation comes up with if you search for skipif - it also has other more verbose helpers for similar things15:23
tlaterSuch as .skipunless15:23
tlaterNevermind, I'm in the wrong documentation15:24
tlaterx)15:24
tristanhmm15:36
* tristan has made a couple of tweaks and now tests run again without bzr installed15:36
*** tlater has quit IRC15:41
*** tlater has joined #buildstream15:42
gitlab-br-botpush on buildstream@master (by Tristan Van Berkom): 6 commits (last: testutis/site.py: A location for checking the presense of host features) https://gitlab.com/BuildStream/buildstream/commit/0d665475aca1bb847749dce7cc415aefcf238e8715:50
tristantlater, ok now there is testutils/site.py15:50
tristantlater, from any test you can do 'from tests.testsutils.site import HAVE_BZR' for instance15:50
tlatertristan: Ah, so now I can add things like HAVE_OSTREE15:52
tlateror those already exist ;)15:53
gitlab-br-botpush on buildstream@cross_platform (by Tristan Maat): 20 commits (last: Implement tarcache) https://gitlab.com/BuildStream/buildstream/commit/95ae8a23c6dbd5395370e333d0a025407fdf31b415:56
gitlab-br-botbuildstream: merge request (cross_platform->master: WIP: Cross platform) #81 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/8115:56
tristantlater, Well.15:57
tristantlater, yes I think that is sane15:58
tristantlater, probably for consistency we want an entry there; although I suspect you must have checked HAVE_OSTREE at some point in the core anyway15:58
tristanI've added only HAVE_OSTREE_CLI because some tests need a cli but we dont assert for that at install15:59
* tristan notes that tests/sources/ostree.py is entirely useless15:59
tristanand will remove it15:59
gitlab-br-botpush on buildstream@master (by Tristan Van Berkom): 2 commits (last: cachekey.py: Fix broken logic of excluding tests) https://gitlab.com/BuildStream/buildstream/commit/99f7febbcf697ad198af4a493feb21f7f56529dc16:00
tlatertristan: Some tests will require root permissions if bwrap is not available, should I just add something that checks os.geteuid()?16:01
gitlab-br-botpush on buildstream@master (by Tristan Van Berkom): 1 commit (last: tests/sources/ostree.py: Removed test and data.) https://gitlab.com/BuildStream/buildstream/commit/ce675ba46b6745b2625fc21e03a8fbf50b2de78b16:04
tristantlater, sure16:04
tristantlater, so what we could do is have an option for force using the fallback backends used for unixy platforms, on linux16:06
tristantlater, and then we could test those code paths in the integration tests at least16:06
tristanAnd maybe its a hidden testing only thing16:07
tristanif the user can choose to do that, then we'd probably need to take the sandbox type into account in the cache keys16:08
tristanmaybe we should be doing that anyway ?16:08
tristanimmaterial right now as long as there is no choice, anyway16:08
tlatertristan: The caches don't currently share artifacts at all, not sure that's necessary - certainly not before tar pushing/pulling is implemented16:10
tristanwell if it's on a different platform then the cache key already has to be different16:13
tristanif something is built on another platform16:13
tristanbut if it's built on the same platform but with a different Platform backend (cause we forced it), I *think* that we need 'choice of plaform backend' to be taken into account for cache key generation16:14
tristanwe dont want to advertise equal keys built by different backends, even if those are (currently) stored by different artifact servers16:15
tlaterI guess that would be necessary in the case that another platform supports ostree in the future16:15
tristanRight16:15
tlaterOr another cache16:15
tristanWe should automatically start using it but have that effect cache key16:16
tristanor smth16:16
tlaterShould this block the current MR or be part of something else?16:19
tristantlater, not block no16:19
tristantlater, well wait... choice of backend in cache key should be I think16:20
tristantlater, because it's very inexpensive, we should have it considered16:20
tristantlater, the tests should also run on your target platforms really16:21
tristanbut as far as automating things on gitlab and forcing the fallback platform so that we can automate testing of both... no that shouldnt block16:21
tristanhaving passing `./setup.py test` shouldnt be too challenging though16:21
gitlab-br-botpush on buildstream@master (by Tristan Van Berkom): 2 commits (last: project.py: Declare main BST_ARTIFACT_VERSION here) https://gitlab.com/BuildStream/buildstream/commit/1d9e7c186dce262842736a8089069fb33121f57c16:23
ssam2something BuildStream does seems to break 'pdb' ... when I add `pdb.set_trace()` calls they don't always work17:12
ssam2oh, maybe the error is before my call :-)17:13
ssam2ignore me17:13
*** tlater has quit IRC17:17
*** ssam2 has quit IRC17:23
*** jonathanmaw has quit IRC17:31
tristanWhat is the point of `bst workspace reset --no-checkout` ?17:55
gitlab-br-botbuildstream: issue #55 ("Workspace list in machine readable format") changed state ("closed") https://gitlab.com/BuildStream/buildstream/issues/5519:03
gitlab-br-botbuildstream: issue #80 ("Awkward to recover after manually deleting workspace dir") changed state ("closed") https://gitlab.com/BuildStream/buildstream/issues/8019:03
gitlab-br-botpush on buildstream@master (by Tristan Van Berkom): 7 commits (last: _yaml.py: Make _yaml.dump() optionally dump to stdout) https://gitlab.com/BuildStream/buildstream/commit/32ea8e4f305d5968f50df59798e6eb0342b05bc219:03
*** tristan has quit IRC19:21
*** tristan has joined #buildstream20:38
*** bochecha has quit IRC20:49
*** bochecha has joined #buildstream21:17
*** bochecha has quit IRC22:18
*** tristan has quit IRC22:35
*** tristan has joined #buildstream22:53
gitlab-br-botpush on buildstream@test-build (by Tristan Van Berkom): 10 commits (last: Restructuring tests using the Repo and Cli) https://gitlab.com/BuildStream/buildstream/commit/193bc3c195e9d0843d38f4a7e4eecac5b8daa1a223:33
gitlab-br-botpush on buildstream@test-build (by Tristan Van Berkom): 2 commits (last: tests/frontend/push.py: Adding test for `bst push`) https://gitlab.com/BuildStream/buildstream/commit/788ceecb07b42897b20241738d791725962aacd223:38

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!