IRC logs for #buildstream for Wednesday, 2018-07-04

*** Prince781 has quit IRC00:20
*** Prince781 has joined #buildstream02:33
*** mohan43u has quit IRC04:01
*** Prince781 has quit IRC05:14
*** mohan43u has joined #buildstream06:26
paulsherwoodmorning06:55
paulsherwoodi'm thinking about setting up a new pipeline to build some arm-target things... the current implmenetation is using buildroot for cross-compile06:57
paulsherwoodcould i use buildstream for this? (the targets are linux applications, not gnome, to run on a small multicore SoC06:58
*** Prince781 has joined #buildstream06:58
*** Prince781 has quit IRC07:07
*** Prince781 has joined #buildstream07:08
*** mohan43u has quit IRC07:12
*** Phil has joined #buildstream07:27
*** coldtom has joined #buildstream08:03
*** toscalix has joined #buildstream08:08
*** bethw has joined #buildstream08:12
*** bethw has quit IRC08:16
*** bethw has joined #buildstream08:36
*** jonathanmaw has joined #buildstream08:42
laurencepaulsherwood, a lot of contributors to the project are travelling to GUADEC at the moment, so the channel may be a little quiet08:44
finnjmac, juergbi, is there any metadata you can attach to a command to tell it what directory to chdir into?08:58
*** noisecell has joined #buildstream08:59
jmacYeah, it's 'build-root' in buildstream09:08
tiagopaulsherwood my understanding is that you can only cross-compile until stage 2. The rest, needs to be natively built09:10
finnMaybe you could stick it in the EnvironmentVariable part of Command?09:11
jmacYes, EnvironmentVariable looks like the best place09:11
jmac`PWD` seems unlikey to clash with a real variable on unix09:12
juergbiit'd be a bit against the spec, though09:13
juergbiaccording to the spec, the working directory is always the input root09:13
juergbibut that's a bit inconvenient09:14
finnhave you any other suggestions?09:14
juergbiwe could insert an appropriate 'cd' command into the command line09:15
finnthat would also work09:15
finnthat would need to be done on bst client of course09:15
finnthe addition of the command that is09:15
jmacPossible but I think there might be corner cases where that wouldn't work09:16
juergbiwe could also raise it upstream, proposing a spec extension09:17
jmacRemote execution commands are meant to be single commands, not shell scripts, so you'd have to wrap the whole thing in a shell09:17
jmacShell and directory specification are platform-specific09:17
finnjuergbi, raising this upstream could take time and could be a long-term fix09:18
finnI still don't think the Watcher API has even been replaced yet...09:18
finnFor short term, environment variable until we get a spec change?09:19
jmacEnvironment variable feels like a better hack to me than adding a cd09:19
finnI should send an email out about our progress to the community. I could include our thoughts about raising an API change too09:20
juergbiwe anyway need to wrap it in a shell line, though, afaict09:21
juergbie.g., bst commands expect to respect PATH while REAPI doesn't09:21
juergbiand with possible future command batching it's also required in any case09:22
juergbior am I missing something?09:22
paulsherwoodtiago: so the short answer is 'no', not possible to build arm things on x86 via bst?09:22
jmacI noticed all the commands we send are wrapped, didn't know if it was a bst thing09:22
jmacIf so, then adding a CD wouldn't be a problem09:22
jmacApart from needing to know the build system path rules which I'm not sure we handle at the moment09:23
juergbipaulsherwood: short answer is 'no', correct. that said, I've successfully done full cross compilation using buildstream with a scratchbox-like approach (cross compiler + qemu-user with binfmt-misc for the rest)09:23
* juergbi has to board the plane now09:24
*** Prince781 has quit IRC09:25
finnsee you in Spain juergbi :)09:26
paulsherwoodsafe travels all09:26
*** toscalix has quit IRC09:45
* tlater notes that tiago's auto-generated profile picture is probably the coolest of them all09:48
tlaterAlso since when to commits link to their parent MRs?09:48
* tiago looks09:49
jmacI think we've had that rule for a while tlater, since we don't have merge commits in master09:51
* tiago deslikes merge commits09:52
tlaterI know we have that rule, but I've never seen gitlab make your commit message a *link* to the MR09:52
jmacOh, I see09:52
tiagoIt makes it easier to revert if necessary, but they add too much noise to the git log. Particular in MR with only 1 commit09:53
jmacThat's quite clever, but also a bit annoying09:53
tlaterI think it's cute :309:53
*** mohan43u has joined #buildstream09:57
tiagovalentind, adds68 are you guys responsible for the freedesktop-sdk?10:21
adds68tiago, yes and jjardon also10:22
adds68and abderrahim[m]10:22
tiagoOn aarch64, I get this broken symbolic link for base-sdk-image.bst:10:22
gitlab-br-botbuildstream: merge request (sam/pushing-fix->master: WIP: _artifactcache/pushreceive.py: Avoid premature 'done' messages) #532 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/53210:22
tiago /home/ubuntu/.cache/buildstream/build/gnu-toolchain-stage1-binutils-89gn_ln4/root/usr/files/bin/sh -> ../../../bin/bash10:23
adds68tiago, is this when you check it out?10:26
adds68I am not too clued up on the bootstrapping phase, as valentind did a lot of that work, and he is currently travelling to GUADEC10:26
*** mohan43u has quit IRC10:27
jmacUnfortunately, buildbox doesn't seem to handle 'cd' well: https://paste.gnome.org/pkxwaxdwj10:33
finntry removing the --chdir option?10:35
finnah also10:35
finnI'm guessing this is command line right?10:35
finn sh -c -e "cd /buildstream " >> try that in quotes?10:35
jmacHmm, that works10:36
jmacThat's odd10:36
finnIt's the way it interprets the command line args10:37
finnYou can see what happens if you do: ls; ls10:37
finnthe first one will work in BuildBox, the second ls will list your actual directory unless you put it in quotes10:37
*** WSalmon has joined #buildstream10:38
jmacYes, I thought that would happen, but why is "cd /buildstream" treated differently?10:38
finnI'm wondering if  sh -c -e is executed followed by cd10:39
* finn shrugs10:40
WSalmonI have been looking at https://buildstream.gitlab.io/buildstream/examples/flatpak-autotools.html it mentions gnome-sdk.gpg but a quick google dose not give a down load link, i presume i am looking in a silly place..10:40
finnit should download it from the alias right>10:41
finnaliases:10:41
finn  gnomesdk: https://sdk.gnome.org/10:41
finnthere should be a keys alias I'm guessing since:10:42
finngpg-key: keys/gnome-sdk.gpg10:42
WSalmonfound it, thanks finn! now to work out how to update the docs :)10:43
finnPhil is doc king10:43
finnjmac, I've extracted the built directory using your tool and gone into: buildstream-install/usr/bin10:45
finnThere is a hello executable in there10:45
finncan't run it10:45
finnhello: ELF 64-bit LSB executable, x86-64, version 1 (SYSV), dynamically linked, interpreter /lib/ld-musl-x86_64.so.1, stripped10:45
jmacOk, is it saying 'file not found'? i.e. failing to find the interpreter?10:45
jmacDo you have /lib/ld-musl-x86_64.so.1 ?10:45
finnbash: ./hello: No such file or directory10:45
finnta, it needed musl10:47
finncool, all works then10:47
jmacThat's the same error I saw yesterday, anyway. Something in buildbox must cause it to link with that.10:48
*** mohan43u has joined #buildstream10:55
*** mohan43u has quit IRC11:03
gitlab-br-botbuildstream: merge request (caching_build_trees->master: Caching buildtrees) #474 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/47411:11
*** mohan43u has joined #buildstream11:13
*** mohan43u has quit IRC11:15
laurencefinn, let's move the unit-tests for buildgrid back to 'Todo' - https://gitlab.com/BuildGrid/buildgrid/issues/2511:39
* laurence is trying to tidy up all gitlab instances ahead of guadec11:39
laurencethe board should show an accurate picture of the current items that are being worked on11:40
laurencefinn, can we please raise an issue to cover the work done so far and the next steps re the demo?11:40
*** bethw has quit IRC11:45
noisecellhi! Im getting this build script: https://paste.baserock.org/himixijide from this element: https://gitlab.com/baserock/definitions/blob/master/elements/gnu-toolchain/base.bst when running the following command: 'bst --option arch armv8l64 source-bundle bootstrap/stage3-sysroot.bst  --except gnu-toolchain/stage2.bst'  https://gitlab.com/baserock/definitions/blob/master/elements/bootstrap/stage3-sysroot.bst for reference12:04
noisecellmy question is: in the autogeneraged script why (set -ex; mv /buildstream/baserock/gnu-toolchain/base.bst/gnu-toolchain-base /buildstream-install) || exit 1) is looking for gnu-toolchain-base inside of base.bst ?12:05
noisecellit is clear that previously gnu-toolchain-base contents have been copied/moved into base.bst12:06
noisecellcp -a "$SRCDIR/gnu-toolchain-base/." '/buildstream/baserock/gnu-toolchain/base.bst' <-- line ^^12:06
noisecellIm following the instructions of how to bootstrap sysroots: https://gitlab.com/baserock/definitions/blob/master/README.md and more specifically http://wiki.baserock.org/guides/how-to-cross-bootstrap/ trying to crossboostrap to aarch6412:09
noisecellany help would be appreciated12:09
*** bochecha has joined #buildstream13:19
tlaterUmm13:42
tlaterIs gitlab broken? I'm trying to comment on an MR, and when I click the little comment button it creates a comment input box for *every single line* in the MR13:42
* tlater waves his fist at UIs13:43
* noisecell tries to recreate his question13:49
noisecelldoes someone know where to look at the commands that an import element will run when building?13:50
laurencenoisecell, apologies for the lack of responses today, some people are travelling to guadec and many others are busy with preparation.13:51
laurenceIf you still don't get answers, the ML is an option13:51
laurenceand also if you are going to guadec you can obvioiusly ask in person :)13:51
noisecelllaurence, ok, thank you for the heads up :)13:51
jmacnoisecell: Import shouldn't run any commands itself, but integration commands for each element it uses will13:52
Philnoisecell, For integration commands, if you haven't found it already there is https://buildstream.gitlab.io/buildstream/tutorial/integration-commands.html13:54
noisecelljmac, https://paste.baserock.org/himixijide and https://gitlab.com/BuildStream/buildstream/blob/master/buildstream/data/build-module.sh.in suggests that at least creates a directory and moves the content (or something else) there13:56
jmacI'm not familiar with build-module.sh, sorry13:59
noisecellPhil, the integration commands are not failing here https://gitlab.com/baserock/definitions/blob/master/elements/gnu-toolchain/base.bst in relation with the URLs linked before hand. I think the issue is either the autogeneration of that script is nor right or base.bst should never passed as element for a crosscompilation source tarball14:00
noisecelljmac, no worries, thanks for replying14:00
*** coldtom has quit IRC14:18
*** coldtom has joined #buildstream14:18
tiagoIs there any documentation about the meaning of  (Pulled:0 79 0)→ (Fetched:0 79 0)→ (Built:1 0 0). I failed to decode this14:22
jmacThe numbers are the number of jobs processed (succeded), skipped, and failed respectively14:24
jmacThere's an expanded version of that printed out when a job finishes14:24
gitlab-br-botbuildstream: merge request (willsalmon/documentation_link->master: Adding a helpful link to the example) #533 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/53314:25
tiagojmac makes sense, thanks :)14:25
gitlab-br-botbuildstream: merge request (phil/437-workspaces-tutorial->master: Phil/437 workspaces tutorial) #519 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/51914:39
*** finn_ has joined #buildstream15:01
*** Phil has quit IRC15:01
*** Phil has joined #buildstream15:02
*** jonathanmaw has quit IRC15:02
*** finn has quit IRC15:03
*** WSalmon has quit IRC15:04
*** WSalmon has joined #buildstream15:09
*** jonathanmaw has joined #buildstream15:18
*** finn_ has quit IRC15:45
*** Prince781 has joined #buildstream15:51
*** noisecell has quit IRC15:57
*** Prince781 has quit IRC16:05
*** Phil has quit IRC16:08
*** finn has joined #buildstream16:09
*** Phil has joined #buildstream16:10
*** Phil has quit IRC16:11
*** jennis has quit IRC16:19
*** finn has quit IRC16:25
laurencetlater, please update this ticket with a comment as per our chat earlier - https://gitlab.com/BuildStream/buildstream/issues/13516:47
laurenceand the MR, if you wish - https://gitlab.com/BuildStream/buildstream/merge_requests/34716:47
tlaterlaurence: Thanks for the reminder, was just about to update that :)16:52
tlaterI also have a few other issues that have been assigned to me, I'll figure out the ones I'm actually working on16:53
laurencethanks a lot16:57
*** coldtom has quit IRC16:59
laurencejonathanmaw, please update the source mirroring ticket - https://gitlab.com/BuildStream/buildstream/issues/32817:06
laurencei know you've been updating the MR recently too17:06
gitlab-br-botbuildstream: merge request (328-support-for-downloading-sources-from-mirrors->master: Resolve "Support for downloading sources from mirrors") #404 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/40417:08
gitlab-br-botbuildstream: issue #458 ("Update test suite images") changed state ("opened") https://gitlab.com/BuildStream/buildstream/issues/45817:10
laurencethanks jonathanmaw17:14
*** jonathanmaw has quit IRC17:15
laurencejuergbi, if you have a min, please could you update the ticket for the CAS cache - https://gitlab.com/BuildStream/buildstream/issues/38717:27
laurencejust a few lines summarising the current status17:27
*** coldtom has joined #buildstream17:29
juergbilaurence: the pending points are in the MR, does it really make sense to repeat that (producing noise for subscribers)?17:42
gitlab-br-botbuildstream: merge request (phil/436-add-ubuntu-install-intructions->master: Phil/436 add ubuntu install intructions) #525 changed state ("opened"): https://gitlab.com/BuildStream/buildstream/merge_requests/52518:27
*** Prince781 has joined #buildstream18:40
*** Prince781 has quit IRC19:05
*** toscalix has joined #buildstream19:11
*** Prince781 has joined #buildstream19:32
*** bochecha has quit IRC19:36
*** bochecha has joined #buildstream19:39
*** Prince781 has quit IRC19:40
*** Prince781 has joined #buildstream20:33
*** bochecha has quit IRC20:51
*** WSalmon has quit IRC21:45
*** Prince781 has quit IRC21:51
*** Prince781 has joined #buildstream22:29
*** Prince781 has quit IRC22:34
*** Prince781 has joined #buildstream23:05
*** Prince781 has quit IRC23:07
*** Prince781 has joined #buildstream23:08
*** toscalix has quit IRC23:41

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!