| *** toscalix has joined #baserock | 00:25 | |
| *** toscalix has quit IRC | 00:52 | |
| *** toscalix has joined #baserock | 01:02 | |
| *** toscalix has quit IRC | 01:31 | |
| jjardon | paulsherwood: is it possible to reduce the output of ybd when downloading tarballs? It's making the logs so big that is reaching the gitlab limit; https://gitlab.com/baserock/definitions/builds/2356530 | 06:33 |
|---|---|---|
| *** fay has joined #baserock | 06:51 | |
| *** fay is now known as Guest98262 | 06:52 | |
| *** rdale has joined #baserock | 07:56 | |
| paulsherwood | jjardon: that's GitLab output, not ybd? | 08:14 |
| paulsherwood | (i think... i don't normally see anything like that when I run ybd) | 08:14 |
| *** franred has joined #baserock | 08:18 | |
| pedroalvarez | jjardon: we had a similar problem in morph | 08:25 |
| pedroalvarez | in morph with mason* | 08:26 |
| pedroalvarez | but the solution we made might not work for this case | 08:27 |
| paulsherwood | what was the solutiom? | 08:31 |
| pedroalvarez | here: http://git.baserock.org/cgit/baserock/baserock/morph.git/commit/?id=0f00fbbed38757a2b0628341f172c69d9c4dd60a | 08:32 |
| pedroalvarez | (took me a bit to find it) | 08:32 |
| *** CTtpollard has quit IRC | 08:33 | |
| pedroalvarez | that might work with gitlab, and shouldn't be complicated to implement | 08:34 |
| *** jonathanmaw has joined #baserock | 08:37 | |
| *** CTtpollard has joined #baserock | 08:42 | |
| * paulsherwood still can't retry builds, for some reason. | 08:44 | |
| paulsherwood | jjardon: pls can you retry? | 08:45 |
| pedroalvarez | paulsherwood: i think you should redirect stderr to null, not stdout | 08:47 |
| pedroalvarez | but yes, try that first just in case | 08:48 |
| paulsherwood | pedroalvarez: the messages i'm trying to lose are stdout? | 08:48 |
| pedroalvarez | i think the messages are stderr | 08:48 |
| paulsherwood | really? how odd.. they aren't errors, obviosly | 08:48 |
| pedroalvarez | quick test: `wget https://github.com/ 2> file` | 08:49 |
| paulsherwood | i can do both, in any case... it's in a try block, falling back to git clone | 08:49 |
| pedroalvarez | some commands send to stderr information | 08:50 |
| paulsherwood | actually, my logic leaves something to be desired | 08:50 |
| paulsherwood | i've dropped both, in any case, if jjardon can retry | 08:52 |
| pedroalvarez | right | 08:52 |
| paulsherwood | tvm | 08:54 |
| jjardon | paulsherwood: thanks, it will rerun in https://gitlab.com/baserock/definitions/builds/2365342 | 09:02 |
| *** Guest98262 is now known as faybrocklebank | 09:07 | |
| *** locallycompact has joined #baserock | 09:16 | |
| *** tiagogomes has quit IRC | 10:39 | |
| *** tiagogomes has joined #baserock | 10:49 | |
| *** edcragg has joined #baserock | 10:55 | |
| *** paulwaters_ has joined #baserock | 12:40 | |
| paulsherwood | jjardon: one step forward, one step back | 12:49 |
| paulsherwood | leeming: https://gitlab.com/baserock/definitions/builds/2365342 is that a different example from the one you fixed? | 12:49 |
| *** paulwaters_ has joined #baserock | 12:50 | |
| leeming | paulsherwood, looks like another example yes. Internally YBD uses byte arrays (ascii strings) instead of unicode strings | 13:17 |
| *** anahuelamo has quit IRC | 13:57 | |
| *** gtristan has joined #baserock | 13:57 | |
| gtristan | jjardon, are you here ?? | 13:58 |
| paulsherwood | leeming: that sounds like the kind of thing that should be configurable once-and-for-all, rather than futzing with specific code lines? | 14:01 |
| richard_maw | in this case it's because pyfilesystem is crap and assumes file paths are unicode objects when they are actually arbitrary byte strings | 14:04 |
| paulsherwood | :/ | 14:05 |
| richard_maw | the right thing to do is to have a clear understanding of what types your interfaces actually are, but the implicit conversion rules in python2 mean that you're not immediately told when you've gotten it wrong and it takes until you have unexpected unicode data or data that can't be converted to unicode | 14:06 |
| richard_maw | python3 is more strict about the types… but it got file paths wrong so it's also doing the wrong thing | 14:06 |
| leeming | ^ what he said | 14:07 |
| paulsherwood | so for a mere mortal like me, i guess the only solution is futzing around, or OSFS | 14:08 |
| *** edcragg has quit IRC | 14:08 | |
| richard_maw | OSFS being the pyfilesystem thing? | 14:08 |
| richard_maw | if that is what was meant then futzing around is more correct | 14:08 |
| paulsherwood | yes, so ok | 14:09 |
| paulsherwood | leeming: pls would you consider doing the futzing for this too? | 14:09 |
| richard_maw | pyfilesystem suffers even more heavily from the assumption that file paths are unicode, and converts all your carefully preserved bytestrings into unicode… the *wrong* way | 14:10 |
| * paulsherwood was in an odd discussion this week... where the relative impacts of my death versus Lennart's death were considered | 14:10 | |
| paulsherwood | net result, even though very few people use ybd, i'm trying to encourage other people to fix it :) | 14:10 |
| locallycompact | who | 14:10 |
| paulsherwood | who? anyone | 14:11 |
| paulsherwood | anyone competent, that is ;) | 14:11 |
| locallycompact | who is Lennart | 14:11 |
| rjek | Mr Avahi, PulseAudio, and systemd | 14:12 |
| locallycompact | oh that gyu | 14:12 |
| rjek | A triptych of controversy | 14:12 |
| leeming | im not quite sure what pyfilesystem is, or the expected time to go through all of the YBD code to fix it :\ what priority is this? | 14:13 |
| paulsherwood | leeming: never mind | 14:13 |
| locallycompact | pyfilesystem is a python filesystem abstraction that lets you walk with folds and simpler iterators | 14:14 |
| *** gtristan has quit IRC | 14:14 | |
| locallycompact | but apparently causes all this unicode problems | 14:14 |
| leeming | folds? | 14:14 |
| locallycompact | https://wiki.haskell.org/Fold | 14:14 |
| richard_maw | python's equivalent is called reduce | 14:14 |
| richard_maw | and I'm sure locallycompact is about to chime in and tell me they are completely different | 14:15 |
| locallycompact | oh | 14:15 |
| locallycompact | oh oh | 14:15 |
| * paulsherwood gets popcorn | 14:15 | |
| leeming | I thought locallycompact was writing ybd in rust anyway? | 14:15 |
| richard_maw | rust is multi-paradigm I think | 14:15 |
| locallycompact | I do have a few thoughts | 14:16 |
| locallycompact | https://gitlab.com/baserock/morph-rs | 14:16 |
| locallycompact | early days yet | 14:16 |
| locallycompact | be interested to know if it builds everywhere | 14:16 |
| * leeming started to go through some rust tutorials the other evening | 14:16 | |
| richard_maw | the defining your command-line parser as a yaml document and having a macro generate the code for it is terrifyingly clever | 14:17 |
| * leeming gets confused and toddles off back to work on his git repo generator | 14:19 | |
| locallycompact | I do like that thing | 14:19 |
| *** edcragg has joined #baserock | 14:19 | |
| * richard_maw wonders if it can also generate config file readers | 14:20 | |
| locallycompact | it's doing it | 14:21 |
| * tiagogomes wonders if rust will actually succeed or just become the new "D" language | 14:21 | |
| locallycompact | well serde is doing that | 14:21 |
| locallycompact | #[derive(Deserialize)] makes serde do magic against a type all of whose members derive Deserialize | 14:23 |
| locallycompact | tiagogomes, the bar for success imo is replacing all the c code in linux | 14:29 |
| locallycompact | at a minimum | 14:29 |
| *** fay has joined #baserock | 14:40 | |
| *** fay is now known as Guest28383 | 14:40 | |
| richard_maw | ha! I'd settle for usurping the throne of node.js, ruby or Go | 14:41 |
| *** faybrocklebank has quit IRC | 14:44 | |
| *** Guest28383 is now known as faybrocklebank | 14:50 | |
| jjardon | reading https://www.azavea.com/blog/2014/03/24/solving-unicode-problems-in-python-2-7/ , seems a possible solution is to only use Unicode objects internally | 15:12 |
| jjardon | paulsherwood: about the python unicode problem ^ | 15:13 |
| richard_maw | jjardon: how does that handle file paths which aren't unicode strings? | 15:13 |
| jjardon | you can still treat them as unicode internally? | 15:14 |
| rjek | not losslessly IIRCC | 15:14 |
| richard_maw | not if the strings contain bytes that aren't valid unicode code points | 15:14 |
| richard_maw | there's os.fsencode and os.fsdecode, but they have some strange notion that the user's language and localisation settings are relevant | 15:19 |
| locallycompact | at what point does pyfilesystem start to misbehave, because there is this maybe http://docs.pyfilesystem.org/en/latest/wrapfs/base.html | 15:20 |
| locallycompact | oh but wraps existing | 15:20 |
| locallycompact | maybe pointles | 15:20 |
| richard_maw | I think fs{encode,decode} fall back to using the "surrogateescape" encoding so it hex encodes characters it can't represent, but that has the terrifying implication that if you're just joining arbitrary unicode strings together you can end up picking up user input that encodes a NUL in the decoded string, and truncating the string when the python filesystem API translates it back into bytes for calling the syscall | 15:24 |
| richard_maw | so while python3 will catch you if you combine byte strings and unicode strings, it won't help you if you combine unicode strings with file paths | 15:24 |
| richard_maw | since they decided that file paths can be unicode strings | 15:25 |
| locallycompact | I'm sure they'll fix it in python 4 | 15:26 |
| richard_maw | ha! | 15:26 |
| richard_maw | there's not going to be a python4 | 15:26 |
| * paulsherwood doesn't understand how they messed up going from 2 to 3, but they clearly did | 15:27 | |
| richard_maw | there may be a successor language that's pythony, but it's not going to be directly descended from python | 15:27 |
| richard_maw | paulsherwood: it's a topic of hot debate in the python community, lwn.net has quite a few good articles about it, but the general problem is the difficulty porting *because* it was a breaking change | 15:27 |
| richard_maw | paulsherwood: if it were ABI compatible, so you could use the same python interpreter and safely run both python3 and python2 code, so you could migrate your applications piecemeal then it would have been ok | 15:28 |
| paulsherwood | ack | 15:28 |
| richard_maw | paulsherwood: but the biggest problem was that libraries weren't ported quickly enough | 15:28 |
| richard_maw | you can't justify a rewrite of your whole codebase | 15:28 |
| locallycompact | I can justify that all day long. | 15:29 |
| richard_maw | do you have thousands of users who depend on you to provide bug fixes for every version of your codebase? | 15:33 |
| locallycompact | No but I can complain just as loudly | 15:41 |
| *** franred has quit IRC | 16:07 | |
| *** CTtpollard has quit IRC | 16:17 | |
| *** jonathanmaw has quit IRC | 16:42 | |
| *** edcragg has quit IRC | 17:17 | |
| *** edcragg has joined #baserock | 17:24 | |
| *** locallycompact has quit IRC | 17:44 | |
| pedroalvarez | Im curious about the not booting problem you hit the other day. Is that fixed? I'll need to do some baserocking next week and I'm hoping it goes smoothly | 19:58 |
| pedroalvarez | jjardon: nevermind, genivi-baseline (with initramfs) seems to boot fine | 22:55 |
| *** rdale has quit IRC | 23:17 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!