*** tristan <tristan!tristan@223.62.172.178> has quit IRC | 03:53 | |
*** tristan <tristan!tristan@223.62.219.63> has joined #buildstream | 06:48 | |
*** ChanServ sets mode: +o tristan | 06:48 | |
*** coldtom <coldtom!coldtom@2a00:23c7:5e9a:5301:0:0:0:1b8> has joined #buildstream | 08:36 | |
*** tpollard <tpollard!tompollard@cpc109023-salf6-2-0-cust777.10-2.cable.virginm.net> has joined #buildstream | 09:49 | |
*** tristan <tristan!tristan@223.62.219.63> has quit IRC | 10:53 | |
*** abderrahim[m] <abderrahim[m]!abderrahim@2001:470:1af1:104:0:0:0:3558> has quit IRC | 11:54 | |
*** MatrixTravelerbot[m] <MatrixTravelerbot[m]!voyagert2b@2001:470:1af1:104:0:0:0:4efe> has quit IRC | 11:54 | |
*** doras[m] <doras[m]!dorasmatri@2001:470:1af1:104:0:0:0:507e> has quit IRC | 11:54 | |
*** WadeBerrier[m] <WadeBerrier[m]!wberrierma@2001:470:1af1:104:0:0:0:492d> has quit IRC | 11:54 | |
*** jjardon[m] <jjardon[m]!jjardonmat@2001:470:1af1:104:0:0:0:510d> has quit IRC | 11:54 | |
*** SamThursfield[m] <SamThursfield[m]!ssssammatr@2001:470:1af1:104:0:0:0:5124> has quit IRC | 11:54 | |
*** robjh[m] <robjh[m]!~robjhm@2001:470:1af1:104:0:0:0:48ba> has quit IRC | 11:54 | |
*** TheMuso[m] <TheMuso[m]!themuso82m@2001:470:1af1:104:0:0:0:4d68> has quit IRC | 11:54 | |
*** nanonyme <nanonyme!nanonyme@2001:470:1af1:104:0:0:0:45ea> has quit IRC | 11:54 | |
*** devcurmudgeon[m] <devcurmudgeon[m]!devcurmudg@2001:470:1af1:104:0:0:0:4be6> has quit IRC | 11:54 | |
*** abderrahim[m] <abderrahim[m]!abderrahim@2001:470:1af1:104:0:0:0:3558> has joined #buildstream | 12:04 | |
*** doras <doras!doras@2001:470:1af1:104:0:0:0:220b> has joined #buildstream | 12:31 | |
*** jjardon[m] <jjardon[m]!jjardonmat@2001:470:1af1:104:0:0:0:224c> has joined #buildstream | 12:31 | |
*** SamThursfield[m] <SamThursfield[m]!ssssammatr@2001:470:1af1:104:0:0:0:220c> has joined #buildstream | 12:31 | |
*** TheMuso[m] <TheMuso[m]!themuso82m@2001:470:1af1:104:0:0:0:4d68> has joined #buildstream | 12:31 | |
*** devcurmudgeon[m] <devcurmudgeon[m]!devcurmudg@2001:470:1af1:104:0:0:0:4be6> has joined #buildstream | 12:31 | |
*** MatrixTravelerbot[m] <MatrixTravelerbot[m]!voyagert2b@2001:470:1af1:104:0:0:0:2261> has joined #buildstream | 12:31 | |
*** nanonyme <nanonyme!nanonyme@2001:470:1af1:104:0:0:0:45ea> has joined #buildstream | 12:31 | |
*** robjh[m] <robjh[m]!~robjhm@2001:470:1af1:104:0:0:0:48ba> has joined #buildstream | 12:31 | |
*** WadeBerrier[m] <WadeBerrier[m]!wberrierma@2001:470:1af1:104:0:0:0:492d> has joined #buildstream | 12:31 | |
*** tpollard <tpollard!tompollard@cpc109023-salf6-2-0-cust777.10-2.cable.virginm.net> has quit IRC | 17:31 | |
nanonyme | So do we have any further ideas on how to solve the source fetching schedule issues with bst2? | 19:53 |
---|---|---|
*** coldtom <coldtom!coldtom@2a00:23c7:5e9a:5301:0:0:0:1b8> has quit IRC | 19:58 | |
nanonyme | juergbi: Is the problematic code this stuff? https://github.com/apache/buildstream/blob/c2ae6d47aad0686d29d34208e83f0447f5c4591b/src/buildstream/_scheduler/scheduler.py#L365-L375 | 20:04 |
nanonyme | Seems the logic is very old. Maybe it has never worked in a way that works great with Huge projects. Fetch should only be preferred in such a case that elements exists such that all their build deps are in cache. Otherwise pull should always be preferred. | 20:07 |
nanonyme | Not doing that means wasting build nodes for a longer time period while you're waiting for sources | 20:08 |
nanonyme | That is, the primary purpose of fetchers is to saturate builders. If something else is happening, that is clearly wrong behaviour. | 20:11 |
nanonyme | It might really be trying to work that way but the code comment is very dubious | 21:11 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!