IRC logs for #buildstream for Friday, 2022-03-04

*** tristan <tristan!tristan@223.62.172.178> has quit IRC03:53
*** tristan <tristan!tristan@223.62.219.63> has joined #buildstream06:48
*** ChanServ sets mode: +o tristan06:48
*** coldtom <coldtom!coldtom@2a00:23c7:5e9a:5301:0:0:0:1b8> has joined #buildstream08:36
*** tpollard <tpollard!tompollard@cpc109023-salf6-2-0-cust777.10-2.cable.virginm.net> has joined #buildstream09:49
*** tristan <tristan!tristan@223.62.219.63> has quit IRC10:53
*** abderrahim[m] <abderrahim[m]!abderrahim@2001:470:1af1:104:0:0:0:3558> has quit IRC11:54
*** MatrixTravelerbot[m] <MatrixTravelerbot[m]!voyagert2b@2001:470:1af1:104:0:0:0:4efe> has quit IRC11:54
*** doras[m] <doras[m]!dorasmatri@2001:470:1af1:104:0:0:0:507e> has quit IRC11:54
*** WadeBerrier[m] <WadeBerrier[m]!wberrierma@2001:470:1af1:104:0:0:0:492d> has quit IRC11:54
*** jjardon[m] <jjardon[m]!jjardonmat@2001:470:1af1:104:0:0:0:510d> has quit IRC11:54
*** SamThursfield[m] <SamThursfield[m]!ssssammatr@2001:470:1af1:104:0:0:0:5124> has quit IRC11:54
*** robjh[m] <robjh[m]!~robjhm@2001:470:1af1:104:0:0:0:48ba> has quit IRC11:54
*** TheMuso[m] <TheMuso[m]!themuso82m@2001:470:1af1:104:0:0:0:4d68> has quit IRC11:54
*** nanonyme <nanonyme!nanonyme@2001:470:1af1:104:0:0:0:45ea> has quit IRC11:54
*** devcurmudgeon[m] <devcurmudgeon[m]!devcurmudg@2001:470:1af1:104:0:0:0:4be6> has quit IRC11:54
*** abderrahim[m] <abderrahim[m]!abderrahim@2001:470:1af1:104:0:0:0:3558> has joined #buildstream12:04
*** doras <doras!doras@2001:470:1af1:104:0:0:0:220b> has joined #buildstream12:31
*** jjardon[m] <jjardon[m]!jjardonmat@2001:470:1af1:104:0:0:0:224c> has joined #buildstream12:31
*** SamThursfield[m] <SamThursfield[m]!ssssammatr@2001:470:1af1:104:0:0:0:220c> has joined #buildstream12:31
*** TheMuso[m] <TheMuso[m]!themuso82m@2001:470:1af1:104:0:0:0:4d68> has joined #buildstream12:31
*** devcurmudgeon[m] <devcurmudgeon[m]!devcurmudg@2001:470:1af1:104:0:0:0:4be6> has joined #buildstream12:31
*** MatrixTravelerbot[m] <MatrixTravelerbot[m]!voyagert2b@2001:470:1af1:104:0:0:0:2261> has joined #buildstream12:31
*** nanonyme <nanonyme!nanonyme@2001:470:1af1:104:0:0:0:45ea> has joined #buildstream12:31
*** robjh[m] <robjh[m]!~robjhm@2001:470:1af1:104:0:0:0:48ba> has joined #buildstream12:31
*** WadeBerrier[m] <WadeBerrier[m]!wberrierma@2001:470:1af1:104:0:0:0:492d> has joined #buildstream12:31
*** tpollard <tpollard!tompollard@cpc109023-salf6-2-0-cust777.10-2.cable.virginm.net> has quit IRC17:31
nanonymeSo do we have any further ideas on how to solve the source fetching schedule issues with bst2?19:53
*** coldtom <coldtom!coldtom@2a00:23c7:5e9a:5301:0:0:0:1b8> has quit IRC19:58
nanonymejuergbi: Is the problematic code this stuff? https://github.com/apache/buildstream/blob/c2ae6d47aad0686d29d34208e83f0447f5c4591b/src/buildstream/_scheduler/scheduler.py#L365-L37520:04
nanonymeSeems the logic is very old. Maybe it has never worked in a way that works great with Huge projects. Fetch should only be preferred in such a case that elements exists such that all their build deps are in cache. Otherwise pull should always be preferred.20:07
nanonymeNot doing that means wasting build nodes for a longer time period while you're waiting for sources20:08
nanonymeThat is, the primary purpose of fetchers is to saturate builders. If something else is happening, that is clearly wrong behaviour.20:11
nanonymeIt might really be trying to work that way but the code comment is very dubious21:11

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!