My CI recently started taking much longer on nightly. Any ideas why?
https://github.com/LilithHafner/Chairmarks.jl/commit/662cdce96413c8e8365a9fb993fe1e5769728ff8
I've seen it in many other packages as well
I started seeing this a few hours ago, have you seen it before then?
Yeah, it has been like that for a while
https://github.com/JuliaLang/julia/issues/52592
That's 25%, I'm looking at 500%
lol at the name "Chairmarks.jl" :smiley: :chair:
Following clause 5 of the naming guidelines :P
The gist is that it's narrower (both in how wide the invocations are and in precompile/compile/runtime/memory usage) than benchmarktools without loosing too much accuracy or precision.
A chair is the obvious choice for something like a bench but narrower
I like it. Simultaneously sarcastic and practical.
I've also only seen that slowdown today, specifically 923fe2d74d4
was fast and ea1a0d2512b
wasn't anymore
the only thing that jumps out at me from the merged PRs is https://github.com/JuliaLang/julia/pull/53440
Looking at my CI logs I got a perfect snapshot of the culprit. I ran CI before and after an NFC commit to my repo on two adjacent commits to master
Here's the likely culprit: https://github.com/JuliaLang/julia/pull/53439#issuecomment-1962142094
If someone could chime in on that PR with data from another Package's CI that would help make sure we know it's not spurious.
commented
the regression I've seen happens to be on the exact same commit from my repo, running twice on different branches, so that means the two runs should be completely identical
Lilith Hafner said:
Following clause 5 of the naming guidelines :P
it's funny that that guideline mentions plotting specifically to make that point aha
Oh Chairmarks looks neat! I think I may have to grab it.
Thanks! I'm just waiting on visually pretty docs before a 1.0 release and wider announcement. LMK if you run into any issues!
I've tangent-ified into updating my startup.jl
to rework to autoloading before I add Chairmasks
... :sweat_smile:
But after I've done that I'll happily let you know how I find it!
https://chairmarks.lilithhafner.com/stable/#For-interactive-use
For one take on auto-loading in startup.jl
https://code.tecosaur.net/tec/setup.jl/src/branch/master/src/autoloads.jl is my current take, but I'm about to overhaul the environment aspect of it.
I'm going to try to make ] autoloads add Chairlift
all that's needed.
Whats the load time of your auto-loader?
We're back! This time it's only 4x slower on nightly.
https://github.com/LilithHafner/Chairmarks.jl/actions/runs/8206349255/job/22445251020?pr=75
Last updated: Nov 22 2024 at 04:41 UTC