Lilith Hafner (Feb 23 2024 at 22:10): Lilith Hafner (Feb 23 2024 at 22:10):My CI recently started taking much longer on nightly. Any ideas why?
https://github.com/LilithHafner/Chairmarks.jl/commit/662cdce96413c8e8365a9fb993fe1e5769728ff8
Mosè Giordano (Feb 23 2024 at 23:09):I've seen it in many other packages as well
Lilith Hafner (Feb 23 2024 at 23:10):I started seeing this a few hours ago, have you seen it before then?
Mosè Giordano (Feb 23 2024 at 23:12):Yeah, it has been like that for a while
Mosè Giordano (Feb 23 2024 at 23:13):https://github.com/JuliaLang/julia/issues/52592
Lilith Hafner (Feb 23 2024 at 23:15):That's 25%, I'm looking at 500%
Expanding Man (Feb 23 2024 at 23:17):lol at the name "Chairmarks.jl" :smiley: :chair:
Lilith Hafner (Feb 23 2024 at 23:18):Following clause 5 of the naming guidelines :P
Lilith Hafner (Feb 23 2024 at 23:20):The gist is that it's narrower (both in how wide the invocations are and in precompile/compile/runtime/memory usage) than benchmarktools without loosing too much accuracy or precision.
Lilith Hafner (Feb 23 2024 at 23:20):A chair is the obvious choice for something like a bench but narrower
Expanding Man (Feb 23 2024 at 23:21):I like it. Simultaneously sarcastic and practical.
Sukera (Feb 23 2024 at 23:30):I've also only seen that slowdown today, specifically 923fe2d74d4 was fast and ea1a0d2512b wasn't anymore
Sukera (Feb 23 2024 at 23:31):the only thing that jumps out at me from the merged PRs is https://github.com/JuliaLang/julia/pull/53440
Lilith Hafner (Feb 23 2024 at 23:45):Looking at my CI logs I got a perfect snapshot of the culprit. I ran CI before and after an NFC commit to my repo on two adjacent commits to master
Here's the likely culprit: https://github.com/JuliaLang/julia/pull/53439#issuecomment-1962142094
Lilith Hafner (Feb 23 2024 at 23:47):If someone could chime in on that PR with data from another Package's CI that would help make sure we know it's not spurious.
Sukera (Feb 24 2024 at 06:41):commented
Sukera (Feb 24 2024 at 06:42):the regression I've seen happens to be on the exact same commit from my repo, running twice on different branches, so that means the two runs should be completely identical
Eric Hanson (Feb 25 2024 at 00:55):Lilith Hafner said:
Following clause 5 of the naming guidelines :P
it's funny that that guideline mentions plotting specifically to make that point aha
Timothy (Feb 28 2024 at 15:45):Oh Chairmarks looks neat! I think I may have to grab it.
Lilith Hafner (Feb 28 2024 at 16:07):Thanks! I'm just waiting on visually pretty docs before a 1.0 release and wider announcement. LMK if you run into any issues!
Timothy (Feb 28 2024 at 16:36):I've tangent-ified into updating my startup.jl to rework to autoloading before I add Chairmasks... :sweat_smile:
But after I've done that I'll happily let you know how I find it!
Lilith Hafner (Feb 28 2024 at 16:56):https://chairmarks.lilithhafner.com/stable/#For-interactive-use
Lilith Hafner (Feb 28 2024 at 16:56):For one take on auto-loading in startup.jl
Timothy (Feb 28 2024 at 16:57):https://code.tecosaur.net/tec/setup.jl/src/branch/master/src/autoloads.jl is my current take, but I'm about to overhaul the environment aspect of it.
Timothy (Feb 28 2024 at 17:01):I'm going to try to make ] autoloads add Chairlift all that's needed.
Lilith Hafner (Feb 28 2024 at 20:44):Whats the load time of your auto-loader?
Lilith Hafner (Mar 08 2024 at 16:50):We're back! This time it's only 4x slower on nightly.
https://github.com/LilithHafner/Chairmarks.jl/actions/runs/8206349255/job/22445251020?pr=75
Lilith Hafner (Mar 08 2024 at 17:47):Last updated: Nov 06 2024 at 04:40 UTC