Skip to content

CI: ccache fixes for unix#203

Open
lucascolley wants to merge 3 commits into
scipy:mainfrom
lucascolley:ccache
Open

CI: ccache fixes for unix#203
lucascolley wants to merge 3 commits into
scipy:mainfrom
lucascolley:ccache

Conversation

@lucascolley

@lucascolley lucascolley commented Jun 21, 2026

Copy link
Copy Markdown
Member

towards gh-200. Not figured out the windows problem yet.

@github-actions github-actions Bot added the CI Items related to the CI tools such as CircleCI, GitHub Actions or Azure label Jun 21, 2026
@lucascolley lucascolley force-pushed the ccache branch 2 times, most recently from 7d28067 to c5877b5 Compare June 21, 2026 13:33
Comment thread pixi.toml
Comment on lines 20 to 22
[environments.default]
features = ["build", "tests", "tests-debug"]
solve-group = "default"

[environments.ci]
features = ["build", "tests", "tests-debug", "cov", "ci"]
features = ["build", "tests", "tests-debug", "cov"]
solve-group = "default"

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let's just simplify this and have one env

@lucascolley lucascolley marked this pull request as ready for review June 21, 2026 13:53
@lucascolley

Copy link
Copy Markdown
Member Author

@fbourgey I'm inclined to merge this to speed up unix, then investigate using ninja (previously mentioned in gh-31) before debugging getting ccache working on windows. The linked issue can be renamed to be specific to windows. WDYT?

@lucascolley lucascolley requested a review from fbourgey June 21, 2026 13:54
@lucascolley lucascolley reopened this Jun 21, 2026
@lucascolley lucascolley changed the title CI: ccache fixes CI: ccache fixes for unix Jun 21, 2026
@lucascolley

Copy link
Copy Markdown
Member Author

@nickodell how are these ccache stats looking?

@nickodell

Copy link
Copy Markdown
Member

@nickodell how are these ccache stats looking?

  1. MacOS hit rate seems low:

      Hits:             203 /  609 (33.33%)
    

    Typically, ccache can hit 80%-100%. Here's a histogram of scipy/scipy's typical ccache hit rate, across all jobs. The pattern here is that you can see most jobs have >95% hit rate. Some jobs fail to restore a cache entry or are misconfigured, so they get a 0% hit rate.

    newplot
  2. To have a valid test, you really need to both generate and consume the cache entry under the new configuration. I would suggest changing the prefix of all of the cache keys to prevent it from getting a cache hit from main, then running these tests through CI twice.

    The MacOS hit rate thing I mentioned could just be that CCACHE_COMPILERCHECK changed.

@lucascolley lucascolley reopened this Jun 21, 2026
@lucascolley

Copy link
Copy Markdown
Member Author

After changing the key prefix, the jobs are still at exactly 203 hits (50%). Sounds like there is something else going on @nickodell ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CI Items related to the CI tools such as CircleCI, GitHub Actions or Azure

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants