Skip to content

increase the default max Cholesky size to 50000#117

Open
kayween wants to merge 1 commit into
cornellius-gp:mainfrom
kayween:increase-max-cholesky-size
Open

increase the default max Cholesky size to 50000#117
kayween wants to merge 1 commit into
cornellius-gp:mainfrom
kayween:increase-max-cholesky-size

Conversation

@kayween

@kayween kayween commented Nov 26, 2025

Copy link
Copy Markdown
Collaborator

as titled

@kayween kayween linked an issue Nov 26, 2025 that may be closed by this pull request
@gpleiss

gpleiss commented Nov 26, 2025

Copy link
Copy Markdown
Member

50000 seems like too much for older GPUs. Is there some way we could try 50000, and then adjust if we get OOM errors?

@kayween

kayween commented Nov 26, 2025

Copy link
Copy Markdown
Collaborator Author

Sounds reasonable. I will put together a prototype and update this PR.

@Balandat

Copy link
Copy Markdown
Collaborator

Also, lots of people run stuff on CPU and so we definitely want to be careful about cranking the size up too much by default...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Inference] The Default Threshold for Cholesky Decomposition

3 participants