Skip to content

Add simple safeguarded compressor wrappers for BitRound, ZFP, SZ3, and SPERR#56

Open
juntyr wants to merge 14 commits intomainfrom
safeguards
Open

Add simple safeguarded compressor wrappers for BitRound, ZFP, SZ3, and SPERR#56
juntyr wants to merge 14 commits intomainfrom
safeguards

Conversation

@juntyr
Copy link
Collaborator

@juntyr juntyr commented Sep 5, 2025

This PR adds (simple) safeguarded (https://github.com/juntyr/compression-safeguards) variants for the BitRound+PCO, ZFP-ROUND, SZ3, and SPERR compressors

@juntyr

This comment was marked as outdated.

@juntyr
Copy link
Collaborator Author

juntyr commented Dec 11, 2025

@treigerm The safeguards have their first public alpha release on PyPi now, so this is ready for our debugging session tomorrow

@juntyr juntyr changed the title [DO NOT MERGE] Test simplest safeguards compressor wrappers [DO NOT MERGE] Add simple safeguards compressor wrappers for ZFP, SZ3, and SPERR Jan 23, 2026
@juntyr
Copy link
Collaborator Author

juntyr commented Feb 2, 2026

@treigerm This is now ready again, please completely remove the .venv before rerunning the benchmark

@juntyr
Copy link
Collaborator Author

juntyr commented Feb 2, 2026

Also, please include all safeguarded compressors (safeguarded-bitround-pco, safeguarded-zfp-round, safeguarded-sz3, safeguarded-sperr, safeguarded-zero, safeguarded-zero-dssim). Thanks!

@juntyr juntyr changed the title [DO NOT MERGE] Add simple safeguards compressor wrappers for ZFP, SZ3, and SPERR Add simple safeguards compressor wrappers for ZFP, SZ3, and SPERR Feb 3, 2026
@juntyr juntyr marked this pull request as ready for review February 3, 2026 11:46
@juntyr juntyr requested a review from treigerm February 3, 2026 11:46
@juntyr
Copy link
Collaborator Author

juntyr commented Feb 3, 2026

@treigerm I would like to merge this PR in and just have the safeguards part of the benchmark (which makes follow-up work easier).

Adjustments for plotting will come in #66, but that will require some refactoring after I get the plots as I want.

@juntyr juntyr changed the title Add simple safeguards compressor wrappers for ZFP, SZ3, and SPERR Add simple safeguarded compressor wrappers for BitRound, ZFP, SZ3, and SPERR Feb 3, 2026
@juntyr
Copy link
Collaborator Author

juntyr commented Feb 4, 2026

While the Safeguarded(0, dSSIM) compressor works as expected on 2D data, it fails once we have different height levels, since analysis quantises over the 2D min-max range, but the safeguards are only given the global ones. This could be done by threading through the per-2D level range ... let's see if I can make it work

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant