SPECTRA: Sparse-Precision Tensor Reconstruction Architecture for Hardware-Saturated Edge Inference is an AI compression algorithm that compresses any LLM weights by upto 3x from its orignal BF16 format. That too without any memory loss.
I want feedback on my repo. Clone it, get any AI from HF and let me know the results......
Github :- https://github.com/NeuraCryption/SPECTRA
Research Paper:- https://zenodo.org/records/24058202
Top comments (0)