Experience CrystALS - our layer supercompression technique that reduces model footprint several times without quantization. With less GPU required, our solution offers significant savings on compute for model training and particularly serving. Smaller models also fit on smaller, typically 30-40% cheaper GPUs, resulting in considerable potential savings. Last but not least, smaller models may fit on CPUs for added hedge and remote serving.
