INT4 LoRA great-tuning vs QLoRA: A user inquired about the discrepancies amongst INT4 LoRA high-quality-tuning and QLoRA in terms of accuracy and speed. One more member explained that QLoRA with HQQ consists of frozen quantized weights, doesn't use tinnygemm, and makes use of dequantizing alongside torch.matmul "Automation just isn't changin