Skip to content

Add BF16 support for int8_vectorwise_quant / LLM.int8 activation quant - #1985

Open
kru2710shna wants to merge 6 commits into
bitsandbytes-foundation:mainfrom
kru2710shna:feature/int8-bf16-vectorwise-quant
Open

Add BF16 support for int8_vectorwise_quant / LLM.int8 activation quant#1985
kru2710shna wants to merge 6 commits into
bitsandbytes-foundation:mainfrom
kru2710shna:feature/int8-bf16-vectorwise-quant

Fix CUDA<12.4/ROCm builds, restore fp32 support, rename dequant_mm_int32

42b08e1
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs