1.错误信息

Traceback (most recent call last):
  File "/root/.cache/huggingface/modules/transformers_modules/Baichuan2-13B-Chat-lora23/modeling_baichuan.py", line 735, in quantize
    from .quantizer import quantize_online
  File "/root/.cache/huggingface/modules/transformers_modules/Baichuan2-13B-Chat-lora23/quantizer.py", line 1, in <module>
    import bitsandbytes as bnb
ModuleNotFoundError: No module named 'bitsandbytes

2.错误原因排查

	pip install torch 默认安装的版本太高导致，如图：

3.错误解决

	降低版本：pip install torch==2.0.1