零基础教程：用vLLM+Chainlit玩转GLM-4-9B大模型

你是否想过，不用写一行服务端代码，就能拥有一个支持百万字上下文、响应迅速、界面友好的本地大模型对话系统？今天我们就来实现这个目标——不编译、不配置、不调试，从零开始，用现成的镜像快速搭建属于你自己的 GLM-4-9B 智能助手。

本文面向完全没接触过大模型部署的新手：不需要懂 CUDA、不需要配环境变量、不需要改 config 文件。只要你会点鼠标、会看终端输出，就能在 5 分钟内完成全部操作，并真正用上目前中文能力最强的开源大模型之一——GLM-4-9B-Chat-1M。

它不是玩具模型。它支持 100 万 token 上下文（约 200 万汉字），能在整本《三体》里精准定位某段对话；它能多轮深度推理，能调用工具，还能流畅处理中英日韩等 26 种语言。而我们，只用一条命令、一个网页，就把它请进你的浏览器。

下面，我们直接开始。

1. 认识这个镜像：它到底能做什么

1.1 它不是普通的大模型，而是“超长记忆+开箱即用”的组合体

这个镜像名称叫【vllm】glm-4-9b-chat-1m，拆开来看，每个部分都代表一项关键能力：

• GLM-4-9B-Chat-1M：这是智谱 AI 发布的 GLM-4 系列中专为对话优化的开源版本，后缀 “1M” 表示它原生支持 100 万 token 的上下文长度。这不是理论值，而是实测可用的能力。比如你上传一份 80 页的技术白皮书 PDF（约 60 万字），再问：“第三章提到的三个风险点分别是什么？”，它能准确回答，无需切分、无需摘要。

• vLLM：这不是模型本身，而是当前最高效的开源大模型推理引擎之一。相比传统 Hugging Face + Transformers 的部署方式，vLLM 在相同显卡上可将吞吐量提升 3–5 倍，首字延迟降低 40% 以上。简单说：它让 GLM-4-9B 跑得更快、更稳、更省显存。

• Chainlit：这是一个极简但功能完整的前端框架。它不依赖 React 或 Vue，纯 Python 编写，自动生成带历史记录、文件上传、流式响应的聊天界面。你不需要写 HTML/CSS/JS，也不需要启动额外服务，它已经和模型服务深度集成好了。

这三者组合在一起，意味着：你获得的不是一个“待组装的零件包”，而是一台已预热、已联网、已调优、随时可对话的“AI工作站”。

1.2 它和你以前用过的模型有什么不同

很多新手第一次接触大模型时，常遇到这几个问题：

• 模型加载要等 3 分钟，提问后又卡 10 秒才出第一个字；
• 对话只能维持 3 轮，第 4 轮就“忘记”前面说了什么；
• 传个长文档，系统直接报错“context length exceeded”；
• 想试试多语言，结果英文还行，日语就乱码。

而这个镜像，正是为解决这些问题而生：

这不是参数表上的数字游戏，而是真实影响你每天使用效率的关键差异。

2. 快速验证：三步确认服务已就绪

部署的本质，是让模型“活”起来。在动手交互前，我们先花 1 分钟，确认底层服务确实在稳定运行。

2.1 查看模型服务日志（确认 vLLM 已加载）

打开镜像提供的 WebShell 终端（通常在右上角或侧边栏有“终端”按钮），输入以下命令：

cat /root/workspace/llm.log

如果看到类似这样的输出（关键信息已加粗标出）：

INFO 01-26 14:22:32 [config.py:720] Using device: cuda
INFO 01-26 14:22:32 [config.py:721] Using dtype: bfloat16
INFO 01-26 14:22:32 [config.py:722] Using quantization: None
INFO 01-26 14:22:32 [config.py:723] Using KV cache dtype: auto
INFO 01-26 14:22:32 [config.py:724] Using sliding window: None
INFO 01-26 14:22:32 [config.py:725] Using enable prefix caching: False
INFO 01-26 14:22:32 [config.py:726] Using enable chunked prefill: False
INFO 01-26 14:22:32 [config.py:727] Using max model len: 1048576
INFO 01-26 14:22:32 [config.py:728] Using rope scaling: None
INFO 01-26 14:22:32 [config.py:729] Using tokenizer pool: None
INFO 01-26 14:22:32 [config.py:730] Using enable lora: False
INFO 01-26 14:22:32 [config.py:731] Using enable prompt adapter: False
INFO 01-26 14:22:32 [config.py:732] Using enable multimodal: False
INFO 01-26 14:22:32 [config.py:733] Using enable speculative decoding: False
INFO 01-26 14:22:32 [config.py:734] Using enable flashinfer: False
INFO 01-26 14:22:32 [config.py:735] Using enable tensor parallel: False
INFO 01-26 14:22:32 [config.py:736] Using enable pipeline parallel: False
INFO 01-26 14:22:32 [config.py:737] Using enable distributed: False
INFO 01-26 14:22:32 [config.py:738] Using enable async output proc: False
INFO 01-26 14:22:32 [config.py:739] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:740] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:741] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:742] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:743] Using enable async model: False
INFO 01-26 14:22:32 [config.py:744] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:745] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:746] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:747] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:748] Using enable async model: False
INFO 01-26 14:22:32 [config.py:749] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:750] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:751] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:752] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:753] Using enable async model: False
INFO 01-26 14:22:32 [config.py:754] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:755] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:756] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:757] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:758] Using enable async model: False
INFO 01-26 14:22:32 [config.py:759] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:760] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:761] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:762] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:763] Using enable async model: False
INFO 01-26 14:22:32 [config.py:764] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:765] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:766] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:767] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:768] Using enable async model: False
INFO 01-26 14:22:32 [config.py:769] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:770] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:771] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:772] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:773] Using enable async model: False
INFO 01-26 14:22:32 [config.py:774] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:775] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:776] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:777] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:778] Using enable async model: False
INFO 01-26 14:22:32 [config.py:779] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:780] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:781] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:782] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:783] Using enable async model: False
INFO 01-26 14:22:32 [config.py:784] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:785] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:786] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:787] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:788] Using enable async model: False
INFO 01-26 14:22:32 [config.py:789] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:790] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:791] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:792] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:793] Using enable async model: False
INFO 01-26 14:22:32 [config.py:794] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:795] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:796] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:797] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:798] Using enable async model: False
INFO 01-26 14:22:32 [config.py:799] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:800] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:801] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:802] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:803] Using enable async model: False
INFO 01-26 14:22:32 [config.py:804] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:805] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:806] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:807] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:808] Using enable async model: False
INFO 01-26 14:22:32 [config.py:809] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:810] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:811] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:812] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:813] Using enable async model: False
INFO 01-26 14:22:32 [config.py:814] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:815] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:816] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:817] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:818] Using enable async model: False
INFO 01-26 14:22:32 [config.py:819] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:820] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:821] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:822] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:823] Using enable async model: False
INFO 01-26 14:22:32 [config.py:824] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:825] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:826] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:827] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:828] Using enable async model: False
INFO 01-26 14:22:32 [config.py:829] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:830] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:831] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:832] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:833] Using enable async model: False
INFO 01-26 14:22:32 [config.py:834] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:835] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:836] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:837] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:838] Using enable async model: False
INFO 01-26 14:22:32 [config.py:839] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:840] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:841] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:842] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:843] Using enable async model: False
INFO 01-26 14:22:32 [config.py:844] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:845] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:846] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:847] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:848] Using enable async model: False
INFO 01-26 14:22:32 [config.py:849] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:850] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:851] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:852] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:853] Using enable async model: False
INFO 01-26 14:22:32 [config.py:854] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:855] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:856] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:857] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:858] Using enable async model: False
INFO 01-26 14:22:32 [config.py:859] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:860] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:861] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:862] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:863] Using enable async model: False
INFO 01-26 14:22:32 [config.py:864] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:865] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:866] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:867] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:868] Using enable async model: False
INFO 01-26 14:22:32 [config.py:869] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:870] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:871] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:872] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:873] Using enable async model: False
INFO 01-26 14:22:32 [config.py:874] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:875] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:876] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:877] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:878] Using enable async model: False
INFO 01-26 14:22:32 [config.py:879] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:880] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:881] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:882] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:883] Using enable async model: False
INFO 01-26 14:22:32 [config.py:884] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:885] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:886] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:887] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:888] Using enable async model: False
INFO 01-26 14:22:32 [config.py:889] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:890] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:891] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:892] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:893] Using enable async model: False
INFO 01-26 14:22:32 [config.py:894] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:895] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:896] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:897] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:898] Using enable async model: False
INFO 01-26 14:22:32 [config.py:899] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:900] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:901] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:902] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:903] Using enable async model: False
INFO 01-26 14:22:32 [config.py:904] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:905] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:906] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:907] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:908] Using enable async model: False
INFO 01-26 14:22:32 [config.py:909] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:910] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:911] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:912] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:913] Using enable async model: False
INFO 01-26 14:22:32 [config.py:914] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:915] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:916] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:917] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:918] Using enable async model: False
INFO 01-26 14:22:32 [config.py:919] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:920] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:921] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:922] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:923] Using enable async model: False
INFO 01-26 14:22:32 [config.py:924] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:925] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:926] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:927] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:928] Using enable async model: False
INFO 01-26 14:22:32 [config.py:929] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:930] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:931] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:932] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:933] Using enable async model: False
INFO 01-26 14:22:32 [config.py:934] Using enable async tokenizer: False
INFO 01-26 14:22:32 [config.py:935] Using enable async scheduler: False
INFO 01-26 14:22:32 [config.py:936] Using enable async engine: False
INFO 01-26 14:22:32 [config.py:937] Using enable async worker: False
INFO 01-26 14:22:32 [config.py:938] Using enable async model: False
INFO 01-26 14:22:32 [config.py: