为熟悉传统 IT 的人准备的 AI 术语解析。每个术语都配有一条传统 IT 类比，让你把已有的知识直接映射到新概念上。
37 个术语
传统 IT 类比: The new general-purpose server: one box that runs almost any text workload you throw at it.
A neural network trained on massive amounts of text to predict the next token, which in practice lets it write, summarize, translate, and reason in natural language. GPT, Claude, and Gemini are LLMs. Everything else in this glossary exists to feed, steer, or constrain one.
相关术语: Token · Parameters · Inference · Frontier model
传统 IT 类比: The byte of the AI world — the smallest unit models read, and the unit you're billed in.
A chunk of text, roughly three-quarters of an English word, that models process and providers meter. API pricing is quoted per million tokens, split into input (what you send) and output (what the model writes). A page of prose is about 500 tokens.
相关术语: Context window · Inference · API pricing
传统 IT 类比: RAM for a conversation: fixed capacity, and when it's full something gets evicted.
The maximum number of tokens a model can consider at once — your prompt, the conversation history, retrieved documents, and the reply all share it. Models range from 64K to over 1M tokens. Overflow doesn't error; the model just stops seeing what fell out.
传统 IT 类比: The new CLI: precise input in, useful output out — vague input in, garbage out.
The text you send a model to make it do something. Prompting rewards the same skills as good shell commands and tickets: explicit requirements, examples, constraints, and expected output format. It is the primary programming interface of the AI age.
相关术语: System prompt · Zero-shot / few-shot · Prompt injection
传统 IT 类比: Group Policy for a model: standing rules applied before any user request.
Instructions set by the application (not the end user) that define a model's role, tone, rules, and boundaries for the whole session. User messages are interpreted inside whatever the system prompt established.
相关术语: Prompt · Guardrails · Prompt injection
传统 IT 类比: Runtime, as opposed to build time — serving requests with a model that's already trained.
Running a trained model to produce output. Every chat message, API call, and agent step is inference. It's what you pay for per token, as opposed to training, which happened once at enormous cost before you ever showed up.
相关术语: Training · Token · Latency vs throughput
传统 IT 类比: Burning the firmware: done in the factory, not something you do in production.
The process of adjusting a model's billions of parameters against training data until it predicts well. It costs millions of dollars in GPU time and is done by the model provider — almost nobody else trains models from scratch. What most teams call 'training' is actually fine-tuning or RAG.
相关术语: Fine-tuning · Parameters · Inference
传统 IT 类比: The spec-sheet number, like core count — bigger usually means more capable and more expensive to run.
The learned numeric weights inside a model; '7B' means seven billion of them. Parameter count roughly tracks capability and directly drives memory needs: a 7B model runs on a laptop, a 70B model wants a serious GPU or a Mac with lots of unified memory.
相关术语: Quantization · Local model · VRAM / unified memory
传统 IT 类比: A custom image on top of the vendor OS: same core, your specifics baked in.
Continuing a model's training on your own examples so behavior you'd otherwise cram into every prompt becomes the default. Useful for consistent format and tone at volume; usually the wrong first move — most teams get further with better prompts and RAG.
传统 IT 类比: Giving the model read access to your file share instead of asking it to remember everything.
An architecture where relevant documents are fetched (usually via embeddings and a vector database) and pasted into the prompt so the model answers from your data instead of its training memory. It's how 'chat with your docs' products work, and the standard cure for hallucinated facts about your own systems.
相关术语: Embedding · Vector database · Hallucination · Context window
传统 IT 类比: A hash for meaning: similar content produces nearby values, so you can index by 'what it's about.'
A list of numbers representing a text's meaning, produced by an embedding model. Texts about similar things land near each other in that number space, which is what makes semantic search possible: you match by meaning, not keywords.
相关术语: Vector database · RAG
传统 IT 类比: An index tuned for one query: 'find records that mean roughly this.'
A database that stores embeddings and answers nearest-neighbor queries fast. It's the storage layer of RAG. Pinecone, pgvector, and Qdrant are common choices; for small datasets a plain array and cosine similarity works fine.
传统 IT 类比: A confident wrong answer from a system with no error code — the silent data corruption of AI.
When a model states something false as fact, fluently and without any signal of uncertainty. It's a structural property of next-token prediction, not a bug that will be patched out. Mitigations: RAG for grounding, asking for sources, verification steps, and never shipping unreviewed model output where correctness matters.
相关术语: RAG · Evals · Temperature
传统 IT 类比: A jitter knob: zero for reproducible runs, higher for variety.
A sampling setting controlling how random the model's word choices are. Low (0–0.3) gives consistent, focused output for extraction and code; higher (0.7+) gives variety for brainstorming and creative work. It does not control accuracy — a temperature-0 model still hallucinates.
相关术语: Hallucination · Inference
传统 IT 类比: Cron plus a script that can improvise: work delegated end-to-end, not step-by-step.
A model given tools and a goal, running in a loop: assess, act, check results, act again until done. Unlike a chatbot answering one message, an agent might search, run code, edit files, and retry failures. Power and risk both come from the same place — it acts without you approving each step.
相关术语: Tool use · MCP · Orchestration · Guardrails
传统 IT 类比: Syscalls for models: the defined interface through which the model touches the real world.
The mechanism by which a model invokes external capabilities — search, database queries, code execution, APIs — by emitting structured calls the host application executes. Everything an agent does beyond generating text goes through tool use.
传统 IT 类比: ODBC for AI: one standard connector instead of a custom integration per app-and-tool pair.
An open protocol that standardizes how AI applications connect to tools and data sources. An MCP server exposes capabilities (your database, your ticket system); any MCP-capable assistant can use them without custom integration code. It's becoming the middleware layer of the AI stack.
传统 IT 类比: Compression for models: trade a little fidelity for a lot less memory.
Storing model weights with fewer bits. Q4 shrinks a model to roughly a quarter of full size with modest quality loss, which is what makes running 7B–70B models on consumer hardware possible at all. Most local-AI users run Q4 or Q8.
相关术语: Parameters · Local model · VRAM / unified memory
传统 IT 类比: On-prem instead of cloud: your hardware, your data, no per-request bill.
A model whose weights you download and run yourself with tools like Ollama or LM Studio. Weaker than frontier hosted models, but free per token, offline-capable, and private — data never leaves the machine. The practical question is memory: parameters times quantization must fit your RAM or VRAM.
相关术语: Quantization · Open weights · VRAM / unified memory · Frontier model
传统 IT 类比: Freeware, not open source: you get the binary to run, not the build system.
Models whose trained weights are published for download (Llama, Mistral, DeepSeek) under licenses of varying permissiveness. 'Open weights' is not full open source — training data and code usually stay private. It's what makes local AI and self-hosting possible.
相关术语: Local model · Frontier model
传统 IT 类比: The flagship SKU: the most capable tier on the market, priced accordingly.
The most capable models available at a given time — currently the top GPT, Claude, and Gemini tiers. They cost the most per token and handle the hardest reasoning. Most workloads don't need one: routing easy work to cheaper tiers is the single biggest AI cost lever.
相关术语: API pricing · Local model · LLM
传统 IT 类比: Metered hosting instead of a flat-rate plan — pay for exactly what you use.
Direct model access billed per million tokens, input and output priced separately. Light users usually beat a $20/month subscription with API pricing; heavy users often don't. Batch endpoints (~50% off) and cached input (up to 90% off) change the math substantially.
相关术语: Token · Frontier model · BYOK
传统 IT 类比: Using your own license with someone else's tooling.
A pattern where an application lets you plug in your own API key, so you pay the provider directly for usage instead of paying the app a marked-up subscription. Often the cheapest way to get frontier AI into a workflow you control.
相关术语: API key · API pricing
传统 IT 类比: A service account credential — and it deserves the same paranoia.
The secret that authenticates your requests to a model provider and bills your account. Treat like any credential: environment variables or a secrets manager, never in client-side code or a repo, rotate on exposure, set spend limits. Leaked AI keys get abused within hours.
相关术语: BYOK · Rate limit
传统 IT 类比: QoS on the provider's side: exceed your tier and requests get throttled, not queued.
Provider-enforced caps on requests and tokens per minute, by account tier. Production AI systems need the same discipline as any rate-limited API: backoff with retries, request queuing, and monitoring for 429s.
相关术语: API key · Latency vs throughput
传统 IT 类比: SQL injection's successor: untrusted input that gets executed as instructions.
An attack where content the model processes — a web page, an email, a document — contains instructions the model then follows as if they came from the user. It's the top security issue for agents and RAG systems. Defenses are partial: treat all fetched content as untrusted, limit tool permissions, and require human approval for consequential actions.
相关术语: Jailbreak · Guardrails · Agent
传统 IT 类比: Privilege escalation against the model's policy layer instead of the OS.
Prompting techniques that trick a model into ignoring its safety rules. Distinct from prompt injection: jailbreaks target the model's own limits, injections hijack it through content it processes. Providers patch known jailbreaks continuously; none stay reliable for long.
相关术语: Prompt injection · Guardrails
传统 IT 类比: Firewall rules for model behavior: allow, deny, and log at the boundary.
The checks around a model that constrain what goes in and what comes out — input filtering, output validation, permission limits on tools, human approval gates. In practice guardrails live in your application code, not inside the model.
相关术语: System prompt · Prompt injection · Evals
传统 IT 类比: The test suite: without one, every model or prompt change is a deploy on faith.
Systematic tests for AI behavior — a set of inputs with expected properties, run against every prompt change or model upgrade. Evals are how you know the new model version didn't quietly break your extraction format. The AI equivalent of CI.
相关术语: Benchmark · Hallucination · Guardrails
传统 IT 类比: Synthetic load tests: useful signal, but never mistake them for your production workload.
Standardized public test sets (MMLU, SWE-bench, and dozens more) used to compare models. Directionally useful, heavily marketed, and increasingly gamed. Your own evals on your own tasks beat any leaderboard.
相关术语: Evals · Frontier model
传统 IT 类比: One port that accepts more than one protocol: text, images, audio through the same interface.
Models that accept and/or produce more than text — reading screenshots, diagrams, and PDFs, or generating images and speech. Practically: you can paste a screenshot of an error dialog instead of retyping it.
传统 IT 类比: tail -f on the response instead of waiting for the job to finish.
Receiving a model's output token-by-token as it generates rather than all at once at the end. It's why chat UIs feel responsive despite multi-second total generation times. API consumers handle it as server-sent events.
相关术语: Latency vs throughput · Inference
传统 IT 类比: The same tradeoff you tuned in every system: response time versus jobs per hour.
Time-to-first-token and tokens-per-second determine how fast one response feels; throughput is how much total work you push through. Interactive use optimizes the former, batch pipelines the latter — batch APIs trade hours of delay for ~50% lower cost.
相关术语: Streaming · API pricing · Inference
传统 IT 类比: The disk-space check of the AI age: the model file must fit or nothing runs.
GPU memory (VRAM) is the hard constraint for running models locally at speed — the quantized model must fit in it. Apple Silicon's unified memory lets the GPU use most of system RAM, which is why a 32 GB MacBook can run models a PC would need a 24 GB graphics card for.
相关术语: Local model · Quantization · Parameters
传统 IT 类比: Spec-only versus spec-plus-examples — and examples win more arguments than specs.
Zero-shot means asking a model to do a task from instructions alone; few-shot means including worked examples in the prompt. Two or three good examples routinely fix output-format problems that paragraphs of instructions can't.
相关术语: Prompt · Fine-tuning
传统 IT 类比: Verbose mode for thinking: slower, costlier, and far better on hard multi-step problems.
Having a model work through intermediate steps before answering — either prompted ('think step by step') or built in, as with dedicated reasoning models that spend extra 'thinking' tokens. You pay for those tokens; use reasoning tiers for genuinely hard problems, not lookups.
相关术语: Frontier model · Token · Prompt
传统 IT 类比: The job scheduler layer: many workers, dependencies, retries — the pipeline thinking you already know.
Coordinating multiple model calls or agents into a workflow — routing easy tasks to cheap models, fanning out parallel subtasks, verifying outputs before the next stage. This is where old-IT pipeline and queue experience transfers directly to AI systems.
相关术语: Agent · Evals · API pricing
用免费的 AI 工具把这些术语用起来：