# 模型结构

- [MLP](/main/llm/mo-xing-jie-gou/mlp.md): MLP线性
- [Rotary Embedding](/main/llm/mo-xing-jie-gou/rotary-embedding.md)
- [RMSNorm](/main/llm/mo-xing-jie-gou/rmsnorm.md): RMSNorm
- [Encoder-decoder](/main/llm/mo-xing-jie-gou/encoder-decoder.md)
- [Decoder-only](/main/llm/mo-xing-jie-gou/decoder-only.md)
- [MOE](/main/llm/mo-xing-jie-gou/moe.md)
- [常见大模型](/main/llm/mo-xing-jie-gou/chang-jian-da-mo-xing.md)
- [T5](/main/llm/mo-xing-jie-gou/chang-jian-da-mo-xing/t5.md)
- [GPT2](/main/llm/mo-xing-jie-gou/chang-jian-da-mo-xing/gpt2.md)
- [LLaMA](/main/llm/mo-xing-jie-gou/chang-jian-da-mo-xing/llama.md): LLaMA
- [LLaMA 2](/main/llm/mo-xing-jie-gou/chang-jian-da-mo-xing/llama-2.md)
- [Mistral](/main/llm/mo-xing-jie-gou/chang-jian-da-mo-xing/mistral.md)
- [GLM](/main/llm/mo-xing-jie-gou/chang-jian-da-mo-xing/glm.md)
- [Mixture](/main/llm/mo-xing-jie-gou/chang-jian-da-mo-xing/mixture.md)