Top-p Sampling
Full Form: Top-p (Nucleus) Sampling
Category: AI Usage
📖 Definition
Top-p sampling controls output diversity by limiting AI to consider only the most probable tokens that together make up a certain probability mass. It offers another way to control creativity.
🔑 Key Points
- Alternative to temperature for controlling randomness
- Top-p of 0.9 means considering tokens making up 90% probability
- Often used together with temperature for fine control
- Lower values = more focused; higher = more diverse
💡 Why It Matters
Top-p provides fine-grained control over AI output. Understanding it helps you get more precise control over AI responses.