All Lessons

What proportion of a token budget is typically allocated to the system prompt?

1 / 2
intermediate 20 min

Token Budgeting

Loading lesson content...

A team has a 200K context budget. System prompt is 5K, conversation history is 180K, leaving 15K for new user input. What's wrong with this budget?

1 / 2

A system uses a fixed 10K token budget but some requests need 5K and others need 80K. What architecture handles this?

1 / 2