What are 10,000 monthly interactions?
An interaction refers to a query or request that a user makes to an agent trained with
RAG (Retrieval-Augmented Generation). Each interaction consumes tokens, which
are units of text processed by the model.
Tokens:
Depending on the complexity of the query and the response, an interaction may consume between 50 and 500 tokens
(or more). For example:
- A short question like "What is the capital of France?" might consume ~50 tokens.
- A more complex query like "Explain the theory of relativity" might consume ~300 tokens.
Daily Interaction Distribution
If you have 10,000 monthly interactions, we can calculate how many interactions would occur daily:
- Daily interactions: 10,000 interactions / 30 days = ~333 interactions per day.
- Interactions per hour: 333 interactions / 24 hours = ~14 interactions per hour.
This means that, on average, your agent would handle 14 interactions per hour, which is manageable for a
well-optimized system.
Usage Scenarios and Number of Users
The number of people who can interact daily with your agent depends on how frequently each user interacts. Here
are some scenarios:
- Scenario 1: Customer Support
Interactions per user: 2-3 per day.
Number of users: 333 interactions / 2.5 (average) = ~133 daily users.
- Scenario 2: Online Education
Interactions per user: 1 per day.
Number of users: 333 interactions / 1 = ~333 daily users.
- Scenario 3: Personal Assistant
Interactions per user: 5-10 per day.
Number of users: 333 interactions / 7.5 (average) = ~44 daily users.
Practical Examples
- Example 1: Technical Support
User: "How do I reset my password?"
Agent: "To reset your password, go to 'Settings' and select 'Reset Password'. We will send you an email with instructions."
Tokens consumed: ~50.
- Example 2: Educational Query
User: "Explain photosynthesis."
Agent: "Photosynthesis is the process by which plants convert sunlight, water, and carbon dioxide into glucose and
oxygen. It occurs in the chloroplasts of plant cells."
Tokens consumed: ~100.
- Example 3: Personal Assistant
User: "What movies are trending?"
Agent: "Currently, the most popular movies are 'Dune: Part Two,' 'Oppenheimer,' and 'Spider-Man: Across the Spider-Verse.'
Would you like to see trailers or reviews?"
Tokens consumed: ~150.