Skip to main content

Agent coverage

Control how many visitors receive your AI agents and maintain a control group to measure agent impact and performance.

Written by Vasil Dachev

Agent coverage lets you control how widely your agents run across your visitors while keeping a portion of traffic untouched as a control group.

This gives you a consistent baseline for comparing the experience and measuring the impact of your agents.

How agent coverage works

Agent coverage determines what percentage of your visitors will receive your active agents.

The remaining visitors are kept in a control group and experience your site without agents.

For example, if you set agent coverage to 90%:

  • 90% of visitors will receive your agents.

  • 10% of visitors will remain without agents as the control group.

The control group gives you a baseline that you can use to compare results between visitors who experienced your agents and those who did not.

How to configure agent coverage

  1. Go to Settings.

  2. Open Site settings.

  3. Select Agent coverage.

  4. Use the slider to choose the percentage of visitors who should receive your agents.

  5. Click Save changes.

You can choose any coverage level while keeping at least 10% of visitors in the control group.

Understanding the coverage percentage

The percentage you select represents the share of visitors who will have your agents active.

For example:

Agent coverage

Visitors with agents

Control group

90%

90%

10%

75%

75%

25%

50%

50%

50%

25%

25%

75%

Keeping a control group allows you to compare performance between visitors who are exposed to your agents and those who aren't.

Measuring agent impact

Agent coverage is particularly useful when you want to understand the real-world impact of your agents.

With a control group in place, you can compare outcomes between:

  • Visitors with agents - visitors who received the agent-powered experience.

  • Control group - visitors who experienced your site without agents.

This can help you evaluate whether your agents are contributing to improvements in areas such as performance, engagement, conversion, and revenue.

For meaningful comparisons, allow enough traffic to accumulate before evaluating the results. Smaller sample sizes can produce larger fluctuations and may not represent the longer-term impact of your agents.

Disabling agents

If you want to temporarily disable all agents, you don't need to change or remove their individual configurations.

Simply:

  1. Go to Settings.

  2. Open Site settings.

  3. Select Agent coverage.

  4. Set coverage to 0%.

  5. Click Save changes.

Setting coverage to 0% disables all agents while keeping their existing configuration intact.

Best practices

Keep a control group

Keep at least 10% of your visitors without agents so you have a baseline for comparison.

Give your experiment enough traffic

Avoid drawing conclusions from a small number of visitors. The more data you collect, the more useful the comparison becomes.

Use coverage to gradually roll out agents

You can start with a lower coverage percentage and increase it as you validate your agents' impact.

Use 0% when you need to pause agents

Setting coverage to 0% is useful when you want to temporarily stop agents without changing their individual configurations.

In summary

Agent coverage gives you control over how widely your agents run while maintaining a control group for comparison.

Use it to gradually roll out agents, measure their impact, or temporarily disable them without changing your agent configuration.

Did this answer your question?