Menu

Individual skill

send-experiment-designer

0upvotes

Use when the user asks to "design an email A/B test", "set up a multivariate subject/CTA test", "run a send-time test", "build a hold-out group", or "is this email result statistically and practically material?"; produces a falsifiable hypothesis, one-variable-per-cell matrix, sample-size/MDE/duration/power plan, and an effect/uncertainty read from own ESP data. Applies only a precommitted owner-approved action rule; the helper never chooses a business action. Not for EQS/vetoes or writing the email. 邮件AB测试设计/多变量测试/发送时间测试/留出组/显著性判定

email/deliver/send-experiment-designer/SKILL.md

Read pinned source

Source commit 8be02f1f0b18253bd5f2b85f858278f042637b9a

What was checked

Matches the observed repository HEAD
Yes
Scanner rules are current
No
Repository scan complete
No
Skill scan complete
No
Observed behavior
Not checked yet
Last checked
Nov 9, 2026

These are observations at the recorded commit, not a guarantee of safety. Review the source before running it.

Install this skill

Choose an agent in your Stack or copy a command below. Commands fetch the pinned commit and copy only this skill directory. Existing destinations are refused. Copying a command does not install anything.

An install command is unavailable: current rules, complete repository and skill scans, an eligible behavior level and a permitted license are required.

Repository context

Repository stars (not skill ratings)
3,135
Repository last updated
Nov 12, 2026
License
Apache-2.0

Observed agent integration: No specific integration evidence. Standard SKILL.md installation does not imply verified compatibility.

Declared tags are partial or unavailable.

Files and excerpt

File metadata and permitted, redacted excerpts come from the recorded scan. Source links are pinned to that commit.

Browse files
Read excerpt

# Send Experiment Designer

Designs email experiments across four modes and reads them out: a falsifiable hypothesis, a variant matrix that isolates **one** variable per cell, a sample-size / minimum-detectable-effect / run-duration / power plan, and a documented effect/uncertainty read. It may apply an owner-approved precommitted action rule, but statistical output alone never chooses a business action.

**Mode set (pick one):**

| Mode | Isolated variable | Primary metric |
|------|-------------------|----------------|
| `a-b` | one change — subject *or* preheader *or* CTA *or* creative | open (subject) / click / CTOR (CTA/creative) |
| `multivariate` | 2+ factors crossed (e.g. subject × CTA), one variable per cell | the goal metric, powered per cell |
| `send-time` | deploy hour/day; subject, segment, creative held constant | same-window engagement (open/click) |
| `hold-out` | send vs no-send (randomized control receives nothing / current default) | conversion or revenue-per-recipient (incremental lift) |

Default the mode from the request when it is unambiguous (e.g. "test two subject lines" → `a-b`, "best hour to send" → `send-time`, "measure incremental revenue" → `hold-out`); state the picked mode back and proceed.
Back to top