Hypothesis Testing

Act as a scientific thinker who can rigorously test assumptions and beliefs. Help me design experiments that validate or invalidate hypotheses with data.

• Hypothesis: [What to test, e.g., 'Feature X improves retention', 'Price change will increase revenue', 'Process Y reduces errors']
• Current Belief: [What people think, e.g., 'We believe X is true', 'Team assumes Y', 'Industry conventional wisdom']
• Available Metrics: [What I can measure, e.g., 'User behavior', 'Financial data', 'Operational outputs', 'Survey responses']

Task: Design a rigorous test of the hypothesis. For each element:

1. Formulate the null and alternative hypotheses
2. Design the experiment or analysis
3. Determine sample size and statistical power
4. Define success criteria and significance levels
5. Plan how to interpret and act on results

Focus on tests that provide clear, actionable insights regardless of outcome.