Written analysis plan before fieldwork closes
Analysis decided after the data arrives tends to chase whatever looks interesting, and a survey with no stated questions produces fifty tables and no answer. Writing down the three to five decisions the survey must inform, the key measures, the subgroups to compare and the tests to run, before the survey closes, keeps the findings honest and the report short.
First tasks
- Write the three to five decisions the survey results must inform
- Map each research question to the question numbers that answer it
- List the subgroups to compare and estimate the base size of each
- Mark the primary measures and send the plan to the survey sponsor