✅ Checkpoint 1: Research foundations
A mixed quiz on Parts 1 and 2. Pass mark: 7 of 9 on the first try.
How this checkpoint works
Answer without looking back; only your first try counts.
Quiz
1. A paper's contribution is best described as…
2. In the three-pass method, which pass reveals hidden assumptions?
3. Every paper in your synthesis matrix uses English and none reports variance. This suggests…
4. Which question passes FINER best for a 4-month project with one GPU?
5. Your method uses 3× the compute of the baseline. The fair comparison…
6. Five seeds give 81.2 ± 1.4 for A and 81.9 ± 1.3 for B. You report…
7. A paired bootstrap CI for (B − A) is [−0.3, +1.1]. Conclusion?
8. You evaluated 15 variants and 2 were significant at 0.05 without correction. Best practice?
9. Before collecting ratings from clinicians, you need…
📚 Further reading
Trusted, mostly free sources: official documentation, well-known textbooks and courses. When you want to confirm or go deeper on anything here, start with these.
- Dror et al., The Hitchhiker's Guide to Testing Statistical Significance in NLP (ACL 2018) ↗ which test to use when
- Pineau, Machine Learning Reproducibility Checklist ↗ the checklist many venues adopted