Evidence, not claims

Every number on this site is one the product can show on a demo, with its basis beneath it. This page is the method behind the numbers that will come from real pilots.

How a pilot is measured

The design is agreed and written down before the first class. Nothing in it changes once the term has started.

  1. What will be measured

    One measure, chosen with the department before the term: the mean on the common final, or the share of students who fail or withdraw, in pilot sections against comparison sections. How it will be analysed is written down at the same time.

  2. Which sections are compared

    Sections of the same course, same term, without the product. The sections are named in the design, not chosen afterwards.

  3. Ethics approval and consent

    The institution's ethics committee approves the design. Students are informed in their language and can decline; the information and consent materials are part of the design.

  4. Nobody is denied help

    No student in a comparison section is denied help. Comparison sections get the product the term after.

  5. Published whatever it says

    The report is co-authored with the department and published whether the measure moved or not.

Where the numbers come from

The numbers on this site are facts about the product that a demo can show: which LMSs it connects to, which courses are ready, what a report contains. They are not estimates. Numbers about learning will come only from pilots run as described above, and are published here when they exist.

Reports

  • Sample pilot report

    A worked report on the fictional institution, in the format a real pilot will produce: the written design, the sections, the analysis and the honest result. To follow.

  • Publications

    None yet. Real pilot reports are published here as they are completed, with the department as co-author, whatever they say.

Design a pilot with us

The pilot page lists what we commit to in writing; the demo is where the design starts.