Every number on this site is one the product can show on a demo, with its basis beneath it. This page is the method behind the numbers that will come from real pilots.
The design is agreed and written down before the first class. Nothing in it changes once the term has started.
One measure, chosen with the department before the term: the mean on the common final, or the share of students who fail or withdraw, in pilot sections against comparison sections. How it will be analysed is written down at the same time.
Sections of the same course, same term, without the product. The sections are named in the design, not chosen afterwards.
The institution's ethics committee approves the design. Students are informed in their language and can decline; the information and consent materials are part of the design.
No student in a comparison section is denied help. Comparison sections get the product the term after.
The report is co-authored with the department and published whether the measure moved or not.
The numbers on this site are facts about the product that a demo can show: which LMSs it connects to, which courses are ready, what a report contains. They are not estimates. Numbers about learning will come only from pilots run as described above, and are published here when they exist.
A worked report on the fictional institution, in the format a real pilot will produce: the written design, the sections, the analysis and the honest result. To follow.
None yet. Real pilot reports are published here as they are completed, with the department as co-author, whatever they say.
The pilot page lists what we commit to in writing; the demo is where the design starts.