Measuring ourselves against Manus, on Manus's own tasks
We are reproducing the ten most STEM-relevant Manus examples on mit.nonlocally.org with the same input, scoring both on a preregistered six-axis rubric, and recording each run. The first two examples are in, and both scored zero, for reasons worth writing down.