We computed the accuracy of our Art Unit Predictor over a set of 10,000 patent applications (separate from our training data). Here are the results as of January 2022.

Group Prediction (57 groups)

• Top prediction has 71% accuracy
• Top 3 prediction has 91% accuracy

Art Unit Prediction (504 art units)

• Top prediction has 52% accuracy
• Top 5 prediction has 82% accuracy

We have worked extremely hard to achieve this level of accuracy, and are very pleased with the results. This prediction task is very challenging because of (i) the large number of groups and art units and (ii) inconsistencies in the assignments done by the USPTO (humans are involved).