AntilliaAntillia
Contact ↗ PL
IntentRoute / Recorded study

How often is the topic correct?

Explore the recorded study results. Changing a selection shows another part of the report.

Accuracy · Validation set

Higher values indicate better performance on this metric.

TF–IDF
87.3%
Embeddings + MLP
90.3%

Macro F1 · Validation set

Higher values indicate better performance on this metric.

TF–IDF
0.8746
Embeddings + MLP
0.9052

Top-three accuracy · Validation set

Higher values indicate better performance on this metric.

TF–IDF
96.15%
Embeddings + MLP
97.55%

Accuracy · Test set

Higher values indicate better performance on this metric.

TF–IDF
87.73%
Embeddings + MLP
90.72%

Macro F1 · Test set

Higher values indicate better performance on this metric.

TF–IDF
0.8781
Embeddings + MLP
0.9074

Top-three accuracy · Test set

Higher values indicate better performance on this metric.

TF–IDF
96.16%
Embeddings + MLP
97.49%

Reading the result

Accuracy on 12 authored Polish examples: 66.67%. This is not a representative Polish benchmark.