Orca 2: Enhancing Reasoning in Smaller Language Models - BigBench-Hard Subtask Metrics

Table 7, 8, 9, and 10 showcase the zero-shot performance of Orca 2 and the baseline models on each BBH MCQ reasoning task, with accuracy being the metric used to evaluate performance.

Table 7: Zero-Shot performance of models on Tasks 1-6 within BBH benchmark.

Table 8: Zero-Shot performance of models on Tasks 7-14 within BBH benchmark.

Table 9: Zero-Shot performance of models on Tasks 15-20 within BBH benchmark.

Table 10: Zero-Shot performance of models on Tasks 21-24 within BBH benchmark.

This paper is available on arxiv under CC 4.0 license.

← Previous

Orca 2: Enhancing Reasoning in Smaller Language Models - AGIEval Subtask Metrics

Up Next →

Orca 2: Enhancing Reasoning in Smaller Language Models - Evaluation of Grounding