Authors:
(1) Arindam Mitra;
(2) Luciano Del Corro, work done while at Microsoft;
(3) Shweti Mahajan, work done while at Microsoft;
(4) Andres Codas, denote equal contributions;
(5) Clarisse Simoes, denote equal contributions;
(6) Sahaj Agarwal;
(7) Xuxi Chen, work done while at Microsoft;;
(8) Anastasia Razdaibiedina, work done while at Microsoft;
(9) Erik Jones, work done while at Microsoft;
(10) Kriti Aggarwal, work done while at Microsoft;
(11) Hamid Palangi;
(12) Guoqing Zheng;
(13) Corby Rosset;
(14) Hamed Khanpour;
(15) Ahmed Awadall. Table of Links Abstract and Introduction Preliminaries Teaching Orca 2 to be a Cautious Reasoner Technical Details Experimental Setup Evaluation Results Limitations Conclusions and References A. AGIEval Subtask Metrics B. BigBench-Hard Subtask Metrics C. Evaluation of Grounding in Abstractive Summarization D. Evaluation of Safety E. Prompts used in Evaluation F. Illustrative Example from Evaluation Benchmarks and Corresponding Model Outpu F Illustrative Example from Evaluation Benchmarks and Corresponding Model Output This paper is available on arxiv under CC 4.0 license. Authors: (1) Arindam Mitra; (2) Luciano Del Corro, work done while at Microsoft; (3) Shweti Mahajan, work done while at Microsoft; (4) Andres Codas, denote equal contributions; (5) Clarisse Simoes, denote equal contributions; (6) Sahaj Agarwal; (7) Xuxi Chen, work done while at Microsoft;; (8) Anastasia Razdaibiedina, work done while at Microsoft; (9) Erik Jones, work done while at Microsoft; (10) Kriti Aggarwal, work done while at Microsoft; (11) Hamid Palangi; (12) Guoqing Zheng; (13) Corby Rosset; (14) Hamed Khanpour; (15) Ahmed Awadall. Authors: Authors: (1) Arindam Mitra; (2) Luciano Del Corro, work done while at Microsoft; (3) Shweti Mahajan, work done while at Microsoft; (4) Andres Codas, denote equal contributions; (5) Clarisse Simoes, denote equal contributions; (6) Sahaj Agarwal; (7) Xuxi Chen, work done while at Microsoft;; (8) Anastasia Razdaibiedina, work done while at Microsoft; (9) Erik Jones, work done while at Microsoft; (10) Kriti Aggarwal, work done while at Microsoft; (11) Hamid Palangi; (12) Guoqing Zheng; (13) Corby Rosset; (14) Hamed Khanpour; (15) Ahmed Awadall. Table of Links Abstract and Introduction Abstract and Introduction Preliminaries Preliminaries Teaching Orca 2 to be a Cautious Reasoner Teaching Orca 2 to be a Cautious Reasoner Technical Details Technical Details Experimental Setup Experimental Setup Evaluation Results Evaluation Results Limitations Limitations Conclusions and References Conclusions and References A. AGIEval Subtask Metrics A. AGIEval Subtask Metrics B. BigBench-Hard Subtask Metrics B. BigBench-Hard Subtask Metrics C. Evaluation of Grounding in Abstractive Summarization C. Evaluation of Grounding in Abstractive Summarization D. Evaluation of Safety D. Evaluation of Safety E. Prompts used in Evaluation E. Prompts used in Evaluation F. Illustrative Example from Evaluation Benchmarks and Corresponding Model Outpu F. Illustrative Example from Evaluation Benchmarks and Corresponding Model Outpu F Illustrative Example from Evaluation Benchmarks and Corresponding Model Output This paper is available on arxiv under CC 4.0 license. This paper is available on arxiv under CC 4.0 license. available on arxiv

Part of HackerNoon's growing list of open-source research papers, promoting free access to academic material.

Orca 2: Enhancing Reasoning in Smaller Language Models - Example from Benchmarks and Output

About Author

Comments

TOPICS

THIS ARTICLE WAS FEATURED IN

Related Stories

102 Languages, One Model: The Multimodal AI Breakthrough You Need to Know

Orca 2: Enhancing Reasoning in Smaller Language Models - Abstract and Introduction

Orca 2: Enhancing Reasoning in Smaller Language Models - Preliminaries

Orca 2: Enhancing Reasoning in Smaller Language Models - Teaching Orca 2

Orca 2: Enhancing Reasoning in Smaller Language Models - Technical Details

Orca 2: Enhancing Reasoning in Smaller Language Models - Experimental Setup

102 Languages, One Model: The Multimodal AI Breakthrough You Need to Know

Orca 2: Enhancing Reasoning in Smaller Language Models - Abstract and Introduction

Orca 2: Enhancing Reasoning in Smaller Language Models - Preliminaries

Orca 2: Enhancing Reasoning in Smaller Language Models - Teaching Orca 2

Orca 2: Enhancing Reasoning in Smaller Language Models - Technical Details

Orca 2: Enhancing Reasoning in Smaller Language Models - Experimental Setup

Light-Mode

Classic

Newspaper

Minty

Dark-Mode

Neon Noir

Minty

HN StartUps