kunato/typhoon15x_70b_agent.md

Created May 29, 2024 17:39

Star (0) You must be signed in to star a gist
Fork (0) You must be signed in to fork a gist

Select an option

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/kunato/1cf09df1a2a4df24a827ee01d735c681.js"></script>
Save kunato/1cf09df1a2a4df24a827ee01d735c681 to your computer and use it in GitHub Desktop.

Download ZIP

Raw

typhoon15x_70b_agent.md

Model	GAIA - Thai/English	GSM8K - Thai/English	HotpotQA - Thai/English
gpt-3.5-turbo-0125	18.42/37.5	70/80	39.56/59
Typhoon-1.5X 70B	17.10/36.25	80/95	52.7/65.83
gpt-4-0612	17.10/38.75	90/100	56.41/76.25
---	---	---	---
gpt-4o	44.73/57.5	100/100	71.64/76.58

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment