ProjectAvailabilityDocumentationAccess
Open codeLLM dataLLM weightsRL dataRL weightsLicenseCodeArchitecturePreprintPaperModelcardDatasheetPackageAPI
OLMo 7B Instruct✔︎✔︎✔︎✔︎✔︎✔︎✔︎✔︎✔︎✘✔︎✔︎✔︎~
BLOOMZ✔︎✔︎✔︎✔︎~~✔︎✔︎✔︎✔︎✔︎✔︎✘✔︎
AmberChat✔︎✔︎✔︎✔︎✔︎✔︎~~✔︎✘~~✘✔︎
Open Assistant✔︎✔︎✔︎✔︎✘✔︎✔︎✔︎~✘✘✘✔︎✔︎
OpenChat 3.5 7B✔︎✘✔︎✘✔︎✔︎~✔︎✔︎✔︎~✘✔︎~
Pythia-Chat-Base-7B-v0.16✔︎✔︎✔︎✔︎✘✔︎✔︎✔︎~✘~~✔︎✘
Cerebras GPT 111M Instruction~✔︎✔︎✔︎✔︎~✘✔︎~✘✘✔︎✘✔︎
RedPajama-INCITE-Instruct-7B~✔︎✔︎✔︎✔︎~~~✘✘✔︎✔︎✘~
dolly✔︎✔︎✔︎✔︎✘✔︎✔︎✔︎~✘✘✘✔︎✘
Tulu V2 DPO 70B✔︎✘~✔︎✔︎~~~✔︎✘~~✘✔︎
MPT-30B Instruct✔︎~✔︎~✘✔︎✔︎~✘✘~✘✔︎~
MPT-7B Instruct✔︎~✔︎~✘✔︎✔︎~✘✘✔︎✘✔︎✘
trlx✔︎✔︎✔︎~✘✔︎✔︎~✘✘✘✘~✔︎
NeuralChat 7B~✘✔︎✔︎✔︎✔︎~~✘✘~~~✘
Vicuna 13B v 1.3✔︎~✔︎✘✘~✔︎✘✔︎✘~✘✔︎~
minChatGPT✔︎✔︎✔︎~✘✔︎✔︎~✘✘✘✘✘✔︎
ChatRWKV✔︎~✔︎✘✘✔︎~~~✘✘✘✔︎~
BELLE✔︎~~~~✘~✔︎✔︎✘✘~✘✘
Geitje Ultra 7B✘~✔︎✔︎✔︎✘✘~~✘~~✘~
Phi 3 Instruct✘✘✘✘✔︎✔︎✘✔︎~✘✔︎✘~✔︎
WizardLM 13B v1.2~✘~✔︎✔︎~~✔︎✔︎✘✘✘✘✘
Airoboros L2 70B GPT4~✘~✔︎✔︎~~~✘✘~~✘✘
ChatGLM-6B~~✔︎✘✘✔︎~~✘~✘✘✘✔︎
Mistral 7B-Instruct~✘✔︎✘~✔︎✘~~✘✘✘~✔︎
WizardLM-7B~~✘✔︎~~~✔︎✔︎✘✘✘✘✘
Mistral NeMo Instruct~✘✔︎✘~✔︎✘~✘✘✘✘~✔︎
Qwen 1.5~✘✔︎✘✔︎✘~~✘✘✘✘~✔︎
StableVicuna-13B~✘~~~~~~~✘~✘✘~
Falcon-40B-instruct✘~✔︎~✘✔︎✘~~✘~✘✘✘
UltraLM✘✘~✔︎~✘✘~✔︎✘~~✘✘
Yi 34B Chat~✘✔︎✘✔︎~✘✘✔︎✘✘✘✘~
Koala 13B✔︎~~~✘~~~✘✘✘✘✘✘
Llama 3.1~✘~✘✘✘~~✘✘~✘✔︎~
Mixtral 8x7B Instruct✘✘✔︎✘~✔︎✘~~✘✘✘~✘
Stable Beluga 2✘✘~✘✔︎~✘~~✘~✘✘~
Stanford Alpaca✔︎✘~~~✘~✔︎✘✘✘✘✘✘
Falcon-180B-chat✘~~~~✘✘~~✘~✘✘✘
Gemma 7B Instruct~✘~✘~✘✘~~✘✔︎✘✘✘
Orca 2✘✘~✘✔︎✘✘~~✘~✘✘~
Command R+✘✘✘✔︎✔︎~✘✘✘✘~✘✘✘
LLaMA2 Chat✘✘~✘~✘✘~~✘~✘✘~
Nanbeige2-Chat✔︎✘✘✘✔︎~✘✘✘✘✘✘✘~
Llama 3 Instruct✘✘~✘~✘✘~✘✘~✘✘~
Solar 70B✘✘~✘~✘✘✘✘✘~✘✘~
Xwin-LM✘✘~✘✘✘✘✘✘✘✘✘✘~
ChatGPT✘✘✘✘✘✘✘✘~✘✘✘✘✘

How to use this table. Every cell records a three-level openness judgement (✔︎ open, ~ partial or ✘ closed) with a direct link to the available evidence; on hover, the cell will display the notes we have on file for that judgement. The name of each project is a direct link to source data. The table is sorted by cumulative openness, where ✔︎ is 1, ~ is 0.5 and ✘ is 0 points. Note that RL may refer to RLHF or other forms of fine-tuning aimed at fostering instruction-following behaviour.