Falcon-40B-Instruct

No public details of the different elements needed to classify and understand them even at the most basic level.

Why use Falcon-40B-Instruct?

• You are looking for a ready-to-use chat/instruct model based on Falcon-40B.

• Falcon-40B is the best open-source model available. It outperforms LLaMA, StableLM, RedPajama, MPT, etc. See the OpenLLM Leaderboard.

• It features an architecture optimized for inference, with FlashAttention (Dao et al., 2022) and multiquery (Shazeer et al., 2019).

This is an instruct model, which may not be ideal for further finetuning. If you are interested in building your own instruct/chat model, we recommend starting from Falcon-40B.

tiiuae/falcon-40b-instruct · Hugging Facehuggingface

• Link: https://huggingface.co/tiiuae/falcon-40b-instruct

• Type: instruction/chat model

• Family: Falcon

• Pretraining Architecture: Causal decoder-only

• Pretraining Task:

• Extension:

• Application: Same as GPT-3

• Date (of first known publication): 05/2023

• Num. Params: 40B

• Corpus:

• License: TII Falcon LLM License

• Developed By: https://www.tii.ae

💬 This is an instruct model, which may not be ideal for further finetuning. If you are interested in building your own instruct/chat model, we recommend starting from Falcon-40B.