FinLLaMA-instruct

📄 Paper · 🤗 Collection · 🌐 The Fin AI

Part of Open-FinLLMs — Open-FinLLMs: Open Multimodal Large Language Models for Financial Applications (arXiv:2408.11878).

FinLLaMA-instruct (FinLLaMA-Instruct-8B in the paper) is FinLLaMA — LLaMA3-8B continually pre-trained on 52B financial tokens — instruction-tuned on 573K financial instructions to follow instructions and perform downstream financial tasks.

Model Details

Quick Start

from transformers import AutoModelForCausalLM, AutoTokenizer

name = "TheFinAI/FinLLaMA-instruct"
tokenizer = AutoTokenizer.from_pretrained(name)
model = AutoModelForCausalLM.from_pretrained(name, torch_dtype="auto", device_map="auto")

messages = [{"role": "user", "content": "Classify the sentiment of this headline as positive, negative or neutral: 'Company X beats quarterly earnings expectations.'"}]
inputs = tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt", return_dict=True).to(model.device)
out = model.generate(**inputs, max_new_tokens=128)
print(tokenizer.decode(out[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True))

Evaluation

The paper reports that FinLLaMA-Instruct outperforms GPT-4 and other financial LLMs on 15 datasets. See the paper for results.

Intended Use & Limitations

• Research on financial instruction following and financial NLP tasks.
• Not investment advice; may hallucinate figures or facts.

Repository note

On 2026-10-07 this repository was restored to its LLaMA-8B state (commit 367dad6) after a Qwen2-0.5B checkpoint had been uploaded here by mistake in April 2025.

Citation

@misc{huang2025openfinllmsopenmultimodallarge,
      title={Open-FinLLMs: Open Multimodal Large Language Models for Financial Applications}, 
      author={Jimin Huang and Mengxi Xiao and Dong Li and Zihao Jiang and Yuzhe Yang and Yifei Zhang and Lingfei Qian and Yan Wang and Xueqing Peng and Yang Ren and Ruoyu Xiang and Zhengyu Chen and Xiao Zhang and Yueru He and Weiguang Han and Shunian Chen and Lihang Shen and Daniel Kim and Yangyang Yu and Yupeng Cao and Zhiyang Deng and Haohang Li and Duanyu Feng and Yongfu Dai and VijayaSai Somasundaram and Peng Lu and Guojun Xiong and Zhiwei Liu and Zheheng Luo and Zhiyuan Yao and Ruey-Ling Weng and Meikang Qiu and Kaleb E Smith and Honghai Yu and Yanzhao Lai and Min Peng and Jian-Yun Nie and Jordan W. Suchow and Xiao-Yang Liu and Benyou Wang and Alejandro Lopez-Lira and Qianqian Xie and Sophia Ananiadou and Junichi Tsujii},
      year={2025},
      eprint={2408.11878},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2408.11878}, 
}