Issues

• Pretrain data source request

  TencentARC/LLaMA-Pro#34 · Filter by author shutttttdown opened on Jan 5, 2025

• 这个方法可以扩展到vit类的视觉encode上吗？

  TencentARC/LLaMA-Pro#33 · Filter by author lucasjinreal opened on Aug 29, 2024

• 请教大佬可以训练qewn2-7b吗

  TencentARC/LLaMA-Pro#32 · Filter by author jqtian123 opened on Aug 23, 2024

• 关于运行流程

  TencentARC/LLaMA-Pro#30 · Filter by author GOOD-N-LCM opened on Jun 26, 2024
  4

• 关于零初始化和扩展层的位置

  TencentARC/LLaMA-Pro#28 · Filter by author ouyanxi1125 opened on Jun 7, 2024
  4

• finetune_cosmopedia.sh如何训练出来8B模型

  TencentARC/LLaMA-Pro#27 · Filter by author RuipingWang1986 opened on May 20, 2024
  1

• 利用finetune_cosmopedia.sh脚本进行继续预训练中的数据集如何构建

  TencentARC/LLaMA-Pro#26 · Filter by author RuipingWang1986 opened on May 20, 2024
  2

• Thanks for wonderful projects ! Why I always got the results of apparent loss of original ability?

  TencentARC/LLaMA-Pro#25 · Filter by author hzgdeerHo opened on May 17, 2024
  8

• Training on arbitary data

  TencentARC/LLaMA-Pro#23 · Filter by author HelloWorldLTY opened on Apr 8, 2024
  2

• Pretrain code of Mistral-Pro-8B-v0.1

  TencentARC/LLaMA-Pro#22 · Filter by author shawnricecake opened on Apr 5, 2024
  1

• 请教下训练的显存需求

  TencentARC/LLaMA-Pro#20 · Filter by author denghj3 opened on Mar 27, 2024
  6

• Comparison with PEFT

  TencentARC/LLaMA-Pro#19 · Filter by author LaVieEnRose365 opened on Mar 14, 2024
  1

• 更大的模型需要更多的block吗？

  TencentARC/LLaMA-Pro#18 · Filter by author PoseidomWong opened on Mar 13, 2024
  1

• add pip install fire to requirements.txt

  TencentARC/LLaMA-Pro#17 · Filter by author r4dm opened on Mar 12, 2024
  1

• 对比lora优势是什么

  TencentARC/LLaMA-Pro#14 · Filter by author xiaozhu1106 opened on Feb 28, 2024
  1

• guide to run the code

  TencentARC/LLaMA-Pro#11 · Filter by author Abolfazl-kr opened on Feb 12, 2024
  2

• Question regarding the difference between llama-pro and the regular llama.（关于llama-pro和普通llama之间的区别的疑问）

  TencentARC/LLaMA-Pro#9 · Filter by author WUHU-G opened on Jan 30, 2024
  8

• How to load the new model weight

  TencentARC/LLaMA-Pro#8 · Filter by author khalil-Hennara opened on Jan 30, 2024
  1

• Should I freeze norm.weight?

  TencentARC/LLaMA-Pro#7 · Filter by author metterian opened on Jan 28, 2024
  1

• full code to continue pre-training

  TencentARC/LLaMA-Pro#6 · Filter by author Abolfazl-kr opened on Jan 13, 2024
  1

• Question about Llama-7B and Llama-7B-Pro comparison.

  TencentARC/LLaMA-Pro#5 · Filter by author ryusaeba opened on Jan 12, 2024
  2

• Arxiv Data

  TencentARC/LLaMA-Pro#4 · Filter by author ZhengTang1120 opened on Jan 11, 2024
  2

• 我们如何针对扩展区块微调?

  TencentARC/LLaMA-Pro#3 · Filter by author win10ogod opened on Jan 10, 2024
  5

• Code for training llama pro?

  TencentARC/LLaMA-Pro#2 · Filter by author yhyu13 opened on Jan 7, 2024
  8