Fine-tuning scripts
- Add finetuning scripts - Add data standardization script - Add inference scripts
Showing
- .gitignore 7 additions, 1 deletion.gitignore
- data_standardization/dataset_standardization.py 58 additions, 0 deletionsdata_standardization/dataset_standardization.py
- data_standardization/llama_dataset_standardization.py 66 additions, 0 deletionsdata_standardization/llama_dataset_standardization.py
- data_standardization/slurm_data_standardization.sh 39 additions, 0 deletionsdata_standardization/slurm_data_standardization.sh
- fine-tuning/main_llama_fine_tuning.py 125 additions, 0 deletionsfine-tuning/main_llama_fine_tuning.py
- fine-tuning/main_qwen_fine_tuning.py 126 additions, 0 deletionsfine-tuning/main_qwen_fine_tuning.py
- fine-tuning/slurm_finetune.sh 39 additions, 0 deletionsfine-tuning/slurm_finetune.sh
- inference/llama_finetuned_inference.py 264 additions, 0 deletionsinference/llama_finetuned_inference.py
- inference/llama_finetuned_inference_java.py 224 additions, 0 deletionsinference/llama_finetuned_inference_java.py
- inference/qwen_finetuned_inference.py 266 additions, 0 deletionsinference/qwen_finetuned_inference.py
- inference/qwen_finetuned_inference_java.py 226 additions, 0 deletionsinference/qwen_finetuned_inference_java.py
- inference/slurm_llama_inference.sh 39 additions, 0 deletionsinference/slurm_llama_inference.sh
- inference/slurm_qwen_inference.sh 40 additions, 0 deletionsinference/slurm_qwen_inference.sh
Loading
Please register or sign in to comment