Set up data generation pipeline
- Add slurm script for data generation - Finalize Qwen-2.5-coder-32B model for data generation
Showing
- .gitignore 1 addition, 0 deletions.gitignore
- data_generation/main.py 110 additions, 0 deletionsdata_generation/main.py
- data_generation/main_qwen.py 390 additions, 0 deletionsdata_generation/main_qwen.py
- data_generation/slurm.sh 38 additions, 0 deletionsdata_generation/slurm.sh
- data_generation/slurm_qwen.sh 38 additions, 0 deletionsdata_generation/slurm_qwen.sh
- requirements.txt 48 additions, 0 deletionsrequirements.txt
Loading
Please register or sign in to comment