Exploring mergekit for Model Merge, AutoEval for Model Evaluation, and DPO for Model Fine-tuning

My observations from experimenting with model merge, evaluation, and two model fine-tuning techniques

Image generated by DALL-E 3 by the author

Let’s continue our learning journey of Maxime Labonne’s llm-course, which is pure gold for the community. This time, we will focus on…