https://viig99.github.io/tags/large-language-models/Recent content in Large Language Models on /home/vigi99Hugoen-usMon, 17 Jun 2024 10:03:05 -0400https://viig99.github.io/docs/posts/supervised_finetuning/Mon, 22 May 2023 00:00:00 +0000https://viig99.github.io/docs/posts/supervised_finetuning/<h2 id="the-power-of-supervised-fine-tuning-in-large-language-models-an-in-depth-analysis"><strong>The Power of Supervised Fine-Tuning in Large Language Models: An In-depth Analysis</strong><a class="anchor" href="#the-power-of-supervised-fine-tuning-in-large-language-models-an-in-depth-analysis">#</a></h2> <h3 id="introduction"><strong>Introduction</strong><a class="anchor" href="#introduction">#</a></h3> <p>In recent years, the development of machine learning, particularly large language models (LLMs), has revolutionized the way we approach a multitude of challenges, from query-based tasks to content generation. In this post, we will dive deep into a technique gaining traction within the AI community - supervised fine-tuning using domain-specific instruction datasets - and contrast it with the more conventional prompt tuning approach, with a focus on techniques such as retrieval augmentation.</p>