Tag

#fine-tuning

10 articles

I had Gemini and Claude write my email replies - but only one sounds like me

This article explains how language model fine-tuning and personalization work in AI systems, using the comparison between Gemini and Claude's email reply generation as a practical example.

Jul 122

Building Supervised Fine-Tuning Data from NVIDIA Open-SWE-Traces: Trajectory Parsing, Patch Analysis, Token Budgets, and Tool-Use Metrics

Learn how to load, process, and filter the NVIDIA Open-SWE-Traces dataset for supervised fine-tuning of AI models in software engineering tasks.

Jun 2625

DeepSeek lines up its first outside money: a $7bn round at up to $59bn

Learn how to fine-tune a pre-trained language model using Hugging Face's Transformers library, a technique used by AI companies like DeepSeek.

Jun 262

How to Fine-Tune LFM2 Using QLoRA and DPO: A Complete Step-by-Step Coding Tutorial on Google Colab

Learn how fine-tuning with QLoRA and DPO can make language models smarter and more useful, even on limited hardware.

Jun 233

Adaption aims big with AutoScientist, an AI tool that helps models train themselves

Learn how to use AutoScientist, an AI tool that automates model fine-tuning for beginners. This tutorial walks you through setting up the environment, preparing data, and running automated training sessions.

May 1356

tools

smol-audio: A Colab-Friendly Notebook Collection for Fine-Tuning Whisper, Parakeet, Voxtral, Granite Speech, and Audio Flamingo 3

smol-audio is a Colab-friendly notebook collection that simplifies fine-tuning of leading audio AI models like Whisper, Parakeet, and Voxtral.

Apr 2862

The LoRA Assumption That Breaks in Production

LoRA, a widely used technique for fine-tuning large language models, assumes all updates are similar — a premise that fails in real-world production environments. This limitation is now prompting a reevaluation of its effectiveness in complex, diverse applications.

Apr 2664

This AI Paper Introduces TinyLoRA, A 13-Parameter Fine-Tuning Method That Reaches 91.8 Percent GSM8K on Qwen2.5-7B

Researchers from Meta, Cornell, and CMU introduce TinyLoRA, a 13-parameter fine-tuning method that achieves 91.8% accuracy on GSM8K using Qwen2.5-7B.

Mar 2486

Unsloth AI Releases Unsloth Studio: A Local No-Code Interface For High-Performance LLM Fine-Tuning With 70% Less VRAM Usage

Learn how to use Unsloth Studio, a no-code interface for fine-tuning Large Language Models locally with 70% less VRAM usage.

Mar 17129

tools

How to Build a Stable and Efficient QLoRA Fine-Tuning Pipeline Using Unsloth for Large Language Models

A new tutorial demonstrates how to build a stable and efficient QLoRA fine-tuning pipeline using Unsloth, addressing common Colab issues and enabling resource-efficient LLM training.

Mar 3167