September 1, 2024 · 2 min read
Distillation Experiments
Experiments comparing Distillation to Finetuning
Weaviate Blog
Keep up-to-date on the latest product updates, how-tos, industry insights, and community spotlights.
August 8, 2024 · 2 min read
Language Model Distillation
Distilling Large Language models in Small Language Models!
July 28, 2024 · 3 min read
LoRA: Low-Rank Adaptation of Large Language Models
Tuning LLMs by only learning a fraction of weight updates!
July 22, 2024 · 2 min read
Prover-verifier Games Improve Legibility of LLM Outputs
Optimizing to improve legibility of an LLMs output!
July 14, 2024 · 2 min read
RouteLLM: Learning to Route LLMs with Preference Data
Route between LLMs to optimize cost and quality!
July 7, 2024 · 2 min read
Adaptive Retrieval and Scalable Indexing for k-NN Search with Cross-Encoders
The quality of a reranked retreiver and the speed of a bi-encoder retreiver!