Distillation Experiments
Experiments comparing Distillation to Finetuning
September 1, 2024 · 2 min read
Distillation Experiments
· 2 min read
Developer Advocate
Weaviate Paper Reviews
Language Model Distillation
· 3 min read
Developer Advocate
Language Model Distillation
Distilling Large Language models in Small Language Models!
August 8, 2024 · 2 min read
LoRA: Low-Rank Adaptation of Large Language Models
· 3 min read
Developer Advocate
LoRA: Low-Rank Adaptation of Large Language Models
Tuning LLMs by only learning a fraction of weight updates!
July 28, 2024 · 3 min read
Prover-verifier Games Improve Legibility of LLM Outputs
· 3 min read
Developer Advocate
Prover-verifier Games Improve Legibility of LLM Outputs
Optimizing to improve legibility of an LLMs output!
July 22, 2024 · 2 min read
RouteLLM: Learning to Route LLMs with Preference Data
· 2 min read
Developer Advocate
RouteLLM: Learning to Route LLMs with Preference Data
Route between LLMs to optimize cost and quality!
July 14, 2024 · 2 min read
Adaptive Retrieval and Scalable Indexing for k-NN Search with Cross-Encoders
· 2 min read
Developer Advocate
Adaptive Retrieval and Scalable Indexing for k-NN Search with Cross-Encoders
The quality of a reranked retreiver and the speed of a bi-encoder retreiver!
July 7, 2024 · 2 min read