In the v1.0 release of Weaviate (docs — GitHub) we introduced the concept of modules. Weaviate modules are used to extend the vector database with vectorizers or functionality that can be used to query your dataset. With the release of Weaviate v1.2, we have introduced the use of transformers (DistilBERT, BERT, RoBERTa, Sentence-BERT, etc) to vectorize and semantically search through your data.
Weaviate v1.2 introduction video
What are transformers?
Getting started with out-of-the-box transformers in Weaviate
Weaviate configurator — selecting the Transformers module
Custom transformer models
You can also use custom transformer models that are compatible with Hugging Face's
AutoTokenzier. Learn more about using custom models in Weaviate here.
Q&A style questions on your own dataset answered in milliseconds
Weaviate now allows you to get to sub-50ms results by using transformers on your own data. You can learn more about Weaviate’s speed in combination with transformers in this article.
Check out Getting Started with Weaviate, and begin building amazing apps with Weaviate.