Skip to main content

Google Cloud Marketplace

Overview

You can use Google Cloud Marketplace to directly launch a Weaviate cluster.

Prerequisites
  • A Google Cloud account with sufficient credit / payment method.
  • (Recommended) Familiarity with Google Cloud and the Google Cloud console.

Installation instructions

Broadly, the steps are as follows:

  1. Go to Weaviate's Google Cloud Marketplace listing page and click Configure.
  2. Configure and deploy Weaviate by following the on-screen instructions.

We go through these steps in detail below.

Configuration options

Before you get started

Suggested configurations

  • The default values for settings such as Global Query limit, Modules and Storage Size should be suitable for a majority of cases.
  • Storage size: For production environments, at least 500GB per pod is recommended. (Smaller disks may be sufficient for dev environments.)

Once you are at the deployment page, you should see a set of options.

You will need to:

  1. Select a GKE cluster to deploy Weaviate to.
    1. Optionally, you can create a new cluster and then specify it.
  2. Set the namespace (for dividing cluster resources) and a unique app instance name for identifying the application.
  3. Set the app instance name.
  4. Set the service account for billing.
  5. Set Weaviate parameters, such as Replicas of Weaviate Instances, Global Query Limit, Enable Modules and Storage Size.
  6. If you agree, accept the terms of service and click Deploy.

Once you have done so, Weaviate will be deployed to the selected cluster. This should take a few minutes.

Accessing the cluster

Once the application has been created, you can access the cluster through the load balancer.

You can interact with the cluster using kubectl, or through the Weaviate API. We show examples below.

Interaction using kubectl

You can run the following command which will update or create a kubeconfig file for the Weaviate cluster:

gcloud container clusters get-credentials [YOUR_CLUSTER_NAME] --zone [YOUR_GC_ZONE] --project [YOUR_GC_PROJECT]
How to find the kubectl command

The exact command can be found in the Kubernetes Engine page, by clicking on the vertical ellipsis ( ) for your cluster, and clicking Connect.

Once that's set up, you can run kubectl commands as usual. For example

  • kubectl get pods -n default to list all pods in the default namespace (or whatever namespace you specified).
  • kubectl get svc --all-namespaces to list all services in all namespaces.
Example output

An example output of kubectl get svc --all-namespaces is:

NAMESPACE            NAME                                     TYPE           CLUSTER-IP     EXTERNAL-IP    PORT(S)            AGE
application-system application-controller-manager-service ClusterIP 10.24.8.231 <none> 443/TCP 11m
default kubernetes ClusterIP 10.24.0.1 <none> 443/TCP 11m
default weaviate LoadBalancer 10.24.13.245 34.173.96.14 80:30664/TCP 8m38s
default weaviate-headless ClusterIP None <none> 80/TCP 8m38s
gmp-system alertmanager ClusterIP None <none> 9093/TCP 10m
gmp-system gmp-operator ClusterIP 10.24.12.8 <none> 8443/TCP,443/TCP 10m
kalm-system kalm-controller-manager-service ClusterIP 10.24.7.189 <none> 443/TCP 11m
kube-system default-http-backend NodePort 10.24.12.61 <none> 80:32508/TCP 10m
kube-system kube-dns ClusterIP 10.24.0.10 <none> 53/UDP,53/TCP 11m
kube-system metrics-server ClusterIP 10.24.13.204 <none> 443/TCP

Here, the externally accessible Weaviate IP is 34.173.96.14.

Finding the Weaviate URL

Once the application has been created, you can access Weaviate via the load balancer URL.

You can find the Weaviate endpoint URL by any of:

  • Going to the Kubernetes Engine section of Google Cloud, under Service & Ingress. Find the load balancer, and look for the Endpoints column.
  • Running kubectl get svc -n [YOUR_NAMESPACE_NAME] and looking for the EXTERNAL-IP of the weaviate service. The load balancer URL (e.g. 34.38.6.240) will be the Weaviate URL (e.g. http://34.38.6.240).

Removing Weaviate and the cluster

caution

Verify that all unused resources are deleted. You continue to incur costs for any remaining resources.

Removing Weaviate

To remove Weaviate and the associated services, go to the Applications section of Kubernetes Engine in Google Cloud, and delete the Weaviate deployment.

Review the Services & Ingress section as well as the Storage section to ensure that all associated services and storage are removed. You may need to delete any remaining resources manually.

Removing the cluster

If you no longer require the cluster (e.g. if you created a new cluster for Weaviate), you can delete the cluster by going to the Applications section of Kubernetes Engine in Google Cloud. Delete the cluster by selecting it from the list, clicking DELETE, and following the prompts.

Billing

You will be charged for Weaviate and associated resources directly by Google Cloud.

This will, for example, include the compute instances, volumes, and any other resources used by the cluster.

Questions and feedback

If you have any questions or feedback, let us know in the user forum.