Managed GPU Containers
Autoscaling GPU containers for your inference workloads.
Build
your API
endpoint, not the infrastructure to run it on.
Autoscaling GPU containers for your inference workloads.
Build
your API
endpoint, not the infrastructure to run it on.
Build your container from scratch, or use one of our preconfigured templates. All the container needs to do is provide an HTTP endpoint.
Configure your container's CPU, RAM, and disk resources. Rank GPUs by priority, and set the minimum and maximum number of replicas.
We'll handle the rest — autoscaling, load balancing, and redundancy. You'll be ready to send API requests to your new endpoint in minutes.
TensorDock's managed GPU containers are the easiest way to deploy a scalable API endpoint for any use case, and it's available at no additional charge on top of the cost of the compute resources.
LLM inference
Image endpoints
Transcoding APIs
Data analytics
Our managed container platform lets you deploy container groups atop any of our massive fleets of GPUs and autoscale with ease.
Uncompromising performance for image and video processing, gaming, and rendering.
Deploy a 4090 container
Accelerated machine learning LLM inference with 80GB of GPU memory.
Deploy an A100 container
24 GPU models available, choose the one that best suits your workload.
Customize a container
Need help deciding which GPU type to utilize for your
container group, or need a custom white glove solution? Chat
with our sales team.
Schedule a video chat
Send us an email or message
When you spend more than $10,000/month on TensorDock:
A person to ensure that your needs have been met.
Your requests will be placed in a priority queue.
Chat with our team in realtime to resolve issues.
We will automatically add a replica if the average GPU utilization over a 10-minute period surpasses 80%, and delete a replica if the average GPU utilization over a 10-minute period is below 20%.
We use a round-robin load balancer to distribute requests evenly across replicas. We try to keep replicas within the same general geographic region but on different physical servers for best-in-class latency and redundancy
We operate on a prepaid model: you deposit money and then provision compute. You must manually add more funds, we do not automatically charge your card.
You can either provide a Docker image from a public registry (e.g. Docker Hub) or a private registry, which you'll need to provide authentication credentials for. We recommend using a private registry for security reasons.
At the moment, we only accept 3D Secure credit card payments via Stripe. We can also manually accept cryptocurrency payments on deposits larger than $500 on request after you have completed a KYC check.
Each refund costs us, so we can offer refunds of 97% of a remaining account balance on a case by case basis. Please start off small with a $5 deposit to test out our services.
"Deploying our models was a breeze. And managing them is even easier."
ELBO AI builds an app "Puppetry" that allows users to animate faces onto still images and provide an API for other startups to do so as well.
"The server is really fast, you never have to worry about noisy neighbors. Wow!"
Ultramarine Linux is an open-source Fedora-based distribution that uses TensorDock's CPU servers to process hundreds of gigabytes of data.
Delivered by dedicated professionals
And you'll never look back.
