<p>Run a ready-to-use Docker image with vLLM and JupyterLab IDE on top of your ROCm-enabled system! All software is preinstalled under containers, so you can jump straight into your workflow—get started with either SSH or Jupyter. <a href="https://docs.vllm.ai/en/latest/" rel="noopener" target="_blank">vLLM</a> accelerates large-language-model inference and supports a <a href="https://docs.vllm.ai/en/v0.7.0/models/supported_models.html" rel="noopener" target="_blank">variety of models</a>. This 1-click setup also bundles five hands-on tutorials to guide you through vLLM and how to use it:</p>

ROCm (host system)

ROCm (in Docker image)

JupyterLab (in Docker image)

vLLM (in Docker image)

vLLM 0.8.5, ROCm 6.3.1. Optimized for LLM inference and serving.

AMD Developer Cloud

vLLM 0.8.5

Focus on building great things, while you use these 1-Click Apps to build your business.

These 1-Click Apps make it simple to deploy and manage your clients' infrastructure. Save time and resources, while reducing headaches and passing the value onto your clients.

Apps for agencies and website development shops

Work more effectively from home or remotely with these 1-Click Apps.

Work more effectively from home or remotely

Stop spending hours editing YAML and Helm charts. Instead, use these popular, preconfigured solutions to add apps to your Kubernetes cluster in minutes instead of days.

1-Click Apps for managing Kubernetes environments

Stay focused on teaching and learning, instead of managing infrastructure. 

1-Click Apps for students and educational institutions

Secure your network with a VPN, protect your database, and more, with this selection of 1-Click Apps.

SaaS Add-Ons make your DigitalOcean infrastructure better! Check out the full list of SaaS Add-Ons here!  

New Feature Alert: Introducing Software License Subscriptions on DigitalOcean Marketplace!

We now support Droplet 1-Click updates via API. See documentation for the details

Check out Tabnine, the AI coding assistant that accelerates & simplifies software development.

Description

Software Included

Getting started after deploying vLLM 0.8.5