DevOps
vast-ai
This skill allows you to provision on-demand GPU infrastructure.
# Skill: VAST.ai GPU Rental
## Overview
This skill allows you to provision on-demand GPU infrastructure. You must have a user-provided API Key before performing write actions.
## Capabilities
1. **Search**: Find machines by GPU model (e.g., "RTX 4090") and max hourly price.
2. **Rent**: Instantiate a container (default: PyTorch) on a specific Offer ID.
3. **Connect**: Retrieve the SSH connection string for an active instance.
4. **Balance**: Check available credit and current hourly burn rate across all active machines.
## Usage Protocol
- **Step 1**: Ask the user for their VAST API Key if not already in context.
- **Pre-flight Check**: Before renting, call `balance` to ensure the user has sufficient funds.
- **Step 2**: Search for offers and present the top 3 cheapest options to the user.
- **Step 3**: Upon confirmation, call `rent`.
- **Reporting**: If credit is below $5.00, warn the user after every successful rental.
- **Step 4**: Wait 30-60 seconds, then call `connect` to provide the SSH string.
## Tool Definitions
- `search(gpu: string, price: number)`
- `rent(id: number, image: string)`
- `connect(id: number)`
- `balance()`
## Execution
Run the CLI wrapper for these tools.
Command: `node /Users/sschepis/Development/vast-ai/dist/cli.js <action> [params]`
Env: `VAST_API_KEY` must be set.
### Examples
- Search: `node dist/cli.js search --gpu "RTX 4090" --price 0.5`
- Rent: `node dist/cli.js rent --id 12345 --image "pytorch/pytorch"`
- Connect: `node dist/cli.js connect --id 12345`
- Balance: `node dist/cli.js balance`
devops
By
Comments
Sign in to leave a comment