Automation & Ops ✓ Google · Official

AI Workload Migration to GKE Inference

Move existing AI inference workloads to self-hosted inference on Google Kubernetes Engine.

50/ 100
Use with care

Useful, but reliability, evidence or controls still have material gaps.

See how it was scored ↓
Works as-is in
Codex · Claude Code
Stars
★ 21k
Last updated
12d ago
License
Apache-2.0
google-cloudgkeai-inferencecloud-run-migration
+3vllmkubernetesgpu-provisioning

What does this skill do, and when should you use it?

This skill is for AI inference workloads already running on Cloud Run, the Gemini API, Gemini Enterprise Agent Platform, or a custom VM. It uses a four-phase process covering discovery, solution design, implementation, and validation with traffic cutover. It inspects resources with gcloud and kubectl, designs compute, storage, networking, and serving components, and produces Kubernetes manifests. It is not intended for brand-new GKE inference deployments and does not perform automated migration through the Gemini Cloud Assist MCP server.

After receiving permission, it uses filtered gcloud list and describe commands to inspect Cloud Run services, GKE clusters, Vertex AI endpoints, and Cloud Storage; gathers model, hardware, storage, traffic, and autoscaling requirements; estimates VRAM from parameter count, KV-cache overhead, and a safety margin; plans vLLM, Custom Compute Classes, Workload Identity, Cloud Storage FUSE or Managed Lustre, Gateway API, and Prometheus; generates YAML for a vLLM Deployment, ComputeClass, Gateway, storage configuration, and model-staging Job; and provides kubectl commands for application, waiting, logging, rollout checks, port forwarding, inference testing, traffic cutover, and rollback.

Good fit
  • A team running an AI inference service on Cloud Run wants to move it to self-hosted GKE for more control over GPUs and the serving stack.
  • A Gemini API or Gemini Enterprise Agent Platform user wants to evaluate replacing the managed source workload with an open-weight model on GKE.
  • A platform engineer with a custom VM inference workload needs a GKE design covering accelerators, model storage, and traffic migration.
  • An organization needs a concrete vLLM, GPU, model-staging, and internal Gateway plan for an existing large-model inference service.

How do you install this skill?

Before you use it
  • The supplied skill evidence ends mid-way through the VRAM sizing formula, and the required assets are not included; do not assume the remaining templates or formula details are complete.
  • Before execution, verify gcloud/kubectl permission scope, Workload Identity, image tags, accelerator quota, external-document reachability, and a rollback plan.
  • Before external exposure of the vLLM endpoint, configure authentication or strict access controls; never place Hugging Face or other tokens in prompts, manifests, or logs.
Before you start
Your agent needs
  • Shell / CLI
  • Network access
  • Local filesystem
Install first
  • gcloud CLI
  • kubectl
  • Node.js with npx

Run npx skills add google/skills, then select skills/cloud/google-cloud-solution-guided-gke-ai-migration from the repository during installation. The README does not document a more specific client installation directory or version requirement.

Generic route: install into Claude Code manually (macOS / Linux)
tmp="$(mktemp -d)"
git clone --depth 1 https://github.com/google/skills.git "$tmp"
mkdir -p ~/.claude/skills
cp -R "$tmp/skills/cloud/google-cloud-solution-guided-gke-ai-migration" ~/.claude/skills/
rm -rf "$tmp"

Generated from the source repository and skill path; it copies only this skill's folder. If the author's install steps above differ, follow those first. To scope it to one project, replace ~/.claude/skills with that project's .claude/skills.

How do you use this skill?

Try saying

Once installed, send your agent any of these to trigger it:

  • Migrate my existing Cloud Run AI inference service to GKE, starting with environment discovery.

In an Agent Skills-compatible client with the skill installed, use a prompt such as “Migrate my existing Cloud Run AI inference service to GKE, starting with environment discovery.” Before discovery, explicitly authorize read-only gcloud inspection. Later phases normally generate files and commands for the user to run unless the user explicitly asks the agent to execute mutations. The source requires using the current directory for migration-state.md and generated YAML manifests, but does not provide a complete trigger syntax or the referenced template files.

What are this skill's strengths and limitations?

Pros
  • Covers the migration lifecycle from discovery through validation and traffic cutover.
  • Clearly separates read-only inspection from commands that change cloud resources.
  • Provides concrete guidance for VRAM sizing, model staging, Workload Identity, Gateway configuration, and rollback.
  • Includes security guardrails for Hugging Face tokens, external exposure, and unauthenticated inference endpoints.
Limitations
  • Focused on migrating existing workloads and unsuitable for fresh GKE inference deployments.
  • Requires gcloud, kubectl, access to a Google Cloud environment, and local filesystem writes.
  • The source provides no test suite, automated validation results, or evidence of platform-specific compatibility testing.
  • The workflow still requires user approval of discovery findings, the design, and the final migration state.

How does this skill compare with similar options?

Side by side with related skills; every score comes from the same FSRS standard.

Skill FS score Stars Last updated License
AI Workload Migration to GKE Inference this page ✓ Google · Official 50 · Use with care ★ 21k 12d ago Apache-2.0
GKE Cluster Creation Advisor ✓ Google · Official 48 · Use with care ★ 21k 12d ago Apache-2.0
GKE AI Inference Deployment Assistant ✓ Google · Official 46 · Use with care ★ 21k 12d ago Apache-2.0
GKE Production Golden Path ✓ Google · Official 54 · Use with care ★ 21k 12d ago Apache-2.0
GKE Basics Navigator ✓ Google · Official 45 · Not recommended ★ 21k 12d ago Apache-2.0

Unlike the repository's gke-inference skill, this skill focuses on migrating existing workloads from Cloud Run, the Gemini API, Agent Platform, or other platforms to GKE; gke-inference is intended for new GKE AI model-server deployments. For automated infrastructure analysis or resource mutation, the source identifies the Gemini Cloud Assist MCP server as an alternative.

How did FollowSkills review this skill?

FollowSkills review · FSRS-2.0
Use with care
50/ 100 5-point scale 2.5 / 5
The upstream repository has new commits since this review. The score still applies to the reviewed revision shown and may not cover the latest changes.
1Trust18 / 25 · 3.6/5

The skill requires permission before read-only discovery, gates mutations, and includes controls for Workload Identity, token handling, external exposure, and internal load balancing. It lacks a complete rollback plan, digest-pinned images, dependency-security verification, and full data-flow disclosure, so points are deducted.

2Reliability6 / 20 · 1.5/5

The four-phase workflow, checklist, and routing rules are fairly clear, but the supplied file is truncated in the VRAM formula section and the required assets are not provided. Static review cannot reproduce command execution, template generation, or validation; testing, edge-case coverage, and failure diagnostics therefore remain thin.

3Adaptability10 / 15 · 3.3/5

Invocation conditions, migration-versus-new-deployment boundaries, MCP off-ramp, and major inputs are explicit. However, Chinese-language support and mainland-China reachability are not established, and the workflow depends on Google Cloud, Hugging Face, and external documentation, so points are deducted.

4Convention8 / 15 · 2.7/5

The name, description, phased information architecture, installation entry point, Apache-2.0 license, and repository support channel are clear. The skill itself lacks a version, changelog, FAQ, named maintenance owner, and explicit update path; its asset dependencies are also not fully evidenced here.

5Effectiveness5 / 15 · 1.7/5

The skill covers discovery, design, implementation, and validation with concrete GKE, vLLM, storage, gateway, and secret-handling guidance. However, the key templates and generated-file contents are absent, the formula section is truncated, and static evidence cannot establish directly usable migration output, so only limited points are awarded.

6Verifiability3 / 10 · 1.5/5

Concrete commands, template names, checklists, and reference links provide some auditability. There is no skill-specific test suite, CI coverage, or third-party execution evidence in the supplied material, and key paths cannot be reproduced statically, so points are deducted.

1 2 3 4 5 6

Open a dimension to read why it scored that way

Reviewed Jul 28, 2026 Reviewed revision d1c9be2009ba Review evidence[1][2][3][4]

Evidence confidence:Low — Mostly static review, author material or a limited demo; useful for discovery, not high-risk decisions.

See the full review method →

FAQ

Can it directly create or delete GKE and IAM resources?
Not by default. It generates and presents gcloud and kubectl commands. It executes mutating commands only when the user explicitly asks it to, and reports the actual output.
Is it suitable for a project with no existing AI workload?
No. It is designed for migration of an existing workload. A new GKE inference deployment should use `gke-inference` instead.
How are model weights handled?
The skill generally recommends staging weights in Cloud Storage and using a cluster Job to populate or access a PVC, avoiding local downloads and repeated downloads after container restarts.
What access does it require?
It requires gcloud and kubectl access and user authorization to inspect relevant Google Cloud resources. Exact IAM permissions depend on the target environment and implementation actions.

More skills from this repository

All from google/skills

Automation & Ops ✓ Google · Official

GKE Cluster Creation Advisor

Plan, provision, and audit GKE clusters against production best practices.

★ 21k FS 48 Use with care 12d ago
Automation & Ops ✓ Google · Official

GKE AI Inference Deployment Assistant

Deploy, tune, and autoscale GPU/TPU AI inference services on GKE.

★ 21k FS 46 Use with care 12d ago
Automation & Ops ✓ Google · Official

GKE Production Golden Path

Set production-oriented GKE defaults, readiness checks, and decision guardrails for cluster design.

★ 21k FS 54 Use with care 12d ago
Automation & Ops ✓ Google · Official

GKE Basics Navigator

A focused entry point for discovering GKE cluster needs and routing each task to the right specialist skill.

★ 21k FS 45 Not recommended 12d ago
Dev & Engineering ✓ Google · Official

Google Agents CLI Agent Development Guide

Guides agents from specification through development, deployment, and monitoring.

★ 21k FS 44 Not recommended 12d ago
Automation & Ops ✓ Google · Official

GKE Cluster Autoscaler Guide

Configure, optimize, and troubleshoot automatic GKE node scaling.

★ 21k FS 52 Use with care 12d ago
Automation & Ops ✓ Google · Official

GKE ComputeClasses Advisor

Configure, optimize, and troubleshoot GKE ComputeClasses for cost, capacity, and workload placement.

★ 21k FS 57 Use with care 12d ago
Automation & Ops ✓ Google · Official

GKE Enterprise RAG Search Architect

Designs and validates enterprise RAG search systems built on GKE and AlloyDB.

★ 21k FS 53 Use with care 12d ago
Automation & Ops ✓ Google · Official

GKE Cost Optimization

Reduce GKE spending through rightsizing, quotas, Spot VMs, and capacity planning.

★ 21k FS 47 Use with care 12d ago
Automation & Ops ✓ Google · Official

GKE Observability Configuration

Configure GKE logging, monitoring, and Prometheus metrics.

★ 21k FS 44 Not recommended 12d ago
Automation & Ops ✓ Google · Official

GKE Multi-Tenancy Planner

Plan isolation, quotas, access control, and cost attribution for teams sharing a GKE cluster.

★ 21k FS 52 Use with care 12d ago
Automation & Ops ✓ Google · Official

GKE Production Readiness Review

Assess whether GKE clusters and workloads are ready for production.

★ 21k FS 49 Use with care 12d ago
Automation & Ops ✓ Google · Official

GKE Workload Autoscaling

Configure manual scaling, HPA, and VPA for GKE workloads while improving resource requests from observed usage.

★ 21k FS 49 Use with care 12d ago
Automation & Ops ✓ Google · Official

GKE App Onboarding Assistant

Containerize and deploy an application to Google Kubernetes Engine for the first time.

★ 21k FS 45 Not recommended 12d ago
Automation & Ops ✓ Google · Official

GKE Storage Manager

Configure persistent disks, Filestore, and GCS FUSE storage for GKE workloads.

★ 21k FS 43 Not recommended 12d ago
Automation & Ops ✓ Google · Official

GKE Workload Reliability Guide

Reduce GKE workload disruption with high-availability configuration.

★ 21k FS 41 Not recommended 12d ago
Automation & Ops ✓ Google · Official

GKE Backup & Disaster Recovery

Configure Backup for GKE policies and restore workflows for stateful workloads.

★ 21k FS 35 Not recommended 12d ago
Automation & Ops ✓ Google · Official

Google Cloud AI Agent Builder

Design, implement, deploy, and validate AI agents and multi-agent systems on Google Cloud.

★ 21k FS 53 Use with care 12d ago
Dev & Engineering ✓ Google · Official

Google Cloud Agent Platform Inference Assistant

Guides developers in connecting to Google Cloud Agent Platform and calling Gemini or OpenMaaS models.

★ 21k FS 47 Use with care 12d ago
Dev & Engineering ✓ Google · Official

Gemini LiveAPI Client Service Skill

Generate a resumable, multimodal, bidirectional Gemini LiveAPI client over WebSockets.

★ 21k FS 52 Use with care 12d ago

Related skills