aidentity / index

google/skills · Apache-2.0

agent-platform-tuning-management

Manages GenAI tuning jobs in Agent Platform. Use this to list, get, or cancel ongoing model tuning jobs. Don't use for fine-tuning models (use `agent-platform-tuning`), deploying models to endpoints (use `agent-platform-deploy`), or managing serving endpoints (use `agent-platform-endpoint-management`).

agents cloud stable

Contents

Agent Platform Tuning Management

This skill provides instructions on how to manage GenAI Tuning Jobs using the

Agent Platform Python SDK. Use this skill when a user wants to check the status

of their tuning runs, find an active tuning job, or cancel a job that is running

too long.

Safety & Confirmation Tiers (CRITICAL)

Before executing any commands on behalf of the user, you MUST adhere to the

following safety tiers based on the action requested:

  1. Tier R: Read-only (list, get)
  • Rule: No confirmation needed. You may execute these commands

immediately to gather information for the user.

  1. Tier D: Destructive & Interruptive (cancel)
  • Rule: This requires explicit typed confirmation. You MUST output

a text message to the user explaining that this will stop the tuning

process and any progress will be lost, and asking them to type "I

confirm" or "Yes, cancel it". You MUST ask for this confirmation

IMMEDIATELY, before executing the cancel command.

Phase 0: Environment Setup

CRITICAL: Before running any of the Python snippets below, you MUST ensure

the environment is correctly initialized by following these steps:

  1. Google Cloud Authentication: Authenticate with your Google Cloud account

and configure active Application Default Credentials (ADC) for Agent

Platform access:

    gcloud auth login
    gcloud auth application-default login
    

  1. Python Dependencies: This skill needs google-cloud-aiplatform. Do

not create a virtual environment — it starts empty and hides packages

the environment already provides, forcing a redundant install. Probe, and

install only what is missing:

    python3 -c "import vertexai" || pip install google-cloud-aiplatform
    

  1. Execution: Run Python snippets with a plain python3. There is no

environment to activate first.

Workflow Decision Tree

  1. Information Gathering: Do you have a Project ID and Region?
  • No -> You MUST ask the user for the missing Project ID and

Region in plain text, or advise them to check their gcloud

configuration. If neither location has this information, then ask the

user to provide it. Do not attempt to search random regions on your own.

  • Yes -> Proceed to Step 2.
  1. Task Type: What does the user want to do?
  • Find or List Jobs -> Use the Python SDK to list tuning jobs. (Tier

R)

  • Check Status / Inspect a Specific Job -> Use the Python SDK to get

tuning job details. (Tier R)

  • Cancel a Job -> Ask for confirmation, then use the Python SDK to

cancel the tuning job. (Tier D)

Using the Python SDK

> [!NOTE]

>

> Resource Verification & Missing Projects/Jobs: If the execution of the

> Python snippet fails with an error (such as 403 Permission Denied, `404 Not

> Found, INVALID_ARGUMENT`, or indicating a dummy/missing project or job ID),

> you MUST inform the user that the project or tuning job does not exist or

> cannot be accessed. You MUST prompt the user to provide a valid Project ID

> or Job ID, and stop tool execution immediately to wait for their response. Do

> NOT retry or loop, do NOT assume the resource is valid, and do NOT

> execute further scripts before receiving valid details from the user.

1. Listing Tuning Jobs (Tier R)

If the user asks "What tuning jobs do I have running?" or wants to find a

specific job ID:

from google.cloud import aiplatform_v1

project_id = "YOUR_PROJECT_ID"
region = "YOUR_REGION"
parent = f"projects/{project_id}/locations/{region}"

client = aiplatform_v1.GenAiTuningServiceClient(
    client_options={"api_endpoint": f"{region}-aiplatform.googleapis.com"}
)

jobs = client.list_tuning_jobs(parent=parent)
for job in jobs:
    print(f"Name: {job.name}")
    print(f"Base Model: {job.base_model}")
    print(f"State: {job.state}")

2. Getting Details for a Specific Job (Tier R)

If the user provides a Tuning Job ID and asks for its status:

from google.cloud import aiplatform_v1

project_id = "YOUR_PROJECT_ID"
region = "YOUR_REGION"
job_id = "YOUR_JOB_ID"  # 19-digit ID
name = f"projects/{project_id}/locations/{region}/tuningJobs/{job_id}"

client = aiplatform_v1.GenAiTuningServiceClient(
    client_options={"api_endpoint": f"{region}-aiplatform.googleapis.com"}
)

job = client.get_tuning_job(name=name)
print(f"Name: {job.name}")
print(f"Base Model: {job.base_model}")
print(f"State: {job.state}")
print(f"Tuning Model: {job.tuned_model_display_name}")

3. Canceling a Job (Tier D)

If the user explicitly requests to stop, abort, or cancel a running tuning job:

Safety Check: **Action requires explicit typed confirmation before

proceeding.** You MUST ask the user for confirmation before generating or

providing this script, even if they provided the job ID, unless they explicitly

use confirming language like "Yes, I confirm, cancel tuning job 123456".

> [!IMPORTANT]

>

> **NEVER pre-emptively provide or execute any cancellation code before

> receiving the user's response in a new turn.** You must never speculate or

> assume that confirmation will be given. Asking for confirmation and providing

> the code in a single parallel turn is a severe safety violation.

from google.cloud import aiplatform_v1

project_id = "YOUR_PROJECT_ID"
region = "YOUR_REGION"
job_id = "YOUR_JOB_ID"  # 19-digit ID
name = f"projects/{project_id}/locations/{region}/tuningJobs/{job_id}"

client = aiplatform_v1.GenAiTuningServiceClient(
    client_options={"api_endpoint": f"{region}-aiplatform.googleapis.com"}
)

client.cancel_tuning_job(name=name)
print(f"Successfully requested cancellation for {name}")

Provenance

Authored by Google LLC in google/skills. The content is mirrored here under its upstream license.

Related

agent-platform-alert-configuration Configures best-practice alerting policies for AI agents using OpenTelemetry (OTel) metrics, generating output as Terraform (.tf) configuration files. Use when analyzing, writing, or deploying alerting policies to monitor agent latency, error rates, token usage, and quality metrics. Don't use for standard infrastructure monitoring unrelated to AI agents, or when the agent is not instrumented with OpenTelemetry (for Reliability, Cost, Safety, Security alerts). NOTE: Reliability, Cost, Safety, and Security alerts use generic OTel metrics and work across runtimes (such as Cloud Run, Vertex AI). Quality alerts rely on Vertex AI Online Monitors and are strictly bound to Vertex AI deployments. google/skills Apache-2.0 agent-platform-deploy Deploy open models or custom weights from Model Garden to Agent Platform endpoints, check the status of an in-progress deployment operation, or clean up resources by undeploying models and deleting endpoints. Use when asked to actively deploy a model, list the Model Garden CATALOG of available models, check if a specific model is deployable (`gcloud ai model-garden models list-deployment-config`), query deployment cost, troubleshoot deployment errors (like quota limits), or undeploy/clean up endpoints. Also use when copying and deploying a 1P Tuned Model. Don't use for pure listing/discovery questions of the form "is X deployed?", "list my endpoints", or "which regions have models running?" — for those use `agent-platform-endpoint-management`. Don't use for public Vertex AI deployments (use the `vertex-deploy` skill) or for running model evaluations (use the `agent-platform-eval-flywheel` skill). google/skills Apache-2.0 agent-platform-endpoint-management Manages Agent Platform serving endpoints. Use when you need to create, list, describe, update, or delete serving endpoints for model deployment on Agent Platform. Also use when troubleshooting endpoint permission, quota, or resource busy errors. Don't use for deploying models to endpoints or for running model evaluations. google/skills Apache-2.0 agent-platform-eval-flywheel Measures and improves the quality of AI models and agents on Google Cloud using the Eval Quality Flywheel methodology. Use when evaluating an agent or model, building an eval dataset, picking or writing evaluation metrics, analyzing failures, comparing results before and after a fix, or when guidance is needed on Agent Platform eval methodology — including dataset schema, LLM-as-judge scoring, and common failure causes. For fine-tuning, use agent-platform-tuning. For general production deployment, use agent-platform-deploy. google/skills Apache-2.0 agent-platform-inference Connects to and performs inference with Google Cloud Agent Platform GenAI models, including First-Party Gemini models and Third-Party OpenMaaS models (Llama, DeepSeek, Qwen, etc.). Use when asked to perform inference, ask a model a question, run a test prompt, execute chat completions, or generate code for calling Gemini or OpenMaaS models, authenticate with GenAI SDK, OpenAI SDK, or legacy Agent Platform SDK, configure base URLs and global/regional endpoints, or troubleshoot 429 Resource Exhausted (DSQ), 400 User Validation, or 404 Not Found errors. Don't use for deploying models to endpoints or for running model evaluations. google/skills Apache-2.0