aidentity / index

google/skills · Apache-2.0

bigquery-basics

Manages datasets, tables, and jobs in BigQuery. Use when you need to interact with BigQuery, run SQL queries, manage BigQuery resources (datasets, tables, views), or perform basic data ingestion and analysis.

cloud stable

Contents

BigQuery Basics

BigQuery is a serverless, AI-ready data platform that enables high-speed

analysis of large datasets using SQL and Python. Its disaggregated architecture

separates compute and storage, allowing them to scale independently while

providing built-in machine learning, geospatial analysis, and business

intelligence capabilities.

Setup and Basic Usage

  1. Enable the BigQuery API:

    gcloud services enable bigquery.googleapis.com --quiet
    

  1. Create a Dataset:

    bq mk --dataset --location=US my_dataset
    

  1. Create a Table:

Create a file named schema.json with your table schema:

    [
      {
        "name": "name",
        "type": "STRING",
        "mode": "REQUIRED"
      },
      {
        "name": "post_abbr",
        "type": "STRING",
        "mode": "NULLABLE"
      }
    ]
    

Then create the table with the bq tool:

    bq mk --table my_dataset.mytable schema.json
    

  1. Run a Query:

    bq query --use_legacy_sql=false \
    'SELECT name FROM `bigquery-public-data.usa_names.usa_1910_2013` \
    WHERE state = "TX" LIMIT 10'
    

Reference Directory

  • [Core Concepts](references/core-concepts.md): Storage types, analytics

workflows, and BigQuery Studio features.

  • [Change History](references/change-history.md): Tracking and querying

incremental table changes using APPENDS and CHANGES.

  • [Continuous Queries](references/continuous-queries.md): Running continuous

SQL statements to analyze incoming data in real time.

  • [CLI Usage](references/cli-usage.md): Essential bq command-line tool

operations for managing data and jobs.

  • [Client Libraries](references/client-library-usage.md): Using Google Cloud

client libraries for Python, Java, Node.js, and Go.

  • [MCP Usage](references/mcp-usage.md): Using the BigQuery remote MCP server and

Gemini CLI extension.

  • [Infrastructure as Code](references/iac-usage.md): Terraform examples for

datasets, tables, and reservations.

  • [IAM & Security](references/iam-security.md): Roles, permissions, and data

governance best practices.

*If you need product information not found in these references, use the

Developer Knowledge MCP server search_documents tool.*

Related Skills

  • [BigQuery AI & ML Skill](../bigquery-ai-ml):

SKILL.md file for BigQuery AI and ML capabilities (forecast, anomaly

detection, text generation).

Provenance

Authored by Google LLC in google/skills. The content is mirrored here under its upstream license.

Related

agent-platform-alert-configuration Configures best-practice alerting policies for AI agents using OpenTelemetry (OTel) metrics, generating output as Terraform (.tf) configuration files. Use when analyzing, writing, or deploying alerting policies to monitor agent latency, error rates, token usage, and quality metrics. Don't use for standard infrastructure monitoring unrelated to AI agents, or when the agent is not instrumented with OpenTelemetry (for Reliability, Cost, Safety, Security alerts). NOTE: Reliability, Cost, Safety, and Security alerts use generic OTel metrics and work across runtimes (such as Cloud Run, Vertex AI). Quality alerts rely on Vertex AI Online Monitors and are strictly bound to Vertex AI deployments. google/skills Apache-2.0 agent-platform-deploy Deploy open models or custom weights from Model Garden to Agent Platform endpoints, check the status of an in-progress deployment operation, or clean up resources by undeploying models and deleting endpoints. Use when asked to actively deploy a model, list the Model Garden CATALOG of available models, check if a specific model is deployable (`gcloud ai model-garden models list-deployment-config`), query deployment cost, troubleshoot deployment errors (like quota limits), or undeploy/clean up endpoints. Also use when copying and deploying a 1P Tuned Model. Don't use for pure listing/discovery questions of the form "is X deployed?", "list my endpoints", or "which regions have models running?" — for those use `agent-platform-endpoint-management`. Don't use for public Vertex AI deployments (use the `vertex-deploy` skill) or for running model evaluations (use the `agent-platform-eval-flywheel` skill). google/skills Apache-2.0 agent-platform-endpoint-management Manages Agent Platform serving endpoints. Use when you need to create, list, describe, update, or delete serving endpoints for model deployment on Agent Platform. Also use when troubleshooting endpoint permission, quota, or resource busy errors. Don't use for deploying models to endpoints or for running model evaluations. google/skills Apache-2.0 agent-platform-eval-flywheel Measures and improves the quality of AI models and agents on Google Cloud using the Eval Quality Flywheel methodology. Use when evaluating an agent or model, building an eval dataset, picking or writing evaluation metrics, analyzing failures, comparing results before and after a fix, or when guidance is needed on Agent Platform eval methodology — including dataset schema, LLM-as-judge scoring, and common failure causes. For fine-tuning, use agent-platform-tuning. For general production deployment, use agent-platform-deploy. google/skills Apache-2.0 agent-platform-inference Connects to and performs inference with Google Cloud Agent Platform GenAI models, including First-Party Gemini models and Third-Party OpenMaaS models (Llama, DeepSeek, Qwen, etc.). Use when asked to perform inference, ask a model a question, run a test prompt, execute chat completions, or generate code for calling Gemini or OpenMaaS models, authenticate with GenAI SDK, OpenAI SDK, or legacy Agent Platform SDK, configure base URLs and global/regional endpoints, or troubleshoot 429 Resource Exhausted (DSQ), 400 User Validation, or 404 Not Found errors. Don't use for deploying models to endpoints or for running model evaluations. google/skills Apache-2.0