71 posts tagged with "stackql"

Latest DigitalOcean Provider Available

September 7, 2025 · 5 min read

Technologist and Cloud Consultant

The latest digitalocean provider for StackQL is available now (v25.09.00345), featuring a comprehensive reorganization of services and resources that better aligns with DigitalOcean's API structure. This update improves discoverability, logical grouping, and overall usability when working with DigitalOcean resources through StackQL, while adding exciting new capabilities like support for Gradient AI Platform through the genai service.

What's Changed

The updated DigitalOcean provider features a more granular and logical organization of services that mirrors DigitalOcean's API architecture more closely. Here is a summary of the services included in the latest digitalocean provider:

Service	Description
`account`	Manages account information, settings, and team configurations
`apps`	Manages App Platform deployments for static sites, APIs, and web applications
`billing`	Handles billing configurations, invoices, and payment methods
`compute`	Controls virtual machines (Droplets), snapshots, and compute resources
`container_registry`	Manages container registries and image repositories
`databases`	Manages managed database services and configurations
`genai`	Provides access to AI capabilities including the Gradient AI Platform
`kubernetes`	Controls Kubernetes clusters, node pools, and related resources
`monitoring`	Manages monitoring solutions, alerts, and metrics
`networking`	Controls VPCs, load balancers, and network configurations
`oneclick`	Provides one-click application installations and marketplace solutions
`projects`	Organizes resources into logical groups for better management and billing
`serverless`	Manages Functions as a Service (FaaS) for event-driven, scalable computing
`spaces`	Controls object storage for storing and serving large files and static assets
`vpcs`	Manages Virtual Private Cloud networks for isolated resource communications

note

The improved organization including service and resource naming and mapping will introduce changes to queries against the previous provider version (v24.11.00274). You can pin the previous version in stackql-deploy or via registry pull in the interim while you make necessary query modifications.

Enhanced Documentation

The new DigitalOcean Provider Docs provide comprehensive documentation on how to use the new digitalocean provider including ready-to-use SQL examples for each resource and method. A standout feature is the copy-paste functionality for all SQL queries, making it incredibly easy to:

Compose Infrastructure-as-Code workflows: Each method documentation includes working SQL examples that can be directly copied into your deployment scripts or CI/CD pipelines. Simply click the copy button next to any example to get production-ready SQL code.
Build analytics dashboards: Create sophisticated cross-service queries by combining examples from different resources. The documentation's consistent query formatting makes it simple to join related data across multiple DigitalOcean services.
Develop governance reports: Copy baseline queries and customize them for your specific compliance needs. The pre-formatted SQL provides the perfect starting point for custom reporting.

Gradient AI Platform Support

A standout addition to this release is comprehensive support for DigitalOcean's Gradient AI Platform through the new genai service. This enables developers to:

Deploy and manage AI models using familiar SQL syntax
Monitor AI workloads alongside other cloud resources
Incorporate AI capabilities into infrastructure-as-code workflows
Create cross-service orchestrations that leverage AI capabilities

Getting Started

To start using the updated digitalocean provider, simply pull the latest version from stackql shell or stackql registry command:

registry pull digitalocean;

Then you can begin querying your DigitalOcean resources with SQL:

Droplet inventory
Kubernetes clusters

-- List all droplets
SELECT
  id,
  name,
  status,
  size_slug,
  JSON_EXTRACT(size, '$.vcpus') as vcpus,
  JSON_EXTRACT(size, '$.memory') as memory,
  JSON_EXTRACT(size, '$.disk') as disk_size_gb,
  JSON_EXTRACT(size, '$.price_hourly') as price_hourly,
  JSON_EXTRACT(size, '$.price_monthly') as price_monthly
FROM digitalocean.compute.droplets;

Results:

|-----------|---------------------------------------|--------|------------------------|-------|--------|--------------|--------------|---------------|
|    id     |                 name                  | status |       size_slug        | vcpus | memory | disk_size_gb | price_hourly | price_monthly |
|-----------|---------------------------------------|--------|------------------------|-------|--------|--------------|--------------|---------------|
| 457265395 | ubuntu-s-1vcpu-1gb-35gb-intel-syd1-01 | active | s-1vcpu-1gb-35gb-intel |     1 |   1024 |           35 |       0.0119 |             8 |
|-----------|---------------------------------------|--------|------------------------|-------|--------|--------------|--------------|---------------|
| 510398669 | pool-urzofvwy7-l5vvz                  | active | s-2vcpu-4gb            |     2 |   4096 |           80 |      0.03571 |            24 |
|-----------|---------------------------------------|--------|------------------------|-------|--------|--------------|--------------|---------------|

-- List all Kubernetes clusters
SELECT 
  id,
  name,
  cluster_subnet,
  region,
  JSON_EXTRACT(status, '$.state') as state
FROM 
  digitalocean.kubernetes.clusters;

Results:

|--------------------------------------|------------------------------------|----------------|--------|---------|
|                  id                  |                name                | cluster_subnet | region |  state  |
|--------------------------------------|------------------------------------|----------------|--------|---------|
| 52d8fa14-eca0-46c8-80a8-8aae70a2c82a | k8s-1-33-1-do-2-syd1-1753698369839 | 10.150.0.0/16  | syd1   | running |
|--------------------------------------|------------------------------------|----------------|--------|---------|

Using the App Platform Functions

The apps services provide access to DigitalOcean's modern deployment platforms. Here's an example of how to list your deployed applications:

-- List all deployed applications
SELECT
  id,
  default_ingress,
  active_deployment,
  created_at,
  updated_at,
  region,
  tier_slug
FROM
  digitalocean.apps.apps;

Using the GenAI Service

The new genai service provides access to DigitalOcean's Gradient AI Platform capabilities. Here's an example of how to list deployed agents:

-- List all deployed AI agents
SELECT
  name,
  uuid,
  url,
  project_id,
  created_at,
  updated_at,
  region,
  temperature
FROM
  digitalocean.genai.agents;

Use Cases for the DigitalOcean Provider

Infrastructure as Code: Manage your DigitalOcean resources alongside other cloud providers in a unified IaC approach, see stackql-deploy.
Cost Optimization: Identify unused resources and opportunities for cost savings with queries that expose pricing information across all resource types.
Security and Compliance: Audit firewall rules, network configurations, and access patterns to ensure compliance with security policies.
Performance Monitoring: Track resource utilization, database performance, and identify optimization opportunities.
Cross-Provider Orchestration: Build workflows that span DigitalOcean and other resource providers, enabling sophisticated data and infrastructure pipelines.
AI-Enhanced Infrastructure: Leverage the new GenAI service to incorporate AI capabilities into your infrastructure management workflows.
Automated Reporting: Create automated reports on DigitalOcean usage, performance, and costs.

Provider Metrics

The latest DigitalOcean provider includes:

15 services
192 resources
516 total methods
254 selectable methods

This comprehensive coverage ensures you can manage and query virtually all aspects of your DigitalOcean infrastructure using familiar SQL syntax.

⭐ us on GitHub and join our community!

New Okta Provider Released

September 5, 2025 · 6 min read

Jeffrey Aven

Technologist and Cloud Consultant

The latest okta provider for StackQL is available now (v25.09.00341), featuring a comprehensive reorganization of services and resources that better aligns with Okta's API structure. This update improves discoverability, logical grouping, and overall usability when working with Okta resources through StackQL.

What's Changed

The updated Okta provider features a more granular and logical organization of services that mirrors Okta's API architecture more closely. Here is a summary of the services included in the latest okta provider:

Service	Description
`agentpools`	Manages agent pools for on-premises integration and deployment
`api_tokens`	Handles API token creation, management, and access control
`apps`	Manages Okta application integration, configuration, and assignments
`attack_protection`	Configures security controls to prevent various attack vectors
`authenticators`	Manages authentication methods, factors, and settings
`authorizationservers`	Controls OAuth 2.0 and OIDC authorization servers and policies
`behaviors`	Configures end-user behavioral patterns for risk-based authentication
`brands`	Manages customization of Okta UI appearance and branding
`captchas`	Configures CAPTCHA settings to prevent automated attacks
`device_access`	Controls access policies based on device attributes
`device_assurances`	Manages device trust requirements and verification
`device_integrations`	Configures integrations with MDM and endpoint security tools
`device_posture_checks`	Verifies security posture of devices accessing resources
`devices`	Manages device enrollment, lifecycle, and inventory
`directories`	Handles directory service connections and synchronization
`domains`	Manages custom domain configuration for Okta tenant
`email_domains`	Controls email domains for user provisioning and validation
`email_servers`	Configures email server settings for notifications
`eventhooks`	Manages webhook subscriptions for Okta event notifications
`features`	Controls feature flags and preview feature management
`first_party_app_settings`	Configures settings for Okta-developed applications
`groups`	Manages group creation, membership, and rule configuration
`hook_keys`	Handles encryption keys for securing hook communications
`iam`	Provides core identity and access management functionality
`identity_sources`	Manages sources of identity data for user provisioning
`idps`	Configures external identity providers for federation
`inlinehooks`	Manages customization points within Okta workflows
`integrations`	Configures third-party service integrations
`logs`	Provides access to system logs and audit events
`logstreams`	Manages streaming of log data to external systems
`mappings`	Configures attribute mappings between systems
`meta`	Provides metadata about the Okta API and environment
`oauth2`	Manages OAuth 2.0 clients, scopes, and tokens
`okta_personal_settings`	Controls user-specific preferences and settings
`org`	Manages organization-level settings and configurations
`orgs`	Handles multi-org deployments and org relationships
`policies`	Configures authentication, password, and access policies
`principal_rate_limits`	Manages API rate limits for specific principals
`privileged_access`	Controls privileged access management settings
`push_providers`	Configures push notification delivery services
`rate_limit_settings`	Manages global API rate limit configurations
`realm_assignments`	Maps users and groups to authentication realms
`realms`	Configures authentication realms for different user populations
`risk`	Manages risk-based authentication settings and policies
`roles`	Controls administrative role assignments and permissions
`security`	Provides security settings and configurations
`security_events_providers`	Manages integrations with security event sources
`sessions`	Controls user session policies and management
`ssf`	Configures server-side functions for customization
`templates`	Manages templates for emails, notifications, and forms
`threats`	Controls threat intelligence settings and configurations
`trustedorigins`	Manages CORS and redirect configurations
`users`	Handles user lifecycle, profiles, and credentials
`webauthn_registration`	Manages WebAuthn/FIDO2 credential registration
`zones`	Configures network zones for policy application

note

The improved organization including service and resource naming and mapping will introduce changes to queries against the previous provider version (v23.03.00121), you can pin the previous version in stackql-deploy or via registry pull in the interim while you make necessary query modifications.

Enhanced Documentation

The new Okta Provider Docs provide comprehensive documentation on how to use the new okta provider including ready-to-use SQL examples for each resource and method. A standout feature is the copy-paste functionality for all SQL queries, making it incredibly easy to:

Compose Infrastructure-as-Code workflows: Each method documentation includes working SQL examples that can be directly copied into your deployment scripts or CI/CD pipelines. Simply click the copy button next to any example to get production-ready SQL code.
Build analytics dashboards: Create sophisticated cross-service queries by combining examples from different resources. The documentation's consistent query formatting makes it simple to join related data across multiple Okta services.
Develop governance reports: Copy baseline queries and customize them for your specific compliance needs. The pre-formatted SQL provides the perfect starting point for custom reporting.

Getting Started

To start using the updated okta provider, simply pull the latest version from stackql shell or stackql registry command:

registry pull okta;

Then you can begin querying your Okta resources with SQL:

Group assignments
User activity
Network zones
AuthZ servers and scopes

-- Get all users and their group assignments
SELECT 
  u.id, 
  JSON_EXTRACT(u.profile, '$.email') as email,
  u.status, 
  JSON_EXTRACT(g.profile, '$.name') as group_name
FROM 
  okta.user.users u
JOIN 
  okta.group.users gu ON u.id = gu.user_id
JOIN 
  okta.group.groups g ON gu.group_id = g.id
WHERE subdomain = 'my-company';  

-- Report on users login and activity
SELECT
id,
activated,
created,
lastLogin,
lastUpdated,
passwordChanged,
JSON_EXTRACT(profile, '$.email') as email,
JSON_EXTRACT(profile, '$.firstName') as first_name,
JSON_EXTRACT(profile, '$.lastName') as last_name,
status,
statusChanged
FROM okta.users.users
WHERE subdomain = 'my-company';  

-- Inventory network zones for security audit
SELECT 
  name, 
  type, 
  status, 
  gateways, 
  proxies
FROM 
  okta.networkzone.zones
WHERE subdomain = 'my-company'; 

-- Review authorization servers and scopes
SELECT 
  a.name as auth_server_name,
  s.name as scope_name,
  s.description
FROM 
  okta.authorizationserver.authorizationservers a
JOIN 
  okta.authorizationserver.scopes s ON a.id = s.server_id
WHERE subdomain = 'my-company'; 

Use Cases for the Okta Provider

Infrastructure as Code: Manage your Okta resources alongside other cloud providers in a unified IaC approach, see stackql-deploy.
Cost Optimization: Identify unused resources and opportunities for cost savings.
Security and Compliance: Audit account roles, permissions, and access patterns to ensure compliance with security policies.
Performance Monitoring: Track query performance, warehouse utilization, and identify optimization opportunities.
Cross-Provider Orchestration: Build workflows that span Okta and other resource providers, enabling sophisticated data and infrastructure pipelines.
Automated Reporting: Create automated reports on Okta usage, performance, and costs.

⭐ us on GitHub and join our community!

Updated Google Providers for StackQL Available

August 29, 2025 · 2 min read

Jeffrey Aven

Technologist and Cloud Consultant

The latest versions of the Google-related providers for StackQL: google, googleadmin, googleworkspace, and firebase are available now. These updates include the latest services, resources and methods available from Google.

What's New

The latest release introduces several new services to the google provider, expanding your ability to manage and query Google Cloud resources:

API Hub: Centrally manage and discover APIs across your organization
Area Insights: Access location-based insights and analytics
Cloud Location Finder: Identify optimal Google Cloud regions for your workloads
Gemini Cloud Assist: Leverage Google's AI assistant for cloud operations
Managed Kafka: Work with Google's fully-managed Apache Kafka service
Observability: Enhanced monitoring and observability services
Parallel Store: Interact with Google's high-performance storage solution
Parameter Manager: Manage configuration parameters across services
SaaS Service Management: Tools for managing SaaS offerings on Google Cloud
Secure Source Manager: Google's secure, fully-managed source control service
Security Posture: Assess and improve your cloud security posture
Storage Batch Operations: Perform batch operations on Cloud Storage resources

Enhanced Documentation

We've also released enhanced user documentation to help you get the most out of these providers. Check out our comprehensive docs:

Getting Started

To start using these updated providers, simply pull the latest version from stackql shell or stackql registry command:

registry pull google;
registry pull googleadmin;
registry pull googleworkspace;
registry pull firebase;

Then you can begin querying your Google resources with SQL:

SELECT name, region, status 
FROM google.compute.instances
WHERE project = 'my-project';

Use Cases for the Google Provider

The Google provider for StackQL opens up numerous possibilities:

Infrastructure as Code: Manage your Google resources alongside other cloud providers in a unified IaC approach, see stackql-deploy.
Cost Optimization: Identify unused resources and opportunities for cost savings.
Security and Compliance: Audit account roles, permissions, and access patterns to ensure compliance with security policies.
Performance Monitoring: Track query performance, warehouse utilization, and identify optimization opportunities.
Cross-Provider Orchestration: Build workflows that span Google and other cloud providers, enabling sophisticated data and infrastructure pipelines.
Automated Reporting: Create automated reports on Google usage, performance, and costs.

⭐ us on GitHub and join our community!

Snowflake Provider for StackQL Released

May 20, 2025 · 3 min read

Jeffrey Aven

Technologist and Cloud Consultant

We're excited to announce the release of the Snowflake provider for StackQL! This new provider enables you to query and interact with your Snowflake resources using familiar SQL syntax, bridging the gap between data analytics and infrastructure management.

The Snowflake provider for StackQL gives you the ability to:

Query Snowflake metadata and statistics using SQL
Monitor warehouse, database, and query performance
Analyze resource usage and optimize costs
Integrate Snowflake management with your existing cloud infrastructure
Build cross-provider workflows and automation

Full documentation for the Snowflake provider is available here.

Getting Started

Getting started is as easy as...

REGISTRY PULL snowflake;

Example Queries

Let's explore some powerful examples of what you can do with the Snowflake provider for StackQL.

Analyzing Warehouses

Query
Results

SELECT 
  size, 
  count(*) as num_warehouses
FROM 
  snowflake.warehouse.warehouses
WHERE 
  endpoint = 'OKXVNMC-VH34026'
GROUP BY 
  size;

|---------|----------------|
|  size   | num_warehouses |
|---------|----------------|
| X-Small |             12 |
|---------|----------------|
| Small   |              8 |
|---------|----------------|
| Medium  |              5 |
|---------|----------------|
| Large   |              3 |
|---------|----------------|
| X-Large |              1 |
|---------|----------------|

Other fields for the warehouses resource include : name, warehouse_type, state, scaling_policy, auto_suspend, auto_resume, resource_monitor, enable_query_acceleration, query_acceleration_max_scale_factor, max_concurrency_level, owner, warehouse_credit_limit, target_statement_size and more.

Table Analysis

Query
Results

SELECT 
  name, 
  bytes, 
  data_retention_time_in_days, 
  table_type 
FROM 
  snowflake.table.tables 
WHERE 
  database_name = 'SNOWFLAKE_SAMPLE_DATA' 
  AND schema_name = 'TPCH_SF10' 
  AND endpoint = 'OKXVNMC-VH34026' 
ORDER BY 
  bytes DESC;

|----------|------------|-----------------------------|------------|
|   name   |   bytes    | data_retention_time_in_days | table_type |
|----------|------------|-----------------------------|------------|
| LINEITEM | 1717059584 |                           1 | NORMAL     |
|----------|------------|-----------------------------|------------|
| ORDERS   |  446439424 |                           1 | NORMAL     |
|----------|------------|-----------------------------|------------|
| PARTSUPP |  373145600 |                           1 | NORMAL     |
|----------|------------|-----------------------------|------------|
| CUSTOMER |  108249088 |                           1 | NORMAL     |
|----------|------------|-----------------------------|------------|
| PART     |   52776960 |                           1 | NORMAL     |
|----------|------------|-----------------------------|------------|
| SUPPLIER |    6791168 |                           1 | NORMAL     |
|----------|------------|-----------------------------|------------|
| NATION   |       4096 |                           1 | NORMAL     |
|----------|------------|-----------------------------|------------|
| REGION   |       4096 |                           1 | NORMAL     |
|----------|------------|-----------------------------|------------|

Other Services and Resources

Other notable resources which can be provisioned, managed or queried using the snowflake provider for stackql include:

alerts, api_integrations, catalog_integrations, compute_pools, databases, database_roles, dynamic_tables, event_tables, external_volumes, functions, grants, iceberg_tables, image_repositories, network_policies, notebooks, notification_integrations, pipes, procedures, roles, schemas, stages, streams, tasks, users, user_defined_functions, views, and more!

Use Cases for the Snowflake Provider

The Snowflake provider for StackQL opens up numerous possibilities:

Infrastructure as Code: Manage your Snowflake resources alongside other cloud providers in a unified IaC approach, see stackql-deploy.
Cost Optimization: Identify unused resources, inefficient warehouses, and opportunities for cost savings.
Security and Compliance: Audit account roles, permissions, and access patterns to ensure compliance with security policies.
Performance Monitoring: Track query performance, warehouse utilization, and identify optimization opportunities.
Cross-Provider Orchestration: Build workflows that span Snowflake and other cloud providers, enabling sophisticated data and infrastructure pipelines.
Automated Reporting: Create automated reports on Snowflake usage, performance, and costs.

⭐ us on GitHub and join our community!

(Quickly) Identify Old Node Runtimes in AWS Lambda

April 29, 2025 · 3 min read

Jeffrey Aven

Technologist and Cloud Consultant

Have you been sent one of these?

[Action Required] AWS Lambda end of support for Node.js 18 [AWS Account: 824123456789] [EU-CENTRAL-1]

If you are like me and manage AWS accounts with numerous Lambda functions potentially deployed across multiple regions, you need to identify affected resources, in this case, Lambda node runtimes, which will be discontinued later this year.

With stackql this task is easy...

Open AWS cloud shell in your AWS account (any region - it doesn't matter)
Download stackql

curl -L https://bit.ly/stackql-zip -O && unzip stackql-zip

Open an authenticated stackql command shell

sh stackql-aws-cloud-shell.sh

Run some analytic queries using stackql; here are some examples...

🔍 List all functions and runtimes across regions

Run a stackql query to get the details about functions, runtimes, etc, deployed at any given time across one or more AWS regions. You can include all 25 AWS regions; each query will be performed asynchronously - speeding up the results.

Query
Results

select 
  function_name, 
  region,
  runtime 
FROM aws.lambda.functions 
WHERE region IN ('us-east-1', 'eu-west-1');

|----------------------------------------------|---------------|------------|
| function_name                                | region        | runtime    |
|----------------------------------------------|---------------|------------|
| order-processing-handler                     | us-east-1     | nodejs16.x |
|----------------------------------------------|---------------|------------|
| payment-service-lambda                       | us-east-1     | nodejs18.x |
|----------------------------------------------|---------------|------------|
| user-notifications-service                   | us-east-1     | python3.8  |
|----------------------------------------------|---------------|------------|
| generate-invoice-pdf                         | eu-west-1     | nodejs18.x |
|----------------------------------------------|---------------|------------|
| realtime-data-stream-processor               | eu-west-1     | java11     |
|----------------------------------------------|---------------|------------|
| chat-message-router                          | eu-west-1     | nodejs20.x |
|----------------------------------------------|---------------|------------|
| scheduled-maintenance-checker                | ap-southeast-2| python3.11 |
|----------------------------------------------|---------------|------------|
| s3-image-thumbnail-generator                 | ap-southeast-2| nodejs16.x |
|----------------------------------------------|---------------|------------|
| email-delivery-status-updater                | ap-southeast-2| python3.8  |
|----------------------------------------------|---------------|------------|

📊 Group by runtime and region

Perform an analytic query like a group by aggregate query such as...

Query
Results

select 
  runtime, 
  region, 
  count(*) as num_functions 
FROM aws.lambda.functions 
WHERE region IN ('us-east-1', 'eu-west-1', 'ap-southeast-2')
GROUP BY runtime, region;

|--------------|----------------|---------------|
| runtime      | region         | num_functions |
|--------------|----------------|---------------|
| nodejs16.x   | us-east-1      | 102           |
|--------------|----------------|---------------|
| nodejs18.x   | us-east-1      | 98            |
|--------------|----------------|---------------|
| python3.8    | us-east-1      | 138           |
|--------------|----------------|---------------|
| nodejs18.x   | eu-west-1      | 40            |
|--------------|----------------|---------------|
| java11       | eu-west-1      | 113           |
|--------------|----------------|---------------|
| nodejs20.x   | eu-west-1      | 120           |
|--------------|----------------|---------------|
| python3.11   | ap-southeast-2 | 384           |
|--------------|----------------|---------------|
| nodejs16.x   | ap-southeast-2 | 88            |
|--------------|----------------|---------------|
| python3.8    | ap-southeast-2 | 18            |
|--------------|----------------|---------------|

tip

You can easily visualise this data using a notebook; see stackql-codespaces-notebook or stackql-jupyter-demo.

Using StackQL you can:

Quickly spot functions running on runtimes like nodejs18.x that are approaching end of support.
Plan your upgrades region-by-region with confidence.

⭐ us on GitHub and join our community!

What's Changed​

Enhanced Documentation​

Gradient AI Platform Support​

Getting Started​

Using the App Platform Functions​

Using the GenAI Service​

Use Cases for the DigitalOcean Provider​

Provider Metrics​

What's Changed​

Enhanced Documentation​

Getting Started​

Use Cases for the Okta Provider​

What's New​

Enhanced Documentation​

Getting Started​

Use Cases for the Google Provider​

Getting Started​

Example Queries​

Analyzing Warehouses​

Table Analysis​

Other Services and Resources​

Use Cases for the Snowflake Provider​

🔍 List all functions and runtimes across regions​

📊 Group by runtime and region​

What's Changed

Enhanced Documentation

Gradient AI Platform Support

Getting Started

Using the App Platform Functions

Using the GenAI Service

Use Cases for the DigitalOcean Provider

Provider Metrics

What's Changed

Enhanced Documentation

Getting Started

Use Cases for the Okta Provider

What's New

Enhanced Documentation

Getting Started

Use Cases for the Google Provider

Getting Started

Example Queries

Analyzing Warehouses

Table Analysis

Other Services and Resources

Use Cases for the Snowflake Provider

🔍 List all functions and runtimes across regions

📊 Group by runtime and region