List of Metrics#
This has the list of metrics which are available for usage. In many systems, only a subset of metrics get stored based on how they would be used.
Metric Tiers#
Importance is about storage, not stability: it says which metrics are worth keeping when capacity is limited, not what we promise about their names.
For that, see Stability Guarantees and Deprecation Policy — in short, mz_* names come from Materialize itself and we disclose rather than freeze them.
Metrics are grouped by “metricImportance” levels (mzmon-specific). These levels guide which metrics are prioritized in metric stores which have limited capacity.
The essential metrics are the set of metrics that are critical and you would always want to have available. These are used in alerting.
The recommended metrics are the set of metrics that are used in dashboards and are generally desirable for troubleshooting.
The extended set of metrics are used for optional/experimental dashboards.
The diagnostic set of metrics are used for in-depth troubleshooting and analysis.
In our materialize-monitoring configuration, we also
provide an all min-importance for including
absolutely everything.
This is recommended if you have cheaper metric storage
like our bundled Thanos provider.
Essential Metrics#
FIXME: Some links for alerts mistakenly point at the common-queries page.
- alloy_build_infoUsed labels: app, namespace, pod
Example queries: - alloy_component_controller_running_componentsUsed labels: app, health_type, namespace, pod
Example queries: - alloy_config_last_load_successfulUsed labels: app, namespace, pod
Example queries: - certmanager_certificate_ready_statusUsed labels: condition
Example queries: - cilium_bpf_map_pressure
- cilium_drop_count_totalUsed labels: reason
Example queries: - container_cpu_cfs_periods_totalUsed labels: container, namespace
Example queries: - container_cpu_cfs_throttled_periods_totalUsed labels: container, namespace
Example queries: - container_cpu_usage_seconds_totalUsed labels: container, namespace, pod
Example queries:- infra.alloy.resources.cpu
- infra.karpenter.controller.cpu
- infra.kubernetes.pods_high_cpu_ratio
- infra.kubernetes.vector_high_cpu_ratio
- materialize.clusters.cpu_high
- materialize.environmentd.high_cpu
- materialize.generations.cpu
- materialize.kubernetes.cpu.usage.absolute
- materialize.kubernetes.cpu.usage.percent
- materialize.kubernetes.pods.cpu_usage
- container_file_descriptorsUsed labels: container
Example queries: - container_fs_limit_bytes
Example queries: - container_fs_usage_bytes
Example queries: - container_last_seenUsed labels: materialize_cloud_swap
Example queries: - container_memory_swap
Example queries: - container_memory_working_set_bytesUsed labels: container, namespace, pod
Example queries:- infra.alloy.resources.memory
- infra.karpenter.controller.memory
- infra.kubernetes.memory_elevated
- infra.kubernetes.memory_high
- materialize.environmentd.high_memory
- materialize.environmentd.memory_elevated
- materialize.generations.memory
- materialize.generations.pods
- materialize.kubernetes.memory.usage.absolute
- materialize.kubernetes.memory.usage.percent
- materialize.kubernetes.pods.memory_usage
- container_network_receive_bytes_totalUsed labels: interface, namespace, pod, workload
Example queries:- infra.egress_gateway.excessive_traffic
- infra.egress_gateway.high_traffic
- infra.egress_gateway.low_traffic
- infra.egress_gateway.traffic_missing_metrics
- infra.net.k8s.errors.by_namespace
- infra.net.k8s.throughput.by_namespace
- infra.net.overview.errors
- infra.net.overview.throughput
- infra.net.overview.top_talkers
- materialize.kubernetes.pods.network_rx
- container_network_receive_errors_totalUsed labels: namespace, pod
Example queries: - container_network_receive_packets_dropped_totalUsed labels: namespace, pod
Example queries: - container_network_transmit_bytes_totalUsed labels: interface, namespace, pod
Example queries: - container_network_transmit_errors_totalUsed labels: namespace, pod
Example queries: - container_network_transmit_packets_dropped_totalUsed labels: namespace, pod
Example queries: - container_spec_cpu_periodUsed labels: container, namespace, pod
Example queries: - container_spec_cpu_quotaUsed labels: container, namespace, pod
Example queries: - container_spec_memory_limit_bytesUsed labels: container, namespace, pod
Example queries:- infra.kubernetes.memory_elevated
- infra.kubernetes.memory_high
- materialize.environmentd.high_memory
- materialize.environmentd.memory_elevated
- materialize.kubernetes.memory.capacity
- materialize.kubernetes.memory.capacity.all_containers
- materialize.kubernetes.memory.usage.percent
- materialize.kubernetes.pods.memory_usage
- container_spec_memory_swap_limit_bytes
Example queries: - container_start_time_secondsUsed labels: container, namespace
Example queries: - container_ulimits_softUsed labels: ulimit
Example queries: - coredns_dns_request_duration_seconds_bucketUsed labels: zone
Example queries: - crdb_dedicated_capacity
- crdb_dedicated_capacity_used
- crdb_dedicated_intentcount
- crdb_dedicated_ranges_underreplicated
Example queries: - crdb_dedicated_rocksdb_read_amplification
- crdb_dedicated_schedules_backup_last_completed_time
Example queries: - crdb_dedicated_sql_mem_distsql_current
- crdb_dedicated_sql_service_latency_bucket
Example queries: - crdb_dedicated_sys_cpu_combined_percent_normalized
- crdb_dedicated_sys_totalmem
Example queries: - ext:consensus_up
Example queries: - kube_deployment_status_conditionUsed labels: condition, deployment, status
Example queries: - kube_deployment_status_replicas_readyUsed labels: namespace
Example queries: - kube_horizontalpodautoscaler_spec_max_replicas
- kube_horizontalpodautoscaler_status_current_replicas
- kube_node_createdUsed labels: node
Example queries: - kube_node_info
- kube_node_spec_taintUsed labels: key, node
Example queries: - kube_node_spec_unschedulableUsed labels: node
Example queries: - kube_node_status_allocatable
- kube_node_status_capacityUsed labels: node, resource
Example queries: - kube_node_status_conditionUsed labels: condition, node, status
Example queries: - kube_pod_container_resource_limitsUsed labels: container, namespace, node, pod, resource
Example queries: - kube_pod_container_resource_requestsUsed labels: container, namespace, node, pod, resource, unit
Example queries:- infra.autoscaling.capacity.requested
- infra.autoscaling.pools.cpu_requested
- infra.autoscaling.pools.memory_requested
- infra.kubernetes.daemonset_high_cpu
- infra.kubernetes.daemonset_saturating_cpu
- infra.kubernetes.daemonset_saturating_mem
- infra.kubernetes.pods_high_cpu_ratio
- infra.kubernetes.vector_high_cpu_ratio
- infra.nodes.allocation.cpu
- infra.nodes.allocation.memory
- infra.nodes.pods.budgets
- kube_pod_container_status_last_terminated_exitcodeUsed labels: container, pod
Example queries: - kube_pod_container_status_last_terminated_reasonUsed labels: container, namespace, pod, reason
Example queries: - kube_pod_container_status_restarts_totalUsed labels: container, namespace, pod
Example queries:- infra.alloy.health.restarts
- infra.kubernetes.oomkill_core_systems
- infra.kubernetes.oomkill_important_systems
- infra.kubernetes.oomkill_nonessential_systems
- infra.kubernetes.pod_restart_rate_high
- infra.kubernetes.pod_restart_rate_high_nonessential
- infra.loki.health.restarts
- infra.nodes.pods.restarts
- materialize.clusterd.error_kill
- materialize.clusterd.new_restarts_during_release
- materialize.clusterd.not_receiving_commands
- materialize.clusterd.swap_cluster_oom
- materialize.clusterd.system_cluster_terminated
- materialize.clusters.replica_oomkilled
- materialize.environmentd.terminated
- kube_pod_container_status_waiting
Example queries: - kube_pod_created
- kube_pod_infoUsed labels: namespace, node
Example queries: - kube_pod_start_time
- kube_pod_status_phaseUsed labels: namespace, phase
Example queries:- infra.autoscaling.capacity.requested
- infra.autoscaling.pods.pending
- infra.autoscaling.pods.pending_by_namespace
- infra.autoscaling.pools.cpu_requested
- infra.autoscaling.pools.memory_requested
- infra.kubernetes.infra_pod_pending
- infra.nodes.allocation.pods
- infra.nodes.pods.by_namespace
- infra.nodes.pods.by_phase
- infra.nodes.pods.not_ready
- materialize.environmentd.pod_pending
- materialize.environmentd.pod_pending_critical
- materialize.kubernetes.pods.readiness
- kube_pod_status_readyUsed labels: condition, namespace, pod
Example queries: - kube_statefulset_status_replicas_readyUsed labels: namespace
Example queries: - kubelet_node_nameUsed labels: workload
Example queries: - kubelet_volume_stats_capacity_bytesUsed labels: persistentvolumeclaim
Example queries: - kubelet_volume_stats_used_bytesUsed labels: persistentvolumeclaim
Example queries: - loki_canary_entries_totalUsed labels: app_instance, namespace
Example queries: - loki_canary_missing_entries_totalUsed labels: app_instance, namespace
Example queries: - loki_canary_response_latency_seconds_bucketUsed labels: app_instance, namespace
Example queries: - loki_canary_spot_check_missing_entries_totalUsed labels: app_instance, namespace
Example queries: - loki_distributor_bytes_received_totalUsed labels: app_instance, namespace
Example queries: - loki_objstore_bucket_operation_failures_totalUsed labels: app_instance, namespace
Example queries: - loki_panic_total
Example queries: - loki_request_duration_seconds_countUsed labels: app_instance, container, namespace, route, status_code
Example queries: - loki_write_dropped_entries_totalUsed labels: app, namespace, pod
Example queries: - loki_write_sent_entries_totalUsed labels: app, namespace, pod
Example queries: - mz_adapter_commandsUsed labels: application_name, materialize_cloud_organization_name, status
Example queries: - mz_auth_request_countUsed labels: path, status
Example queries: - mz_can_connect
- mz_cluster_infoUsed labels: materialize_cloud_organization_name
Example queries: - mz_cluster_server_last_command_receivedUsed labels: cluster_environmentd_materialize_cloud_cluster_id, pod, server_name
Example queries: - mz_dataflow_replica_expiration_remaining_secondsUsed labels: pod
Example queries: - mz_dataflow_wallclock_lag_secondsUsed labels: instance_id, materialize_cloud_organization_name, pod, quantile, replica_id
Example queries:- materialize.clusters.falling_behind
- materialize.clusters.hydration_stuck
- materialize.clusters.stale
- materialize.compute.freshness.lag_by_cluster
- materialize.compute.freshness.lag_total_by_cluster
- materialize.compute.freshness.top_collections
- materialize.compute.hydration.currently_hydrating
- materialize.generations.collections
- materialize.generations.hydrating
- materialize.generations.lag.max
- materialize.generations.lag.total
- materialize.generations.lag.total_by_cluster
- materialize.info.max_lag
- materialize.system_clusters.falling_behind
- materialize.system_clusters.hydration_stuck
- materialize.system_clusters.stale
- mz_envd_up
Example queries: - mz_external_calls_countUsed labels: status
Example queries: - mz_external_envd_up
Example queries: - mz_memory_limiter_memory_limit_bytesUsed labels: pod
Example queries: - mz_memory_limiter_memory_usage_bytesUsed labels: pod
Example queries: - mz_metrics_resource_usageUsed labels: cluster_environmentd_materialize_cloud_cluster_id, metric
Example queries: - mz_parameter_frontend_last_cse_time_seconds
Example queries: - mz_parameter_frontend_last_sse_time_seconds
Example queries: - mz_persist_columnar_op_countUsed labels: op, result
Example queries: - mz_persist_compaction_droppedUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_compaction_failedUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_compaction_noop
Example queries: - mz_persist_consensus_failures
Example queries: - mz_persist_external_blob_delete_noop_count
Example queries: - mz_persist_external_failed_countUsed labels: materialize_cloud_organization_name, op
Example queries: - mz_persist_lease_timeout_readUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_pushdown_parts_mismatched_stats_count
Example queries: - mz_persist_schema_cache_fetch_state_count
Example queries: - mz_persist_shard_unconsolidated_snapshot
Example queries: - mz_persist_state_update_state_slow_path
Example queries: - mz_shard_finalization_outstanding
Example queries: - mz_source_offset_committedUsed labels: cluster_environmentd_materialize_cloud_cluster_id, cluster_environmentd_materialize_cloud_replica_id, materialize_cloud_organization_name
Example queries: - mz_source_offset_knownUsed labels: cluster_environmentd_materialize_cloud_cluster_id, cluster_environmentd_materialize_cloud_replica_id, materialize_cloud_organization_name
Example queries: - mz_time_to_first_row_seconds_bucketUsed labels: application_name, instance_id
Example queries: - mz_views_query_successful
- node_boot_time_secondsUsed labels: instance
Example queries: - node_cpu_seconds_totalUsed labels: instance, mode
Example queries: - node_disk_io_time_seconds_totalUsed labels: instance
Example queries: - node_filefd_allocatedUsed labels: instance
Example queries: - node_filefd_maximumUsed labels: instance
Example queries: - node_filesystem_avail_bytesUsed labels: fstype, instance
Example queries: - node_filesystem_readonlyUsed labels: fstype, instance
Example queries: - node_filesystem_size_bytesUsed labels: fstype, instance
Example queries: - node_load1Used labels: instance
Example queries: - node_memory_MemAvailable_bytesUsed labels: instance
Example queries: - node_memory_MemTotal_bytesUsed labels: instance
Example queries: - node_memory_SwapFree_bytesUsed labels: instance
Example queries: - node_memory_SwapTotal_bytesUsed labels: instance
Example queries: - node_network_receive_bytes_totalUsed labels: device, instance
Example queries: - node_network_receive_drop_totalUsed labels: instance
Example queries: - node_network_receive_errs_totalUsed labels: instance
Example queries: - node_network_transmit_bytes_totalUsed labels: device, instance
Example queries: - node_network_transmit_drop_totalUsed labels: instance
Example queries: - node_network_transmit_errs_totalUsed labels: instance
Example queries: - node_nf_conntrack_entriesUsed labels: instance
Example queries: - node_nf_conntrack_entries_limitUsed labels: instance
Example queries: - node_pressure_cpu_waiting_seconds_totalUsed labels: instance
Example queries: - node_pressure_memory_stalled_seconds_totalUsed labels: instance
Example queries: - node_pressure_memory_waiting_seconds_totalUsed labels: instance
Example queries: - node_scrape_collector_successUsed labels: instance
Example queries: - node_time_secondsUsed labels: instance
Example queries: - node_vmstat_oom_killUsed labels: instance
Example queries: - node_vmstat_pswpinUsed labels: instance
Example queries: - node_vmstat_pswpoutUsed labels: instance
Example queries: - prometheus_remote_storage_highest_timestamp_in_secondsUsed labels: app, namespace, pod
Example queries: - prometheus_remote_storage_queue_highest_sent_timestamp_secondsUsed labels: app, namespace, pod
Example queries: - prometheus_remote_storage_samples_failed_totalUsed labels: app, namespace, pod, url
Example queries: - prometheus_remote_storage_samples_totalUsed labels: app, namespace, pod, url
Example queries: - upUsed labels: app, app_instance, cluster_environmentd_materialize_cloud_cluster_id, container, job, namespace, network_component, pod
Example queries:- infra.alloy.health.agents_missing
- infra.alloy.health.restarts
- infra.alloy.health.up
- infra.alloy.metric_pipeline.down_targets
- infra.alloy.metric_pipeline.targets_down
- infra.alloy.resources.cpu
- infra.alloy.resources.memory
- infra.alloy.resources.terminations
- infra.alloy.resources.throttling
- infra.cloud.collection.pulls
- infra.loki.health.up
- infra.monitoring.clusterd_metrics_missing
- infra.monitoring.critical_metrics_missing
- infra.net.overview.dataplane
- materialize.environmentd.down
- materialize.environmentd.not_scraped
- materialize.scraper.mzmon.clusterd
- materialize.scraper.mzmon.environmentd
- materialize.scraper.mzmon.orchestratord
Recommended Metrics#
- alloy_component_evaluation_queue_sizeUsed labels: app, namespace, pod
Example queries: - alloy_component_evaluation_seconds_countUsed labels: app, namespace, pod
Example queries: - alloy_component_evaluation_slow_secondsUsed labels: app, namespace, pod
Example queries: - alloy_config_hashUsed labels: app, namespace, pod
Example queries: - alloy_resources_process_start_time_secondsUsed labels: app, namespace, pod
Example queries: - awscni_assigned_ip_addresses
Example queries: - awscni_aws_api_latency_ms_count
Example queries: - awscni_aws_api_latency_ms_sum
Example queries: - awscni_eni_allocated
Example queries: - awscni_eni_max
Example queries: - awscni_ip_max
Example queries: - awscni_no_available_ip_addresses
Example queries: - awscni_total_ip_addresses
Example queries: - cilium_endpoint_regeneration_time_stats_seconds_bucket
Example queries: - cilium_endpoint_state
Example queries: - cilium_policy_verdict_total
Example queries: - cilium_unreachable_health_endpoints
Example queries: - cilium_unreachable_nodes
Example queries: - cluster_node_gossip_health_scoreUsed labels: app, namespace, pod
Example queries: - cluster_node_infoUsed labels: app, namespace, pod
Example queries: - cluster_node_peersUsed labels: app, namespace, pod
Example queries: - cluster_ready_for_trafficUsed labels: app, namespace, pod
Example queries: - cluster_transport_stream_tx_packets_failed_totalUsed labels: app, namespace, pod
Example queries: - cluster_transport_tx_packets_failed_totalUsed labels: app, namespace, pod
Example queries: - environmentd_needs_updateUsed labels: namespace
Example queries: - hubble_flows_processed_total
Example queries: - kube_daemonset_status_desired_number_scheduledUsed labels: daemonset, namespace
Example queries: - kube_endpointslice_endpointsUsed labels: namespace
Example queries: - kube_horizontalpodautoscaler_spec_min_replicas
Example queries: - kube_horizontalpodautoscaler_status_conditionUsed labels: condition, status
Example queries: - kube_horizontalpodautoscaler_status_desired_replicas
Example queries: - kube_networkpolicy_spec_egress_rulesUsed labels: namespace
Example queries: - kube_networkpolicy_spec_ingress_rulesUsed labels: namespace
Example queries: - kube_node_labels
- kube_pod_status_scheduledUsed labels: condition
Example queries: - kube_service_spec_type
Example queries: - kube_service_status_load_balancer_ingress
Example queries: - kubeproxy_network_programming_duration_seconds_bucket
Example queries: - kubeproxy_sync_proxy_rules_duration_seconds_bucket
Example queries: - loki_boltdb_shipper_compact_tables_operation_last_successful_run_timestamp_secondsUsed labels: app_instance, namespace
Example queries: - loki_boltdb_shipper_compact_tables_operation_totalUsed labels: app_instance, namespace
Example queries: - loki_cache_fetched_keysUsed labels: app_instance, namespace
Example queries: - loki_cache_hitsUsed labels: app_instance, namespace
Example queries: - loki_compactor_apply_retention_last_successful_run_timestamp_secondsUsed labels: app_instance, namespace
Example queries: - loki_compactor_oldest_pending_delete_request_age_secondsUsed labels: app_instance, namespace
Example queries: - loki_compactor_pending_delete_requests_countUsed labels: app_instance, namespace
Example queries: - loki_discarded_bytes_totalUsed labels: app_instance, namespace
Example queries: - loki_discarded_samples_totalUsed labels: app_instance, namespace
Example queries: - loki_distributor_lines_received_totalUsed labels: app_instance, namespace
Example queries: - loki_ingester_chunks_flushed_totalUsed labels: app_instance, namespace
Example queries: - loki_ingester_memory_chunksUsed labels: app_instance, namespace
Example queries: - loki_ingester_memory_streamsUsed labels: app_instance, namespace
Example queries: - loki_ingester_wal_disk_full_failures_totalUsed labels: app_instance, namespace
Example queries: - loki_ingester_wal_disk_usage_percentUsed labels: app_instance, namespace
Example queries: - loki_ingester_wal_replay_activeUsed labels: app_instance, namespace
Example queries: - loki_logql_querystats_bytes_processed_per_seconds_sumUsed labels: app_instance, namespace
Example queries: - loki_objstore_bucket_operations_totalUsed labels: app_instance, namespace
Example queries: - loki_process_cri_lines_truncated_totalUsed labels: app, namespace, pod
Example queries: - loki_process_dropped_lines_totalUsed labels: app, namespace, pod, reason
Example queries: - loki_query_frontend_queries_in_progressUsed labels: app_instance, namespace
Example queries: - loki_source_api_entries_writtenUsed labels: app, namespace, pod
Example queries: - loki_source_api_request_duration_seconds_countUsed labels: app, namespace, pod, route, status_code
Example queries: - loki_source_file_files_active_totalUsed labels: app, namespace, pod
Example queries: - loki_source_file_read_lines_totalUsed labels: app, namespace, pod
Example queries: - loki_source_journal_target_lines_totalUsed labels: app, namespace, pod
Example queries: - loki_tsdb_shipper_tables_sync_operation_totalUsed labels: app_instance, namespace
Example queries: - loki_tsdb_shipper_tables_upload_operation_totalUsed labels: app_instance, namespace
Example queries: - loki_write_batch_retries_totalUsed labels: app, namespace, pod
Example queries: - loki_write_request_duration_seconds_countUsed labels: app, namespace, pod
Example queries: - memcached_current_bytesUsed labels: app_instance, namespace
Example queries: - memcached_limit_bytesUsed labels: app_instance, namespace
Example queries: - mz_active_sessionsUsed labels: materialize_cloud_organization_name
Example queries: - mz_active_subscribesUsed labels: materialize_cloud_organization_name
Example queries: - mz_arrangement_maintenance_seconds_totalUsed labels: cluster_environmentd_materialize_cloud_cluster_id, cluster_environmentd_materialize_cloud_replica_id, materialize_cloud_organization_name
Example queries: - mz_arrangement_record_countUsed labels: collection_id, instance_id, materialize_cloud_organization_name, replica_id
Example queries: - mz_compute_cluster_statusUsed labels: compute_cluster_id, compute_replica_id, compute_replica_name, materialize_cloud_organization_name, pod
Example queries: - mz_compute_commands_totalUsed labels: materialize_cloud_organization_name, pod
Example queries: - mz_compute_controller_hydration_queue_sizeUsed labels: instance_id, materialize_cloud_organization_name, replica_id
Example queries: - mz_compute_hydration_time_secondsUsed labels: hydrated, instance_id, materialize_cloud_organization_name, replica_id
Example queries: - mz_compute_peek_duration_seconds_bucketUsed labels: instance_id, materialize_cloud_organization_name
Example queries: - mz_compute_replica_history_dataflow_countUsed labels: cluster_environmentd_materialize_cloud_cluster_id, cluster_environmentd_materialize_cloud_replica_id, materialize_cloud_organization_name
Example queries: - mz_dataflow_elapsed_seconds_totalUsed labels: instance_id, materialize_cloud_organization_name, replica_id
Example queries: - mz_indexes_countUsed labels: materialize_cloud_organization_name
Example queries: - mz_mzd_views_countUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_blob_cache_hits_bytesUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_blob_hedges_firedUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_blob_hedges_wonUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_cmd_cas_mismatch_countUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_compaction_appliedUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_compaction_bytesUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_compaction_queued_secondsUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_compaction_requestedUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_compaction_secondsUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_compaction_startedUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_compaction_timed_outUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_compaction_write_stall_countUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_external_bytes_countUsed labels: materialize_cloud_organization_name, op
Example queries: - mz_persist_external_consensus_truncated_countUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_external_rtt_latencyUsed labels: external, materialize_cloud_organization_name
Example queries: - mz_persist_external_secondsUsed labels: materialize_cloud_organization_name, op
Example queries: - mz_persist_external_started_countUsed labels: materialize_cloud_organization_name, op
Example queries: - mz_persist_external_succeeded_countUsed labels: materialize_cloud_organization_name, op
Example queries: - mz_persist_gc_finishedUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_gc_noopUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_gc_startedUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_postgres_connpool_acquire_secondsUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_postgres_connpool_acquiresUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_postgres_connpool_availableUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_postgres_connpool_connection_errorsUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_postgres_connpool_connections_createdUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_postgres_connpool_sizeUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_postgres_connpool_ttl_reconnectionsUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_retry_retries_countUsed labels: materialize_cloud_organization_name, op
Example queries: - mz_persist_s3_connect_timeoutsUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_s3_errorsUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_s3_operation_attempt_timeoutsUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_s3_operation_timeoutsUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_s3_operationsUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_s3_read_timeoutsUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_user_bytesUsed labels: materialize_cloud_organization_name
Example queries: - mz_persist_user_write_stall_countUsed labels: materialize_cloud_organization_name
Example queries: - mz_query_totalUsed labels: materialize_cloud_organization_name
Example queries: - mz_sink_bytes_committedUsed labels: cluster_environmentd_materialize_cloud_cluster_id, cluster_environmentd_materialize_cloud_replica_id, materialize_cloud_organization_name
Example queries: - mz_sink_bytes_stagedUsed labels: cluster_environmentd_materialize_cloud_cluster_id, cluster_environmentd_materialize_cloud_replica_id, materialize_cloud_organization_name
Example queries: - mz_sink_iceberg_commit_conflictsUsed labels: cluster_environmentd_materialize_cloud_cluster_id, cluster_environmentd_materialize_cloud_replica_id, materialize_cloud_organization_name
Example queries: - mz_sink_iceberg_commit_duration_seconds_bucketUsed labels: cluster_environmentd_materialize_cloud_cluster_id, cluster_environmentd_materialize_cloud_replica_id, materialize_cloud_organization_name
Example queries: - mz_sink_iceberg_commit_failuresUsed labels: cluster_environmentd_materialize_cloud_cluster_id, cluster_environmentd_materialize_cloud_replica_id, materialize_cloud_organization_name
Example queries: - mz_sink_iceberg_data_files_writtenUsed labels: cluster_environmentd_materialize_cloud_cluster_id, cluster_environmentd_materialize_cloud_replica_id, materialize_cloud_organization_name
Example queries: - mz_sink_iceberg_delete_files_writtenUsed labels: cluster_environmentd_materialize_cloud_cluster_id, cluster_environmentd_materialize_cloud_replica_id, materialize_cloud_organization_name
Example queries: - mz_sink_iceberg_snapshots_committedUsed labels: cluster_environmentd_materialize_cloud_cluster_id, cluster_environmentd_materialize_cloud_replica_id, materialize_cloud_organization_name
Example queries: - mz_sink_rdkafka_connectsUsed labels: cluster_environmentd_materialize_cloud_cluster_id, cluster_environmentd_materialize_cloud_replica_id, materialize_cloud_organization_name
Example queries: - mz_sink_rdkafka_disconnectsUsed labels: cluster_environmentd_materialize_cloud_cluster_id, cluster_environmentd_materialize_cloud_replica_id, materialize_cloud_organization_name
Example queries: - mz_sink_rdkafka_outbuf_msg_cntUsed labels: cluster_environmentd_materialize_cloud_cluster_id, cluster_environmentd_materialize_cloud_replica_id, materialize_cloud_organization_name
Example queries: - mz_sink_rdkafka_txerrsUsed labels: cluster_environmentd_materialize_cloud_cluster_id, cluster_environmentd_materialize_cloud_replica_id, materialize_cloud_organization_name
Example queries: - mz_source_bytes_receivedUsed labels: cluster_environmentd_materialize_cloud_cluster_id, cluster_environmentd_materialize_cloud_replica_id, materialize_cloud_organization_name
Example queries: - mz_source_messages_receivedUsed labels: cluster_environmentd_materialize_cloud_cluster_id, cluster_environmentd_materialize_cloud_replica_id, materialize_cloud_organization_name
Example queries: - mz_source_offset_commit_failuresUsed labels: cluster_environmentd_materialize_cloud_cluster_id, cluster_environmentd_materialize_cloud_replica_id, materialize_cloud_organization_name
Example queries: - mz_storage_objectsUsed labels: materialize_cloud_organization_name, type
Example queries: - mz_tables_countUsed labels: materialize_cloud_organization_name
Example queries: - mz_ts_oracle_failed_countUsed labels: materialize_cloud_organization_name
Example queries: - mz_ts_oracle_postgres_connpool_acquire_secondsUsed labels: materialize_cloud_organization_name
Example queries: - mz_ts_oracle_postgres_connpool_acquiresUsed labels: materialize_cloud_organization_name
Example queries: - mz_ts_oracle_postgres_connpool_availableUsed labels: materialize_cloud_organization_name
Example queries: - mz_ts_oracle_postgres_connpool_connection_errorsUsed labels: materialize_cloud_organization_name
Example queries: - mz_ts_oracle_postgres_connpool_connections_createdUsed labels: materialize_cloud_organization_name
Example queries: - mz_ts_oracle_postgres_connpool_sizeUsed labels: materialize_cloud_organization_name
Example queries: - mz_ts_oracle_postgres_connpool_ttl_reconnectionsUsed labels: materialize_cloud_organization_name
Example queries: - mz_ts_oracle_retry_retries_countUsed labels: materialize_cloud_organization_name
Example queries: - mz_ts_oracle_secondsUsed labels: materialize_cloud_organization_name
Example queries: - mz_ts_oracle_started_countUsed labels: materialize_cloud_organization_name
Example queries: - mz_views_countUsed labels: materialize_cloud_organization_name
Example queries: - network_policy_drop_count_total
Example queries: - node_arp_entriesUsed labels: instance
Example queries: - node_context_switches_totalUsed labels: instance
Example queries: - node_disk_io_time_weighted_seconds_totalUsed labels: instance
Example queries: - node_disk_read_bytes_totalUsed labels: instance
Example queries: - node_disk_read_time_seconds_totalUsed labels: instance
Example queries: - node_disk_reads_completed_totalUsed labels: instance
Example queries: - node_disk_write_time_seconds_totalUsed labels: instance
Example queries: - node_disk_writes_completed_totalUsed labels: instance
Example queries: - node_disk_written_bytes_totalUsed labels: instance
Example queries: - node_entropy_available_bitsUsed labels: instance
Example queries: - node_entropy_pool_size_bitsUsed labels: instance
Example queries: - node_filesystem_filesUsed labels: fstype, instance
Example queries: - node_filesystem_files_freeUsed labels: fstype, instance
Example queries: - node_intr_totalUsed labels: instance
Example queries: - node_memory_Buffers_bytesUsed labels: instance
Example queries: - node_memory_Cached_bytesUsed labels: instance
Example queries: - node_memory_Committed_AS_bytesUsed labels: instance
Example queries: - node_memory_MemFree_bytesUsed labels: instance
Example queries: - node_memory_SReclaimable_bytesUsed labels: instance
Example queries: - node_memory_SUnreclaim_bytesUsed labels: instance
Example queries: - node_memory_Slab_bytesUsed labels: instance
Example queries: - node_netstat_TcpExt_ListenDropsUsed labels: instance
Example queries: - node_netstat_TcpExt_ListenOverflowsUsed labels: instance
Example queries: - node_netstat_TcpExt_TCPRcvQDropUsed labels: instance
Example queries: - node_netstat_TcpExt_TCPSynRetransUsed labels: instance
Example queries: - node_netstat_TcpExt_TCPTimeoutsUsed labels: instance
Example queries: - node_netstat_Tcp_OutSegsUsed labels: instance
Example queries: - node_netstat_Tcp_RetransSegsUsed labels: instance
Example queries: - node_netstat_Udp_InErrorsUsed labels: instance
Example queries: - node_netstat_Udp_NoPortsUsed labels: instance
Example queries: - node_netstat_Udp_RcvbufErrorsUsed labels: instance
Example queries: - node_network_carrierUsed labels: instance
Example queries: - node_network_speed_bytesUsed labels: instance
Example queries: - node_network_upUsed labels: instance
Example queries: - node_schedstat_waiting_seconds_totalUsed labels: instance
Example queries: - node_scrape_collector_duration_secondsUsed labels: instance
Example queries: - node_sockstat_TCP_allocUsed labels: instance
Example queries: - node_sockstat_TCP_inuseUsed labels: instance
Example queries: - node_sockstat_TCP_mem_bytesUsed labels: instance
Example queries: - node_sockstat_TCP_orphanUsed labels: instance
Example queries: - node_sockstat_TCP_twUsed labels: instance
Example queries: - node_sockstat_UDP_mem_bytesUsed labels: instance
Example queries: - node_softnet_dropped_totalUsed labels: instance
Example queries: - node_softnet_processed_totalUsed labels: instance
Example queries: - node_softnet_times_squeezed_totalUsed labels: instance
Example queries: - node_timex_estimated_error_secondsUsed labels: instance
Example queries: - node_timex_maxerror_secondsUsed labels: instance
Example queries: - node_timex_offset_secondsUsed labels: instance
Example queries: - node_timex_sync_statusUsed labels: instance
Example queries: - node_udp_queuesUsed labels: instance, ip, queue
Example queries: - node_vmstat_pgfaultUsed labels: instance
Example queries: - node_vmstat_pgmajfaultUsed labels: instance
Example queries: - node_vmstat_pgscan_directUsed labels: instance
Example queries: - node_vmstat_pgscan_kswapdUsed labels: instance
Example queries: - node_vmstat_pgsteal_directUsed labels: instance
Example queries: - node_vmstat_pgsteal_kswapdUsed labels: instance
Example queries: - orchestratord_is_leaderUsed labels: namespace
Example queries: - orchestratord_reconciliation_duration_seconds_bucketUsed labels: namespace
Example queries: - orchestratord_reconciliation_step_duration_seconds_bucketUsed labels: namespace
Example queries: - orchestratord_reconciliation_steps_totalUsed labels: namespace, outcome
Example queries: - orchestratord_reconciliations_total
- otelcol_exporter_queue_capacityUsed labels: app, namespace, pod
Example queries: - otelcol_exporter_queue_sizeUsed labels: app, namespace, pod
Example queries: - otelcol_exporter_send_failed_log_records_totalUsed labels: app, namespace, pod
Example queries: - otelcol_exporter_send_failed_metric_points_totalUsed labels: app, namespace, pod
Example queries: - otelcol_exporter_sent_log_records_totalUsed labels: app, namespace, pod
Example queries: - otelcol_exporter_sent_metric_points_totalUsed labels: app, namespace, pod
Example queries: - otelcol_processor_filter_datapoints_filtered_totalUsed labels: app, namespace, pod
Example queries: - otelcol_processor_memory_limiter_accepted_metric_points_totalUsed labels: app, namespace, pod
Example queries: - otelcol_processor_memory_limiter_refused_metric_points_totalUsed labels: app, namespace, pod
Example queries: - otelcol_receiver_accepted_log_records_totalUsed labels: app, namespace, pod
Example queries: - otelcol_receiver_accepted_metric_points_totalUsed labels: app, namespace, pod
Example queries: - otelcol_receiver_refused_log_records_totalUsed labels: app, namespace, pod
Example queries: - otelcol_receiver_refused_metric_points_totalUsed labels: app, namespace, pod
Example queries: - prometheus_api_remote_write_invalid_labels_samples_totalUsed labels: app, namespace, pod
Example queries: - prometheus_forwarded_samples_totalUsed labels: app, component_id, namespace, pod
Example queries: - prometheus_receive_http_request_duration_seconds_countUsed labels: app, namespace, pod, route, status_code
Example queries: - prometheus_remote_storage_samples_retried_totalUsed labels: app, namespace, pod, url
Example queries: - prometheus_remote_storage_shardsUsed labels: app, namespace, pod
Example queries: - prometheus_remote_storage_shards_desiredUsed labels: app, namespace, pod
Example queries: - prometheus_remote_storage_shards_maxUsed labels: app, namespace, pod
Example queries: - prometheus_remote_write_wal_checkpoint_creations_failed_totalUsed labels: app, namespace, pod
Example queries: - prometheus_remote_write_wal_corruptions_totalUsed labels: app, namespace, pod
Example queries: - prometheus_remote_write_wal_storage_active_seriesUsed labels: app, namespace, pod
Example queries: - prometheus_target_scrape_pool_exceeded_label_limits_totalUsed labels: app, namespace, pod
Example queries: - prometheus_target_scrape_pool_exceeded_target_limit_totalUsed labels: app, namespace, pod
Example queries: - prometheus_target_scrape_pool_targetsUsed labels: app, namespace, pod
Example queries: - prometheus_target_scrapes_exceeded_body_size_limit_totalUsed labels: app, namespace, pod
Example queries: - prometheus_target_scrapes_exceeded_sample_limit_totalUsed labels: app, namespace, pod
Example queries: - prometheus_target_scrapes_sample_duplicate_timestamp_totalUsed labels: app, namespace, pod
Example queries: - prometheus_target_scrapes_sample_out_of_bounds_totalUsed labels: app, namespace, pod
Example queries: - prometheus_target_scrapes_sample_out_of_order_totalUsed labels: app, namespace, pod
Example queries: - prometheus_tsdb_wal_storage_size_bytesUsed labels: app, namespace, pod
Example queries: - prometheus_tsdb_wal_truncations_failed_totalUsed labels: app, namespace, pod
Example queries: - prometheus_tsdb_wal_writes_failed_totalUsed labels: app, namespace, pod
Example queries: - scrape_duration_seconds
Example queries: - scrape_samples_post_metric_relabeling
Example queries: