package load

import "github.com/apache/beam/sdks/v2/go/test/load"

Index

Functions

func PublishMetrics

func PublishMetrics(results metrics.QueryResults)

PublishMetrics calculates the runtime and sends the result to InfluxDB database.

Types

type RuntimeMonitor

type RuntimeMonitor struct{}

RuntimeMonitor is a DoFn to record processing time in the pipeline.

It uses a distribution metric which is updated every time a new bundle starts or finishes. The processing time can be extracted by calculating the difference of the maximum and the minimum value of the distribution metric.

func (*RuntimeMonitor) FinishBundle

func (fn *RuntimeMonitor) FinishBundle(ctx context.Context, emit func([]byte, []byte))

FinishBundle updates a distribution metric.

func (*RuntimeMonitor) ProcessElement

func (fn *RuntimeMonitor) ProcessElement(key, value []byte, emit func([]byte, []byte))

ProcessElement emits unmodified input elements.

func (*RuntimeMonitor) StartBundle

func (fn *RuntimeMonitor) StartBundle(ctx context.Context, emit func([]byte, []byte))

StartBundle updates a distribution metric.

Source Files

util.go

Directories

PathSynopsis
go/test/load/cogbk
go/test/load/combine
go/test/load/group_by_key
go/test/load/pardo
go/test/load/sideinput
Version
v2.65.0 (latest)
Published
May 6, 2025
Platform
linux/amd64
Imports
13 packages
Last checked
2 days ago

Tools for package owners.