package regression

import "github.com/apache/beam/sdks/v2/go/test/regression"

Package regression contains pipeline regression tests.

Index ¶

• Constants
• func DirectParDo() *beam.Pipeline
• func DirectParDoAfterGBK() *beam.Pipeline
• func EmitParDo() *beam.Pipeline
• func EmitParDoAfterGBK() *beam.Pipeline
• func LPErrorPipeline(s beam.Scope) beam.PCollection
• func LPErrorReshufflePipeline(s beam.Scope) beam.PCollection
• func MixedOutputParDo() *beam.Pipeline
• func MultiEmitParDo() *beam.Pipeline

Constants ¶

const (
	// MetricNamespace is the namespace for regression test metrics.
	MetricNamespace = string("regression")
	// FruitCounterName is the name of the fruit counter metric.
	FruitCounterName = string("fruitCount")
)

Functions ¶

func DirectParDo ¶

func DirectParDo() *beam.Pipeline

DirectParDo tests direct form output DoFns.

func DirectParDoAfterGBK ¶

func DirectParDoAfterGBK() *beam.Pipeline

DirectParDoAfterGBK generates a pipeline with a direct-form ParDo after a GBK. See: BEAM-3978 and BEAM-4175.

func EmitParDo ¶

func EmitParDo() *beam.Pipeline

EmitParDo tests emit form output DoFns.

func EmitParDoAfterGBK ¶

func EmitParDoAfterGBK() *beam.Pipeline

EmitParDoAfterGBK generates a pipeline with a emit-form ParDo after a GBK. See: BEAM-3978 and BEAM-4175.

func LPErrorPipeline ¶

func LPErrorPipeline(s beam.Scope) beam.PCollection

LPErrorPipeline constructs a pipeline that has a GBK followed by a CoGBK using the same input, with schema encoded structs as elements. This ends up having the stage after the CoGBK fail since the decoder post-cogbk is missing a Length Prefix coder that was applied to the GBK input, but not the CoGBK output. Root is likely in that there's no Beam standard CoGBK format for inject and expand. JIRA: BEAM-12438

func LPErrorReshufflePipeline ¶

func LPErrorReshufflePipeline(s beam.Scope) beam.PCollection

LPErrorReshufflePipeline checks a Row type with reshuffle transforms. It's intentionally just a prefix with validation done in the specific test cases, as the success/failure is dependent on subsequent pipeline use of data.

This pipeline will output a pcollection containing 3 fruit.

func MixedOutputParDo ¶

func MixedOutputParDo() *beam.Pipeline

MixedOutputParDo tests mixed direct + emit form output DoFns.

func MultiEmitParDo ¶

func MultiEmitParDo() *beam.Pipeline

MultiEmitParDo tests double emit form output DoFns.

Source Files ¶

lperror.go pardo.go

Directories ¶