package wordcount

import "github.com/apache/beam/sdks/v2/go/test/integration/wordcount"

Package wordcount contains transforms for wordcount.

Index ¶

• func CountWords(s beam.Scope, lines beam.PCollection) beam.PCollection
• func Format(s beam.Scope, counted beam.PCollection) beam.PCollection
• func WordCount(glob, hash string, size int) *beam.Pipeline
• func WordCountFromPCol(s beam.Scope, in beam.PCollection, hash string, size int)

Functions ¶

func CountWords ¶

func CountWords(s beam.Scope, lines beam.PCollection) beam.PCollection

CountWords is a composite transform that counts the words of a PCollection of lines. It expects a PCollection of type string and returns a PCollection of type KV<string,int>. The Beam type checker enforces these constraints during pipeline construction.

func Format ¶

func Format(s beam.Scope, counted beam.PCollection) beam.PCollection

Format formats a KV of a word and its count as a string.

func WordCount ¶

func WordCount(glob, hash string, size int) *beam.Pipeline

WordCount returns a self-validating wordcount pipeline.

func WordCountFromPCol ¶

func WordCountFromPCol(s beam.Scope, in beam.PCollection, hash string, size int)

WordCountFromPCol counts the words from a PCollection and validates it.

Source Files ¶

wordcount.go