schrodinger.seam.testing.test_pipelines module

class schrodinger.seam.testing.test_pipelines.BenchFlow(num_outputs: int, fanout_rate: int, output_size_bytes: int, with_local_exec_dofn: bool = False)

Bases: apache_beam.transforms.ptransform.PTransform

A workflow for benchmarking the performance and memory of a pipeline.

This workflow generates random strings of a given size and number of outputs.

__init__(num_outputs: int, fanout_rate: int, output_size_bytes: int, with_local_exec_dofn: bool = False)

static generate_random_strings(_: None, size: int, num_out: int) → Iterable[str]

class LocalRandomStringsDoFn(*unused_args, **unused_kwargs)

Bases: schrodinger.seam.transforms._resources._LocalOnlyDoFn, schrodinger.seam.testing.test_pipelines.BenchFlow.LocalRandomStringsDoFn

expand(pbegin)