schrodinger.seam.testing.stu_tests.workerfleet_gc module

Test that WorkerFleet objects are properly garbage collected after pipeline execution.

This test verifies the fix for SEAM-428: Driver memory growing with workers. The issue was that WorkerFleet objects were kept alive by a closure chain through the periodic callback passed to JobDJ.run().

Usage:

$SCHRODINGER/run python3 -m schrodinger.seam.testing.stu_tests.workerfleet_gc

class schrodinger.seam.testing.stu_tests.workerfleet_gc.ExpensiveTransform(label: Optional[str] = None)

Bases: PTransform

A transform that will be run with fixed scaling (job workers).

expand(pcoll)

schrodinger.seam.testing.stu_tests.workerfleet_gc.main()