Skip to content

loader

sqllocks_spindle.packs.loader

Load scenario pack YAML files into ScenarioPack dataclasses.

Classes

ManifestSpec dataclass

File-drop manifest configuration.

DoneFlagSpec dataclass

Done-flag marker configuration.

LatenessSpec dataclass

Late-arriving data configuration.

DuplicateSpec dataclass

Duplicate record injection configuration.

BackfillSpec dataclass

Historical backfill configuration.

FileDropSpec dataclass

File-drop landing zone specification.

StreamEnvelopeSpec dataclass

Envelope schema for stream events.

StreamCadenceSpec dataclass

Rate and timing configuration for streams.

StreamOrderingSpec dataclass

Out-of-order event configuration.

StreamReplaySpec dataclass

Event replay window configuration.

StreamTopicSpec dataclass

Definition of a single stream topic.

StreamAnomalySpec dataclass

Anomaly injection configuration for streams.

StreamSpec dataclass

Streaming specification.

HybridMicroBatchSpec dataclass

Micro-batch portion of hybrid mode.

HybridStreamSpec dataclass

Stream portion of hybrid mode.

HybridLinkStrategySpec dataclass

How stream and batch data link together.

HybridSpec dataclass

Hybrid (stream + micro-batch) specification.

SchemaDriftSpec dataclass

Schema drift injection configuration.

FailureInjectionSpec dataclass

Failure injection specification.

ValidationSpec dataclass

Validation gate configuration.

ScenarioPack dataclass

Complete scenario pack definition loaded from YAML.

Attributes
entities property

Return the list of entities referenced in this pack.

topics property

Return the list of stream topics referenced in this pack.

PackLoader

Load scenario pack YAML files into ScenarioPack instances.

Methods:
load(path)

Load a scenario pack from an arbitrary YAML file path.

load_builtin(domain, pack_id)

Load a builtin scenario pack by domain and pack ID.

Example::

loader = PackLoader()
pack = loader.load_builtin("retail", "fd_daily_batch")
list_builtin()

Return metadata for all available builtin packs.

Returns a list of dicts with keys: domain, pack_id, path.