On this page
Delta table (delta)¶
YAML location: an entry in a flowgroup’s actions list.
Source selector: source.type: delta.
Reads a Delta table into a temporary view. Fields live under source:.
Minimal example¶
Add this entry to the actions list in your flowgroup.
- name: load_customers
type: load
source:
type: delta
catalog: "${catalog}"
schema: "${bronze_schema}"
table: customers
readMode: batch
target: v_customers
Source fields¶
Field |
Type |
Required |
Default |
Description |
|---|---|---|---|---|
|
string |
Yes |
— |
Must be |
|
string |
Yes |
— |
Catalog of the source table. |
|
string |
Yes |
— |
Schema of the source table. |
|
string |
Yes |
— |
Source table name. |
|
mapping |
No |
— |
Delta reader options (values must be non-empty). CDC and time-travel keys go here. |
|
list[string] |
No |
|
Filter expressions applied with |
|
list[string] |
No |
— |
Column projection applied with |
readMode defaults to batch and accepts batch or stream.
options.readChangeFeed: "true" requires readMode: stream, or a
startingVersion/startingTimestamp bound in batch mode.
Read mode placement¶
Prefer action-level readMode alongside source and target.
The generator also accepts source.readMode as a fallback. An action-level
value takes precedence when both are supplied.
Action-level fields¶
These fields apply to every load sub-type. name, type, source and target are required.
Field |
Type |
Required |
Default |
Description |
|---|---|---|---|---|
|
string |
Yes |
— |
Unique action name within the flowgroup. |
|
string |
Yes |
— |
Always |
|
mapping |
Yes |
— |
Source configuration. |
|
string |
Yes |
— |
Name of the temporary view this action creates. |
|
string |
No |
sub-type |
|
|
string |
No |
auto |
Docstring for the generated view function. |
|
bool or list[string] |
No |
— |
Explicit column names to add; action-level |
|
list[string] |
No |
— |
Extra upstream table or view references added to the dependency graph. See Dependency analysis reference. |