What just happened?
Hydra evaluates the expression on every row. A row whose amount is empty never matches — a comparison against a missing value is false, not an error.
Change one value, run the pipeline, and watch how a filter transforms the orders dataset.
transformations: steps: - filter: expr: amount > 20 # keep matching rows on_error: stop
Keep orders above €50. Move the threshold, then run the pipeline.
| order_id | amount | status |
|---|
Generated from the engine models.
| key | type | required | default | constraint |
|---|---|---|---|---|
| expr | string | yes | — | au moins 1 caractere(s) |
Hydra evaluates the expression on every row. A row whose amount is empty never matches — a comparison against a missing value is false, not an error.
On a compatible SQL source, Hydra can push this filter down as a WHERE clause instead of loading every row.