Convert Functions
Type coercion functions used inside a Multi-Transform Sequence step. The source column is always the implicit first input.
| Function | Syntax | Parameters | Notes |
|---|---|---|---|
to_number |
to_number(column) |
None. | Strips all non-numeric characters via regex, then casts the result to decimal(18,2). |
to_date |
to_date(column, format) |
format — Java SimpleDateFormat pattern. Default: yyyy-MM-dd. |
Parses a string column into a Spark date type. |
cast |
cast(column, targetType, precision, scale) |
targetType — required, any Spark SQL type (e.g. string, int, decimal).precision, scale — only used when targetType is decimal. |
Direct .cast() call; no null-safety wrapper. Use try_cast (Type/Encoding category) for a null-safe version. |