Summary
The upstream DataFusion library provides map functions that are not yet exposed in datafusion-python. These are needed for working with map/dictionary data types.
Missing Functions
Upstream Reference
Implementation
- Rust bindings:
crates/core/src/functions.rs
- Python wrappers:
python/datafusion/functions.py
Note: This gap analysis was performed using an AI agent comparing upstream DataFusion v53 documentation against the current datafusion-python codebase.
Summary
The upstream DataFusion library provides map functions that are not yet exposed in datafusion-python. These are needed for working with map/dictionary data types.
Missing Functions
map— creates a map from key/value arraysmap_entries— returns entries of a map as an array of structsmap_extract— extracts value by key from a mapmap_keys— returns all keys of a mapmap_values— returns all values of a mapelement_at— access element in a map or array by key/indexUpstream Reference
Implementation
crates/core/src/functions.rspython/datafusion/functions.py