Sparkdantic
JSON →Sparkdantic is a Python library that bridges Pydantic models with PySpark schemas. It allows developers to define data structures using Pydantic, then automatically generate equivalent `pyspark.sql.types.StructType` schemas for use in Spark DataFrames. This simplifies data validation and schema management across Python applications and Spark environments. The current version is 2.8.0, and it maintains an active release cadence, frequently updating for Pydantic and PySpark compatibility.
Traffic · last 30 days ↑500% vs prev 7d
total hits 16
actors 7 distinct systems
last hit 17h ago AhrefsBot
top countries 🇺🇸 United States · 🇨🇦 Canada · 🇩🇪 Germany · 🇸🇬 Singapore · 🇫🇷 France
Resources
API endpoints
full doc /v1/registry/sparkdantic
install /v1/registry/sparkdantic/install
compatibility /v1/registry/sparkdantic/compatibility