PySpark DataFrame Testing Utility
JSON →pyspark-test is a Python library designed to simplify unit testing for PySpark DataFrames. It provides a function, `assert_pyspark_df_equal`, inspired by the pandas testing module, which allows users to compare two Spark DataFrames and identify any differences. The library is currently at version 0.2.0 and has a stable, albeit infrequent, release cadence, focusing on its core DataFrame comparison functionality.
Traffic · last 30 days stale · no recent hits
total hits 18
actors 4 distinct systems
last hit 17d ago ByteDance
top countries 🇸🇬 Singapore · 🇺🇸 United States · 🇨🇦 Canada · 🇫🇷 France · BD
API endpoints
full doc /v1/registry/pyspark-test
compatibility /v1/registry/pyspark-test/compatibility