PySpark DataFrame Testing Utility
JSON →pyspark-test is a Python library designed to simplify unit testing for PySpark DataFrames. It provides a function, `assert_pyspark_df_equal`, inspired by the pandas testing module, which allows users to compare two Spark DataFrames and identify any differences. The library is currently at version 0.2.0 and has a stable, albeit infrequent, release cadence, focusing on its core DataFrame comparison functionality.
Traffic · last 30 days ↑25% vs prev 7d
total hits 22
actors 7 distinct systems
last hit 3d ago MetaBot
top countries 🇺🇸 United States · 🇫🇷 France · 🇨🇦 Canada · 🇩🇪 Germany · 🇳🇴 Norway
API endpoints
full doc /v1/registry/pyspark-test
compatibility /v1/registry/pyspark-test/compatibility