{"library":"snowpark-connect-deps-2","title":"Snowpark Connect Dependencies Part 2","type":"library","description":"The `snowpark-connect-deps-2` package provides supporting JAR dependencies essential for Snowflake's Snowpark Connect for Spark. Snowpark Connect enables developers to execute Apache Spark workloads directly on Snowflake's high-performance compute engine, leveraging familiar Spark DataFrame APIs without the overhead of managing a dedicated Spark cluster. This package, alongside `snowpark-connect-deps-1`, underpins the functionality of the user-facing `snowpark-connect` library, which is part of the broader Snowpark for Python ecosystem. It is currently at version 3.56.4 and follows a rapid release cadence in conjunction with the `snowpark-connect` library.","language":"python","status":"active","last_verified":"Thu Apr 16","install":{"commands":["pip install snowpark-connect-deps-2"],"cli":null},"imports":[],"auth":{"required":false,"env_vars":[]},"links":{"homepage":"https://www.snowflake.com","github":null,"docs":null,"changelog":null,"pypi":"https://pypi.org/project/snowpark-connect-deps-2/","npm":null,"openapi_spec":null,"status_page":null,"smithery":null},"quickstart":{"code":"import os\nfrom snowflake import snowpark_connect\nfrom pyspark.sql import SparkSession\n\n# Set environment variable to enable Spark Connect mode\nos.environ[\"SPARK_CONNECT_MODE_ENABLED\"] = \"1\"\n\n# Configure connection parameters (replace with your Snowflake details)\n# It's recommended to use environment variables or a configuration file\n# for sensitive information like passwords.\nos.environ[\"SNOWFLAKE_ACCOUNT\"] = os.environ.get(\"SNOWFLAKE_ACCOUNT\", \"your_account_identifier\")\nos.environ[\"SNOWFLAKE_USER\"] = os.environ.get(\"SNOWFLAKE_USER\", \"your_username\")\nos.environ[\"SNOWFLAKE_PASSWORD\"] = os.environ.get(\"SNOWFLAKE_PASSWORD\", \"your_password\")\nos.environ[\"SNOWFLAKE_ROLE\"] = os.environ.get(\"SNOWFLAKE_ROLE\", \"your_role\")\nos.environ[\"SNOWFLAKE_WAREHOUSE\"] = os.environ.get(\"SNOWFLAKE_WAREHOUSE\", \"your_warehouse\")\nos.environ[\"SNOWFLAKE_DATABASE\"] = os.environ.get(\"SNOWFLAKE_DATABASE\", \"your_database\")\nos.environ[\"SNOWFLAKE_SCHEMA\"] = os.environ.get(\"SNOWFLAKE_SCHEMA\", \"your_schema\")\n\n# Start the Spark Connect session\nsnowpark_connect.start_session()\nspark = snowpark_connect.get_session()\n\n# Example: Create a DataFrame and show data\ndata = [(\"Alice\", 1), (\"Bob\", 2), (\"Charlie\", 3)]\ndf = spark.createDataFrame(data, [\"Name\", \"ID\"])\ndf.show()\n\n# Stop the Spark session when done\nspark.stop()\n","lang":"python","description":"This package is a backend dependency. Users do not directly import `snowpark-connect-deps-2`. The quickstart demonstrates how to use `snowpark-connect` (the user-facing library that depends on `snowpark-connect-deps-2`) to establish a Spark session and perform basic DataFrame operations with Snowflake. Ensure your Snowflake connection parameters are configured, preferably via environment variables, to establish the session.","tag":null,"tag_description":null,"last_tested":null,"results":[]},"compatibility":null}