{"id":2992,"library":"meltano","title":"Meltano","description":"Meltano is an open-source command-line interface (CLI) for ELT+ (Extract, Load, Transform) data integration. It provides a flexible and scalable framework for moving, transforming, and testing data, streamlining data engineering workflows. Currently at version 4.2.0, Meltano maintains an active development cycle with frequent releases across major, minor, and patch versions.","status":"active","version":"4.2.0","language":"en","source_language":"en","source_url":"https://github.com/meltano/meltano","tags":["ELT","data integration","CLI","orchestration","data engineering","open-source"],"install":[{"cmd":"pip install meltano","lang":"bash","label":"Install Meltano"}],"dependencies":[],"imports":[{"note":"Meltano is predominantly used as a command-line interface. While its internal components can be imported for plugin development, it's not designed for general programmatic use as a library within other Python applications.","symbol":"meltano","correct":"Meltano is primarily a CLI tool. Direct programmatic import of `meltano` for end-user applications is not a common pattern. Instead, users interact with `meltano` via its command-line interface or by developing custom plugins."}],"quickstart":{"code":"# Initialize a new Meltano project\nmeltano init my_meltano_project\ncd my_meltano_project\n\n# Add a data source (e.g., tap-carbon-intensity)\nmeltano add extractor tap-carbon-intensity\n\n# Add a data target (e.g., target-jsonl)\nmeltano add loader target-jsonl\n\n# Configure an extractor setting (optional, replace with actual config)\nmeltano config tap-carbon-intensity set country 'GB'\n\n# Run the ELT pipeline\nmeltano elt tap-carbon-intensity target-jsonl","lang":"bash","description":"This quickstart demonstrates how to initialize a new Meltano project, add an extractor (data source) and a loader (data target), configure a setting for the extractor, and then run a basic ELT pipeline. The output will be stored by the chosen loader (e.g., in `output.jsonl` if using `target-jsonl`)."},"warnings":[{"fix":"Refer to the official Meltano v4 migration guide for detailed steps on updating `meltano.yml` and adapting to the new CLI syntax. Review your `meltano.yml` for required changes, especially in plugin configurations.","message":"Meltano v4 introduced significant breaking changes compared to v3, including a new CLI parser (Click), changes to the `meltano.yml` project file structure, and updated plugin definition schemas.","severity":"breaking","affected_versions":"v4.0.0 and later (migrating from v3.x)"},{"fix":"Consult the updated documentation for the specific commands you use, especially `meltano config`. For example, `meltano config <plugin_name> set <key> <value>` is the new pattern.","message":"The command-line syntax, particularly for `meltano config`, changed in Meltano v4 due to the new CLI parser. Old commands might no longer work as expected.","severity":"breaking","affected_versions":"v4.0.0 and later (migrating from v3.x)"},{"fix":"If you rely on the `latest` Docker tags, ensure you pull the image again to get the most recent v4 version. Consider pinning to specific version tags (e.g., `meltano/meltano:v4.2.0-python`) for production environments to avoid unexpected updates.","message":"Docker Hub `latest` and `latest-python` tags for `meltano/meltano` image inadvertently reverted to Meltano v3 for a period around the v3.9.2 release before being corrected to v4.","severity":"gotcha","affected_versions":"v3.9.2 to v4.2.0 (Docker users)"},{"fix":"Always install Meltano in a dedicated virtual environment. If dependency conflicts occur, try a fresh installation in a new environment or use `pip check` to identify specific conflicts. Consult release notes for explicit dependency bumps.","message":"Meltano frequently updates its internal dependency requirements (e.g., `google-cloud-storage`, `uv`, `structlog`). While typically handled by `pip install meltano`, conflicts can arise in complex Python environments or if `meltano` is installed into a shared virtual environment.","severity":"gotcha","affected_versions":"All versions (especially when upgrading)"}],"env_vars":null,"last_verified":"2026-04-11T00:00:00.000Z","next_check":"2026-07-10T00:00:00.000Z"}