https://store-images.s-microsoft.com/image/apps.60369.f34cafac-2c86-4417-bd7f-7fbd93220312.d51126d7-88b7-4425-9dfe-c8101571e025.bc7b2cd2-7fe5-4dbb-a3fe-7300b86a5d36

Airflow

kCloudHub

Airflow

kCloudHub

Version 2.10.4 + Free Support on Ubuntu 24.04

Apache Airflow is an open-source platform for orchestrating complex computational workflows and data processing pipelines.

Features of Apache Airflow:

  • Apache Airflow provides a robust platform for orchestrating complex workflows and data pipelines, offering extensive support for scheduling and managing tasks.
  • The system is designed to handle dynamic workflows with ease, allowing for scalable execution and monitoring of tasks across diverse environments.
  • It features a rich web-based user interface for visualizing workflows, tracking progress, and managing execution in real-time.
  • Apache Airflow supports integration with various databases and cloud services, enabling seamless data processing and automation.

Login Credentials are saved in credentials.txt file located at /var/airflow directory.

To run Airflow : We need to run following codes on your VM :
$sudo su
$cd /opt/airflow
$source airflow_venv/bin/activate
$ Add user using$airflow users create \ --username admin \ --firstname Admin \ --lastname User \ --role Admin \ --email mailto:admin@example.com \ --password yourpassword
$airflow webserver --daemon
$airflow scheduler --daemon
$http://your-server-ip:8080

Disclaimer: Apache Airflow is an open-source project distributed under the Apache License 2.0. It maintains independence from any company and is not affiliated with, endorsed by, or sponsored by any organization. Apache Airflow is provided "as is," without express or implied warranties. Users are responsible for any risks associated with its use. The developers and contributors of Apache Airflow hold no liability for damages, losses, or consequences resulting from using this software. Before using Apache Airflow, users are advised to carefully review and comply with the licensing terms and any applicable regulations.