The Role of Airflow in Finance Transformation at Etraveli Group with Mihir Samant

The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

Transforming bottlenecked finance processes into streamlined, automated systems requires the right tools and a forward-thinking approach. In this episode, Mihir Samant, Senior Data Analyst at Etraveli Group, joins us to share how his team leverages Airflow to revolutionize finance automation. With extensive experience in data workflows and a passion for open-source tools, Mihir provides valuable insights into building efficient, scalable systems. We explore the transformative power of Airflow in automating workflows and enhancing data orchestration within the finance domain.

Key Takeaways:

(02:14) Etraveli Group specializes in selling affordable flight tickets and ancillary services.

(03:56) Mihir’s finance automation team uses Airflow to tackle month-end bottlenecks.

(06:00) Airflow's flexibility enables end-to-end automation for finance workflows.

(07:00) Open-source Airflow tools offer cost-effective solutions for new teams.

(08:46) Sensors and dynamic DAGs are pivotal features for optimizing tasks.

(13:30) GitSync simplifies development by syncing environments seamlessly.

(16:27) Plans include integrating Databricks for more advanced data handling.

(17:58) Airflow and Databricks offer multiple flexible methods to trigger workflows and execute SQL queries seamlessly.

Resources Mentioned:

Mihir Samant -

https://www.linkedin.com/in/misamant/?originalSubdomain=ca

Etraveli Group -

https://www.linkedin.com/company/etraveli-group/

Apache Airflow -

https://airflow.apache.org/

Docker -

https://www.docker.com/

Databricks -

https://www.databricks.com/

Thanks for listening to “The Data Flowcast: Mastering Airflow for Data Engineering & AI.” If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.

#AI #Automation #Airflow #MachineLearning