Wavicle Data Solutions

Lead Data Engineer

LinkedIn

LinkedIn Learning Instructor

Globant

Senior Data Engineer

CRISIL Limited

Senior Analyst - Data Engineer

Quantiphi

Data Engineer

Tata Consultancy Services

System Engineer

Assistant System Engineer

Assistant System Engineer - Trainee

InsideSherpa

KPMG Data Analytics Consulting Virtual Internship

Monisha Enterprises

•	Data mining and Extraction Transformation Loading using R programming.
•	Data cleaning and processing for Data analysis done using Python using NumPy, pandas, SciPy, Scikit. Data modelling and prediction was done using algorithms – Logistic Regression, Time Series Forecasting, Clustering and Classification.
•	Data Visualization done using Tableau for generating reports to enhance the productivity of the products.
•	Built a Data Warehouse on MSSQL Server for ERP System of the enterprise to organize the data for future processing.

Data Analyst Intern

Open to Collaborate | Storyteller | Lead Data Engineer@Wavicle| Linkedin Top Voice 2024 | Globant | Linkedin Learning Instructor | 2xGCP & AWS Certified | LICAP'2022

Data Engineer with 7+ years of experience working on data engineering, analysis, and modelling projects for various domains, such as banking, healthcare, sales, and e-commerce. I leverage my strong statistical and analytical ability to explore business ideas and provide innovative solutions. 

Skilled with technologies and strong intellect with enthusiasm as an avid learner with challenging opportunities. I’m working as a LinkedIn Learning Instructor to bring change as a data evangelist.

Post Graduated in Master of Technology in Data Science and Engineering from Birla Institute of Technology and Science, Pilani in 2023, where I learned advanced concepts and techniques in data science and engineering, machine learning, cloud computing, and visualization. 

I hold multiple certifications in GCP, AWS, and Azure, and I enjoy working with cloud technologies and big data platforms.

I am passionate about data science and women empowerment, and I have been recognized as the 
- Linkedin Top Voice 2024 
- Data Science and Women Empowerment Thought Leader by Global AI Hub. 

I am also a proud participant of the LinkedIn Creator Accelerator Program 2022, where I share my insights and experiences with the data science community. 

I am open to collaborate and share ideas, or explore various opportunities in the data field.

Pooja Jain

73% of data pipeline failures happen because of dependency issues, not bad code.
Cron jobs don't care if yesterday's data never arrived. They'll happily run on empty tables and produce garbage.

Airflow? It checks, retries, alerts, and refuses to cascade your failure downstream.

→ Beyond scheduling Airflow gives an important feature of 𝗗𝗔𝗚𝘀(𝗗𝗶𝗿𝗲𝗰𝘁 𝗔𝗰𝘆𝗰𝗹𝗶𝗰 𝗚𝗿𝗮𝗽𝗵𝘀), that helps to monitor, retry and gives flexibility to organize pipelines with minimum/less code.

🤔 Data Engineers often misinterpret Airflow just as an orchestration tool.

Apache Airflow is an open-source platform designed to programmatically author, schedule, retry and monitor workflows. 

🎼Think of it as the "conductor of an orchestra", where each musician (your data tasks, like data extraction, transformation, loading, or model training) knows when to play, what to play, and what happens if they make a mistake.

Most data engineers automate the wrong things at the wrong time.

Here's the framework I use after 8 years of building production systems:
✅ AUTOMATE WHEN: 
→ Task runs daily/weekly 
→ Human errors cause outages 
→ Work blocks other priorities
→ Team growth = more manual work
Examples: Reports, schema checks, alerts

❌ DON'T AUTOMATE WHEN: 
→ Task happens quarterly 
→ Requirements change weekly 
→ Process isn't understood yet 
→ Manual steps reveal insights

My rule: If it’s done 3+ times, script it; 10+ times, automate it; fails 5+ times, redesign it.
Automate what matters, when it matters—not everything!

Airflow isn’t just about running tasks.

🕑 It’s about building trustworthy, scalable, and observable pipelines that run reliably at 2am — even when you’re not watching.

Airflow gives structure to your chaos.
DAGs give clarity to your pipelines. 
That’s why DEs love them ❤️

Real Example: 
Instead of: 
❌ Cron jobs that fail silently 
❌ Manual dependency management
❌ No visibility into failures
You get: 
✅ Visual workflow monitoring 
✅ Automatic failure notifications
✅ Smart task scheduling 
✅ Easy debugging & restarting

Here's an amazing Airflow cheatsheet with some fundamentals concepts and interview questions to prepare for data engineers. 👇

Carousel Credits -  Futurense.com

Willing to learn more, here's the link to Astronomer free learning path - https://lnkd.in/g8-EWBda

Also, level up with Marc Lamberti's Udemy course on Airflow 3 - https://lnkd.in/gwArwaME

Airflow

TopAIsJobs - Find your next job in Data & AI

Your go-to source for the best job opportunities in the Data & AI industry. Our mission is to connect you with top companies and the world's most innovative startups 👉 https://topaisjobs.com/ 

📩 Subscribe to our newsletter https://topaisjobs.substack.com/ and get: 
• Handpicked selection of top-tier positions from industry leaders and innovative startups directly to your inbox. 
• Curated resources and articles from over 100 sources to help you ace interviews and grow as an engineer.

Founder

Data and AI Central

Connecting professionals and enthusiasts, Data and AI Central is your go-to hub for bridging theory to practice, delivering industry insights, actionable trends, and fostering collaboration within the data and AI community.

Horizon AI

Join our forward-thinking community for daily 3-minute briefings on the latest in AI news, tools and tutorials.

Factored

Factored (backed by Andrew Ng's AI Fund and deeplearning.ai) helps leading tech companies select, upskill, and build world-class data science, machine learning and AI engineering teams much faster and more cost effectively. Our engineers have been personally vetted, educated, and mentored by some of the most talented and recognized AI educators and engineers from Silicon Valley, Stanford University and deeplearning.ai.

Data Analyst

Rappi

BI/Data Engineer

Indra

Junior Systems Engineer

Global Business Services Intern

MedaBots SAC

IT Project Intern

Data Analyst | Data Engineer | AI | GenAI | Mentor | Content Creator 👩🏻‍💻 | Google WTM Ambassador | Python | Tableau | Snowflake | Power BI | Business Intelligence

Founder of TopAIsJobs and Horizon AI:
↳ 💼 topaisjobs.com
Find the best job opportunities in the Data & AI industry. Our mission is to connect you with top companies and the world's most innovative startups.
↳ 🧠 joinhorizon.ai
Join our forward-thinking community for daily 3-minute briefings on the latest in AI news, tools and tutorials.

Let's connect 🤝
↳ Twitter/X: x.com/ginacostag_
↳ IG: instagram.com/ginacostag

I have worked as a Data Engineer and Data Analyst in data-related projects in tech companies such as IBM, Indra, Rappi, and Factored, a company founded by Andrew Ng and specialized in Data and AI.

I have been recognized as an IBM Champion 2022 and a Google Women Techmakers Ambassador. I have also been a Mentor and Regional Ambassador at the Hackmakers World Innovation Day Hack 2022 International Hackathon, organized by Hackmakers, where I mentored the winning team.

I have published two research papers, one of them in Springer, and I have been a speaker at the WorldCIST'20 International Conference. In addition, I have participated as a speaker in webinars held by IBM Champions and data and tech communities. 

👩🏻‍💻 I enjoy creating content about data-related topics and insights and sharing them on LinkedIn, Instagram and Twitter.

Gina Acosta Gutiérrez

Kaggle has launched their FREE "5-Day Gen AI Intensive Course with Google"!

I’ve put together a list of all the free Kaggle Data Science courses + Certificates 👇

Learn about Feature Engineering, Data Cleaning, GenAI, Time Series, and more ...

1. 5-Day Gen AI Intensive Course - https://lnkd.in/eMBnxd2Y (Starts on Nov 11)

2. Python - https://lnkd.in/eMZAhANT

3. Intro to Machine Learning - https://lnkd.in/ezYxipjp

4. Pandas - https://lnkd.in/eC6VPUzM

5. Intermediate Machine Learning - https://lnkd.in/exY_DUHN

6. Data Visualization - https://lnkd.in/eFtZt7QZ

7. Feature Engineering - https://lnkd.in/esnSzHhk

8. Intro to SQL - https://lnkd.in/ebTWM7FS

9. Advanced SQL - https://lnkd.in/eb8qyFmB

10. Intro to Deep Learning - https://lnkd.in/eXfREFR2

11. Computer Vision - https://lnkd.in/eHaVz7AK

12. Time Series - https://lnkd.in/etzxU5bV

13. Data Cleaning - https://lnkd.in/e-3TMtUw

14. Geospatial Analysis - https://lnkd.in/eHKVgU3e

15. Machine Learning Explainability - https://lnkd.in/e4Yhh3mh

💜 Bonus ↓
🧠 Learn anything 10x faster: https://lnkd.in/exwQPmv5
🔥 Find +$200K/year Data, SWE & AI jobs: https://lnkd.in/eQEyqXrm

Daily Posts and Resources on Data Science, Data Engineering, and AI 📚 | Mentor | Google WTM Ambassador

taplio

The Battle

Pooja Jain

Gina Acosta Gutiérrez

Followers

Posts

Engagements

Likes

Performance ScorePooja Jain's LinkedIn Performance

Performance ScoreGina Acosta Gutiérrez's LinkedIn Performance

Ready to grow your LinkedIn presence?

taplio

The Battle

Pooja Jain

Gina Acosta Gutiérrez

Followers

Posts

Engagements

Likes

Performance Score.css-goub6s{font-size:var(--chakra-fontSizes-md);font-weight:500;color:var(--chakra-colors-gray-600);display:block;margin-top:var(--chakra-space-1);}Pooja Jain's LinkedIn Performance

Performance ScoreGina Acosta Gutiérrez's LinkedIn Performance

Ready to grow your LinkedIn presence?

Performance ScorePooja Jain's LinkedIn Performance