Google

- Working in the Google Devices and Services group as a Data Engineer
- Develop high quality modern pipelining, warehousing, and reporting solutions and deliver it to customers across teams, making data more useful to the enterprise
- Designing data solutions to help customers, and so the organization, grow fast

Data Engineer

Microsoft

- Core Data Engineering team of Microsoft Edge
- Responsible for Browser's success and health, by advanced telemetry & customer analytics
- Designed data frameworks on top of Google Chromium's open-source engine and telematics design
- Developed the data framework (Pipelines, Data Lakes) using Azure and open-source tools 
- Owned self serve dashboarding system, which enabled analysis for 50+ features 
- Directly worked with Feature PMs, Senior Leadership, and several other stakeholders
- This contributed directly in making Microsoft Edge a world class browser

TiVo

- Analyzed viewership of programs and channels across US with raw Television/ STB data
- Rated all TV Programs and Channels, using complex time-zone normalization and other proprietary algorithms
- Sold the data directly to third parties
- Used internally to optimize the bundling of the channels across TiVo Operators
- Helped make TiVo TV Guide more powerful

Thorogood Associates

- Worked directly with customers from Unilever (UK), and Novartis (Germany)
- Gained experience across many functional areas like BFSI, HR, and HealthCare
- Trained new hires multiple times during his span at Thorogood, for SQL and other Data technologies

Business Intelligence Consultant

MAQ Software

- Developed and designed a Data Mart, ETL, Multidimensional solution for an internal site of Microsoft

Business Intelligence Engineer

A creative thinker, a continuous learner, a technologist. Deepanshu is a data engineer with great technical skills and a passion for resolving complex problems at ease. 
Adept at maintaining focus on achieving the right end results while formulating and implementing advanced technology and business solutions, especially in customer analytics and growth analytics areas. Deepanshu's skills include SQL, Data Engineering, Apache Spark, Extract, Transform, Load (ETL), Pipelining, Python, NoSQL and he has worked on all three major cloud platforms GCP, Azure, and AWS.

Apart from these Deepanshu focuses on collaboration and communication skills, together with a demonstrable desire to learn more thanks to the exceptionally amazing peers he has worked with. This helps him secure competitive advantage when comes to good quality work and team building.

He is currently delivering value to customers as a Data Engineer at Google with his Data strategy, vision, and technical implementation. In the past, he worked with Microsoft and touched billion+ of users with his data solutions. Deepanshu is aspiring and interested to get into or promote into a role where he can clearly demonstrate his leadership and product management qualities.

You can connect with Deepanshu on Instagram as well at instagram.com/dkalra_/

Thank you for reading.
Keep hustling! Keep growing!

Deepanshu Kalra

zeroG - AI in Aviation

Lead Data Architect

Cognizant

Lead Data & ML Solution Architect (Senior Manager)

E.ON Digital Technology

•	Lead a team of data engineers to build scalable and robust data pipelines
•	Provided innovative tools to the team to ensure efficient and accurate data science
•	Actively involved in requirement engineering with different business units to build appropriate data solutions based on specific business needs
•	Utilized Azure cloud components to provide reference data architecture that meets the requirements of the business
•	Worked with Spark for over 4 years and developed various ML pipelines using Spark
•	Developed data quality check solutions to ensure high-quality data and detect issues early on
•	Attended Spark-based AI conferences to bring new and innovative tools to the team, such as ML Flow
•	Constantly learning new technologies to share with the team
•	Involved in discussions on upcoming AI use cases as a senior member of the architecture team
•	Actively working on predictive maintenance of energy network assets
•	Expertise in Data Engineering, ML-Ops, and Data-Mesh
•	Experience working with tools such as Databricks, Cloudera, Azure ML, and AWS

Data / ML Engineer 

NEW YORKER

• Managed and troubleshot Cloudera and Mesosphere clusters
• Handled day-to-day issues with the platform
• Implemented data load workloads using Impala, Sqoop, and Apache Kudu as the relational storage
• Possessed a complete understanding of Change Data Capture (CDC) technology from MS SQL Server and Oracle and implemented it using Streamsets
• Learned Python and improved the existing code base
• Helped data scientists to optimize Apache Spark workloads
• Implemented Luigi as the pipeline management tool for data workloads, also created a giter8-based artifact with all the basic functionality required for data engineering
• Implemented Artifactory on DCOS for repository management
• Implemented Spark and Scala data pipeline for ingesting data from several data points

Senior Data Engineer

Eon Business Services

•	Leading team of data engineers to deliver critical data workloads 
•	Designed and architected the data workload using Apache spark and Scala 
•	Managing Azure HDInsights instance and proposed the CICD solution using gitci
•	Mentoring team to learn Apache Spark, Scala and some more big data technologies 
•	Involved in end to end delivery of data engineering pipeline for predictive maintenance projects for Medium and low voltage cables

•	Implemented custom model pipeline solution for model industrialisation using Apache spark, Scala and Spark ml lib 
•	Translated 15 R based model to spark and Scala code based for industrialisation purpose
•	Mentoring team to learn Spark and Scala 
•	Developed several data pipeline for sessionization of the log data, ingestion of customer data etc.
•	Advising clients on Hadoop cluster size and helping them setup Cloudera and Hortonworks setup in their in-house environment
•	Working on different big data use cases and selecting  specific big data toolsets to deliver the requirements

Senior Hadoop Engineer

PricePanda Group

•	Implemented new front-end and back-end functionalities using agile development methods
•	Executed refactoring and advancements, and defined related guidelines and tools
•	Conducted independent evaluations of alternatives, new technologies, and frameworks for future developments and improvements
•	Collaborated with the team to design and implement new features for an international price comparison platform, PricePanda
•	Utilized various technologies, including Java, Spring, Maven, Junit, NoSQL environment, and handled big data in high-performance areas such as Hadoop, Cassandra, and DB replication
•	Designed and implemented databases using design patterns, including PostgreSQL and MySQL
•	Employed Scrum methodology, CI, Jenkins, Git, web crawlers, and search engines such as Solr, Elastic search, Weka, and Mahout.

GWDG - Gesellschaft für wissenschaftliche Datenverarbeitung mbH Göttingen

Senior Java Developer -Data

Capgemini

Senior Java Developer

Capco

•	Gathered requirements for project implementation
•	Developed and implemented a Reconciliation color code tool to generate the Reconciliation Gap using Excel POI
•	Coordinated with clients to identify gaps in reports and provided easy and achievable solutions
•	Responsible for end-to-end testing and deployment of the solution developed
•	Handled and fixed server-side and UI issues
•	Analyzed Use-Case documents for project development
•	Provided Onsite and Offsite support to a Tier 1 Canadian Bank
•	Developed Rule-Based Business Component for project implementation
•	Developed SOA Web Services for different client services
•	Conducted Web Service testing using SoapUI.

Senior Java Developer - Products

As an experienced Hadoop Ecosystem and Apache Spark developer, I have spent over a decade working with big data ecosystems. With proficiency in Scala, Python, and Java-based frontend, backend, and middleware services, I have a proven track record of managing and troubleshooting Cloudera and Mesosphere clusters, handling day-to-day issues with platforms, and implementing data load workloads using Impala, Sqoop, and Apache Kudu as the relational storage.

My expertise extends to a wide range of technologies, including Apache Spark, Spark MLLib, Azure Machine Learning, Azure Data Factory, HDInsight, ML Flow, Azure DevOps, Impala, Streamsets, MapReduce, Hive, Pig, Sqoop, and more. I have also demonstrated my ability to set Data Architecture and Machine learning architecture on Azure cloud, and I have advised clients on the Hadoop cluster size, helping them to set up Cloudera and Hortonworks Hadoop stack.

I take pride in my ability to guide a team of data engineers to build scalable and robust data pipelines, and I have provided innovative tools for the team to get the data science done in the correct way. I am also passionate about mentoring juniors in the data engineering domain, and I have been involved in requirement engineering with different business units to build appropriate data solutions.


Throughout my career, I have implemented various use cases such as:
- Fraud Detection for insurance clients
- Multiple use cases for the airline industry
- Inventory Management, including predicting box sizes, for fashion clients
- Predictive Maintenance for industrial clients
- Predicting optimal temperature for assets for energy 

I fairly experienced  in Reporting, Retail Banking, Call Center Survey Management, Airline, and Energy, and have developed data quality check solutions to early detect data quality issues and find appropriate solutions to handle them. I have visited Spark-based AI conferences to bring new and innovative tools to the team to resolve existing issues (e.g., ML Flow), and I am always keen on learning new technology and sharing it with the team in a timely manner.

If you need an expert in Hadoop Ecosystem, Apache Spark, or data engineering technologies, feel free to reach out to me. As a Certified Cloudera Apache Hadoop Developer and Azure Cloud and AWS cloud , I am confident in my ability to deliver high-quality solutions that meet your business needs.

taplio

The Battle

Deepanshu Kalra

Ankit K.

Followers

Posts

Engagements

Likes

Ready to grow your LinkedIn presence?