Everseen

✅ Actively involved in all stages of ML project lifecycle.

𝐄𝐯𝐞𝐫𝐬𝐞𝐞𝐧 is an AI company that empowers end-to-end visibility across the entire supply chain for the biggest retail clients in the world, aiming to  reduce shrink and increase perpetual inventory accuracy using it’s VisualAI platform.

☑ Worked on a theft-prevention system that was showcased at 𝐍𝐞𝐰𝐘𝐨𝐫𝐤 𝐍𝐑𝐅2023, and at numerous demo-sessions that 𝐚𝐭𝐭𝐫𝐚𝐜𝐭𝐞𝐝 3 𝐧𝐞𝐰 𝐜𝐥𝐢𝐞𝐧𝐭𝐬 into wanting the product for their stores. 

☑ 𝐇𝐚𝐧𝐝𝐥𝐢𝐧𝐠 project/tooling 𝐫𝐚𝐦𝐩-𝐮𝐩 phase for new members within the team, successfully reducing the period from 1 𝐦𝐨𝐧𝐭𝐡 𝐭𝐨 𝐥𝐞𝐬𝐬 𝐭𝐡𝐚𝐧 1 𝐰𝐞𝐞𝐤.

☑ Handled 𝐞𝐧𝐝-𝐭𝐨-𝐞𝐧𝐝 engineering and 𝐝𝐞𝐩𝐥𝐨𝐲𝐦𝐞𝐧𝐭 to 5 𝐩𝐢𝐥𝐨𝐭 𝐬𝐭𝐨𝐫𝐞𝐬.

☑ Improved the 𝐢𝐭𝐞𝐫𝐚𝐭𝐢𝐨𝐧 𝐬𝐩𝐞𝐞𝐝 within the team by 𝐚𝐮𝐭𝐨𝐦𝐚𝐭𝐢𝐧𝐠 𝐌𝐋𝐎𝐩𝐬 practices such as Structured Model Experimenting, Resources Monitoring, Model Registry, CI/CD and Jira Integrations.

☑ 𝐎𝐫𝐠𝐚𝐧𝐢𝐳𝐞𝐝 and established a 𝐝𝐨𝐜𝐮𝐦𝐞𝐧𝐭𝐚𝐭𝐢𝐨𝐧 𝐬𝐭𝐫𝐮𝐜𝐭𝐮𝐫𝐞 which enabled us to 𝐫𝐞𝐚𝐜𝐡 > 70% 𝐜𝐨𝐯𝐞𝐫𝐚𝐠𝐞 both on code,tools documentation and custom models tailored for various clients.

☑ Worked on a live camera feed processing pipeline that ran 3 𝐝𝐞𝐞𝐩 𝐥𝐞𝐚𝐫𝐧𝐢𝐧𝐠 𝐦𝐨𝐝𝐮𝐥𝐞𝐬 while achieving 24-25 FPS on a 4K video stream with high QPS rate.

☑ Implemented a 𝐦𝐨𝐧𝐢𝐭𝐨𝐫𝐢𝐧𝐠 𝐩𝐢𝐩𝐞𝐥𝐢𝐧𝐞 𝐟𝐨𝐫 𝐨𝐮𝐫 𝐞𝐝𝐠𝐞 𝐝𝐞𝐩𝐥𝐨𝐲𝐦𝐞𝐧𝐭𝐬 that saved time with hardware requirements and optimisations using Prometheus, Grafana, Kibana and ES.

☑ Actively 𝐩𝐚𝐫𝐭𝐢𝐜𝐢𝐩𝐚𝐭𝐢𝐧𝐠 𝐢𝐧 𝐭𝐡𝐞 𝐥𝐢𝐟𝐞𝐜𝐲𝐜𝐥𝐞 of the current project, providing support to QA, Development and Deployment processes.

☑ 𝐀𝐮𝐭𝐨𝐦𝐚𝐭𝐞𝐝 the multi-gpu 𝐦𝐨𝐝𝐞𝐥 𝐜𝐨𝐧𝐯𝐞𝐫𝐬𝐢𝐨𝐧 and integration with high-throughput Model Serving technologies like Nvidia Triton Server.

Senior Machine Learning Engineer

Neural Bits

✅ Writing the Neural Bits Newsletter to help AI/ML Engineers upskill in their career.
☑ Making AI accessible to a larger general audience by explaining concepts in simple terms.
☑ Sharing insights and practical advice on AI/ML Systems.

Author

Decoding ML

Sharing insights and actionable advice towards building production-ready ML systems.

Co-Founder

HandsOnLLMs

✅ Contributed to a free hands-on course on end-to-end LLMops.

Worked alongside 𝐏𝐚𝐮 𝐋𝐚𝐛𝐚𝐫𝐭𝐚 𝐁𝐚𝐣𝐨 𝐚𝐧𝐝 𝐏𝐚𝐮𝐥 𝐈𝐮𝐬𝐳𝐭𝐢𝐧 into developing this end-to-end course to help students 𝐛𝐮𝐢𝐥𝐝 𝐚 𝐜𝐨𝐦𝐩𝐥𝐞𝐭𝐞 𝐋𝐋𝐌 𝐚𝐩𝐩𝐥𝐢𝐜𝐚𝐭𝐢𝐨𝐧 while following the 𝐛𝐞𝐬𝐭 𝐩𝐫𝐚𝐜𝐭𝐢𝐜𝐞𝐬 both in software development, model deployment and MLOps integrations.

☑ Implemented the EDA stage on LLM fine-tuning dataset.
☑ Implemented the LangChain logic and modules that connected the QDrant vector database to inference pipeline and model registry.
☑ Worked on the training/fine-tuning pipeline and prompt monitoring using CometML.
☑ Provided support and approved Pull Requests.
☑ Implemented and documented best practices on Prompt Templates and LLM workflow.

Check the course here: http://bit.ly/3Rxjyvp

Co Author

IVFuture

✅ Worked on on a suite of tools including Generative AI, LLM’s and Vision Models.

𝐈𝐕𝐅𝐮𝐭𝐮𝐫𝐞’𝐬 mission is to transform common businesses, communities and people’s needs into intelligent and innovative software solutions, to simplify life through scalable technology.

☑ Implemented a 𝐝𝐞𝐦𝐨 for virtual try-on fashion tool called 𝐓𝐀𝐈𝐒, which was presented to investors and attracted interest from various fashion providers across Romania.

☑ Implemented a CV solution, that was able to accurately showcase over 25 𝐛𝐨𝐝𝐲 𝐦𝐞𝐚𝐬𝐮𝐫𝐞𝐦𝐞𝐧𝐭𝐬 𝐢𝐧 3𝐃 using 2D cameras, with an 𝐞𝐫𝐫𝐨𝐫-𝐫𝐚𝐭𝐞 𝐨𝐟 5-10% while using cheap hardware, <700$ 𝐩𝐞𝐫 𝐬𝐞𝐭𝐮𝐩, considering industry available setups 𝐞𝐱𝐜𝐞𝐞𝐝 10.000$.

☑ Developed and integrated an 𝐋𝐋𝐌 13𝐁 𝐜𝐡𝐚𝐭 𝐚𝐠𝐞𝐧𝐭, fine-tuned on specific descriptions that was used by the team to automatically 𝐥𝐚𝐛𝐞𝐥 𝐡𝐮𝐧𝐝𝐫𝐞𝐝𝐬 𝐨𝐟 𝐩𝐫𝐨𝐝𝐮𝐜𝐭𝐬.

☑ Fine-tuned 𝐒𝐭𝐚𝐛𝐥𝐞 𝐃𝐢𝐟𝐟𝐮𝐬𝐢𝐨𝐧1.5 and tailored it to specific product generation use-case.

☑ Worked on a solution for 𝐓𝐓𝐒 𝐚𝐧𝐝 𝐒𝐓𝐓 and exposed it as an API, which was able to accurately 𝐜𝐥𝐨𝐧𝐞 𝐯𝐨𝐢𝐜𝐞𝐬 𝐟𝐫𝐨𝐦 𝐚 𝐬𝐡𝐨𝐫𝐭 5𝐬𝐞𝐜 𝐚𝐮𝐝𝐢𝐨 𝐜𝐥𝐢𝐩 and synthesize text-to-speech and speech-to-text.

☑ Worked on a 𝐑𝐀𝐆 𝐚𝐠𝐞𝐧𝐭, that was able to ingest document context and provide assistant-like answers on user queries.

Machine Learning Consultant - Generative AI

Odeen Software

✅ Worked on Flowstate, a Computer Vision solution developed for 𝐔𝐑𝐁𝐍𝐒𝐔𝐑𝐅 𝐌𝐞𝐥𝐛𝐨𝐮𝐫𝐧𝐞, 𝐀𝐮𝐬𝐭𝐫𝐚𝐥𝐢𝐚, that generates 𝐬𝐨𝐜𝐢𝐚𝐥-𝐦𝐞𝐝𝐢𝐚 𝐫𝐞𝐞𝐥𝐬 𝐚𝐧𝐝 𝐬𝐡𝐨𝐫𝐭𝐬 for park attendees.

𝐎𝐝𝐞𝐞𝐧 is a company that provides IT services, staff augmentation and SASS solutions on various technology stacks, including Machine Learning, Web Development and more.

☑ Implemented a 𝐦𝐮𝐥𝐭𝐢-𝐜𝐚𝐦𝐞𝐫𝐚 𝐭𝐫𝐚𝐜𝐤𝐢𝐧𝐠 feature using SOTA Centroid ReID to track and re-identify person detections in multiple camera views.

☑ Integrated 𝐅𝐀𝐈𝐒𝐒 𝐕𝐞𝐜𝐭𝐨𝐫 𝐃𝐚𝐭𝐚𝐛𝐚𝐬𝐞 to store track embeddings and perform ReID searching for similar tracks in a batch fashion.

☑ Used 𝐃𝐞𝐞𝐩𝐅𝐚𝐜𝐞 to detect and group track detections with face detections, and human pose prediction to filter accurate poses to consider when generating reels.

☑ Worked on the video streaming workflow, offline batch tracking and edge integration with Viso.AI.

Machine Learning Consultant

Upwork

💎 Top Rated • 💯 Job Success Rate • ⭐⭐⭐⭐⭐ Reviews

✅ Developed plug-and-play ML/CV modules.

☑ Client had over 50𝐤 𝐫𝐞𝐜𝐞𝐢𝐩𝐭𝐬 from various stores, and needed to automate the process of analyzing these receipts. I’ve implemented a 𝐌𝐋 𝐬𝐨𝐥𝐮𝐭𝐢𝐨𝐧 𝐬𝐚𝐯𝐢𝐧𝐠 𝐮𝐩 𝐭𝐨 80% of the time used to detect, decode and organise these receipts by their QR code metadata.

☑ Client wanted a 𝐄𝐝𝐮𝐓𝐞𝐜𝐡 𝐰𝐞𝐛 𝐩𝐥𝐚𝐭𝐟𝐨𝐫𝐦 that allows parents to create quizz tests for their children based on an uploaded document (.pdf, .docx). I’ve implemented a full-stack web application with included ML components which loaded a document, applied ETL, generated quizz test and construct the UI view.

☑ Client wanted a CV plugin that would detect various icons from a phone screen, classify them and automatically create app testing workflows. Using template matching, pyramid-detection and super-resolution GAN’s, I’ve managed to 𝐨𝐩𝐭𝐢𝐦𝐢𝐬𝐞 𝐚𝐧𝐝 𝐚𝐮𝐭𝐨𝐦𝐚𝐭𝐞 𝐜𝐥𝐨𝐬𝐞 𝐭𝐨 100% on a few use-cases, and around 30-40% 𝐨𝐧 𝐭𝐡𝐞 𝐫𝐞𝐬𝐭 of the use-cases required.

☑ 𝐂𝐨𝐧𝐬𝐮𝐥𝐭𝐞𝐝 on various Computer Vision topics and project ideas.

Top Rated Machine Learning Engineer

✅ Developed and deployed CV/ML modules into existing API's.

☑ Client wanted a CV solution that 𝐩𝐫𝐨𝐜𝐞𝐬𝐬𝐞𝐬 𝐬𝐩𝐨𝐫𝐭𝐬 𝐠𝐚𝐦𝐞𝐬 𝐚𝐧𝐝 𝐬𝐞𝐧𝐝𝐬 𝐧𝐨𝐭𝐢𝐟𝐢𝐜𝐚𝐭𝐢𝐨𝐧𝐬 𝐰𝐡𝐞𝐧𝐞𝐯𝐞𝐫 𝐭𝐡𝐞 𝐬𝐜𝐨𝐫𝐞 𝐜𝐡𝐚𝐧𝐠𝐞𝐬. whenever the score changes. I’ve applied smart-template matching, targeted motion detection and OCR to extract the team names, scores and send a push message whenever the score changed.

☑ Client wanted a CV solution that scans documents for hand signatures, identifies faulty ones and groups them in a specific structure. Solution was based on deep learning and OCR post-processing, deployed as a docker ML service which helped the client to 𝐬𝐩𝐞𝐞𝐝-𝐮𝐩 𝐭𝐡𝐞 𝐩𝐫𝐨𝐜𝐞𝐬𝐬 𝐛𝐲 𝐚 3𝐱 𝐟𝐚𝐜𝐭𝐨𝐫, relying far less on Humans-in-the-Loop activity.

☑ Client wanted a project concept report on how to apply custom texture from an image onto a 3D model. I’ve researched and planned a workflow that included Object Detection, Instance Segmentation and UV mapping.

Machine Learning Engineer

Elektrobit

✅ Developed multiple Computer Vision solutions and deployed them on edge devices.

𝐄𝐥𝐞𝐤𝐭𝐫𝐨𝐛𝐢𝐭 is key supplier of embedded software solutions for the automotive industry.

☑ Worked on a 𝐣𝐨𝐢𝐧𝐭-𝐩𝐫𝐨𝐣𝐞𝐜𝐭 𝐰𝐢𝐭𝐡 𝐁𝐌𝐖 𝐌𝐮𝐧𝐢𝐜𝐡 𝐟𝐨𝐫 𝐄𝐏𝐈 (European Processor Initiative 2020) and deployed 𝐚 𝐜𝐚𝐫 𝐝𝐞𝐭𝐞𝐜𝐭𝐢𝐨𝐧 𝐚𝐧𝐝 𝐩𝐚𝐭𝐡-𝐩𝐥𝐚𝐧𝐧𝐢𝐧𝐠 𝐬𝐨𝐥𝐮𝐭𝐢𝐨𝐧 on an Nvidia Jetson AGX board, placed in a real 𝐁𝐌𝐖 𝐱5 𝐭𝐞𝐬𝐭 𝐜𝐚𝐫, which was able to detect and map the environment around the test vehicle using video feed from 2xIntelCameras and 1xLidarSensor.

☑ 𝐒𝐮𝐜𝐜𝐞𝐬𝐬𝐟𝐮𝐥𝐥𝐲 𝐩𝐮𝐛𝐥𝐢𝐬𝐡𝐞𝐝 𝐚 𝐬𝐜𝐢𝐞𝐧𝐭𝐢𝐟𝐢𝐜 𝐩𝐚𝐩𝐞𝐫 titled GFPNet, under the supervision of the Head of AI @Elektrobit Romania, at the 𝐈𝐄𝐄𝐄 𝐑𝐨𝐛𝐨𝐭𝐢𝐜𝐬 𝐚𝐧𝐝 𝐀𝐮𝐭𝐨𝐦𝐚𝐭𝐢𝐨𝐧 𝐋𝐞𝐭𝐭𝐞𝐫𝐬 2020, within the Machine Learning and Robotics field that studied the shape reconstruction of occluded 3D objects.

☑ Generated synthetic data using 𝐂𝐚𝐫𝐥𝐚𝐒𝐢𝐦𝐮𝐥𝐚𝐭𝐨𝐫 (𝐔𝐄4) to train deep neural networks for specific autonomous driving scenarios, improving the accuracy of certain prediction.

☑ Worked on development and optimisation of a vehicle direction and position classifier neural network, integrated directly on the Renesas 𝐑-𝐂𝐚𝐫-𝐇3𝐄 𝐜𝐡𝐢𝐩 (𝐒𝐨𝐂), further deployed to one of the clients test car.

☑ Worked on a 𝐦𝐨𝐝𝐞𝐥 𝐜𝐨𝐧𝐯𝐞𝐫𝐬𝐢𝐨𝐧 𝐚𝐧𝐝 𝐝𝐞𝐩𝐥𝐨𝐲𝐦𝐞𝐧𝐭 𝐩𝐢𝐩𝐞𝐥𝐢𝐧𝐞 for edge devices, that allowed a model to be ported in Python/C++ with no further intervention, 𝐬𝐩𝐞𝐞𝐝𝐢𝐧𝐠 𝐮𝐩 𝐭𝐡𝐞 𝐩𝐫𝐨𝐜𝐞𝐬𝐬 𝐛𝐲 𝐨𝐯𝐞𝐫 50%.

✅ Researched computer vision topics, mainly targeted towards autonomous driving scenarios.

☑ Researched 𝐇𝐲𝐝𝐫𝐚𝐍𝐞𝐭𝐬 for 𝐚𝐮𝐭𝐨𝐦𝐨𝐭𝐢𝐯𝐞 𝐯𝐢𝐬𝐢𝐨𝐧 𝐭𝐚𝐬𝐤𝐬, using ResNet (50, 100) encoder backbones and multiple prediction heads (classification, 3D bounding-box, object detection and orientation), the research 𝐫𝐞𝐩𝐨𝐫𝐭 𝐛𝐞𝐢𝐧𝐠 𝐟𝐮𝐫𝐭𝐡𝐞𝐫 𝐮𝐬𝐞𝐝 to develop, train and deploy a model on a small 𝐟𝐨𝐮𝐫-𝐰𝐡𝐞𝐞𝐥𝐞𝐝 𝐫𝐨𝐛𝐨𝐭.

☑ Researched 𝐏𝐨𝐢𝐧𝐭𝐂𝐥𝐨𝐮𝐝 𝐬𝐞𝐠𝐦𝐞𝐧𝐭𝐚𝐭𝐢𝐨𝐧 𝐟𝐫𝐨𝐦 𝐃𝐞𝐩𝐭𝐡 using a X-Box KinectSensor, feature that was further tested in a stack of models 𝐨𝐩𝐞𝐫𝐚𝐭𝐢𝐧𝐠 𝐨𝐧 𝐚 𝐟𝐥𝐲𝐢𝐧𝐠 𝐝𝐫𝐨𝐧𝐞 that followed QR markers on the floor.

☑ Worked on a model-development dashboard that 𝐚𝐥𝐥𝐨𝐰𝐞𝐝 𝐮𝐬𝐞𝐫𝐬 𝐭𝐨 𝐮𝐩𝐥𝐨𝐚𝐝 𝐝𝐚𝐭𝐚, 𝐛𝐮𝐢𝐥𝐝 𝐭𝐡𝐞 𝐦𝐨𝐝𝐞𝐥, 𝐬𝐜𝐡𝐞𝐝𝐮𝐥𝐞 𝐚 𝐭𝐫𝐚𝐢𝐧𝐢𝐧𝐠 𝐣𝐨𝐛, inspect metrics and download artifacts on specific targets (.pt, .onnx, .trt, .gzip).

Junior Machine Learning Engineer

Universitatea Transilvania din Brașov

✅ Teaching 𝐢𝐧𝐭𝐞𝐫𝐦𝐞𝐝𝐢𝐚𝐭𝐞 programming concepts and intro to 𝐦𝐚𝐜𝐡𝐢𝐧𝐞 𝐥𝐞𝐚𝐫𝐧𝐢𝐧𝐠.

☑ Java OOP, Python, Git
☑ Data Structures and Algorithms, Graphs
☑ Artificial Neural Networks
☑ Supervised and unsupervised learning
☑ House Price Prediction
☑ Activation Functions
☑ Hand Digits Recognition using Computer Vision and Deep Learning

Teaching Assistant

Siemens

✅ Platform to manage/schedule an industrial process workflow.

𝐒𝐢𝐞𝐦𝐞𝐧𝐬 𝐂𝐨𝐫𝐩𝐨𝐫𝐚𝐭𝐞 𝐓𝐞𝐜𝐡𝐧𝐨𝐥𝐨𝐠𝐲 is a strategic partner to Siemens operative units. It provides important services along the entire value chain – from research and development to production and quality assurance, as well as optimized business processes.

☑ 𝐏𝐥𝐚𝐧𝐧𝐞𝐝 𝐭𝐡𝐞 𝐜𝐨𝐦𝐩𝐨𝐧𝐞𝐧𝐭𝐬 for an app that would allow users to inspect and manage stock for a potato-chips factory.

☑ Implemented the 𝐬𝐞𝐜𝐮𝐫𝐢𝐭𝐲 𝐥𝐚𝐲𝐞𝐫 for admin, observer, user with different functionalities for each category.

☑ 𝐈𝐦𝐩𝐥𝐞𝐦𝐞𝐧𝐭𝐞𝐝 𝐭𝐡𝐞 𝐟𝐮𝐥𝐥-𝐬𝐭𝐚𝐜𝐤 𝐥𝐨𝐠𝐢𝐜, communications between components and frontend dashboard.

☑ 𝐖𝐨𝐧 3’rd place amongst over 10 projects presented.

Student Internship

Hard work always pays off, be consistent!

I'm a Senior Machine Learning Engineer with a keen interest in developing AI/ML solutions for real world problems and helping others get started on their Machine Learning Journey.

Let's connect @:
📘 https://medium.com/@alexandrurazvant
✉️ alexandrurazvant@gmail.com
🌐 https://www.neuraleaps.com

Alex Razvant

Want to learn about Agents, MCP, Multimodal AI, and LLMOps?

Miguel Otero and I have released an open-source course where we build an Multimodal Agent that can understand videos, step by step.

The project idea is simple: 𝐘𝐨𝐮 𝐮𝐩𝐥𝐨𝐚𝐝 𝐚 𝐯𝐢𝐝𝐞𝐨, 𝐚𝐧𝐝 𝐭𝐡𝐞𝐧 𝐜𝐡𝐚𝐭 𝐰𝐢𝐭𝐡 𝐢𝐭..

However, there are many complex challenges, underlying this simple idea.

Some of them are:
- How to build and debug MCP Servers in Python
- Understanding Multimodal Ingestion (video, audio, text, images)
- Designing efficient FastAPI APIs, Background Tasks
- Tool Calling / Router Agents from scratch, in Python
- Understanding Vision Language Models (VQA), Audio Transcription Models (STT)
- How to connect APIs (FastAPI) with UIs (React JS)

Throughout the course,  we explain each module with an general audience pace in mind.

We aimed for it to be easy to follow, easy to understand.

However, we still kept it technical enough.

You don't have to register or be an AI Expert to take this course. It's free.

The course lessons split:
1/ Course Overview
🔗 https://lnkd.in/dm73KT_i

2/ Understand Multimodal Pipelines
🔗  https://lnkd.in/dmn_RBfm

3/ Advanced FastAPI and Pydantic (extra)
🔗  https://lnkd.in/drpKtPFD

4/ Understand the MCP Protocol (extra)
🔗  https://lnkd.in/dJzNp8mH

5/ Build an MCP Server for Multimodal Ingestion
🔗  https://lnkd.in/d33Rsm4e

6/ Building a Tool Calling Agent from Scratch
🔗  https://lnkd.in/dDz6-zZU

7/ Building the full-stack (API, Agent, UI) Application
🔗 https://lnkd.in/dJezq4ry 

8/ Kubrick: The Multimodal Agent Round-up
🔗 https://lnkd.in/drZWiBdT 

Find the GitHub Repository here (give us a ⭐ ):
🔗 https://lnkd.in/dudc7BZS


Tech Stack:
- FastAPI, React JS, FastMCP, MCP Inspector, Docker Compose
- LLMOps with Opik (by @Comet)
- Multimodal Processing with @Pixeltable
- LLMs, VLMs and STT (Speech To Text) AI Models.

What you'll learn as a result:
- Build an MCP Server
- Build an API in Python with FastAPI
- Add LLM/Agent observability
- Process video/audio multimodal data.
- Connect multiple components into an AI System

Have fun learning & building!
✌️

Senior AI Engineer | Author @ NeuralBits | Helping engineers understand, build, and master AI.

CNNs remember where. ViTs remember what  

In a majority of Computer Vision models, the feature extractors (i.e, backbone networks) were built either as CNN encoders, ResNets, or Pyramid Networks.

Regardless of how large the Backbone is, CNNs are not that good at learning full-image context, due to how Receptive Fields work.

```
In deep learning, a receptive field is the specific area of the input data that influences the calculation of a single output feature or neuron in a CNN layer. 
```

1/ CNNs have inductive biases baked into their design
2/ Local receptive fields, hard to scale to High-Res images.
3/ Hierarchical feature extraction
4/ This can be improved, but at the cost of the model's depth

In the top section of the attached image, the `blue-square trace represents a receptive field from High-Level features onto Low-Level features`.

The red ❌  signs represent the feature regions that are not covered by the Receptive Field.

Thus, with CNNs, a larger image context is left out.

---

ViTs, on the other hand, see an image as a sequence of patches and mix them globally through self-attention. 

When feeding an image to a transformer, we first split it into patches of NxN pixels.
Each patch receives a positional encoding vector.
The resulting embedding vector is passed through the Transformer layers.

That makes Transformers:
1/ Permutation-invariant, positional embeddings are required.
2/ Focus on learning global + local level features 
3/ Adversarial Robustness (due to global-context, can spot tinkered features)
3/ Attention Mechanism over patches is computed in Many-to-Many order.
4/ Better for tasks that require image-wide context.

To summarize:
CNNs are limited in capturing global context due to their Receptive Fields.
ViTs compute relationships with and between each patch in the image.

CNNs are better for locality-focused tasks, e.g, Object Detection.
ViTs are better for context-focused tasks, e.,g VQA.

♻️ Reshare and let others learn this too.
Follow me to learn more about AI Engineering and production-ready AI Systems!

"What should I know about NVIDIA AI Stack?"

Here's my answer, tailored for those starting out in AI regarding NVIDIA's ecosystem.

𝗧𝗵𝗲 𝗘𝗰𝗼𝘀𝘆𝘀𝘁𝗲𝗺
NVIDIA doesn't just build the GPUs that power a large chunk of AI Infrastructure.

They've built a full end-to-end ecosystem.
> 𝙃𝙖𝙧𝙙𝙬𝙖𝙧𝙚: All the architectures and iterations (Turing, Ada, Hopper, Blackwell, etc.)
> 𝙎𝙤𝙛𝙩𝙬𝙖𝙧𝙚: CUDA, cuDNN, TensorRT, Triton, NeMo, Dynamo, and more.

This stack powers everything from training LLMs to deploying models at the edge, across various fields (Robotics, Vision, Language, Speech, Agentic and Embodied AI).

But for a beginner, these are too many, each with its place in the end-to-end AI workflow.
It's easy to get lost.

So, here's my advice, split into 3 categories:
1/ General Important Details
2/ Engineering Advice
3/ Software Stack

𝗚𝗲𝗻𝗲𝗿𝗮𝗹 𝗜𝗺𝗽𝗼𝗿𝘁𝗮𝗻𝘁 𝗗𝗲𝘁𝗮𝗶𝗹𝘀
First, I recommend that you learn at a very high level the GPU components.

This will get you started in understanding the hardware black box and differentiating between various GPU/DSA architectures.

Learn about:
1. GPU Cores
What are they? What's the difference between a CUDA Core and a Tensor Core?

2. Memory Hierarchy
Differentiate between VRAM, SRAM, and Registers. This will open doors to understanding FlashAttention, which is a key optimization in LLMs.

3. Precision & Data Types
The majority of LLMs are trained in FP32 or Mixed (FP32/FP16). For Inference, FP16/BF16,  FP4. This will also help you understand the quantization data types.

𝗘𝗻𝗴𝗶𝗻𝗲𝗲𝗿𝗶𝗻𝗴 𝗔𝗱𝘃𝗶𝗰𝗲
These will help you understand how to work more efficiently with NVIDIA's hardware and software stack.

1. Learn to read a GPU Cheatsheet (details about a GPU's performance)
2. Learn to use the Framework Compatibility Matrix (mandatory for SWEs, AIEs)
3. Learn to use NVIDIA's pre-built containers (built in robust, isolated environments)

𝗧𝗵𝗲 𝗦𝗼𝗳𝘁𝘄𝗮𝗿𝗲 𝗦𝘁𝗮𝗰𝗸
We have a lot on this layer, but for starters, just learn what each of these does:

1. 𝘊𝘰𝘳𝘦 > CUDA & cuDNN, the backbone for deep learning, both training and inference.
2. 𝘋𝘢𝘵𝘢 𝘗𝘳𝘰𝘤𝘦𝘴𝘴𝘪𝘯𝘨 > DeepStream for real-time video pipelines, cuDF for Dataframes on GPU.
3. 𝘐𝘯𝘧𝘦𝘳𝘦𝘯𝘤𝘦 > TensorRT/LLM for optimizing models, Triton, and Dynamo for deployment.
4. 𝘎𝘦𝘯𝘈𝘐 > Nemotron Models, NeMo Framework to create, customize, and deploy GenAI models.
5. 𝘌𝘯𝘵𝘦𝘳𝘱𝘳𝘪𝘴𝘦 > NIM for batteries-included GenAI deployments. Riva for Speech.
6. 𝘌𝘥𝘨𝘦 𝘈𝘐 > Jetson Xavier, DGX Spark, Orin platforms.
7. 𝘚𝘤𝘢𝘭𝘪𝘯𝘨 > K8S GPU Operator and KAI Scheduler for GPU resource management at scale.

---
There are a few more, but this is a solid start.

In the end, if you spend a few hours reading through these, you'll get a good overview of what's out there.

♻️ Share this post, and research it later.

HeyJobs

As an ML Engineering Manager at HeyJobs, I am responsible to drive the development and optimization of ML-driven Search and Recommendation systems that enhance user experience and user-job Matching on our platform while building robust MLOps frameworks. 
I lead a cross-functional team of ML Engineers, Data Engineers, and Software Engineers, focusing on implementing state-of-the-art machine learning systems, advanced MLOps practices, and NLP techniques leveraging various AWS and other services to deliver high-impact solutions aligned with business goals.

- Led the successful implementation and tuning/optimization of a new Search engine for job searches. 
This reduced considerable costs, improved key business KPIs, and enabled the addition of advanced features like Learning to Rank (LTR) and personalized search experiences.

- Proposed and led the development and deployment of a state-of-the-art job recommendation system using Vector DB, which personalizes job matches across million of new job listings with very low latency. 
This project significantly increased business KPIs, doubling the performance compared to previous systems.

- Introduced new tooling and led the development of the first general MLOps template at HeyJobs, which streamlined MLOps implementations across teams, reducing the deployment timeline from months to just days, ensuring faster and more reliable model deployment.

- Managing and supporting development of NLP techniques,integration of LLMs to enhanced data extraction and driving innovation.

- Mentor and guide ML Engineers, Analysts and Software Engineers within and beyond my team.

- Support multiple data science projects beyond my team, contributing to initiatives in Marketing, Sales, and other areas.

AI/ML Engineering Manager - Search, Recommendations, RAG and AI Agents

Jam with AI

Blogging, sharing real-world AI insights :)

Co-Jammer

Multiple companies

- Developed and deployed scalable microservices on Google Cloud Platform (GCP) using FastAPI and Cloud SQL, implementing RESTful APIs for efficient communication.

- Built an MLOps framework in GCP for automating the retraining of Transformer-based NLP models using TensorFlow, ensuring continuous model improvement.

- Created and deployed a full-stack, ML-powered web application that allows document uploads (PDF/Word) for text manipulations like chapter separation and question-answer generation, leveraging Transformer-based NLP models in TensorFlow.

- Worked on Python-based microservices for user tracking and ML-driven behavior analysis, using advanced NLP techniques (regex 😉) to improve the accuracy of cookie-free tracking data.

Credit Suisse

- Led the development and deployment of an NLP-based classification model in Flask framework, automating commentary generation and email notifications for the Liquidity Management team, enhancing operational efficiency.

- Implemented MLOps practices using on-premise infrastructure and internal cloud solutions, orchestrating model deployment and monitoring, ensuring scalability, reliability, and continuous integration of machine learning solutions.

- Automated complex financial calculations for the Product Control department using R, and developed an RShiny dashboard for interactive statistical visualization.

- Developed a recommendation system prototype for internal finance tools, improving the personalization of data insights and decision-making support.

Senior Data Scientist

eGain Corporation

- Developed an email classification using NLP techniques and simple neural networks, improving categorization accuracy.
 
- Designed and implemented an RNN-based sequence-to-sequence model in TensorFlow for an in-house chatbot PoC.

- Created automation test cases with Selenium, streamlining testing processes and reducing deployment time.

Software Engineer II

Experienced Machine Learning Engineering lead with a strong background in Machine Learning and MLOps across various domains including information retrieval (Search, Recommendations, RAG-systems & ChatBots), NLP, and Customer Analytics. Brand new: AI Agents!

I specialize in guiding cross-functional teams of ML Engineers, Software Engineers, etc. to build scalable, event-driven ML solutions with a focus on robust MLOps practices using Python/PySpark and cloud platforms like AWS, GCP, etc. - (GCP Certified ML Engineer)

Currently, at HeyJobs, I have been fortunate to initiate and lead multiple complex ML projects (Search, RecSys, NLP and AI Agent) that that have significantly outperformed previous benchmarks and generated substantial business value. Additionally, I also designed and lead the implementation of a new MLOps and monitoring framework that has been embraced across all Data Science teams within the company.

Additionally, I love learning the latest advancements in the ML space, always exploring new ideas to push boundaries and improve outcomes. I’m also dedicated to mentoring and sharing knowledge, focused on building systems that drive innovation and business outcome.

Shantanu Ladhwe

Many wouldn't like this:
If I’m hiring for an AI Engineer…
I’m not going to ask 5 RAG flows or 10 agent flows.

Here’s what I really want to know 👇

1. Can you design a system end-to-end? from ingestion to serving? what are the bottlenecks?
2. How would you estimate costs? how to reduce it?
3. How would you reduce latency? what is a good tradeoff of latency vs quality? 
4. Do you really need self-hosted LLMs? When is it needed? 
5. How would you fine-tune language models on user behavior? which framework? what about model serving?
6. How would you construct the dataset, what about loss function? what about MLOps? 
7. Which database would you use and why? Vector DB? SQL? NoSQL?
8. What metrics would you track? How? 
9. What about system monitoring? How would you debug failure cases?
10. What about feedback loop? how would we track and evaluate?
11. How would you make the system more deterministic?
12. How would you replace embedding models and backfill embeddings without any downtime?
13. What are the fallback mechanisms?

My favourite:
1️⃣ How would you solve this problem without LLMs or vector DBs?
2️⃣ Can you solve the problem with classical IR, rules, heuristics?
3️⃣ How would you make the system more deterministic?
4️⃣ Can you explain tokenization and embeddings from scratch?
5️⃣ What happens during fine-tuning? optimizer, learning rate, layer freezing? - not just “let's use LoRA”

These are just a few top-of-mind.

The reason:
I’ve seen engineers spend months building something flashy and complex that never made it to production.
I want engineers who understand the fundamentals, not just the hype.

I don’t want a flashy agent.
I want a resilient system.

NOTE:
Many of these questions are answered in the below self-paced course launched.

Do check it out here - https://lnkd.in/d3-X6F4x

(This is from real-world experienced professionals!)

--
♻️ Repost to share with others :)
🔔 Follow me, Shantanu for production AI/ML/MLOps & careers
➕ Join 31.000+ serious AI/ML builders here: https://lnkd.in/ds_SzEUH

Head of AI/ML - AI Agents, RAG, NLP, Recommenders, Search & MLOps

How to choose perfect Vector DB?
How to select an embedding model?
How to select reranking model?

Many struggle with these questions.
The below pdf from Pratik answers them very well!

𝗧𝗵𝗲 𝟳 𝗰𝗵𝗮𝗽𝘁𝗲𝗿𝘀 𝘆𝗼𝘂 𝗮𝗰𝘁𝘂𝗮𝗹𝗹𝘆 𝗻𝗲𝗲𝗱:

1️⃣ 𝗟𝗟𝗠 + 𝗥𝗔𝗚 𝗕𝗮𝘀𝗶𝗰𝘀 
→ How generative models differ from discriminative 
→ Where RAG actually helps (and where it doesn't)

2️⃣ 𝗣𝗮𝗶𝗻 𝗣𝗼𝗶𝗻𝘁𝘀 𝗡𝗼𝗯𝗼𝗱𝘆 𝗧𝗮𝗹𝗸𝘀 𝗔𝗯𝗼𝘂𝘁 
→ Real production challenges 
→ Practical fixes that actually work

3️⃣ 𝗛𝗮𝗹𝗹𝘂𝗰𝗶𝗻𝗮𝘁𝗶𝗼𝗻 𝗥𝗲𝗱𝘂𝗰𝘁𝗶𝗼𝗻 
→ Prompting techniques that matter 
→ What works in production 

4️⃣ 𝗖𝗵𝘂𝗻𝗸𝗶𝗻𝗴 + 𝗘𝗺𝗯𝗲𝗱𝗱𝗶𝗻𝗴𝘀 
→ Vector databases that scale 
→ Re-ranking strategies 
→ Architectural decisions that stick

5️⃣ 𝗣𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻 𝗧𝗲𝘀𝘁𝗶𝗻𝗴 
→ 8 test case scenarios 
→ What breaks in production 
→ How to catch it before users do

6️⃣ 𝗢𝗯𝘀𝗲𝗿𝘃𝗮𝗯𝗶𝗹𝗶𝘁𝘆 
→ Monitor what matters 
→ Debug when things go wrong

7️⃣ 𝗣𝗲𝗿𝗳𝗼𝗿𝗺𝗮𝗻𝗰𝗲 𝗢𝗽𝘁𝗶𝗺𝗶𝘇𝗮𝘁𝗶𝗼𝗻 
→ Making it faster 
→ Making it cheaper 
→ Keeping it reliable

I hope this helps!

--
♻️ Repost to share with others :)
🔔 Follow me, Shantanu for production AI/ML/MLOps & careers
➕ Join 30.000+ AI/ML builders here: https://lnkd.in/ds_SzEUH

How to RAG!

If you are serious about AI/ML engineering
Stop building 5+ shallow projects!!!
ONE serious AI project will teach you more than any $2000+ project or other shallow projects out there...

We spent 6 weeks building production RAG for 10,000+ research papers.

While you were bookmarking "Learn RAG in 15 minutes" videos.
Here's what 𝐚𝐜𝐭𝐮𝐚𝐥 building looks like:

𝐖𝐞𝐞𝐤 𝟏: Docker orchestration 
(that doesn't crash when you need it)

𝐖𝐞𝐞𝐤 𝟐: Automated pipelines 
(run while you sleep, not when you babysit)  

𝐖𝐞𝐞𝐤 𝟑: BM25 search 
(beats your precious vectors 40% of the time)

𝐖𝐞𝐞𝐤 𝟒: Chunking strategies 
(spoiler: most tutorials get this wrong)

𝐖𝐞𝐞𝐤 𝟓: Hybrid search 
(high retrieval accuracy on real test data)

𝐖𝐞𝐞𝐤 𝟔: Redis caching + monitoring 
(70% faster responses)

𝐓𝐡𝐞 𝐫𝐞𝐬𝐮𝐥𝐭𝐬:
→ Zero API costs (runs locally, imagine that)
→ Processes arXiv papers daily (without breaking)
→ Catches edge cases automatically (because production is messy)
→ Real error handling (not print statements)

Here's what will actually happen: 
- 1000 people will read this 
- 100 will visit the course 
- 10 will preview it 
- 1 will start and submit a pull request

Which group are you in?

Initial part of career I wasted my time and money on Shallow courses!
Learn the real deal here - https://jamwithai.dev/

The first 100 people get EXTRA 25% off!

Use this coupon - PGJYQ39XY6 
(a lot of value in there)

Hurry up!
Remember: You can extend this project for any use case!

--
♻️ Repost to share with others :)
🔔 Follow me, Shantanu for production AI/ML/MLOps & careers
➕ Join 31.500+ serious AI/ML builders here: https://lnkd.in/ds_SzEUH

Many people ask me how they can get started with ML engineering. 
These are good steps mentioned below👇

Sr. Data Scientist/ AI Engineer | Data Science, RAG, AI Agents, & MLOps | Germany’s Top Female Voice in AI 🇩🇪

If I was starting with ML Engineering in 2026.

I will follow these simple steps and resources to get started
(no over complication)

ML Engineering still exists and is much needed!
These are simple go to resources. 

You can replace resources by any.
Just don't get drowned into it.

1️⃣ 𝗣𝘆𝘁𝗵𝗼𝗻 𝗺𝗮𝘀𝘁𝗲𝗿𝘆:
a. Arjan Codes (Youtube) - youtube.com/arjancodes
↳ Real-world patterns, not toy examples

b. 100 Days of Code (Udemy) - https://lnkd.in/dt26wVzW
↳ Build while you learn

2️⃣ 𝗦𝗤𝗟 𝗳𝗼𝘂𝗻𝗱𝗮𝘁𝗶𝗼𝗻𝘀:
a. SQL Fundamentals (DataCamp) - https://lnkd.in/dp9nRNcN
↳ Production queries from day 1

3️⃣ 𝗠𝗮𝘁𝗵𝗲𝗺𝗮𝘁𝗶𝗰𝘀 (𝗱𝗼𝗻'𝘁 𝘀𝗸𝗶𝗽, 𝗯𝘂𝘁 𝗮𝗹𝘀𝗼 𝗱𝗼𝗻’𝘁 𝗼𝘃𝗲𝗿𝗱𝗼 𝗶𝘁 ):
a. Linear Algebra (Youtube) -https://lnkd.in/dmCSmw4q
↳ Visual intuition over formulas

b. Mathematics of Machine Learning (Book) - amazon.com/dp/1837027870
↳ The one ML math book you need

4️⃣ 𝗗𝗲𝗲𝗽 𝗟𝗲𝗮𝗿𝗻𝗶𝗻𝗴:
a. Deep Learning Specialization (Coursera) - https://lnkd.in/d_MUvhqb
↳ Taught by Andrew Ng himself

5️⃣ 𝗦𝘆𝘀𝘁𝗲𝗺 𝗗𝗲𝘀𝗶𝗴𝗻:
a. Stanford System Design (Youtube) - https://lnkd.in/dcnzFYHU
↳ Architecture patterns that scale

6️⃣ 𝗠𝗟𝗢𝗽𝘀:
a. Designing Machine Learning Systems (Book) - amazon.com/dp/1098107969
↳ Production ML bible by Chip Huyen

b. AWS ML Specialty Certification (Udemy) - https://lnkd.in/dntE2dCx
↳ Hands-on cloud deployment

Total cost: <$500
Total time: 6-9 months (honestly, it takes time)
ROI: Career-changing

Check the steps added below 👇  

--
♻️ Repost to if you found it helpful 💚 
➕ Join 29.000+ AI/ML builders here: https://lnkd.in/ds_SzEUH

taplio

The Battle

Alex Razvant

Shantanu Ladhwe

Followers

Posts

Engagements

Likes

Performance ScoreAlex Razvant's LinkedIn Performance

Performance ScoreShantanu Ladhwe's LinkedIn Performance

Ready to grow your LinkedIn presence?

taplio

The Battle

Alex Razvant

Shantanu Ladhwe

Followers

Posts

Engagements

Likes

Performance Score.css-goub6s{font-size:var(--chakra-fontSizes-md);font-weight:500;color:var(--chakra-colors-gray-600);display:block;margin-top:var(--chakra-space-1);}Alex Razvant's LinkedIn Performance

Performance ScoreShantanu Ladhwe's LinkedIn Performance

Ready to grow your LinkedIn presence?

Performance ScoreAlex Razvant's LinkedIn Performance