🦾Jepson Taylor

I build stuff that doesn’t exist, an AI explorer. 
Unfortunately I have too many connections so please follow me instead. 

人工智能 (Chinese)
人工知能 (Japanese)
कृत्रिम बुद्धिमत्ता (hindi)
الذكاء الاصطناعي (Standard Arabic)
কৃত্রিম বুদ্ধিমত্তা (Bengali)
искусственный интеллект (Russian)

I watch the watchers, I direct the learners. 

I am passionate about machine learning. My life's mission is to further the boundaries of what is possible with data science. I spend as much time as I can working with deep learning, NLP, and all forms of data science. I currently have a passion project I am managing where I am combining the power of genetic programming with deep learning to automate network design. I think there is a trend happening in data science where human expertise and creativity are being replaced by powerful new methods (i.e. deep learning, big data). 

I am most well known for my machine learning work with the data science community and with HireVue. With the community, I enjoy posting opinions on jobs and tutorials on ML methods. I also enjoy speaking and presenting to all types of audiences. 

I've enjoyed working across engineering, product, sales, marketing, and customer success. This wider POV has helped shape the way I think about innovation, from the innovation farm to the customer's table ;)

CEO/founder VEOX

VEOX Inc is revolutionizing the AI industry by creating an AI-driven algorithm factory, compressing decades of progress into moments. Our technology automates AI science research, continuously improving algorithm efficiency and outperforming human-made algorithms. VEOX is not just building another AI company; we're catalyzing an explosion of technological advancements that will reshape the entire tech landscape. Join us in accelerating intelligence beyond human limits and leading the next wave of AI breakthroughs.

Jepson Taylor

I create content about deep learning | The DevRel and Deep Learning Dude

I don’t wanna hop on call to learn about or see a demo of what you’re building. Too busy hacking on VLMs, curating multimodal datasets, and contributing to the open source community. 

Harpreet Sahota 🥑

It was great to be back in Boston last week and host another awesome meetup!

Thank you for everyone who showed up, our awesome lineup of speakers for taking time out of their schedules for delivering such informative talks: Anku Rani Hanhui Wang Sage Simhon Sharut G. 

And for Voxel51 for sponsoring!

If you missed the event, checkout the comments for where you can find the recordings of the talks

🤖 Hacker-in-Residence @ Voxel51| 👨🏽‍💻 AI/ML Engineer | 👷🏽‍♀️ Technical Developer Advocate | Learn. Do. Write. Teach. Repeat.

No alternative text description for this image

i built a ComfyUI-inspired visual, node-based workflow editor for FiftyOne

now you can build dataset curation, analysis, and model evaluation pipelines by connecting nodes on a canvas, without writing code

give it a try and let me know what you think, completely open source and all you have to is `pip install fiftyone` and follow the instructions on the readme

looking through the data for Action100M that was used to train VL-JEPA

it took me a while to go through the paper to understand this "tree of captions" concept and what they mean. there's five relevant annotation fields per video segment, each support different downstream tasks:

- `gpt_action_brief` — short verb phrase labels for action classification. 

- `gpt_action_detailed` — imperative instructions for embodied AI / robotics. 

- `gpt_summary_brief` — one-sentence captions for quick video understanding. 

- `gpt_summary_detailed` — rich descriptions for text-to-video retrieval. 

- `gpt_action_actor` — who's doing it, for multi-person disambiguation.

so the annotations are the same visual moment described through different lenses. 

ie:

- classifier needs "spread almonds on tray." 

-  retrieval model needs the full scene description. 

- robot needs step-by-step instructions. 

the VL-JEPA model they train actually mixes all four text fields as a form of data augmentation, so the same video segment has multiple descriptions with different granularities

btw i'm doing a virtual workshop using this dataset, it'll be cool. we'll use qwen3vl-embeddings, qwen3vl, molmo2, and some other things. 

here's a subset of it: https://lnkd.in/gxYaxFMA

register here: https://lnkd.in/gPEDEwvd

it's been a long, long while since i've done a live stream on linkedin, but it's happening in t-mius 8 minutes!

if you're interested in learning about how to work with video datasets using open source tools, open data, and open models...this is the session for you!

Join us on Feb 26 for Exploring Video Datasets with FiftyOne and Vision-Language Models. Register for the Zoom: https://lnkd.in/gCk7gGPi

Video is the hardest modality to work with — more data, more complexity, and annotation workflows that don’t scale. This hands-on session by Harpreet Sahota 🥑 shows how to understand what’s inside massive video datasets without manually watching thousands of clips.

You’ll learn how to:
🎬 Navigate and explore video datasets in the FiftyOne App and understand dataset structure
🔎 Compute embeddings with Qwen3-VL to enable semantic search, zero-shot classification, and clustering
📝 Generate video descriptions and localize events using vision-language models like Qwen3-VL and Molmo2
🧭 Visualize patterns and trends through embedding projections in FiftyOne
📏 Evaluate model outputs against Action100M’s hierarchical annotations

Perfect for ML engineers, data scientists, and computer vision teams working with large-scale video data who want practical workflows for exploration, curation, and debugging.

#computervision #machinelearning #ai #datascience #videoanalytics #visionlanguagemodels #mlops #opensource

Derek Van de Streek, Swati Bannore Jain and 11 other attendees

Feb 26 - Exploring Video Datasets with FiftyOne and Vision-Language Models

if you're interested in learning how to work with and understand your video datasets, then join me for this workshop!

excited to be back in stuttart! if you're in the area and want to speak at the meetup on april 21st, send me a dm

Chief Community Officer @ Voxel51 | Startup Advisor

Are you based in the Stuttgart area? Consider speaking at the upcoming April 21 - Stuttgart AI, ML and Computer Vision Meetup: https://voxel51.com/speak

#computervision #ai #artificialintelligence #machinevision
#machinelearning #datascience #opensource #stuttgart

been waiting for this to drop, and pumped to have this available in the app!

Visual AI teams are spending millions on annotations that don't improve model performance — then cycling through 5-7 rounds of QA to fix mistakes that should have been caught upstream. Yet 6-10% error rates persist in production systems, wasting budgets and time on labels that don't actually improve performance.

Today, we're announcing new capabilities in FiftyOne Annotation that rethink this entirely. 

Instead of treating annotation as an isolated step, FiftyOne now unifies data selection, 2D and 3D label creation, QA, and error detection alongside curation and model evaluation — in one platform.

No more exporting to external tools, waiting for labels, importing back, finding mistakes, and repeating. With FiftyOne Annotation, you can:
🎯 Select the right data to label using zero-shot and embeddings techniques — our research shows teams can match model accuracy with just 10% of training data
✍️ Create and edit 2D bounding boxes, 3D polylines, and cuboids directly in FiftyOne
🔍 Surface and fix labeling mistakes using ML-backed error detection before they hurt performance

Learn more about what you can do with FiftyOne Annotation:  https://lnkd.in/gH7wvjTv

i've learned a lot from Eric Ma over the years, from the first time I saw one of his talks on principled data science workflows to talks he's given for my communities over the years, and his latest work on getting the most from coding agents.

check out his next talk, and support the SciPy community as well!

Together with my teammates, we solve biological problems with network science, deep learning and Bayesian methods.

As a data scientist, how much of your week is spent on work a coding agent could do?

I once planned multiple days of work for a machine learning experiment last year. This was an experiment that I had put off for an entire quarter because, as a team lead, I didn't have the time to block out the 3-4 afternoons that I thought I'd need. 

Instead, I described the problem to Claude Opus 4.5 via OpenCode, and it wrote the code, ran the training, found issues, switched strategies, and finished the whole thing in 20 minutes, complete with a written report drafted *with* figures referenced.

The data scientists who figure this out now will have an edge.

I'm teaching a workshop on how to do this flavour of agentic data science to raise funds for SciPy 2026's Financial Aid Program. You'll learn:

- Prescriptive prompting for experiments
- Project structure for agents
- Logging and verification strategies to enable automated control
- Report writing with AI
- Staying in control during EDA
- The minimalist version first

These are the same techniques I use in my personal projects and my teammates to compress data science timelines from days to minutes. I think you'll have a chance to learn something good while doing something good!

Details:

- Date: March 27 & April 3, 2026
- Time: 2:00-4:00 PM EST
- Venue: Google Meet (calendar invite will be provided)
- 40 spots available
- $1,000 minimum donation, paid directly to NumFOCUS (tax-deductible), student pricing: $200!

Video recordings available if you can't attend live.

Sign up here: https://lnkd.in/eFjc36Tb. I'm looking forward to seeing what you'll build with these techniques! 

P.S. If you can't make it but share it with others who have the means and would benefit from the workshop, I would deeply appreciate it!

Open article: Agentic Data Science Workshop | SciPy 2026 Fundraiser by agent-assisted-data-science.vercel.app

Agentic Data Science Workshop | SciPy 2026 Fundraiser

We just released a new AWS workshop that I’m really excited to finally share 👇
https://lnkd.in/eiNprTd7

This came from something I keep seeing across autonomy, robotics, and computer vision teams lately.

Most teams are not blocked by models anymore.
They are blocked by data and iteration speed.

So we wanted to show what a practical workflow actually looks like:
🚗 generate synthetic driving data
 🧠 auto label using foundation models
 🔧 fine tune a small vision language model
 ☁️ deploy and iterate using AWS SageMaker
 👀 inspect and improve everything inside FiftyOne

The goal was simple.

Build something real that teams could follow end to end.

Huge credit to Ryan Patrick Sweeney, Mark Vinciguerra, and Derick Thompson for driving this forward, along with great collaboration between Amazon Web Services (AWS), NVIDIA Omniverse, and Voxel51 🙌

Also excited that Voxel51 is now live on AWS Marketplace, which makes getting started a lot easier for teams working on computer vision and robotics workflows!

Personally, I think this is how a lot of Physical AI systems will get built going forward.

Faster loops between data, models, and deployment instead of long waiting cycles.

If you’re working on robotics, AV, or multimodal systems, I’d genuinely love to hear what you’re building.

More coming soon 🚀

#PhysicalAI #ComputerVision #Robotics #MultimodalAI #SyntheticData #AWS #MachineLearning #AutonomousSystems

Open article: GitHub - aws-samples/sample-finetuning-small-vlms-synthetic-data by github.com

Contribute to aws-samples/sample-finetuning-small-vlms-synthetic-data development by creating an account on GitHub.

GitHub - aws-samples/sample-finetuning-small-vlms-synthetic-data

I’m so happy to have my boi Wiz present at one of our meets!

AI @ NVIDIA - 🏗️ Build | 🚢 Ship | 🚀 Share

View Chris "The Wiz 🪄" Alexiuk’s profile

skills.md - you've seen it, you've probably used it (I assume if you're following this LinkedIn account, you're someone who uses tools like OpenCode/etc.

I'm excited to be yappin' about skills at an upcoming Voxel51 / Hugging Face virtual event with a line up that boggles the mind: 

Ben Burtenshaw, Daniel Ávila Arias, and AdonAI Vera.

My presentation will focus on something near and dear to my heart: Skills as documentation. 

The days of documentation aren't over - humans, and agents, still need to understand how things work - but they're changing quickly. Not everyone wants to read a thorough getting started guide that may be built for a specific system (and if it's not, it'll be ~2K words long) Sometimes, you just want to clone a repository - and get cooking. 

Skills help bridge that gap - context for LLMs, but tailored for a human experience. 

Can't wait for the event, come on out and ask any skill questions you have!

looking forward to hosting this workshop tomorrow, join me!

Join Harpreet Sahota 🥑 on Feb 26 for a virtual workshop to learn how to use Facebook's Action100M dataset and FiftyOne to build an end-to-end workflow - https://lnkd.in/gFvwbQni

What you'll learn:

* Navigate and explore video data in the FiftyOne App, filter samples, and understand dataset structure

* Compute embeddings with Qwen3-VL to enable semantic search, zero-shot classification, and clustering

* Generate descriptions and localize events using vision-language models like Qwen3-VL and Molmo2

* Visualize patterns in your data through embedding projections and the FiftyOne App

* Evaluate model outputs against Action100M's hierarchical annotations to validate what the models actually capture

By the end of the session, you'll have a reusable toolkit for understanding any video dataset at scale, whether you're curating training data, debugging model performance, or exploring a new domain.

***********

Want to build better computer vision models? FiftyOne is an open source toolkit from Voxel51 (our Meetup sponsor) that helps you curate datasets, evaluate model performance, visualize embeddings, catch annotation errors, and eliminate duplicate images—all in one place.

“pip install fiftyone” is all it takes to get started - https://docs.voxel51.com/

#computervision #ai #artificialintelligence #machinevision #machinelearning #datascience #opensource

taplio

The Battle

Jepson Taylor

Harpreet Sahota 🥑

Followers

Posts

Engagements

Likes

Performance ScoreHarpreet Sahota 🥑's LinkedIn Performance

Ready to grow your LinkedIn presence?

taplio

The Battle

Jepson Taylor

Harpreet Sahota 🥑

Followers

Posts

Engagements

Likes

Performance Score.css-goub6s{font-size:var(--chakra-fontSizes-md);font-weight:500;color:var(--chakra-colors-gray-600);display:block;margin-top:var(--chakra-space-1);}Harpreet Sahota 🥑's LinkedIn Performance

Ready to grow your LinkedIn presence?

Performance ScoreHarpreet Sahota 🥑's LinkedIn Performance