Get All Access for $5/mo

How to Apply and Optimize Your Algorithm When You're Ready to Run With AI Follow a tried-and-true implementation methodology of purposeful, simple and tested engineering, such as Lean AI, to unlock AI's true potential.

By Sourav Dey Edited by Dan Bova

Opinions expressed by Entrepreneur contributors are their own.

MF3d | Getty Images

Amazon's recently launched SageMaker artificial intelligence service is an exciting new development, but the program doesn't do it all. There's a distinct gap between innovative AI technology that exists and AI solutions that will help drive business results in your specific case. Using products such as SageMaker is like having a brand-new Tesla Model S: It's an awesome car, but it's a giant electric paperweight if you don't know how to drive.

We discussed "walking" with AI in a prior Entrepreneur article; now it's time to hit the ground running. At Manifold, we work with clients using a method called "Lean AI." Our method is inspired by many other popular processes, including human-centered design by IDEO, agile software development, the Lean Startup methodology and CRISP-DM. Lean AI has six steps: understand, engineer, model, acquire feedback, deploy and validate. Here, I'll focus on three key pieces that any entrepreneur will need to follow to optimize AI.

Related: 10 Artificial Intelligence Trends to Watch in 2018

1. Engineer: Quit playing around

Because AI engineering is software engineering, you need to use good practices such as source control, code reviews and clean interfaces, among others. Many data scientists are guilty of "playing in the sandbox," but you should always build as if you're going to production.

At Manifold, one of the most important steps we've implemented involves using Docker to take advantage of containerized data science. The resulting developer flow is cleaner and more collaborative, and it's ultimately far more productive.

People have been engineering software far longer than they've been engineering AI solutions. Applying existing development and operations best practices to AI systems will make your processes as efficient as possible.

2. Model: Start small, and scale up

When incorporating AI into your business, the possibilities seem endless. Don't let your imagination get the best of you -- even if you have big plans, you'll want to start simple and scale up. Take the advice of Emmanuel Ameisen, the AI lead at Insight Data Science, a post-doctoral fellowship program connected with big Silicon Valley names like Facebook and Zillow: Efficient problem-solving happens at the most straightforward, basic level. Baseline models will consistently deliver superior end products, especially for the user.

We use explicit rules in our process to keep simplicity in mind, particularly when applied to supervised learning problems. We believe in nailing a few features first; you can always add more later. And we always begin with classification before regression -- dealing with a set number of values rather than a continuous values -- so we can learn from the more obvious class errors.

Related: Why Small Business Should Be Paying Attention to Artificial Intelligence

3. Acquire feedback: See what (many) humans think

At the end of the day, humans will have to interact with and make sense of your AI's recommendations. Get your AI in front of users -- fast. They can tell when the AI is recommending reasonable things or the search results are relevant. In our research, we've found two major patterns: suspicion of AI and the need to post-process raw predictions.

AI models rarely gain immediate trust, especially among people who haven't worked with machine learning before. Explainable AI is still a field in its infancy, but there are great packages already, like Tree SHAP, that explain the "whys" of an AI's predictions so users feel more comfortable.

We've also found that an AI's raw predictions are often insufficient on their own. It's necessary to build a user interface that allows post-processing so users can go a little further to solve the business problem. One of our clients, a leading oil field services company, had many compressor units that were running in "stressed" situations. While raw AI predictions correctly predicted that these units were going to fail soon, that wasn't useful information to the maintenance techs. Rather, they wanted to find "normal" units that transitioned to "likely to fail."

To solve the problem, we post-processed the time series of raw predictions and built a user interface that only alerted techs when a unit had significant changes in its failure probability. This resulted in fewer false alarms and a more useful AI with fewer inefficiencies. The takeaway for us has been that the user interface, or UI, is as important as the AI.

Related: Why AI Won't Replace (Great) Salespeople

AI can accelerate businesses to new levels of insight more quickly than we know. However, AI and machine learning are still in their relative infancy. Because of the newness, business owners and entrepreneurs might be intimidated by the technology, or they might try to run with it before they can walk or even crawl. Instead, follow a tried-and-true implementation methodology of purposeful, simple and tested engineering, such as Lean AI, to unlock AI's true potential.

Sourav Dey

Managing Director and the Head of Machine Learning of Manifold

Sourav Dey is a managing director and the head of machine learning at Manifold, an artificial intelligence product development studio.

Want to be an Entrepreneur Leadership Network contributor? Apply now to join.

Side Hustle

The Side Hustle He Started in His College Apartment Turned Into a $70,000-a-Month Income Stream — Then Earned Nearly $2 Million Last Year

Kyle Morrand and his college roommates loved playing retro video games — and the pastime would help launch his career.


5 SEO Hacks to Help You Rank Fast

Discover the best SEO hacks you can use to rank fast and avoid waiting for months to see results.

Starting a Business

Inside the Exclusive Private Club Devoted to Food, Wine and the Arts

Barrett Wissman breaks down the passions and partnerships behind his latest venture Domus Artium Reserve.

Business News

Elon Musk Threatens to Ban Employees from Using Apple Products, Says Will Lock Devices in 'Cages'

The Tesla founder sounded off on X following Apple's 2024 Worldwide Developer Conference on Monday.


Watch Out for These 5 Consequences of Too Much Collaboration

Beware of the collaboration trap! Too much collaboration causes overload, and well-intentioned efforts to have broad collaboration can backfire.

Science & Technology

Why We Shouldn't Fear AI in Education (and How to Use It Effectively)

Facing resistance to new technologies in the educational process is nothing new, and AI is no exception. Yet, this powerful tool is set to overcome these challenges and revolutionize education, preparing students and professionals for a future of unparalleled efficiency and personalized learning.