AIMultiple ResearchAIMultiple Research

AI Limitations in 2024: Data hungry, opaque, brittle systems

Written by
Cem Dilmegani
Cem Dilmegani
Cem Dilmegani

Cem is the principal analyst at AIMultiple since 2017. AIMultiple informs hundreds of thousands of businesses (as per Similarweb) including 60% of Fortune 500 every month.

Cem's work focuses on how enterprises can leverage new technologies in AI, automation, cybersecurity(including network security, application security), data collection including web data collection and process intelligence.

View Full Profile

Though we preach that AI investments can transform businesses, we are also not naive in our beliefs in AI’s current capabilities. Most modern AI systems suffer from common issues highlighted by respectable publications that we will collect here:

Reliance on large volumes of data

Impacts deep learning algorithms. Sadly, even when data is available, it’s likely to suffer from bias.

Research on one shot learning is an attempt to solve this problem.

Reliance on labeled data

Limits supervised learning algorithms to relatively few problems where labeled data is either available or where the solution is so valuable that companies invest in preparing semi-manually labeled data.

As a response, unsupervised learning algorithms are being improved.

Limited ability to adapt

Small changes to the problem can stop a perfectly working system and require it to be tweaked by experts to get back to functioning again.

Transfer learning is an area of active research to counter this issue. Recently AlphaZero was able to master chess, shogi and Go in a relatively short time.

Lack of transparency

Impacts deep learning algorithms. Since deep neural networks are complex mathematical structures, their logic can not be easily summarized to humans.

Local interpretable model agnostic explanations (LIME) and attention techniques are being developed to address the lack of transparency. This McKinsey article offers some good visualizations on how these techniques work.

Lack of methods for integrating prior knowledge

Though some AI methods solely rely on encoded prior knowledge, some like deep learning have no way of taking in summarized information from experts. This is a significant limitation while building systems that work with domains where current science can explain most phenomena accurately.

Almost all of these issues were highlighted by these sources:

  • McKinsey
  • Gary Marcus, a professor of cognitive psychology at NYU and briefly director of Uber’s AI lab.

Though there are limitations, there is still plenty of ways to leverage AI. You can check out AI applications in marketing, sales, customer service, IT, data or analytics.

If you decide to apply AI, start reviewing our data-driven lists of AI platform, consultant and companies.

And If you have a business problem that is not addressed here:

Find the Right Vendors
Cem Dilmegani
Principal Analyst

Cem is the principal analyst at AIMultiple since 2017. AIMultiple informs hundreds of thousands of businesses (as per Similarweb) including 60% of Fortune 500 every month.

Cem's work focuses on how enterprises can leverage new technologies in AI, automation, cybersecurity(including network security, application security), data collection including web data collection and process intelligence.

Cem's work has been cited by leading global publications including Business Insider, Forbes, Washington Post, global firms like Deloitte, HPE, NGOs like World Economic Forum and supranational organizations like European Commission. You can see more reputable companies and media that referenced AIMultiple.

Cem's hands-on enterprise software experience contributes to the insights that he generates. He oversees AIMultiple benchmarks in dynamic application security testing (DAST), data loss prevention (DLP), email marketing and web data collection. Other AIMultiple industry analysts and tech team support Cem in designing, running and evaluating benchmarks.

Throughout his career, Cem served as a tech consultant, tech buyer and tech entrepreneur. He advised enterprises on their technology decisions at McKinsey & Company and Altman Solon for more than a decade. He also published a McKinsey report on digitalization.

He led technology strategy and procurement of a telco while reporting to the CEO. He has also led commercial growth of deep tech company Hypatos that reached a 7 digit annual recurring revenue and a 9 digit valuation from 0 within 2 years. Cem's work in Hypatos was covered by leading technology publications like TechCrunch and Business Insider.

Cem regularly speaks at international technology conferences. He graduated from Bogazici University as a computer engineer and holds an MBA from Columbia Business School.

Sources:

AIMultiple.com Traffic Analytics, Ranking & Audience, Similarweb.
Why Microsoft, IBM, and Google Are Ramping up Efforts on AI Ethics, Business Insider.
Microsoft invests $1 billion in OpenAI to pursue artificial intelligence that’s smarter than we are, Washington Post.
Data management barriers to AI success, Deloitte.
Empowering AI Leadership: AI C-Suite Toolkit, World Economic Forum.
Science, Research and Innovation Performance of the EU, European Commission.
Public-sector digitization: The trillion-dollar challenge, McKinsey & Company.
Hypatos gets $11.8M for a deep learning approach to document processing, TechCrunch.
We got an exclusive look at the pitch deck AI startup Hypatos used to raise $11 million, Business Insider.

To stay up-to-date on B2B tech & accelerate your enterprise:

Follow on

Next to Read

Comments

Your email address will not be published. All fields are required.

0 Comments