AIMultiple ResearchAIMultiple Research

RPA & Computer Vision: 5 Intelligent Automation Examples in '24

Written by
Cem Dilmegani
Cem Dilmegani
Cem Dilmegani

Cem is the principal analyst at AIMultiple since 2017. AIMultiple informs hundreds of thousands of businesses (as per Similarweb) including 60% of Fortune 500 every month.

Cem's work focuses on how enterprises can leverage new technologies in AI, automation, cybersecurity(including network security, application security), data collection including web data collection and process intelligence.

View Full Profile

With hyperautomation becoming one of the top enterprise technology trends, leading robotic process automation (RPA) companies are beginning to integrate artificial intelligence capabilities into their automation tools to create intelligent bots that automate end-to-end processes and make decisions. Computer vision is one of the key AI capabilities of new-generation RPA tools.

In this article, we will explore five examples of how computer vision and RPA can be used together to enable business intelligent automation.

1. Remote desktop automation

50%1 of businesses expect to increase their spending on remote desktop software as:

  • Nearly 60%

However, such virtual desktop infrastructures (VDI) only provide access to images from applications to end users, and traditional RPA and automation methods that require operating system access cannot automate processes through a remote desktop.

Intelligent RPA bots with computer vision capabilities can “see” the screen of a computer as human employees do and:

  • Record the user’s interaction with the screen to learn how to carry out a task.
  • Interact with user interface elements such as images, texts, buttons, dropdown menus, and checkboxes.
  • Open and close applications.
  • Extract data from an application and enter it into other applications.

Learn more about RPA and BPO integration.

2. Legacy system integration

Legacy systems are pervasive in many industries because replacing them can be disruptive to essential business operations. For instance:

  • 80%

While these systems can be challenging to replace, they can become obstacles to digital transformation in the long run. Intelligent automation can offer a solution for businesses that want to integrate their legacy systems with modern applications without developing specialized integration solutions. Computer vision-enabled bots can:

  • Connect to different types of software including legacy and modern cloud applications,
  • Interact with GUI elements,
  • Extract and migrate data between applications.

3. Handwriting recognition

Figure 1. Cursive handwriting is hard to recognize.

Although we have optical character recognition (OCR) that can recognize text printed in different fonts since the 70s2, recognizing handwriting is still a challenge for machines as:

  • Handwriting varies greatly among individuals,
  • An individual’s handwriting style can even change over time,
  • The handwriting might be cursive or skewed, which makes identification difficult (Figure 1).

Neural network-based computer vision models can achieve 99%3 handwriting text recognition accuracy. Leveraging these models, intelligent bots can digitize handwritten documents in industries such as:

  • Healthcare: Prescriptions, patient forms
  • Financial services: Cheques, KYC documents, money transfer receipts
  • Insurance: Claim documents, accident reports

4. Insurance claims automation

Efficient claims processing is important for insurance companies as:

  • Claims processing accounts for 70%

Combining RPA and computer vision can improve insurance claims processing. For example, when an insurance company receives a claim for car damage, an intelligent bot can:

  • Guide the insured to take photos or videos of the damage using conversational AI,
  • Analyze the visual data provided by the customer,
  • Generate a report to be used by the insurance company to determine the extent of the damage, decide on the claim, and prevent inflated claims.

Bots with computer vision capabilities can also be used to verify the identity of claimants. This is important in cases where fraud is suspected. Bots can extract information from ID documents and compare images to verify a customer’s identity and help insurance companies avoid paying out fraudulent claims to non-existent customers and entities.

5. Banking customer onboarding

Figure 2. COVID-19’s impact on the use of digital channels in banking. Source: BCG

When it comes to customer onboarding, banks are under pressure to provide a fast, convenient, and compliant experience as:

  • The COVID-19 pandemic has accelerated the shift to digital channels for consumers, such as mobile and online banking (Figure 2).
  • The average rate of customer attrition due to onboarding issues is between 25%

Banks can leverage intelligent automation to automate the know your customer (KYC) process for faster and compliant customer onboarding. Intelligent bots can:

  • Capture data from documents such as ID cards, driver’s licenses, or utility bills using OCR. This data can then be automatically entered into the bank’s customer information system, reducing the need for manual data entry.
  • Verify the identity of applicants by comparing their facial features to those on ID documents. Facial recognition can prevent fraud and improve the accuracy of KYC checks.

If you want to get started with cognitive automation, you can check our in-depth article on intelligent automation tools. If you have other questions, feel free to ask:

Find the Right Vendors
Cem Dilmegani
Principal Analyst

Cem is the principal analyst at AIMultiple since 2017. AIMultiple informs hundreds of thousands of businesses (as per Similarweb) including 60% of Fortune 500 every month.

Cem's work focuses on how enterprises can leverage new technologies in AI, automation, cybersecurity(including network security, application security), data collection including web data collection and process intelligence.

Cem's work has been cited by leading global publications including Business Insider, Forbes, Washington Post, global firms like Deloitte, HPE, NGOs like World Economic Forum and supranational organizations like European Commission. You can see more reputable companies and media that referenced AIMultiple.

Cem's hands-on enterprise software experience contributes to the insights that he generates. He oversees AIMultiple benchmarks in dynamic application security testing (DAST), data loss prevention (DLP), email marketing and web data collection. Other AIMultiple industry analysts and tech team support Cem in designing, running and evaluating benchmarks.

Throughout his career, Cem served as a tech consultant, tech buyer and tech entrepreneur. He advised enterprises on their technology decisions at McKinsey & Company and Altman Solon for more than a decade. He also published a McKinsey report on digitalization.

He led technology strategy and procurement of a telco while reporting to the CEO. He has also led commercial growth of deep tech company Hypatos that reached a 7 digit annual recurring revenue and a 9 digit valuation from 0 within 2 years. Cem's work in Hypatos was covered by leading technology publications like TechCrunch and Business Insider.

Cem regularly speaks at international technology conferences. He graduated from Bogazici University as a computer engineer and holds an MBA from Columbia Business School.

Sources: Traffic Analytics, Ranking & Audience, Similarweb.
Why Microsoft, IBM, and Google Are Ramping up Efforts on AI Ethics, Business Insider.
Microsoft invests $1 billion in OpenAI to pursue artificial intelligence that’s smarter than we are, Washington Post.
Data management barriers to AI success, Deloitte.
Empowering AI Leadership: AI C-Suite Toolkit, World Economic Forum.
Science, Research and Innovation Performance of the EU, European Commission.
Public-sector digitization: The trillion-dollar challenge, McKinsey & Company.
Hypatos gets $11.8M for a deep learning approach to document processing, TechCrunch.
We got an exclusive look at the pitch deck AI startup Hypatos used to raise $11 million, Business Insider.

To stay up-to-date on B2B tech & accelerate your enterprise:

Follow on

Next to Read


Your email address will not be published. All fields are required.