AIMultiple ResearchAIMultiple Research

AIMultiple Proxy & Web Unblocker Benchmark Methodology in '24

AIMultiple aims to help buyers identify the right solution provider for their data collection needs.

AIMultiple’s benchmark will aim to help businesses with technical teams that need to crawl from tens of thousands of pages to millions of pages per month from domains deploying anti-scraping measures. AIMultiple will focus on residential proxies and web unblockers as a solution for such teams.

What will be the guiding principles?

AIMultiple’s benchmark methodology is designed for an objective and transparent assessment. It also explains participation requirements.

What will be benchmarked?

AIMultiple team will first try to get responses using a residential proxy service. When that service fails, the same page will be tried with the web unblocker provided by the same service provider.

Web crawling APIs will not be part of the benchmark.

How will AIMultiple perform the benchmark?

AIMultiple’s proxy benchmark aims to closely match the preferences of proxy buyers. They want a flexible, cost-effective solution. Therefore, AIMultiple will measure these metrics:

Effectiveness

It will be measured by success rate of responses on the target URL set. Target URL set will include a total of 10,000 from 6 websites in these domains:

  • E-commerce
  • Travel:
  • HR
  • Real estate

Success will be determmined by a successful response, (i.e. 200) and a page size that is close to or equal to the page size.

Speed

Average response time and distribution of response times will be measured.

Scalability

The same metrics will be tested with a fixed number of simultaneous connections.

Optional criteria

These criteria may be included in the benchmark as well:

Features

Geo-targeting can be useful to businesses targeting specific locations and testing successful geo-targeting may be part of the benchmark.

Cost

Public cost data published by the vendors will be used to calculate the cost of the benchmark. Vendor’s cost model will also be shared to help buyers compare prices of different vendors.

Customer service

Reviews on B2B review platforms will be analyzed to assess customer satisfaction.

How will the results be published?

They will be published on research.AIMultiple.com. For an example, see residential proxy benchmark.

Participants can receive their detailed URL level results as well as the average results if they decide to sponsor part of the costs of the benchmark.

Reach out to AIMultiple team via email or Linkedin if you would like to participate in the AIMultiple proxy benchmark.

If you have questions or need help in finding vendors, reach out:

Find the Right Vendors
Access Cem's 2 decades of B2B tech experience as a tech consultant, enterprise leader, startup entrepreneur & industry analyst. Leverage insights informing top Fortune 500 every month.
Cem Dilmegani
Principal Analyst
Follow on

Cem Dilmegani
Principal Analyst

Cem has been the principal analyst at AIMultiple since 2017. AIMultiple informs hundreds of thousands of businesses (as per similarWeb) including 60% of Fortune 500 every month.

Cem's work has been cited by leading global publications including Business Insider, Forbes, Washington Post, global firms like Deloitte, HPE, NGOs like World Economic Forum and supranational organizations like European Commission. You can see more reputable companies and media that referenced AIMultiple.

Throughout his career, Cem served as a tech consultant, tech buyer and tech entrepreneur. He advised businesses on their enterprise software, automation, cloud, AI / ML and other technology related decisions at McKinsey & Company and Altman Solon for more than a decade. He also published a McKinsey report on digitalization.

He led technology strategy and procurement of a telco while reporting to the CEO. He has also led commercial growth of deep tech company Hypatos that reached a 7 digit annual recurring revenue and a 9 digit valuation from 0 within 2 years. Cem's work in Hypatos was covered by leading technology publications like TechCrunch and Business Insider.

Cem regularly speaks at international technology conferences. He graduated from Bogazici University as a computer engineer and holds an MBA from Columbia Business School.

To stay up-to-date on B2B tech & accelerate your enterprise:

Follow on

Next to Read

Comments

Your email address will not be published. All fields are required.

0 Comments