EN

How to Set Up and Use Web Scraping API | Decodo Product Tutorial

#Proxy
2025-05-23 19:219 min read

Content Introduction

This video provides a comprehensive guide on utilizing the Dakota web scraping API. It begins by navigating the Dakota dashboard to select either the core or advanced scraping plans. Users learn how to set up their scraping configurations, including username, password, and authentication settings. The video explains how to input the target URL, select geolocation, choose HTTP methods, and define successful response codes. Viewers are shown how to send requests and obtain raw HTML responses, with options for export and coding templates in various programming languages. The tutorial also covers saving scraper setups, scheduling future scrapes, and monitoring usage statistics. Lastly, it touches on utilizing API endpoints for integration and accessing additional documentation for more advanced scraping needs.

Key Information

  • To use the web scraping API, start by navigating to the Dakota dashboard and selecting scraping APIs and pricing.
  • Users can choose between advanced and core plans, with the core plan initiating with basic setup steps.
  • In the scraping tab, users will see options including a username, password, and a basic authentication token, which can be regenerated at any time.
  • Users need to specify the target URL, choose a location for proxies, select an HTTP method (GET or POST), and define acceptable HTTP response codes.
  • Once setup is complete, users can send requests and receive raw HTML responses, which can be copied or exported.
  • Advanced scraping setups allow users to select specific templates, enable JavaScript rendering for dynamic pages, and choose between different parameters for headers and cookies.
  • To schedule future scrapes, users can save their scraper and specify how often it should run and the method for data delivery.
  • Dakota scrapers can integrate with an API for asynchronous and bulk requests, and users can monitor their usage via statistics on the dashboard.

Timeline Analysis

Content Keywords

Web Scraping API

To start using the Web Scraping API, navigate to the Dakota dashboard and select Scraping APIs and Pricing. Users can choose between advanced and core plans and set up the scraper with a username, password, and authentication token. Parameters are customizable, including the URL, geographic location, and HTTP methods. The interface allows copying or exporting HTML responses.

Advanced Scraping Setup

The advanced scraping setup involves selecting scraping templates that apply specialized unblocking strategies. Users can enter target URLs, choose between bulk scraping features, and enable JavaScript rendering to scrape dynamic pages. Custom headers, cookies, and status codes can be specified, with all configurations tied to a subscription.

Scheduling Scrapes

Once a scraper template is saved, users can schedule future scrapes by selecting how often to run the scraper and the data delivery method. Turning off scheduling is possible through the toggle feature. The Dakota scrapers can also be integrated via API endpoints, allowing access to traffic statistics and usage.

Traffic Statistics

The usage statistics tab provides data on the number of requests sent, average response times, traffic used, and JavaScript renders during the selected period. For additional integration guides, users are directed to the Decodto YouTube channel and documentation.

Related questions&answers

How do I start using the web scraping API?

To start using the web scraping API, head to the Dakota dashboard and select 'scraping APIs and pricing' from the left side menu.

What plans are available for the web scraping API?

You can choose between advanced and core plans for the web scraping API.

How do I set up the web scraping API?

In the scraper tab, you will see a username, password, and a basic authentication token which you can regenerate anytime.

What should I enter in the URL field?

In the URL field, enter your targeted website you wish to scrape.

What is the default HTTP method for requests?

Get is the default HTTP method for requests, but you can also select post if you want to pass a payload.

How can I manage my scraping requests?

You can copy the raw HTML response to your clipboard or export it as an HTML file. Use the request tab to get requests in multiple programming languages.

How do I save my scraper template?

You can save your scraper by clicking on the three dots button and selecting 'save scraper' in the saved section.

Can I schedule future scrapes?

Yes, you can schedule future scrapes by clicking on the saved scraper and the three dots menu, then choosing 'schedule scraper'.

Where can I track my usage statistics?

You can track your traffic usage by going to the usage statistics tab in the Dakota dashboard.

What languages are available for the web scraping API?

The language or local parameter determines the search page web interface language that you can specify when setting up the API.

More video recommendations