Request queues - Introduction

This section describes API endpoints to create, manage, and delete request queues.

Request queue is a storage for a queue of HTTP URLs to crawl, which is typically used for deep crawling of websites where you start with several URLs and then recursively follow links to other pages. The storage supports both breadth-first and depth-first crawling orders.

For more information, see the Request queue documentation.

note

Some of the endpoints do not require the authentication token, the calls are authenticated using the hard-to-guess ID of the queue.