# Apify documentation

If you're new to Apify, it's great to meet you! Let's get you up to speed with what we do.

Apify is an online cloud platform specializing in web scraping, data extraction and robotic process automation. With Apify, you can easily compare prices of services or generate new leads for your business by extracting structured data from websites. In addition, you can use our tools to automate manual workflows such as filling in forms or uploading files.

This site contains everything you need to know about using Apify, from beginner-friendly [tutorials](/tutorials) for using our ready-made scrapers to information about how to [develop](/actors/development) your own actors, manage your [stored data](/storage) or reduce blocking using [proxies](/proxy).

We are always trying to improve our documentation, so if you have any feedback, please let us know using the **Feedback** button on the right.

## [](#get-started) Get started

Almost everything we do is centered around [actors](/actors). Actors are cloud programs running on the Apify platform that can scrape web pages, process data or automate workflows. You can learn more about actors by checking out their [documentation](/actors).

Once you're familiar with the basics, you can visit [Apify Store](https://apify.com/store) and try some of our ready-made tools such as the **Booking Scraper** ([dtrungtin/booking-scraper](https://apify.com/dtrungtin/booking-scraper)), **SEO Audit Tool** ([drobnikj/seo-audit-tool](https://apify.com/drobnikj/seo-audit-tool)), or the **Google Sheets Import & Export** ([lukaskrivka/google-sheets](https://apify.com/lukaskrivka/google-sheets)) tool.

### [](#tutorials) Tutorials

If you're interested in learning how to scrape websites or automate processes using Apify, visit our [tutorials](/tutorials). They will walk you through the principles of our scraping tools and prepare you for more advanced projects.

To learn how to build your own actor from scratch, you can use the [Apify SDK](https://sdk.apify.com/docs/guides/getting-started). It is a scalable JavaScript/Node.js library tailor-made for data extraction and web automation jobs (not only) with [headless Chrome](https://developers.google.com/web/updates/2017/04/headless-chrome) and [Puppeteer](https://pptr.dev/).

## [](#experienced-users) Experienced users

For everything you need to know about Apify actors such as [development](/actors/development), [running](/actors/running), [publishing](/actors/publishing) or [platform limits](/actors/limits), visit the [**Actors**](/actors) section.

If you're looking to set up recurring events such as actor or task runs, check out the [**Schedules**](/storage) page.

To execute events during your actor runs, you'll need to set up a [**Webhook**](/webhooks).

To learn all about how you can store and manage your data, visit the [**Storage**](/storage) section.


If you're looking to collaborate on a project or just to share your resources with other Apify users, the [**Access rights**](/access-rights) page has what you need. There, you can learn about our organization account and the kind of permissions you can grant for your resources.

The [**API reference**](/api) will guide you through setting up programmatic access to your resources, while the [**JavaScript API client**](/apify-client-js) will make it a breeze to access the API from any JavaScript/Node.js application.

To reduce blocking from the sites you're trying to scrape, use the [**Apify Proxy**](/proxy).

And, last but not least, our [**command-line client**](/cli) will help you to create, develop, run and deploy Apify actors locally.


## [](#external-resources) External resources

*   [**Stack Overflow**](https://stackoverflow.com/questions/tagged/apify) - community questions.
*   [**Help center**](https://help.apify.com/) - examples, tutorials and various tips & tricks.
*   [**Video tutorials**](https://www.youtube.com/apify) - step-by-step video tutorials for beginners.

Anything missing? Please let us know at [support@apify.com](mailto:support@apify.com) or using the **Feedback** button on the right.

Overview of the Apify platform's documentation. Make your first steps in web scraping and automating processes or dive deep into technical reference.

Rf0FORjzzglhH3gJ416MnFaG70f438P8IAQnLCPReU4=

Home

47DEQpj8HBSa+/TImW+5JCeuQeRkm5NMpJWZG3hSuFU=

Step-by-step tutorial that will help you get started with all Apify Scrapers. Learn the foundations of scraping the web with Apify and creating your own actors.

Getting started

Getting started with Apify Scrapers

m9vaN2PzzDK1jbyIAvs6coFyK2HxrCiT7B4hWYvoA+c=

Learn how to scrape a website using Apify's Web Scraper. Build an actor's page function, extract information from a web page and download your data.

Web Scraper

Learn how to scrape a website using Apify's Cheerio Scraper. Build an actor's page function, extract information from a web page and download your data.

Cheerio Scraper

Learn how to scrape a website using Apify's Puppeteer Scraper. Build an actor's page function, extract information from a web page and download your data.

Puppeteer Scraper

GQqUZbTZXWZXGzyLTrY8daJroYQnZfA/VIOoLLE59jI=

Discover Apify's ready-made web scraping and automation tools. Compare Web Scraper, Cheerio Scraper and Puppeteer Scraper to decide which is right for you.

Apify scrapers

/XHyk1PhMK8yAqm/xDZpWRBMjL1elLD2PAHPJa78adk=

Learn how to scrape the web and automate processes with Apify. From beginner guides for using actors to advanced topics like migrations and performance.

Tutorials

SmcVMhc/rRPwSXKWBTU0iVYfGz6b99cXM94rKQXDqtU=

An introduction to the methods you can use to extract data from websites. Analyze web pages for hidden elements to find the most effective approach.

Web scraping techniques

GW6nCZ0OC5mfmBhs237v810i309EWxBBdFD4qBEl2iE=

Explore the basics of web scraping prevention. Get around them with IP address rotation and proxies, emulate browser signatures or shared IP address sessions.

Anti-scraping techniques

Anti-scraping techniques and how to bypass them

GO9AhEJMLnEhX5kUqokAD1dLt1OUulLaoWUcbPn06PE=

All you need to know about extracting structured data from web pages, the protections websites employ to prevent it, and how to bypass them.

Web Scraping 101

Gjxl7oXg0YKXzuJP6lHCL0MoI0xHJnj3cpftRlX8xLQ=

Learn how to make your automated processes more effective. Avoid common RPA pitfalls, future-proof your programs and improve your processes.

Tips and tricks

7ghgXvWrWmzK5IofWrrw6nqvM8vbI1WRZGJgr68Q5sU=

Learn the basics of robotic process automation. Make your processes on the web and other software more efficient by automating repetitive tasks.

Robotic process automation

VPqhvoLSaWn++jTNSj2NEh2r8BDtxTsotFdEKqve9JQ=

A step-by-step monitoring tutorial that shows how you can receive notifications when an actor or task run fails or does not return enough results.

Actor or task run failure

cn4fdEExnSwHLLgR/XBohVOWpbWnhBiOskceFGUyCWg=

A step-by-step monitoring tutorial that shows you how to ensure your data is correctly formatted and unique. Visualize your data using the monitoring dashboard.

Check data quality

5Hd80yCbvNRfyiqQWNnrBD0/CzFiKDUOhcodvnaJBPU=

A step-by-step monitoring tutorial that shows you how to monitor and ensure consistency in named datasets which aggregate data from multiple actors or tasks.

Monitor shared datasets

xRWS1JZZl2Xc7l6OjrLRTlc9Acx8JLkSJvjO0VT45sQ=

A step-by-step monitoring tutorial that shows you how to monitor multiple runs, validate your results and visualize them using the monitoring dashboard.

Monitor multiple tasks

XnnRZqOI7E6dgHsdJKuLe0MjoQofTFyCPvLTDcMkZ3c=

Learn how to check the performance of your actors, tasks and storages. Validate your data and receive notifications when your jobs succeed or fail.

Monitoring

SgjKBP72EBa6tzjtXFSxLIzqUPbXL2geBBJxsxkzNYo=

Create your first Apify actor using code examples. A step-by-step introduction to web scraping with the Apify platform.

Quick start

hdjOX0NXsZ5RwgEEo9iveV2scjIVlYsLXHJAup1+VrE=

Configure your actor's input parameters using the Apify app, locally or via API. Access parameters in key-value stores from your actor's code.

Input

t/Oh+kb4g6ZdwAuwnCplq3jxe8Emlyi1Er4PTzBcQ8A=

Start your actors from the Apify app or via API. Learn about actor lifecycles, how to specify settings and version, provide input and resurrect finished runs.

Running

sLDtD2xrgh7nwXFuMKcs76WD+52aJqzAmrCJCbA3HiE=

Create custom versions of an actor for specific use cases. Set a task's name and input parameters.

Configure

d6TQvlwys4aLEYRr6jd6z0eD3jK5Z9YbRrLB3iDf3xE=

Learn how to set up reusable versions of your actors for specific use cases.

Create

S87dynVsMwG52LgS79qb/FKw8BQ1iWbFSHFFi1BXlvo=

Start your actor tasks from the Apify app or via API.

8rzw7exASJlANvytYsIVXV0mPnQq1k11yo2ZzOhuCl4=

Set up configurations of your Apify actors for simplified usage. Create multiple configurations of the same actor tailored to various use cases.

Tasks

haV31b5XZaHp5YimWCyLZawTrV1KObIiTs9dxFyLUyk=

Apify's conventions for actor build numbers. Learn to use a specific version of your actor in a run, understand an actor's lifecycle and manage its cache.

Builds

p8TYQel2zLO3KFfwEcWZjwfMqSEPdyC/BAqn+H5BQAM=

Learn how to provide your actor with context that determines its behavior.

Environment variables

auTeHP7/ab1dpM/Q+dO4OAO2Om0dlxwnahDTb/rod68=

Learn all about an Apify actor's code. Compare deployment options, create a custom Dockerfile, set environment variables and metamorph your actor.

Source code

LspdNqk99R6hNBUCQyaR4IxMXbJSRmV7aqw68Swku5U=

Maintain a long-running actor's state to protect from unexpected restarts. See a code example on how to protect your run in case of server shutdown.

State persistence

PHULHnxQvLhfLlwPoOyjfdizORU0CynqIMbfFwtD0Jo=

Learn how to define and easily validate a schema for your actor's input with code examples. Provide an autogenerated input UI to your actor's users.

Input schema

UGu0V5+N7lwMC2u0t5smvU6OWVbl3SxlwbDUDFcZi88=

Learn about the Docker images you can use as your actor's base. Choose the correct base image for your actor's type and requirements.

Base Docker images

9EROvX5Mrfe+pYTdG8yL0WpLnf/aNROHVfHVi8u4NrE=

Read about the technical part of building Apify actors. Learn to define actor inputs, build new versions, persist actor state and choose base Docker images.

Development

5yBYwebrjpiiUc0dSGP2vb8QThQH60u9LMG7xcTjAMc=

Apify's standards for actor naming. Learn how to choose the right name for scraping and non-scraping actors and how to optimize your actor for search engines.

Naming your actor

gd6JDIYJESLw1B06Tg6kDcLNv+gST9FI5mDo1qPqJQI=

Optimize your actors to get more relevant visits from Google and other search engines. Set search engine-friendly actor name, title and description examples.

SEO for actors

Ouytpd/3wsTXT6BHL0MpQ/JC5MDvba7PvMHZMyPHbRk=

Learn how to make your actor available to the public or keep it private. Prepare your actor for Apify Store with a description and README file.

Publishing

1JQlRQKYYnhcBMng9Ho+KRQQvh1k8QDH7dr+jl9+1sk=

Learn more about Apify's security practices and data protection measures.

Security

Zec7v/RKM31JENADfka6icpgFTOTjrKlUHI1uM6DtSk=

Learn the Apify platform's resource capability and limitations such as max memory, disk size and number of actors/tasks per user or schedule.

Limits

R04YPQA/seFALnBpat183ofD8vSoO2J9Z1Phj2yuxKQ=

Discover the Apify platform's various features. This page contains introductory code for building actors, Dockerfiles and persisting your actor's state.

Examples

WAVoQICVogn6Nhu1jv0RjfCoZ+VerBLcoh0AniT+/2c=

Learn how to develop, run and share serverless cloud programs. Create your own web scraping and automation tools and publish them on the Apify platform.

Actors

Z/FkZY34iBJe4Rix81PYtjOfGP88H4RxYxnXJCI3xj4=

Learn how to automatically start your actor and task runs and the basics of *cron* expressions. Set up and manage your schedules from the Apify app or via API.

Schedules

NoqFxs9zcXOfoIamX0dqeuptusho2C0EQarqAWxIciU=

Store and export web scraping, crawling or data processing job results. Learn how to access and manage datasets in the Apify app or via API.

Dataset

2SYp5PnyiCMW7G3HqAT3ufWi7Udb4HkAiI6svZS7YfY=

Store anything from actor or task run results JSON documents or images. Learn how to access and manage key-value stores from the Apify app or via API.

Key-value store

nNYrRI8zyzhTfgLwNQQLsH+T8CqaXwRLakMiPQG1BM4=

Queue URLs for an actor to visit in its run. Learn how to share your queues between actor runs. Access and manage request queues from the Apify app or via API.

Request queue

DG8xFqPxmkKpeMU5SibkFi/YDRREghKQn94wBc2jCo0=

Store anything from images and key-value pairs to structured output data. Learn how to access and manage your stored data from the Apify platform or via API.

Storage

G1pZKsAd+8XJuDp84rOfjypDhcqXWQovviiyLoTk2rQ=

Learn how to connect your application to Apify Proxy. See the required parameters such as the correct username and password.

Connection settings

susnIIxfk7IVGQE22TY2c6mkUC63tlpNkysxpgoCO1Q=

Learn how to connect to Apify's datacenter proxies from your application with Node.js (axios and got), Python 2 and 3 and PHP using code examples.

8+Q50DVqlp6IduZS2ZXNSyve2jf7vRinQo6YXhpwLaQ=

Learn how to reduce blocking when web scraping using IP address rotation. See proxy parameters and learn to implement Apify Proxy in an application.

Datacenter proxy

m+WiaceUXhh/jGnWVRO4OPEKnCVAAXkz15Dw9GSAPaA=

Helpful tips for using your application with Apify's residential proxies. Control traffic, deal with interrupted connections and manage expenses.

Ek0ahxbwMQpKV5K7yksvoOhBupROkaI9teldCcOK044=

Achieve a higher level of anonymity using real IP addresses. Access a wider pool of proxies and reduce blocking by websites' anti-scraping measures.

Residential proxy

hTsbcwWHVw+47GWSH5tMVYH9JjgkWyWd7E9BEBbXur8=

Learn how to connect to Google SERP proxies from your applications with Node.js (axios and got), Python 2 and 3 and PHP using code examples.

mZbYzZL2Qh9onjiz7tebUSurlKRndVPY3PMOBaJ3EjQ=

Learn how to collect search results from Google Search-powered tools. Get search results from localized domains in multiple countries, e.g. the US and Germany.

Google SERP proxy

Om8qNXlGkYNxiDYHv+MdFvaiBiYWq0xGcqBh4cYpEhY=

Useful tips for debugging applications that use Apify Proxy. Check the status of your proxies and view information about the client IP address.

Troubleshooting

bENK6LQoIUFq5tHwRkhYpETLycTzPEEwu2uGwr4Z0w8=

Learn how to anonymously access websites when running web scraping or automation jobs. Prevent IP address-based blocking using IP address rotation.

Proxy

O0juD9aPRsi9SZj/UD1rd+MdXeJSJI51BYOL2Y3CJ1g=

Specify the types of events that trigger a webhook in an actor or task run. Trigger an action on actor or task run creation, success or failure.

Events

MfxLIXpn7cnh112PIP3F9JsXQVPuWYklUtMVtgyve+A=

Send a notification when a specific event occurs in your actor or task run. Dynamically add data to the notification payload when sending the notification.

Actions

vQW7QIts1nzeOlcXRjL2T7sRR6SeIiCHa3oXvL7L+5g=

Learn how to set one-off webhooks for actor runs started via the Apify API or from the actor's code. Trigger the event once the run reaches a desired state.

Ad hoc webhooks

yZDQCzNv8M1G1sTD/72XdAol2oyN48bLKY2vDm/psf4=

Learn how to integrate multiple Apify actors or external systems with your actor or task run. Send alerts when your actor run succeeds or fails.

Webhooks

vGh+xO+yogoOMt4i4SYC5SCHt7SVH5goiRtXgj0HaUI=

Configure your organization account by inviting new members and assigning their roles. Manage team members' access permissions to the organization's resources.

Setup

F5a+jlLeJiaHdYBnbRwm6d4k01LqyiirGX6eOK6x1Ts=

Learn to use and manage your organization account using the Apify app or API. View the organizations you are in and manage your memberships.

How to use

3ZCFEl72MLcyJK60aH9cCg+JvrBGuoPG+5eX/CwN6cY=

Create a specialized account for your organization to encourage collaboration and manage permissions efficiently. Convert an existing account or create one from scratch.

Organization account

8VMHCw0IIaMLSQUdkU4M5JOd6SLL7dKAEjJY5b6GztI=

Learn about the access rights you can grant to other users. See a list of all access options for Apify resources such as actors, actor runs/tasks and storage.

List of permissions

7r+IoYov5vTv4TGI/Rcx2u1NVwaRSI5m0VuWSiqSTfc=

Manage permissions for organizations or private resources such as actors, actor runs and storages. Allow other users to read, run, modify or build new versions.

Access rights

daEdpEyAJIa8b2VkCqSKcw8PaExcB6Qro80XNes/sHA=

Manage, build and run actors, access and manage your storages with the Apify REST API (v2). Test API endpoints and create URL requests using the Blueprint GUI.

API reference

Simplified access to the Apify API from any JavaScript or Node.js application. Manage your actors, tasks and storage via API with the apify-client NPM package.

JavaScript API client

AbpHGcgLb+kRsJGnwFEktk7uzpZOCcBY74+YBdrKVGs=

Create new actors from your computer's command line. Run actors locally or deploy them to the Apify platform. View the Apify CLI's command reference.

Command-line interface

Develop web scraping and automation tools using JavaScript/Node.js and headless Chrome and Puppeteer. Build Apify actors locally or upload to the Apify cloud.