Skip to main content

Expert scraping with Apify

After learning the basics of actors and Apify, learn to develop pro-level scrapers on the Apify platform with this advanced course.

This course will teach you the nitty gritty of what it takes to build pro-level scrapers with Apify. We recommend that you've at least looked through all of the other courses in the academy prior to taking this one.

Preparations​

Before developing a pro-level Apify scraper, there are some important things you should have at least a bit of knowledge about (knowing the basics of each is enough to continue through this section), as well as some things that you should have installed on your system.

If you've already gone through the Web scraping for beginners course and the first courses of the Apify platform category, you will be more than well equipped to continue on with the lessons in this course.

Crawlee, Apify SDK, and the Apify CLI​

If you're feeling ambitious, you don't need to have any prior experience with Crawlee to get started with this course; however, at least 5-10 minutes of exposure is recommended. If you haven't yet tried out Crawlee, you can refer to this lesson in the Web scraping for beginners course (and ideally follow along). To familiarize yourself with the Apify SDK, you can refer to the Apify Platform category.

The Apify CLI will play a core role in the running and testing of the actor you will build, so if you haven't gotten it installed already, please refer to this short lesson.

Git​

In one of the later lessons, we'll be learning how to integrate our Actor on the Apify platform with a GitHub repository. For this, you'll need to understand at least the basics of Git. Here's a great tutorial to help you get started with Git.

Docker​

Docker is a massive topic on its own, but don't be worried! We only expect you to know and understand the very basics of it, which can be learned about in this short article (10 minute read).

The basics of actors​

Part of this course will be learning more in-depth about actors; however, some basic knowledge is already assumed. If you haven't yet gone through the actors lesson of the Apify platform course, it's highly recommended to at least give it a glance before moving forward.

First up​

First up, we'll be learning in-depth about integrating actors with each other using webhooks.

Each lesson will have a short (and optional) quiz that you can take at home to test your skills and knowledge related to the lesson's content. Some questions have straight factual answers, but some others can have varying opinionated answers.