Learn how to anonymously access websites when running web scraping or automation jobs. Improve data throughput and efficiency of bots, and enable access to websites from various geographies.
You can use proxies in your actors or any other application that supports HTTP, HTTPS, and FTP protocols. Apify Proxy monitors the health of your IP pool and intelligently rotates addresses to prevent IP address-based blocking.
You can view your proxy settings and password on the Proxy page in the Apify console.
For pricing information, visit apify.com/proxy.
Web scrapers can rotate the IP addresses they use to access websites. They assign each request a different IP address, which makes it appear like they are all coming from different users. This greatly enhances performance and data throughput.
- Browser – a different IP address is used for each browser.
- HTTP request – a different IP address is used for each request.
Click here to learn more about IP address rotation and our findings on how blocking works.
Sessions allow you to use the same IP address for multiple connections.
To set a new session, pass the
session parameter in your username field when connecting to a proxy. This will serve as the session's ID and an IP address will be assigned to it. To use that IP address in other requests, pass that same session ID in the username field.
The created session will store information such as cookies and can be used to generate browser fingerprints. You can also assign custom user data such as authorization tokens and specific headers.
This parameter is optional. By default, each proxied request is assigned a randomly picked least used IP address.
You can persist your sessions (use the same IP address) by setting the
session parameter in the
username field. This assigns a single IP address to a session ID after you make the first request.
Session IDs represent IP addresses. Therefore, you can manage the IP addresses you use by managing sessions. In cases where you need to keep the same session (e.g. when you need to log in to a website), it is best to keep the same proxy. By assigning an IP address to a session ID, you can use that IP for every request you make.
Google SERP proxies do not support sessions.
Our health check performs an HTTP and HTTPS request with each proxy server every few hours. If a server fails both requests 3 times in a row, it's marked as dead and all user sessions with this server are discarded.
Banned proxies are not considered dead, since they become useable after a while.