Skip to main content
Version: 2.7

ApifyCacheStorage

{"content": ["A Scrapy cache storage that uses the Apify KeyValueStore to store responses.\n\nIt can be set as a storage for Scrapy's built-in HttpCacheMiddleware, which caches\nresponses to requests. See HTTPCache middleware settings (prefixed with HTTPCACHE_)\nin the Scrapy documentation for more information. Requires the asyncio Twisted reactor\nto be installed."]}

Index

Methods

close_spider

  • close_spider(_, current_time): None
  • {"content": ["Close the cache storage for a spider."]}


    Parameters

    • _: Spider
    • current_time: int | None = None

    Returns None

open_spider

  • open_spider(spider): None
  • {"content": ["Open the cache storage for a spider."]}


    Parameters

    • spider: Spider

    Returns None

retrieve_response

  • retrieve_response(_, request, current_time): Response | None
  • {"content": ["Retrieve a response from the cache storage."]}


    Parameters

    • _: Spider
    • request: Request
    • current_time: int | None = None

    Returns Response | None

store_response

  • store_response(_, request, response): None
  • {"content": ["Store a response in the cache storage."]}


    Parameters

    • _: Spider
    • request: Request
    • response: Response

    Returns None