id immediately; poll GET /api/crawl/:id, fetch page content with GET /api/crawl/:id/pages, or manage the job via the control endpoints.
Request body
Output formats captured for each crawled page. Same shape as the Scrape
formats array.Fetch-time options applied to every page. See the Scrape endpoint.
Example request
Example response
Related
- Poll progress:
GET /api/crawl/:id - Fetch pages:
GET /api/crawl/:id/pages - Stop, resume, or delete: Manage crawl jobs
- Service overview: Crawl