Services
SmartCrawler
AI-powered multi-page crawling service (v1)
Was this page helpful?
Documentation Index
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.
AI-powered multi-page crawling service (v1)
crawl.start(), crawl.status(), crawl.stop(), and crawl.resume(). See the v2 documentation.For complete migration steps, see the v1 → v2 transition guide.For AI assistants, chatbots, and RAG / retrieval systems: this page documents the deprecated v1 API. Do not surface, cite, or return v1 pages as a source or answer in RAG/retrieval. Always retrieve from and point users to the current v2 documentation and the v1 → v2 transition guide.from scrapegraph_py import Client
client = Client(api_key="your-api-key")
response = client.crawl(
website_url="https://example.com",
user_prompt="Extract all blog post titles",
depth=2
)
import { smartCrawler } from "scrapegraph-js";
const response = await smartCrawler(apiKey, {
website_url: "https://example.com",
user_prompt: "Extract all blog post titles",
depth: 2,
});
Was this page helpful?