Crawleo Crawler Tutorial: Crawl Websites, Extract HTML & Screenshots
The Crawleo Crawler turns any URL into clean, model-ready data. In this tutorial we crawl real websites, extract both raw HTML and clean Markdown, and capture full-page screenshots using Crawleo's headful, anti-bot browser. You'll see how to set crawl parameters, handle pages that block ordinary scrapers, and get output that's ready to feed straight into an LLM or RAG pipeline.
What you'll learn
- Crawling a website with the Crawleo Crawler API
- Extracting clean HTML and Markdown
- Capturing full-page screenshots
- Reaching pages that block ordinary scrapers
Step-by-step guide
- 1
Copy your Crawleo API key
Get your API key from the Crawleo Dashboard so your crawl requests are authenticated.
- 2
Send your first crawl request
Call the crawl endpoint (or use the Playground) with a target URL. Crawleo loads the page in a real browser and returns the content.
- 3
Extract HTML and Markdown
Choose your output format. Crawleo returns clean Markdown ready for an LLM, and raw HTML when you need the full structure.
- 4
Capture a screenshot
Enable the screenshot option to get a full-page image of the rendered page — useful for archiving, QA, or visual context.
- 5
Crawl an anti-bot site
Point the crawler at a site that normally blocks scrapers. Crawleo's headful, anti-bot browser renders it like a real user and returns the data anyway.
Frequently asked questions
Can Crawleo crawl JavaScript-heavy or protected pages?
Yes. Crawleo uses a real, headful, anti-bot browser, so it renders JavaScript and gets through protections that defeat simple HTTP scrapers — returning clean HTML, Markdown, and screenshots.
Do I need a paid Crawleo plan to follow this tutorial?
No. Crawleo has a free tier that includes credits for search and crawling, so you can complete the entire setup and run real requests without entering a card. Create an account at crawleo.dev, grab your API key, and you're ready.
Where do I get my Crawleo API key?
Sign in at crawleo.dev, open your Dashboard, and copy the API key from the API Keys section. Treat it like a password and store it in an environment variable rather than committing it to source control.
Try it with your own API key
Create a free Crawleo account and follow along — no card required.
