Crawl API
Automate content extraction from any domain. Simply define the root URL and retrieve the full website content as Markdown, Text, HTML, or JSON files.

- Map entire site structures in one request
- Capture both static and dynamic web content
- Flexible for SEO, AI, and compliance needs
- Integrates with popular dev frameworks and no-code
const options = {
method: 'POST',
headers: {Authorization: 'Bearer ', 'Content-Type': 'application/json'},
body: '[{"url":"https://il.linkedin.com/company/bright-data"}]'
};
fetch('https://api.brightdata.com/datasets/v3/trigger', options)
.then(response => response.json())
.then(response => console.log(response))
.catch(err => console.error(err));
import requests
url = "https://api.brightdata.com/datasets/v3/trigger"
payload = [{"url": "https://il.linkedin.com/company/bright-data"}]
headers = {
"Authorization": "Bearer ",
"Content-Type": "application/json"
}
response = requests.request("POST", url, json=payload, headers=headers)
print(response.text)
Easy to start, easier to scale
-
Choose target domainDefine target URL and connect to the API with a single line of code
-
Send requestEdit crawl parameters and insert your custom logic using Python or JavaScript
-
Get your dataRetrieve website data as Markdown, Text, HTML, or JSON files
Developer-first experience
Quick Start
Custom Collection
Data Parsing
Crawl API pricing
Leading the way in ethical web data collection
Bright Data sets the gold standard in compliance, effectively self-regulating the industry. With transparent operations validated by top security firms, clear peer consent, and pioneering compliance units, we ensure legitimate and safe data collection. Upholding international privacy laws and utilizing tools like BrightBot, we minimize your legal exposure, making partnership with us a strategic move to curtail legal risks and associated costs.
Every 15 minutes, our customers scrape enough data to train ChatGPT from scratch.
API for Seamless Crawl Data Access
Comprehensive, Scalable, and Compliant Crawl Data Extraction
Tailored to your workflow
Get structured data in JSON, NDJSON, or CSV files through Webhook or API delivery.
Built-in infrastructure and unblocking
Get maximum control and flexibility without maintaining proxy and unblocking infrastructure. Easily scrape data from any geo-location while avoiding CAPTCHAs and blocks.
Battle-proven infrastructure
Bright Data’s platform powers over 20,000+ companies worldwide, offering peace of mind with 99.99% uptime, access to 150M+ real user IPs covering 195 countries.
Industry leading compliance
Our privacy practices comply with data protection laws, including the EU data protection regulatory framework, GDPR, and CCPA – respecting requests to exercise privacy rights and more.
Quer saber mais?
Fale com um especialista para discutir as suas necessidades de raspagem de.