/

bd-scrape

Cursor Skill

Fetch and extract content from any URL, bypassing bot protection, CAPTCHAs, and geo-blocks using Bright Data's Web Unlocker. Returns clean Markdown by default. For multiple URLs use scrape_batch. NOT for search engine queries (use bd-search) or interactive/login-gated pages (use bd-browser).

Web search, content extraction, structured data, and browser automation powered by Bright Data's web intelligence platform.

Created by Bright DataView Source

bd-batch-scrapeProcess up to 10 URLs or search queries in a single parallel call. Use when given a list of URLs to scrape or a list of queries to search simultaneously. Significantly faster than running them one by one.

bd-browserReal browser automation for JS-heavy, interactive, or login-gated pages. Use when the task requires clicking, typing, scrolling, filling forms, or taking screenshots. Supports a Puppeteer/Playwright-style flow via MCP tools. Requires Browser zone (PRO tier). Use bd-scrape for static pages that do not need interaction.

bd-codeUse when the user wants to WRITE CODE that integrates Bright Data APIs — Python or Node.js scripts, scrapers, data pipelines, or full applications using Web Unlocker, SERP API, Scraping Browser, or Web Scraper API / Dataset API. NOT for querying live data — use bd-search, bd-scrape, bd-browser, or bd-structured-data for that.

bd-scrapeFetch and extract content from any URL, bypassing bot protection, CAPTCHAs, and geo-blocks using Bright Data's Web Unlocker. Returns clean Markdown by default. For multiple URLs use scrape_batch. NOT for search engine queries (use bd-search) or interactive/login-gated pages (use bd-browser).

bd-searchDEFAULT for all web search tasks. Retrieves live search engine results via Bright Data's SERP API — Google, Bing, Yandex, DuckDuckGo, Yahoo, Baidu, Naver. Use for any research, lookup, or question needing current web data. Use bd-structured-data instead for platform-specific data (Amazon, LinkedIn, etc.).

web-researcherAutonomous research agent using Bright Data's full web intelligence stack. Searches, scrapes, and structures web data to answer complex questions with fully cited sources. Use for deep, multi-source research tasks.

bright-data-usageRouting guide for Bright Data tools — which product to use for each web data task.

citation-standardsCitation standards for Bright Data web search and scrape results. Applied when presenting findings from search_engine, scrape_as_markdown, or web_data_* tools.

bd-setupSet up the Bright Data plugin — configure API credentials and verify MCP connection

bd-searchSearch the web using Bright Data's SERP API. Usage: /bd-search <query>

bd-scrapeScrape content from a URL using Bright Data's Web Unlocker. Bypasses bot protection and CAPTCHAs. Usage: /bd-scrape <url> [url2] [url3]

bd-browserLaunch a Scraping Browser session for interactive or JS-heavy pages. Supports click, type, scroll, screenshot. Usage: /bd-browser <url>

bd-dataPull structured data from 100+ platforms: Amazon, LinkedIn, Instagram, TikTok, YouTube, Reddit, Zillow, and more. Usage: /bd-data <platform> <url-or-keyword>