feat: add Bright Data agents for web intelligence and real-time web data#2104
feat: add Bright Data agents for web intelligence and real-time web data#2104felixLandlord wants to merge 4 commits into
Conversation
- Introduced `brightdata-pro-agent` for advanced web intelligence with 60+ tools for scraping and automation. - Added `brightdata-rapid-agent` for real-time web research using the Bright Data MCP free tier. - Updated documentation to include both agents in the agents' README.
|
🟡 Contributor Reputation Check: MEDIUM risk
Maintainers: please review this contributor before merging. |
🔍 Skill Validator Results✅ All checks passed
Summary
Full validator output |
🔒 PR Risk Scan ResultsScanned 3 changed file(s).
✅ No matching risk patterns were detected in changed files.
|
There was a problem hiding this comment.
Pull request overview
Adds two new GitHub Copilot custom agents that configure and enforce using Bright Data’s MCP server for live web intelligence (Rapid/free tier vs Pro mode), and registers them in the generated agents documentation.
Changes:
- Added a Rapid-mode Bright Data web research agent with a constrained tool workflow and failure-handling guidance.
- Added a Pro-mode Bright Data web intelligence agent including guidance for
web_data_*,extract, andscraping_browser_*tools. - Updated
docs/README.agents.mdto include the two new agents and MCP install links.
Reviewed changes
Copilot reviewed 3 out of 3 changed files in this pull request and generated 3 comments.
| File | Description |
|---|---|
| docs/README.agents.md | Adds the two Bright Data agents to the generated agents table and includes MCP install links. |
| agents/brightdata-rapid-agent.agent.md | Introduces the Rapid (free-tier) Bright Data MCP-backed research agent definition and usage rules. |
| agents/brightdata-pro-agent.agent.md | Introduces the Pro Bright Data MCP-backed web intelligence agent definition and usage rules. |
| @@ -0,0 +1,72 @@ | |||
| --- | |||
| name: brightdata-pro-agent | |||
| | [Brightdata Pro Agent](../agents/brightdata-pro-agent.agent.md)<br />[](https://aka.ms/awesome-copilot/install/agent?url=vscode%3Achat-agent%2Finstall%3Furl%3Dhttps%3A%2F%2Fraw.githubusercontent.com%2Fgithub%2Fawesome-copilot%2Fmain%2Fagents%2Fbrightdata-pro-agent.agent.md)<br />[](https://aka.ms/awesome-copilot/install/agent?url=vscode-insiders%3Achat-agent%2Finstall%3Furl%3Dhttps%3A%2F%2Fraw.githubusercontent.com%2Fgithub%2Fawesome-copilot%2Fmain%2Fagents%2Fbrightdata-pro-agent.agent.md) | Web intelligence via Bright Data MCP Pro — 60+ tools for search, scrape, platform data, and browser automation | [brightdata](https://github.com/mcp/io.github.brightdata/brightdata-mcp)<br />[](https://aka.ms/awesome-copilot/install/mcp-vscode?name=brightdata&config=%7B%22url%22%3A%22https%3A%2F%2Fmcp.brightdata.com%2Fmcp%3Ftoken%3D%24%7B%7B%20secrets.COPILOT_MCP_BRIGHTDATA_TOKEN%20%7D%7D%26pro%3D1%22%2C%22headers%22%3A%7B%22Authorization%22%3A%22Bearer%20%24%7B%7B%20secrets.COPILOT_MCP_BRIGHTDATA_TOKEN%20%7D%7D%22%7D%7D)<br />[](https://aka.ms/awesome-copilot/install/mcp-vscodeinsiders?name=brightdata&config=%7B%22url%22%3A%22https%3A%2F%2Fmcp.brightdata.com%2Fmcp%3Ftoken%3D%24%7B%7B%20secrets.COPILOT_MCP_BRIGHTDATA_TOKEN%20%7D%7D%26pro%3D1%22%2C%22headers%22%3A%7B%22Authorization%22%3A%22Bearer%20%24%7B%7B%20secrets.COPILOT_MCP_BRIGHTDATA_TOKEN%20%7D%7D%22%7D%7D)<br />[](https://aka.ms/awesome-copilot/install/mcp-visualstudio/mcp-install?%7B%22url%22%3A%22https%3A%2F%2Fmcp.brightdata.com%2Fmcp%3Ftoken%3D%24%7B%7B%20secrets.COPILOT_MCP_BRIGHTDATA_TOKEN%20%7D%7D%26pro%3D1%22%2C%22headers%22%3A%7B%22Authorization%22%3A%22Bearer%20%24%7B%7B%20secrets.COPILOT_MCP_BRIGHTDATA_TOKEN%20%7D%7D%22%7D%7D) | | ||
| | [Brightdata Rapid Agent](../agents/brightdata-rapid-agent.agent.md)<br />[](https://aka.ms/awesome-copilot/install/agent?url=vscode%3Achat-agent%2Finstall%3Furl%3Dhttps%3A%2F%2Fraw.githubusercontent.com%2Fgithub%2Fawesome-copilot%2Fmain%2Fagents%2Fbrightdata-rapid-agent.agent.md)<br />[](https://aka.ms/awesome-copilot/install/agent?url=vscode-insiders%3Achat-agent%2Finstall%3Furl%3Dhttps%3A%2F%2Fraw.githubusercontent.com%2Fgithub%2Fawesome-copilot%2Fmain%2Fagents%2Fbrightdata-rapid-agent.agent.md) | Real-time web research via Bright Data MCP (free tier) — search, discover, and scrape | [brightdata](https://github.com/mcp/io.github.brightdata/brightdata-mcp)<br />[](https://aka.ms/awesome-copilot/install/mcp-vscode?name=brightdata&config=%7B%22url%22%3A%22https%3A%2F%2Fmcp.brightdata.com%2Fmcp%3Ftoken%3D%24%7B%7B%20secrets.COPILOT_MCP_BRIGHTDATA_TOKEN%20%7D%7D%22%2C%22headers%22%3A%7B%22Authorization%22%3A%22Bearer%20%24%7B%7B%20secrets.COPILOT_MCP_BRIGHTDATA_TOKEN%20%7D%7D%22%7D%7D)<br />[](https://aka.ms/awesome-copilot/install/mcp-vscodeinsiders?name=brightdata&config=%7B%22url%22%3A%22https%3A%2F%2Fmcp.brightdata.com%2Fmcp%3Ftoken%3D%24%7B%7B%20secrets.COPILOT_MCP_BRIGHTDATA_TOKEN%20%7D%7D%22%2C%22headers%22%3A%7B%22Authorization%22%3A%22Bearer%20%24%7B%7B%20secrets.COPILOT_MCP_BRIGHTDATA_TOKEN%20%7D%7D%22%7D%7D)<br />[](https://aka.ms/awesome-copilot/install/mcp-visualstudio/mcp-install?%7B%22url%22%3A%22https%3A%2F%2Fmcp.brightdata.com%2Fmcp%3Ftoken%3D%24%7B%7B%20secrets.COPILOT_MCP_BRIGHTDATA_TOKEN%20%7D%7D%22%2C%22headers%22%3A%7B%22Authorization%22%3A%22Bearer%20%24%7B%7B%20secrets.COPILOT_MCP_BRIGHTDATA_TOKEN%20%7D%7D%22%7D%7D) | |
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
|
🟡 Contributor Reputation Check: MEDIUM risk
Maintainers: please review this contributor before merging. |
|
🟡 Contributor Reputation Check: MEDIUM risk
Maintainers: please review this contributor before merging. |
|
🟡 Contributor Reputation Check: MEDIUM risk
Maintainers: please review this contributor before merging. |
|
Upon review, this is a little too heavily reliant on a paid service to fit into awesome copilot. |
Pull Request Checklist
npm startand verified thatREADME.mdis up to date.stagedbranch for this pull request.Description
This contribution adds two GitHub Copilot custom agents that connect Copilot to Bright Data's Web MCP server for live web intelligence:
brightdata-rapid-agent— Real-time web research on Bright Data's free tier (5,000 requests/month). Usesdiscover,search_engine,scrape_as_markdown, and batch variants for search and page retrieval.brightdata-pro-agent— Full Bright Data MCP Pro mode with 60+ tools: everything in Rapid plus browser automation (scraping_browser_*), structured platform extractors (web_data_*for Amazon, LinkedIn, X, npm, etc.), andextract.Both agents instruct Copilot to route all live web work exclusively through Bright Data MCP—not built-in web fetch or training data—and to cite tool output with title and URL. Users select the agent manually from the Copilot agent dropdown on github.com/copilot/agents, when assigning issues, in Copilot Chat
/task, or via Copilot CLI (/agentor--agent=).Setup: Add an Agents secret named
COPILOT_MCP_BRIGHTDATA_TOKENwith a Bright Data API token. Requires a paid GitHub Copilot plan (Pro, Pro+, Business, or Enterprise). The Pro agent appends&pro=1to the MCP URL for pay-as-you-go billing; Rapid uses the standard endpoint.Type of Contribution
Additional Notes
Paid service disclosure: Bright Data is a third-party paid service. The Rapid agent works on the free tier (5,000 MCP requests/month); Pro mode is usage-based. Users must create their own Bright Data account and supply their own API token via
COPILOT_MCP_BRIGHTDATA_TOKEN. No credentials are embedded in the agent files.MCP configuration: Agent-level
mcp-serversin the YAML is used by Copilot cloud agent on GitHub.com. Copilot CLI users must configure the Bright Data MCP server locally with/mcp add; repository MCP settings do not carry over to CLI.Testing: Agents were tested on GitHub.com cloud agent and Copilot CLI with live search, scrape, and (Pro) browser automation tasks. Both agents include retry and error-handling instructions for common MCP failures (502, timeout, empty body).
Official references:
By submitting this pull request, I confirm that my contribution abides by the Code of Conduct and will be licensed under the MIT License.