bgcpartners.com
robots.txt

Robots Exclusion Standard data for bgcpartners.com

Resource Scan

Scan Details

Site Domain bgcpartners.com
Base Domain bgcpartners.com
Scan Status Ok
Last Scan2026-01-21T20:49:30+00:00
Next Scan 2026-02-04T20:49:30+00:00

Last Scan

Scanned2026-01-21T20:49:30+00:00
URL https://bgcpartners.com/robots.txt
Redirect https://www.bgcg.com/robots.txt
Redirect Domain www.bgcg.com
Redirect Base bgcg.com
Domain IPs 148.106.149.1, 148.106.149.2
Redirect IPs 148.106.149.1, 148.106.149.2
Response IP 148.106.149.2
Found Yes
Hash 8dc087835da2bcc2dc2b1dc3b64c6b21ad4b50506be278a55a5d252f1a10a925
SimHash 0814532ac3f3

Groups

blp_bbot/0.1

Rule Path
Disallow /

blp_bbot

Rule Path
Disallow /

psbot/0.1

Rule Path
Disallow /

psbot

Rule Path
Disallow /

exabot/3.0

Rule Path
Disallow /

baiduspider+

Rule Path
Disallow /

yeti

Rule Path
Disallow /

snapbot/1.0

Rule Path
Disallow /

bbot

Rule Path
Disallow /