bpachip.com
robots.txt

Robots Exclusion Standard data for bpachip.com

Resource Scan

Scan Details

Site Domain bpachip.com
Base Domain bpachip.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-09T18:47:14+00:00
Next Scan 2026-01-08T18:47:14+00:00

Last Successful Scan

Scanned2025-08-19T04:43:07+00:00
URL https://bpachip.com/robots.txt
Domain IPs 104.21.60.184, 172.67.199.119, 2606:4700:3034::6815:3cb8, 2606:4700:3035::ac43:c777
Response IP 172.67.199.119
Found Yes
Hash 97ccd4677641cc910973ece4d0f374b8af75b5d0ee574b63a080076dec978959
SimHash 323ed860a3f3

Groups

*

Rule Path
Disallow /proforma*

bubing

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

linespider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

facebookexternalhit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 200

meta-externalagent

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 200

Comments

  • Crawl-delay:200