brocorama.com
robots.txt

Robots Exclusion Standard data for brocorama.com

Resource Scan

Scan Details

Site Domain brocorama.com
Base Domain brocorama.com
Scan Status Ok
Last Scan2024-09-20T20:13:01+00:00
Next Scan 2024-09-27T20:13:01+00:00

Last Scan

Scanned2024-09-20T20:13:01+00:00
URL http://brocorama.com/robots.txt
Redirect http://www.brocorama.com/robots.txt
Redirect Domain www.brocorama.com
Redirect Base brocorama.com
Domain IPs 2001:8d8:100f:f000::2cd, 217.160.0.208
Redirect IPs 2001:8d8:100f:f000::2cd, 217.160.0.208
Response IP 217.160.0.208
Found Yes
Hash 75bcace2451ed48f235df85783d9f230b158be5032fd9e911c070ba29b633af8
SimHash 403ecc72e33b

Groups

*

Rule Path
Allow /

dotbot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 172800

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 172800

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 172800

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 172800

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 172800