Log In Sign Up

bestecamping.in
robots.txt

Robots Exclusion Standard data for bestecamping.in

Resource Scan

Scan Details

Site Domain bestecamping.in
Base Domain bestecamping.in
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-22T08:41:56+00:00
Next Scan 2024-10-06T08:41:56+00:00

Last Successful Scan

Scanned2024-09-07T08:41:29+00:00
URL https://bestecamping.in/robots.txt
Redirect https://www.bestecamping.in/robots.txt
Redirect Domain www.bestecamping.in
Redirect Base bestecamping.in
Domain IPs 136.144.254.166, 2a01:7c8:d009:40b:5054:ff:feca:da5b
Redirect IPs 136.144.254.166, 2a01:7c8:d009:40b:5054:ff:feca:da5b
Response IP 136.144.254.166
Found Yes
Hash f92b321d63d71ffe158572dca3e1b282ede704014d6930ac4eaa5fe678e7c997
SimHash 4019d0414035

Groups

*

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

jobdiggerspider

Rule Path
Disallow /

expertsearchspider

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

ingrid

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

yahoo! slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20
Back to top