Log In Sign Up

bestecamping.in
robots.txt

Robots Exclusion Standard data for bestecamping.in

Resource Scan

Scan Details

Site Domain bestecamping.in
Base Domain bestecamping.in
Scan Status Ok
Last Scan2024-11-10T19:24:11+00:00
Next Scan 2024-11-17T19:24:11+00:00

Last Scan

Scanned2024-11-10T19:24:11+00:00
URL https://bestecamping.in/robots.txt
Redirect https://www.bestecamping.in/robots.txt
Redirect Domain www.bestecamping.in
Redirect Base bestecamping.in
Domain IPs 136.144.254.166, 2a01:7c8:d009:40b:5054:ff:feca:da5b
Redirect IPs 136.144.254.166, 2a01:7c8:d009:40b:5054:ff:feca:da5b
Response IP 136.144.254.166
Found Yes
Hash f92b321d63d71ffe158572dca3e1b282ede704014d6930ac4eaa5fe678e7c997
SimHash 4019d0414035

Groups

*

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

jobdiggerspider

Rule Path
Disallow /

expertsearchspider

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

ingrid

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

yahoo! slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20
Back to top