Log In Sign Up

ghost-hostel.com
robots.txt

Robots Exclusion Standard data for ghost-hostel.com

Resource Scan

Scan Details

Site Domain ghost-hostel.com
Base Domain ghost-hostel.com
Scan Status Ok
Last Scan2025-09-12T07:53:33+00:00
Next Scan 2025-10-12T07:53:33+00:00

Last Scan

Scanned2025-09-12T07:53:33+00:00
URL https://ghost-hostel.com/robots.txt
Domain IPs 104.21.80.136, 172.67.183.127, 2606:4700:3031::6815:5088, 2606:4700:3033::ac43:b77f
Response IP 172.67.183.127
Found Yes
Hash da80c1d24799a874c7d14e58badfeba59ab2f7866ed39c3e7051ccc0d5bff369
SimHash 6bbbdc45a893

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/

mail.ru

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 90

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120
Back to top

Other Records

Field Value
sitemap https://ghost-hostel.com/sitemap_index.xml
Back to top