hotelsinghana.com
robots.txt

Robots Exclusion Standard data for hotelsinghana.com

Resource Scan

Scan Details

Site Domain hotelsinghana.com
Base Domain hotelsinghana.com
Scan Status Ok
Last Scan2025-11-25T18:37:10+00:00
Next Scan 2025-12-02T18:37:10+00:00

Last Scan

Scanned2025-11-25T18:37:10+00:00
URL https://hotelsinghana.com/robots.txt
Domain IPs 104.21.51.16, 172.67.217.245, 2606:4700:3033::ac43:d9f5, 2606:4700:3035::6815:3310
Response IP 172.67.217.245
Found Yes
Hash 0322ea1596ecddce7f7cf3611581301c8a38b7475b3731493191aebb01951d95
SimHash 4818ce00e781

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /api/admin/
Disallow /api/
Disallow /*.json$

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

yandexbot

Rule Path
Allow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot-sa

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://hotelsinghana.com/sitemap.xml

Comments

  • Sitemap location
  • Block admin areas
  • Block sensitive areas
  • Allow all major search engines
  • Crawl-delay for aggressive crawlers
  • Block unwanted bots