freetourrome.com
robots.txt

Robots Exclusion Standard data for freetourrome.com

Resource Scan

Scan Details

Site Domain freetourrome.com
Base Domain freetourrome.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-29T12:41:53+00:00
Next Scan 2025-11-05T12:41:53+00:00

Last Successful Scan

Scanned2025-10-21T11:42:00+00:00
URL https://freetourrome.com/robots.txt
Domain IPs 2a02:4780:84:479e:a33c:4f0c:5d7b:7a12, 2a02:4780:84:8525:759f:315c:8d8b:cbc, 84.32.84.54, 84.32.84.81
Response IP 191.101.228.245
Found Yes
Hash c89c765ec4d89b48b51eeb1da66211fc4496519e611f93993e3b4a31543d5b7c
SimHash 190828828cf3

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php

gptbot

Rule Path
Allow /

ccbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

claudebot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.freetourrome.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK
  • Explicit allow for AI crawlers