rollingworldnews.com
robots.txt

Robots Exclusion Standard data for rollingworldnews.com

Resource Scan

Scan Details

Site Domain rollingworldnews.com
Base Domain rollingworldnews.com
Scan Status Ok
Last Scan2026-02-19T09:17:13+00:00
Next Scan 2026-02-26T09:17:13+00:00

Last Scan

Scanned2026-02-19T09:17:13+00:00
URL https://rollingworldnews.com/robots.txt
Domain IPs 35.219.200.9
Response IP 35.219.200.9
Found Yes
Hash e1f500eddea14bc2f0ca982f86b942e7335665314cb56a1513b71e9e37398afe
SimHash aa142a974761

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /make-me-admin/

Other Records

Field Value
sitemap https://rollingworldnews.com/sitemap.xml

Comments

  • See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • Allow crawling of all content
  • Disallow admin pages