thetruestory.news
robots.txt

Robots Exclusion Standard data for thetruestory.news

Resource Scan

Scan Details

Site Domain thetruestory.news
Base Domain thetruestory.news
Scan Status Ok
Last Scan2024-06-02T18:44:05+00:00
Next Scan 2024-06-16T18:44:05+00:00

Last Scan

Scanned2024-06-02T18:44:05+00:00
URL https://thetruestory.news/robots.txt
Domain IPs 18.154.144.48, 18.154.144.49, 18.154.144.63, 18.154.144.76
Response IP 18.165.171.46
Found Yes
Hash 50e31e3f6e8f260bb552c6d3a9343718426a2dc95f9fe200a32064d21f863d6c
SimHash d1b6540be4c4

Groups

*

Rule Path
Disallow /ru/israel/geo/
Disallow /ru/israel/person/
Disallow /ru/israel/category/
Disallow /ru/israel/org/
Disallow /ru/israel/source/
Disallow /en/world/geo/
Disallow /en/world/person/
Disallow /en/world/category/
Disallow /en/world/org/
Disallow /en/world/source/
Disallow /uk/ukraine/geo/
Disallow /uk/ukraine/person/
Disallow /uk/ukraine/category/
Disallow /uk/ukraine/org/
Disallow /uk/ukraine/source/
Disallow /ru/ukraine/geo/
Disallow /ru/ukraine/person/
Disallow /ru/ukraine/category/
Disallow /ru/ukraine/org/
Disallow /ru/ukraine/source/
Disallow /ru/belarus/geo/
Disallow /ru/belarus/person/
Disallow /ru/belarus/category/
Disallow /ru/belarus/org/
Disallow /ru/belarus/source/
Disallow /ru/russia/geo/
Disallow /ru/russia/person/
Disallow /ru/russia/category/
Disallow /ru/russia/org/
Disallow /ru/russia/source/

Comments

  • https://www.robotstxt.org/robotstxt.html