raten.org
robots.txt

Robots Exclusion Standard data for raten.org

Resource Scan

Scan Details

Site Domain raten.org
Base Domain raten.org
Scan Status Ok
Last Scan2024-10-04T02:38:26+00:00
Next Scan 2024-10-11T02:38:26+00:00

Last Scan

Scanned2024-10-04T02:38:26+00:00
URL https://raten.org/robots.txt
Domain IPs 2a00:1169:103:9670::, 92.205.52.152
Response IP 92.205.52.152
Found Yes
Hash 9642c055d3768399d9c91c4622040db36dfd1ed6f606984210a12a66abd88959
SimHash 021c8e18ab10

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /goto/
Disallow /wp-content/cache/cachify/
Disallow /shop/
Disallow /redirect/
Disallow /wp-admin/

strucr
mj12bot
ahrefsbot
seokicks-robot
xovi
searchmetricsbot
backlinkcrawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.raten.org/sitemap_index.xml