thisreader.com
robots.txt

Robots Exclusion Standard data for thisreader.com

Resource Scan

Scan Details

Site Domain thisreader.com
Base Domain thisreader.com
Scan Status Ok
Last Scan2025-10-26T13:17:04+00:00
Next Scan 2025-11-02T13:17:04+00:00

Last Scan

Scanned2025-10-26T13:17:04+00:00
URL https://www.thisreader.com/robots.txt
Domain IPs 104.21.28.86, 172.67.170.111, 2606:4700:3033::6815:1c56, 2606:4700:3033::ac43:aa6f
Response IP 172.67.170.111
Found Yes
Hash eb1aa834d5d8ef43a95a6b24b7d5c84cc500c0ddd4517082486301b8416d6955
SimHash 68005e49cb12

Groups

*

Rule Path
Disallow */node/hit
Disallow */site/stat

Other Records

Field Value
sitemap https://www.thisreader.com/sitemap.xml