criticthoughts.com
robots.txt

Robots Exclusion Standard data for criticthoughts.com

Resource Scan

Scan Details

Site Domain criticthoughts.com
Base Domain criticthoughts.com
Scan Status Ok
Last Scan2025-08-13T06:08:45+00:00
Next Scan 2025-09-12T06:08:45+00:00

Last Scan

Scanned2025-08-13T06:08:45+00:00
URL http://criticthoughts.com/robots.txt
Redirect https://www.rajabos.link/robots.txt
Redirect Domain www.rajabos.link
Redirect Base rajabos.link
Domain IPs 192.64.119.191
Redirect IPs 209.74.67.85
Response IP 209.74.67.85
Found Yes
Hash 5013af73d85819d7cbcc3392b70d3de402fd7850ce3082b9e431d9b4609821bf
SimHash 6950cd61c7d3

Groups

*

Rule Path
Disallow /cgi-bin/
Allow /

Other Records

Field Value
sitemap https://www.rajabos.link/sitemap.xml

Warnings

  • `host` is not a known field.