itshouldbefresh.today
robots.txt

Robots Exclusion Standard data for itshouldbefresh.today

Resource Scan

Scan Details

Site Domain itshouldbefresh.today
Base Domain itshouldbefresh.today
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2026-01-15T09:57:51+00:00
Next Scan 2026-04-15T09:57:51+00:00

Last Successful Scan

Scanned2024-03-27T00:27:58+00:00
URL https://itshouldbefresh.today/robots.txt
Redirect http://www.itshouldbefresh.today/robots.txt
Redirect Domain www.itshouldbefresh.today
Redirect Base itshouldbefresh.today
Domain IPs 104.21.21.200, 172.67.200.22, 2606:4700:3033::6815:15c8, 2606:4700:3035::ac43:c816
Redirect IPs 104.21.21.200, 172.67.200.22, 2606:4700:3033::6815:15c8, 2606:4700:3035::ac43:c816
Response IP 172.67.200.22
Found Yes
Hash eb1d0e0c7307cc572120203938ad5885d18586e4964a8ce897847a576e876496
SimHash 41008800cbb3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap http://www.itshouldbefresh.today/sitemap.xml