whatsstoday.com
robots.txt
Robots Exclusion Standard data for whatsstoday.com
Resource Scan
Scan Details
Site Domain | whatsstoday.com |
Base Domain | whatsstoday.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 3/27/2025, 4:57:33 PM |
Next Scan | 6/25/2025, 4:57:33 PM |
Last Successful Scan
Scanned | 8/12/2023, 1:57:16 PM |
URL | https://whatsstoday.com/robots.txt |
Domain IPs | 104.21.59.36, 172.67.211.243, 2606:4700:3030::6815:3b24, 2606:4700:3032::ac43:d3f3 |
Response IP | 104.21.59.36 |
Found | Yes |
Hash | 226e78bfe1382ffcfbcca60ca0e78b5b5ce5adad6a279410bb40251c3cc167e8 |
SimHash | 4908c880fd9a |
Groups
*
Rule | Path |
---|---|
Allow | /wp-admin/admin-ajax.php |
Disallow | /wp-admin/ |
*
Rule | Path |
---|---|
Disallow |
Other Records
Field | Value |
---|---|
sitemap | https://whatsstoday.com/sitemap.xml |
sitemap | https://whatsstoday.com/sitemap.rss |
sitemap | https://whatsstoday.com/sitemap_index.xml |
Comments