todayer.ru
robots.txt
Robots Exclusion Standard data for todayer.ru
Resource Scan
Scan Details
| Site Domain | todayer.ru |
| Base Domain | todayer.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 5/13/2025, 9:26:19 AM |
| Next Scan | 7/12/2025, 9:26:19 AM |
Last Successful Scan
| Scanned | 3/15/2025, 9:13:33 AM |
| URL | https://todayer.ru/robots.txt |
| Domain IPs | 104.21.57.131, 172.67.163.222, 2606:4700:3033::6815:3983, 2606:4700:3035::ac43:a3de |
| Response IP | 172.67.163.222 |
| Found | Yes |
| Hash | 13ad5816d9d9c1441fd325bd2fbcd7fc7e85f298ab14eda7139060f015c239c0 |
| SimHash | 1b045c62e8f0 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /wp-admin/admin-ajax.php |
| Allow | /wp-content/uploads/ |
| Allow | /wp-content/uploads |
| Disallow | /author |
| Disallow | /author/ |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /xmlrpc.php |
| Disallow | /trackback/ |
| Disallow | /trackback |
| Disallow | */trackback |
| Disallow | */trackback/ |
| Disallow | *?replytocom |
| Disallow | /index.php/openid/server |
| Disallow | /wp-json/ |
| Disallow | */tag/* |
| Disallow | */tags/* |
| Disallow | /*term%3D* |
| Disallow | /*taxonomy?* |
| Disallow | /page/* |
| Disallow | /feed/* |
| Disallow | /*blackhole |
| Disallow | /?blackhole |
Other Records
| Field | Value |
|---|---|
| sitemap | https://todayer.ru/sitemap.xml |