speedwaydigest.com
robots.txt
Robots Exclusion Standard data for speedwaydigest.com
Resource Scan
Scan Details
Site Domain | speedwaydigest.com |
Base Domain | speedwaydigest.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-23T06:11:23+00:00 |
Next Scan | 2024-05-30T06:11:23+00:00 |
Last Successful Scan
Scanned | 2024-04-24T06:10:08+00:00 |
URL | https://speedwaydigest.com/robots.txt |
Domain IPs | 104.21.70.244, 172.67.140.253, 2606:4700:3030::6815:46f4, 2606:4700:3032::ac43:8cfd |
Response IP | 104.21.70.244 |
Found | Yes |
Hash | 573551ec3b4e4a4c35eaee781bcc8f947bcf6da2936194279bb4d77b9d7c6fcb |
SimHash | 48804e504bb0 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Allow | /*.png* |
Allow | /*.jpg* |
Allow | /*.gif* |
Other Records
Field | Value |
---|---|
sitemap | https://speedwaydigest.com/sitemap.xml |
sitemap | https://speedwaydigest.com/sitemap.rss |