urlwebsite.com
robots.txt
Robots Exclusion Standard data for urlwebsite.com
Resource Scan
Scan Details
| Site Domain | urlwebsite.com |
| Base Domain | urlwebsite.com |
| Scan Status | Ok |
| Last Scan | 2025-09-22T20:33:35+00:00 |
| Next Scan | 2025-09-29T20:33:35+00:00 |
Last Scan
| Scanned | 2025-09-22T20:33:35+00:00 |
| URL | https://urlwebsite.com/robots.txt |
| Domain IPs | 104.21.21.14, 172.67.195.172, 2606:4700:3034::ac43:c3ac, 2606:4700:3035::6815:150e |
| Response IP | 104.21.21.14 |
| Found | Yes |
| Hash | 7bf78cbfc773310c018bd99ec499ffbb2d8a2eab63343bf3468bfaf53792edfe |
| SimHash | 5116c460eb30 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /wp-content/uploads/wpforms/ |