be-street.com
robots.txt
Robots Exclusion Standard data for be-street.com
Resource Scan
Scan Details
| Site Domain | be-street.com |
| Base Domain | be-street.com |
| Scan Status | Ok |
| Last Scan | 2024-09-21T06:59:55+00:00 |
| Next Scan | 2024-09-28T06:59:55+00:00 |
Last Scan
| Scanned | 2024-09-21T06:59:55+00:00 |
| URL | https://be-street.com/robots.txt |
| Domain IPs | 104.21.73.213, 172.67.149.230, 2606:4700:3033::6815:49d5, 2606:4700:3037::ac43:95e6 |
| Response IP | 104.21.73.213 |
| Found | Yes |
| Hash | 3a4c2982868f5efb951199efbc8e5d9fb2b2df4af624e824c92d0997b4494b45 |
| SimHash | e844c1628832 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /wp-json/ |
| Disallow | /search |
| Disallow | /cgi-bin |
| Disallow | */trackback/ |
| Disallow | */feed |
| Disallow | */comments/ |
| Disallow | */comment |
| Disallow | */tag/* |
| Disallow | */attachment/* |
| Disallow | /author |
| Disallow | */print/ |
| Disallow | *?print=* |
| Disallow | /xmlrpc.php |
| Disallow | /readme.html |
| Disallow | *?attachment_id= |
| Disallow | *?s= |
| Disallow | *%26s%3D |
| Disallow | /recommends/ |
| Allow | */uploads |
| Allow | /*/*.js |
| Allow | /*/*.css |
| Allow | /*.png |
| Allow | /*.jpg |
| Allow | /*.jpeg |
| Allow | /*.gif |