habitatafrica.co.za
robots.txt
Robots Exclusion Standard data for habitatafrica.co.za
Resource Scan
Scan Details
| Site Domain | habitatafrica.co.za |
| Base Domain | habitatafrica.co.za |
| Scan Status | Ok |
| Last Scan | 2024-06-11T08:40:50+00:00 |
| Next Scan | 2024-07-11T08:40:50+00:00 |
Last Scan
| Scanned | 2024-06-11T08:40:50+00:00 |
| URL | https://habitatafrica.co.za/robots.txt |
| Domain IPs | 156.38.154.14 |
| Response IP | 156.38.154.14 |
| Found | Yes |
| Hash | 68ac66847d5b5aaee6771b2aa04c5204b4faf1952110cf1076a2c8adc43398f4 |
| SimHash | ab405d422313 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /readme.html |
| Disallow | /license.txt |
| Disallow | /xmlrpc.php |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /*?* |
| Disallow | /*? |
| Disallow | /*~* |
| Disallow | /*~ |
qwant
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /feed/ |
| Disallow | /feed/$ |
| Disallow | /comments/feed |
| Disallow | /trackback/ |
| Disallow | /cart/ |
| Disallow | /checkout/ |
| Disallow | /my-account/ |
| Disallow | /*?orderby=price |
| Disallow | /*?orderby=rating |
| Disallow | /*?orderby=date |
| Disallow | /*?orderby=price-desc |
| Disallow | /*?orderby=popularity |
| Disallow | /*?filter |
| Disallow | /*add-to-cart%3D* |
Comments