nichemarket.co.za
robots.txt
Robots Exclusion Standard data for nichemarket.co.za
Resource Scan
Scan Details
Site Domain | nichemarket.co.za |
Base Domain | nichemarket.co.za |
Scan Status | Ok |
Last Scan | 2024-09-28T09:10:04+00:00 |
Next Scan | 2024-10-05T09:10:04+00:00 |
Last Scan
Scanned | 2024-09-28T09:10:04+00:00 |
URL | https://nichemarket.co.za/robots.txt |
Redirect | https://www.nichemarket.co.za/robots.txt |
Redirect Domain | www.nichemarket.co.za |
Redirect Base | nichemarket.co.za |
Domain IPs | 156.38.214.162 |
Redirect IPs | 156.38.214.162 |
Response IP | 156.38.214.162 |
Found | Yes |
Hash | 24213b02b84fec14a75a3cc7075b6f27214945c39918d849466247ea8fbc25bb |
SimHash | 54098091c497 |
Groups
*
Rule | Path |
---|---|
Disallow | /Admin/ |
Disallow | /Authentication/ |
Disallow | /User/ |
Disallow | /blog-search/ |
Disallow | /page-not-found |
Allow | /Admin/Content/images/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.nichemarket.co.za/sitemap_index.xml |