nichemarket.co.za
robots.txt

Robots Exclusion Standard data for nichemarket.co.za

Resource Scan

Scan Details

Site Domain nichemarket.co.za
Base Domain nichemarket.co.za
Scan Status Ok
Last Scan2024-09-28T09:10:04+00:00
Next Scan 2024-10-05T09:10:04+00:00

Last Scan

Scanned2024-09-28T09:10:04+00:00
URL https://nichemarket.co.za/robots.txt
Redirect https://www.nichemarket.co.za/robots.txt
Redirect Domain www.nichemarket.co.za
Redirect Base nichemarket.co.za
Domain IPs 156.38.214.162
Redirect IPs 156.38.214.162
Response IP 156.38.214.162
Found Yes
Hash 24213b02b84fec14a75a3cc7075b6f27214945c39918d849466247ea8fbc25bb
SimHash 54098091c497

Groups

*

Rule Path
Disallow /Admin/
Disallow /Authentication/
Disallow /User/
Disallow /blog-search/
Disallow /page-not-found
Allow /Admin/Content/images/

Other Records

Field Value
sitemap https://www.nichemarket.co.za/sitemap_index.xml