automart.co.za
robots.txt

Robots Exclusion Standard data for automart.co.za

Resource Scan

Scan Details

Site Domain automart.co.za
Base Domain automart.co.za
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-09-22T10:08:14+00:00
Next Scan 2024-10-06T10:08:14+00:00

Last Successful Scan

Scanned2024-09-07T10:06:57+00:00
URL https://automart.co.za/robots.txt
Redirect https://www.automart.co.za/robots.txt
Redirect Domain www.automart.co.za
Redirect Base automart.co.za
Domain IPs 102.133.235.23
Redirect IPs 102.133.235.23
Response IP 102.133.235.23
Found Yes
Hash 47590b81103e1a06fb951dad6f16c260f507a565ccbde1952d044e7a60342798
SimHash 89045a6345b3

Groups

*

Rule Path
Allow /
Disallow /*.rss$
Disallow /*/sort/*

Other Records

Field Value
sitemap https://www.automart.co.za/sitemap.xml