fastquotes.co.za
robots.txt

Robots Exclusion Standard data for fastquotes.co.za

Resource Scan

Scan Details

Site Domain fastquotes.co.za
Base Domain fastquotes.co.za
Scan Status Ok
Last Scan2024-09-29T10:40:04+00:00
Next Scan 2024-10-06T10:40:04+00:00

Last Scan

Scanned2024-09-29T10:40:04+00:00
URL https://fastquotes.co.za/robots.txt
Redirect https://www.fastquotes.co.za/robots.txt
Redirect Domain www.fastquotes.co.za
Redirect Base fastquotes.co.za
Domain IPs 66.147.237.41
Redirect IPs 66.147.237.41
Response IP 66.147.237.41
Found Yes
Hash c18ab74f008da59260580dc3384bef8b9caee06d2d55a9304ccc75096f17c6c0
SimHash 681513945ff3

Groups

facebookexternalhit

Rule Path
Disallow /api/
Allow /

*

Rule Path
Disallow
Disallow /login
Disallow /connect
Disallow /writeareview
Disallow /quote/
Disallow /demand/

googlebot

Rule Path
Allow /quotes/
Allow /demand/

googlebot-mobile

Rule Path
Allow /quotes/
Allow /demand/

msnbot

Rule Path
Disallow /quotes/
Allow /demand/

Other Records

Field Value
sitemap https://www.fastquotes.co.za/pro-sitemaps-4067078.php
sitemap https://a153328.hostedsitemap.com/4067078/sitemap.xml.gz