cfaomobility.co.za
robots.txt

Robots Exclusion Standard data for cfaomobility.co.za

Resource Scan

Scan Details

Site Domain cfaomobility.co.za
Base Domain cfaomobility.co.za
Scan Status Ok
Last Scan2024-04-09T18:17:47+00:00
Next Scan 2024-05-09T18:17:47+00:00

Last Scan

Scanned2024-04-09T18:17:47+00:00
URL https://www.cfaomobility.co.za/robots.txt
Domain IPs 18.155.68.114, 18.155.68.120, 18.155.68.59, 18.155.68.7, 2600:9000:23d2:2200:5:5eb9:ac00:93a1, 2600:9000:23d2:5800:5:5eb9:ac00:93a1, 2600:9000:23d2:5c00:5:5eb9:ac00:93a1, 2600:9000:23d2:6400:5:5eb9:ac00:93a1, 2600:9000:23d2:7e00:5:5eb9:ac00:93a1, 2600:9000:23d2:d800:5:5eb9:ac00:93a1, 2600:9000:23d2:f200:5:5eb9:ac00:93a1, 2600:9000:23d2:f800:5:5eb9:ac00:93a1
Response IP 18.155.68.114
Found Yes
Hash 8e5730ecbdfa01df5c06a07edea75c4db676443ad864af66f1750297eeb69551
SimHash 891ddb01cd43

Groups

*

Rule Path
Allow /
Disallow */online-deposits/*
Disallow */enquiry/*
Disallow */news/*
Disallow */new-car-variants/*
Disallow */book-a-test-drive/*
Disallow */api/*
Disallow */ajax/*
Disallow */search/*
Disallow *order%3D*
Disallow */vehicle-search/*
Disallow */new-car-configurator/*
Disallow */data-preferences/*
Disallow */online-payments/*

semaltspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.cfaomobility.co.za/sitemap.xml.gz

Comments

  • robots.txt generated at http://www.gforces.co.uk