s1cars.com
robots.txt

Robots Exclusion Standard data for s1cars.com

Resource Scan

Scan Details

Site Domain s1cars.com
Base Domain s1cars.com
Scan Status Ok
Last Scan2024-09-17T19:10:42+00:00
Next Scan 2024-09-24T19:10:42+00:00

Last Scan

Scanned2024-09-17T19:10:42+00:00
URL https://s1cars.com/robots.txt
Redirect https://www.s1cars.com/robots.txt
Redirect Domain www.s1cars.com
Redirect Base s1cars.com
Domain IPs 93.174.10.120
Redirect IPs 93.174.10.120
Response IP 93.174.10.120
Found Yes
Hash 3f4ddc1d5682d40b7fa3c8ac9494449ea3d336afca4a53ffc6326037afd6ac25
SimHash 886edc778dc1

Groups

trovitbot
nutch
baiduspider

Rule Path
Disallow /

*

Rule Path
Disallow /*.asmx
Disallow /WebServices/
Disallow /*?*notfound=
Disallow /*?*dealerlist=
Disallow /local/
Disallow /localsites/
Disallow /search/
Disallow /Search/
Disallow *?vb*
Disallow /nid*
Disallow /classifieds*
Disallow /ad/
Disallow /handle/stats/
Disallow /gdpr/
Disallow /gdpr

Other Records

Field Value
sitemap https://www.s1cars.com/sitemap/s1xml/sitemap_index.xml