m.sgcarmart.com
robots.txt

Robots Exclusion Standard data for m.sgcarmart.com

Resource Scan

Scan Details

Site Domain m.sgcarmart.com
Base Domain sgcarmart.com
Scan Status Ok
Last Scan2024-09-13T13:37:31+00:00
Next Scan 2024-09-27T13:37:31+00:00

Last Scan

Scanned2024-09-13T13:37:31+00:00
URL https://m.sgcarmart.com/robots.txt
Domain IPs 104.18.20.216, 104.18.21.216
Response IP 104.18.21.216
Found Yes
Hash e3530695c4b9e18f3e42cc306edf82610355b511743fe5e54696c098d355cee2
SimHash a135c4ab2747

Groups

ia_archiver

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

psbot

Rule Path
Disallow /

googlebot-desktop

Rule Path
Disallow /includes/
Disallow /components/
Disallow /checkout/
Disallow /used_cars/valuation.php

siteauditbot-desktop

Rule Path
Disallow /includes/
Disallow /components/
Disallow /checkout/
Disallow /used_cars/valuation.php

googlebot-mobile

Rule Path
Disallow /includes/
Disallow /components/
Disallow /checkout/
Disallow /used_cars/valuation.php

siteauditbot-mobile

Rule Path
Disallow /includes/
Disallow /components/
Disallow /checkout/
Disallow /used_cars/valuation.php