Log In Sign Up

classickiacarrollton.com
robots.txt

Robots Exclusion Standard data for classickiacarrollton.com

Resource Scan

Scan Details

Site Domain classickiacarrollton.com
Base Domain classickiacarrollton.com
Scan Status Ok
Last Scan2024-11-03T14:40:10+00:00
Next Scan 2024-12-03T14:40:10+00:00

Last Scan

Scanned2024-11-03T14:40:10+00:00
URL https://www.classickiacarrollton.com/robots.txt
Domain IPs 23.215.7.18, 23.215.7.25, 2600:1413:1::1734:ab38, 2600:1413:1::1734:abe0
Response IP 23.32.29.88
Found Yes
Hash ec5751e542f55a95755eafc5e7c0302a55d718c685d7b9e3bc9898c128b012a7
SimHash 4d7eb95fcda9

Groups

imagewalker

Rule Path
Disallow /

gsa-crawler

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

realspider

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow /api/pse/
Disallow /api/legacy/pse/
Disallow /external-catalog-services/
Disallow /tcd/
Disallow /esntial.htm
Disallow /microsite/
Disallow /*ajax.htm$
Disallow /*fragment.htm
Disallow /image/viewer.htm
Disallow /apis/mycars/
Disallow /mycars/
Disallow /reserve-it-now/form.htm
Disallow /contact-form.htm
Disallow /specials/trims.htm
Disallow /inventory-detail/print.htm
Disallow /blog/tags/*
Disallow /used_vehicle_details.htm
Disallow /new_vehicle_details.htm
Disallow /specials.htm
Disallow /parts_order_form.htm
Disallow /build_research.htm
Disallow /parts_center.htm
Disallow /service_center.htm
Disallow /cart.htm
Disallow /certified_specials.htm
Disallow /new_specials.htm
Disallow /departments.htm
Disallow /parts_contact_form.htm
Disallow /new_inventory.htm
Disallow /service_specials.htm
Disallow /featured_vehicles.htm

adsbot-google-mobile

Rule Path
Disallow /api/pse/
Disallow /api/legacy/pse/
Disallow /external-catalog-services/
Disallow /tcd/
Disallow /esntial.htm
Disallow /microsite/
Disallow /*ajax.htm$
Disallow /*fragment.htm
Disallow /image/viewer.htm
Disallow /apis/mycars/
Disallow /mycars/
Disallow /reserve-it-now/form.htm
Disallow /contact-form.htm
Disallow /specials/trims.htm
Disallow /inventory-detail/print.htm
Disallow /blog/tags/*
Disallow /used_vehicle_details.htm
Disallow /new_vehicle_details.htm
Disallow /specials.htm
Disallow /parts_order_form.htm
Disallow /build_research.htm
Disallow /parts_center.htm
Disallow /service_center.htm
Disallow /cart.htm
Disallow /certified_specials.htm
Disallow /new_specials.htm
Disallow /departments.htm
Disallow /parts_contact_form.htm
Disallow /new_inventory.htm
Disallow /service_specials.htm
Disallow /featured_vehicles.htm

mj12bot

Rule Path
Disallow /api/pse/
Disallow /api/legacy/pse/
Disallow /external-catalog-services/
Disallow /tcd/
Disallow /esntial.htm
Disallow /microsite/
Disallow /*ajax.htm$
Disallow /*fragment.htm
Disallow /image/viewer.htm
Disallow /apis/mycars/
Disallow /mycars/
Disallow /reserve-it-now/form.htm
Disallow /contact-form.htm
Disallow /specials/trims.htm
Disallow /inventory-detail/print.htm
Disallow /blog/tags/*
Disallow /used_vehicle_details.htm
Disallow /new_vehicle_details.htm
Disallow /specials.htm
Disallow /parts_order_form.htm
Disallow /build_research.htm
Disallow /parts_center.htm
Disallow /service_center.htm
Disallow /cart.htm
Disallow /certified_specials.htm
Disallow /new_specials.htm
Disallow /departments.htm
Disallow /parts_contact_form.htm
Disallow /new_inventory.htm
Disallow /service_specials.htm
Disallow /featured_vehicles.htm

Other Records

Field Value
crawl-delay 20

slurp

Rule Path
Disallow /api/pse/
Disallow /api/legacy/pse/
Disallow /external-catalog-services/
Disallow /tcd/
Disallow /esntial.htm
Disallow /microsite/
Disallow /*ajax.htm$
Disallow /*fragment.htm
Disallow /image/viewer.htm
Disallow /apis/mycars/
Disallow /mycars/
Disallow /reserve-it-now/form.htm
Disallow /contact-form.htm
Disallow /specials/trims.htm
Disallow /inventory-detail/print.htm
Disallow /blog/tags/*
Disallow /used_vehicle_details.htm
Disallow /new_vehicle_details.htm
Disallow /specials.htm
Disallow /parts_order_form.htm
Disallow /build_research.htm
Disallow /parts_center.htm
Disallow /service_center.htm
Disallow /cart.htm
Disallow /certified_specials.htm
Disallow /new_specials.htm
Disallow /departments.htm
Disallow /parts_contact_form.htm
Disallow /new_inventory.htm
Disallow /service_specials.htm
Disallow /featured_vehicles.htm

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /api/pse/
Disallow /api/legacy/pse/
Disallow /external-catalog-services/
Disallow /tcd/
Disallow /esntial.htm
Disallow /microsite/
Disallow /*ajax.htm$
Disallow /*fragment.htm
Disallow /image/viewer.htm
Disallow /apis/mycars/
Disallow /mycars/
Disallow /reserve-it-now/form.htm
Disallow /contact-form.htm
Disallow /specials/trims.htm
Disallow /inventory-detail/print.htm
Disallow /blog/tags/*
Disallow /used_vehicle_details.htm
Disallow /new_vehicle_details.htm
Disallow /specials.htm
Disallow /parts_order_form.htm
Disallow /build_research.htm
Disallow /parts_center.htm
Disallow /service_center.htm
Disallow /cart.htm
Disallow /certified_specials.htm
Disallow /new_specials.htm
Disallow /departments.htm
Disallow /parts_contact_form.htm
Disallow /new_inventory.htm
Disallow /service_specials.htm
Disallow /featured_vehicles.htm
Back to top

Other Records

Field Value
sitemap https://www.classickiacarrollton.com/sitemap.xml
Back to top