classicelitechevysugarland.com
robots.txt

Robots Exclusion Standard data for classicelitechevysugarland.com

Resource Scan

Scan Details

Site Domain classicelitechevysugarland.com
Base Domain classicelitechevysugarland.com
Scan Status Ok
Last Scan2024-06-13T19:05:20+00:00
Next Scan 2024-07-13T19:05:20+00:00

Last Scan

Scanned2024-06-13T19:05:20+00:00
URL https://classicelitechevysugarland.com/robots.txt
Domain IPs 34.120.123.249
Response IP 34.120.123.249
Found Yes
Hash 444348e35dc462b705b4a288717abe6e5471fb8c51776f319ad1c26262db9e10
SimHash 4a5c4c7286e2

Groups

*

Rule Path
Disallow /inventory-feed.*
Disallow /404
Disallow /terms
Disallow /privacy
Disallow /credit-privacy
Disallow /credit-terms
Disallow /inventoryphotos/*
Disallow /inventory/*/start-deal
Disallow /inventory/*/show-deal
Disallow /*.json$
Disallow /*_buildManifest.js$
Disallow /*_middlewareManifest.js$
Disallow /*_ssgManifest.js$
Disallow /*.js$
Allow /_next/static/chunks/pages/*.js$
Allow /_next/static/chunks/*.js$

Other Records

Field Value
crawl-delay 2

dotbot

Rule Path
Disallow /

motominerbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://classicelitechevysugarland.com/sitemap.xml