classicelitechevysugarland.com
robots.txt
Robots Exclusion Standard data for classicelitechevysugarland.com
Resource Scan
Scan Details
Site Domain | classicelitechevysugarland.com |
Base Domain | classicelitechevysugarland.com |
Scan Status | Ok |
Last Scan | 2024-06-13T19:05:20+00:00 |
Next Scan | 2024-07-13T19:05:20+00:00 |
Last Scan
Scanned | 2024-06-13T19:05:20+00:00 |
URL | https://classicelitechevysugarland.com/robots.txt |
Domain IPs | 34.120.123.249 |
Response IP | 34.120.123.249 |
Found | Yes |
Hash | 444348e35dc462b705b4a288717abe6e5471fb8c51776f319ad1c26262db9e10 |
SimHash | 4a5c4c7286e2 |
Groups
*
Rule | Path |
---|---|
Disallow | /inventory-feed.* |
Disallow | /404 |
Disallow | /terms |
Disallow | /privacy |
Disallow | /credit-privacy |
Disallow | /credit-terms |
Disallow | /inventoryphotos/* |
Disallow | /inventory/*/start-deal |
Disallow | /inventory/*/show-deal |
Disallow | /*.json$ |
Disallow | /*_buildManifest.js$ |
Disallow | /*_middlewareManifest.js$ |
Disallow | /*_ssgManifest.js$ |
Disallow | /*.js$ |
Allow | /_next/static/chunks/pages/*.js$ |
Allow | /_next/static/chunks/*.js$ |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Other Records
Field | Value |
---|---|
sitemap | https://classicelitechevysugarland.com/sitemap.xml |