planetmitsubishi.com
robots.txt
Robots Exclusion Standard data for planetmitsubishi.com
Resource Scan
Scan Details
Site Domain | planetmitsubishi.com |
Base Domain | planetmitsubishi.com |
Scan Status | Ok |
Last Scan | 2025-04-05T13:12:58+00:00 |
Next Scan | 2025-05-05T13:12:58+00:00 |
Last Scan
Scanned | 2025-04-05T13:12:58+00:00 |
URL | https://planetmitsubishi.com/robots.txt |
Domain IPs | 34.107.211.165 |
Response IP | 34.107.211.165 |
Found | Yes |
Hash | 26bc2ecc3cc7299cbd7c5968fc59d8ea6731b78bbe445724f95ee4aa1107d174 |
SimHash | 4a4cdc7026e2 |
Groups
*
Rule | Path |
---|---|
Disallow | /inventory-feed.* |
Disallow | /404 |
Disallow | /terms |
Disallow | /privacy |
Disallow | /credit-privacy |
Disallow | /credit-terms |
Disallow | /inventoryphotos/* |
Disallow | /inventory/*/start-deal |
Disallow | /inventory/*/show-deal |
Disallow | /internal/inventory |
Disallow | /*.json$ |
Disallow | /*_buildManifest.js$ |
Disallow | /*_middlewareManifest.js$ |
Disallow | /*_ssgManifest.js$ |
Disallow | /*.js$ |
Allow | /_next/static/chunks/pages/*.js$ |
Allow | /_next/static/chunks/*.js$ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://planetmitsubishi.com/sitemap.xml |