citroen.jp
robots.txt
Robots Exclusion Standard data for citroen.jp
Resource Scan
Scan Details
Site Domain | citroen.jp |
Base Domain | citroen.jp |
Scan Status | Ok |
Last Scan | 2024-09-19T05:07:41+00:00 |
Next Scan | 2024-10-19T05:07:41+00:00 |
Last Scan
Scanned | 2024-09-19T05:07:41+00:00 |
URL | https://citroen.jp/robots.txt |
Redirect | https://www.citroen.jp/robots.txt |
Redirect Domain | www.citroen.jp |
Redirect Base | citroen.jp |
Domain IPs | 217.70.184.55 |
Redirect IPs | 23.215.7.27, 23.215.7.5, 2600:1413:b000:1b::17d7:705, 2600:1413:b000:1b::17d7:71b |
Response IP | 23.32.29.97 |
Found | Yes |
Hash | b42a50e3c356bbad4eaea330879b2a4e32e30b97e2c174b4902278dcfe3924e4 |
SimHash | 69182c0cff9b |
Groups
*
Rule | Path |
---|---|
Disallow | */masterhead-video* |
Disallow | /api/ |
Disallow | /*?id |
Disallow | /*utm_content |
Disallow | /*utm_campaign |
Disallow | /*utm_medium |
Disallow | /*?lcdv |
Disallow | /*?gclsrc |
Disallow | /*?&gclid |
Disallow | /*utm_source |
Other Records
Field | Value |
---|---|
sitemap | https://www.citroen.jp/sitemap.xml |
Warnings
- 3 invalid lines.