citroen.rs
robots.txt
Robots Exclusion Standard data for citroen.rs
Resource Scan
Scan Details
Site Domain | citroen.rs |
Base Domain | citroen.rs |
Scan Status | Ok |
Last Scan | 2024-11-02T04:26:25+00:00 |
Next Scan | 2024-12-02T04:26:25+00:00 |
Last Scan
Scanned | 2024-11-02T04:26:25+00:00 |
URL | https://citroen.rs/robots.txt |
Redirect | https://www.citroen.rs/robots.txt |
Redirect Domain | www.citroen.rs |
Redirect Base | citroen.rs |
Domain IPs | 217.70.184.55 |
Redirect IPs | 23.32.29.17, 2600:1413:b000:1b::17d7:70a, 2600:1413:b000:1b::17d7:719, 96.17.180.44 |
Response IP | 23.32.29.17 |
Found | Yes |
Hash | b8b532abf0320fe96366a1c8e61f74a5cb88dbc88798351d58c935107ecd902d |
SimHash | 961d6f25cc43 |
Groups
*
Rule | Path |
---|---|
Disallow | *?id=* |
Disallow | *.pdf$ |
Disallow | *?series=* |
Disallow | *?lcdv16=* |
Disallow | */formation-altran |
Disallow | */_/* |
Disallow | *?lcdv=* |
Disallow | *?_ga=* |
Disallow | /dspp/ |
Disallow | *mobile-save-popin* |
Disallow | */popin-* |
Disallow | /library/ |
Disallow | *?pid=* |
Disallow | *?autoplay=* |
Disallow | *?pdv=* |
Disallow | *?grcommercialid=* |
Disallow | *?popin=* |
Disallow | *?energy=* |
Disallow | */module/* |
Disallow | */api/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.citroen.rs/sitemap.xml |
Comments