lexpansion.lexpress.fr
robots.txt
Robots Exclusion Standard data for lexpansion.lexpress.fr
Resource Scan
Scan Details
Site Domain | lexpansion.lexpress.fr |
Base Domain | lexpress.fr |
Scan Status | Ok |
Last Scan | 2024-05-16T07:34:06+00:00 |
Next Scan | 2024-05-23T07:34:06+00:00 |
Last Scan
Scanned | 2024-05-16T07:34:06+00:00 |
URL | https://lexpansion.lexpress.fr/robots.txt |
Domain IPs | 23.52.171.128, 23.52.171.130, 2600:1413:b000:14::b857:c146, 2600:1413:b000:14::b857:c147 |
Response IP | 42.99.140.219 |
Found | Yes |
Hash | f22c4ac4887dde2a4dd5abe23abb61169877a0fd713a709ca709f0b8fcf16100 |
SimHash | 486dda040346 |
Groups
*
Rule | Path |
---|---|
Disallow | /tiny/ |
Disallow | /includes |
Disallow | /imgs |
Disallow | /imgstat |
Disallow | */pf/api/ |
Disallow | /.well-known/assetlinks.json |
Other Records
Field | Value |
---|---|
sitemap | https://www.lexpress.fr/arc/outboundfeeds/sitemap-news.xml |
sitemap | https://www.lexpress.fr/arc/outboundfeeds/sitemap.xml |