ledroitfranco.com
robots.txt
Robots Exclusion Standard data for ledroitfranco.com
Resource Scan
Scan Details
Site Domain | ledroitfranco.com |
Base Domain | ledroitfranco.com |
Scan Status | Ok |
Last Scan | 2024-11-15T13:18:03+00:00 |
Next Scan | 2024-11-22T13:18:03+00:00 |
Last Scan
Scanned | 2024-11-15T13:18:03+00:00 |
URL | https://ledroitfranco.com/robots.txt |
Redirect | https://www.ledroitfranco.com:443/robots.txt |
Redirect Domain | www.ledroitfranco.com |
Redirect Base | ledroitfranco.com |
Domain IPs | 15.197.177.215, 3.33.164.6 |
Redirect IPs | 23.209.46.91, 23.209.46.93, 2600:1413:b000:13::b857:c188, 2600:1413:b000:13::b857:c1a1 |
Response IP | 42.99.140.184 |
Found | Yes |
Hash | 7ea87d36a239845cc0d72ee8da3ca153f7e829c58feffed69489fba705f00f4b |
SimHash | 6a5c59d5f013 |
Groups
*
Rule | Path |
---|---|
Disallow | /recherche* |
Disallow | /article-favori-modifier/ |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | https://www.ledroit.com/arc/outboundfeeds/sitemap-index?outputType=xml |
sitemap | https://www.ledroit.com/arc/outboundfeeds/sitemap-news?outputType=xml |
sitemap | https://www.ledroit.com/arc/outboundfeeds/sitemap/?outputType=xml |