laferte.com
robots.txt
Robots Exclusion Standard data for laferte.com
Resource Scan
Scan Details
Site Domain | laferte.com |
Base Domain | laferte.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-03T23:31:33+00:00 |
Next Scan | 2024-10-17T23:31:33+00:00 |
Last Successful Scan
Scanned | 2024-08-26T23:27:40+00:00 |
URL | https://laferte.com/robots.txt |
Redirect | https://www.laferte.com/robotstxt |
Redirect Domain | www.laferte.com |
Redirect Base | laferte.com |
Domain IPs | 13.107.246.59, 2620:1ec:bdf::59 |
Redirect IPs | 13.107.246.59, 2620:1ec:bdf::59 |
Response IP | 13.107.246.59 |
Found | Yes |
Hash | f6720e24623a04400cf35ee9e8bf17b670159b3a9e0646e39b43b9c79cc3cbd2 |
SimHash | 69544a528431 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /codes-promo |
Disallow | /codes-promo/ |
Disallow | /emplois-2-0 |
Disallow | /emplois-2-0/ |
Disallow | /emplois-2-0/* |
Other Records
Field | Value |
---|---|
sitemap | /sitemap.xml |