antiquites-en-france.com
robots.txt
Robots Exclusion Standard data for antiquites-en-france.com
Resource Scan
Scan Details
Site Domain | antiquites-en-france.com |
Base Domain | antiquites-en-france.com |
Scan Status | Ok |
Last Scan | 2024-09-21T00:36:21+00:00 |
Next Scan | 2024-10-21T00:36:21+00:00 |
Last Scan
Scanned | 2024-09-21T00:36:21+00:00 |
URL | https://www.antiquites-en-france.com/robots.txt |
Domain IPs | 2001:41d0:1:1b00:213:186:33:24, 213.186.33.24 |
Response IP | 213.186.33.24 |
Found | Yes |
Hash | 99c4f93b68c257b0139c00c44c9abf15f71388b8085b5615ad971238d5d719f4 |
SimHash | cc12dae8c698 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
*
Rule | Path |
---|---|
Disallow | /map/ |
Disallow | /annuaire/ |
Disallow | /street/ |
Disallow | /buy/ |
Disallow | /contact/ |
Disallow | /contactMember/ |
Disallow | /sendtoFriend/ |
Disallow | /userend.php/ |