meilleurduweb.com
robots.txt
Robots Exclusion Standard data for meilleurduweb.com
Resource Scan
Scan Details
Site Domain | meilleurduweb.com |
Base Domain | meilleurduweb.com |
Scan Status | Ok |
Last Scan | 2024-11-02T03:08:00+00:00 |
Next Scan | 2024-11-09T03:08:00+00:00 |
Last Scan
Scanned | 2024-11-02T03:08:00+00:00 |
URL | https://meilleurduweb.com/robots.txt |
Domain IPs | 2001:41d0:1:1b00:213:186:33:2, 213.186.33.2 |
Response IP | 213.186.33.2 |
Found | Yes |
Hash | dc0b183051c62a75b84881680f740d6b84859f899ad4f5d29923adb9a27556d3 |
SimHash | 291b0813c0ba |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /cron/ |
Disallow | /paypal/ |
Disallow | /test/ |
Disallow | /conf/ |
Disallow | /rubriques/out.php* |
Other Records
Field | Value |
---|---|
sitemap | https://meilleurduweb.com/sitemap.xml |