nageurs.com
robots.txt
Robots Exclusion Standard data for nageurs.com
Resource Scan
Scan Details
Site Domain | nageurs.com |
Base Domain | nageurs.com |
Scan Status | Ok |
Last Scan | 2024-10-07T20:48:42+00:00 |
Next Scan | 2024-11-06T20:48:42+00:00 |
Last Scan
Scanned | 2024-10-07T20:48:42+00:00 |
URL | https://nageurs.com/robots.txt |
Domain IPs | 213.186.33.2 |
Response IP | 213.186.33.2 |
Found | Yes |
Hash | 3c28bbf41ab4060ee509c3500427f6e8fcc5afc54608d79fee4a23c6530ffcce |
SimHash | 4f07cc504191 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /horaires.cgi* |
Disallow | /xmlhoraires.cgi* |
Disallow | /alerte.cgi* |
Disallow | /resume.cgi* |
Disallow | /forums.cgi?edit&* |
Disallow | /tag.cgi* |
Disallow | /fermeture.cgi* |
Disallow | /seances/20* |
Disallow | /ajout_photo* |
Disallow | /modifier* |
Disallow | /images/boutons* |
Disallow | /images/flags* |
Disallow | /christophe/* |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | https://www.nageurs.com/sitemap.xml |