francegenweb.org
robots.txt
Robots Exclusion Standard data for francegenweb.org
Resource Scan
Scan Details
| Site Domain | francegenweb.org |
| Base Domain | francegenweb.org |
| Scan Status | Ok |
| Last Scan | 2024-09-21T04:07:25+00:00 |
| Next Scan | 2024-10-21T04:07:25+00:00 |
Last Scan
| Scanned | 2024-09-21T04:07:25+00:00 |
| URL | https://francegenweb.org/robots.txt |
| Redirect | https://www.francegenweb.org/robots.txt |
| Redirect Domain | www.francegenweb.org |
| Redirect Base | francegenweb.org |
| Domain IPs | 83.166.130.71 |
| Redirect IPs | 83.166.130.71 |
| Response IP | 83.166.130.71 |
| Found | Yes |
| Hash | 3391a8f7382fce257c4240d70b6314252b8e0fb63ba8da47c51c41eac65dcdcc |
| SimHash | b313410a47e2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /2002/ |
| Disallow | /admino/ |
| Disallow | /ajeter/ |
| Disallow | /cgi-bin/ |
| Disallow | /cgi-local/ |
| Disallow | /chat/ |
| Disallow | /coordin/ |
| Disallow | /crypto/ |
| Disallow | /data/ |
| Disallow | /div/ |
| Disallow | /error/ |
| Disallow | /fbeziaud/ |
| Disallow | /gif/ |
| Disallow | /gestion/ |
| Disallow | /gestionnairesFGW/ |
| Disallow | /images/ |
| Disallow | /livor/images/ |
| Disallow | /members/ |
| Disallow | /membres/ |
| Disallow | /newsweb/ |
| Disallow | /pmwiki/ |
| Disallow | /populis/ |
| Disallow | /pub/ |
| Disallow | /sitescgw/00/ |
| Disallow | /sitescgw/000/ |
| Disallow | /temp/ |
| Disallow | /test/ |
| Disallow | /bibliogenweb/ |
| Disallow | /biblio/ |
| Disallow | /biblio2/ |
| Disallow | /biblio3/ |
| Disallow | /~biblio/ |
| Disallow | /~biblio2/ |
| Disallow | /~biblio3/ |
| Disallow | css.php |
| Disallow | css.mp3 |
| Disallow | /*.old$ |
| Disallow | /*.bck$ |
| Disallow | /wikiOLD/ |
| Disallow | /wiki2/ |
| Disallow | /wiki/index.php?diff= |
| Disallow | /wiki/index.php?oldid= |
| Disallow | /wiki/index.php?title=Help |
| Disallow | /wiki/index.php?title=Image |
| Disallow | /wiki/index.php?title=MediaWiki |
| Disallow | /wiki/index.php?title=Special%3A |
| Disallow | /wiki/index.php?title=Template |
| Disallow | /wiki/skins/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Comments