lepaysdumanga.fr
robots.txt

Robots Exclusion Standard data for lepaysdumanga.fr

Resource Scan

Scan Details

Site Domain lepaysdumanga.fr
Base Domain lepaysdumanga.fr
Scan Status Ok
Last Scan2024-09-16T04:54:49+00:00
Next Scan 2024-10-16T04:54:49+00:00

Last Scan

Scanned2024-09-16T04:54:49+00:00
URL https://lepaysdumanga.fr/robots.txt
Redirect https://www.lepaysdumanga.fr/robots.txt
Redirect Domain www.lepaysdumanga.fr
Redirect Base lepaysdumanga.fr
Domain IPs 109.234.160.25
Redirect IPs 109.234.160.25
Response IP 109.234.160.25
Found Yes
Hash 75009a4c2145678d581e8d6bee04c89de99c00d786b0106c2055fe62ffaa57a3
SimHash 2d91d191d5f0

Groups

googlebot
bingbot
msnbot
voilabot
slurp
yahoo-blogs
yahoo-mmcrawler
ia_archiver
ia_archiver(os-wayback)
archive.org_bot
qwantify

Rule Path
Disallow /avatars/
Disallow /img/
Disallow /v3/Packages/
Disallow /v3/Smileys/
Disallow /v3/Sources/
Disallow /v3/Themes/
Disallow /v3/index.php?action=activate*
Disallow /v3/index.php?action=arcade*
Disallow /v3/index.php?action=calendar*
Disallow /v3/index.php?action=login*
Disallow /v3/index.php?action=permissions*
Disallow /v3/index.php?action=pm*
Disallow /v3/index.php?action=printpage*
Disallow /v3/index.php?action=profile*
Disallow /v3/index.php?action=recent*
Disallow /v3/index.php?action=register*
Disallow /v3/index.php?action=reminder*
Disallow /v3/index.php?action=search*
Disallow /v3/index.php?action=stats*
Disallow /v3/index.php?action=who*
Disallow /v3/index.php?PHPSESSID=*
Disallow /v3/index.php?*imode*
Disallow /v3/index.php?*rss*
Disallow /v3/index.php?*wap*
Disallow /v3/index.php?*wap2*
Disallow /v3?*
Disallow /?*
Allow /

urlmetriques

Rule Path
Disallow /

obot

Rule Path
Disallow /

*

Rule Path
Disallow /

Comments

  • allow only important bots