Log In Sign Up

puydufou.com
robots.txt

Robots Exclusion Standard data for puydufou.com

Resource Scan

Scan Details

Site Domain puydufou.com
Base Domain puydufou.com
Scan Status Ok
Last Scan2024-05-06T23:56:09+00:00
Next Scan 2024-05-20T23:56:09+00:00

Last Scan

Scanned2024-05-06T23:56:09+00:00
URL https://puydufou.com/robots.txt
Domain IPs 108.157.254.10, 108.157.254.12, 108.157.254.58, 108.157.254.6
Response IP 108.157.254.12
Found Yes
Hash c9252bedff04695e4341d557153155b99b7bf218a607f4b2118f6657a7a16007
SimHash b5493c83ced4

Groups

*

Rule Path
Allow /france/core/*.css$
Allow /france/core/*.css?
Allow /france/core/*.js$
Allow /france/core/*.js?
Allow /france/core/*.gif
Allow /france/core/*.jpg
Allow /france/core/*.jpeg
Allow /france/core/*.png
Allow /france/core/*.svg
Allow /france/profiles/*.css$
Allow /france/profiles/*.css?
Allow /france/profiles/*.js$
Allow /france/profiles/*.js?
Allow /france/profiles/*.gif
Allow /france/profiles/*.jpg
Allow /france/profiles/*.jpeg
Allow /france/profiles/*.png
Allow /france/profiles/*.svg
Allow /espana/core/*.css$
Allow /espana/core/*.css?
Allow /espana/core/*.js$
Allow /espana/core/*.js?
Allow /espana/core/*.gif
Allow /espana/core/*.jpg
Allow /espana/core/*.jpeg
Allow /espana/core/*.png
Allow /espana/core/*.svg
Allow /espana/profiles/*.css$
Allow /espana/profiles/*.css?
Allow /espana/profiles/*.js$
Allow /espana/profiles/*.js?
Allow /espana/profiles/*.gif
Allow /espana/profiles/*.jpg
Allow /espana/profiles/*.jpeg
Allow /espana/profiles/*.png
Allow /espana/profiles/*.svg
Disallow /france/core/
Disallow /france/profiles/
Disallow /espana/core/
Disallow /espana/profiles/
Disallow /france/README.txt
Disallow /france/web.config
Disallow /france/admin/
Disallow /france/comment/reply/
Disallow /france/filter/tips/
Disallow /france/node/add/
Disallow /france/search/
Disallow /france/user/register/
Disallow /france/user/password/
Disallow /france/user/login/
Disallow /france/user/logout/
Disallow /france/fr/user/register/
Disallow /france/fr/user/password/
Disallow /france/fr/user/login/
Disallow /france/fr/user/logout/
Disallow /espana/admin/
Disallow /espana/comment/reply/
Disallow /espana/filter/tips/
Disallow /espana/node/add/
Disallow /espana/search/
Disallow /espana/user/register/
Disallow /espana/user/password/
Disallow /espana/user/login/
Disallow /espana/user/logout/
Disallow /espana/fr/user/register/
Disallow /espana/fr/user/password/
Disallow /espana/fr/user/login/
Disallow /espana/fr/user/logout/
Disallow /france/index.php/admin/
Disallow /france/index.php/comment/reply/
Disallow /france/index.php/filter/tips/
Disallow /france/index.php/node/add/
Disallow /france/index.php/search/
Disallow /france/index.php/user/password/
Disallow /france/index.php/user/register/
Disallow /france/index.php/user/login/
Disallow /france/index.php/user/logout/
Disallow /espana/index.php/admin/
Disallow /espana/index.php/comment/reply/
Disallow /espana/index.php/filter/tips/
Disallow /espana/index.php/node/add/
Disallow /espana/index.php/search/
Disallow /espana/index.php/user/password/
Disallow /espana/index.php/user/register/
Disallow /espana/index.php/user/login/
Disallow /espana/index.php/user/logout/
Disallow /fonts/
Disallow /images/
Disallow /js/
Disallow /videos/

*

Rule Path
Disallow /*?text=

noxtrumbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /

orthogaffe

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

googlebot

Rule Path
Allow /*.css$
Allow /*.js$
Back to top

Other Records

Field Value
sitemap https://www.puydufou.com/france/fr/sitemap.xml
sitemap https://www.puydufou.com/france/en/sitemap.xml
sitemap https://www.puydufou.com/france/es/sitemap.xml
sitemap https://www.puydufou.com/france/de/sitemap.xml
sitemap https://www.puydufou.com/france/nl/sitemap.xml
sitemap https://www.puydufou.com/france/ru/sitemap.xml
sitemap https://www.puydufou.com/france/zh-hant/sitemap.xml
Back to top

Comments

  • ROBOTS.TXT
  • PUY DU FOU
  • CSS, JS, Images
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • Landing Page
  • Bloqueo de busquedas
  • Blocage de la recherche
  • Ralentizamos algunos bots que se suelen volver locos
  • Ralentir certains bots
  • Bloqueo de bots y crawlers poco utiles
  • Bloquer les bots peu utiles
  • Previene problemas de recursos bloqueados en Google Webmaster Tools
  • Empêcher les problèmes de verrouillage des ressources dans Google Webmaster Tools
Back to top