Log In Sign Up

formulaf1.es
robots.txt

Robots Exclusion Standard data for formulaf1.es

Resource Scan

Scan Details

Site Domain formulaf1.es
Base Domain formulaf1.es
Scan Status Ok
Last Scan2024-11-12T03:03:42+00:00
Next Scan 2024-11-19T03:03:42+00:00

Last Scan

Scanned2024-11-12T03:03:42+00:00
URL https://formulaf1.es/robots.txt
Domain IPs 104.21.20.26, 172.67.190.251, 2606:4700:3031::6815:141a, 2606:4700:3033::ac43:befb
Response IP 104.21.20.26
Found Yes
Hash 0cd91cc159e5394557bbc060d8df7d9f117c89583a46952e42dd6d8696fc5704
SimHash 2224774bc5ec

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /2007/0
Disallow /2007/1
Disallow /2008/0
Disallow /2008/1
Disallow /2009/0
Disallow /2009/1
Disallow /2010/0
Disallow /2010/1
Disallow /2011/0
Disallow /2011/1
Disallow /2012/0
Disallow /2012/1
Disallow /2013/0
Disallow /2013/1
Disallow /*.inc$
Disallow /*.gz$
Disallow /*.wmv$
Disallow /*.tar$
Disallow /*.tgz$
Disallow /*.cgi$
Disallow */feed/
Disallow */trackback/
Disallow /*revision*
Disallow /*autosave*
Disallow /foros/usuario/david-2/*
Back to top

Comments

  • This rule means it applies to all user-agents
  • Disallow all directories and files within
  • Disallow: /wp-includes/
  • Disallow all monthly archive pages
  • Disallow all files ending with these extensions
  • Disallow Google from parsing indididual post feeds and trackbacks..
  • Disallow all files with ? in url
  • Disallow: /*?*
  • Disallow: /*?
  • Disallow caotic sitemaps
  • Disallow user david-2 paginated
Back to top