Log In Sign Up

2501.eu
robots.txt

Robots Exclusion Standard data for 2501.eu

Resource Scan

Scan Details

Site Domain 2501.eu
Base Domain 2501.eu
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2026-02-20T07:29:27+00:00
Next Scan 2026-03-06T07:29:27+00:00

Last Successful Scan

Scanned2026-02-03T15:19:17+00:00
URL https://2501.eu/robots.txt
Domain IPs 92.205.173.138
Response IP 92.205.173.138
Found Yes
Hash 21947fcf3d38b1358b9f59d8bf45fedbc0eac9714ee7f0c4b8b5bcf90d02c2d7
SimHash 6a1dc613f681

Groups

googlebot
googlebot-image

Rule Path
Allow /*

googlebot-video

Rule Path
Allow /*

mediapartners-google*

Rule Path
Disallow /*?*
Allow /wp-content/
Allow /tag/
Allow /category/
Allow /*.php$
Allow /*.js$
Allow /*.inc$
Allow /*.css$
Allow /*.gz$
Allow /*.cgi$
Allow /*.wmv$
Allow /*.cgi$
Allow /*.xhtml$
Allow /*.php*
Allow /*.gif$
Allow /*.jpg$
Allow /*.png$
Back to top

Other Records

Field Value
sitemap http://www.2501.eu/sitemap_index.xml
Back to top

Comments

  • disallow all files in these directories
  • Disallow: /Werbeformen/
  • Disallow: /2010
  • Disallow: /2011
  • Disallow: /wp-admin/
  • Disallow: /wp-includes/
  • Disallow: /wp-content/themes/
  • Disallow: /wp-content/plugins/
  • Disallow: /trackback/
  • Disallow: /videos
  • Disallow: /page/
  • Disallow: /category/
  • Disallow: /tag/
  • disallow all files ending with these extensions
  • Disallow: /?*
  • Disallow: /?wptouch*
  • Disallow: /?wptouch
  • Disallow: /?wpmp
  • Disallow: /*.php$
  • Disallow: /*.js$
  • Disallow: /*.inc$
  • Disallow: /*.css$
  • Disallow: /*.gz$
  • Disallow: /*.cgi$
  • Disallow: /*.wmv$
  • Disallow: /*.png$
  • Disallow: /*.gif$
  • Disallow: /*.jpg$
  • Disallow: /*.cgi$
  • Disallow: /*.xhtml$
  • Disallow: /*.php*
  • Disallow: */trackback*
  • Disallow: /wp-*
  • Allow: /wp-content/uploads/
  • allow google image bot to search all images
  • allow adsense bot on entire site
  • disallow archiving site
  • User-agent: ia_archiver
  • Disallow: /
  • disable duggmirror
  • User-agent: duggmirror
  • Disallow: /
  • User-agent: Mediapartners-Google*
  • Disallow:
  • User-agent: MJ12bot
  • Disallow: /
  • User-agent: Slurp
  • Disallow: /
Back to top