Log In Sign Up

eatsmarter.de
robots.txt

Robots Exclusion Standard data for eatsmarter.de

Resource Scan

Scan Details

Site Domain eatsmarter.de
Base Domain eatsmarter.de
Scan Status Ok
Last Scan2024-05-13T23:11:54+00:00
Next Scan 2024-05-20T23:11:54+00:00

Last Scan

Scanned2024-05-13T23:11:54+00:00
URL https://eatsmarter.de/robots.txt
Domain IPs 94.130.145.107
Response IP 94.130.145.107
Found Yes
Hash 4f3dcf2c7002b1f13d07f5ae65dffced93ce465206028ca14010449f160f8115
SimHash 6a649b00e472

Groups

*

Rule Path
Disallow /r4032login
Disallow /includes
Disallow /profiles
Disallow /scripts
Disallow /themes
Disallow /cron.php
Disallow /update.php
Disallow /xmlrpc.php
Disallow /admin
Disallow /filter/tips
Disallow /node/add
Disallow *?q=admin%2F$
Disallow *?q=comment%2Freply%2F$
Disallow *?q=filter%2Ftips%2F$
Disallow *?q=node%2Fadd%2F$
Disallow *?q=search%2F$
Disallow *?q=user%2Fpassword%2F$
Disallow *?q=user%2Fregister%2F$
Disallow *?q=user%2Flogin%2F$
Disallow *?q=user%2Flogout%2F$
Disallow /cdn-cgi/mirage/*

gptbot

Rule Path
Disallow /

pinterest

Rule Path
Disallow /r4032login
Disallow /includes
Disallow /profiles
Disallow /scripts
Disallow /themes
Disallow /cron.php
Disallow /update.php
Disallow /xmlrpc.php
Disallow /admin
Disallow /filter/tips
Disallow /node/add
Disallow *?q=admin%2F$
Disallow *?q=comment%2Freply%2F$
Disallow *?q=filter%2Ftips%2F$
Disallow *?q=node%2Fadd%2F$
Disallow *?q=search%2F$
Disallow *?q=user%2Fpassword%2F$
Disallow *?q=user%2Fregister%2F$
Disallow *?q=user%2Flogin%2F$
Disallow *?q=user%2Flogout%2F$
Disallow /cdn-cgi/mirage/*

Other Records

Field Value
crawl-delay 10

pinterest/0.2 (+https://www.pinterest.com/bot.html)

Rule Path
Disallow /r4032login
Disallow /includes
Disallow /profiles
Disallow /scripts
Disallow /themes
Disallow /cron.php
Disallow /update.php
Disallow /xmlrpc.php
Disallow /admin
Disallow /filter/tips
Disallow /node/add
Disallow *?q=admin%2F$
Disallow *?q=comment%2Freply%2F$
Disallow *?q=filter%2Ftips%2F$
Disallow *?q=node%2Fadd%2F$
Disallow *?q=search%2F$
Disallow *?q=user%2Fpassword%2F$
Disallow *?q=user%2Fregister%2F$
Disallow *?q=user%2Flogin%2F$
Disallow *?q=user%2Flogout%2F$
Disallow /cdn-cgi/mirage/*

Other Records

Field Value
crawl-delay 10

mozilla/5.0 (compatible; pinterestbot/1.0; +https://www.pinterest.com/bot.html)

Rule Path
Disallow /r4032login
Disallow /includes
Disallow /profiles
Disallow /scripts
Disallow /themes
Disallow /cron.php
Disallow /update.php
Disallow /xmlrpc.php
Disallow /admin
Disallow /filter/tips
Disallow /node/add
Disallow *?q=admin%2F$
Disallow *?q=comment%2Freply%2F$
Disallow *?q=filter%2Ftips%2F$
Disallow *?q=node%2Fadd%2F$
Disallow *?q=search%2F$
Disallow *?q=user%2Fpassword%2F$
Disallow *?q=user%2Fregister%2F$
Disallow *?q=user%2Flogin%2F$
Disallow *?q=user%2Flogout%2F$
Disallow /cdn-cgi/mirage/*

Other Records

Field Value
crawl-delay 10

mozilla/5.0 (compatible; pinterestbot/1.0; +http://www.pinterest.com/bot.html)

Rule Path
Disallow /r4032login
Disallow /includes
Disallow /profiles
Disallow /scripts
Disallow /themes
Disallow /cron.php
Disallow /update.php
Disallow /xmlrpc.php
Disallow /admin
Disallow /filter/tips
Disallow /node/add
Disallow *?q=admin%2F$
Disallow *?q=comment%2Freply%2F$
Disallow *?q=filter%2Ftips%2F$
Disallow *?q=node%2Fadd%2F$
Disallow *?q=search%2F$
Disallow *?q=user%2Fpassword%2F$
Disallow *?q=user%2Fregister%2F$
Disallow *?q=user%2Flogin%2F$
Disallow *?q=user%2Flogout%2F$
Disallow /cdn-cgi/mirage/*

Other Records

Field Value
crawl-delay 10

mozilla/5.0 (linux; android 6.0.1; nexus 5x build/mmb29p) applewebkit/537.36 (khtml, like gecko) chrome/41.0.2272.96 mobile safari/537.36 (compatible; pinterestbot/1.0; +https://www.pinterest.com/bot.html)

Rule Path
Disallow /r4032login
Disallow /includes
Disallow /profiles
Disallow /scripts
Disallow /themes
Disallow /cron.php
Disallow /update.php
Disallow /xmlrpc.php
Disallow /admin
Disallow /filter/tips
Disallow /node/add
Disallow *?q=admin%2F$
Disallow *?q=comment%2Freply%2F$
Disallow *?q=filter%2Ftips%2F$
Disallow *?q=node%2Fadd%2F$
Disallow *?q=search%2F$
Disallow *?q=user%2Fpassword%2F$
Disallow *?q=user%2Fregister%2F$
Disallow *?q=user%2Flogin%2F$
Disallow *?q=user%2Flogout%2F$
Disallow /cdn-cgi/mirage/*

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow /r4032login
Disallow /includes
Disallow /profiles
Disallow /scripts
Disallow /themes
Disallow /cron.php
Disallow /update.php
Disallow /xmlrpc.php
Disallow /admin
Disallow /filter/tips
Disallow /node/add
Disallow *?q=admin%2F$
Disallow *?q=comment%2Freply%2F$
Disallow *?q=filter%2Ftips%2F$
Disallow *?q=node%2Fadd%2F$
Disallow *?q=search%2F$
Disallow *?q=user%2Fpassword%2F$
Disallow *?q=user%2Fregister%2F$
Disallow *?q=user%2Flogin%2F$
Disallow *?q=user%2Flogout%2F$
Disallow /cdn-cgi/mirage/*

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://eatsmarter.de/sitemap.xml
Back to top

Comments

  • Rules are valid for all robots
  • General exclusions
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • Crawling problem
  • Block ChatGPT.
  • Set delay for Pinterest bot.
  • General exclusions
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • Crawling problem
  • General exclusions
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • Crawling problem
  • General exclusions
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • Crawling problem
  • General exclusions
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • Crawling problem
  • General exclusions
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • Crawling problem
  • Set delay for Bingbot.
  • General exclusions
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • Crawling problem
Back to top