Log In Sign Up

plantlilies.com
robots.txt

Robots Exclusion Standard data for plantlilies.com

Resource Scan

Scan Details

Site Domain plantlilies.com
Base Domain plantlilies.com
Scan Status Ok
Last Scan2024-09-29T21:17:50+00:00
Next Scan 2024-10-06T21:17:50+00:00

Last Scan

Scanned2024-09-29T21:17:50+00:00
URL https://plantlilies.com/robots.txt
Domain IPs 104.152.169.215
Response IP 104.152.169.215
Found Yes
Hash 227510b9316ec9327b9e2f961a4ab8af0cec811977f33b5bb82eef49255d525c
SimHash 2b324df2cc15

Groups

ninjabot
lycos
yahoo-blogs/v3.9
slurp
baiduspider
psbot
asterias
screaming frog seo spider
seznambot
ahrefsbot
yandex
bingbot
pinterestbot

Rule Path
Disallow /

*

Rule Path
Disallow /*%3D
Disallow /administrator/
Disallow /api/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /components/
Disallow /component/tags/tag/
Disallow /images/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /modules/
Disallow /plugins/
Disallow /tmp/
Disallow /index.php?option=com_content&view=article&id=243
Disallow /index.php?option=com_content&view=article&id=746
Allow /*.js
Allow /*.js$
Allow /*.css
Allow /*.css$
Allow /*.ttf$
Allow /*.woff$
Allow /media/*.js$
Allow /media/*.css$
Allow /media/jui/css/*.css
Allow /modules/*.js
Allow /modules/*.css
Allow /modules/*cookie_script.js
Allow /plugins/*.js
Allow /plugins/*.css
Allow /templates/*.js
Allow /templates/*.css
Allow /templates/*.ttf
Allow /templates/*.woff
Allow /components/*.js
Allow /components/*.css
Allow /component/osmap/?view=xml&id=1&format=xml

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://plantlilies.com/component/osmap/?view=xml&id=1&format=xml
Back to top

Comments

  • BLOCK BOTS LIST BANDWIDTH SUCKERS LIST FIRST IN FILE
  • TO ALLOW ACCESS JUST REMOVE FROM LIST BELOW
  • Sitemap entries
Back to top

Warnings

  • `user agent` is not a known field.
Back to top