bezdepexpert.guru
robots.txt

Robots Exclusion Standard data for bezdepexpert.guru

Resource Scan

Scan Details

Site Domain bezdepexpert.guru
Base Domain bezdepexpert.guru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-18T14:17:34+00:00
Next Scan 2025-10-19T14:17:34+00:00

Last Successful Scan

Scanned2025-09-18T14:17:30+00:00
URL https://bezdepexpert.guru/robots.txt
Redirect https://bezdepexpert.fun/robots.txt
Redirect Domain bezdepexpert.fun
Redirect Base bezdepexpert.fun
Domain IPs 185.141.192.220
Redirect IPs 104.21.87.244, 172.67.171.133, 2606:4700:3033::6815:57f4, 2606:4700:3035::ac43:ab85
Response IP 172.67.171.133
Found Yes
Hash 2e8c8c5a529f799965c5d6ecf78b26d034f6d499838dfb3acdf573f3beba835d
SimHash ba191d5243c4

Groups

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

*

Rule Path
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /components/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /modules/
Disallow /plugins/
Disallow /tmp/
Disallow /*?

Comments

  • NOTICE: The collection of content and other data on this
  • site through automated means, including any device, tool,
  • or process designed to data mine or scrape content, is
  • prohibited except (1) for the purpose of search engine indexing or
  • artificial intelligence retrieval augmented generation or (2) with express
  • written permission from this site’s operator.
  • To request permission to license our intellectual
  • property and/or other materials, please contact this
  • site’s operator directly.
  • BEGIN Cloudflare Managed content
  • END Cloudflare Managed Content
  • If the Joomla site is installed within a folder
  • eg www.example.com/joomla/ then the robots.txt file
  • MUST be moved to the site root
  • eg www.example.com/robots.txt
  • AND the joomla folder name MUST be prefixed to all of the
  • paths.
  • eg the Disallow rule for the /administrator/ folder MUST
  • be changed to read
  • Disallow: /joomla/administrator/
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/orig.html
  • For syntax checking, see:
  • http://tool.motoricerca.info/robots-checker.phtml

Warnings

  • `clean-param` is not a known field.