Log In Sign Up

the451group.com
robots.txt

Robots Exclusion Standard data for the451group.com

Resource Scan

Scan Details

Site Domain the451group.com
Base Domain the451group.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-04-10T08:00:32+00:00
Next Scan 2025-07-09T08:00:32+00:00

Last Successful Scan

Scanned2023-02-27T22:09:43+00:00
URL http://the451group.com/robots.txt
Redirect https://uptimeinstitute.com/robots.txt
Redirect Domain uptimeinstitute.com
Redirect Base uptimeinstitute.com
Domain IPs 104.130.127.180
Redirect IPs 2001:4800:7817:104:be76:4eff:fe04:6d19, 23.253.242.117
Response IP 23.253.242.117
Found Yes
Hash b025172dc6fab62b732e2d6ad3348cc055987ff02de7c949b59e068a5c012712
SimHash a21e95d8c3e5

Groups

*

Rule Path
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /components/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /modules/
Disallow /plugins/
Disallow /tmp/
Disallow *.pdf$

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://uptimeinstitute.com/index.php?option=com_jmap&view=sitemap&format=xml
Back to top

Comments

  • e.g. www.example.com/joomla/ the robots.txt file MUST be
  • moved to the site root at e.g. www.example.com/robots.txt
  • AND the joomla folder name MUST be prefixed to the disallowed
  • path, e.g. the Disallow rule for the /administrator/ folder
  • MUST be changed to read Disallow: /joomla/administrator/
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/orig.html
  • For syntax checking, see:
  • http://tool.motoricerca.info/robots-checker.phtml
  • JSitemap entries
Back to top

Warnings

  • 1 invalid line.
Back to top