testgroupassessments.com
robots.txt

Robots Exclusion Standard data for testgroupassessments.com

Resource Scan

Scan Details

Site Domain testgroupassessments.com
Base Domain testgroupassessments.com
Scan Status Ok
Last Scan2025-10-08T20:26:37+00:00
Next Scan 2025-10-22T20:26:37+00:00

Last Scan

Scanned2025-10-08T20:26:37+00:00
URL https://testgroupassessments.com/robots.txt
Redirect https://www.testgroup.com/robots.txt
Redirect Domain www.testgroup.com
Redirect Base testgroup.com
Domain IPs 104.21.62.9, 172.67.217.168, 2606:4700:3037::6815:3e09, 2606:4700:3037::ac43:d9a8
Redirect IPs 104.21.78.15, 172.67.214.130, 2606:4700:3034::ac43:d682, 2606:4700:3036::6815:4e0f
Response IP 104.21.78.15
Found Yes
Hash 22dec2932dbcb28ef317b50ba2f79fbbea225549ade107e8050d12508e21978b
SimHash 246d955767e2

Groups

*

Rule Path
Disallow /~/*
Disallow /admin/*
Disallow /csrf
Disallow /edit/*
Disallow /forms/*
Disallow /honeypot

Other Records

Field Value
sitemap https://www.testgroup.com/sitemap.xml

Comments

  • Robots file for TestGroup
  • For all user agents out there (shout out)
  • Path of static version of previous website which should not be accessible for search engines
  • Exclude admin, edit and forms
  • Sitemaps