cybernetikz.com
robots.txt

Robots Exclusion Standard data for cybernetikz.com

Resource Scan

Scan Details

Site Domain cybernetikz.com
Base Domain cybernetikz.com
Scan Status Ok
Last Scan2025-04-27T21:43:36+00:00
Next Scan 2025-05-27T21:43:36+00:00

Last Scan

Scanned2025-04-27T21:43:36+00:00
URL https://cybernetikz.com/robots.txt
Redirect https://www.cybernetikz.com/robots.txt
Redirect Domain www.cybernetikz.com
Redirect Base cybernetikz.com
Domain IPs 104.21.52.17, 172.67.193.240, 2606:4700:3037::6815:3411, 2606:4700:3037::ac43:c1f0
Redirect IPs 104.21.52.17, 172.67.193.240, 2606:4700:3037::6815:3411, 2606:4700:3037::ac43:c1f0
Response IP 104.21.52.17
Found Yes
Hash 117a267c853a47b5be8dfe5179a6a0e635cf73dc7aebf1ad480cafea837030db
SimHash 61048d118790

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

*

Rule Path
Disallow /accounts

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.cybernetikz.com/sitemap.xml

Comments

  • Allow Googlebot full access to the website
  • Allow Googlebot-Image to crawl and index images
  • Block all crawlers from accessing /accounts
  • Allow all other crawlers to access the rest of the site
  • Host
  • Sitemap

Warnings

  • `host` is not a known field.