Log In Sign Up

hypnotek.com
robots.txt

Robots Exclusion Standard data for hypnotek.com

Resource Scan

Scan Details

Site Domain hypnotek.com
Base Domain hypnotek.com
Scan Status Ok
Last Scan2026-01-07T08:43:39+00:00
Next Scan 2026-02-06T08:43:39+00:00

Last Scan

Scanned2026-01-07T08:43:39+00:00
URL https://hypnotek.com/robots.txt
Redirect https://www.hypnotek.com/robots.txt
Redirect Domain www.hypnotek.com
Redirect Base hypnotek.com
Domain IPs 18.155.68.14, 18.155.68.19, 18.155.68.5, 18.155.68.65, 2600:9000:23d2:5e00:10:2c2:4900:93a1, 2600:9000:23d2:800:10:2c2:4900:93a1, 2600:9000:23d2:9400:10:2c2:4900:93a1, 2600:9000:23d2:d200:10:2c2:4900:93a1, 2600:9000:23d2:da00:10:2c2:4900:93a1, 2600:9000:23d2:e000:10:2c2:4900:93a1, 2600:9000:23d2:e00:10:2c2:4900:93a1, 2600:9000:23d2:f000:10:2c2:4900:93a1
Redirect IPs 18.155.68.14, 18.155.68.19, 18.155.68.5, 18.155.68.65, 2600:9000:23d2:1600:10:2c2:4900:93a1, 2600:9000:23d2:4400:10:2c2:4900:93a1, 2600:9000:23d2:5c00:10:2c2:4900:93a1, 2600:9000:23d2:8a00:10:2c2:4900:93a1, 2600:9000:23d2:9a00:10:2c2:4900:93a1, 2600:9000:23d2:c000:10:2c2:4900:93a1, 2600:9000:23d2:c400:10:2c2:4900:93a1, 2600:9000:23d2:d400:10:2c2:4900:93a1
Response IP 18.155.68.5
Found Yes
Hash 6163d06165cf4ec04f4aa83ce64b09b92d465029928ffe1d2cb217157616b6ce
SimHash aade89416ee0

Groups

*

Rule Path
Allow /
Disallow /api/*
Disallow /_next/*
Disallow /assets/*
Disallow /server-sitemap.xml
Disallow /_next/data/*
Allow /sitemap.xml
Allow /sitemap-*.xml

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap http:hypnotek.com/api/sitemap
Back to top

Comments

  • robots.txt for https://hypnotek.com/
  • Allow all robots full access to the main site
  • Block access to sensitive or non-indexable routes
  • Block common static file types (Optional: Uncomment if needed)
  • Disallow: /*.css$
  • Disallow: /*.js$
  • Disallow: /*.json$
  • Allow important SEO files
  • Specify sitemap locations
  • Add a crawl delay to prevent server overload
Back to top