Log In Sign Up

hottakesapp.com
robots.txt

Robots Exclusion Standard data for hottakesapp.com

Resource Scan

Scan Details

Site Domain hottakesapp.com
Base Domain hottakesapp.com
Scan Status Ok
Last Scan2025-08-24T19:41:43+00:00
Next Scan 2025-09-23T19:41:43+00:00

Last Scan

Scanned2025-08-24T19:41:43+00:00
URL https://hottakesapp.com/robots.txt
Redirect https://hottakes.com/robots.txt
Redirect Domain hottakes.com
Redirect Base hottakes.com
Domain IPs 76.76.21.21
Redirect IPs 2600:9000:2724:4c00:6:139:ffc0:93a1, 2600:9000:2724:9a00:6:139:ffc0:93a1, 2600:9000:2724:a600:6:139:ffc0:93a1, 2600:9000:2724:be00:6:139:ffc0:93a1, 2600:9000:2724:c000:6:139:ffc0:93a1, 2600:9000:2724:c800:6:139:ffc0:93a1, 2600:9000:2724:cc00:6:139:ffc0:93a1, 2600:9000:2724:d000:6:139:ffc0:93a1, 3.164.182.22, 3.164.182.30, 3.164.182.54, 3.164.182.63
Response IP 18.244.87.41
Found Yes
Hash d328c76bcb895b8254e9f2db8476f1311b24281030afb79d3729018681d03297
SimHash 6208d51a0d70

Groups

*

Rule Path
Allow /
Disallow /api/*
Disallow /studio/*
Disallow /bitcoin
Back to top

Other Records

Field Value
sitemap https://hottakes.com/sitemap.xml
Back to top

Comments

  • Allow all crawlers
  • Block sensitive routes
  • We stop blocking this because it breaks Google rendering
  • Disallow: /_next/*
  • Temporarily hidden pages
  • Block dynamic parameters
  • This is not needed as we have clean canonical (and some resources are loaded with quey params)
  • Disallow: /*?*
  • Sitemap location
Back to top