jobhat.com
robots.txt

Robots Exclusion Standard data for jobhat.com

Resource Scan

Scan Details

Site Domain jobhat.com
Base Domain jobhat.com
Scan Status Ok
Last Scan2026-01-10T09:53:40+00:00
Next Scan 2026-01-17T09:53:40+00:00

Last Scan

Scanned2026-01-10T09:53:40+00:00
URL https://jobhat.com/robots.txt
Redirect https://www.jobhat.com:443/robots.txt
Redirect Domain www.jobhat.com
Redirect Base jobhat.com
Domain IPs 54.147.147.20, 98.90.109.163
Redirect IPs 104.18.4.75, 104.18.5.75, 2606:4700::6812:44b, 2606:4700::6812:54b
Response IP 104.18.4.75
Found Yes
Hash 735698e6139dc73cadd4047d97f931d4479d0a3e2ba8cb5c84cc0327d8f5b78e
SimHash a81129867671

Groups

*

Rule Path
Disallow /admin/
Disallow /job_search/toggle_job_tag
Disallow /job_search/recommended_jobs
Disallow /job_search/autocomplete_job_titles
Disallow /job_search/autocomplete_location

Comments

  • See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file