www2.jobhat.com
robots.txt

Robots Exclusion Standard data for www2.jobhat.com

Resource Scan

Scan Details

Site Domain www2.jobhat.com
Base Domain jobhat.com
Scan Status Ok
Last Scan2026-02-04T10:31:33+00:00
Next Scan 2026-03-06T10:31:33+00:00

Last Scan

Scanned2026-02-04T10:31:33+00:00
URL https://www2.jobhat.com/robots.txt
Domain IPs 104.18.4.75, 104.18.5.75, 2606:4700::6812:44b, 2606:4700::6812:54b
Response IP 104.18.4.75
Found Yes
Hash 735698e6139dc73cadd4047d97f931d4479d0a3e2ba8cb5c84cc0327d8f5b78e
SimHash a81129867671

Groups

*

Rule Path
Disallow /admin/
Disallow /job_search/toggle_job_tag
Disallow /job_search/recommended_jobs
Disallow /job_search/autocomplete_job_titles
Disallow /job_search/autocomplete_location

Comments

  • See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file