job-tree.com
robots.txt
Robots Exclusion Standard data for job-tree.com
Resource Scan
Scan Details
| Site Domain | job-tree.com |
| Base Domain | job-tree.com |
| Scan Status | Ok |
| Last Scan | 2026-01-02T22:49:54+00:00 |
| Next Scan | 2026-01-09T22:49:54+00:00 |
Last Scan
| Scanned | 2026-01-02T22:49:54+00:00 |
| URL | https://job-tree.com/robots.txt |
| Redirect | https://www.job-tree.com:443/robots.txt |
| Redirect Domain | www.job-tree.com |
| Redirect Base | job-tree.com |
| Domain IPs | 52.1.250.252, 54.147.147.20 |
| Redirect IPs | 104.18.24.2, 104.18.25.2, 2606:4700::6812:1802, 2606:4700::6812:1902 |
| Response IP | 104.18.24.2 |
| Found | Yes |
| Hash | 735698e6139dc73cadd4047d97f931d4479d0a3e2ba8cb5c84cc0327d8f5b78e |
| SimHash | a81129867671 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /job_search/toggle_job_tag |
| Disallow | /job_search/recommended_jobs |
| Disallow | /job_search/autocomplete_job_titles |
| Disallow | /job_search/autocomplete_location |
Comments