diversityjobs.com
robots.txt
Robots Exclusion Standard data for diversityjobs.com
Resource Scan
Scan Details
| Site Domain | diversityjobs.com |
| Base Domain | diversityjobs.com |
| Scan Status | Ok |
| Last Scan | 2024-09-30T22:55:42+00:00 |
| Next Scan | 2024-10-30T22:55:42+00:00 |
Last Scan
| Scanned | 2024-09-30T22:55:42+00:00 |
| URL | https://diversityjobs.com/robots.txt |
| Domain IPs | 52.162.201.54 |
| Response IP | 52.162.201.54 |
| Found | Yes |
| Hash | f7deaa5007fb5784292baedb0c2aa4421f041239693ded143ddd361abd645933 |
| SimHash | 0500d2327091 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin |
| Disallow | /imglib_thumbnails |
| Disallow | /candidate/apply_registration |
| Disallow | /candidate/quick_registration |
| Disallow | /candidate/registration |
| Disallow | /candidate/job_apply |
| Disallow | /candidate/job_search/similar |
| Disallow | /candidate/private |
| Disallow | /candidate/redirect_apply |
| Disallow | /candidate/success_apply |
| Disallow | /candidate/trackback_apply |
| Disallow | /employer/registration |
| Disallow | /employer/private |
| Disallow | /jobsearch/display |
| Disallow | /trackback |
| Allow | /main/rss/feed |
| Allow | /main/download |
| Allow | /main/clients/products |
| Allow | /js/* |
| Disallow | /main |