findusajobs.com
robots.txt
Robots Exclusion Standard data for findusajobs.com
Resource Scan
Scan Details
| Site Domain | findusajobs.com |
| Base Domain | findusajobs.com |
| Scan Status | Ok |
| Last Scan | 2025-04-03T19:27:58+00:00 |
| Next Scan | 2025-04-10T19:27:58+00:00 |
Last Scan
| Scanned | 2025-04-03T19:27:58+00:00 |
| URL | https://findusajobs.com/robots.txt |
| Domain IPs | 104.21.28.168, 172.67.146.232, 2606:4700:3031::6815:1ca8, 2606:4700:3034::ac43:92e8 |
| Response IP | 104.21.28.168 |
| Found | Yes |
| Hash | cb2a911c6d93a8f57dfc7ac61cd18e94db05499fc8a7e965632fb55b723cc78b |
| SimHash | 63018c8821b3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /privacy-policy/ |
| Disallow | /terms-of-use/ |
| Disallow | /unsubscribe/ |
| Disallow | /readme.html |
| Disallow | /wp-admin/ |
| Disallow | /wp-admin/admin-ajax.php |
| Disallow | /ca-rights/ |
| Disallow | /california-rights/ |
| Disallow | /california-resident-privacy-statement/ |
| Disallow | /ca-resident-privacy-statement/ |
| Disallow | /privacy-statement-for-ca-residents/ |
| Disallow | /wp-content/uploads/ |