jobcute.com
robots.txt
Robots Exclusion Standard data for jobcute.com
Resource Scan
Scan Details
Site Domain | jobcute.com |
Base Domain | jobcute.com |
Scan Status | Ok |
Last Scan | 5/18/2025, 7:38:00 PM |
Next Scan | 5/25/2025, 7:38:00 PM |
Last Scan
Scanned | 5/18/2025, 7:38:00 PM |
URL | https://jobcute.com/robots.txt |
Redirect | https://www.jobcute.com/robots.txt |
Redirect Domain | www.jobcute.com |
Redirect Base | jobcute.com |
Domain IPs | 104.21.42.183, 172.67.207.125, 2606:4700:3033::ac43:cf7d, 2606:4700:3035::6815:2ab7 |
Redirect IPs | 104.21.42.183, 172.67.207.125, 2606:4700:3033::ac43:cf7d, 2606:4700:3035::6815:2ab7 |
Response IP | 172.67.207.125 |
Found | Yes |
Hash | c88de33ee7316e4c6b9ec0e4369f888f808fd0f04c44051a1b2b3ae43d8483de |
SimHash | a057694071cb |
Groups
*
Rule | Path |
---|---|
Disallow | /*/job-search |
Disallow | /*/about |
Disallow | /about |
Disallow | /job-search |
Disallow | /vn/* |
Disallow | /mm/* |
Disallow | /kh/* |
Disallow | /la/* |
Disallow | /my/* |
Disallow | /id/* |
Disallow | /ph/* |
Disallow | /ar/* |
Disallow | /cn/* |
Disallow | /*/site/get-job-functions |
Disallow | /site/get-job-functions |
Disallow | /account/ |
Disallow | /*/account/ |