need-a-job.com
robots.txt

Robots Exclusion Standard data for need-a-job.com

Resource Scan

Scan Details

Site Domain need-a-job.com
Base Domain need-a-job.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-26T14:18:40+00:00
Next Scan 2026-01-25T14:18:40+00:00

Last Successful Scan

Scanned2025-09-27T09:04:45+00:00
URL https://need-a-job.com/robots.txt
Domain IPs 104.21.60.170, 172.67.198.110, 2606:4700:3033::ac43:c66e, 2606:4700:3037::6815:3caa
Response IP 104.21.60.170
Found Yes
Hash d4e690d8c53625e224e1b472eedc712dc0533f0283938ccdc851f705720b7636
SimHash 9954c1044d91

Groups

*

Rule Path
Disallow /cdn-cgi