dailyjob.com
robots.txt

Robots Exclusion Standard data for dailyjob.com

Resource Scan

Scan Details

Site Domain dailyjob.com
Base Domain dailyjob.com
Scan Status Ok
Last Scan2026-02-18T17:21:49+00:00
Next Scan 2026-03-20T17:21:49+00:00

Last Scan

Scanned2026-02-18T17:21:49+00:00
URL https://dailyjob.com/robots.txt
Domain IPs 104.21.2.166, 172.67.186.250, 2606:4700:3031::6815:2a6, 2606:4700:3032::ac43:bafa
Response IP 104.21.2.166
Found Yes
Hash 70bcd3f194fe063a925792e07a83b77dfdd843b8048839ad1b3fb44024e2bb96
SimHash 4904dc30c613

Groups

*

Rule Path
Allow /
Disallow /app/
Disallow /admin/
Disallow /api/

Other Records

Field Value
sitemap https://dailyjob.com/sitemap.xml