remotehunt.com
robots.txt

Robots Exclusion Standard data for remotehunt.com

Resource Scan

Scan Details

Site Domain remotehunt.com
Base Domain remotehunt.com
Scan Status Ok
Last Scan2025-11-09T03:39:41+00:00
Next Scan 2025-12-09T03:39:41+00:00

Last Scan

Scanned2025-11-09T03:39:41+00:00
URL https://remotehunt.com/robots.txt
Redirect https://weworkremotely.com/robots.txt?utm_source=remotehunt.com
Redirect Domain weworkremotely.com
Redirect Base weworkremotely.com
Domain IPs 3.131.150.69
Redirect IPs 172.66.40.148, 172.66.43.108, 2606:4700:3108::ac42:2894, 2606:4700:3108::ac42:2b6c
Response IP 172.66.43.108
Found Yes
Hash fc9ed26e31100ce53eeccf020345d3282c8bacd4d1b2c54409328c9a9813ce37
SimHash 10151cd60f51

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /account/
Disallow /job-seekers/profile/
Disallow /manage-company/
Disallow /*edit?token=%2F
Disallow /*cancel?token=%2F

Other Records

Field Value
sitemap https://weworkremotely.com/sitemap.xml

Comments

  • robots.txt for https://weworkremotely.com/