jobfinfin.com
robots.txt

Robots Exclusion Standard data for jobfinfin.com

Resource Scan

Scan Details

Site Domain jobfinfin.com
Base Domain jobfinfin.com
Scan Status Ok
Last Scan2025-03-20T04:47:44+00:00
Next Scan 2025-04-19T04:47:44+00:00

Last Scan

Scanned2025-03-20T04:47:44+00:00
URL https://jobfinfin.com/robots.txt
Redirect https://www.jobfinfin.com/robots.txt
Redirect Domain www.jobfinfin.com
Redirect Base jobfinfin.com
Domain IPs 2600:9000:2894:1c00:1f:403b:39c0:93a1, 2600:9000:2894:2a00:1f:403b:39c0:93a1, 2600:9000:2894:4400:1f:403b:39c0:93a1, 2600:9000:2894:4800:1f:403b:39c0:93a1, 2600:9000:2894:6400:1f:403b:39c0:93a1, 2600:9000:2894:9600:1f:403b:39c0:93a1, 2600:9000:2894:a000:1f:403b:39c0:93a1, 2600:9000:2894:de00:1f:403b:39c0:93a1, 3.170.229.111, 3.170.229.117, 3.170.229.36, 3.170.229.6
Redirect IPs 2600:9000:2894:400:1f:403b:39c0:93a1, 2600:9000:2894:7e00:1f:403b:39c0:93a1, 2600:9000:2894:800:1f:403b:39c0:93a1, 2600:9000:2894:9a00:1f:403b:39c0:93a1, 2600:9000:2894:9c00:1f:403b:39c0:93a1, 2600:9000:2894:9e00:1f:403b:39c0:93a1, 2600:9000:2894:a600:1f:403b:39c0:93a1, 2600:9000:2894:aa00:1f:403b:39c0:93a1, 3.170.229.111, 3.170.229.117, 3.170.229.36, 3.170.229.6
Response IP 3.170.229.6
Found Yes
Hash 12b01e2a05474a0722cfa94f39e0d88d89712ad757bded0a694357fe82a68e17
SimHash c04988c1cf10

Groups

*

Rule Path
Disallow *.pdf
Disallow /cookie_policy
Allow /

Other Records

Field Value
sitemap https://www.jobfinfin.com/sitemap.xml

Warnings

  • 3 invalid lines.