ifp.co.in
robots.txt
Robots Exclusion Standard data for ifp.co.in
Resource Scan
Scan Details
Site Domain | ifp.co.in |
Base Domain | ifp.co.in |
Scan Status | Ok |
Last Scan | 2024-10-31T12:59:23+00:00 |
Next Scan | 2024-11-07T12:59:23+00:00 |
Last Scan
Scanned | 2024-10-31T12:59:23+00:00 |
URL | https://ifp.co.in/robots.txt |
Redirect | https://www.ifp.co.in:443/robots.txt |
Redirect Domain | www.ifp.co.in |
Redirect Base | ifp.co.in |
Domain IPs | 13.35.238.115, 13.35.238.125, 13.35.238.2, 13.35.238.93 |
Redirect IPs | 3.7.193.30, 3.7.91.192 |
Response IP | 3.7.193.30 |
Found | Yes |
Hash | 3c8af743e1f4b5a6030ba4bc5e6c9116e8918a491e51140519f89a8c4c50f7c5 |
SimHash | 43409073efd6 |
Groups
*
Rule | Path |
---|---|
Allow | /* |
Disallow | /search/* |
Disallow | /ifp_admin/* |
Disallow | /accounts/* |
Disallow | /admin/* |
Disallow | /content-missing |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Other Records
Field | Value |
---|---|
sitemap | https://ifp.co.in/sitemap.xml |
Warnings
- `host` is not a known field.