herofincorp.com
robots.txt
Robots Exclusion Standard data for herofincorp.com
Resource Scan
Scan Details
| Site Domain | herofincorp.com |
| Base Domain | herofincorp.com |
| Scan Status | Ok |
| Last Scan | 2024-11-10T16:53:27+00:00 |
| Next Scan | 2024-11-17T16:53:27+00:00 |
Last Scan
| Scanned | 2024-11-10T16:53:27+00:00 |
| URL | https://herofincorp.com/robots.txt |
| Redirect | https://www.herofincorp.com:443/robots.txt |
| Redirect Domain | www.herofincorp.com |
| Redirect Base | herofincorp.com |
| Domain IPs | 3.165.102.127, 3.165.102.27, 3.165.102.47, 3.165.102.7 |
| Redirect IPs | 3.165.102.127, 3.165.102.27, 3.165.102.47, 3.165.102.7 |
| Response IP | 3.165.102.7 |
| Found | Yes |
| Hash | b486882aca70615285816c88759cb8a9bc13ce214b7e9b35df20abd7cbc61d4b |
| SimHash | d9198c69bd15 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /blog/search/ |
| Disallow | /search/ |
| Disallow | *//* |
| Disallow | *?page=* |
| Disallow | *--* |
| Disallow | *?utm_* |
| Disallow | *.pdf* |
| Disallow | */blog/te/blog/* |
| Disallow | */blog/ta/blog/* |
| Disallow | */blog/mr/blog/* |
| Disallow | */blog/kn/blog/* |
| Disallow | */blog/bn/blog/* |
| Disallow | */blog/ml/blog/* |
| Disallow | */blog/gu/blog/* |
| Disallow | *personal-loansbn* |
| Disallow | */personal-loansblog/* |
| Disallow | */personal-loansmr/* |
| Disallow | */personal-loansgu/* |
| Disallow | */personal-loansml/* |
| Disallow | */tags/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.herofincorp.com/sitemap.xml |