xxxfin.com
robots.txt
Robots Exclusion Standard data for xxxfin.com
Resource Scan
Scan Details
| Site Domain | xxxfin.com |
| Base Domain | xxxfin.com |
| Scan Status | Ok |
| Last Scan | 2024-11-16T17:42:52+00:00 |
| Next Scan | 2024-11-23T17:42:52+00:00 |
Last Scan
| Scanned | 2024-11-16T17:42:52+00:00 |
| URL | https://xxxfin.com/robots.txt |
| Redirect | https://www.xxxfin.com/robots.txt |
| Redirect Domain | www.xxxfin.com |
| Redirect Base | xxxfin.com |
| Domain IPs | 104.21.15.174, 172.67.206.160, 2606:4700:3030::6815:fae, 2606:4700:3031::ac43:cea0 |
| Redirect IPs | 104.21.15.174, 172.67.206.160, 2606:4700:3030::6815:fae, 2606:4700:3031::ac43:cea0 |
| Response IP | 104.21.15.174 |
| Found | Yes |
| Hash | c4bfbc7d6966a76a0597c4f02b27313aee13d43ef98e09482af00d5245ea408c |
| SimHash | 49089cf0c381 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
*
| Rule | Path |
|---|---|
| Disallow | /*blackhole |
| Disallow | /?blackhole |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.xxxfin.com/sitemap_index.xml |