cainer.com
robots.txt
Robots Exclusion Standard data for cainer.com
Resource Scan
Scan Details
| Site Domain | cainer.com |
| Base Domain | cainer.com |
| Scan Status | Ok |
| Last Scan | 2024-11-11T01:40:12+00:00 |
| Next Scan | 2024-11-18T01:40:12+00:00 |
Last Scan
| Scanned | 2024-11-11T01:40:12+00:00 |
| URL | https://cainer.com/robots.txt |
| Redirect | https://www.cainer.com/robots.txt |
| Redirect Domain | www.cainer.com |
| Redirect Base | cainer.com |
| Domain IPs | 104.26.14.191, 104.26.15.191, 172.67.69.123, 2606:4700:20::681a:ebf, 2606:4700:20::681a:fbf, 2606:4700:20::ac43:457b |
| Redirect IPs | 104.26.14.191, 104.26.15.191, 172.67.69.123, 2606:4700:20::681a:ebf, 2606:4700:20::681a:fbf, 2606:4700:20::ac43:457b |
| Response IP | 104.26.14.191 |
| Found | Yes |
| Hash | c68a759dff0ef418230b1061ba42dffc47c6eed559ae4de45e60c95a23e9bf9a |
| SimHash | 497d4940c583 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /fa/ |
| Disallow | /charts/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cainer.com/sitemap.xml |