openprovider.com
robots.txt
Robots Exclusion Standard data for openprovider.com
Resource Scan
Scan Details
Site Domain | openprovider.com |
Base Domain | openprovider.com |
Scan Status | Ok |
Last Scan | 2024-11-12T01:01:02+00:00 |
Next Scan | 2024-11-19T01:01:02+00:00 |
Last Scan
Scanned | 2024-11-12T01:01:02+00:00 |
URL | https://openprovider.com/robots.txt |
Redirect | https://www.openprovider.com/robots.txt |
Redirect Domain | www.openprovider.com |
Redirect Base | openprovider.com |
Domain IPs | 76.76.21.21 |
Redirect IPs | 76.76.21.142, 76.76.21.61 |
Response IP | 76.76.21.22 |
Found | Yes |
Hash | 6959ad4e9f1dc915ee6fff6030bebeb821054b2e5d11a8001083654d522f3398 |
SimHash | 48094808cd12 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /wp-admin/ |
Disallow | /test/ |
Disallow | /api/ |
Disallow | /newsletters/ |
Disallow | /ru/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.openprovider.com/sitemap.xml |