mywot.com
robots.txt
Robots Exclusion Standard data for mywot.com
Resource Scan
Scan Details
| Site Domain | mywot.com |
| Base Domain | mywot.com |
| Scan Status | Ok |
| Last Scan | 2024-09-07T20:35:05+00:00 |
| Next Scan | 2024-09-21T20:35:05+00:00 |
Last Scan
| Scanned | 2024-09-07T20:35:05+00:00 |
| URL | https://mywot.com/robots.txt |
| Redirect | https://www.mywot.com:443/robots.txt |
| Redirect Domain | www.mywot.com |
| Redirect Base | mywot.com |
| Domain IPs | 52.13.134.221, 52.35.197.217 |
| Redirect IPs | 2600:1413:b000:6::17d5:2bca, 2600:1413:b000:6::17d5:2bd8, 96.17.96.14, 96.17.96.8 |
| Response IP | 23.59.168.138 |
| Found | Yes |
| Hash | 476f4b6cbe1100ef01f6f8d4460770accdaf3ff9dece1529ce42d40d05efe193 |
| SimHash | 60058980ee93 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /user/ |
| Disallow | /*/user/ |
| Disallow | /*/download.php$ |
| Disallow | /*/download.php? |
| Disallow | /*/download$ |
| Disallow | /*/download/ |
| Disallow | /download |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mywot.com/sitemaps/sitemap.xml.gz |
| sitemap | https://www.mywot.com/blog/sitemap_index.xml |