comparedth.com
robots.txt
Robots Exclusion Standard data for comparedth.com
Resource Scan
Scan Details
| Site Domain | comparedth.com |
| Base Domain | comparedth.com |
| Scan Status | Ok |
| Last Scan | 2025-11-07T09:22:10+00:00 |
| Next Scan | 2025-11-14T09:22:10+00:00 |
Last Scan
| Scanned | 2025-11-07T09:22:10+00:00 |
| URL | https://comparedth.com/robots.txt |
| Redirect | https://www.comparedth.com/robots.txt |
| Redirect Domain | www.comparedth.com |
| Redirect Base | comparedth.com |
| Domain IPs | 104.21.52.40, 172.67.195.15, 2606:4700:3035::ac43:c30f, 2606:4700:3036::6815:3428 |
| Redirect IPs | 104.21.52.40, 172.67.195.15, 2606:4700:3035::ac43:c30f, 2606:4700:3036::6815:3428 |
| Response IP | 172.67.195.15 |
| Found | Yes |
| Hash | e9acf97e0f6ec9c74b2b5fc1bf8d0e65654683e57b84022ee3d12b28fa38697b |
| SimHash | 2424d880c1b3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /blog-detail/18/link-n.html |
| Disallow | /blog-detail/40/link-n.html |
| Disallow | /blog-detail/19/link-n.html |
| Disallow | /blog-detail/43/link-n.html |
| Disallow | /blog.php?get=* |
| Disallow | /blog-detail.php |
| Disallow | /new_review.php* |
| Disallow | /pg-online-pay.php* |
| Disallow | /blog.php?search=* |
| Disallow | /articles-view.php* |