textcompare.org
robots.txt
Robots Exclusion Standard data for textcompare.org
Resource Scan
Scan Details
| Site Domain | textcompare.org |
| Base Domain | textcompare.org |
| Scan Status | Ok |
| Last Scan | 2024-10-01T02:30:23+00:00 |
| Next Scan | 2024-10-08T02:30:23+00:00 |
Last Scan
| Scanned | 2024-10-01T02:30:23+00:00 |
| URL | https://textcompare.org/robots.txt |
| Redirect | https://www.textcompare.org/robots.txt |
| Redirect Domain | www.textcompare.org |
| Redirect Base | textcompare.org |
| Domain IPs | 104.21.88.167, 172.67.151.107, 2606:4700:3030::6815:58a7, 2606:4700:3031::ac43:976b |
| Redirect IPs | 104.21.88.167, 172.67.151.107, 2606:4700:3030::6815:58a7, 2606:4700:3031::ac43:976b |
| Response IP | 172.67.151.107 |
| Found | Yes |
| Hash | 0943306b65cec7565f0fdef6b2325c12d45f116818fb6920e71e98acc5916e32 |
| SimHash | 84185228e910 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /categories/ |
| Disallow | /tags/ |
| Disallow | /account/ |
| Disallow | /api/ |