freewareweb.com
robots.txt
Robots Exclusion Standard data for freewareweb.com
Resource Scan
Scan Details
| Site Domain | freewareweb.com |
| Base Domain | freewareweb.com |
| Scan Status | Ok |
| Last Scan | 2025-10-22T09:24:22+00:00 |
| Next Scan | 2025-11-21T09:24:22+00:00 |
Last Scan
| Scanned | 2025-10-22T09:24:22+00:00 |
| URL | https://freewareweb.com/robots.txt |
| Redirect | http://www.freewareweb.com/robots.txt |
| Redirect Domain | www.freewareweb.com |
| Redirect Base | freewareweb.com |
| Domain IPs | 104.21.46.36, 172.67.223.36, 2606:4700:3030::6815:2e24, 2606:4700:3030::ac43:df24 |
| Redirect IPs | 104.21.46.36, 172.67.223.36, 2606:4700:3030::6815:2e24, 2606:4700:3030::ac43:df24 |
| Response IP | 172.67.223.36 |
| Found | Yes |
| Hash | d735919f756e58021f917a690b180d36aa345244e6b1825f6cd7e07ef9580bf4 |
| SimHash | ea2b1b700fc2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/dl.pl |
| Disallow | /cgi-bin/go.pl |
| Disallow | /cgi-bin/goto.pl |
| Disallow | /cgi-bin/tell.pl |
| Disallow | /cgi-bin/mailbroken.pl |
| Disallow | /cgi-bin/report.pl |
Comments