web62.com
robots.txt
Robots Exclusion Standard data for web62.com
Resource Scan
Scan Details
| Site Domain | web62.com |
| Base Domain | web62.com |
| Scan Status | Ok |
| Last Scan | 2025-11-10T17:38:20+00:00 |
| Next Scan | 2025-11-17T17:38:20+00:00 |
Last Scan
| Scanned | 2025-11-10T17:38:20+00:00 |
| URL | https://web62.com/robots.txt |
| Redirect | http://www.web62.com/robots.txt |
| Redirect Domain | www.web62.com |
| Redirect Base | web62.com |
| Domain IPs | 104.21.2.217, 172.67.129.185, 2606:4700:3034::6815:2d9, 2606:4700:3037::ac43:81b9 |
| Redirect IPs | 104.21.2.217, 172.67.129.185, 2606:4700:3034::6815:2d9, 2606:4700:3037::ac43:81b9 |
| Response IP | 104.21.2.217 |
| Found | Yes |
| Hash | ff1bc4585bc7f473b1e714b9cdeeeaf2b5d2fddfd71c45b9abbb4bee6cc22f6a |
| SimHash | 41014f91efb1 |
Groups
*
| Product | Comment |
|---|---|
| * | directed to all robots |
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/sources |
| Disallow | /access_stats |
| Disallow | /cafeteria/lunch_menus/ |
| Disallow | /amember/ |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.web62.com/sitemap.xml |
Warnings
- 2 invalid lines.