avgosu.com
robots.txt
Robots Exclusion Standard data for avgosu.com
Resource Scan
Scan Details
| Site Domain | avgosu.com |
| Base Domain | avgosu.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-12-01T18:14:35+00:00 |
| Next Scan | 2026-03-01T18:14:35+00:00 |
Last Successful Scan
| Scanned | 2024-04-18T10:47:29+00:00 |
| URL | https://avgosu.com/robots.txt |
| Redirect | https://avgosu6.com/robots.txt |
| Redirect Domain | avgosu6.com |
| Redirect Base | avgosu6.com |
| Domain IPs | 104.21.58.248, 172.67.166.129, 2606:4700:3031::ac43:a681, 2606:4700:3033::6815:3af8 |
| Redirect IPs | 104.21.58.17, 172.67.197.53, 2606:4700:3030::ac43:c535, 2606:4700:3031::6815:3a11 |
| Response IP | 104.21.58.17 |
| Found | Yes |
| Hash | ee6fbe3b53b6d97a032037b889cf03745b9edc602801d2a685109bd33a59fe78 |
| SimHash | 6814e310c793 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://avgosu.com/sitemap_index.xml |