avclub.gr
robots.txt
Robots Exclusion Standard data for avclub.gr
Resource Scan
Scan Details
| Site Domain | avclub.gr |
| Base Domain | avclub.gr |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-12-31T10:33:21+00:00 |
| Next Scan | 2025-03-31T10:33:21+00:00 |
Last Successful Scan
| Scanned | 2024-02-13T06:59:13+00:00 |
| URL | https://avclub.gr/robots.txt |
| Domain IPs | 104.21.52.184, 172.67.202.216, 2606:4700:3030::6815:34b8, 2606:4700:3032::ac43:cad8 |
| Response IP | 172.67.202.216 |
| Found | Yes |
| Hash | 299988ac2f34b19d5c4305276f33f2e3f6c8295553cb7cf6cfddc155daa000f7 |
| SimHash | 8015dcc2aa03 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /account/ |
| Disallow | /goto/ |
| Disallow | /login/ |
| Disallow | /search/ |
| Disallow | /members/ |
| Disallow | /admin.php |
| Disallow | /index.php?uix%2Ftoggle-category.json* |
| Disallow | /index.php?uix%2Ftoggle-sidebar-navigation.json* |
| Disallow | /index.php?uix%2Ftoggle-width.json* |
| Disallow | /index.php?uix%2Ftoggle-sidebar.json* |
| Disallow | /index.php?uix%2Ftoggle-sidebar.json* |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.avclub.gr/sitemap.php |