wineclubreviews.net
robots.txt
Robots Exclusion Standard data for wineclubreviews.net
Resource Scan
Scan Details
Site Domain | wineclubreviews.net |
Base Domain | wineclubreviews.net |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 1/29/2025, 3:51:32 AM |
Next Scan | 4/29/2025, 3:51:32 AM |
Last Successful Scan
Scanned | 1/10/2023, 5:00:25 AM |
URL | https://wineclubreviews.net/robots.txt |
Domain IPs | 104.26.0.116, 104.26.1.116, 172.67.73.195, 2606:4700:20::681a:174, 2606:4700:20::681a:74, 2606:4700:20::ac43:49c3 |
Response IP | 104.26.0.116 |
Found | Yes |
Hash | 3a20a37b48944445507f3bc4487c92498bfb41aac511dadf908e48648aae052d |
SimHash | 2c385f14fd81 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | /sitemap-elastic.xml |
Disallow | /clicks/ |
Disallow | /clickout.php |
Disallow | /account/ |
Disallow | /api/ |
Disallow | /lp/ |
Disallow | /wine-clubs/ |
Disallow | /wineclubreviews/ |
*
Rule | Path |
---|---|
Disallow | /clickout.php |
Disallow | /account/ |
Disallow | /api/ |
Disallow | /clicks/ |
Disallow | /lp/ |
Disallow | /wine-clubs/ |
Disallow | /wineclubreviews/ |
Other Records
Field | Value |
---|---|
sitemap | https://wineclubreviews.net/sitemap.xml |
sitemap | https://wineclubreviews.net/sitemap.xml |