personalwine.com
robots.txt
Robots Exclusion Standard data for personalwine.com
Resource Scan
Scan Details
Site Domain | personalwine.com |
Base Domain | personalwine.com |
Scan Status | Ok |
Last Scan | 2024-09-24T18:54:43+00:00 |
Next Scan | 2024-10-24T18:54:43+00:00 |
Last Scan
Scanned | 2024-09-24T18:54:43+00:00 |
URL | https://personalwine.com/robots.txt |
Redirect | https://www.personalwine.com/robots.txt |
Redirect Domain | www.personalwine.com |
Redirect Base | personalwine.com |
Domain IPs | 52.84.229.120, 52.84.229.26, 52.84.229.32, 52.84.229.76 |
Redirect IPs | 18.205.222.128, 52.202.168.65, 54.161.241.46, 54.237.133.81 |
Response IP | 52.202.168.65 |
Found | Yes |
Hash | 6a5515357cbc01772b8e71617da5663284895eaba820c766b2b98055b04976f8 |
SimHash | 2d3dcd14c913 |
Groups
*
Rule | Path |
---|---|
Disallow | /checkout |
Disallow | /cart |
Disallow | /orders |
Disallow | /countries |
Disallow | /password_resets |
Disallow | /states |
Disallow | /user_sessions |
Disallow | /user_registrations |
Disallow | /users |
Disallow | /user |
Disallow | /account |
Disallow | /backend |
Disallow | /admin |
Disallow | /password |
Disallow | /login |
Disallow | /signup |
Disallow | /api |
Other Records
Field | Value |
---|---|
sitemap | https://s3.amazonaws.com/file.personalwine.com/sitemaps/sitemap.xml.gz |