sidelineswap.com
robots.txt
Robots Exclusion Standard data for sidelineswap.com
Resource Scan
Scan Details
Site Domain | sidelineswap.com |
Base Domain | sidelineswap.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-26T17:44:55+00:00 |
Next Scan | 2025-01-24T17:44:55+00:00 |
Last Successful Scan
Scanned | 2024-01-01T16:38:44+00:00 |
URL | https://sidelineswap.com/robots.txt |
Domain IPs | 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132 |
Response IP | 151.101.2.132 |
Found | Yes |
Hash | 5152caf951bf7f2a5baeaa508ffe424c01eacf473896ef3bd19ec078f61dabff |
SimHash | df11bbe06d33 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /settings |
Disallow | /login |
Disallow | /register |
Disallow | /search |
Disallow | /shop/*?* |
Disallow | /sm/*?* |
Disallow | /value-guide |
Disallow | /feed |
Disallow | /swaps |
Disallow | /*/following |
Disallow | /*/feedback |
Disallow | /*/followers |
Disallow | /*/sold |
Disallow | /locker/* |
Disallow | /gear/*?* |
Disallow | /en-CA |
Disallow | /en-CA/* |
Allow | /shop/*?utm_*=* |
Allow | /shop/*?page=* |
Allow | /shop/*?bat-type*=*&utm_*= |
Allow | /shop/*?drop*=*&utm_*= |
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://sidelineswap.com/sitemaps/sitemap.xml.gz |
sitemap | https://sidelineswap.com/sitemaps/blog.xml |
Warnings
- `host` is not a known field.