sidelineswap.com
robots.txt

Robots Exclusion Standard data for sidelineswap.com

Resource Scan

Scan Details

Site Domain sidelineswap.com
Base Domain sidelineswap.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-26T17:44:55+00:00
Next Scan 2025-01-24T17:44:55+00:00

Last Successful Scan

Scanned2024-01-01T16:38:44+00:00
URL https://sidelineswap.com/robots.txt
Domain IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Response IP 151.101.2.132
Found Yes
Hash 5152caf951bf7f2a5baeaa508ffe424c01eacf473896ef3bd19ec078f61dabff
SimHash df11bbe06d33

Groups

*

Rule Path
Disallow /admin/
Disallow /settings
Disallow /login
Disallow /register
Disallow /search
Disallow /shop/*?*
Disallow /sm/*?*
Disallow /value-guide
Disallow /feed
Disallow /swaps
Disallow /*/following
Disallow /*/feedback
Disallow /*/followers
Disallow /*/sold
Disallow /locker/*
Disallow /gear/*?*
Disallow /en-CA
Disallow /en-CA/*
Allow /shop/*?utm_*=*
Allow /shop/*?page=*
Allow /shop/*?bat-type*=*&utm_*=
Allow /shop/*?drop*=*&utm_*=
Allow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

comscore

Rule Path
Disallow /

proximic

Rule Path
Disallow /

Other Records

Field Value
sitemap https://sidelineswap.com/sitemaps/sitemap.xml.gz
sitemap https://sidelineswap.com/sitemaps/blog.xml

Warnings

  • `host` is not a known field.