oldfootballshirts.com
robots.txt

Robots Exclusion Standard data for oldfootballshirts.com

Resource Scan

Scan Details

Site Domain oldfootballshirts.com
Base Domain oldfootballshirts.com
Scan Status Ok
Last Scan2024-06-16T00:49:28+00:00
Next Scan 2024-06-23T00:49:28+00:00

Last Scan

Scanned2024-06-16T00:49:28+00:00
URL https://oldfootballshirts.com/robots.txt
Redirect https://www.oldfootballshirts.com/robots.txt
Redirect Domain www.oldfootballshirts.com
Redirect Base oldfootballshirts.com
Domain IPs 192.124.249.15
Redirect IPs 192.124.249.15
Response IP 192.124.249.15
Found Yes
Hash 28c27fb8e0a771ddf8ded32171e48165c7c7ce0c7dd3f95d148689104b429ddf
SimHash 8e54dd844810

Groups

yandex

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

*

Rule Path
Disallow /en/ajax/ajax.social-share-buttons-v2.php
Disallow /en/buy/
Disallow /*/buy/
Disallow /admin/
Disallow /admin2/
Disallow /shop/
Disallow /*/user-registration.php
Disallow /*/user-login.php
Disallow /forum/

Comments

  • User-agent: Mediapartners-Google
  • Disallow:
  • Disallow: /img/shirts/*/thumbs/*
  • Disallow: /*/add-a-link.php
  • Disallow: /*/contact-oldfootballshirts.php
  • Disallow: /en/ajax/
  • Disallow: /*/buy-retro-*