sammyfans.com
robots.txt

Robots Exclusion Standard data for sammyfans.com

Resource Scan

Scan Details

Site Domain sammyfans.com
Base Domain sammyfans.com
Scan Status Ok
Last Scan2026-02-05T20:37:18+00:00
Next Scan 2026-02-12T20:37:18+00:00

Last Scan

Scanned2026-02-05T20:37:18+00:00
URL https://sammyfans.com/robots.txt
Domain IPs 104.26.12.158, 104.26.13.158, 172.67.72.93, 2606:4700:20::681a:c9e, 2606:4700:20::681a:d9e, 2606:4700:20::ac43:485d
Response IP 172.67.72.93
Found Yes
Hash eea33131112c1efc965f62e61e200022b90aa9ea277f861b835e321f27eb04d1
SimHash 624ed850a883

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-login.php
Disallow /cdn-cgi/

mediapartners-google

Rule Path
Disallow

yandex

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

seznambot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

dotbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow

gptbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.sammyfans.com/sitemap_index.xml

Comments

  • Sitemap location