cdn.fangraphs.com
robots.txt

Robots Exclusion Standard data for cdn.fangraphs.com

Resource Scan

Scan Details

Site Domain cdn.fangraphs.com
Base Domain fangraphs.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-04-11T22:00:59+00:00
Next Scan 2024-07-10T22:00:59+00:00

Last Successful Scan

Scanned2023-09-15T03:39:31+00:00
URL https://cdn.fangraphs.com/robots.txt
Domain IPs 138.199.46.68, 2400:52e0:1500::868:1
Response IP 138.199.46.68
Found Yes
Hash 6ffbe1268a456cc89d1bd846d91ea48b93606c41af8521555ff472c45beb7b6a
SimHash c16c4ac3ebf7

Groups

*

Rule Path
Disallow /fantasyleaders.aspx
Disallow /fantasyminorleaders.aspx
Disallow /thegame/tgleaders.aspx
Disallow /thttest/
Disallow /blogstest/
Disallow /plustest/
Disallow /blank-page.aspx
Disallow /statss-legacy.aspx
Disallow /graphs-legacy.aspx
Disallow /pitchfxg-legacy.aspx
Disallow /statsplits-legacy.aspx
Disallow /splitstool-legacy.aspx
Disallow /pitchfx-legacy.aspx
Disallow /statsd-legacy.aspx
Disallow /statsp-legacy.aspx
Disallow /comparison-legacy.aspx
Disallow /spraycharts-legacy.aspx
Disallow /zonegrid-legacy.aspx

Comments

  • robots.txt for http://www.fangraphs.com/