pokegoldfish.com
robots.txt

Robots Exclusion Standard data for pokegoldfish.com

Resource Scan

Scan Details

Site Domain pokegoldfish.com
Base Domain pokegoldfish.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-03-24T13:15:58+00:00
Next Scan 2024-06-22T13:15:58+00:00

Last Successful Scan

Scanned2022-10-12T09:38:40+00:00
URL https://www.pokegoldfish.com/robots.txt
Response IP 34.235.240.69, 52.1.46.118
Found Yes
Hash f12aa0ff710eeaffa9db6de50a4b4864fbd5cc3988bd23dd3ccd1c2a30464332
SimHash a0858b8d7454

Groups

*

Rule Path
Disallow /ebay_listings
Disallow /tcgplayer/price_widget
Disallow /embed/decklist
Disallow /widgets/price
Disallow /widgets/price_compact
Disallow /widgets/price_compact/js
Disallow /deals/ad_js
Disallow /deck/download*
Disallow /articles/footer/js
Disallow /health

grapeshot

Rule Path
Disallow /q

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines: