Log In Sign Up

mtgmintcard.com
robots.txt

Robots Exclusion Standard data for mtgmintcard.com

Resource Scan

Scan Details

Site Domain mtgmintcard.com
Base Domain mtgmintcard.com
Scan Status Ok
Last Scan2024-05-01T04:02:29+00:00
Next Scan 2024-05-31T04:02:29+00:00

Last Scan

Scanned2024-05-01T04:02:29+00:00
URL https://mtgmintcard.com/robots.txt
Redirect http://www.mtgmintcard.com/robots.txt
Redirect Domain www.mtgmintcard.com
Redirect Base mtgmintcard.com
Domain IPs 2600:9000:202d:1000:5:c44f:8fc0:93a1, 2600:9000:202d:1c00:5:c44f:8fc0:93a1, 2600:9000:202d:2600:5:c44f:8fc0:93a1, 2600:9000:202d:6600:5:c44f:8fc0:93a1, 2600:9000:202d:7c00:5:c44f:8fc0:93a1, 2600:9000:202d:9e00:5:c44f:8fc0:93a1, 2600:9000:202d:d200:5:c44f:8fc0:93a1, 2600:9000:202d:fa00:5:c44f:8fc0:93a1, 52.84.16.181
Redirect IPs 13.33.88.116, 13.33.88.123, 13.33.88.17, 13.33.88.73, 2600:9000:223b:2a00:5:c44f:8fc0:93a1, 2600:9000:223b:5400:5:c44f:8fc0:93a1, 2600:9000:223b:5c00:5:c44f:8fc0:93a1, 2600:9000:223b:6200:5:c44f:8fc0:93a1, 2600:9000:223b:8a00:5:c44f:8fc0:93a1, 2600:9000:223b:8c00:5:c44f:8fc0:93a1, 2600:9000:223b:9600:5:c44f:8fc0:93a1, 2600:9000:223b:cc00:5:c44f:8fc0:93a1
Response IP 13.33.88.73
Found Yes
Hash ab2acb787269c9defd7e5232f299b9d1eb85c39bf709aabfaec6bd6f63e76a5b
SimHash 0815d951ce17

Groups

*

Rule Path
Disallow /mtgadmin
Disallow /ajax_servers
Disallow /cache
Allow /cache-
Disallow /datafeed
Disallow /docs
Disallow /download
Disallow /editors
Disallow /email
Disallow /extras
Disallow /includes
Allow /includes/templates/template_default/css/*.css
Allow /includes/templates/template_default/jscript/*.js
Allow /includes/languages/*.js
Disallow /images
Allow /images/products/*/*/*/*.jpg
Allow /images/products/*/*.jpg
Allow /images/ebay_products/*/*/*/*/*.jpg
Allow /images/mtg/*/*/*/*.jpg
Allow /images/accessories/*/*/*.jpg
Allow /images/combos/*/*.jpg
Disallow /cronjob
Disallow /receive_wg_api_servers
Disallow /login
Disallow /shopping-cart
Disallow /buylist-cart
Disallow /ajax_index.php
Disallow /job_index.php
Disallow /ebayx1.php
Disallow /ebayx4.php
Disallow /ebayx10.php
Disallow /image.php
Disallow /ipn_main_handler.php
Disallow /singlesX1ImageResize.php
Disallow /singlesX4ImageResize.php
Disallow /singlesX10ImageResize.php
Allow /sitemap

googlebot-image

Rule Path
Allow /images

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap http://www.mtgmintcard.com/sitemap.xml
Back to top

Comments

  • These settings will keep spiders from indexing your unwanted pages
  • This assumes that your OSC install is in your web site's ROOT directory
  • ie: http://www.yoursite.com/index.php <- Use if this brings up your OSC main page
  • Sitemap: http://www.mtgmintcard.com/sitemap/sitemap.xml
Back to top