blackrockgalleries.com
robots.txt

Robots Exclusion Standard data for blackrockgalleries.com

Resource Scan

Scan Details

Site Domain blackrockgalleries.com
Base Domain blackrockgalleries.com
Scan Status Ok
Last Scan2024-06-03T18:53:40+00:00
Next Scan 2024-07-03T18:53:40+00:00

Last Scan

Scanned2024-06-03T18:53:40+00:00
URL https://blackrockgalleries.com/robots.txt
Redirect https://www.blackrockgalleries.com/robots.txt
Redirect Domain www.blackrockgalleries.com
Redirect Base blackrockgalleries.com
Domain IPs 198.49.77.66
Redirect IPs 198.49.77.66
Response IP 198.49.77.66
Found Yes
Hash 868ad8a65ba1a432b447f527bb1b7115e6ce947aa200e211fcf38ff3b688c222
SimHash 2006ccd55c7e

Groups

*

Rule Path
Disallow

googlebot

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

yahoo-mmcrawler

Rule Path
Disallow /

yahoo-slurp

Rule Path
Disallow /

slurp

Rule Path
Allow /

bingbot

Rule Path
Allow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

nbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

crawl

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

crawler

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

linkdex

Rule Path
Disallow /

majestic

Rule Path
Disallow /

meanpath

Rule Path
Disallow /

pageanalyzer

Rule Path
Disallow /

semalt

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

spider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

dalvik

Rule Path
Disallow /

cfnetwork

Rule Path
Disallow /

bingpreview

Rule Path
Disallow /

slack-imgproxy

Rule Path
Disallow /

snap

Rule Path
Disallow /

slackbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

bitlybot

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

linkedinbot

Rule Path
Disallow /

slackbot-linkexpanding

Rule Path
Disallow /
Disallow
Disallow /cart*
Disallow /*?auction=*
Disallow /*?blog_keyword=*
Disallow /*?keyword=*
Disallow /*?Page=*
Disallow /*?placebid=*
Disallow /*?sort=*
Disallow /*?start=*
Disallow /*?view=*
Disallow /gotolivebid.php?*
Disallow /aucinfopopup.php?*
Disallow /aucemailpopup.php?*
Disallow /embedvdo-pro.php?*
Disallow /embedvdo.php?*
Disallow /confirm_aucloc.php?*
Disallow /confirmaucloc.php?*
Disallow /loginmsg.php
Disallow /messages.php?*
Disallow /shipping-option.php?*
Disallow /thanks.php?*
Disallow /thankyou.php?*
Disallow /usps.php?*
Disallow /uspsinfopopup.php?*
Disallow /uspsinfopopupauc.php?*

Other Records

Field Value
sitemap https://www.blackrockgalleries.com/sitemap.xml
sitemap https://www.blackrockgalleries.com/auction-sitemap1.xml
sitemap https://www.blackrockgalleries.com/auction-sitemap2.xml
sitemap https://www.blackrockgalleries.com/store-sitemap.xml