Log In Sign Up

sansha.com
robots.txt

Robots Exclusion Standard data for sansha.com

Resource Scan

Scan Details

Site Domain sansha.com
Base Domain sansha.com
Scan Status Ok
Last Scan2024-09-11T17:42:42+00:00
Next Scan 2024-10-11T17:42:42+00:00

Last Scan

Scanned2024-09-11T17:42:42+00:00
URL http://sansha.com/robots.txt
Redirect http://nydancestore.com/robots.txt
Redirect Domain nydancestore.com
Redirect Base nydancestore.com
Domain IPs 209.17.116.163
Redirect IPs 18.235.151.227, 3.220.160.166
Response IP 18.235.151.227
Found Yes
Hash 027e3426f637bb63ed1c24b84c980a7f512ec9b33f58f325e6e73cec3da381e9
SimHash 10141a16f7b2

Groups

*

Rule Path
Allow /
Disallow /checkout
Disallow /customer/account/$
Disallow /customer/address/new/$
Disallow /customer/account/edit/$
Disallow /customer/account/logoutSuccess/$
Disallow /sales
Disallow /wishlist
Disallow /review
Disallow /newsletter
Disallow /catalogsearch/result/?q=

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

expanse

Rule Path
Disallow /

internet-measurement

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dataprovider

Rule Path
Disallow /

dalvik/2.1.0

Rule Path
Disallow /

ioncrawl

Rule Path
Disallow /

java

Rule Path
Disallow /

mozlila

Rule Path
Disallow /

orbbot

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

sogou

Rule Path
Disallow /

builtwith

Rule Path
Disallow /

wp_is_mobile

Rule Path
Disallow /

colly

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

sqlmap

Rule Path
Disallow /

httrack

Rule Path
Disallow /

masscan

Rule Path
Disallow /

ioncrawl

Rule Path
Disallow /

seositecheckup

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

germcrawler

Rule Path
Disallow /

germcrawler

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

friendly_crawler

Rule Path
Disallow /

rome client

Rule Path
Disallow /

crawler_eb_germany_2.0

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

wirereaderbot

Rule Path
Disallow /

udu/1.6.5

Rule Path
Disallow /

zend_http_client

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://nydancestore.com/pub/sitemaps/sitemap_newyork.xml
sitemap https://world.sansha.com/pub/sitemaps/sitemap_world.xml
sitemap https://b2b-usa.sansha.com/pub/sitemaps/sitemap_b2b.xml
Back to top