topstockresearch.com
robots.txt

Robots Exclusion Standard data for topstockresearch.com

Resource Scan

Scan Details

Site Domain topstockresearch.com
Base Domain topstockresearch.com
Scan Status Ok
Last Scan2024-11-13T19:23:26+00:00
Next Scan 2024-11-20T19:23:26+00:00

Last Scan

Scanned2024-11-13T19:23:26+00:00
URL https://topstockresearch.com/robots.txt
Redirect https://www.topstockresearch.com/robots.txt
Redirect Domain www.topstockresearch.com
Redirect Base topstockresearch.com
Domain IPs 13.127.140.105
Redirect IPs 13.127.140.105
Response IP 13.127.140.105
Found Yes
Hash a7f1dcade39497db4f679584dcfa666cadae2292e125b75f545ed38a1dbb1146
SimHash fb1750d0619d

Groups

*

Rule Path
Disallow /*BASE_WWW_URL
Disallow /*BASE_COMMUNITY_URL
Disallow /INDIAN_STOCKS/TEST/
Disallow /TrendingStocks/Shares/NonTrending/FIFTEEN_DAY_MA_PERIOD/
Disallow /TrendingStocks/Shares/NonTrending/FIFTY_DAY_MA_PERIOD/
Disallow /TrendingStocks/Shares/NonTrending/HUNDRED_DAY_MA_PERIOD/
Disallow /TrendingStocks/Shares/NonTrending/TWO_HUNDRED_DAY_MA_PERIOD/

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

accompanybot

Rule Path
Disallow /

criteobot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

ttd-content

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

leikibot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

proximic

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

admantx

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

awariorssbot
awariosmartbot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

gptbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap http://www.topstockresearch.com/sitemap.xml