chance.com
robots.txt

Robots Exclusion Standard data for chance.com

Resource Scan

Scan Details

Site Domain chance.com
Base Domain chance.com
Scan Status Ok
Last Scan2024-06-21T13:34:55+00:00
Next Scan 2024-06-28T13:34:55+00:00

Last Scan

Scanned2024-06-21T13:34:55+00:00
URL https://chance.com/robots.txt
Redirect https://www.chance.com:443/robots.txt
Redirect Domain www.chance.com
Redirect Base chance.com
Domain IPs 18.178.187.231, 52.193.35.82, 52.197.8.132
Redirect IPs 18.178.187.231, 52.193.35.82, 52.197.8.132
Response IP 18.178.187.231
Found Yes
Hash f1380d02c3ca8ed4748630392e0430e177f37e0f6554067bca8d9c5da7b4ec1b
SimHash 801450607dd3

Groups

bingbot

Rule Path
Allow /
Disallow /*

Other Records

Field Value
crawl-delay 3600000

baiduspider

Rule Path
Disallow /

linespider

Rule Path
Disallow /

yetibot

Rule Path
Disallow /

linkfluence.com

Rule Path
Disallow /

yak

Rule Path
Disallow /

admantx

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

buck

Rule Path
Disallow /

clipper

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

femtosearchbot

Rule Path
Disallow /

http://firstra.in/fr3_0

Rule Path
Disallow /

flamingo_searchengine

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

mappy

Rule Path
Disallow /

mediawords

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

proximic

Rule Path
Disallow /

linguee

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

toutiaospider

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

trendkite-akashic-crawler

Rule Path
Disallow /

yandex

Rule Path
Disallow /

zoominfo

Rule Path
Disallow /

punkspider

Rule Path
Disallow /

punkspider.org

Rule Path
Disallow /

webdatastats

Rule Path
Disallow /

*

Rule Path
Disallow /go.srv
Disallow /jump.srv
Disallow /sjump.srv
Disallow /pjump.srv
Disallow /click
Disallow /search/adjump.srv
Disallow /member/login.srv?
Disallow /unsubscribe/

Other Records

Field Value
sitemap https://www.chance.com/sitemap.xml

Comments

  • Bing
  • baidu
  • Naver / LINE
  • YaK/linkfluence.com
  • AdmantX
  • AhrefsBot
  • webmeup BLEX
  • Buck
  • Clipper
  • Common Crawl
  • dotbot
  • ExaBot
  • Femtosearch
  • firstrain
  • flamingosearch.com
  • grapeshot
  • NICT ICC
  • Magpie Brandwatch
  • Mappy Crawler
  • cyber.harvard.edu
  • MJ12bot
  • Nutch
  • comscore
  • Linguee
  • Semrush
  • sogou.com chinese search engine
  • toutia
  • Trendiction
  • trendkite
  • Yandex
  • ZoominfoBot, not related webmeeting system: zoom
  • Punkspider vulnerability scanner
  • WebDataStats, russian vulnerability scanner