Log In Sign Up

accountdiscounts.com
robots.txt

Robots Exclusion Standard data for accountdiscounts.com

Resource Scan

Scan Details

Site Domain accountdiscounts.com
Base Domain accountdiscounts.com
Scan Status Ok
Last Scan2025-05-01T05:42:43+00:00
Next Scan 2025-05-31T05:42:43+00:00

Last Scan

Scanned2025-05-01T05:42:43+00:00
URL https://accountdiscounts.com/robots.txt
Domain IPs 51.68.218.88
Response IP 51.68.218.88
Found Yes
Hash 050c6ff50bf49c9db5c5aea752a817076eb5cd904988d82f83f09c823bfcb5dc
SimHash db7e5c51ae90

Groups

*

Rule Path
Disallow /go/
Disallow /click/

Other Records

Field Value
crawl-delay 3

awariorssbot
awariosmartbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

linguee

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mail.ru_bot/2.0

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

mail.ru_bot/2.0; +http://go.mail.ru/help/robots

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

semrush

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

crowdtanglebot

Rule Path
Disallow /

go-resty

Rule Path
Disallow /

researchscan

Rule Path
Disallow /

seekport

Rule Path
Disallow /

checkmarknetwork

Rule Path
Disallow /

indeedbot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

senutobot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://accountdiscounts.com/sitemapindex.xml
Back to top

Comments

  • Block SEOkicks
  • SEOkicks
  • Block MegaIndex.ru
  • MJ12bot
  • AhrefsBot
  • Mail.RU_Bot/2.0 Russia
  • Mail.RU Russia
  • Mail.Ru Russia
  • TurnitinBot
  • ZoomInfoBot
  • MauiBot
  • TweetmemeBot
  • magpie-crawler
  • YisouSpider
  • bytespider
  • semrush
  • BLEXbot
  • serpstatbot
  • CrowdTanglebot
  • go-resty
  • Researchscan
  • Seekport
  • CheckMarkNetwork
  • IndeedBot
  • 360Spider
Back to top

Warnings

  • 2 invalid lines.
Back to top