Log In Sign Up

dryusdan.space
robots.txt

Robots Exclusion Standard data for dryusdan.space

Resource Scan

Scan Details

Site Domain dryusdan.space
Base Domain dryusdan.space
Scan Status Ok
Last Scan2024-09-24T17:05:59+00:00
Next Scan 2024-10-24T17:05:59+00:00

Last Scan

Scanned2024-09-24T17:05:59+00:00
URL https://dryusdan.space/robots.txt
Domain IPs 2a01:e0a:21a:17a7:1:5ee:bad:c0de, 82.66.66.131
Response IP 82.66.66.131
Found Yes
Hash 47593ac121b1fcd904f3a7640ac635f2deab8d7eca4cc9995aa039f7f081694d
SimHash 58b77f504c77

Groups

chatgpt-user

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

anderspinkbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

ev-crawler

Rule Path
Disallow /

google-safety

Rule Path
Disallow /

hubspot

Rule Path
Disallow /

ioncrawl

Rule Path
Disallow /

lightspeedsystemscrawler

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

muckrack

Rule Path
Disallow /

netcraftsurveyagent

Rule Path
Disallow /

netvibes

Rule Path
Disallow /

pandalytics

Rule Path
Disallow /

proximic

Rule Path
Disallow /

scoop.it

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

trendsmapresolver

Rule Path
Disallow /

turnitin

Rule Path
Disallow /

twingly

Rule Path
Disallow /

um-ln

Rule Path
Disallow /

virustotal

Rule Path
Disallow /

dataprovider.com

Rule Path
Disallow /

dcrawl

Rule Path
Disallow /

httrack

Rule Path
Disallow /

httrack 3.0

Rule Path
Disallow /

metainspector

Rule Path
Disallow /

newspaper

Rule Path
Disallow /

nutch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

hypestat

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /
Back to top

Comments

  • AI Assistant
  • https://darkvisitors.com/agents/chatgpt-user
  • AI Data Scraper
  • https://darkvisitors.com/agents/bytespider
  • AI Data Scraper
  • https://darkvisitors.com/agents/ccbot
  • AI Data Scraper
  • https://darkvisitors.com/agents/claudebot
  • AI Data Scraper
  • https://darkvisitors.com/agents/diffbot
  • AI Data Scraper
  • https://darkvisitors.com/agents/facebookbot
  • AI Data Scraper
  • https://darkvisitors.com/agents/google-extended
  • AI Data Scraper
  • https://darkvisitors.com/agents/gptbot
  • AI Data Scraper
  • https://darkvisitors.com/agents/omgili
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/anderspinkbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/awariobot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/awariosmartbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/ev-crawler
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/google-safety
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/hubspot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/ioncrawl
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/lightspeedsystemscrawler
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/linkfluence
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/magpie-crawler
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/mediatoolkitbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/muckrack
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/netcraftsurveyagent
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/netvibes
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/pandalytics
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/proximic
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/scoop-it
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/trendictionbot
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/trendsmapresolver
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/turnitin
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/twingly
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/um-ln
  • Intelligence Gatherer
  • https://darkvisitors.com/agents/virustotal
  • Scraper
  • https://darkvisitors.com/agents/008
  • Scraper
  • https://darkvisitors.com/agents/dataprovider-com
  • Scraper
  • https://darkvisitors.com/agents/dcrawl
  • Scraper
  • https://darkvisitors.com/agents/httrack
  • Scraper
  • https://darkvisitors.com/agents/httrack-3-0
  • Scraper
  • https://darkvisitors.com/agents/metainspector
  • Scraper
  • https://darkvisitors.com/agents/newspaper
  • Scraper
  • https://darkvisitors.com/agents/nutch
  • Scraper
  • https://darkvisitors.com/agents/offline-explorer
  • Scraper
  • https://darkvisitors.com/agents/scrapy
  • SEO Crawler
  • https://darkvisitors.com/agents/ahrefsbot
  • SEO Crawler
  • https://darkvisitors.com/agents/barkrowler
  • SEO Crawler
  • https://darkvisitors.com/agents/blexbot
  • SEO Crawler
  • https://darkvisitors.com/agents/dataforseobot
  • SEO Crawler
  • https://darkvisitors.com/agents/domainstatsbot
  • SEO Crawler
  • https://darkvisitors.com/agents/dotbot
  • SEO Crawler
  • https://darkvisitors.com/agents/hypestat
  • SEO Crawler
  • https://darkvisitors.com/agents/linkdexbot
  • SEO Crawler
  • https://darkvisitors.com/agents/mj12bot
  • SEO Crawler
  • https://darkvisitors.com/agents/screaming-frog-seo-spider
  • SEO Crawler
  • https://darkvisitors.com/agents/semrushbot
  • SEO Crawler
  • https://darkvisitors.com/agents/semrushbot-ba
  • SEO Crawler
  • https://darkvisitors.com/agents/semrushbot-ct
  • SEO Crawler
  • https://darkvisitors.com/agents/semrushbot-si
  • SEO Crawler
  • https://darkvisitors.com/agents/semrushbot-swa
  • SEO Crawler
  • https://darkvisitors.com/agents/serpstatbot
  • SEO Crawler
  • https://darkvisitors.com/agents/zoombot
  • Undocumented AI Agent
  • https://darkvisitors.com/agents/anthropic-ai
  • Undocumented AI Agent
  • https://darkvisitors.com/agents/claude-web
  • Undocumented AI Agent
  • https://darkvisitors.com/agents/cohere-ai
  • Custom categories
  • https://darkvisitors.com/agents/ahrefssiteaudit
  • Custom categories
  • https://darkvisitors.com/agents/mail-ru-bot
  • Custom categories
  • https://darkvisitors.com/agents/twitterbot
Back to top

Warnings

  • 2 invalid lines.
Back to top