finduxevents.com
robots.txt

Robots Exclusion Standard data for finduxevents.com

Resource Scan

Scan Details

Site Domain finduxevents.com
Base Domain finduxevents.com
Scan Status Ok
Last Scan2024-09-24T22:02:57+00:00
Next Scan 2024-10-01T22:02:57+00:00

Last Scan

Scanned2024-09-24T22:02:57+00:00
URL https://finduxevents.com/robots.txt
Domain IPs 34.174.136.240
Response IP 34.174.136.240
Found Yes
Hash 5fd12d0cc296f580bcc49cb842db5e6d648da4d50da32e7034efd8cb8f78f03b
SimHash d74cdf534623

Groups

aihitbot
ahrefsbot
baiduspider
baiduspider-video
baiduspider-image
blekkobot
blexbot
meanpathbot
mail.ru_bot/2.0
ccbot/2.0
changedetection
cloudservermarketspider
coccoc
dotbot
docoloc
domainappender
exabot/3.0
grapeshotcrawler/2.0
gigablastopensource
megaindex.ru/2.0
megaindex.ru
mj12bot
genieo/1.0
gigablastopensource/1.0
haosouspider
lssrocketcrawler
searchmetricsbot
seznambot
sogou spider
semrushbot-sa
searchmetricsbot
sogou web spider/4.0
riddler
wotbox
wikido
meanpathbot
linqiascrapebot
mojeekbot
netseer
maxpointcrawler
wesee
yandex
naverbot
yeti
obot
youdaobot
yisouspider
riddler
skimbot
spbot
smtbot
seolyticscrawler
qwantify
prlog
ec2-test
lipperhey-kaus-australis

Rule Path
Disallow /

*

Rule Path
Disallow /upcoming/
Disallow /blackhole/

Other Records

Field Value
sitemap http://finduxevents.com/sitemap.xml

Comments

  • robots.txt
  • User-agent: Googlebot
  • Disallow:
  • User-agent: msnbot
  • Disallow:
  • User-agent: Slurp
  • Disallow:
  • User-agent: *
  • Disallow: /
  • User-agent: proximic