claim-event.xyz
robots.txt

Robots Exclusion Standard data for claim-event.xyz

Resource Scan

Scan Details

Site Domain claim-event.xyz
Base Domain claim-event.xyz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-24T18:07:17+00:00
Next Scan 2024-10-22T18:07:17+00:00

Last Successful Scan

Scanned2023-12-05T00:07:56+00:00
URL https://claim-event.xyz/robots.txt
Domain IPs 104.21.43.165, 172.67.181.184, 2606:4700:3033::6815:2ba5, 2606:4700:3036::ac43:b5b8
Response IP 104.21.43.165
Found Yes
Hash 82f65ccaae41ef2a153a69e3dd2f6975be41951c6a283765ff42b1995e4e98b4
SimHash 2c511b92e2ea

Groups

adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
adidxbot
applebot
applenewsbot
baiduspider
baiduspider-image
baiduspider-news
baiduspider-video
bingbot
bingpreview
bublupbot
ccbot
cliqzbot
coccoc
coccocbot-image
coccocbot-web
daumoa
dazoobot
deusu
duckduckbot
duckduckgo-favicons-bot
euripbot
exploratodo
facebookcatalog
facebookexternalhit
facebot
feedly
findxbot
googlebot
googlebot-image
googlebot-mobile
googlebot-news
googlebot-video
haosouspider
ichiro
istellabot
jikespider
lycos
mail.ru
mediapartners-google
microsoftpreview
mojeekbot
msnbot
msnbot-media
orangebot
pinterest
plukkie
qwantify
rambler
seznambot
sosospider
slurp
sogou blog
sogou inst spider
sogou news spider
sogou orion spider
sogou spider2
sogou web spider
sputnikbot
teoma
twitterbot
whatsapp
wotbox
yacybot
yandex
yandexmobilebot
yeti
yioopbot
yoozbot
youdaobot

Rule Path
Disallow

*

Rule Path
Disallow /

Comments

  • ROBOTS.TXT
  • Updates can be retrieved from: https://www.ditig.com/robots-txt-template
  • This document is licensed with a CC BY-NC-SA 4.0 license.
  • Last update: 2023-03-15

Warnings

  • 3 invalid lines.