Log In Sign Up

realtimes2020.com
robots.txt

Robots Exclusion Standard data for realtimes2020.com

Resource Scan

Scan Details

Site Domain realtimes2020.com
Base Domain realtimes2020.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-01T23:12:41+00:00
Next Scan 2024-09-29T23:12:41+00:00

Last Successful Scan

Scanned2022-12-08T18:02:36+00:00
URL https://realtimes2020.com/robots.txt
Redirect http://www.realtimes2020.com/robots.txt
Redirect Domain www.realtimes2020.com
Redirect Base realtimes2020.com
Domain IPs 104.21.93.197, 172.67.214.51, 2606:4700:3030::ac43:d633, 2606:4700:3035::6815:5dc5
Redirect IPs 104.21.93.197, 172.67.214.51, 2606:4700:3030::ac43:d633, 2606:4700:3035::6815:5dc5
Response IP 104.21.93.197
Found Yes
Hash 3617c3257df4fd54b3f5b4eded19f7299494a47864aec850247e8906e33d5a33
SimHash 94554a1201d7

Groups

twitterbot

Rule Path
Allow /

seznambot

Rule Path
Allow /

bingbot

Rule Path
Allow /

googlebot

Rule Path
Allow /

yandexbot

Rule Path
Allow /

sogou spider

Rule Path
Allow /

yahoo!

Rule Path
Allow /

baiduspider

Rule Path
Allow /

yoozbot

Rule Path
Allow /

coccocbot

Rule Path
Allow /

omgilibot

Rule Path
Allow /

cliqzbot

Rule Path
Allow /

istellabot

Rule Path
Allow /

naverbot

Rule Path
Allow /

mail.ru bot

Rule Path
Allow /

mojeekbot

Rule Path
Allow /

applebot

Rule Path
Allow /

yisouspider

Rule Path
Allow /

exabot

Rule Path
Allow /

psbot

Rule Path
Allow /

swobblspider

Rule Path
Allow /

yacybot

Rule Path
Allow /

vebidoobot

Rule Path
Allow /

elefent

Rule Path
Allow /

qwantify

Rule Path
Allow /

gigabot

Rule Path
Allow /

tineye

Rule Path
Allow /

auskunftbot

Rule Path
Allow /

laserlikebot

Rule Path
Allow /

daumoa

Rule Path
Allow /

arielisbot

Rule Path
Allow /

wbsearchbot

Rule Path
Allow /

deusu

Rule Path
Allow /

wotbox

Rule Path
Allow /

plukkie

Rule Path
Allow /

saucenao

Rule Path
Allow /

kd bot

Rule Path
Allow /

metajobbot

Rule Path
Allow /

idbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

netpursual

Rule Path
Allow /

femtosearchbot

Rule Path
Allow /

googlebot

Rule Path
Allow /

seeker

Rule Path
Allow /

solofield bot

Rule Path
Allow /

orangebot

Rule Path
Allow /

toweyabot

Rule Path
Allow /

izsearch.com

Rule Path
Allow /

iskanie

Rule Path
Allow /

iqdb

Rule Path
Allow /

storm-crawler

Rule Path
Allow /

sputnikbot

Rule Path
Allow /

teeraidbot

Rule Path
Allow /

openfosbot

Rule Path
Allow /

kaz.kz_bot

Rule Path
Allow /

exif-search

Rule Path
Allow /

popin_agent

Rule Path
Allow /

yeti

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

*

Rule Path
Disallow /
Back to top

Warnings

  • 2 invalid lines.
Back to top