Log In Sign Up

timegenie.com
robots.txt

Robots Exclusion Standard data for timegenie.com

Resource Scan

Scan Details

Site Domain timegenie.com
Base Domain timegenie.com
Scan Status Ok
Last Scan2024-10-01T21:41:30+00:00
Next Scan 2024-10-08T21:41:30+00:00

Last Scan

Scanned2024-10-01T21:41:30+00:00
URL https://timegenie.com/robots.txt
Redirect https://www.timegenie.com/robots.txt
Redirect Domain www.timegenie.com
Redirect Base timegenie.com
Domain IPs 135.181.4.36
Redirect IPs 135.181.4.36
Response IP 135.181.4.36
Found Yes
Hash b9f8acc70203b5ef8ff7975fbbd4a8d32c258629dddb7ca8afc55aaa1dd3e363
SimHash 2cd45a124683

Groups

mediapartners-google

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

googlebot

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

adsbot-google

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

googlebot-news

Rule Path
Disallow /

googlebot-video

Rule Path
Disallow /

googlebot-mobile

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

accelobot

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

Other Records

Field Value
crawl-delay 30

adidxbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 30

archive.org_bot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 30

baiduspider

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

Other Records

Field Value
crawl-delay 30

bingbot

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

Other Records

Field Value
crawl-delay 20

blekkobot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 30

bountii bot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 30

butterfly

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

Other Records

Field Value
crawl-delay 30

dotbot

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

Other Records

Field Value
crawl-delay 30

duckduckbot

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

Other Records

Field Value
crawl-delay 30

etaospider

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 30

eventgurubot

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

Other Records

Field Value
crawl-delay 30

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 30

alexabot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 30

verifybot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 30

ichiro

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

Other Records

Field Value
crawl-delay 30

irlbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 3600

gigabot

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

Other Records

Field Value
crawl-delay 30

mail.ru

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

Other Records

Field Value
crawl-delay 10

mail.ru_bot/2.0

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

Other Records

Field Value
crawl-delay 10

meltwater

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 30

mj12bot

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

Other Records

Field Value
crawl-delay 30

naverbot

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

Other Records

Field Value
crawl-delay 30

newsnow

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 30

omgili

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 30

openindexspider

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

Other Records

Field Value
crawl-delay 30

picsearch

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 30

psbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 30

rogerbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 30

shopwiki

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 30

seznambot

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

Other Records

Field Value
crawl-delay 30

slurp

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

Other Records

Field Value
crawl-delay 30

sogou spider

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

Other Records

Field Value
crawl-delay 30

sosospider

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

Other Records

Field Value
crawl-delay 30

teoma

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

Other Records

Field Value
crawl-delay 30

webvac

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 30

webzip

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 30

yandex

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

Other Records

Field Value
crawl-delay 30

yeti

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

Other Records

Field Value
crawl-delay 30

yisouspider

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

Other Records

Field Value
crawl-delay 30

youdaobot

Rule Path
Disallow /_images/
Disallow /_flags_emblems/
Disallow /bnbchoices/

Other Records

Field Value
crawl-delay 30
Back to top

Other Records

Field Value
sitemap https://www.timegenie.com/sitemap_index.xml
Back to top

Warnings

  • 9 invalid lines.
Back to top