tech.everyeye.it
robots.txt

Robots Exclusion Standard data for tech.everyeye.it

Resource Scan

Scan Details

Site Domain tech.everyeye.it
Base Domain everyeye.it
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-26T17:13:13+00:00
Next Scan 2024-07-25T17:13:13+00:00

Last Successful Scan

Scanned2022-12-07T16:43:32+00:00
URL https://tech.everyeye.it/robots.txt
Domain IPs 104.22.0.44, 104.22.1.44, 172.67.21.223, 2606:4700:10::6816:12c, 2606:4700:10::6816:2c, 2606:4700:10::ac43:15df
Response IP 104.22.0.44
Found Yes
Hash dcf0e779e49b165df450e34859b47fb1f6bc2d7db7b6905a789d370c54f12ae5
SimHash e24c0682c61a

Groups

*

Rule Path
Allow *.css
Allow *.js
Disallow /engine/*
Disallow /media/*
Allow /engine2008/players_4/iframe_video.asp
Allow /engine2008/players_2/everyeye_mediaplayer.swf
Disallow /engine2008/*
Disallow /sbbi/*
Disallow /paolo/*
Disallow /engine2013/*
Disallow /template2015/*
Disallow /include_statici/*
Disallow /*?tipo_news=
Disallow /*?filtro_news=
Disallow /*?cactus=
Disallow /engine2015/stampa_ajax/top/
Disallow /engine2015/stampa_ajax/servizio/topskin/

googlebot-news

Rule Path
Disallow /imgad/

mediapartners-google

Rule Path
Allow /

acunetix

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bomborabot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

pimeyesbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

screaming frog seo

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

sogou

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

voluumdsp-content-bot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

trendkite-akashic-crawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://tech.everyeye.it/sitemaps/sitemap-tech.xml
sitemap https://tech.everyeye.it/sitemaps/sitemap-news.xml

Comments

  • --Good--
  • --Bad--