everyeye.it
robots.txt

Robots Exclusion Standard data for everyeye.it

Resource Scan

Scan Details

Site Domain everyeye.it
Base Domain everyeye.it
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-28T13:50:26+00:00
Next Scan 2024-07-27T13:50:26+00:00

Last Successful Scan

Scanned2023-01-01T20:09:24+00:00
URL https://everyeye.it/robots.txt
Redirect https://www.everyeye.it/robots.txt
Redirect Domain www.everyeye.it
Redirect Base everyeye.it
Domain IPs 104.22.0.44, 104.22.1.44, 172.67.21.223, 2606:4700:10::6816:12c, 2606:4700:10::6816:2c, 2606:4700:10::ac43:15df
Redirect IPs 104.22.0.44, 104.22.1.44, 172.67.21.223, 2606:4700:10::6816:12c, 2606:4700:10::6816:2c, 2606:4700:10::ac43:15df
Response IP 172.67.21.223
Found Yes
Hash 942040c4907805b734f8fe22a15da6551568a47ec5756376dca0d82ee409f248
SimHash c25c4682661a

Groups

*

Rule Path
Allow *.css
Allow *.js
Disallow /engine/*
Disallow /media/*
Allow /engine2008/players_4/iframe_video.asp
Allow /engine2008/players_2/everyeye_mediaplayer.swf
Disallow /engine2008/*
Disallow /sbbi/*
Disallow /paolo/*
Disallow /engine2013/*
Disallow /template2015/*
Disallow /include_statici/*
Disallow /*?tipo_news=
Disallow /*?filtro_news=
Disallow /*?cactus=
Disallow /engine2015/stampa_ajax/top/
Disallow /engine2015/stampa_ajax/servizio/topskin/

googlebot-news

Rule Path
Disallow /imgad/

mediapartners-google

Rule Path
Allow /

acunetix

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bomborabot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

pimeyesbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

screaming frog seo

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

sogou

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

voluumdsp-content-bot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

trendkite-akashic-crawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.everyeye.it/sitemaps/sitemap.xml
sitemap https://www.everyeye.it/sitemaps/sitemap-news.xml

Comments

  • --Good--
  • --Bad--