Log In Sign Up

screenweek.it
robots.txt

Robots Exclusion Standard data for screenweek.it

Resource Scan

Scan Details

Site Domain screenweek.it
Base Domain screenweek.it
Scan Status Ok
Last Scan2024-06-09T18:36:18+00:00
Next Scan 2024-07-09T18:36:18+00:00

Last Scan

Scanned2024-06-09T18:36:18+00:00
URL https://screenweek.it/robots.txt
Redirect https://www.screenweek.it:443/robots.txt
Redirect Domain www.screenweek.it
Redirect Base screenweek.it
Domain IPs 52.213.137.166
Redirect IPs 52.19.65.218, 52.214.21.241, 54.220.157.4
Response IP 52.214.21.241
Found Yes
Hash 5581e6d0e4761d4b46b15b78d2c6c75901c266c13c997229db8ab5ac9df8c351
SimHash 777de062e611

Groups

acunetix
ahrefsbot*
awariorssbot
awariosmartbot
blexbot*
bomborabot
bubing
chinaclaw
dotbot
diibot
fhscan
mj12bot
mauibot
megaindex.ru
npbot*
serpstatbot
trendictionbot
sogou spider
sogou web spider
screaming frog seo
veooz
veoozbot
petalbot

Rule Path
Disallow /

*
googlebot
adsbot-google
mediapartners-google

Rule Path
Disallow /galleria/
Disallow /images/
Disallow /magazine/
Disallow /eventi
Disallow /embed
Disallow /links/
Disallow /act_to_gallery/
Disallow /tweets/*/flag_content
Disallow /backup/
Disallow /banners/
Disallow /img/
Back to top

Other Records

Field Value
sitemap https://www.screenweek.it/sitemaps/recently_updated.xml.gz
sitemap https://www.screenweek.it/sitemaps/sitemap.xml.gz
Back to top

Comments

  • Bad Bots
  • User-agent: Yandex
  • User-agent: Baiduspider
  • User-agent: Cliqzbot
  • User-agent: SemrushBot*
  • Good Bots
Back to top