mr.comingsoon.it
robots.txt

Robots Exclusion Standard data for mr.comingsoon.it

Resource Scan

Scan Details

Site Domain mr.comingsoon.it
Base Domain comingsoon.it
Scan Status Ok
Last Scan2024-05-28T17:27:55+00:00
Next Scan 2024-06-04T17:27:55+00:00

Last Scan

Scanned2024-05-28T17:27:55+00:00
URL https://mr.comingsoon.it/robots.txt
Domain IPs 104.22.70.145, 104.22.71.145, 172.67.23.189, 2606:4700:10::6816:4691, 2606:4700:10::6816:4791, 2606:4700:10::ac43:17bd
Response IP 104.22.70.145
Found Yes
Hash 3ab75f668ca6cbaf98cb961d4fbc5397eb4efcb75047d688076e58aa7218c2b8
SimHash 576d50e0e611

Groups

yandex
semrushbot*
acunetix
awariorssbot
awariosmartbot
bomborabot
bubing
chinaclaw
dotbot
diibot
fhscan
mj12bot
mauibot
megaindex.ru
serpstatbot
trendictionbot
sogou spider
sogou web spider
screaming frog seo
veooz
veoozbot
petalbot
ahrefsbot*
blexbot
criteobot*
npbot*
ttd-content

Rule Path
Disallow /

*
googlebot
adsbot-google
mediapartners-google

Rule Path
Disallow /backup/
Disallow /banners/
Disallow /imgdb/banner/

Comments

  • Bad Bots
  • User-agent: Baiduspider
  • User-agent: Cliqzbot
  • Good Bots