fotovoltaico.news
robots.txt

Robots Exclusion Standard data for fotovoltaico.news

Resource Scan

Scan Details

Site Domain fotovoltaico.news
Base Domain fotovoltaico.news
Scan Status Ok
Last Scan2024-06-05T18:57:08+00:00
Next Scan 2024-06-12T18:57:08+00:00

Last Scan

Scanned2024-06-05T18:57:08+00:00
URL https://fotovoltaico.news/robots.txt
Redirect http://www.fotovoltaico.news/robots.txt
Redirect Domain www.fotovoltaico.news
Redirect Base fotovoltaico.news
Domain IPs 104.21.25.159, 172.67.134.93, 2606:4700:3031::6815:199f, 2606:4700:3031::ac43:865d
Redirect IPs 104.21.25.159, 172.67.134.93, 2606:4700:3031::6815:199f, 2606:4700:3031::ac43:865d
Response IP 104.21.25.159
Found Yes
Hash 979390a062232622e6e0686142fdbbfd005884e32000f9ae05e63431b5199c59
SimHash 22d49e01467a

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /rdr.php
Disallow /rdrxml.php
Disallow /rdriframe.php
Disallow /iframe.php
Disallow /forum/post/
Disallow /forum/captcha/
Disallow /user/cp/
Disallow /user/s123/
Disallow /user/filaki.php
Disallow /user/annunci.php
Disallow /user/forum-abuse.php
Disallow /tag/
Disallow /articolo/
Disallow /blogs/
Disallow /crono
Disallow /eyeblaster/
Disallow /experimental/
Disallow /argomenti/
Disallow /*%26page%3D
Disallow /notizia/

*

Rule Path
Allow /blogs/vote.php
Allow /blogs/publish.php

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

whitevector crawler

Rule Path
Disallow /

speedy

Rule Path
Disallow /

spbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /