intopic.it
robots.txt

Robots Exclusion Standard data for intopic.it

Resource Scan

Scan Details

Site Domain intopic.it
Base Domain intopic.it
Scan Status Ok
Last Scan2024-11-14T04:49:35+00:00
Next Scan 2024-11-21T04:49:35+00:00

Last Scan

Scanned2024-11-14T04:49:35+00:00
URL https://intopic.it/robots.txt
Redirect https://www.intopic.it/robots.txt
Redirect Domain www.intopic.it
Redirect Base intopic.it
Domain IPs 104.21.50.226, 172.67.167.166, 2606:4700:3031::6815:32e2, 2606:4700:3034::ac43:a7a6
Redirect IPs 104.21.50.226, 172.67.167.166, 2606:4700:3031::6815:32e2, 2606:4700:3034::ac43:a7a6
Response IP 172.67.167.166
Found Yes
Hash 872b98278225751cd11461938f0eec5475ff05c5efaf617840a2f2265a86672d
SimHash a3d45e014682

Groups

*

Rule Path
Disallow /rdr.php
Disallow /rdrxml.php
Disallow /rdriframe.php
Disallow /iframe.php
Disallow /forum/post/
Disallow /forum/captcha/
Disallow /forum/blogs/
Disallow /forum/intopic/
Disallow /forum/offtopic/
Disallow /forum/musica/tokio-hotel/
Disallow /forum/arte/ashley-tisdale/
Disallow /forum/televisione/high-school-musical/
Disallow /forum/arte/zac-efron/
Disallow /forum/televisione/vanessa-hudgens/
Disallow /forum/arte/miley-cyrus/
Disallow /forum/economia/antitrust/
Disallow /forum/italia/45811/p14/
Disallow /forum/italia/silvio-berlusconi/45811/p14/
Disallow /forum/varie/truffe/
Disallow /forum/economia/findomestic/
Disallow /forum/auto/72054/
Disallow /forum/auto/fernando-alonso/72054/
Disallow /forum/auto/ferrari/72054/
Disallow /forum/auto/gran-premio-del-brasile-san-paolo-interlagos/72054/
Disallow /user/cp/
Disallow /user/s123/
Disallow /user/filaki.php
Disallow /user/annunci.php
Disallow /user/forum-abuse.php
Disallow /tag/
Disallow /articolo/
Disallow /blogs/
Disallow /crono
Disallow /eyeblaster/
Disallow /experimental/
Disallow /argomenti/
Disallow /*%26page%3D
Disallow /notizia/

mediapartners-google

Rule Path
Disallow

*

Rule Path
Allow /blogs/vote.php
Allow /blogs/publish.php

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

whitevector crawler

Rule Path
Disallow /

speedy

Rule Path
Disallow /

spbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /