giorgiotave.it
robots.txt

Robots Exclusion Standard data for giorgiotave.it

Resource Scan

Scan Details

Site Domain giorgiotave.it
Base Domain giorgiotave.it
Scan Status Ok
Last Scan2025-07-09T04:38:54+00:00
Next Scan 2025-08-08T04:38:54+00:00

Last Scan

Scanned2025-07-09T04:38:54+00:00
URL https://giorgiotave.it/robots.txt
Domain IPs 104.21.45.174, 172.67.217.10, 2606:4700:3034::6815:2dae, 2606:4700:3034::ac43:d90a
Response IP 172.67.217.10
Found Yes
Hash 7457d59ba0824c544547d260f125b51854d788fc201d8dd3191f31f6bca0cfee
SimHash 431472c245f7

Groups

*

Rule Path
Allow /
Disallow /greet.php
Disallow /widgets/
Disallow /directory/listing.php
Disallow /directory/*cat_path*
Disallow /ray/
Disallow /directory/%7B*
Disallow /wikigt/index.php?title=*
Disallow /wikigt/*action%3Dedit*
Disallow /wikigt/os/Discussione%3A
Disallow /wikigt/os/Discussione%3A
Disallow /directory/browse.php?*cat=*%2Fmore*.html
Disallow /directory/browse.php?*
Disallow /forum/velocipedi-equestri/profile.php
Disallow /directory/rss.php?type=*&cat=*

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

yandex

Rule Path
Disallow /

coccoc

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

fatbot

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

psbot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

willybot

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

germcrawler

Rule Path
Disallow /