publiweb.com
robots.txt

Robots Exclusion Standard data for publiweb.com

Resource Scan

Scan Details

Site Domain publiweb.com
Base Domain publiweb.com
Scan Status Ok
Last Scan2024-09-21T06:21:13+00:00
Next Scan 2024-09-28T06:21:13+00:00

Last Scan

Scanned2024-09-21T06:21:13+00:00
URL https://publiweb.com/robots.txt
Redirect https://www.publiweb.com/robots.txt
Redirect Domain www.publiweb.com
Redirect Base publiweb.com
Domain IPs 2a02:af8:fab0:807:94:76:251:207, 94.76.251.207
Redirect IPs 2a02:af8:fab0:807:94:76:251:207, 94.76.251.207
Response IP 94.76.251.207
Found Yes
Hash e1baade3f267db0714fddfd5a6985399ac82f1964e29ba8e50b2614a2302595b
SimHash 4376976a4f81

Groups

*

Rule Path
Disallow /gallery

*

Rule Path
Disallow /email

*

Rule Path
Disallow /paypal

*

Rule Path
Disallow /spazio_utenti

*

Rule Path
Disallow /ban

*

Rule Path
Disallow /facebook

*

Rule Path
Disallow /fotogallery

*

Rule Path
Disallow /salagiochi/cgi-swf

*

Rule Path
Disallow /mia-tv

*

Rule Path
Disallow /cgi-bin/goto

serpstatbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

webmirror

Rule Path
Disallow /

webcopy

Rule Path
Disallow /

winhttrack

Rule Path
Disallow /

website extractor

Rule Path
Disallow /

superbot

Rule Path
Disallow /

superbot/2.6

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

black hole

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

netattache

Rule Path
Disallow /

netattache light 1.1

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

mozilla/4

Rule Path
Disallow /

mozilla/4.0 (compatible; msie 4.0; windows nt)

Rule Path
Disallow /

mozilla/4.0 (compatible; msie 4.0; windows 95)

Rule Path
Disallow /

mozilla/4.0 (compatible; msie 4.0; windows 98)

Rule Path
Disallow /

teleport

Rule Path
Disallow /

wget

Rule Path
Disallow /

telesoft

Rule Path
Disallow /

webzip

Rule Path
Disallow /

moget/2.1

Rule Path
Disallow /

webzip/4.0

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webstripper/2.02

Rule Path
Disallow /

websauger

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

microsoft url control - 5.01.4511

Rule Path
Disallow /

webmasterworldforumbot

Rule Path
Disallow /

spankbot

Rule Path
Disallow /

lwp-trivial/1.34

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

wget/1.6

Rule Path
Disallow /

microsoft url control - 6.00.8169

Rule Path
Disallow /

urly warning

Rule Path
Disallow /

wget/1.5.3

Rule Path
Disallow /

mata hari

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

web image collector

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /