port01.com
robots.txt

Robots Exclusion Standard data for port01.com

Resource Scan

Scan Details

Site Domain port01.com
Base Domain port01.com
Scan Status Ok
Last Scan2024-10-06T04:11:01+00:00
Next Scan 2024-10-13T04:11:01+00:00

Last Scan

Scanned2024-10-06T04:11:01+00:00
URL https://port01.com/robots.txt
Redirect https://www.port01.com/robots.txt
Redirect Domain www.port01.com
Redirect Base port01.com
Domain IPs 136.243.165.112, 2a01:4f8:d0a:6346::2
Redirect IPs 136.243.165.112, 2a01:4f8:d0a:6346::2
Response IP 136.243.165.112
Found Yes
Hash 6e860e50d28ed632c5042c3a7b83dc96176f25d44bce4de73d0a0edcac1852e4
SimHash b9d159918ee1

Groups

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

*

Rule Path
Disallow /Dresden/
Disallow /Leipzig/
Disallow /Stuttgart/
Disallow /Mnchen/
Disallow /Chemnitz/
Disallow /Dsseldorf/
Disallow /Bremen/
Disallow /Plauen_Zwickau/
Disallow /Erfurt/
Disallow /Magdeburg/
Disallow /Bautzen/
Disallow /Zwickau/
Disallow /Essen/
Disallow /Wrzburg/
Disallow /Kleve/
Disallow /Ludwigsburg/
Disallow /Berlin/
Disallow /Regensburg/
Disallow /Nrdliche_Oberpfalz/
Disallow /Hannover/
Disallow /Jena_Weimar/
Disallow /Cottbus/
Disallow /Bayerisches_Oberland/
Disallow /Ibiza/
Disallow /Mnster/
Disallow /Halle/
Disallow /Bocholt/
Disallow /Schwerin_Wismar/
Disallow /Ulm_NeuUlm/
Disallow /Stralsund/
Disallow /Gieen_Marburg_Wetzlar/
Disallow /Krefeld/
Disallow /Gera/
Disallow /Bochum/
Disallow /Mnchengladbach/
Disallow /Pforzheim/
Disallow /Ingolstadt/
Disallow /Straubing_Deggendorf/
Disallow /Wesel/
Disallow /Augsburg/
Disallow /Mainz/
Disallow /Landshut/
Disallow /Kassel/
Disallow /Gelsenkirchen/
Disallow /Konstanz/
Disallow /Oberhausen_Mlheim/
Disallow /Nrnberg/
Disallow /Kiel/
Disallow /Kln/
Disallow /Lbeck/
Disallow /Rosenheim/
Disallow /Dorsten/
Disallow /Hamburg/
Disallow /Rostock/
Disallow /Freiburg/
Disallow /Krefeldalt/
Disallow /Bonn/
Disallow /Paderborn/
Disallow /Flensburg/
Disallow /Koblenz/
Disallow /La_Palma/