netzikon.net
robots.txt
Robots Exclusion Standard data for netzikon.net
Resource Scan
Scan Details
| Site Domain | netzikon.net |
| Base Domain | netzikon.net |
| Scan Status | Ok |
| Last Scan | 2025-11-05T06:41:05+00:00 |
| Next Scan | 2025-11-12T06:41:05+00:00 |
Last Scan
| Scanned | 2025-11-05T06:41:05+00:00 |
| URL | https://netzikon.net/robots.txt |
| Domain IPs | 2a01:4f8:c010:3112::1, 5.75.235.30 |
| Response IP | 5.75.235.30 |
| Found | Yes |
| Hash | 9784fe46a2e0abb1ae1db7467514b1e55e84f808594af99bbb58cef597aa8eea |
| SimHash | 24de5994c413 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /test/ |
| Disallow | /cgi-bin/ |
| Disallow | /hidden/ |
| Disallow | /rfc/txt |
laycat
jobs.de-robot
eurobot
gigabot
speedy
surveybot_ignoreip
surveybot
heise-it-markt-crawler
sitecheck.internetseer.com
zealbot
msiecrawler
sitesnagger
webstripper
webcopier
fetch
offline explorer
teleport
teleportpro
webzip
linko
httrack
microsoft.url.control
xenu
larbin
libwww
zyborg
download ninja
wget
grub-client
webreaper
scoutjet
jobroboter
gonzo*
envolk
psbot
crawly
baiduspider
blogpulselive
searchlink
woriobot
snapbot
flatlandbot
infometrics-bot
exabot
mj12bot
youdaobot
touche
sosospider
tasapspider
euripbot
iearthworm
| Rule | Path |
|---|---|
| Disallow | / |
Comments