smartprofitsolutions.de
robots.txt

Robots Exclusion Standard data for smartprofitsolutions.de

Resource Scan

Scan Details

Site Domain smartprofitsolutions.de
Base Domain smartprofitsolutions.de
Scan Status Ok
Last Scan2025-12-23T00:48:28+00:00
Next Scan 2026-01-22T00:48:28+00:00

Last Scan

Scanned2025-12-23T00:48:28+00:00
URL https://smartprofitsolutions.de/robots.txt
Domain IPs 217.160.0.121
Response IP 217.160.0.121
Found Yes
Hash f6ef695dc7e4e733f99fab1e5bbe9b78db4549cc4eff10e5b7547c48068264e6
SimHash 8171b49ba4d5

Groups

ia_archiver
scooter
atomz
fast-webcrawler
architextspider
googlebot
slurp.so/1.0
slurp/2.0j
slurp/2.0-kitehourly
slurp/2.0-owlweekly
slurp/3.0-au
ultraseek
mantraagent
lycos_spider_(t-rex)
msnbot/0.1
gulliver
scrubby/
zyborg

Rule Path
Disallow /de/management
Disallow /management
Disallow /*management