topster.it
robots.txt

Robots Exclusion Standard data for topster.it

Resource Scan

Scan Details

Site Domain topster.it
Base Domain topster.it
Scan Status Ok
Last Scan2025-09-19T14:05:20+00:00
Next Scan 2025-10-19T14:05:20+00:00

Last Scan

Scanned2025-09-19T14:05:20+00:00
URL https://topster.it/robots.txt
Redirect https://www.topster.de/robots.txt
Redirect Domain www.topster.de
Redirect Base topster.de
Domain IPs 185.30.32.87
Redirect IPs 185.30.32.87
Response IP 185.30.32.87
Found Yes
Hash 068ab948befa8a11fe6420f16f05862c3f399bd9ff563eb759e55fd25d49f890
SimHash 88545a80c352

Groups

*

Rule Path
Disallow /en/
Disallow /pt/
Disallow /pl/
Disallow /fr/
Disallow /it/
Disallow /zh/

httrack

Rule Path
Disallow /

kfsw-bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /