built.sk
robots.txt

Robots Exclusion Standard data for built.sk

Resource Scan

Scan Details

Site Domain built.sk
Base Domain built.sk
Scan Status Ok
Last Scan2025-06-20T12:29:24+00:00
Next Scan 2025-07-20T12:29:24+00:00

Last Scan

Scanned2025-06-20T12:29:24+00:00
URL https://built.sk/robots.txt
Domain IPs 2a00:4b40:aaaa:2004::6, 37.9.175.156
Response IP 37.9.175.156
Found Yes
Hash deb8fe30c6b3d0006a642342f5a60e594f81f542ca84ac035719360ce52ef800
SimHash e000cb12c711

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /2014_backups/