dobraknjiga.rs
robots.txt
Robots Exclusion Standard data for dobraknjiga.rs
Resource Scan
Scan Details
Site Domain | dobraknjiga.rs |
Base Domain | dobraknjiga.rs |
Scan Status | Ok |
Last Scan | 2024-09-14T14:00:54+00:00 |
Next Scan | 2024-10-14T14:00:54+00:00 |
Last Scan
Scanned | 2024-09-14T14:00:54+00:00 |
URL | https://www.dobraknjiga.rs/robots.txt |
Domain IPs | 104.21.40.19, 172.67.174.131, 2606:4700:3031::ac43:ae83, 2606:4700:3037::6815:2813 |
Response IP | 172.67.174.131 |
Found | Yes |
Hash | 221dffc6d919aad6b82f2c7e83a232014365df30bb6a4b2d0e3ff1e30f26c799 |
SimHash | 9a9e5d485eb0 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /*?filter=* |
Disallow | /*?view=* |
Disallow | /home.asp |
Disallow | /Home.asp |
Disallow | /sr/pretraga/ |
Other Records
Field | Value |
---|---|
crawl-delay | 120 |
Comments