cosmodatastock.gr
robots.txt
Robots Exclusion Standard data for cosmodatastock.gr
Resource Scan
Scan Details
Site Domain | cosmodatastock.gr |
Base Domain | cosmodatastock.gr |
Scan Status | Ok |
Last Scan | 2024-06-02T22:31:25+00:00 |
Next Scan | 2024-07-02T22:31:25+00:00 |
Last Scan
Scanned | 2024-06-02T22:31:25+00:00 |
URL | https://cosmodatastock.gr/robots.txt |
Domain IPs | 192.124.249.19 |
Response IP | 192.124.249.19 |
Found | Yes |
Hash | d31698b5acf35ee242bfa36e2d32683dcc1e254c2ff8288df26a7ac9260f44cf |
SimHash | 6908dc624990 |
Groups
*
Rule | Path |
---|---|
Disallow | /dev/ |
Disallow | /Scripts/ |
Other Records
Field | Value |
---|---|
crawl-delay | 20 |
Other Records
Field | Value |
---|---|
sitemap | http://www.cosmodata.gr/sitemap.xml |