agnet.cz
robots.txt

Robots Exclusion Standard data for agnet.cz

Resource Scan

Scan Details

Site Domain agnet.cz
Base Domain agnet.cz
Scan Status Ok
Last Scan2024-09-08T08:18:48+00:00
Next Scan 2024-10-08T08:18:48+00:00

Last Scan

Scanned2024-09-08T08:18:48+00:00
URL https://agnet.cz/robots.txt
Domain IPs 3.73.27.108
Response IP 3.73.27.108
Found Yes
Hash 8b5fbcedb5cb69c4d9f6d1e06bd8b7703acd5ceebd1074e4c22bddf5f63cd752
SimHash 6814dcd4c323

Groups

psbot

Rule Path
Disallow /

*

Rule Path
Disallow /servers/frontend/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://agnet.cz/sitemap.xml