comp.bg
robots.txt

Robots Exclusion Standard data for comp.bg

Resource Scan

Scan Details

Site Domain comp.bg
Base Domain comp.bg
Scan Status Ok
Last Scan2025-08-28T11:20:42+00:00
Next Scan 2025-09-27T11:20:42+00:00

Last Scan

Scanned2025-08-28T11:20:42+00:00
URL https://comp.bg/robots.txt
Domain IPs 104.21.22.159, 172.67.205.131, 2606:4700:3033::6815:169f, 2606:4700:3033::ac43:cd83
Response IP 104.21.22.159
Found Yes
Hash 19642b453cd1880ad6df6fc8186627052a5d1e89c3139443519d1456f1664485
SimHash 6518d072c331

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5