berguedart.cat
robots.txt

Robots Exclusion Standard data for berguedart.cat

Resource Scan

Scan Details

Site Domain berguedart.cat
Base Domain berguedart.cat
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-09-10T23:48:31+00:00
Next Scan 2025-12-09T23:48:31+00:00

Last Successful Scan

Scanned2022-11-02T15:00:58+00:00
URL https://berguedart.cat/robots.txt
Response IP 185.66.41.9
Found Yes
Hash 93661cf643eeaea593f259dc9da901ef536dedb6e3f38ee313955f5ab9374500
SimHash 6200dc0063b0

Groups

*

Rule Path
Disallow

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10