benvingutsapages.cat
robots.txt

Robots Exclusion Standard data for benvingutsapages.cat

Resource Scan

Scan Details

Site Domain benvingutsapages.cat
Base Domain benvingutsapages.cat
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-07-12T01:30:13+00:00
Next Scan 2025-10-10T01:30:13+00:00

Last Successful Scan

Scanned2024-02-26T01:11:22+00:00
URL https://benvingutsapages.cat/robots.txt
Domain IPs 185.66.41.36
Response IP 185.66.41.36
Found Yes
Hash 4054601403da390ff959325768c179a73ec8618a6e820e859b2506b0b1832fcc
SimHash 2819d810e3f0

Groups

googlebot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 300

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 300

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 300

*

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 300