primersegona.cat
robots.txt

Robots Exclusion Standard data for primersegona.cat

Resource Scan

Scan Details

Site Domain primersegona.cat
Base Domain primersegona.cat
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-07-02T11:44:14+00:00
Next Scan 2025-08-01T11:44:14+00:00

Last Successful Scan

Scanned2025-05-11T07:24:57+00:00
URL https://primersegona.cat/robots.txt
Domain IPs 134.0.10.52
Response IP 134.0.10.52
Found Yes
Hash 9b6b5eac98d210264c7b2c826ecc65c48332a6b259d9efc334e28c34d1659efd
SimHash 631740508656

Groups

petalbot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /**.html$

Other Records

Field Value
crawl-delay 500

googlebot/2.1

Rule Path
Disallow /**.html$

Other Records

Field Value
crawl-delay 500

googlebot-image/1.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 500

Other Records

Field Value
sitemap https://primersegona.es/sitemap.xml