pyreneescathares.com
robots.txt
Robots Exclusion Standard data for pyreneescathares.com
Resource Scan
Scan Details
Site Domain | pyreneescathares.com |
Base Domain | pyreneescathares.com |
Scan Status | Ok |
Last Scan | 2025-09-28T00:17:31+00:00 |
Next Scan | 2025-10-12T00:17:31+00:00 |
Last Scan
Scanned | 2025-09-28T00:17:31+00:00 |
URL | https://www.pyreneescathares.com/robots.txt |
Domain IPs | 139.99.218.119 |
Response IP | 139.99.218.119 |
Found | Yes |
Hash | d5afed483541da5440f940215b73dcef994cd6268e1acd343ee05bcd09a75a80 |
SimHash | e582cf4605f0 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp/ |
Disallow | /r/ |
Disallow | /*.php$ |
Disallow | /*.twig$ |
Disallow | /*.inc$ |
Disallow | /*?*p= |
Disallow | /*obf.min.js |
Disallow | /*__hstc%3D* |
Disallow | /*__hssc%3D* |
Disallow | /*__hspf%3D* |
Disallow | /*/feed |
Disallow | /*/comments |
Disallow | /*page_id%3D |
Disallow | /*listpage%3D1$ |
Disallow | /*preview_id%3D |
Disallow | /*preview_nonce%3D |
Disallow | /*preview%3D |
Disallow | /*query%3D |
Disallow | /api/myaccount |
Disallow | /api/content/ts/*/sheets |
Disallow | /wp-json/woody/crop-url/* |
Disallow | /woody_model/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.pyreneescathares.com/sitemap.xml/ |
Comments