katolsk.no
robots.txt
Robots Exclusion Standard data for katolsk.no
Resource Scan
Scan Details
Site Domain | katolsk.no |
Base Domain | katolsk.no |
Scan Status | Ok |
Last Scan | 2024-06-02T16:52:38+00:00 |
Next Scan | 2024-07-02T16:52:38+00:00 |
Last Scan
Scanned | 2024-06-02T16:52:38+00:00 |
URL | https://katolsk.no/robots.txt |
Domain IPs | 2a02:270:2019::15, 77.88.108.15 |
Response IP | 77.88.108.15 |
Found | Yes |
Hash | c8ecda1276a988ace9d3fe7c4738a19a2c5e3c302ac2a44bfd2b46f5baf2ae72 |
SimHash | 2e30ef524ca0 |
Groups
*
Rule | Path |
---|---|
Disallow | /biografier/historisk/minnedager/list.html |
Disallow | /biografier/historisk/minnedager/past.html |
Disallow | /biografier/historisk/minnedager/day.html |
Disallow | /biografier/historisk/minnedager/date.html |
Disallow | /biografier/historisk/minnedager/week.html |
Disallow | /biografier/historisk/minnedager/month.html |
*
Rule | Path |
---|---|
Disallow | /services/ |
Disallow | /%2B%2B* |
Disallow | /*sendto_form$ |
Disallow | /*folder_factories$ |
Disallow | /*ics_view$ |
Disallow | /*vcs_view$ |
Disallow | %40%40 |
Disallow | /%40%40search |
Disallow | /search |
Disallow | /*?* |
Disallow | /*%3D* |
Disallow | /biografier/historisk/minnedager |
Other Records
Field | Value |
---|---|
crawl-delay | 90 |
Warnings
- 2 invalid lines.
Comments