fmach.it
robots.txt
Robots Exclusion Standard data for fmach.it
Resource Scan
Scan Details
Site Domain | fmach.it |
Base Domain | fmach.it |
Scan Status | Ok |
Last Scan | 2024-10-28T20:00:15+00:00 |
Next Scan | 2024-11-27T20:00:15+00:00 |
Last Scan
Scanned | 2024-10-28T20:00:15+00:00 |
URL | https://fmach.it/robots.txt |
Domain IPs | 99.80.82.152, 99.81.25.153 |
Response IP | 99.80.82.152 |
Found | Yes |
Hash | 37b48eb7f2727b59435d2f9931a8bd3b628b0d43b22856c55e557714da88dba4 |
SimHash | 634776726ba7 |
Groups
*
Rule | Path |
---|---|
Disallow | /Classificazioni/ |
Disallow | /backend/ |
Disallow | /content/search |
Disallow | /content/advancedsearch |
Disallow | /api/ |
Disallow | /layout/ |
Disallow | /content/keyword |
Disallow | /debug |
Disallow | /Media/ |
Disallow | /*/%28tag%29/ |
Disallow | /backend/Media |
Disallow | /backend/user |
Disallow | /backend/api/opendata |
Disallow | /backend/opendata |
Disallow | /backend/content/advancedsearch |
Disallow | /backend/content/search |
Disallow | /backend/content/view |
Disallow | /backend/layout |
Disallow | /en/Media |
Disallow | /en/user |
Disallow | /en/api/opendata |
Disallow | /en/opendata |
Disallow | /en/content/advancedsearch |
Disallow | /en/content/search |
Disallow | /en/content/view |
Disallow | /en/layout |
Disallow | /Media |
Disallow | /user |
Disallow | /api/opendata |
Disallow | /opendata |
Disallow | /content/view |
Disallow | /layout |
Disallow | /archivio |
Disallow | /archivio_backend |
Disallow | /archive |
Disallow | /old |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Warnings
- 8 invalid lines.
- `request-rate` is not a known field.
- `visit-time` is not a known field.
Comments