fresh.catering
robots.txt
Robots Exclusion Standard data for fresh.catering
Resource Scan
Scan Details
| Site Domain | fresh.catering |
| Base Domain | fresh.catering |
| Scan Status | Ok |
| Last Scan | 2026-02-07T20:24:57+00:00 |
| Next Scan | 2026-02-21T20:24:57+00:00 |
Last Scan
| Scanned | 2026-02-07T20:24:57+00:00 |
| URL | https://fresh.catering/robots.txt |
| Domain IPs | 104.21.59.117, 172.67.177.48, 2606:4700:3034::6815:3b75, 2606:4700:3034::ac43:b130 |
| Response IP | 172.67.177.48 |
| Found | Yes |
| Hash | 16004666de6c1632a854555887846c812692c18479865d0040bf2cedc116ab48 |
| SimHash | 46344b53c415 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /api/ |
| Disallow | /admin/ |
| Allow | /images/ |
| Allow | /videos/ |
| Allow | /services |
| Allow | /gallery |
| Allow | /contact |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://fresh.catering/sitemap.xml |
Warnings
- `content-signal` is not a known field.
Comments