asianfoodlovers.de
robots.txt
Robots Exclusion Standard data for asianfoodlovers.de
Resource Scan
Scan Details
| Site Domain | asianfoodlovers.de |
| Base Domain | asianfoodlovers.de |
| Scan Status | Ok |
| Last Scan | 2024-05-26T16:44:45+00:00 |
| Next Scan | 2024-06-25T16:44:45+00:00 |
Last Scan
| Scanned | 2024-05-26T16:44:45+00:00 |
| URL | https://asianfoodlovers.de/robots.txt |
| Redirect | https://www.asianfoodlovers.de/robots.txt |
| Redirect Domain | www.asianfoodlovers.de |
| Redirect Base | asianfoodlovers.de |
| Domain IPs | 104.21.59.150, 172.67.179.190, 2606:4700:3030::6815:3b96, 2606:4700:3030::ac43:b3be |
| Redirect IPs | 104.21.59.150, 172.67.179.190, 2606:4700:3030::6815:3b96, 2606:4700:3030::ac43:b3be |
| Response IP | 104.21.59.150 |
| Found | Yes |
| Hash | eadab6b5822992b25394c15947e23277b8b0023b1dfeea42758e19528e13c0ea |
| SimHash | 554968c48d31 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *?query |
| Disallow | */cart |
| Disallow | */login |
| Disallow | *?sortCode= |
| Disallow | *SID%3D |
| Disallow | *land%3D |
| Disallow | *dieetinfo%3D |
| Disallow | *smaak%3D |
| Disallow | *pittigheid%3D |
| Disallow | *subcategorie%3D |
| Disallow | *order%3D |
| Disallow | *manufacturer%3D |
| Disallow | */p/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |