benlemi.hu
robots.txt
Robots Exclusion Standard data for benlemi.hu
Resource Scan
Scan Details
| Site Domain | benlemi.hu |
| Base Domain | benlemi.hu |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2025-11-23T23:18:00+00:00 |
| Next Scan | 2026-02-21T23:18:00+00:00 |
Last Successful Scan
| Scanned | 2024-01-27T19:04:12+00:00 |
| URL | https://benlemi.hu/robots.txt |
| Redirect | https://www.benlemi.hu/robots.txt |
| Redirect Domain | www.benlemi.hu |
| Redirect Base | benlemi.hu |
| Domain IPs | 104.21.28.190, 172.67.147.81, 2606:4700:3030::ac43:9351, 2606:4700:3036::6815:1cbe |
| Redirect IPs | 104.21.28.190, 172.67.147.81, 2606:4700:3030::ac43:9351, 2606:4700:3036::6815:1cbe |
| Response IP | 172.67.147.81 |
| Found | Yes |
| Hash | 37a998a714dda16c34639e30ac140dd2ded1e931679a73b4107079b26d7eb153 |
| SimHash | 31bfc4882fba |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /export/ |
| Disallow | /admin/ |
| Disallow | /script/ |
| Disallow | /api/ |
| Disallow | /action/ |
| Disallow | /*?priceMax |
| Disallow | /*?priceMin |
| Disallow | /*?parameterId |
| Disallow | /*?order |
| Disallow | /*?availabilityId |
| Disallow | /*?manufacturerId |
| Disallow | /*?stock |
| Disallow | /*?pv*=*%2C |
| Disallow | /*%26pv*%3D*%2C |
| Disallow | /*?pv*=*&pv*= |
| Disallow | /*%26pv*%3D*%26pv*%3D |
| Disallow | /*%3A*%2C*/ |
| Disallow | /*/?backTo= |
| Disallow | /*?dd=*%2C |
| Disallow | /*%26dd%3D*%2C |
| Disallow | /*?dd=*&pv*= |
| Disallow | /*?pv*=*&dd= |
| Disallow | /*/?letter=* |
| Disallow | /kereses/ |
| Disallow | /kosar/ |
| Disallow | /bejelentkezes/ |
| Disallow | /regisztracio/ |
| Disallow | /ugyfel/elfelejtett-jelszo/ |
| Disallow | /affiliate-regisztracio/ |
| Disallow | /affiliate-elfelejtett-jelszo/ |
| Disallow | /ugyfel/ |
| Disallow | /affiliate/accounts/ |
| Disallow | /affiliate/scripts/ |
| Disallow | /*%3Adiskuse |
| Disallow | /*%3Adotaz |
| Disallow | /*%3Ahlidat-cenu |
| Disallow | /*%3Aklient-hodnoceni |
| Disallow | /*%3Amoznosti-dopravy |
| Disallow | /*%3Awysiwyg |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.benlemi.hu/sitemap.xml |
Warnings
- 1 invalid line.