libelle.be
robots.txt
Robots Exclusion Standard data for libelle.be
Resource Scan
Scan Details
| Site Domain | libelle.be |
| Base Domain | libelle.be |
| Scan Status | Ok |
| Last Scan | 2024-06-22T16:55:04+00:00 |
| Next Scan | 2024-06-29T16:55:04+00:00 |
Last Scan
| Scanned | 2024-06-22T16:55:04+00:00 |
| URL | https://www.libelle.be/robots.txt |
| Domain IPs | 108.138.246.101, 108.138.246.106, 108.138.246.23, 108.138.246.40 |
| Response IP | 18.165.171.91 |
| Found | Yes |
| Hash | 0c3b2729e96f4c70a4c2df1b4d4292744035ffbefb8f7b36e963afeb10093ef2 |
| SimHash | 59251a214592 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?p= |
| Disallow | /*?*&p= |
| Disallow | /*?rmg_dologin= |
| Disallow | /*?*&rmg_dologin= |
| Disallow | */feed/ |
| Disallow | */ajax/ |
| Disallow | /*?mail= |
| Disallow | /*?recId= |
| Disallow | /*?lnkId= |
| Disallow | /*?dishId= |
| Disallow | /*?keyword= |
| Disallow | /*?bestof= |
| Disallow | /*?recept= |
| Disallow | /*?subcatId= |
| Disallow | /*?keyw&page= |
| Disallow | /*?ut= |
| Disallow | /*?target= |
| Disallow | */Array/ |
| Disallow | */page |
| Disallow | /wp/wp-admin/ |
| Allow | /wp/wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.libelle.be/sitemap_index.xml |
Warnings
- 1 invalid line.