crediteo.be
robots.txt
Robots Exclusion Standard data for crediteo.be
Resource Scan
Scan Details
| Site Domain | crediteo.be |
| Base Domain | crediteo.be |
| Scan Status | Ok |
| Last Scan | 2024-05-30T11:50:40+00:00 |
| Next Scan | 2024-06-29T11:50:40+00:00 |
Last Scan
| Scanned | 2024-05-30T11:50:40+00:00 |
| URL | https://crediteo.be/robots.txt |
| Domain IPs | 172.66.40.127, 172.66.43.129, 2606:4700:3108::ac42:287f, 2606:4700:3108::ac42:2b81 |
| Response IP | 172.66.40.127 |
| Found | Yes |
| Hash | 68c568a43cac791ed28e8d5ce8e7903ea680288e96afb16908caa8b69b6e8690 |
| SimHash | e80598a0cbb2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /wp-content/uploads/wpo-plugins-tables-list.json |
| Disallow | /devis/ |
| Disallow | /offre-emploi/ |
| Disallow | /produit/offre-gold |
| Disallow | /produit/publier-un-article |
| Disallow | /produit/offre-gratuite |
| Disallow | /produit/offre-gold |
| Disallow | /produit/offre-presence |
| Disallow | /produit/ |
| Disallow | /service/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://crediteo.be/sitemap_index.xml |