didier.be
robots.txt
Robots Exclusion Standard data for didier.be
Resource Scan
Scan Details
| Site Domain | didier.be |
| Base Domain | didier.be |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2025-10-24T23:21:38+00:00 |
| Next Scan | 2026-01-22T23:21:38+00:00 |
Last Successful Scan
| Scanned | 2025-03-28T21:02:25+00:00 |
| URL | https://didier.be/robots.txt |
| Redirect | https://www.didier.be/robots.txt |
| Redirect Domain | www.didier.be |
| Redirect Base | didier.be |
| Domain IPs | 2a04:3544:1000:1510:3cc8:64ff:fefa:27f0, 5.22.211.220 |
| Redirect IPs | 2a04:3544:1000:1510:3cc8:64ff:fefa:27f0, 5.22.211.220 |
| Response IP | 5.22.211.220 |
| Found | Yes |
| Hash | 8d6b21fe0a5237ca2ad8d246cf3109631d9afd8fba86f6e8ca91d80c75400f23 |
| SimHash | 3a98d85cc0e0 |
Groups
amazonbot
applebot-extended
awariorssbot
awariosmartbot
bytespider
ccbot
cohere-ai
facebookbot
google-extended
imagesiftbot
magpie-crawler
omgili
omgilibot
peer39_crawler
peer39_crawler/1.0
perplexitybot
youbot
facebookexternalhit
meta-externalagent
semrushbot
dataforseobot
dataforseo-bot
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
semrushbot-bm
splitsignalbot
semrushbot-coub
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /nl/informatie-aanvragen/* |
| Disallow | /de/anfordern-von-informationen/* |
| Disallow | /en/requesting-information/* |
| Disallow | /es/solicitud-de-informacion/* |
| Disallow | /fr/demande-dinformations/* |
| Disallow | /it/richiesta-di-informazioni/* |
| Disallow | /pl/zadanie-informacji/* |
| Disallow | /pt/pedido-de-informacoes/* |
| Disallow | /ro/solicitarea-de-informatii/* |
| Disallow | /nl/aanvraag-schadewagen/* |
| Disallow | /de/anfrage-schaden-auto/* |
| Disallow | /en/request-damage-car/* |
| Disallow | /es/solicitar-danos-coche/* |
| Disallow | /fr/demande-voiture-endommage/* |
| Disallow | /it/richiesta-danni-auto/* |
| Disallow | /pl/zadanie-uszkodzenia-samochodu/* |
| Disallow | /pt/pedir-danos-no-automovel/* |
| Disallow | /ro/cerere-de-deteriorare-a-masinii/* |
| Disallow | /nl/aanvraag-demontagewagen/* |
| Disallow | /de/antrag-auf-einen-abschleppwagen/* |
| Disallow | /en/request-dismantling-car/* |
| Disallow | /es/solicitud-de-furgoneta-de-desmontaje/* |
| Disallow | /fr/demande-voiture-de-demontage/* |
| Disallow | /it/richiesta-di-smontaggio-furgone/* |
| Disallow | /pl/wniosek-o-demontaz-furgonetki/* |
| Disallow | /pt/pedido-de-carrinha-de-desmantelamento/* |
| Disallow | /ro/cerere-de-dezmembrare-a-camionetei/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |