didi.nl
robots.txt

Robots Exclusion Standard data for didi.nl

Resource Scan

Scan Details

Site Domain didi.nl
Base Domain didi.nl
Scan Status Ok
Last Scan2025-02-22T15:54:46+00:00
Next Scan 2025-03-24T15:54:46+00:00

Last Scan

Scanned2025-02-22T15:54:46+00:00
URL https://didi.nl/robots.txt
Redirect https://www.didi.nl/robots.txt
Redirect Domain www.didi.nl
Redirect Base didi.nl
Domain IPs 91.216.141.200
Redirect IPs 91.216.141.200
Response IP 91.216.141.200
Found Yes
Hash 4719e8c48b9b94c43518e4cd62f943d1ff6c4c9bb22f35afe635e9d77e6568f5
SimHash cb3cc422ee93

Groups

mj12bot
blexbot
ahrefsbot
bubing
yandex
dotbot
pingdom
spbot
krzana-rss-bot
ucmore crawler app
velenpublicwebcrawler
seekport crawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.didi.nl/sitemap.xml