alrijne.nl
robots.txt

Robots Exclusion Standard data for alrijne.nl

Resource Scan

Scan Details

Site Domain alrijne.nl
Base Domain alrijne.nl
Scan Status Ok
Last Scan2024-10-02T06:09:20+00:00
Next Scan 2024-10-16T06:09:20+00:00

Last Scan

Scanned2024-10-02T06:09:20+00:00
URL https://www.alrijne.nl/robots.txt
Domain IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.69
Found Yes
Hash 86cc3e156078e2d3995abc08c9af0670cf99dff6db3c806e74ce85a36996473f
SimHash 491cc855c590

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Allow /
Disallow /ajax/
Disallow /experience/
Disallow /search/

bingbot

Rule Path
Allow /
Disallow /ajax/
Disallow /experience/
Disallow /search/

yandex

Rule Path
Allow /
Disallow /ajax/
Disallow /experience/
Disallow /search/

mediapartners-google

Rule Path
Allow /
Disallow /ajax/
Disallow /experience/
Disallow /search/

yadirectbot

Rule Path
Allow /
Disallow /ajax/
Disallow /experience/
Disallow /search/

mail.ru

Rule Path
Allow /
Disallow /ajax/
Disallow /experience/
Disallow /search/

twitterbot

Rule Path
Allow /
Disallow /ajax/
Disallow /experience/
Disallow /search/

Other Records

Field Value
sitemap https://www.alrijne.nl/sitemap.xml