tuindevilla.nl
robots.txt

Robots Exclusion Standard data for tuindevilla.nl

Resource Scan

Scan Details

Site Domain tuindevilla.nl
Base Domain tuindevilla.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-12-06T22:58:44+00:00
Next Scan 2026-01-05T22:58:44+00:00

Last Successful Scan

Scanned2025-11-07T00:11:12+00:00
URL https://tuindevilla.nl/robots.txt
Domain IPs 104.21.51.122, 172.67.180.46, 2606:4700:3031::ac43:b42e, 2606:4700:3035::6815:337a
Response IP 104.21.51.122
Found Yes
Hash 450f823ee28743f9336233cbcf504c47200c5e73cabde418d5c9107fcd2fbf25
SimHash 7b27dc222ab1

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Allow /*css?*
Allow /*js?*
Disallow /?s=
Disallow /search/
Disallow /wp-login.php

aspiegelbot
blexbot
barkrowler
dotbot
mj12bot
mauibot
nimbostratus-bot
petalbot
semrushbot
seznambot
sogou
serpstatbot
trendiction
textbulkerbot

Rule Path
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 180

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://tuindevilla.nl/sitemap-news.xml
sitemap https://tuindevilla.nl/sitemap_index.xml

Warnings

  • 1 invalid line.