leddirect.nl
robots.txt

Robots Exclusion Standard data for leddirect.nl

Resource Scan

Scan Details

Site Domain leddirect.nl
Base Domain leddirect.nl
Scan Status Ok
Last Scan2025-03-09T17:03:12+00:00
Next Scan 2025-04-08T17:03:12+00:00

Last Scan

Scanned2025-03-09T17:03:12+00:00
URL https://leddirect.nl/robots.txt
Redirect https://www.leddirect.nl/robots.txt
Redirect Domain www.leddirect.nl
Redirect Base leddirect.nl
Domain IPs 94.76.223.34
Redirect IPs 94.76.223.34
Response IP 94.76.223.34
Found Yes
Hash a9cb70c8166e893625edbf58e3d656bc86d61ea2adc363cbe9a73a312de95fba
SimHash 61349c418630

Groups

adsbot-google-mobile

Rule Path
Allow /*?channable*
Disallow

adsbot-google

Rule Path
Allow /*?channable*
Disallow

*

Rule Path
Disallow /index.php/
Disallow /checkout/
Disallow /app/
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /f/*
Disallow /customer/
Disallow /sendfriend/
Disallow /review/
Disallow /*SID%3D
Disallow /test*
Disallow /*?channable*
Disallow *?kleur
Disallow /download/file/

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.leddirect.nl/sitemap/nl/sitemap.xml

Comments

  • BOTS
  • Sitemaps