Log In Sign Up

runningdirect.be
robots.txt

Robots Exclusion Standard data for runningdirect.be

Resource Scan

Scan Details

Site Domain runningdirect.be
Base Domain runningdirect.be
Scan Status Ok
Last Scan2025-08-25T09:45:48+00:00
Next Scan 2025-09-08T09:45:48+00:00

Last Scan

Scanned2025-08-25T09:45:48+00:00
URL https://runningdirect.be/robots.txt
Redirect https://www.runningdirect.be/robots.txt
Redirect Domain www.runningdirect.be
Redirect Base runningdirect.be
Domain IPs 104.21.37.100, 172.67.207.18, 2606:4700:3033::ac43:cf12, 2606:4700:3034::6815:2564
Redirect IPs 104.21.37.100, 172.67.207.18, 2606:4700:3033::ac43:cf12, 2606:4700:3034::6815:2564
Response IP 172.67.207.18
Found Yes
Hash 8d577ffc22b1db4d4a9f282a4d9a6bbfc73246c8a008d9f380d4d02af69c1d1d
SimHash 872dfc5107f1

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://www.runningdirect.nl/media/sitemap/runningdirect_nl/sitemap-index.xml
sitemap https://www.runningdirect.be/media/sitemap/runningdirect_be/sitemap-index.xml
sitemap https://www.runningdirect.de/media/sitemap/runningdirect_de/sitemap-index.xml
sitemap https://www.runningdirect.se/media/sitemap/runningshop_se/sitemap-index.xml
Back to top

Comments

  • robots.txt
  • Website Sitemap
  • Directories
  • Paths (clean URLs)
  • Files
  • Paths (no clean URLs)
  • Crawlers Setup
Back to top

Warnings

  • 48 invalid lines.
Back to top