Log In Sign Up

padeldirect.be
robots.txt

Robots Exclusion Standard data for padeldirect.be

Resource Scan

Scan Details

Site Domain padeldirect.be
Base Domain padeldirect.be
Scan Status Ok
Last Scan2025-09-30T14:23:43+00:00
Next Scan 2025-10-30T14:23:43+00:00

Last Scan

Scanned2025-09-30T14:23:43+00:00
URL https://padeldirect.be/robots.txt
Redirect https://www.padeldirect.be/robots.txt
Redirect Domain www.padeldirect.be
Redirect Base padeldirect.be
Domain IPs 104.21.27.105, 172.67.169.29, 2606:4700:3031::ac43:a91d, 2606:4700:3036::6815:1b69
Redirect IPs 104.21.27.105, 172.67.169.29, 2606:4700:3031::ac43:a91d, 2606:4700:3036::6815:1b69
Response IP 104.21.27.105
Found Yes
Hash 353d96aae7f24178ebc3385543949244b7723feca196d4a43a75714117df2fa3
SimHash 872dfd5107b1

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://www.padeldirect.nl/media/sitemap/padeldirect_nl/sitemap-index.xml
sitemap https://www.padeldirect.be/media/sitemap/padeldirect_be/sitemap-index.xml
sitemap https://www.padeldirect.com/media/sitemap/padeldirect_en/sitemap-index.xml
sitemap https://www.padeldirect.com/media/sitemap/padeldirect_de/sitemap-index.xml
sitemap https://www.padeldirect.com/media/sitemap/padeldirect_se/sitemap-index.xml
Back to top

Comments

  • robots.txt
  • Website Sitemap
  • Directories
  • Paths (clean URLs)
  • Files
  • Paths (no clean URLs)
  • Crawlers Setup
Back to top

Warnings

  • 48 invalid lines.
Back to top