leckerplanet.com
robots.txt

Robots Exclusion Standard data for leckerplanet.com

Resource Scan

Scan Details

Site Domain leckerplanet.com
Base Domain leckerplanet.com
Scan Status Ok
Last Scan2026-01-06T11:30:57+00:00
Next Scan 2026-01-13T11:30:57+00:00

Last Scan

Scanned2026-01-06T11:30:57+00:00
URL https://leckerplanet.com/robots.txt
Domain IPs 104.21.13.148, 172.67.200.158, 2606:4700:3034::ac43:c89e, 2606:4700:3035::6815:d94
Response IP 104.21.13.148
Found Yes
Hash 564386276d7d4bb9ad1e2f256ded23fe360f04acdc4f2fcd74fe0f343e17b484
SimHash 6800de32a620

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /api/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://leckerplanet.com/sitemap.xml

Comments

  • Sitemaps
  • Crawl delay (optional - helps prevent server overload)
  • Disallow admin and API paths