spikk.co
robots.txt

Robots Exclusion Standard data for spikk.co

Resource Scan

Scan Details

Site Domain spikk.co
Base Domain spikk.co
Scan Status Ok
Last Scan2025-12-30T11:59:14+00:00
Next Scan 2026-01-29T11:59:14+00:00

Last Scan

Scanned2025-12-30T11:59:14+00:00
URL https://spikk.co/robots.txt
Domain IPs 2406:da18:b3d:e201::258, 2406:da18:b3d:e201::259, 75.2.60.5
Response IP 75.2.60.5
Found Yes
Hash ea79bc27231911873515f60ca285ea23b870d0baa65c57a23a6d0772880854c0
SimHash 21044af23e27

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /_next/
Disallow /admin/
Allow /marketplace
Allow /careers
Allow /vendors
Allow /cart

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://spikk.com/sitemap.xml

Comments

  • Sitemap
  • Disallow admin or private areas (if any)
  • Allow important pages
  • Crawl-delay for respectful crawling