Log In Sign Up

spacescan.io
robots.txt

Robots Exclusion Standard data for spacescan.io

Resource Scan

Scan Details

Site Domain spacescan.io
Base Domain spacescan.io
Scan Status Ok
Last Scan2025-06-17T03:26:19+00:00
Next Scan 2025-06-24T03:26:19+00:00

Last Scan

Scanned2025-06-17T03:26:19+00:00
URL https://spacescan.io/robots.txt
Domain IPs 3.165.75.56, 3.165.75.72, 3.165.75.81, 3.165.75.95
Response IP 3.165.75.56
Found Yes
Hash dced47ffa44c00d0bd07d032e905b8249c57d643f76b2b98b1750d6801dfc2c2
SimHash 6510cad3f7b5

Groups

*

Rule Path
Disallow /
Disallow /*/coin/
Disallow /*/address/
Disallow /*/block/
Disallow /coin/
Disallow /address/
Disallow /block/

imagesiftbot

Rule Path
Disallow /

googlebot

Rule Path
Allow /
Disallow /*/coin/
Disallow /*/address/
Disallow /*/block/
Disallow /coin/
Disallow /address/
Disallow /block/
Disallow /admin/
Disallow /private/

Other Records

Field Value
crawl-delay 1

googlebot-image

Rule Path
Allow /
Disallow /*/coin/
Disallow /*/address/
Disallow /*/block/
Disallow /coin/
Disallow /address/
Disallow /block/
Disallow /admin/
Disallow /private/

Other Records

Field Value
crawl-delay 1

bingbot

Rule Path
Allow /
Disallow /*/coin/
Disallow /*/address/
Disallow /*/block/
Disallow /coin/
Disallow /address/
Disallow /block/
Disallow /admin/
Disallow /private/

Other Records

Field Value
crawl-delay 1

msnbot

Rule Path
Allow /
Disallow /*/coin/
Disallow /*/address/
Disallow /*/block/
Disallow /coin/
Disallow /address/
Disallow /block/
Disallow /admin/
Disallow /private/

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://spacescan.io/sitemap.xml
Back to top

Comments

  • *
  • ImagesiftBot
  • Googlebot
  • Googlebot-Image
  • Bingbot
  • MSNBot
  • Host
  • Sitemaps
Back to top

Warnings

  • `host` is not a known field.
Back to top