skale.space
robots.txt

Robots Exclusion Standard data for skale.space

Resource Scan

Scan Details

Site Domain skale.space
Base Domain skale.space
Scan Status Ok
Last Scan2024-09-25T17:55:37+00:00
Next Scan 2024-10-25T17:55:37+00:00

Last Scan

Scanned2024-09-25T17:55:37+00:00
URL https://skale.space/robots.txt
Domain IPs 13.200.123.229, 13.234.100.116, 65.0.79.182
Response IP 13.234.100.116
Found Yes
Hash e03bb89c58a956b9db6b2dde801989ec0e1d48f961f42b6ec8362cb3a05154ef
SimHash 103dce42a593

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

baiduspider

Rule Path
Disallow

yandex

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://skale.space/sitemap.xml

Comments

  • Disallow all bots by default
  • Allow Googlebot
  • Allow Bingbot
  • Allow other known and profitable bots
  • Disallow specific known bad bots
  • Disallow unknown bots