skale.network
robots.txt

Robots Exclusion Standard data for skale.network

Resource Scan

Scan Details

Site Domain skale.network
Base Domain skale.network
Scan Status Ok
Last Scan2024-09-23T10:08:28+00:00
Next Scan 2024-10-07T10:08:28+00:00

Last Scan

Scanned2024-09-23T10:08:28+00:00
URL https://skale.network/robots.txt
Redirect https://skale.space/robots.txt
Redirect Domain skale.space
Redirect Base skale.space
Domain IPs 75.2.70.75, 99.83.190.102
Redirect IPs 52.197.0.54, 52.199.221.217, 54.178.223.218
Response IP 52.197.0.54
Found Yes
Hash e03bb89c58a956b9db6b2dde801989ec0e1d48f961f42b6ec8362cb3a05154ef
SimHash 103dce42a593

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

baiduspider

Rule Path
Disallow

yandex

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://skale.space/sitemap.xml

Comments

  • Disallow all bots by default
  • Allow Googlebot
  • Allow Bingbot
  • Allow other known and profitable bots
  • Disallow specific known bad bots
  • Disallow unknown bots