scaleo.io
robots.txt

Robots Exclusion Standard data for scaleo.io

Resource Scan

Scan Details

Site Domain scaleo.io
Base Domain scaleo.io
Scan Status Ok
Last Scan2025-09-05T19:51:56+00:00
Next Scan 2025-10-05T19:51:56+00:00

Last Scan

Scanned2025-09-05T19:51:56+00:00
URL https://scaleo.io/robots.txt
Redirect https://www.scaleo.io:443/robots.txt
Redirect Domain www.scaleo.io
Redirect Base scaleo.io
Domain IPs 104.26.10.200, 104.26.11.200, 172.67.75.32, 2606:4700:20::681a:ac8, 2606:4700:20::681a:bc8, 2606:4700:20::ac43:4b20
Redirect IPs 104.26.10.200, 104.26.11.200, 172.67.75.32, 2606:4700:20::681a:ac8, 2606:4700:20::681a:bc8, 2606:4700:20::ac43:4b20
Response IP 104.26.11.200
Found Yes
Hash 79d18c7de1ffa9684863cff2166e1c1e76f67af26851151fcf8eb2d40b983a5e
SimHash 234d8082479f

Groups

googlebot

Rule Path
Disallow /storage
Disallow /terms-use/*
Disallow /privacy-policy/*
Allow /terms-use
Allow /privacy-policy
Allow /storage/app/media
Allow /themes/scaleo/fonts
Allow /themes/scaleo/images
Allow /themes/scaleo/assets/*.css
Allow /themes/scaleo/assets/*.js

*

Rule Path
Disallow /storage
Disallow /search
Disallow /auth
Disallow */?search=*
Disallow */?sort=*
Allow /storage/app/media
Allow /themes/scaleo/fonts
Allow /themes/scaleo/images
Allow /themes/scaleo/assets/*.css
Allow /themes/scaleo/assets/*.js

googlebot-image

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.png
Allow /storage/app/media

yanga

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

dolphin

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.scaleo.io/sitemap.xml
sitemap https://www.scaleo.io/sitemap-ru.xml
sitemap https://www.scaleo.io/sitemap-es.xmll
sitemap https://www.scaleo.io/sitemap-pt.xml
sitemap https://www.scaleo.io/sitemap-vn.xml

Warnings

  • `host` is not a known field.