scalefour.org
robots.txt

Robots Exclusion Standard data for scalefour.org

Resource Scan

Scan Details

Site Domain scalefour.org
Base Domain scalefour.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-29T09:55:29+00:00
Next Scan 2025-09-27T09:55:29+00:00

Last Successful Scan

Scanned2024-08-11T09:09:13+00:00
URL https://scalefour.org/robots.txt
Redirect https://www.scalefour.org/robots.txt
Redirect Domain www.scalefour.org
Redirect Base scalefour.org
Domain IPs 217.160.0.65
Redirect IPs 217.160.0.65
Response IP 217.160.0.65
Found Yes
Hash 5c0a1c0685c812dccd96bb8a92f302d6bd12e30463814b6206a510582655f4a2
SimHash 501c0961a190

Groups

yandexbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /