astha.site
robots.txt

Robots Exclusion Standard data for astha.site

Resource Scan

Scan Details

Site Domain astha.site
Base Domain astha.site
Scan Status Ok
Last Scan2025-06-02T23:41:11+00:00
Next Scan 2025-07-02T23:41:11+00:00

Last Scan

Scanned2025-06-02T23:41:11+00:00
URL https://astha.site/robots.txt
Domain IPs 66.29.148.6
Response IP 66.29.148.6
Found Yes
Hash 2547d3e9ed4bdc0ef954169c5753cfbae0a298c95d8ea04bb27b730a861d4a71
SimHash 1810f702ea22

Groups

ahrefsbot

Rule Path
Allow /

ahrefssiteaudit

Rule Path
Allow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /