astroyogi.com
robots.txt
Robots Exclusion Standard data for astroyogi.com
Resource Scan
Scan Details
Site Domain | astroyogi.com |
Base Domain | astroyogi.com |
Scan Status | Ok |
Last Scan | 2025-10-08T14:52:01+00:00 |
Next Scan | 2025-10-15T14:52:01+00:00 |
Last Scan
Scanned | 2025-10-08T14:52:01+00:00 |
URL | https://astroyogi.com/robots.txt |
Redirect | https://www.astroyogi.com/robots.txt |
Redirect Domain | www.astroyogi.com |
Redirect Base | astroyogi.com |
Domain IPs | 172.66.40.55, 172.66.43.201, 2606:4700:3108::ac42:2837, 2606:4700:3108::ac42:2bc9 |
Redirect IPs | 172.66.40.55, 172.66.43.201, 2606:4700:3108::ac42:2837, 2606:4700:3108::ac42:2bc9 |
Response IP | 172.66.40.55 |
Found | Yes |
Hash | 8cdf8f6fe90b8cd0bd54e2d46dadc0a83263e06f8b4fc0094cf8cf081a428e34 |
SimHash | c8151aa2c5f1 |
Groups
*
Rule | Path |
---|---|
Allow | / |
*
Rule | Path |
---|---|
Disallow | /cdn-cgi/challenge-platform/h/g/scripts/cb/invisible.js |
Disallow | /*?utm_source |
Disallow | /*?utm_medium |
Disallow | /*?utm_campaign |
Disallow | /*?dd |
Disallow | /*?catid |
Disallow | /*?pageid |
Other Records
Field | Value |
---|---|
sitemap | https://www.astroyogi.com/sitemap.xml |