betteraitools.com
robots.txt
Robots Exclusion Standard data for betteraitools.com
Resource Scan
Scan Details
Site Domain | betteraitools.com |
Base Domain | betteraitools.com |
Scan Status | Ok |
Last Scan | 2025-09-21T12:39:11+00:00 |
Next Scan | 2025-09-28T12:39:11+00:00 |
Last Scan
Scanned | 2025-09-21T12:39:11+00:00 |
URL | https://betteraitools.com/robots.txt |
Redirect | https://www.betteraitools.com/robots.txt |
Redirect Domain | www.betteraitools.com |
Redirect Base | betteraitools.com |
Domain IPs | 104.21.21.93, 172.67.197.159, 2606:4700:3032::6815:155d, 2606:4700:3036::ac43:c59f |
Redirect IPs | 104.21.21.93, 172.67.197.159, 2606:4700:3032::6815:155d, 2606:4700:3036::ac43:c59f |
Response IP | 172.67.197.159 |
Found | Yes |
Hash | f6b5173c19d156f11db469c669e62004d51688f358cefda8ef169151fbc047f6 |
SimHash | 4104d4490112 |
Groups
*
Rule | Path |
---|---|
Disallow | /ai/ |
Disallow | /cn/ai/ |
Disallow | /de/ai/ |
Disallow | /ko/ai/ |
Disallow | /es/ai/ |
Disallow | /ru/ai/ |
Disallow | /tw/ai/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.betteraitools.com/sitemap.xml |