mycelebs.ai
robots.txt
Robots Exclusion Standard data for mycelebs.ai
Resource Scan
Scan Details
Site Domain | mycelebs.ai |
Base Domain | mycelebs.ai |
Scan Status | Ok |
Last Scan | 2024-06-20T09:17:53+00:00 |
Next Scan | 2024-06-27T09:17:53+00:00 |
Last Scan
Scanned | 2024-06-20T09:17:53+00:00 |
URL | https://mycelebs.ai/robots.txt |
Redirect | https://www.mycelebs.ai/robots.txt |
Redirect Domain | www.mycelebs.ai |
Redirect Base | mycelebs.ai |
Domain IPs | 18.155.68.110, 18.155.68.128, 18.155.68.33, 18.155.68.91 |
Redirect IPs | 18.155.68.46, 18.155.68.59, 18.155.68.76, 18.155.68.83 |
Response IP | 18.155.68.59 |
Found | Yes |
Hash | 76ca5b69113e0919619f0c34b13690559a429c32e01daf9d4922f9342e6a2fa9 |
SimHash | 4a008a000312 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /member |
Disallow | /member/* |
Disallow | /celeb/*/distance |
Other Records
Field | Value |
---|---|
sitemap | https://www.mycelebs.ai/sitemap.xml |