cafecito.app
robots.txt
Robots Exclusion Standard data for cafecito.app
Resource Scan
Scan Details
Site Domain | cafecito.app |
Base Domain | cafecito.app |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-04-08T05:34:26+00:00 |
Next Scan | 2024-07-07T05:34:26+00:00 |
Last Successful Scan
Scanned | 2023-05-22T04:29:37+00:00 |
URL | https://cafecito.app/robots.txt |
Domain IPs | 104.26.14.158, 104.26.15.158, 172.67.71.97, 2606:4700:20::681a:e9e, 2606:4700:20::681a:f9e, 2606:4700:20::ac43:4761 |
Response IP | 104.26.14.158 |
Found | Yes |
Hash | ccb9542872447616c6d2a9189d8bab1c3c65d14c65b90db850cbc09e9c228726 |
SimHash | 29249602dfb2 |
Groups
*
Rule | Path |
---|---|
Disallow | /my_account |
Disallow | /dashboard |
Disallow | /create_username |
Disallow | /adult |
Disallow | /choose_categories |
Disallow | /stream |
Other Records
Field | Value |
---|---|
sitemap | https://cafecito.app/api/sitemap-index.xml.gz |