meteum.ai
robots.txt
Robots Exclusion Standard data for meteum.ai
Resource Scan
Scan Details
| Site Domain | meteum.ai |
| Base Domain | meteum.ai |
| Scan Status | Ok |
| Last Scan | 2024-11-13T04:39:04+00:00 |
| Next Scan | 2024-11-20T04:39:04+00:00 |
Last Scan
| Scanned | 2024-11-13T04:39:04+00:00 |
| URL | https://meteum.ai/robots.txt |
| Domain IPs | 213.180.193.146, 2a02:6b8::17f |
| Response IP | 213.180.193.146 |
| Found | Yes |
| Hash | 5d85c6a7b9068485e4c1c0a9d0d1f94cafdcf566082d26e38c18a6bee89fa2ab |
| SimHash | 4d15d370cece |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /404 |
| Disallow | /front/* |
| Disallow | /weather/front/graphql |
| Disallow | /segment/details |
| Disallow | /weather/search |
| Disallow | /weather/404 |
| Disallow | /weather/segment/details |
| Disallow | /weather/_next/ |
| Disallow | /*turboapp%3D1* |
| Disallow | /*gql%3D |
Other Records
| Field | Value |
|---|---|
| sitemap | https://meteum.ai/weather/meteum.ai/sitemap-index.ai.xml |