airtel.in
robots.txt
Robots Exclusion Standard data for airtel.in
Resource Scan
Scan Details
| Site Domain | airtel.in |
| Base Domain | airtel.in |
| Scan Status | Ok |
| Last Scan | 2024-11-04T09:31:01+00:00 |
| Next Scan | 2024-11-18T09:31:01+00:00 |
Last Scan
| Scanned | 2024-11-04T09:31:01+00:00 |
| URL | https://airtel.in/robots.txt |
| Redirect | https://www.airtel.in/robots.txt |
| Redirect Domain | www.airtel.in |
| Redirect Base | airtel.in |
| Domain IPs | 125.16.74.90, 2404:a800:ff00:1::101 |
| Redirect IPs | 184.87.193.133, 184.87.193.155, 2600:1413:b000:13::b857:c185, 2600:1413:b000:13::b857:c19b |
| Response IP | 23.45.207.170 |
| Found | Yes |
| Hash | 6f7642c5c82e5575b94f6b908b9bdf77c2765ceac8b48b57c1eddf6be25c05c9 |
| SimHash | d24d5712f515 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /airtellive/* |
| Disallow | /growth-cms-pages/* |
| Disallow | /app* |
| Disallow | /mobile* |
| Disallow | /forme* |
| Disallow | /aes* |
| Disallow | /m/* |
| Disallow | /hfz-hellotunes/* |
| Disallow | /Y/* |
| Disallow | /4g_lte/* |
| Disallow | /ga* |
| Disallow | /personal/* |
| Disallow | /wps/* |
| Disallow | /prepaid-recharge/complete |
| Disallow | /postpaid-bill-pay/complete |
| Disallow | /index-all/product-listing.html |
| Disallow | /bank/?* |
| Allow | /digital-store/ |
| Disallow | /blog/author/*/*/* |
| Disallow | *%26* |
| Disallow | */digital-store/*/*utm* |
| Disallow | /business/b2b/airtel-iq/api-docs/** |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.airtel.in/sitemap.xml |
| sitemap | https://www.airtel.in/infinity-sitemap.xml |
| sitemap | https://www.airtel.in/isp-sitemap.xml |
| sitemap | https://www.airtel.in/broadband-sitemap.xml |
| sitemap | https://www.airtel.in/cms-sitemap.xml |
| sitemap | https://www.airtel.in/dth-sitemap.xml |
| sitemap | https://www.airtel.in/bank/sitemap.xml |