airtel.in
robots.txt

Robots Exclusion Standard data for airtel.in

Resource Scan

Scan Details

Site Domain airtel.in
Base Domain airtel.in
Scan Status Ok
Last Scan2024-09-23T00:59:42+00:00
Next Scan 2024-10-07T00:59:42+00:00

Last Scan

Scanned2024-09-23T00:59:42+00:00
URL https://airtel.in/robots.txt
Redirect https://www.airtel.in/robots.txt
Redirect Domain www.airtel.in
Redirect Base airtel.in
Domain IPs 125.16.74.90, 2404:a800:ff00:1::101
Redirect IPs 125.56.219.35, 2600:1413:b000:13::b857:c185, 2600:1413:b000:13::b857:c191, 96.17.72.11
Response IP 23.52.171.136
Found Yes
Hash 6f7642c5c82e5575b94f6b908b9bdf77c2765ceac8b48b57c1eddf6be25c05c9
SimHash d24d5712f515

Groups

*

Rule Path
Disallow /airtellive/*
Disallow /growth-cms-pages/*
Disallow /app*
Disallow /mobile*
Disallow /forme*
Disallow /aes*
Disallow /m/*
Disallow /hfz-hellotunes/*
Disallow /Y/*
Disallow /4g_lte/*
Disallow /ga*
Disallow /personal/*
Disallow /wps/*
Disallow /prepaid-recharge/complete
Disallow /postpaid-bill-pay/complete
Disallow /index-all/product-listing.html
Disallow /bank/?*
Allow /digital-store/
Disallow /blog/author/*/*/*
Disallow *%26*
Disallow */digital-store/*/*utm*
Disallow /business/b2b/airtel-iq/api-docs/**

slurp

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.airtel.in/sitemap.xml
sitemap https://www.airtel.in/infinity-sitemap.xml
sitemap https://www.airtel.in/isp-sitemap.xml
sitemap https://www.airtel.in/broadband-sitemap.xml
sitemap https://www.airtel.in/cms-sitemap.xml
sitemap https://www.airtel.in/dth-sitemap.xml
sitemap https://www.airtel.in/bank/sitemap.xml