prokerala.com
robots.txt
Robots Exclusion Standard data for prokerala.com
Resource Scan
Scan Details
| Site Domain | prokerala.com |
| Base Domain | prokerala.com |
| Scan Status | Ok |
| Last Scan | 2024-11-13T17:27:43+00:00 |
| Next Scan | 2024-11-20T17:27:43+00:00 |
Last Scan
| Scanned | 2024-11-13T17:27:43+00:00 |
| URL | https://prokerala.com/robots.txt |
| Redirect | https://www.prokerala.com/robots.txt |
| Redirect Domain | www.prokerala.com |
| Redirect Base | prokerala.com |
| Domain IPs | 104.26.14.242, 104.26.15.242, 172.67.69.237, 2606:4700:20::681a:ef2, 2606:4700:20::681a:ff2, 2606:4700:20::ac43:45ed |
| Redirect IPs | 23.215.7.10, 23.215.7.29 |
| Response IP | 23.215.7.10 |
| Found | Yes |
| Hash | 67fec9a969c7b10e4066e88e274e9aa9160931e6a69039c7b9736a308678c1af |
| SimHash | dc3e7040ac1a |
Groups
googlebot-news
| Rule | Path |
|---|---|
| Allow | /news/ |
| Allow | /astrology/ |
| Allow | /festivals/ |
| Allow | /$ |
| Allow | /?amp=1$ |
| Disallow | / |
ahrefsbot
baiduspider
baiduspider-video
baiduspider-image
bytespider
dataforseobot
discoverybot
dotbot
exabot
ichiro
kunatocrawler
mj12bot
moget
naverbot
psbot
paperlibot
petalbot
piplbot
scooperbot
semrushbot
sogou spider
sosospider
yandex
yandeximages
yeti
youdaobot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /res/images/ |
| Disallow | /account/ |
| Disallow | /api/ |
| Disallow | /astrology/location-search.php |
| Disallow | /astrology/*panchang*/*.pdf$ |
| Disallow | /calendar/*.pdf$ |
| Disallow | /automobile/image-update.php |
| Disallow | /automobile/news/ |
| Disallow | /automobile/search_details.php |
| Disallow | /banking/ajax-search.php |
| Disallow | /downloads/downloadfile.php |
| Disallow | /education/imgs/email/ |
| Disallow | /general/calendar/date.php |
| Disallow | /general/calendar/mal-date.php |
| Disallow | /general/calendar/pdf/ |
| Disallow | /general/recipes/recipe.php |
| Disallow | /how-to/call/loc_search.php |
| Disallow | /movies/articles/ |
| Disallow | /res/ |
| Disallow | /redirect/ |
| Disallow | /search/ |
| Disallow | /share/ |
| Disallow | /travel/airports/search.php |
| Disallow | /travel/indian-railway/search.php |
| Disallow | /travel/hotels/ajax_search.php |
| Disallow | /travel/hotels/imgs/ |
| Disallow | /travel/airlines/destination_search.php |
| Disallow | /travel/airlines/airline_search.php |
| Disallow | /travel/search.php |
| Disallow | /what-is/meaning-of/notfound/ |
| Disallow | /*/cron/ |
| Disallow | /admin/bad-bot-detector |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.prokerala.com/banking/sitemap-index.xml.gz |
| sitemap | https://www.prokerala.com/bikes/sitemap-index.xml.gz |
| sitemap | https://www.prokerala.com/news/photos/sitemap-index.xml.gz |
| sitemap | https://www.prokerala.com/pincode/sitemap-index.xml.gz |
| sitemap | https://www.prokerala.com/sitemap/daily.xml.gz |
| sitemap | https://www.prokerala.com/videos/sitemap-index.xml.gz |
Warnings
- 1 invalid line.
Comments