s0.nxstatic.com
robots.txt

Robots Exclusion Standard data for s0.nxstatic.com

Resource Scan

Scan Details

Site Domain s0.nxstatic.com
Base Domain nxstatic.com
Scan Status Ok
Last Scan2024-10-23T06:28:33+00:00
Next Scan 2024-11-22T06:28:33+00:00

Last Scan

Scanned2024-10-23T06:28:33+00:00
URL https://s0.nxstatic.com/robots.txt
Domain IPs 23.215.7.10, 23.215.7.29
Response IP 23.52.40.25
Found Yes
Hash 67fec9a969c7b10e4066e88e274e9aa9160931e6a69039c7b9736a308678c1af
SimHash dc3e7040ac1a

Groups

googlebot-news

Rule Path
Allow /news/
Allow /astrology/
Allow /festivals/
Allow /$
Allow /?amp=1$
Disallow /

mediapartners-google

Rule Path
Allow /
Disallow

adsbot-google

Rule Path
Disallow

proximic

Rule Path
Allow /
Disallow

ahrefsbot
baiduspider
baiduspider-video
baiduspider-image
bytespider
dataforseobot
discoverybot
dotbot
exabot
ichiro
kunatocrawler
mj12bot
moget
naverbot
psbot
paperlibot
petalbot
piplbot
scooperbot
semrushbot
sogou spider
sosospider
yandex
yandeximages
yeti
youdaobot

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /
Allow /news/

anthropic-ai
ccbot
claude-web
google-extended
gptbot
perplexitybot

Rule Path
Disallow /

*

Rule Path
Allow /
Allow /res/images/
Disallow /account/
Disallow /api/
Disallow /astrology/location-search.php
Disallow /astrology/*panchang*/*.pdf$
Disallow /calendar/*.pdf$
Disallow /automobile/image-update.php
Disallow /automobile/news/
Disallow /automobile/search_details.php
Disallow /banking/ajax-search.php
Disallow /downloads/downloadfile.php
Disallow /education/imgs/email/
Disallow /general/calendar/date.php
Disallow /general/calendar/mal-date.php
Disallow /general/calendar/pdf/
Disallow /general/recipes/recipe.php
Disallow /how-to/call/loc_search.php
Disallow /movies/articles/
Disallow /res/
Disallow /redirect/
Disallow /search/
Disallow /share/
Disallow /travel/airports/search.php
Disallow /travel/indian-railway/search.php
Disallow /travel/hotels/ajax_search.php
Disallow /travel/hotels/imgs/
Disallow /travel/airlines/destination_search.php
Disallow /travel/airlines/airline_search.php
Disallow /travel/search.php
Disallow /what-is/meaning-of/notfound/
Disallow /*/cron/
Disallow /admin/bad-bot-detector

Other Records

Field Value
sitemap https://www.prokerala.com/banking/sitemap-index.xml.gz
sitemap https://www.prokerala.com/bikes/sitemap-index.xml.gz
sitemap https://www.prokerala.com/news/photos/sitemap-index.xml.gz
sitemap https://www.prokerala.com/pincode/sitemap-index.xml.gz
sitemap https://www.prokerala.com/sitemap/daily.xml.gz
sitemap https://www.prokerala.com/videos/sitemap-index.xml.gz

Comments

  • AI Crawlers

Warnings

  • 1 invalid line.