auth.esakal.com
robots.txt

Robots Exclusion Standard data for auth.esakal.com

Resource Scan

Scan Details

Site Domain auth.esakal.com
Base Domain esakal.com
Scan Status Ok
Last Scan2025-04-06T10:03:41+00:00
Next Scan 2025-04-20T10:03:41+00:00

Last Scan

Scanned2025-04-06T10:03:41+00:00
URL https://auth.esakal.com/robots.txt
Domain IPs 104.18.90.198, 104.18.91.198, 104.18.92.198, 104.18.93.198, 104.18.94.198, 2606:4700::6812:5ac6, 2606:4700::6812:5bc6, 2606:4700::6812:5cc6, 2606:4700::6812:5dc6, 2606:4700::6812:5ec6
Response IP 104.18.94.198
Found Yes
Hash 218613e9c67b0d78d59e7d48448459320890bb5d8d6b0708c7e46ef1343ece68
SimHash 626ddb774b7b

Groups

*

Rule Path
Allow /
Disallow /Section.aspx/*
Disallow /Section.aspx*
Disallow /loksabha-2019/candidate/*
Disallow /mobapp/*
Disallow /files/*
Disallow /cgi-bin/*
Disallow /*.aspx
Disallow /*?page=*
Disallow /comment/
Disallow /?page=*
Disallow /*?amp=
Disallow /search*
Disallow /taxonomy/*
Disallow /esakal/themes/*
Disallow /?amp*
Disallow */qlitics.js
Disallow */page/*
Disallow /DetailPage.css
Disallow *%26page%3D*
Disallow */krida-aurangabad/*
Disallow */manoranjan-mumbai/*
Disallow */maharashtra-mumbai-paschim-maharashtra-pune-kolhapur/*
Disallow */maharashtra-vidhansabha/*
Disallow */coronavirus-global/*
Disallow */maharashtra-paschim-maharashtra-kolhapur/*
Disallow */coronavirus-desh/*
Disallow */agro-kokan/*
Disallow */krida-cricket/*
Disallow */%5BSectionPage%5D
Disallow */image-story/sachin-tendulkars-daughter-saras-photos-break-the-internet-get-like-from-kartik-aaryan-sbj86/horoscope/weekly
Disallow */paschim-maharashtra/national-school-national-taekwondo-competition-maharashtra-team-248525
Disallow */commotion-satbara-continues-most-errors-haveli-taluka-425006
Disallow */coronavirus-vidarbha/*
Disallow */reaction-union-budget/*
Disallow */union-budget-updates-expert-comments/*
Disallow */topic-tags/*
Disallow *?amp
Disallow *-daily-2016-*
Disallow *-daily-2017-*
Disallow */amp/web-story/*
Disallow *202201*
Disallow *202202*
Disallow *202203*
Disallow *202204*
Disallow *202205*
Disallow *202206*
Disallow *202207*
Disallow *202208*
Disallow *202209*
Disallow *202210*
Disallow *202211*
Disallow *202212*
Disallow */undefined/undefined/*
Disallow */FlashClient/*
Disallow */live-feeds-*
Disallow */reporter/*
Disallow *?fbclid=*
Disallow *?utm_*
Disallow *?dc_data=*
Disallow *?page=*
Disallow /web-story/bold-scene-shoot-movie-trick-sex-interesting-facts-about-movies-srk94
Disallow /web-story/when-does-menstruation-stop-what-are-the-reasons-aak11
Disallow *?botrequest=true*
Disallow /video-story*
Disallow *?logged_in=false
Disallow */user-login
Disallow */api/v1/stories
Disallow /video-story*
Disallow */pageidentifier/*

ahref

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

claude

Rule Path
Disallow /

open ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.esakal.com/news_sitemap.xml
sitemap https://www.esakal.com/sitemap.xml