mnaidunia.jagran.com
robots.txt

Robots Exclusion Standard data for mnaidunia.jagran.com

Resource Scan

Scan Details

Site Domain mnaidunia.jagran.com
Base Domain jagran.com
Scan Status Ok
Last Scan2024-05-10T12:38:22+00:00
Next Scan 2024-05-17T12:38:22+00:00

Last Scan

Scanned2024-05-10T12:38:22+00:00
URL https://mnaidunia.jagran.com/robots.txt
Redirect https://www.naidunia.com/robots.txt
Redirect Domain www.naidunia.com
Redirect Base naidunia.com
Domain IPs 23.210.105.121
Redirect IPs 23.210.105.121, 2600:1413:1:982::18c7
Response IP 23.14.202.79
Found Yes
Hash f1b4aad8dbd1841273ee75894066772a8ac034afd9e803cdf117ff3036ec6357
SimHash 2abce755c811

Groups

*

Rule Path
Allow /
Disallow /*.aspx*
Disallow /*.asp*
Disallow /*php?id*
Disallow /*13276288*
Disallow /home
Disallow */search/*
Disallow *?itm*
Disallow *-page1*
Disallow *-page2*
Disallow *-page3*
Disallow *-page4*
Disallow *-page5*
Disallow *-page6*
Disallow *-page7*
Disallow *-page8*
Disallow *-page9*
Disallow */photo-gallery/*
Disallow */topics-trending/*
Disallow /pfp
Disallow /pfp/
Disallow /pfp/*

googlebot

Rule Path
Disallow /Resources/mnaidunia/plt/

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.naidunia.com/news-sitemap-nd.xml
sitemap https://www.naidunia.com/nd-webstories-sitemap.xml
sitemap https://www.naidunia.com/web-sitemap-nd.xml

Comments

  • Sitemaps