thepunjabkesari.com
robots.txt

Robots Exclusion Standard data for thepunjabkesari.com

Resource Scan

Scan Details

Site Domain thepunjabkesari.com
Base Domain thepunjabkesari.com
Scan Status Ok
Last Scan2024-09-20T19:18:50+00:00
Next Scan 2024-09-27T19:18:50+00:00

Last Scan

Scanned2024-09-20T19:18:50+00:00
URL http://thepunjabkesari.com/robots.txt
Redirect https://www.punjabkesari.in/robots.txt
Redirect Domain www.punjabkesari.in
Redirect Base punjabkesari.in
Domain IPs 54.254.248.135
Redirect IPs 3.165.102.105, 3.165.102.16, 3.165.102.65, 3.165.102.79
Response IP 3.165.102.65
Found Yes
Hash cfb1e0a97b8268e3cb981d7c18f2f14f119df68df945b0e913a62335747ba5c4
SimHash 8901d6570d13

Groups

*

Rule Path
Allow /
Disallow /trending/news/*

Other Records

Field Value
sitemap https://www.punjabkesari.in/newssitemap.xml
sitemap https://www.punjabkesari.in/category.xml
sitemap https://www.punjabkesari.in/sitemap-photo.xml
sitemap https://www.punjabkesari.in/sitemap-national.xml
sitemap https://www.punjabkesari.in/sitemap-international.xml
sitemap https://www.punjabkesari.in/sitemap-business.xml
sitemap https://www.punjabkesari.in/sitemap-dharm.xml
sitemap https://himachal.punjabkesari.in/sitemap-Himachal-pradesh.xml
sitemap https://punjab.punjabkesari.in/sitemap-punjab.xml
sitemap https://haryana.punjabkesari.in/sitemap-haryana.xml
sitemap https://bihar.punjabkesari.in/sitemap-bihar.xml
sitemap https://sports.punjabkesari.in/sitemap-sports.xml
sitemap https://mp.punjabkesari.in/sitemap-madhya-pradesh.xml
sitemap https://nari.punjabkesari.in/sitemap-nari.xml
sitemap https://up.punjabkesari.in/sitemap-uttar-pradesh.xml