Log In Sign Up

punjabijagran.com
robots.txt

Robots Exclusion Standard data for punjabijagran.com

Resource Scan

Scan Details

Site Domain punjabijagran.com
Base Domain punjabijagran.com
Scan Status Ok
Last Scan2024-06-25T07:01:19+00:00
Next Scan 2024-07-02T07:01:19+00:00

Last Scan

Scanned2024-06-25T07:01:19+00:00
URL https://punjabijagran.com/robots.txt
Redirect https://www.punjabijagran.com/robots.txt
Redirect Domain www.punjabijagran.com
Redirect Base punjabijagran.com
Domain IPs 34.93.52.48
Redirect IPs 173.222.152.206, 2600:1413:1:982::18c7
Response IP 104.110.79.216
Found Yes
Hash ffc459a300555a3a9de0725b6496460c51d24a687d63b34770603a026cc13d0d
SimHash 7914df518d73

Groups

*

Rule Path
Allow /
Disallow /search/
Disallow *-page*

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /
Disallow /pfp
Disallow /pfp/
Disallow /pfp/*
Back to top

Other Records

Field Value
sitemap https://www.punjabijagran.com/sitemap.xml
Back to top

Comments

  • Sitemaps
Back to top

Warnings

  • 1 invalid line.
Back to top