blog.itijobalert.in
robots.txt

Robots Exclusion Standard data for blog.itijobalert.in

Resource Scan

Scan Details

Site Domain blog.itijobalert.in
Base Domain itijobalert.in
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-10T15:34:24+00:00
Next Scan 2025-09-09T15:34:24+00:00

Last Successful Scan

Scanned2025-06-18T22:20:12+00:00
URL https://blog.itijobalert.in/robots.txt
Domain IPs 2404:6800:4003:c00::79, 74.125.200.121
Response IP 74.125.68.121
Found Yes
Hash cbdd556ee13e172669bb8ea451ceb1de47b5b38bca2baf0a7e98b98ff37e9a91
SimHash e50192724752

Groups

*

Rule Path
Disallow /*?m=1
Disallow /*?*&m=1
Disallow /*?zx=
Disallow /*?*&zx=
Disallow /*.xml$
Disallow /*.xml?*
Disallow /search
Allow /search$
Allow /search/label/
Allow /

Other Records

Field Value
sitemap https://www.hindisafar.in/sitemap.xml
sitemap https://www.hindisafar.in/sitemap-pages.xml
sitemap https://www.hindisafar.in/atom.xml?redirect=false&start-index=1&max-results=500

Comments

  • robots.txt