navneet.com
robots.txt

Robots Exclusion Standard data for navneet.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	navneet.com
Base Domain	navneet.com
Scan Status	Ok
Last Scan	2025-08-31T21:05:29+00:00
Next Scan	2025-09-30T21:05:29+00:00

Last Scan

Scanned	2025-08-31T21:05:29+00:00
URL	https://navneet.com/robots.txt
Domain IPs	191.96.159.251
Response IP	191.96.159.251
Found	Yes
Hash	ec1d12487851137d8264ff2a14af238a129c42e64b255286be72c093ccca6a87
SimHash	49048bb76681

Groups

*

Rule	Path
Allow	/
Allow	/*/
Allow	/wp-admin/admin-ajax.php
Disallow	/wp-admin/

Rule

Path

Allow

/*/

Allow

/wp-admin/admin-ajax.php

Disallow

/wp-admin/

googlebot

Rule	Path
Allow	/
Allow	/*/
Allow	/wp-admin/admin-ajax.php
Disallow	/wp-admin/

Rule

Path

Allow

/*/

Allow

/wp-admin/admin-ajax.php

Disallow

/wp-admin/

googlebot-image

Rule	Path
Allow	/
Allow	/*/
Allow	/wp-admin/admin-ajax.php
Disallow	/wp-admin/

Rule

Path

Allow

/*/

Allow

/wp-admin/admin-ajax.php

Disallow

/wp-admin/

googlebot-news

Rule	Path
Allow	/
Allow	/*/
Allow	/wp-admin/admin-ajax.php
Disallow	/wp-admin/

Rule

Path

Allow

/*/

Allow

/wp-admin/admin-ajax.php

Disallow

/wp-admin/

googlebot-video

Rule	Path
Allow	/
Allow	/*/
Allow	/wp-admin/admin-ajax.php
Disallow	/wp-admin/

Rule

Path

Allow

/*/

Allow

/wp-admin/admin-ajax.php

Disallow

/wp-admin/

googlebot-mobile

Rule	Path
Allow	/
Allow	/*/
Allow	/wp-admin/admin-ajax.php
Disallow	/wp-admin/

Rule

Path

Allow

/*/

Allow

/wp-admin/admin-ajax.php

Disallow

/wp-admin/

adsbot-google

Rule	Path
Allow	/
Allow	/*/
Allow	/wp-admin/admin-ajax.php
Disallow	/wp-admin/

Rule

Path

Allow

/*/

Allow

/wp-admin/admin-ajax.php

Disallow

/wp-admin/

googlebot-image/1.0

Rule	Path
Allow	/
Allow	/*/
Allow	/wp-admin/admin-ajax.php
Disallow	/wp-admin/

Rule

Path

Allow

/*/

Allow

/wp-admin/admin-ajax.php

Disallow

/wp-admin/

googlebot-news/2.3

Rule	Path
Allow	/
Allow	/*/
Allow	/wp-admin/admin-ajax.php
Disallow	/wp-admin/

Rule

Path

Allow

/*/

Allow

/wp-admin/admin-ajax.php

Disallow

/wp-admin/

googlebot-video/1.0

Rule	Path
Allow	/
Allow	/*/
Allow	/wp-admin/admin-ajax.php
Disallow	/wp-admin/

Rule

Path

Allow

/*/

Allow

/wp-admin/admin-ajax.php

Disallow

/wp-admin/

googlebot-mobile-apps

Rule	Path
Allow	/
Allow	/*/
Allow	/wp-admin/admin-ajax.php
Disallow	/wp-admin/

Rule

Path

Allow

/*/

Allow

/wp-admin/admin-ajax.php

Disallow

/wp-admin/

google-ads-overview-crawler

Rule	Path
Allow	/
Allow	/*/
Allow	/wp-admin/admin-ajax.php
Disallow	/wp-admin/

Rule

Path

Allow

/*/

Allow

/wp-admin/admin-ajax.php

Disallow

/wp-admin/

semrushbot

Rule	Path
Disallow

Rule

Path

Disallow

Other Records

Field	Value
sitemap	https://navneet.com/sitemap.xml
sitemap	https://navneet.com/sitemap.rss
sitemap	https://navneet.com/sitemap.xml
sitemap	https://navneet.com/sitemap.rss
sitemap	https://navneet.com/sitemap.xml
sitemap	https://navneet.com/sitemap.rss
sitemap	https://navneet.com/sitemap.xml
sitemap	https://navneet.com/sitemap.rss
sitemap	https://navneet.com/sitemap.xml
sitemap	https://navneet.com/sitemap.rss
sitemap	https://navneet.com/sitemap.xml
sitemap	https://navneet.com/sitemap.rss
sitemap	https://navneet.com/sitemap.xml
sitemap	https://navneet.com/sitemap.rss
sitemap	https://navneet.com/sitemap.xml
sitemap	https://navneet.com/sitemap.rss
sitemap	https://navneet.com/sitemap.xml
sitemap	https://navneet.com/sitemap.rss
sitemap	https://navneet.com/sitemap.xml
sitemap	https://navneet.com/sitemap.rss
sitemap	https://navneet.com/sitemap.xml
sitemap	https://navneet.com/sitemap.rss
sitemap	https://navneet.com/sitemap.xml
sitemap	https://navneet.com/sitemap.rss
sitemap	https://navneet.com/sitemap.xml
sitemap	https://navneet.com/sitemap.rss

Field

Value

sitemap