sarkarilisting.com
robots.txt

Robots Exclusion Standard data for sarkarilisting.com

Resource Scan

Scan Details

Site Domain sarkarilisting.com
Base Domain sarkarilisting.com
Scan Status Ok
Last Scan2024-10-02T00:40:50+00:00
Next Scan 2024-10-09T00:40:50+00:00

Last Scan

Scanned2024-10-02T00:40:50+00:00
URL https://sarkarilisting.com/robots.txt
Redirect https://www.sarkarilisting.com/robots.txt
Redirect Domain www.sarkarilisting.com
Redirect Base sarkarilisting.com
Domain IPs 104.21.64.20, 172.67.174.95, 2606:4700:3030::ac43:ae5f, 2606:4700:3036::6815:4014
Redirect IPs 104.21.64.20, 172.67.174.95, 2606:4700:3030::ac43:ae5f, 2606:4700:3036::6815:4014
Response IP 104.21.64.20
Found Yes
Hash 0d17aa2e151cf26cc55795d62cf69249c576ccb0833de1698e1fe4407876fc78
SimHash 6144c360d277

Groups

ninjabot

Rule Path
Allow /

googlebot-image

Rule Path
Disallow
Allow /*

mediapartners-google*

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

duggmirror

Rule Path
Disallow /

hypestat

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow */feed/
Disallow */trackback/
Disallow */comments/
Allow /wp-content/uploads/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.sarkarilisting.com/sitemap_index.xml

Comments

  • Ninja Bot
  • Google Image
  • Google Adsense
  • Google Ads Bot
  • Google Mobile
  • digg mirror
  • Hypestat
  • Global