kavitachoudhary.com
robots.txt

Robots Exclusion Standard data for kavitachoudhary.com

Resource Scan

Scan Details

Site Domain kavitachoudhary.com
Base Domain kavitachoudhary.com
Scan Status Ok
Last Scan2025-06-17T07:02:06+00:00
Next Scan 2025-07-17T07:02:06+00:00

Last Scan

Scanned2025-06-17T07:02:06+00:00
URL https://kavitachoudhary.com/robots.txt
Domain IPs 68.178.236.157
Response IP 68.178.236.157
Found Yes
Hash e2c478f34813513555698921d54b5518d788c50eedbb390d1f886318c488680a
SimHash 5914dc374693

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Allow /

slurp

Rule Path
Allow /

msnbot

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

scrubby

Rule Path
Allow /

baiduspider

Rule Path
Allow /

httrack
netcaptor
offline explorer
spiderku/0.9
steeler
webcopier v3.3
webcopier v3.2a
webcopier
webcawler
web downloader/4.9
web downloader/5.8
webgather 3.0
webstripper/2.56
webzip/3.65
webzip
wget
zao
zeus 2.6

Rule Path
Disallow /

Other Records

Field Value
sitemap https://kavitachoudhary.com/page-sitemap.xml
sitemap https://kavitachoudhary.com/post-sitemap.xml