marathikavita.co.in
robots.txt

Robots Exclusion Standard data for marathikavita.co.in

Resource Scan

Scan Details

Site Domain marathikavita.co.in
Base Domain marathikavita.co.in
Scan Status Ok
Last Scan2024-09-24T14:13:01+00:00
Next Scan 2024-10-01T14:13:01+00:00

Last Scan

Scanned2024-09-24T14:13:01+00:00
URL https://marathikavita.co.in/robots.txt
Domain IPs 103.13.114.142
Response IP 103.13.114.142
Found Yes
Hash 65d6f90bf9190456de70d6adaa531105045f3c803c75162c67bc84810420168b
SimHash 2d361ad211b4

Groups

googlebot-image

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

msnbot-mm

Rule Path
Disallow /

googlebot-mobile

Rule Path
Allow /
Disallow /*wap
Disallow /*wap2

yandeximageresizer

Rule Path
Allow /*wap
Disallow /

googlebot

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

*

Rule Path
Allow /$
Allow /*.xml
Allow /*sitemap
Disallow /attachments/
Disallow /avatars/
Disallow /Packages/
Disallow /Smileys/
Disallow /Sources/
Disallow /Themes/
Disallow /*msg
Disallow /*profile
Disallow /*help
Disallow /*search
Disallow /*mlist
Disallow /*sort
Disallow /*recent
Disallow /*register
Disallow /*groups
Disallow /*stats
Disallow /*unread
Disallow /*topicseen
Disallow /*showtopic
Disallow /*prev_next
Disallow /*imode
Disallow /*wap
Disallow /*wap2
Disallow /*all
Disallow /*action
Disallow /*PHPSESSID

Other Records

Field Value
sitemap http://marathikavita.co.in/sitemap.xml