indiaparenting.com
robots.txt

Robots Exclusion Standard data for indiaparenting.com

Resource Scan

Scan Details

Site Domain indiaparenting.com
Base Domain indiaparenting.com
Scan Status Ok
Last Scan2024-11-12T11:03:58+00:00
Next Scan 2024-11-19T11:03:58+00:00

Last Scan

Scanned2024-11-12T11:03:58+00:00
URL https://indiaparenting.com/robots.txt
Redirect https://www.indiaparenting.com/robots.txt
Redirect Domain www.indiaparenting.com
Redirect Base indiaparenting.com
Domain IPs 107.162.227.134
Redirect IPs 107.162.227.134
Response IP 107.162.227.134
Found Yes
Hash f7c544b83ab14e5dce022df014b744cb411f4c9e925eca4dc2315aee8d76810d
SimHash 415149e0c7d1

Groups

*

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /admin/
Disallow /web_admin/
Disallow /crns/
Disallow /names/babynameapp.php
Disallow /names/fb_autologin/home.php
Disallow /names/fb_autologin/test.php
Disallow /alternativehealing/yoga/backups/
Disallow /develop/data/backups/
Disallow /mannersdiscipline/data/backups/
Disallow /workspace/
Disallow /babynames/backup-14-1-14/

pinterestbot

Rule Path
Allow /coloring-pages/

Other Records

Field Value
crawl-delay 0.2

Comments

  • Disallow: /images/
  • User-agent: Googlebot
  • Disallow: /