bharatwebtools.com
robots.txt

Robots Exclusion Standard data for bharatwebtools.com

Resource Scan

Scan Details

Site Domain bharatwebtools.com
Base Domain bharatwebtools.com
Scan Status Ok
Last Scan2024-11-13T05:34:27+00:00
Next Scan 2024-11-20T05:34:27+00:00

Last Scan

Scanned2024-11-13T05:34:27+00:00
URL https://bharatwebtools.com/robots.txt
Domain IPs 208.91.199.108
Response IP 208.91.199.108
Found Yes
Hash 282123485c9be65a76cafb7427b6bdf75eddf648e2aa1a4801636e068e00ca86
SimHash 34808ac5fdf2

Groups

*

Rule Path
Disallow /register
Disallow /login
Disallow /lost-password
Disallow /text-to-speech

Other Records

Field Value
sitemap http://www.example.com/sitemap.xml

Comments

  • robots.txt for http://www.example.com/
  • Allow all robots to visit all areas
  • Sitemap declaration