mumbaicompanydatabase.com
robots.txt

Robots Exclusion Standard data for mumbaicompanydatabase.com

Resource Scan

Scan Details

Site Domain mumbaicompanydatabase.com
Base Domain mumbaicompanydatabase.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2026-04-06T15:02:24+00:00
Next Scan 2026-04-20T15:02:24+00:00

Last Successful Scan

Scanned2026-02-27T15:01:49+00:00
URL https://mumbaicompanydatabase.com/robots.txt
Domain IPs 104.21.52.237, 172.67.205.117, 2606:4700:3032::ac43:cd75, 2606:4700:3036::6815:34ed
Response IP 172.67.205.117
Found Yes
Hash dfacccca9f1cbdb709d7202f08925eb4b2e6e009f12e3ae4b4254383bd501b53
SimHash 4009d8d5d750

Groups

*

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /tmp/
Disallow /private/

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.mumbaicompanydatabase.com/sitemap.xml

Comments

  • robots.txt for Mumbai Company Database
  • Sitemap
  • Crawl-delay
  • Common bots