Log In Sign Up

biostempharma.com
robots.txt

Robots Exclusion Standard data for biostempharma.com

Resource Scan

Scan Details

Site Domain biostempharma.com
Base Domain biostempharma.com
Scan Status Ok
Last Scan2025-11-14T01:13:38+00:00
Next Scan 2025-12-14T01:13:38+00:00

Last Scan

Scanned2025-11-14T01:13:38+00:00
URL https://biostempharma.com/robots.txt
Domain IPs 107.6.176.102
Response IP 107.6.176.102
Found Yes
Hash 6ae2eccbfb19aa1c769e8a726d3c28f34ef6b18dd387d044b93d52d7ad8d6a6a
SimHash 8671dad2c4eb

Groups

*

Rule Path
Allow /
Allow /about
Allow /contact-us
Allow /blog
Allow /products
Allow /pharma-franchise
Allow /indian-pcd-pharma-companies
Allow /pcd-pharma-companies
Allow /third-party-pharma-manufacturing
Allow /pharma-franchise-company
Allow /pcd-pharma-franchise-company
Allow /pharma-pcd
Allow /pcd-pharma
Allow /ptr-and-pts-calculator/
Allow /product/*
Back to top

Other Records

Field Value
sitemap https://biostempharma.com/sitemap.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • Directives to allow bots to index important pages
  • Sitemap
  • Allow crawling of all individual product pages
  • Disallow crawling of URL patterns with parameters
  • to avoid duplicate content issues (uncomment if needed)
  • Disallow: /product/*?*
  • SEO enhancements: disallow URLs that are not necessary for search engines
  • (uncomment based on the necessity, if there are any URLs to be blocked)
  • Disallow: /cgi-bin/
  • Disallow: /tmp/
  • Disallow: /junk/
  • Crawl-delay to prevent server overload (if necessary)
  • Crawl-delay: 10
  • ---------------------------
  • END YOAST BLOCK
Back to top