blalbiotech.com
robots.txt

Robots Exclusion Standard data for blalbiotech.com

Resource Scan

Scan Details

Site Domain blalbiotech.com
Base Domain blalbiotech.com
Scan Status Ok
Last Scan2025-11-10T11:41:23+00:00
Next Scan 2025-12-10T11:41:23+00:00

Last Scan

Scanned2025-11-10T11:41:23+00:00
URL https://blalbiotech.com/robots.txt
Domain IPs 104.21.33.145, 172.67.146.104, 2606:4700:3032::6815:2191, 2606:4700:3033::ac43:9268
Response IP 104.21.33.145
Found Yes
Hash 708b50c427bd9c20772266872657af2a63ae9c4f945670ec81c3b546cd77052a
SimHash 6d6ceb736678

Groups

*

Rule Path
Allow /
Disallow /ja/
Disallow /jp/
Disallow /casino/
Disallow /bet/
Disallow /shopping/
Disallow /online/
Disallow /old/
Disallow /tmp/
Disallow /cgi-bin/
Disallow /*?pid=
Disallow /*?page_id=
Disallow /*?s=
Disallow /*yjp.txt
Disallow /*.html$
Disallow /vendor/
Disallow /storage/
Disallow /bootstrap/
Disallow /config/
Disallow /products/

Other Records

Field Value
sitemap https://www.blalbiotech.com/sitemap.xml

Comments

  • Allow normal crawling
  • Block old spam or hack-generated directories (adjust if not present)
  • Block system folders (Laravel)
  • Security headers & sitemap