Log In Sign Up

biometricsengineer.com
robots.txt

Robots Exclusion Standard data for biometricsengineer.com

Resource Scan

Scan Details

Site Domain biometricsengineer.com
Base Domain biometricsengineer.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-26T22:55:33+00:00
Next Scan 2025-09-25T22:55:33+00:00

Last Successful Scan

Scanned2025-07-28T21:32:11+00:00
URL https://biometricsengineer.com/robots.txt
Response IP 41.80.37.33
Found Yes
Hash 4f588f4d86ff3d5813194df299811ac0f40cea505f4693f0e70eecc5254e5702
SimHash 501c8802e593

Groups

*

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

google-extended

Product Comment
google-extended Gemini/Gemini Pro
Rule Path
Allow /

claudebot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

deepseekbot

Rule Path
Allow /

ccbot

Rule Path
Allow /

cohere-ai

Rule Path
Allow /

sogou spider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://biometricsengineer.com/sitemap.xml
Back to top

Comments

  • Allow all major search engines and AI crawlers
  • --- AI-specific bots ---
  • --- Sitemap (if available) ---
Back to top