Log In Sign Up

bfstatic.com
robots.txt

Robots Exclusion Standard data for bfstatic.com

Resource Scan

Scan Details

Site Domain bfstatic.com
Base Domain bfstatic.com
Scan Status Ok
Last Scan2025-07-22T21:23:22+00:00
Next Scan 2025-08-21T21:23:22+00:00

Last Scan

Scanned2025-07-22T21:23:22+00:00
URL https://www.bfstatic.com/robots.txt
Domain IPs 104.26.8.151, 104.26.9.151, 172.67.69.98, 2606:4700:20::681a:897, 2606:4700:20::681a:997, 2606:4700:20::ac43:4562
Response IP 104.26.9.151
Found Yes
Hash f8536ce151f0fcc20d9b4a6139d94fd3d6ac96e8ec85c662117c9d02f3613450
SimHash 08f6c106dfd6

Groups

*

Rule Path Comment
Disallow /jsp/survey/surveyAction.do We don't want bots to index this url added for case 69377
Back to top

Comments

  • A directive base instructions for crawlers, for details see www.google.com/bot.html
  • Disallow: /login/csl.asp
  • Disallow: /highed/helpNow.asp
  • Disallow: /highed/home.asp
  • Disallow: /JobNow/index.asp
Back to top