Okay, I've found a suspect.

I'm using a modified Nova Theme as a template. Nova uses bootstrap2.css. If I start a new Nova project, I get the same behavior. If I use a different template, or start a project from scratch, they'll use coffeegrinder.css, and the icons work properly.

Now I just have to figure out if I can get glyphicons to work on bootstrap.