@weaver, it appears it is because the Image in the gallery is getting a float left from the rule
#content .attachment-thumbnail {float:left;margin-right:12px;margin-left:12px;padding:0;}
If I remove the float:left, the caption takes its place below the image