@Chebhou's comment above solved the issue.
The tilt of individual (or all) points on a curve can be adjusted by highlighting the relevant control points and pressing Ctrl+T followed by making the adjustment.
When you are using another object with a curve modifier this will adjust the orientation of that object as it follows the curve.