I went back to my pattern and re-measured the neck and band and found the band was 3/16" too small. Also, I decided to try curving the ends of the band up more. You can make the same alteration by slicing through the band from the collar edge to the neck edge without cutting all the way through. Then overlap it along the collar edge. The drawing below shows what I mean (click for a larger view).
Be sure to recheck measurements and the seam with the collar and neck as some adjustments may be needed.