Kacey Musgraves tenderly touches new boyfriend Cole Schafer as they enjoy a boat ride on vacation

A little over a month after they were first spotted holding hands in NYC, Kacey Musgraves and her new beau Cole Schafer enjoyed a luxury tropical vacation together