Two piece knit set with button detail