Track Description Available in: "All You Had to Do Was Stay" is the fifth track from Taylor Swift's fifth studio album, 1989. It was written by Swift and Max Martin. "AYHTDWS" revolves around the broken relationship of people who couldn't be together because the boyfriend wasn't open and loyal enough.