It means that nothing could drag him away from the love of his life, "Wild horses couldn't drag me away" meaning NOTHING or NO ONE could stop his love for her.