Danny Duffy showed no signs of defeat after a rough start