Use your blades, traps and feints all at once to hit him hard, like with Skeletal Pirate. Buy some treasure cards that are heavy hitters. Make sure your gear gives you pips and boosts your shots. He's not an easy one but he's do-able. Oh, and do you have a pet? My Heckhound keeps me alive in a duel so you might want to check into that too.