Balogun: Dunk, Duffy kept me out of Brighton