Two epistemic principles are Knowledge Exclusion and Belief Exclusion. Knowledge Exclusion says that it is necessarily the case that if an agent knows that p, then she does not believe that ∼p, and Belief Exclusion says that it is necessarily the case that if an agent believes that q, then she does not believe that ∼q. Many epistemologists find it reasonable to reject the latter principle and accept the former. I argue that this is in fact not reasonable by proposing a case in which an agent can use that she has contradictory beliefs towards a proposition as decisive evidence for that proposition. A natural response is that this case conflicts with common assumptions about the relation between knowledge, contradictory beliefs and rationality. I reply by drawing ideas from Lasonen-Aarnio’s (2010) remarks on unreasonable knowledge to explain why these common assumptions do not threaten my argument.