Two studies are reported which demonstrate that analytic responding on everyday reasoning problems can be increased and bias eliminated after training on the law of large numbers (Fong, Krantz, Nisbett, 1986). Critical thinking problems involving belief-consistent, neutral, and inconsistent conclusions were presented. Belief bias was eliminated when a written justification of argument strength was elicited. However, belief-based responding was still evident when evaluations of the arguments were elicited using rating scales. This finding demonstrates a dissociation between analytic and belief-based responding as a function of response format. In Experiment 2 an instructional condition designed to foster decontextualised reasoning was included but was ineffective in reducing the degree to which judgements were biased by beliefs. It was concluded that training which makes available the analytic strategies necessary to evaluate a problem has the potential to facilitate performance only if the requested response triggers conscious deliberation of the evidence.