Sceptical theists undermine the argument from evil by claiming that our ability to distinguish between justified and unjustified evil is weak enough that we must take seriously the possibility that all evil is justified. However, I argue that this claim leads to a dilemma: either our judgements regarding unjustified evil are reliable enough that the problem of evil remains a problem, or our judgements regarding unjustified evil are so unreliable that it would be misguided to use them in our decision-making. The first horn undermines theism, while the second undermines our moral decision-making. Thus, sceptical theism is problematic.