There is a widely shared belief that the higher-level sciences can provide better explanations than lower-level sciences. But there is little agreement about exactly why this is so. It is often suggested that higher-level explanations are better because they omit details. I will argue instead that the preference for higher-level explanations is just a special case of our general preference for informative, logically strong, beliefs. I argue that our preference for informative beliefs entirely accounts for why higher-level explanations are sometimes better—and sometimes worse—than lower-level explanations. The result is a step in the direction of the unity of science hypothesis.