The Average Color of the Universe