I remember having this thought before, except it was about seeing the reflection of the sun on a car. Why wouldn't the entire car be awash with blinding light? Thinking about it, though, I realized what Trailblazer described above: only a certain area of the car would reflect the photons from the sun directly into my eye, and that area was the spot where I was the image of the sun.
Instead of thinking about how the sunlight is cast in all directions, think about your own cone of vision. You can picture it as a series of "rays" that converge on your eye(s). Only photons that travel in a path along these rays will be in your vision. So as the rays of light fan outward form the sun, only some will line up with the "rays" that converge on your eyes. It's in those areas that you will see an image, in this case the reflection.
This explanation sort of assumes that we're talking about theoretical points of light rather than real objects with size and mass, but if you imagine that every visible point on the sun is radiating photons in all directions then there will be one ray of light that travels from that point to your eye; do this for every point on the sun and your eye sees an object. The reflection is causing the other rays from those points to bounce in different directions, and some of them are directed into your eye. Others just bounce off elsewhere and scatter, meaning they don't make the same bright reflection as the direct ones.