The vertebrate eye allows to capture an enormous amount of detail about the surrounding world which can only be exploited with sophisticated central information processing. Furthermore, vision is an active process due to head and eye movements that enables the animal to change the gaze and actively select objects to investigate in detail. The entire system requires a coordinated coevolution of its parts to work properly. Ray-finned fishes offer a unique opportunity to study the evolution of the visual system due to the high diversity in all of its parts. Here, we are bringing together information on retinal specializations (fovea), central visual centers (brain morphology studies), and eye movements in a large number of ray-finned fishes in a cladistic framework. The nucleus glomerulosus-inferior lobe system is well developed only in Acanthopterygii. A fovea, independent eye movements, and an enlargement of the nucleus glomerulosus-inferior lobe system coevolved at least five times independently within Acanthopterygii. This suggests that the nucleus glomerulosus-inferior lobe system is involved in advanced object recognition which is especially well developed in association with a fovea and independent eye movements. None of the non-Acanthopterygii have a fovea (except for some deep sea fish) or independent eye movements and they also lack important parts of the glomerulosus-inferior lobe system. This suggests that structures for advanced visual object recognition evolved within ray-finned fishes independent of the ones in tetrapods and non-ray-finned fishes as a result of a coevolution of retinal, central, and oculomotor structures.