There exists insufficient eye-tracking evidence on the differences in emotional word processing between the first language (L1) and second language (L2) readers. This study conducted an eye-tracking experiment to investigate the emotional effects in L2 sentence reading, and to explore the modulation of L2 proficiency and individual emotional states. Adapted from Knickerbocker et al. (2015), the current study recorded eye movements at both early and late processing stages when late Chinese–English bilinguals read emotion-label and neutral target words in natural L2 sentences. Results indicated that L2 readers did not show the facilitation effects of lexical affective connotations during sentence reading, and they even demonstrated processing disadvantages for L2 emotional words. Additionally, the interaction effect between L2 proficiency and emotion was consistently significant for the measure of total reading time in positive words. Measurements of participants’ depressive and anxious states were not robustly correlated with eye movement measures. Our findings supplemented new evidence to existing sparse eye-tracking experiments on L2 emotion processing, and lent support to several theoretical frameworks in the bilingual research field, including the Emotional Contexts of Learning Theory, Lexical Quality Hypothesis and Revised Hierarchical Model.

Previous research has provided evidence for cross-language phonological activation during visual word recognition. However, such findings mainly came from alphabetic languages, and readers’ familiarity with the two scripts might differ. The present study aimed to test whether such cross-language phonological activation can be observed in Chinese, a logographic script, without the confounding factor of script familiarity as readers read the same script in different languages. Cantonese–Mandarin bilinguals were tested in an eye-tracking experiment in which they were instructed to read sentences silently. A target word in the sentence was replaced by either a homophone in both Cantonese and Mandarin, a homophone in Cantonese or in Mandarin only, or an unrelated character. The results showed that native Cantonese readers could activate phonological representations of L1 and L2 while reading Chinese sentences silently. However, the degree to which they relied on phonological decoding in L1 and L2 varied in the two languages.

This paper studied the use of eye movement data to form criteria for judging whether pilots perceive emergency information such as cockpit warnings. In the experiment, 12 subjects randomly encountered different warning information while flying a simulated helicopter, and their eye movement data were collected synchronously. Firstly, the importance of the eye movement features was calculated by ANOVA (analysis of variance). According to the sorting of the importance and the Euclidean distance of each eye movement feature, the warning information samples with different eye movement features were obtained. Secondly, the residual shrinkage network modules were added to CNN (convolutional neural network) to construct a DRSN (deep residual shrinkage networks) model. Finally, the processed warning information samples were used to train and test the DRSN model. In order to verify the superiority of this method, the DRSN model was compared with three machine learning models, namely SVM (support vector machine), RF (radom forest) and BPNN (backpropagation neural network). Among the four models, the DRSN model performed the best. When all eye movement features were selected, this model detected pilot perception of warning information with an average accuracy of 90.4%, of which the highest detection accuracy reached 96.4%. Experiments showed that the DRSN model had advantages in detecting pilot perception of warning information.

Purpose: Cortical and subcortical functional activity stimulated via saccade and vergence eye movements were investigated to examine the similarities and differences between networks and regions of interest (ROIs). Methods: Blood oxygenation level-dependent (BOLD) signals from stimulus-induced functional Magnetic Resonance Imaging (MRI) experiments were analyzed studying 16 healthy subjects. Six types of oculomotor experiments were conducted using a block design to study both saccade and vergence circuits. The experiments included a simple eye movement task and a more cognitively demanding prediction task. A hierarchical independent component analysis (ICA) process began by analyzing individual subject data sets with spatial ICA to extract spatial independent components (sIC), which resulted in three ROIs. Using the time series from each of the three ROIs per subject, per oculomotor experiment, a temporal ICA was used to compute individual temporal independent components (tICs). For each of the three ROIs, the individual tICs from multiple subjects were entered into a second temporal ICA to compute group-level tICs for comparison. Results: Two independent spatial maps were observed for each subject (one sIC showing activity in the frontoparietal regions and another sIC in the cerebellum) during the six oculomotor tasks. Analysis of group-level tICs revealed an increased latency in the cerebellar region when compared to the frontoparietal region. Conclusion: Shared neuronal behavior has been reported in the frontal and parietal lobes, which may in part explain the segregation of frontoparietal functional activity into one sIC. The cerebellum uses multiple time scales for motor learning. This may result in an increased latency observed in the BOLD signal of the cerebellar group-level tIC when compared to the frontal and parietal group-level tICs. The increased latency offers a possible explanation to why ICA dissects the cerebellar activity into an sIC. The hierarchical ICA process used to calculate group-level tICs can yield insight into functional connectivity within complex neural networks.

We identify two aspects of the problem of maintaining perceptual stability despite an observer's eye movements. The first, visual direction constancy, is the (egocentric) stability of apparent positions of objects in the visual world relative to the perceiver. The second, visual position constancy, is the (exocentric) stability of positions of objects relative to each other. We analyze the constancy of visual direction despite saccadic eye movements.

Three information sources have been proposed to enable the visual system to achieve stability: the structure of the visual field, proprioceptive inflow, and a copy of neural efference or outflow to the extraocular muscles. None of these sources by itself provides adequate information to achieve visual direction constancy; present evidence indicates that all three are used.

Our final question concerns how information processing operations result in a stable world. The three traditionally suggested means have been elimination, translation, or evaluation. All are rejected. From a review of the physiological and psychological evidence we conclude that no subtraction, compensation, or evaluation need take place. The problem for which these solutions were developed turns out to be a false one. We propose a “calibration” solution: correct spatiotopic positions are calculated anew for each fixation. Inflow, outflow, and retinal sources are used in this calculation: saccadic suppression of displacement bridges the errors between these sources and the actual extent of movement.

This paper presents a general computational treatment of how mammals are able to deal with visual objects and environments. The model tries to cover the entire range from behavior and phenomenological experience to detailed neural encodings in crude but computationally plausible reductive steps. The problems addressed include perceptual constancies, eye movements and the stable visual world, object descriptions, perceptual generalizations, and the representation of extrapersonal space.

The entire development is based on an action-oriented notion of perception. The observer is assumed to be continuously sampling the ambient light for information of current value. The central problem of vision is taken to be categorizing and locating objects in the environment. The critical step in this process is the linking of visual information to symbolic object descriptions; this is called indexing, from the analogy of identifying a book from index terms. The system must also identify situations and use this knowledge to guide movement and other actions in the environment. The treatment focuses on the different representations of information used in the visual system.

The four representational frames capture information in the following forms: retinotopic, head-based, symbolic, and allocentric. The functional roles of the four frames, the communication among them, and their suggested neurophysiological realization constitute the core of the paper. The model is perforce crude, but appears to be consistent with all relevant findings.

We recorded optokinetic eye movements of the crab, Carcinus maenas, in split-drum experiments. The patterns were either oscillated in antiphase on both sides mimicking translational image flow or they were oscillated in phase producing rotational image flow. Eye movements elicited by the rotational stimulus were larger than those produced by the pseudotranslational pattern movements. The smaller response to the latter is mainly a consequence of binocular interaction, the strength of which depends on both the phase-shift and amplitude of pattern oscillation. We develop two hypotheses to explain our results: either (1) signals from each eye modify the gain of the linkage signals coming from the other eye, or (2) the signals coming from the other eye modify the gain of the control loop itself. Quantitative evaluation of the data favors the second of these two hypotheses, which comprises the models of Barnes and Horridge (1969) and Nalbach et al. (1985). In addition, we found that it is the signals from the two slow channels of the crab's movement-detecting system that are transferred from one eye to the other, while signals of the fastest channel act almost exclusively ipsilaterally. We discuss our results as an adaptation by which an animal with panoramic vision compensates exclusively the rotational component of image flow during locomotion. The fact that freely walking crabs distinguish the two components of image flow better than restrained crabs indicates that further visual and nonvisual signals help to disentangle image flow.

The oculomotor system has long been thought to rely on an accurate representation of eye displacement or position in a successful attempt to reconcile a stationary target's retinal instability (caused by motion of the eyes) with its corresponding spatial invariance. This is in stark contrast to perceptual localization, which has been shown to rely on a sluggish representation of eye displacement, achieving only partial compensation for the retinal displacement caused by saccadic eye movements. Recent studies, however, have begun to cast doubt on the belief that the oculomotor system posseses a signal of eye displacement superior to that of the perceptual system. To verify this, five humans and one monkey (Macaca nemesthna) served as subjects in this study of oculomotor localization abilities. Subjects were instructed to make eye movements, as accurately as possible, to the locations of three successive visual stimuli. Presentation of the third stimulus (2-ms duration) was timed so that it fell before, during, or after the subject's saccade from the first stimulus to the second. Localization errors in each subject (human and nonhuman) were consistent with the hypothesis that the oculomotor system has access to only a damped representation of eye displacement —a representation similar to that found in perceptual localization studies.

A countermanding paradigm was utilized to investigate the regulation of saccade initiation. Two rhesus monkeys were instructed to generate a saccade to a peripheral target; however, on a fraction of trials after a delay, the monkeys were signaled to inhibit saccade initiation. With short delays between the presentation of the target and the signal to inhibit saccade generation, monkeys withheld saccades to the peripheral target. As the delay of the stop signal increased, monkeys increasingly failed to withhold the saccade. The hypothesis that the generation of the saccade is determined by a race between a go and a stop process provides three explicit means of estimating the covert latency of response to the stop signal. This latency, known as stop signal reaction time, was estimated to be on average 82 ms for both monkeys. Because the stop signal latency represents the time required to exert inhibitory control over saccade production, the countermanding paradigm will be useful for studying neural mechanisms that regulate saccade initiation.

The mammalian superior colliculus is involved in the transformation of sensory signals into orienting behaviors. Sensory and motor signals are integrated in the colliculus to produce movements of the eyes, head, and neck. While there is a considerable amount of information available on the afferent and efferent connections of the colliculus, almost nothing is known about its intrinsic circuitry, particularly that of its deepest layers. It is likely that intrinsic connections in these deeper layers of the colliculus participate in the sensory-motor transformations leading to orienting movements. In this study, we used the neuroanatomical tracer biocytin to label small groups of neurons in the deeper layers of the cat superior colliculus and examine the distribution of their axons and terminals. We found a broadly distributed network of intrinsic projections throughout the deep layers of the superior colliculus. While the majority of terminals were found in a 1–2 mm radius around the injection site, labeled terminals were found throughout the deep layers of the colliculus up to 5 mm from the injection site. In addition, these injections sometimes labeled terminals in the superficial tectum. Extensive projections were demonstrated by the more superficial injections, but few terminals were found when injections were confined to the deepest layers of the colliculus. There was no evidence of anisotropy in the distribution of terminals from injections made at different rostrocaudal or mediolateral locations; neurons located in any one region in the colliculus could potentially influence any other region. This network of intrinsic connections in the cat superior colliculus could provide a means for deeper-layer efferent neurons to associate, and to modulate or coordinate their output. Interneurons could also provide a substrate for mutual inhibition between neurons at the rostral pole of the colliculus that are active during fixation, and more caudally located neurons whose activity is associated with saccadic eye movements.

Saccadic suppression is the reduced visibility that occurs during saccadic eye movements. Recent psychophysical studies have suggested that this is due to a reduction in responsiveness of magnocellular (M), but not parvocellular (P), cells of the lateral geniculate nucleus. To address this and other phenomena of responsiveness during saccades, we recorded from geniculate neurons in the behaving monkey before, during, and after saccades. Specifically, we measured neuronal responses to a flashing, whole-field illumination. Contrary to the prediction, most M neurons showed pronounced enhancement of visual activity during saccades, whereas such responsiveness of parvocellular (P) neurons was not significantly affected by saccades. We also analyzed the extent to which saccades affected burst firing, which results from activation of a voltage-dependent Ca2+ conductance. We found that both M and P cells displayed a significant suppression of burst firing during saccades. These results do not support the idea that saccadic suppression has an obvious substrate in reduced responsiveness of geniculate cells, but this suppression may be related to an increased visual threshold for detection associated with reduced burst firing.