We measured the timing of activity in distinct functional areas of the human visual cortex after onset of a visual pattern. This is not possible with visual evoked potentials (VEPs) or magnetic fields alone, and direct combination of functional magnetic resonance imaging (fMRI) with electromagnetic data has turned out to be difficult. We tested a relatively new approach, where both position and orientation of the active cortex was given to the VEP source model. Subjects saw the same visual patterns flashed ON and OFF, both when recording VEPs and fMRI responses. We identified the positions and orientations of the activated cortex in four retinotopic areas in each individual, and the corresponding dipoles were seeded to model the individual evoked potential data. Unexplained variance, comprising signals from other areas, was inversely modeled. Despite the partially a priori fixed model and optimized signal-to-noise ratio of VEP data, full separation of retinotopic areas was only seldom possible due to crosstalk between the adjacent sources, but separation was usually possible between areas V1 and V3/V3a. Whereas the latencies generally followed the hierarchical organization of cortical areas (V1-V2-V3), with around 25 ms between the strongest responses, an early activation emerged 10-20 ms after V1, close to the temporo-occipital junction (LO/V5) and with an additional 20-ms latency in the corresponding region of the opposite hemisphere. Our approach shows that it is feasible to directly seed information from fMRI to electromagnetic source models and to identify the components and dynamics of VEPs in different retinotopic areas of a human individual.