Aligning Data to a Specific Sample Message

Vincent Porretta

2020-11-29

Sometimes, depending on the design of the experiment, you may decide not to define an interest period in Data Viewer prior to exporting the data. If this is the case, there are some functions in VWPre which can help to align the data to your critical stimulus. Specifically, these functions search for a specific Eyelink message which was read out during the recording sequence. They will align the samples to this message, and, if necessary, also apply a variable adjustment forward or backward in time. This depends on whether the message signals the onset of the stimulus itself, or rather, serves as a reference point for the onset of the stimulus.

Before aligning

In order to perform the alignment, you must first load your sample report and complete the first two preprocessing steps using the functions prep_data and relabel_na provided in this package. These step will ensure that an Event column (unique index of each recording sequence - typically the combination of Subject and Trial) is created. A description of these can be found in the Basic Preprocessing vignette.

Aligning to a specific message

Using the function check_msg_time you can see that the TIMESTAMP values associated with the message are not the same for each event. This indicates that alignment is required. Note that a regular expression (regex) can be used here as the message string.

check_msg_time(data = aligndat, Msg = "VowelOnset")
## # A tibble: 9 x 2
##   SAMPLE_MESSAGE TIMESTAMP
##   <fct>              <dbl>
## 1 VowelOnset       1047469
## 2 VowelOnset       1062679
## 3 VowelOnset       1099738
## 4 VowelOnset       1107363
## 5 VowelOnset       1114682
## 6 VowelOnset       1165881
## 7 VowelOnset       1183191
## 8 VowelOnset       1200283
## 9 VowelOnset       1207406
## Set ReturnData to TRUE to output full, event-specific information.

If you are not sure which messages are in your data set, you can use the function check_all_msgs. This will print all the messages (along with Event, Subject, Trial, and Timestamp). By specifiying ReturnData = TRUE, you can assign the output to a dataframe for further sorting, etc.

check_all_msgs(data = aligndat)
## # A tibble: 4 x 1
##   SAMPLE_MESSAGE
##   <fct>         
## 1 Preview       
## 2 TargetOnset   
## 3 VowelOnset    
## 4 TIMER_search
## Set ReturnData to TRUE to output full, event-specific information.

The function align_msg is used to perform the alignment. To do this you must specify the message text as a string to the parameter Msg. Again, this string can contain a regular expression (regex) on which to locate the message. The function finds the instance of the message for each event and sets that sample as the zero point. Consequently, this creates a new column called Align, which represents the time sequence relative to the message.

aligned1 <- align_msg(data = aligndat, Msg = "VowelOnset")

If we check the message time again, we now see that the message occurs at time 0 in the Align column.

check_msg_time(data = aligned1, Msg = "VowelOnset")
## # A tibble: 1 x 2
##   SAMPLE_MESSAGE Align
##   <fct>          <dbl>
## 1 VowelOnset         0
## Set ReturnData to TRUE to output full, event-specific information.

To fully examine all events, you can include the parameter ReturnData=TRUE and assign the output to an object in your environment.

MSGTime <- check_msg_time(data = aligned1, Msg = "VowelOnset", ReturnData = TRUE)

Creating the Time series column

Once you have aligned the time sequence relative to the message, you need to create the Time column using the function create_time_series. This function returns the time series column called Time which is required for subsequent processing, plotting, and modeling of the data. In the example here, our message relates specifically to the time at which the vowel in the word was played (because we programmed Experiment Builder to output a message for that). So, we do not need to specify an adjustment to the time series. If, however, your critical stimulus did not occur exactly at the message, but rather, before or after, an adjustment (i.e., negative or positive value in milliseconds) can be applied to the time series, to shift the zero point. This is done by specifying the Adjust parameter. If, on the other hand, this adjustment differed trial by trial, you can input a column name (present in your dataset) in Adjust, which will apply the recording event specific adjustment.

A positive value (3 in the example below) provided to Adjust shifts the zero point to after the reference point (i.e., Message), effectively moving the zero point forward along the number line and causing the reference point to have a negative time value.

Smp1 Smp2 Smp3 Smp4 Smp5 Smp6 Smp7 Smp8 Smp9 Smp10 Smp11
Before -4 -3 -2 -1 0 1 2 3 4 5 6
Old 0 New 0
After -7 -6 -5 -4 -3 -2 -1 0 1 2 3

A negative value (-3 in the example below) provided to Adjust shifts the zero point to before the reference point (i.e., Message), effectively moving the zero point backward along the number line and causing the reference point to have a postive time value.

Smp1 Smp2 Smp3 Smp4 Smp5 Smp6 Smp7 Smp8 Smp9 Smp10 Smp11
Before -4 -3 -2 -1 0 1 2 3 4 5 6
New 0 Old 0
After -1 0 1 2 3 4 5 6 7 8 9
aligned2 <- create_time_series(data = aligned1, Adjust = 0)
## No adjustment applied.

The function check_time_series can be used to verify that the time series was created. The function outputs a list of the unique start values present in the data. In this example, we do not expect all events to start with the same Time value, given that we performed our own alignment without a relative interest period defined in Data Viewer. As with check_msg_time, the list of Events and Start Times can be returned as a data frame using the parameter ReturnData.

check_time_series(data = aligned2)
## # A tibble: 9 x 1
##   Start_Time
##        <dbl>
## 1       -165
## 2       -191
## 3       -215
## 4       -289
## 5       -257
## 6       -188
## 7       -264
## 8       -338
## 9       -211
## Set ReturnData to TRUE to output full, event-specific information.

Perhaps more meaningfully, we can check the message time again. We can see that our message is still the zero point in the Time series column.

check_msg_time(data = aligned2, Msg = "VowelOnset")
## # A tibble: 1 x 2
##   SAMPLE_MESSAGE  Time
##   <fct>          <dbl>
## 1 VowelOnset         0
## Set ReturnData to TRUE to output full, event-specific information.

Proceed with preprocessing

At this point it is possible to proceed with preprocessing as usual. For details, please refer to the Basic Preprocessing vignette and continue by selecting a recording eye before binning the data.