Sensory Computer Systems Forums

[Mary]

I would like some information on know to how set up a Difference-From-Control Test in SIMS Sensory Quality Software System. Also the Dunnett's T Test.

Thanks in advance,
Mary

[PAL]

Here's an example of the Dunnett's Statistics in your SIMS System:

Updated Summer 2022

Set up:

This document describes how to set up a Difference-From-Control Test in SIMS software.
This test is also known as a Degree of Difference Test (DOD).
To jump right to Dunnett's T Test see #6) below.

Use this test when the project objectives include the following:

• Determine whether there is a difference between a control (reference) sample and one or more other samples.
  
• Estimate the degree of such difference(s).

Questionnaire example showing both an hedonic scale and a line scale.

Overview

Present to each panelist the control (reference) sample plus one or more additional samples. Panelist will rate the degree of difference between each sample and the control. Explain to panelists that some of the test samples may be identical to the control.

While it is acceptable to ask the panelists other questions about each sample, for the purpose of this discussion assume that the difference-from-control question is the only one on the test.

1) Questionnaire

1. Create a questionnaire, Affective type, perhaps named DIFF_CTRL (reusable for future studies).
   (Note: As discussed below, the degree of difference attribute can be either a Line Scale or Hedonic Scale. While it is possible to use a Descriptive questionnaire for a Line Scale attribute, setting the questionnaire type as Affective provides more flexibility to add other attribute types at a later time.)
   
   
2. Create a Hedonic or Line Scale attribute which will be used to record the extent of the difference of each sample from the Control. For a Hedonic Scale the categories will look something like this:
   

   Code:

   Choice Description         Return Value              o    No Difference                       0              o    Very Small Difference               1              o    Small Difference                    2              o    Small/Moderate Difference           3              o    Moderate Difference                 4              o    Moderate/Large Difference           5              o    Large Difference                    6              o    Very Large Difference               7

   
   
   For a Line Scale the Minimum Value should be 0 associated with a description of "No Difference." The Maximum Value should correspond to a description like "Very Large Difference." The scale can be either continuous or incremental. Reference Points associated with mid-level degrees of difference may be included to aid the respondents.
   
   
3. Question Example: Please rate the level of difference for Sample nnn relative to the control sample.
   
   
4. Set the "Attribute Seen With" option to "All Samples."
   
   
   SIMS software express package file: DIFF-CTRL.SIMS2000ExpressPackage.sql.ZIP
   
   

Note: This forum topic and the notes below are about presentations which include Control vs Blind Control.

Control vs Control
Control vs Test Sample #1
Control vs Test Sample #2

In contrast, if your study only includes presentations of Control vs Test(s), and does not incorporate presentations for Control vs Blind Control, then we suggest the following:
- For a simple Control vs Test we recommend a simple 1 sample study, a DOD type question, and after the test, review your raw data, means, standard deviations, and other statistical methods of your choosing.
- For a simple Control vs Test1 + Control vs Test2 we recommend a simple 2 sample study, a DOD type question, and after the test, review your raw data, means, standard deviations, and other statistical methods of your choosing.
- skip all of the notes below.



Read on for:
For Control vs Blind Control , Control vs Test1 , Control vs Test2. This is a 3C3 design.
and very similar if just Control vs Blind Control , Control vs Test1. This is a 2C2 design.
and very similar Control & 3 test samples. This is a 4C4 design.
Etc., etc.



2) Experimental Design

The Experimental Design must be a Complete Block design such as 3 Samples see 3 in order to employ the Dunnett Test when the statistics are generated. It is recommended that Sample Order be randomized within each block to eliminate positional bias, which is called a "Balanced Complete Block".

The Control or Reference Sample is USUALLY designated as Sample 1 in the Experimental Design.

Control
Test Sample #1
Test Sample #2

Each Sample Set presented to a panelist will always include a sample labeled as the "Control" or "Reference." In addition the panelist will also be presented with each of the samples labeled with a three-digit Blinding Code.

The panelist will first taste the Control sample, then they will taste the 3 blind coded samples, one at a time, rating the difference from Control.

Effectively the panelist will be evaluating, in random order:
Control vs Control
Control vs Test Sample #1
Control vs Test Sample #2


In this example, the Experimental Plan should be Permutations 3 choose 3 (blocks 1 2 3 randomized).

So the panelist will compare the Control with each of the blind ordered samples. Exactly one of the ordered samples will be the same as Control, but panelist will not know which one.

3) Test Definition

1. Create a new Test Definition by selecting your new Questionnaire and Experimental Design. Use whatever Panel Type option works for you.
   
   
2. Print the Rotation Plan for the technician to prepare the ballots properly.
   
   
3. In addition, have the technician also prepare a Control sample to include with every ballot.

4) Test Result Master / Execution

1. Create a new Test Result Code, using the Test Definition above.
   
2. Start the Test.

5) Test Administration

You may need to explain to the panelists that the SIMS Sample Verification Prompt will not include the Control or Reference sample. However, each panelist must have this Control sample to complete the test properly. This explanation may be important to those panelists used to the presentation of SIMS Duo-Trio tests, which explicitly include the "R