Information zum Seitenaufbau und Sprungmarken fuer Screenreader-Benutzer: Ganz oben links auf jeder Seite befindet sich das Logo der JLU, verlinkt mit der Startseite. Neben dem Logo schliesst sich die Hauptnavigation in Form der Reiternavigation an. Es folgt die Grobnavigation links unterhalb des Logos. Die Feinnavigation findet sich in der linken Spalte. Unterhalb der Reiternavigation ist die Brotkrumen-Navigation. In der Mitte der Seite befindet sich der Inhaltsbereich. In der rechten Spalte finden Sie die Suche und ueblicherweise Kontaktdaten und direkte Links. Als Abschluss der Seite sind im Fussbereich Links zu Barrierefreiheit, Kontakt Web-Master, Impressum, Plone-Kurse, Hilfe, Login fuer Redakteure aufgelistet.

vor "Barrierefreiheit" im Seitenfuss vor Reiternavigation vor Grobnavigation in linker Kolumne vor Feinnavigation in linker Kolumne vor Sie sind hier vor Inhalt vor rechter Kolumne mit zusaetzlichen Informationen im Suchfeld Suche nach vor Redaktion vor Kontakt Web-Master im Seitenfuss vor Impressum im Seitenfuss

Reiternavigation
Artikelaktionen

Giessen Test Tool

Software for analyzing items of educational and psychological tests

Logo

The GTT software can be used to analyze items of educational and psychological tests. All test items are assumed to have dichotomous response format. The analyses can be based on classical test theory as well as the 1-, 2-, and 3-PL models from item response theory. The software computes several ability estimators and produces various plots. GTT runs on Windows XP, Vista, and Windows 7. This documentation refers to GTT 1.0.7.

You can download GTT by clicking on gtt.zip. After extracting the archive, GTT can be run by double-clicking on the executable file. To get started, see "readme.txt". For recent changes and bug fixes, see the Change-Log.

Project

GTT can read in data from plain text-files in free or fixed-width formats (Project⇒New). Positive and negative responses are assumed to be numerically coded as 1 and 0. The default code for missing values is 9. Only one line of data per individual is allowed. In case the data file contains header lines or columns containing individual IDs, it is possible to skip lines at the beginning and a of columns in each row. After the data have been imported, they are shown in the data window. To each item there belongs a check box for item inclusion and reverse item coding. The data can be stored as a GTT project file (Project⇒Save as) that allows immediate later access to the data (Project⇒Open)

CTT

The CTT menu can be used to perform item analysis based on classical test theory. Specifically item difficulty and item discrimination can be calculated via (CTT⇒Item analysis). In addition the individual sum scores are available along with a frequency table of the observed scores as well as a table relating sum scores to the T-, Z- and C-norms. These norm values have means and standard deviations according to the following table:

Norm value Mean Standard deviation
T 50 10
Z 100 10
C 5 2

 

IRT

The IRT menu can be used to perform item analysis based on item response theory. Before starting item calibration the user can select among the 1-, 2-, and 3-PL models. The statistical approach to item calibration is mainly marginal maximum likelihood (MML) using the EM Algorithm. For the 1-PL model the conditional maximum likelihood approach (CML) is also available. The calibration is run by clicking IRT⇒Run. To fix the scale for the item parameters, MML estimation assumes standard normally distributed abilities, and CML estimation scales the items difficulties such that their mean equals zero.

The result of a model fit is shown in a new window. It is possible to print the output and to save it in different formats:

  • HTML text: Exports the output as browser-viewable text file.
  • TeX table: Creates a table body for pasting into a (La)TeX document.
  • Parameter set: Exports the parameters for later use by the program. These files can be imported by using the import button in Special⇒Define item parameters.

Calibration settings (IRT⇒Settings) can be modified by the user. This is useful if item calibration results in warnings or error messages. Specifically, users can specify:

  • Max EM iterations: Maximum number of EM iterations.
  • EM termination criterion: Maximum absolute change of any single item parameter between successive iterations.
  • Max Newton iterations: Maximum number of Newton iterations when performing the M-step.
  • Newton termination criterion: Maximum absolute item parameter change between successive iterations of the M-step.
  • Starting values: Estimates will be calculated by fitting logistic regression models for each item (option Estimate). It is possible to specify starting values using the Custom option.
  • Number of nodes: Number of rectangles for numerical integration in the E-step.
  • From: Lower integration interval limit of the E-step.
  • To: Upper integration interval limit of the E-step.
Note that the 3-PL model is notoriously difficult to fit to data. Even if the sample size is huge (exceeding several thousands of individuals) the parameter estimates may not convergence. In these cases, warning or error messages can be expected in the output window.


Plots

GTT can display the item characteristic curve (ICC), test characteristic curve (TCC), item information and test information. Plots⇒Run will display the plots for which the corresponding menu entry is checked. Each plot provides controls for selecting which graphs to show, which horizontal and vertical ranges to show, grid intervals and whether to show labels.

Abilities

After fitting a model to the data, ability estimates can be calculated (Abilities⇒Estimate). Users can select among the maximum likelihood (ML), maximum a posteriori (MAP) and the weighted likelihood estimate (WLE). In addition, the following settings influencing the numerical computations can be changed:

  • Max iterations: Maximum number of iterations.
  • Termination criterion: Maximum absolute item parameter change between successive iterations.
  • Automatic starting values: GTT can automatically select a starting value based on a rough guess of the ability estimate.
  • Starting values: Users can supply a starting value, which will be used as a starting value for all individuals.
  • Step size: Factor by which the change in the ability estimate between successive iterations can be shrunk. (A factor less than 1.0 maybe useful in cases of non-convergence.)

Item-fit Statistics

GTT computes Yen's Q1 statistic to evaluate item fit. For the 1-PL model the infit and outfit statistics are also available. Since item-fit statistics depend on ability GTT allows users to select the ability estimate on which the statistics are computed.

For Q1, two modes of ability-based grouping of individuals are available:

  • Equal group size: Users can select the group size.
  • Equal probabilities: This setting assumes normal distribution of abilities and uses the distribution's quantile function to determine ability intervals with equal expected frequency of occurrence. Small groups (Min. group size) will be removed and values will be distributed among adjacent groups.
During calculation of the statistics the program will count expected group sizes below the given warning threshold and report their number for each item. The resulting report contains for each item:
  • Q1
  • p-value
  • Lowest expected group size
  • Ratio of groups having an expected size below the given warning threshold
Note that  p-values of the Q1 statistic are unreliable if the number of items is small (say, less than twenty).  

Special

GTT can produce random responses based on user supplied item parameters (Special⇒Generate responses). The following information needs to be provided:

  • Item parameters.
  • Probability of responses missing at random.
  • Mean and standard deviation of the ability distribution (assumed to be normal).
  • Number of individuals.

 

Contact Information

GTT has been developed at the University of Giessen. Program authors are Christof Schuster and Laurens Berthold.  GTT has been developed using QtEigen and Boost. Qt is licensed under the LGPL 2.1. Eigen is licensed under the LGPL 3.0.

 The program is provided as is with no warranty of any kind.

Copyright © 2011 Christof Schuster and Laurens Berthold


Barrierefreiheit | Kontakt Web-Master | Impressum | Plone-Kurse | Hilfe | Login für Redakteure
Powered by Plone CMS, the Open Source Content Management System

Diese Website erfüllt die folgenden Standards: