Table of Contents | ||||||
---|---|---|---|---|---|---|
|
Requirement | StatCalc | ||||||||
---|---|---|---|---|---|---|---|---|---|
OutlineLevel | 3.2.6 | ||||||||
JIRA Task |
|
Introduction
Excerpt |
---|
The StatCalc component of Epi Info™ 7 enables the user to evaluate the performance of different study designs and statistical tests by supplying high-level information on the properties of hypothetical data sets and the criteria used for evaluation. StatCalc tools can be divided into three broad categories: 1). sample size and power calculations for unmatched case-control studies, population surveys, cohort or cross-sectional studies, and chi-square for trend by the Mantel extension of the Mantel-Haenszel summary odds ratio and chi square (tests for the presence of a trend in dose-response or other case-control studies where a series of increasing or decreasing exposures is being studied); 2). analysis of 2-by-2 2×2 tables to produce odds ratios and risk ratios (relative risks) with confidence limits, Fisher exact tests, and 1- and 2-tailed P p-values, with Mantel-Haenszel summary odds ratios, chi square tests and associated p-values for stratified data; 3). distribution-based event probabilities, two2-tailed p-values and confidence intervals for deviations from binomial (proportions) and Poisson (rare events) distributions given the number of observed and expected events. The StatCalc tools can be accessed as an independent module from the main menu or as part of the Visual Dashboard. |
Accessing StatCalc
Overview
StatCalc appears on the Epi Info™ 7 main menu, middle row, right column, and captioned "Statistical calculators for sample size, power, and more." Selecting the StatCalc button opens the StatCalc menu, which is similar to the main menu in appearance, and contains buttons for the eight (8) StatCalc calculators listed in TABLE NAME + LINK, below. The individual calculators are also part of Visual Dashboard (VD). They can be accessed from the Options menu, under the "Add StatCalc calculator" submenu, and added to the dashboard Canvas in the same manner as other gadgets.
Functional Requirements
- Epi Info™ 7 shall enable the user to open the StatCalc menu from the Epi Info™ main menu.
- The StatCalc menu shall enable the user to start the eight (8) StatCalc calculators from an array of buttons bearing the names of the calculators.
- When the user selects a calculator from the StatCalc menu, each calculator shall open a window containing the components specified in TABLE NAME + LINK, below.
- The VD shall enable the user to select StatCalc calculators from the Options menu.
- The VD shall enable the user to place the selected calculators on the Canvas
- Calculators placed on the dashboard Canvas shall have all the relevant properties of other gadgets including the ability to:
- be repositioned on the Canvas,
- anchor to other gadgets,
- stack vertically with other gadgets in response to the user pressing the Vertical Arrange button on the VD status bar,
- hide its borders in response to the user pressing the Hide Gadget Borders button on the VD status bar
[1]
, - collapse and expand the calculator window in response to the user pressing the Arrow toggle button on the gadget's title bar
[2]
, and - close and be removed from the canvas in response to the user pressing the Close button (red box with a white × inside).
Notes:
- The behavior of this function on StatCalc calculators differs from that of other gadgets. In most cases, the Hide Gadget Borders button not only removes the outer rectangle, but the title bar and associated buttons as well. As a consequence, the gadgets can no longer be repositioned, reconfigured, collapsed or expanded, or closed. The only thing the Hide Gadget Borders button does to a StatCalc calculator is remove its border.
- These functions have not been implemented as of Epi Info™ version 7.2.0.1. See also Future Development.
StatCalc Calculators
Overview
The StatCalc calculators can be divided into three general categories: 1). Sample size and power calculations, 2). Two-way table calculations, and 3). Distribution-based event probabilities. Each group has its characteristic input parameters and analyses but they all provide the user with the ability to enter hypothetical data and evaluate their statistical significance. In doing so, the user may determine important study parameters such as the number of subjects required to test a hypothesis given specific assumptions about variables such as rates of exposure or the ratios of cases to controls.
Functional Requirements
The requirements for StatCalc are best described in a tabular format, with a row for each calculator and a column for each feature, such as titles, labels, and descriptive text, or property category, such as input parameters and the headings for values derived from the input values.
StatCalc Calculator Properties
Sample Size & Power | ||||
Calculator | Title | Description | Input Parameters | Derived Values |
---|---|---|---|---|
Population Survey | Sample Size and Power | Population survey or descriptive study (For simple random sampling, leave design effect and clusters equal to 1.) |
|
|
Cohort or Cross- Sectional | Sample Size and Power | Unmatched cohort and cross-sectional studies (exposed and unexposed) |
| A table consisting of:
|
Unmatched Case-Control | Sample Size and Power | Unmatched case-control study (Comparison of ILL and NOT ILL) |
| A table consisting of:
|
Chi-Square for Trend | Chi-Square for Trend | Analysis for Linear Trends in Proportions |
|
|
2×2 Table Calculations | ||||
Calculator | Title | Input Parameters | Derived Values (By Stratum) | Derived Values (Summary Results) |
Tables (2×2×N) (Stratified Two-way Tables) | 2×2 Tables | By stratum, 1 - 9:
|
|
|
Matched-Pair Case Control | Pair-Matched Case-Control Study |
|
| |
Distribution-Based Event Probabilities | ||||
Calculator | Title | Description | Input Parameters | Derived Values |
Binomial | Binomial | Binomial - Proportion vs. Standard |
|
|
Poisson | Poisson | Rare Event vs. Standard |
|
|
Notes:
Not all input parameters are independent.Anchor t1n1 t1n1
Extended Mantel-HaenszelAnchor t1n2 t1n2
Future Development
Functional Requirements
In the following list, each numbered item represents the name of a StatCalc tool as it appears in the main menu of the stand-alone module or the Options→Add StatCalc Calculator submenu in Visual Dashboard. The secondary (lettered) list items contain labeled elements of user interface such as titles and descriptive text, input parameters (count) and the heading for derived values, the values calculated from the input values. The most deeply nested items are typically the specific input parameters, derived values and summary results, themselves, organized in a hierarchy appropriate for the specific tool.
- Population Survey
- Title: Sample Size and Power
- Description: Population survey or descriptive study
- Note: For simple random sampling, leave design effect and clusters equal to 1.
- Input Parameters:1
- Population size
- Expected frequency
- Acceptable Margin of Error
- Design effect
- Clusters
- Derived values
- For confidence levels of 80%, 90%, 95%, 97%, 99%, 99.9%, and 99.99%
- Cluster size
- Total Sample
- Cohort or Cross-Sectional
- Title: Sample Size and Power
- Description: Unmatched cohort and cross-sectional studies (exposed and non-exposed)
- Note: n/a
- Input parameters (not all parameters are independent):
- Two-sided confidence level (choices: 80%, 90%, 95%, 97%, 99%, 99.9%, and 99.99%)
- Power (%)
- Ratio (Unexposed : Exposed)
- Percent outcome in unexposed group (%)
- Risk ratio
- Odds ratio
- Percent outcome in exposed group (%)
- Derived values:
- Exposed, unexposed, totals
- for Kelsey, Fleiss and Fleiss w/CC Model
- Unmatched Case-Control
- Title: Sample Size and Power
- Description: Unmatched case-control study (Comparison of ILL and NOT ILL)
- Note: n/a
- Input parameters (not all parameters are independent):
- Two-sided confidence level (choices: 80%, 90%, 95%, 97%, 99%, 99.9%, and 99.99%)
- Power (%)
- Ratio of controls to cases
- Percent of controls exposed (%)
- Odds ratio
- Percent of cases with exposure (%)
- Derived values:
- Cases, controls, totals
- for Kelsey, Fleiss and Fleiss w/CC Models
- Chi-square for Trend
- Title: Chi-Square for Trend
- Description: Analysis for Linear Trends in Proportions
- Note: n/a
- Input parameters
- series of records containing the following values: exposure score, cases, controls
- Derived values
- odds ratio (by record)
- Chi square for linear trend (Extended Mantel-Haenszel)
- P-value
- Tables (2 x 2 x N)
- Title: 2x2 Tables
- Description: n/a
- Note: n/a
- Input parameters, by stratum, 1 - 9:
- Subject count: Exposure , Outcome
- Subject count: Exposure , Outcome
- Subject count: Exposure , Outcome
- Subject count: Exposure , Outcome
- Derived values
- By stratum
- Odds-based Parameters
- Odds Ratio: Estimate, Lower, Upper
- Maximum Likelihood Estimate Odds Radio (Mid-P): Estimate, Lower, Upper
- Fisher's Exact Test: Lower and Upper
- Risk-based Parameters
- Risk ratio: Estimate, Lower, Upper
- Risk difference: Estimate, Lower, Upper
- Statistical Tests
- Uncorrected: chi-square, 2-tailed P-value
- Mantel-Haenszel: chi-square, 2-tailed P-value
- Mid-P exact test: 1-tailed P-value
- Fisher's exact test: 1-tailed P-value, 2-tailed P-value
- Odds-based Parameters
- Summary results
- Odds ratio
- Crude (Cross Product): Estimate, Lower, Upper
- Crude (Maximum Likelihood Estimate): Estimate, Lower, Upper
- Fisher's Exact test: Lower and Upper
- Adjusted (MH): Estimate, Lower, Upper
- Adjusted (Maximum Likelihood Estimate): Estimate, Lower, Upper
- Risk Ratio
- Crude: Estimate, Lower, Upper
- Adjusted: Estimate, Lower, Upper
- Chi-Square
- Uncorrected (MH): chi-square, (1-tailed P-value), 2-tailed P-value
- Corrected (MH): chi-square, (1-tailed P-value), 2-tailed P-value
- Odds ratio
- By stratum
- Matched Pair Case Control Study
- Title: Pair-Matched Case-Control Study
- Description: n/a
- Note: n/a
- Input parameters
- Cases: Exposure
- Cases: Exposure
- Controls: Exposure
- Controls: Exposure
- Derived values:
- Odds-based parameters
- Odds Ratio: Estimate, Lower, Upper
- Exact: Lower and Upper
- Statistical Tests
- McNemar: chi-square, 2-tailed P-value
- Corrected: chi-square, 2-tailed P-value
- Fisher's exact test: 1-tailed P-value, 2-tailed P-value
- Odds-based parameters
- Population Binomial (Proportion vs. Std.)
- Title: Binomial
- Description: Binomial - Proportion vs. Standard
- Note: n/a
- Input parameters:
- Numerator
- Total observations
- Expected percentage
- Derived values
- Probability that the number of cases is <, <=, =, >=, > numerator
- Two-tailed P-value
- 95% confidence interval
- Poisson (Rare Event vs. Std.)
- Title: Poisson
- Description: Rare Event vs. Standard
- Note: n/a
- Input parameters
- Observed number of events
- Expected number of events
- Derived values
- Probability that the number of events found is <, <=, =, >=, > to the observed number
Overview
Functional Requirements
Overview
The StatCalc tools are well-implemented from the mathematical and performance points of view. The primary problem involves the labeling of fields and the limited documentation of specific tools. Generally speaking, the calculators are designed with a very specific application in mind, while the underlying calculations may be applied to a much broader set of problems. This can be addressed in a number of ways. Making the labels more general may be helpful for some users. However, a better approach might be to add a pull-down menu to tools such as "Cohort or Cross-Sectional" that offers a number of possible scenarios. In this case, the options may include "Unmatched Cohort Study" and "Cross-Sectional Study". Choosing an option would change the labeling of the input (and some output) fields to use terminology traditionally associated with that study type. The options may also reflect the methodological context of the study. Applied to infectious disease, one examines the ratio of exposed to unexposed individuals and the corresponding numbers who are ill or unaffected. In contrast, a genetic study examines individuals that do or do not possess a particular allele of a gene or marker; the outcome is expressed in terms of phenotypes. The goal is to express the statistical variables in a manner that is familiar to the researcher using a particular study design in a particular discipline. Doing so will help ensure that the user enters the proper information in the correct fields and can accurately interpret the results.
The remaining issues concern consistency in how the tools are named and referred to in different parts of Epi Info™. The label on the button in the StatCalc menu or VD Options menu does not always match the labeling of the resulting window or gadget (when run in stand-alone mode or as part of Visual Dashboard, respectively). There is also inconsistent hyphenation of compound adjectives (e.g., "case-control"). Finally, the StatCalc gadgets in VD do not follow the pattern for the control widgets (located in the upper-right corner) used in other VD gadgets (they cannot be collapsed, for example).