Understanding sources of variation in syndromic surveillance for early warning of natural or intentional disease outbreaks

Daily counts of computer records of hospital emergency department arrivals grouped according to diagnosis (called here syndrome groupings) can be monitored by epidemiologists for changes in frequency that could provide early warning of bioterrorism events or naturally occurring disease outbreaks and epidemics. This type of public health surveillance is sometimes called syndromic surveillance. We used transitional Poisson regression models to obtain one-day-ahead arrival forecasts. Regression parameter estimates and forecasts were updated for each day using the latest 365 days of data. The resulting time series of recursive estimates of parameters such as the amplitude and location of the seasonal peaks as well as the one-day-ahead forecasts and forecast errors can be monitored to understand changes in epidemiology of each syndrome grouping. The counts for each syndrome grouping were autocorrelated and non-homogeneous Poisson. As such, the main methodological contribution of the article is the adaptation of Cumulative Sum (CUSUM) and Exponentially Weighted Moving Average (EWMA) plans for monitoring non-homogeneous counts. These plans were valid for small counts where the assumption of normally distributed one-day-ahead forecasts errors, typically used in other papers, breaks down. In addition, these adaptive plans have the advantage that control limits do not have to be trained for different syndrome groupings or aggregations of emergency departments. Conventional methods for signaling increases in syndrome grouping counts, Shewhart, CUSUM, and EWMA control charts of the standardized forecast errors were also examined. Shewhart charts were, at times, insensitive to shifts of interest. CUSUM and EWMA charts were only reasonable for large counts. We illustrate our methods with respiratory, influenza, diarrhea, and abdominal pain syndrome groupings.