{
  "id": "1998-february-processor-violations",
  "slug": "1998-february-processor-violations",
  "url": "https://dwillis.github.io/uplink/article/1998-february-processor-violations.html",
  "year": 1998,
  "month": "February",
  "monthNum": 2,
  "headline": "Processor violations",
  "kicker": "INSPECTION Du JOUR",
  "author_name": "Brent Johnson",
  "author_title": "Database Editor",
  "affiliation": "NICAR",
  "summary": "Investigative reporters analyzed USDA inspection data and found that meat and poultry plants repeatedly cited for critical violations are rarely shut down by the agency, with one Tyson Foods plant accumulating 1,700 violations. The reporters used database analysis techniques to organize and examine the massive USDA dataset to expose weak enforcement of food safety violations.",
  "keywords": [
    "violations",
    "inspection",
    "enforcement"
  ],
  "topics": [
    "Investigative Methods",
    "Data & Databases",
    "Health & Environment"
  ],
  "technologies": [
    "FoxPro",
    "CD-ROM"
  ],
  "full_text": "Processor violations\n\nBy Brent Johnson NICAR\n\nHundreds of meat and poultry plants operating throughout the country are repeatedly issued citations following inspections by the U.S. Department of Agriculture. But the enforcement record against these gutting operations has most often been gutless. An investigative story by Elliot Jaspin and Scott Montgomery of Cox News Service found that few plants ones cited hundreds of times - are ever forced shut by the USDA.\n\nCritical condition\n\nJaspin and Montgomery used FoxPro to analyze the massive \"Feedback File\" database provided by the USDA following a FOIA request. Although they requested files from 1990-1996, the USDA only released information from 1996. The reporters wanted to know how many \"critical violations\" - defined by the USDA as a plant condition \"certain\" to cause both food contamination and to reach and then harm consumers - occurred at given plants. \"We were expecting 200 tops for a particular plant,\" Jaspin said. However, they found a poultry plant in Arkansas operated by Tyson Foods that had amassed 1,700 violations. That's when they knew they had a story.\n\nFile me up, file me down\n\nThe USDA database arrived on CD-ROM organized by a series of subdivisions. The data were divided into quarters of the year. Each quarter was divided into 26 regions. Each region was divided by week. \"So there were 13 zip files for each region, and within those, when unzipped, were different 'circuits,' or strings of meat and poultry plants,\" Jaspin said. \"We're talking in the neighborhood of 5,000-6,000 little databases.\"\n\n\"When you have large databases, the whole idea is to divide and conquer, to be able to work in a feasible fashion,\" Jaspin said.\n\nTransferring the data from the CD-ROM to the hard drive using a batch file presented the first challenge. Then appending the zip files into databases for each quarter awaited. \"We had to smash (the unzipped files) into one large database actually four. One database would've been too unwieldy - over 25 million records.\"\n\nDivide and conquer\n\nDirty data always lurks. Jaspin and Montgomery had to work around an identification problem. They thought each plant would have a unique number but then found individual plants entered multiple times. By cleaning the unique number problem up, they could link violations from inspection records to particular plants by joining tables.\n\nFinally ready to analyze the data, they created \"subset databases\" to answer particular questions, such as the frequency of critical violations occurring at plants.\n\n\"When you have large databases, the whole idea is to divide and conquer, to be able to work in a feasible fashion,\" Jaspin said.\n\nJaspin and Montgomery also analyzed the data by geographic distribution of violations and plant size. Smaller databases were created and sent to individual Cox newspapers so they could pursue local stories.\n\nUSDA puts up, but doesn't shut down\n\nThrough their database analysis of 1996 inspections, the reporters discovered 299 plants with 100 or more \"critical violations\" and 7 with more than 1,000. That year, the USDA shut down only 6 plants.\n\n\"Heavens,\" an epidemiologist at the Centers for Disease Control and Prevention told the reporters upon hearing those numbers. \"The burning question is why is a plant with that many violations - why has the (federal) inspector not been pulled from that plant? And I have no idea.\"\n\nNICAR IS IN THE PROCESS OF ACQUIRING THE SUMMARY DATA OF THE USDA's PROCESS DEFICIENCY REPORTS, WHICH INCLUDE A LIST OF VIOLATIONS - CRITICAL, MAJOR OR MINOR - BY PLANT.\n\nBrent Johnson can be reached at (573) 882-0684 or by e-mail at bjohnson@nicar.org\n\nA PROFILE OF PAUL ADRIAN, AN INVESTIGATIVE REPORTER AT WBNS-TV IN COLUMBUS, OHIO, WHO HAS ALSO USED THE SUMMARY DATA IN A STORY, WILL APPEAR IN NEXT MONTH'S ISSUE.",
  "provenance": {
    "extracted_by": "anthropic/claude-sonnet-4-6",
    "extracted_at": "2026-07-05",
    "verified": true
  },
  "similar": [
    {
      "slug": "2000-march-some-recent-car-stories",
      "score": 0.237
    },
    {
      "slug": "2006-march-april-truck-inspections",
      "score": 0.231
    },
    {
      "slug": "1991-june-the-safe-and-the-sorry-working-in-ohio",
      "score": 0.204
    },
    {
      "slug": "2002-november-december-access-forms-help-build-inspections-database",
      "score": 0.204
    },
    {
      "slug": "1998-february-behind-the-ratings",
      "score": 0.18
    }
  ],
  "html_url": "https://dwillis.github.io/uplink/article/1998-february-processor-violations.html",
  "json_url": "https://dwillis.github.io/uplink/article/1998-february-processor-violations.json"
}