Accountability for public health data
Moving from Volume to Usability
For many years, transparency in public health was measured in terms of volume—how many PDF files had been uploaded and how many dashboards were available. But the ecosystem has evolved. Analysts, researchers, and algorithms need more than static documents. They need structured data pipelines.
Two states may seem equally transparent because both publish reports, dashboards, and datasets. However, if one state offers searchable records, consistent metadata, downloadable files, and a clear history of updates while the other depends on scattered pages and static reports, the "data debt" imposed on downstream users is not the same.
The Health Transparency Indexwas created to answer a simple question:in practical terms, how transparent is a state's public health data ecosystem?Within this framework, transparency is not a general statement about openness. It is an observable outcome based on whether the public data environment supports discovery, interpretation, technical reuse, and accountability.
The Index is designed for government data teams, public health agencies, health policy researchers, investigative and specialized media, and other people who use public reporting as an operational resource. It does not assess health outcomes, the quality of policy, or clinical performance. It evaluates the data environment that makes these subjects easier—or more difficult—to study.
Discovery
Interpretation
Technical reuse
Accountability
Operational consequences
The Cost of Fragmented Data Environments
Public health information circulates among agencies, providers, researchers, journalists, and the public. When this information is fragmented, difficult to navigate, available only through static reports, or updated without a reliable schedule, the result is more than a simple inconvenience. It creates a friction tax.
Research requires more time, comparisons between states become less dependable, integration costs increase, and conclusions presented to the public become more difficult to verify.
The practical effects vary depending on the audience:
Government teams
May find it difficult to identify reporting gaps or compare their practices with those of similar organizations.
Researchers
Spend more time finding, standardizing, and reconciling evidence before they can begin their analysis.
Media organizations
Face higher costs for evidence-based reporting and a greater risk that their comparisons will depend on inconsistent sources.
The Index reveals these differences through a repeatable scoring model. A ranking is useful, but the diagnostic result is more important: which parts of a state's public data environment reduce friction, which parts create it, and where a specific improvement could make the evidence more usable.
Scoring method
Scoring Structure: What Produces a Difference
The current framework examines six distinct layers of a state's public health data environment. Each category poses a different practical question, and the weighted results are normalized to produce a single overall index value.
Health Transparency Index categories, weights, and practical assessments
| Category |
Weight |
Analytical purpose |
| Price Transparency |
20% |
Whether information about healthcare costs is made available in structured, discoverable formats, including evidence associated with federal price-transparency requirements. |
| Public Health Reporting |
20% |
Whether reports, dashboards, surveillance results, and recurring statistical publications remain visible and are maintained over time. |
| Access to Open Data |
15% |
Whether users have access to centralized portals, searchable datasets, downloadable formats, APIs, and useful metadata. |
| Hospital Quality Reporting |
15% |
Whether hospital performance or reporting data at the state level is available in formats that support public understanding. |
| Insurance Market Transparency |
15% |
Whether rate-review systems, insurer disclosures, and other public indications of market oversight are visible. |
| Machine-Readable Data |
15% |
Whether information is published in reusable formats such as CSV files or APIs, with sufficient metadata for technical use. |
Existence and usability require separate assessments
The categories distinguish the existence of information from the conditions in which it can be used. A report that can be found but not downloaded presents a different limitation from a dataset that can be downloaded but has no metadata or update history. The overall score combines these layers, while the category scores indicate where the practical differences originate.
Understanding the results
Understanding the Method: Transparency Versus Data Availability
- Transparency
- The data is discoverable, accessible, structured, and understandable. Public availability alone does not satisfy all four of these conditions.
- Machine-readable
- The data can be processed programmatically without manual extraction or reformatting. CSV files, structured APIs, and tagged datasets generally qualify; image-based reports and narrative-only pages generally do not.
- Proxy scoring
- A category uses structured signals at the state or federal level when direct validation at the institutional level is not yet complete. This is a documented limitation, not a replacement for disclosure.
- Evidence-based scoring
- Assessments are connected to public sources, observable reporting practices, and defined criteria so the framework can be reviewed and improved as the evidence changes.
These distinctions are important because an index score is an indicator, not a final institutional audit. It supports comparison and identifies areas where further review is justified. It should not be interpreted as proof that every hospital, insurer, agency, or dataset in a state meets the same standard.
Using the analysis
Practical Uses: Who Benefits from This Analysis?
Public administration
Government Data Teams
Compare transparency practices, identify structural weaknesses, and prioritize improvements to reporting, metadata, publication formats, and public access.
Research
Public Health Data Researchers
Estimate the effort required for discovery and preparation before beginning a comparison between states, and identify where cleaning, cross-checking, or manual examination will probably be necessary.
Public reporting
Public Health Data Media
Compare states using consistent criteria and identify where gaps in access, reporting maturity, or accountability deserve more detailed coverage.
In every case, the value is practical: greater transparency reduces the cost of oversight, analysis, and communication. It also provides a clearer starting point for the broaderbusiness intelligence and analytics workneeded to transform public evidence into repeatable decisions.
Scale and governance
Can Money Buy Transparency? Examining Scale and Governance
The framework can supplement the overall score with derived measures that compare transparency performance with the size or capacity of a state. One example is transparency relative to economic scale, which helps determine whether larger states consistently maintain more mature public data infrastructures or whether smaller states can outperform them through disciplined governance and publication practices.
Current patterns indicate that transparency is not simply a function of budget or economic size. The maturity of governance, reporting discipline, machine-readable publication, and investment in open-data infrastructure all appear to play a role. This remains an analytical indication rather than a causal conclusion, but it gives government teams and researchers a more useful question to investigate than scale by itself.
Limits of interpretation
Analytical Limitations and Decision Boundaries
The Index is intended to disclose its own limitations. Some categories still depend in part on proxy indicators because complete validation at the institutional level has not yet been completed. These limitations affect the degree of confidence with which a score can be interpreted and indicate where further evidence is still required.
- Machine-readable hospital price files have not been fully audited in every state.
- The transparency of insurer filings has not been validated for every issuer.
- The quality of datasets may vary within a state even when its wider public data environment receives a strong score.
- A state-level score does not demonstrate the transparency of every institution operating in that state.
These limitations do not make comparisons between states unusable. They establish the decision boundary: the Index measures the maturity of transparency through comparable public indicators; it does not replace an audit of every provider or every filing.
Next phase
The Next Step: Moving from Indicators to Validation
The next phase is to strengthen the evidence behind the state-level indicators. More detailed validation of hospital files, review of filings by issuer, greater automation of metadata assessment, and stronger comparisons over time would reveal not only the current level of transparency, but also whether it is improving or remaining unchanged.
This development is important because the value of an index does not come from its ranking alone. Its value lies in the ability to identify a specific reporting weakness, determine what evidence would resolve it, and measure whether the public data environment becomes easier to use. The long-term objective is therefore to move toward direct validation at the institutional level without losing the state-to-state comparability that makes the framework useful.