Data Quality Campaign

Last updated


The Data Quality Campaign (DQC) is a nonpartisan, nonprofit advocacy organization launched in the United States in 2005 to improve the quality, accessibility and use of data in education. [1]

Contents

Overview

The Data Quality Campaign was founded in 2005, by Aimee Guidera and 10 founding partners as a national collaborative effort to encourage states to improve the collection and use of high-quality education data, and implement state longitudinal data systems to measure student achievement. [1] [2] It focused on its 10 Essential Elements of Statewide Longitudinal Data Systems. During this time, the campaign was managed by the National Center for Educational Achievement (NCEA). [3]

By 2009, many states had implemented data systems but few were utilizing them to their full potential. The organization shifted focus to its 10 State Actions to Ensure Effective Data Use. Around the same time, the NCEA was being acquired by ACT, Inc. in 2007, and the Data Quality Campaign became a fully independent nonprofit organization in 2011. [4]

Today, the Washington, DC based organization leads a partnership of nearly 100 organizations. [5] [6] [1] [7]

10 Essential Elements

When the Campaign was launched, part of its mission was to promote 10 essential elements of a longitudinal data system to see a student's academic growth and the contribution of specific programs. [1]

The elements are: [1] [8] [9] [10]
1. Student Identifier: A unique statewide student identifier that connects student data across key databases across years
2. Student Info: Student-level enrollment, demographic, and program participation information
3. Matching Student Test Records: The ability to match individual students' test records from year to year
4. Untested Student Info: Information on untested students and the reasons they were not tested
5. Teacher/Student Data Link: A teacher identifier system with the ability to match teachers to students
6. Transcript Data: Student-level transcript information, including information on courses completed and grades earned
7. College Readiness Scores: Student-level college readiness test scores
8. Graduation/Dropout Data: Student-level graduation and dropout data
9. P-12/Postsecondary Records Match: The ability to match student records between K-12 and higher education systems [11]
10. Data Audit System: A state data audit system assessing data quality, validity, and reliability

The DQC continued to promote and monitor states' progress in establishing these elements until 2011. In September 2009, all 50 states agreed to implement the 12 America COMPETES Elements, which include DQC's 10 elements and today, states report that information to the Department of Education.

10 State Actions

DQC has identified 10 state actions to help ensure that states use the information available to them. Every year since 2010, it surveys states' progress through the Data for Action survey. [12] [13]

The actions are: [10] [12]
1. Link Data Systems: Link State K-12 data systems with early learning, postsecondary education, workforce, social services, and other agencies(currently in development)
2. Sustained Support: Create stable, sustained support for robust state longitudinal data systems (not yet achieved)
3. Governance Structures: Develop governance structures to guide data collection, sharing, and use
4. Data Repositories: Build state data repositories (e.g. data warehouses) that integrate student, staff, financial, and facility data
5. Timely Access to Data: Implement systems to provide all stakeholders with timely access to the information they need while protecting student privacy
6. Individual Progress Reports: Create progress reports with individual student data that provide information educators, parents and students can us to improve student performance
7. Aggregate Progress Reports: Create reports that include longitudinal statistics on school systems and groups of students to guide school-, district-, and state-level improvement efforts
8. Research Agenda: Develop a purposeful research agenda and collaborate with universities, researchers, and intermediary groups to explore the data for useful information (currently in development)
9. Professional Development: Implement policies and promote practices, including professional development and credentialing, to ensure educators know how to access, analyze, and use data appropriately (partially implemented – professional development is fully implemented; state not involved in credentialing process)
10. Raise Public Awareness: Promote strategies to raise awareness of available data and ensure that key stakeholders, including state policymakers, know how to access, analyze, and use the information

Data for Action

The Data for Action (DFA) is an annual survey of all 50 states, Washington, D.C. and Puerto Rico on their progress toward implementing DQC's 10 State Actions. Each year, DQC invites each state's Governor's office to participate in the survey and uses their responses to analyze which state actions have been implemented in each state. Beyond the 10 state actions, the DFA also includes questions on other data issues and attempts to identify best practices in the field. [14]

DFA 2010

In 2010, not all states had yet implemented all 10 Essential Elements, so the 2010 DFA also measured states' progress on those, as well as the 10 State Actions. The 2010 DFA results showed that 24 states had implemented all 10 Essential Elements but all states had committed to implement them by September 2011. [15] None of the states had implemented all 10 State Actions and 17 states could not link student and teacher data, while 11 states could not link K-12 data to postsecondary data. Based on these results, DQC concluded that while states were making progress in data collection, they were not using that data to improve student achievement, because the data could not be linked across different education systems and was not available to stakeholders . To combat these issues, DQC identified 5 state priorities for the upcoming year:/> [16]

DFA 2011

The results of the 2011 DFA revealed that states were still struggling with actually using the data that they collected. Most tellingly, the two State Actions that were most difficult for states to implement were Actions 5 and 9. Action 5 deals with making the data accessible to all stakeholder, including parents and teachers, while Action 9 deals with providing educators with the skills necessary to access the data and use it to help students. [17] Based on its analysis of the 2011 DFA, DQC issued its "Game-Changing Priorities for States," to accelerate the implementation of the 10 State Actions. The priorities were: [18]

  1. Taking public input and identifying important policies that "will inform the development, implementation, and evaluation of the state’s data efforts"
  2. Among K-12, pre-K, higher education, and workforce data governance bodies, establishing "decision-making authority" for tackling issues of data use
  3. Reporting teacher effectiveness data to the schools that prepared them
  4. Continuing to address the needs of end users by determining whether existing tools are effective and fixing or refining them when they are not

DFA 2012

The results of the 2012 Data for Action survey revealed that only 10 states had implemented 8 or 9 of the 10 State Actions. While 35 states had the policies and funding to support a data system, only 5 made sure that it was accessible and usable for various stakeholders. [19] Based on the results, DQC determined that this may partly be due to the fact that while legislation may allow states to collect the data, it often makes it difficult for them to actually share the data with important stakeholders, like educators and parents. Based on these findings, DQC concluded that it is time to change the culture surrounding data use in education and get the data into the hands of people who need it most, like parents in teachers. To help, they issued five recommendations to guide states in 2013: [20]

Advocacy

DQC spoke out in favor of the Strengthening Education through Research Act (H.R. 4366; 113th Congress), a bill to amend and reauthorize the Education Sciences Reform Act of 2002 and authorize the appropriation of $615 million for fiscal year 2015 and $3.8 billion over the 2015-2019 period to support federal educational research, statistical analysis, and other activities. [21] [22]

Publications

In addition to the yearly reports that DQC publishes based on the DFA, they also have a number of other publications, including one entitled "What Every Parent Should be Asking about Education Data" co-produced with the National PTA. [23]

Other publications include, "Myth Busters: Getting the Facts Straight about Education Data", and a guide about communicating about issues associated with data collection and use in education "Let’s Give Them Something to Talk About: Tools for Communicating the Data Message."

DQC Founding Partners

See also

Related Research Articles

<span class="mw-page-title-main">Outcome-based education</span> Educational system based on the desired goals

Outcome-based education or outcomes-based education (OBE) is an educational theory that bases each part of an educational system around goals (outcomes). By the end of the educational experience, each student should have achieved the goal. There is no single specified style of teaching or assessment in OBE; instead, classes, opportunities, and assessments should all help students achieve the specified outcomes. The role of the faculty adapts into instructor, trainer, facilitator, and/or mentor based on the outcomes targeted.

<span class="mw-page-title-main">No Child Left Behind Act</span> 2002 United States education reform law; repealed 2015

The No Child Left Behind Act of 2001 (NCLB) was a U.S. Act of Congress that reauthorized the Elementary and Secondary Education Act; it included Title I provisions applying to disadvantaged students. It supported standards-based education reform based on the premise that setting high standards and establishing measurable goals could improve individual outcomes in education. The Act required states to develop assessments in basic skills. To receive federal school funding, states had to give these assessments to all students at select grade levels.

The National Center for Education Statistics (NCES) is the part of the United States Department of Education's Institute of Education Sciences (IES) that collects, analyzes, and publishes statistics on education and public school district finance information in the United States. It also conducts international comparisons of education statistics and provides leadership in developing and promoting the use of standardized terminology and definitions for the collection of those statistics. NCES is a principal agency of the U.S. Federal Statistical System.

The Education Quality and Accountability Office (EQAO) is a Crown agency of the Government of Ontario in Canada. It was legislated into creation in 1996 in response to recommendations made by the Royal Commission on Learning in February 1995.

<span class="mw-page-title-main">Health education</span> Education for awareness of and influence on the attitude of health

Health education is a profession of educating people about health. Areas within this profession encompass environmental health, physical health, social health, emotional health, intellectual health, and spiritual health, as well as sexual and reproductive health education.

Editing technology is the use of technology tools in general content areas in education in order to allow students to apply computer and technology skills to learning and problem-solving. Generally speaking, the curriculum drives the use of technology and not vice versa. Technology integration is defined as the use of technology to enhance and support the educational environment. Technology integration in the classroom can also support classroom instruction by creating opportunities for students to complete assignments on the computer rather than with normal pencil and paper. In a larger sense, technology integration can also refer to the use of an integration platform and application programming interface (API) in the management of a school, to integrate disparate SaaS applications, databases, and programs used by an educational institution so that their data can be shared in real-time across all systems on campus, thus supporting students' education by improving data quality and access for faculty and staff.

"Curriculum integration with the use of technology involves the infusion of technology as a tool to enhance the learning in a content area or multidisciplinary setting... Effective technology integration is achieved when students can select technology tools to help them obtain information on time, analyze and synthesize it, and present it professionally to an authentic audience. Technology should become an integral part of how the classroom functions—as accessible as all other classroom tools. The focus in each lesson or unit is the curriculum outcome, not the technology."

Adequate Yearly Progress (AYP) was a measurement defined by the United States federal No Child Left Behind Act that allowed the U.S. Department of Education to determine how every public school and school district in the country was performing academically according to results on standardized tests. As defined by National Council on Measurement in Education (NCME), AYP was "the amount of annual achievement growth to be expected by students in a particular school, district, or state in the U.S. federal accountability system, No Child Left Behind (NCLB)." AYP has been identified as one of the sources of controversy surrounding George W. Bush administration's Elementary and Secondary Education Act. Private schools were not required to make AYP.

Universal preschool is an international movement supporting the use of public funding to provide preschool education to all families. This movement is focused on promoting a global, rather than local, preschool program. The goal is to provide equity across all socioeconomic backgrounds, enabling children to improve their academic and social skills before they attend kindergarten. Universal preschool, funded by the public, would allow more families to send their children to preschool.

<span class="mw-page-title-main">Commission on the Future of Higher Education</span>

The formation of a Commission on the Future of Higher Education, also known as the Spellings Commission, was announced on September 19, 2005, by U.S. Secretary of Education Margaret Spellings. The nineteen-member commission was charged with recommending a national strategy for reforming post-secondary education, with a particular focus on how well colleges and universities are preparing students for the 21st-century workplace, as well as a secondary focus on how well high schools are preparing the students for post-secondary education. In the report, released on September 26, 2006, the Commission focuses on four key areas: access, affordability, the standards of quality in instruction, and the accountability of institutions of higher learning to their constituencies. After the report's publication, implementation of its recommendations was the responsibility of U.S. Under Secretary of Education, Sara Martinez Tucker.

Arts integration differs from traditional education by its inclusion of both the arts discipline and a traditional subject as part of learning The goal of arts integration is to increase knowledge of a general subject area while concurrently fostering a greater understanding and appreciation of the fine and performing arts. The John F. Kennedy Center for the Performing Arts defines arts integration as "an approach to teaching in which students construct and demonstrate understanding through an art form. Students engage in a creative process which connects an art form and another subject and meets evolving objectives in both."

<span class="mw-page-title-main">Sapientis</span> Nonprofit organization based in San Juan, Puerto Rico

Sapientis is a nonprofit organization based in San Juan, Puerto Rico, that improves public education to reduce poverty, stimulate economic growth, and enhance the standard of living in Puerto Rico.

The Rhode Island Department of Education (RIDE) is a state agency in Rhode Island that oversees the elementary and secondary education system from pre-Kindergarten through twelfth grade. It is headquartered in Providence. RIDE works closely with the Rhode Island Office of the Postsecondary Commissioner (RIOPC), the agency charged with overseeing higher education. Together, RIDE and RIOPC aim to provide an aligned, cohesive, and comprehensive education for all students.

<span class="mw-page-title-main">Evidence-based education</span> Paradigm of the education field

Evidence-based education (EBE) is the principle that education practices should be based on the best available scientific evidence, rather than tradition, personal judgement, or other influences. Evidence-based education is related to evidence-based teaching, evidence-based learning, and school effectiveness research. For example, research has shown that spaced repetition "leads to more robust memory formation than massed training does, which involves short or no intervals".

<span class="mw-page-title-main">Educational Policy Institute</span>

The Educational Policy Institute (EPI) is a research organization founded by its current president and CEO, Dr. Watson Scott Swail. EPI is dedicated to high-level research and policy analysis on a variety of educational issues, including the challenges that individuals and families from underserved communities face throughout their educational career.

Race to the Top was a $4.35 billion United States Department of Education competitive grant created to spur and reward innovation and reforms in state and local district K–12 education. Funded as part of the American Recovery and Reinvestment Act of 2009, it was announced by President Barack Obama and Secretary of Education Arne Duncan on July 24, 2009. States competing for the grants were awarded points for enacting certain educational policies, instituting performance-based evaluations for teachers and principals based on multiple measures of educator effectiveness, adopting common standards, adopting policies that did not prohibit the expansion of high-quality charter schools, turning around the lowest-performing schools, and building and using data systems.

<span class="mw-page-title-main">Strengthening Education through Research Act</span>

The Strengthening Education through Research Act or "SETRA" is a bill that would amend and reauthorize the Education Sciences Reform Act of 2002 and would authorize the appropriation of $615 million for fiscal year 2015 and $3.8 billion over the 2015-2019 period to support federal educational research, statistical analysis, and other activities.

P-20 longitudinal data systems are state-level educational databases in the United States created to "capture, study and use student data from preschool into future workforces.”

Educator effectiveness is a United States K-12 school system education policy initiative that measures the quality of an educator performance in terms of improving student learning. It describes a variety of methods, such as observations, student assessments, student work samples and examples of teacher work, that education leaders use to determine the effectiveness of a K-12 educator.

Data based decision making or data driven decision making refers to educator’s ongoing process of collecting and analyzing different types of data, including demographic, student achievement test, satisfaction, process data to guide decisions towards improvement of educational process. DDDM becomes more important in education since federal and state test-based accountability policies. No Child Left Behind Act opens broader opportunities and incentives in using data by educational organizations by requiring schools and districts to analyze additional components of data, as well as pressing them to increase student test scores. Information makes schools accountable for year by year improvement various student groups. DDDM helps to recognize the problem and who is affected by the problem.

<span class="mw-page-title-main">Educational management</span> Administration of education systems

Educational management refers to the administration of the education system in which a group combines human and material resources to supervise, plan, strategise, and implement structures to execute an education system. Education is the equipping of knowledge, skills, values, beliefs, habits, and attitudes with learning experiences. The education system is an ecosystem of professionals in educational institutions, such as government ministries, unions, statutory boards, agencies, and schools. The education system consists of political heads, principals, teaching staff, non-teaching staff, administrative personnel and other educational professionals working together to enrich and enhance. At all levels of the educational ecosystem, management is required; management involves the planning, organising, implementation, review, evaluation, and integration of an institution.

References

  1. 1 2 3 4 5 "Data Quality Campaign Launched at Data Summit". Achieve. 25 May 2006.
  2. "Our Team: Aimee Guidera". Data Quality Campaign. Archived from the original on 2013-09-05. Retrieved 2013-09-11.
  3. "About Us". National Center for Education Achievement. Archived from the original on 2014-01-13. Retrieved 2013-11-12.
  4. "Data Quality Campaign Welcomes New Chairman and Members to Board of Directors". Data Quality Campaign. Archived from the original on 2013-11-15.
  5. "Fact Sheet" (PDF). Data Quality Campaign. Archived from the original (PDF) on 2014-05-17. Retrieved 2013-09-11.
  6. "Campaign Seeks to Dispel Common Core Data Mining Claims". Sunshine State News. Archived from the original on 2013-09-12. Retrieved 2013-09-11.
  7. "Who We Are". Data Quality Campaign. Archived from the original on 2013-09-06. Retrieved 2013-09-11.
  8. "10 Essential Elements". Data Quality Campaign.
  9. "10 Essential Elements Critical to Longitudinal Data Systems: How California Stacks Up" (PDF). Every Child Prepared.
  10. 1 2 "Data Quality Campaign's Ten Essential Elements and State Actions" (PDF). Ohio Department of Education. Archived from the original (PDF) on 2015-09-08. Retrieved 2013-09-11.
  11. Fitzgerald, Dylan. "Data Quality Campaign". Data Quality Campaign. Retrieved 2020-06-15.
  12. 1 2 "10 State Actions". Data Quality Campaign.
  13. "Many Missing Pieces" (PDF). New American Foundation. Archived from the original (PDF) on 2014-01-15. Retrieved 2013-09-11.
  14. "About Data for Action". Data Quality Campaign.
  15. 1 2 "Data for Action 2010". Core Education. 22 February 2011.
  16. "Do States Use Data to Improve Student Learning?". Center for Digital Education. 18 October 2016.
  17. "New Data Quality Campaign Report: The Hard Work Remains". The Quick and the Ed. Archived from the original on 2013-07-18. Retrieved 2013-09-17.
  18. "Report: 4 Keys to Educational Data Systems". THE Journal.
  19. "Data Access for Education Stakeholders". District Administration.
  20. "Time To Focus on Helping People Use Education Data". THE Journal.
  21. "CBO - H.R. 4366". Congressional Budget Office. Retrieved 6 May 2014.
  22. Yochum, Kristin (3 April 2014). "Strengthening Education through Research Act plans to modernize SLDS program". Data Quality Campaign. Archived from the original on 17 March 2015. Retrieved 7 May 2014.
  23. "What Parents Should Know about Education Data". Student First. Archived from the original on 2013-08-31. Retrieved 2013-09-19.