Purpose. To determine if the consistency of data extraction improves after creating explicit instructions for quality improvement study assessment criteria. Findings. Creating explicit instructions to accompany quality improvement study assessment criteria greatly enhances the consistency of data extraction. Lessons Learned for EPC Program. While inconsistency in data extraction was a major barrier to moving forward with identifying criteria crucial for the understanding of quality improvement studies, an iterative process to assess the consistency and then refine the instructions can be successful. Utility for Health Systems. Learning health systems can expect to see extracted data for different criteria that would look consistent regardless of the person doing the extraction and enhancing the consistency from report to report as well.