Quality control (QC) is essential to ensuring the accuracy of document reviews. Knowing which reviewers are the most effective and which ones need more training can significantly reduce review time while improving results. Unfortunately, QC can be a time-consuming and manual process, but that’s changing. Tools used for data visualization during the Early Case Assessment (ECA) process can be adapted for QC of reviewers, providing significant benefits to the review process.
Current Quality Control Processes
During the course of a document review, the Review Manager conducts QC to ensure the reviewers understand the review protocols and are applying them correctly. Typically, throughout the review process, a Review Manager can export information on how many documents a particular reviewer has reviewed over a period of time and how many were overturned on QC. Excel spreadsheets can allow Review Managers to assess generally how productive a reviewer was and their accuracy rate. However, that information is not granular or timely enough to help the Review Manager address specific issues in real-time to improve results during the review process.
Advantages of Data Visualization Tools
The right data visualization and monitoring tools can benefit QC in the following ways:
- Real-time granular reports. A dashboard can provide detailed information anytime down to the document level to allow for ongoing QC.
- Identify problems with individual reviewers. Review Managers can analyze the work of individual reviewers to understand who the outliers are – those who may need additional training – and where they are having difficulty (i.e., what types of documents or issues).
- Aid managers in providing meaningful feedback. Review Managers can offer more helpful coaching by showing reviewers where their work is being overturned. They can provide examples of specific documents the reviewer reviewed that had errors and why. Review Managers can also evaluate whether the reviewer improves after he/she received feedback to ensure the training worked.
- Self-assessment for reviewers. Individual reviewers can look at their own dashboard to learn where they are having difficulties, so they can self-correct or ask for additional guidance.
- Document and defend review process. It is important to document all processes that were run during eDiscovery for record keeping purposes as well as to defend against challenges to the process.
CDS has developed data visualization tools within its eDiscovery platform offering significant advantages that can save clients both time and money.
Learn more about End-to-End eDiscovery Solutions or contact us for a consultation.
