Our Insights

Thought Leadership and Industry Trends

Home 9 Insights 9 Insights - Analytics and ECA 9 How Technology Can Improve Quality Control in eDiscovery

How Technology Can Improve Quality Control in eDiscovery

Aug 28, 2018

Quality control (QC) is essential to ensuring the accuracy of document reviews. Knowing which reviewers are the most effective and which ones need more training can significantly reduce review time while improving results. Unfortunately, QC can be a time-consuming and manual process, but that’s changing. Tools used for data visualization during the Early Case Assessment (ECA) process can be adapted for QC of reviewers, providing significant benefits to the review process.

Current Quality Control Processes

During the course of a document review, the Review Manager conducts QC to ensure the reviewers understand the review protocols and are applying them correctly. Typically, throughout the review process, a Review Manager can export information on how many documents a particular reviewer has reviewed over a period of time and how many were overturned on QC. Excel spreadsheets can allow Review Managers to assess generally how productive a reviewer was and their accuracy rate. However, that information is not granular or timely enough to help the Review Manager address specific issues in real-time to improve results during the review process.

Advantages of Data Visualization Tools

The right data visualization and monitoring tools can benefit QC in the following ways:

  1. Real-time granular reports. A dashboard can provide detailed information anytime down to the document level to allow for ongoing QC.
  2. Identify problems with individual reviewers. Review Managers can analyze the work of individual reviewers to understand who the outliers are – those who may need additional training – and where they are having difficulty (i.e., what types of documents or issues).
  3. Aid managers in providing meaningful feedback. Review Managers can offer more helpful coaching by showing reviewers where their work is being overturned. They can provide examples of specific documents the reviewer reviewed that had errors and why. Review Managers can also evaluate whether the reviewer improves after he/she received feedback to ensure the training worked.
  4. Self-assessment for reviewers. Individual reviewers can look at their own dashboard to learn where they are having difficulties, so they can self-correct or ask for additional guidance.
  5. Document and defend review process. It is important to document all processes that were run during eDiscovery for record keeping purposes as well as to defend against challenges to the process.

CDS has developed data visualization tools within its eDiscovery platform offering significant advantages that can save clients both time and money.

Learn more about End-to-End eDiscovery Solutions or contact us for a consultation.

About the Author

<a href="https://cdslegal.com/team/steve-wang-esq/" target="_blank">Steve Wang</a>

Steve Wang

Steve Wang leads the operations of CDS’s Managed Review services and focuses on overseeing CDS’s Technology Driven Review offering. He coordinates closely with the CDS Project Management and Advisory Services teams as well as law firm attorneys or corporate clients to understand clients’ goals and deadlines. The Review Management team helps develop customized document review protocols, QC protocols, and privilege review and logging protocols to ensure that they are tailored to meet client and case specific needs and adhere to best practices.

Relativity AI Bootcamp: Atlanta

Relativity is kicking off a third season of AI Bootcamps on April 23-24 in Atlanta, where CDS’ Director of Advanced Analytics & Data Privacy Danny Diette will be a featured panelist.

Find out more

7th Annual Putting Insights into Practice Forum

Navigate a virtual journey through today’s biggest legal data management challenges at PIIP 2024: ADVENTURES ON THE DATA CONTINUUM

Find out more

Sign Up for Our Newsletter