As the peer review system struggles to keep up with the flood of manuscripts, the research community has begun looking for solutions. This has raised questions about whether automated screening tools might support peer reviewers by detecting common problems or beneficial practices in published manuscripts. This talk will explore the strengths and limitations of existing tools, while sharing lessons learned from daily screening of almost 24,000 COVID-19 preprints over 2.5 years.