Visual Intelligence Summit: Oct 22 in San Francisco Get your ticket

Using Computer Vision to Fight Coronavirus (COVID-19)

Joseph NelsonPublished Apr 3, 2020
2 min read
SUMMARY
Chest X-rays and CT scans show patterns associated with COVID-19 that computer vision models can learn to flag, offering a supplementary diagnostic path in settings where PCR testing infrastructure is limited. Early open datasets combined COVID-19 scans with existing pneumonia radiology data to give models enough contrast to distinguish the two conditions. Roboflow worked to reformat and consolidate these datasets from formats like DICOM into more accessible structures so researchers could start training models without spending time on data wrangling.

As global coronavirus case numbers continue to climb, troubling stories of hospital shortages, deaths, and disrupted communities fill the news. Frankly, it can leave one feeling disempowered – especially when the primary calls to action are staying home and wearing masks.

Amid the global illness, there have been uplifting stories. Apple is using its unique supply chain to source and donate 10 million masks. Medtronic is open sourcing their designs to create portable ventilators. Countless other companies are using their strengths to make a difference.

We took a look at what we at Roboflow could also do as a company to make an impact.

Computer Vision and Coronavirus

While formal laboratory testing leveraging polymerase chain reaction (PCR) remain the deserved authority on making a diagnostic call for a patient, the shortage of testing infrastructure begs the question if we can identify the novel coronavirus in alternative ways.

In fact, there's a growing body of literature to support that chest scans may be a useful tool for diagnosing COVID-19 in patients. In hospitals where testing infrastructure may be slim yet radiology equipment is readily available, having a patient receive a chest x-ray for interpretation is a welcome alternative. Even if it is an imperfect diagnosis, gaining additional information rather than doctors needing to triage resources blinds saves lives.

Radiology in particular as been ripe for computer vision-assisted medics. Medical imaging is exactly an area where an algorithm might be able to pick up on patterns doctors would otherwise miss.

Doing Our Part: Making Data More Accessible

To the tremendous credit of hundreds of researchers, COVID-19 scans are increasingly becoming available. Moreover, we already have seen open sourced datasets on pneumonia (which also affects the lungs and appears fairly similarly in radiology exams). Combining these enables a clearer picture for algorithms to gain a better view of what is unique to COVID-19 patients.

While these datasets are being open sourced, their accessibility and usability is limited. Perhaps images are made available in DICOM, but computer vision applications assume JPEGs. In other cases, images may be annotated in a format for one model framework but not easily available in another.

We're collecting and re-hosting datasets with an explicit public license to ease research efforts. We understand this is a tiny part of a much bigger picture – and, when testing equipment becomes truly widespread and faster, we can rely solely on that for diagnoses.

Thus, we welcome anyone working on COVID-19 imaging work to please freely use the dataset available at: https://public.roboflow.com. Please contact us if you find any discrepancies or have additions in mind.

Stay safe.

LatestFrom the Blog

Get started

Build on the Platform

For developers, engineers, and technical founders who want to get hands on. Try the free tier; the docs are open.

Bring it into your operation

For heads of AI, operations leaders, and enterprise teams. Bring a known problem, or work with us to find the first one worth taking on.