OWLv2 vs. LLaVA: Compared and Contrasted

Models

OWLv2

OWLv2 is a transformer-based object detection model developed by Google Research. OWLv2 is the successor to OWL ViT.

LLaVA-1.5

LLaVA is an open source multimodal language model that you can use for visual question answering and has limited support for object detection.

Learn more about LLaVA-1.5

Model Type

Object Detection

Model Features

Item 1 Info

Item 2 Info

Architecture

Frameworks

Annotation Format

Instance Segmentation

GitHub

View Repo

GitHub Stars

16,000

License

Apache-2.0

Paper

View Paper

Training Notebook

Train on Colab

Deploy Model

Deploy with Roboflow

Compare Alternatives

Compare OWLv2 and LLaVA-1.5 with Autodistill

Using Autodistill, you can compare OWLv2 and LLaVA on your own images in a few lines of code.

Here is an example comparison:

To start a comparison, first install the required dependencies:


pip install autodistill autodistill-owlv2 autodistill-llava

Next, create a new Python file and add the following code:


from autodistill_owlv2 import OWLv2
from autodistill_llava import LLaVA

from autodistill.detection import CaptionOntology
from autodistill.utils import compare

ontology = CaptionOntology(
    {
        "solar panel": "solar panel",
    }
)

models = [
    OWLv2(ontology=ontology),
    LLaVA(ontology=ontology)
]

images = [
    "/home/user/autodistill/solarpanel1.jpg",
    "/home/user/autodistill/solarpanel2.jpg"
]

compare(
    models=models,
    images=images
)

Above, replace the images in the `images` directory with the images you want to use.

The images must be absolute paths.

Then, run the script.

You should see a model comparison like this:

When you have chosen a model that works best for your use case, you can auto label a folder of images using the following code:


base_model.label(
  input_folder="./images",
  output_folder="./dataset",
  extension=".jpg"
)

OWLv2 vs. LLaVA

Models

OWLv2

LLaVA-1.5

Compare OWLv2 and LLaVA-1.5 with Autodistill

Compare OWLv2 vs. LLaVA