Kosmos-2 vs. CoDet: Compared and Contrasted

Models

Kosmos-2

Kosmos-2 is a multimodal language model capable of object detection and grounding text in images.

Learn more about Kosmos-2

CoDet

CoDet is an open vocabulary zero-shot object detection model.

Learn more about CoDet

Model Type

Object Detection

Model Features

Item 1 Info

Item 2 Info

Architecture

Frameworks

Annotation Format

Instance Segmentation

GitHub

View Repo

GitHub Stars

License

Apache 2.0 License

Paper

View Paper

Training Notebook

Train on Colab

Deploy Model

Deploy with Roboflow

Compare Alternatives

Compare Kosmos-2 and CoDet with Autodistill

Using Autodistill, you can compare Kosmos-2 and CoDet on your own images in a few lines of code.

Here is an example comparison:

To start a comparison, first install the required dependencies:


pip install autodistill autodistill-kosmos-2 autodistill-codet

Next, create a new Python file and add the following code:


from autodistill_kosmos_2 import Kosmos2
from autodistill_codet import CoDet

from autodistill.detection import CaptionOntology
from autodistill.utils import compare

ontology = CaptionOntology(
    {
        "solar panel": "solar panel",
    }
)

models = [
    Kosmos2(ontology=ontology),
    CoDet(ontology=ontology)
]

images = [
    "/home/user/autodistill/solarpanel1.jpg",
    "/home/user/autodistill/solarpanel2.jpg"
]

compare(
    models=models,
    images=images
)

Above, replace the images in the `images` directory with the images you want to use.

The images must be absolute paths.

Then, run the script.

You should see a model comparison like this:

When you have chosen a model that works best for your use case, you can auto label a folder of images using the following code:


base_model.label(
  input_folder="./images",
  output_folder="./dataset",
  extension=".jpg"
)

‍

Kosmos-2 vs. CoDet

Models

Kosmos-2

CoDet

Compare Kosmos-2 and CoDet with Autodistill

Compare Kosmos-2 vs. CoDet