Grounded SAM vs. SAM-CLIP: Compared and Contrasted

Models

Grounded SAM

GroundedSAM combines Grounding DINO with the Segment Anything Model to identify and segment objects in an image given text captions.

Learn more about Grounded SAM

SAM-CLIP

Use Grounding DINO, Segment Anything, and CLIP to label objects in images.

Learn more about SAM-CLIP

Model Type

Instance Segmentation

Model Features

Item 1 Info

Item 2 Info

Architecture

Combination of Grounding DINO and Segment Anything

Combination of Segment Anything and CLIP

Annotation Format

Instance Segmentation

Framework

GitHub

View Repo

GitHub Stars

14.0k

License

Apache 2.0

Paper

View Paper

Training Notebook

Train on Colab

Deploy Model

Deploy with Roboflow

Compare Alternatives

Compare Grounded SAM and SAM-CLIP with Autodistill

Using Autodistill, you can compare Grounded SAM and SAM-CLIP on your own images in a few lines of code.

Here is an example comparison:

To start a comparison, first install the required dependencies:


pip install autodistill autodistill-grounded-sam autodistill-sam-clip

Next, create a new Python file and add the following code:


from autodistill_grounded_sam import GroundedSAM
from autodistill_sam_clip import SAMCLIP

from autodistill.detection import CaptionOntology
from autodistill.utils import compare

ontology = CaptionOntology(
    {
        "solar panel": "solar panel",
    }
)

models = [
    GroundedSAM(ontology=ontology),
    SAMCLIP(ontology=ontology)
]

images = [
    "/home/user/autodistill/solarpanel1.jpg",
    "/home/user/autodistill/solarpanel2.jpg"
]

compare(
    models=models,
    images=images
)

Above, replace the images in the `images` directory with the images you want to use.

The images must be absolute paths.

Then, run the script.

You should see a model comparison like this:

When you have chosen a model that works best for your use case, you can auto label a folder of images using the following code:


base_model.label(
  input_folder="./images",
  output_folder="./dataset",
  extension=".jpg"
)

‍

Grounded SAM vs. SAM-CLIP

Models

Grounded SAM

SAM-CLIP

Compare Grounded SAM and SAM-CLIP with Autodistill

Compare Grounded SAM vs. SAM-CLIP