Visual Intelligence Summit: Oct 22 in San Francisco Get your ticket

Convert annotation formats

How To Convert IBM Cloud Annotations JSON to OpenAI CLIP Classification

In this guide, we show you how to convert data between the Cloud Annotations and CLIP formats for free. You can use your converted data to train OpenAI CLIP models and other models that support the CLIP format.

IBM Cloud Annotations JSON

The native JSON format of IBM's open source Cloud Annotations labeling tool.

Below, learn the structure of IBM Cloud Annotations JSON.

_annotations.jsonJSON
{
    "version": "1.0",
    "type": "localization",
    "labels": ["Untitled Label", "White Rook", "White Pawn", "White Knight", "White Queen", "White King", "White Bishop", "Black Bishop", "Black Pawn", "Black King", "Black Queen", "Black Knight", "Black Rook"],
    "annotations": {
        "85f760d0-c1b6-4ff4-a7f9-88ee6654a355.jpg": [{
            "x": 0.8056980180806675,
            "y": 0.6729166666666667,
            "x2": 0.8752390472878998,
            "y2": 0.8041666666666667,
            "id": "b523453f-d2bb-4ef1-88bb-1f18cba207c4",
            "label": "Black Rook"
        }, {
            "x": 0.5998565716272601,
            "y": 0.45625,
            "x2": 0.6457536509040334,
            "y2": 0.5604166666666667,
            "id": "78a44284-3b3b-4102-984e-6d4611b12f49",
            "label": "Black Pawn"
        }, {
            "x": 0.5650860570236439,
            "y": 0.014583333333333334,
            "x2": 0.6109831363004172,
            "y2": 0.11666666666666667,
            "id": "85eb97d7-5563-4abb-8f4a-fab28c8084ab",
            "label": "Black Rook"
        }, {
            "x": 0.5650860570236439,
            "y": 0.07083333333333333,
            "x2": 0.6123739568845619,
            "y2": 0.19583333333333333,
            "id": "047fd30e-4a20-43e5-a794-202a0ff58ea9",
            "label": "Black Knight"
        }, {
            "x": 0.5692585187760779,
            "y": 0.21666666666666667,
            "x2": 0.6262821627260083,
            "y2": 0.3770833333333333,
            "id": "7632a8cf-1b05-464e-9046-8fab323114c9",
            "label": "Black Queen"
        }, {
            "x": 0.7500651947148818,
            "y": 0.27708333333333335,
            "x2": 0.8265603268428373,
            "y2": 0.4625,
            "id": "f0a4900c-00fa-491f-81e0-05704cd2a2b5",
            "label": "Black King"
        }, {
            "x": 0.674960883171071,
            "y": 0.35833333333333334,
            "x2": 0.7194671418636995,
            "y2": 0.45416666666666666,
            "id": "f9f86e60-cb6e-4eff-a489-4e512e8eede3",
            "label": "Black Pawn"
        }, {
            "x": 0.6540985744089013,
            "y": 0.18541666666666667,
            "x2": 0.6958231919332406,
            "y2": 0.275,
            "id": "fc991b17-43a7-4006-bfdd-5d80447544fa",
            "label": "Black Pawn"
        }, {
            "x": 0.6443628303198887,
            "y": 0.1,
            "x2": 0.6846966272600834,
            "y2": 0.1875,
            "id": "239bf0e7-66e2-4b52-9d7a-fc916c58021d",
            "label": "Black Pawn"
        }, {
            "x": 0.4969358484005563,
            "y": 0.25416666666666665,
            "x2": 0.5386604659248957,
            "y2": 0.34791666666666665,
            "id": "55c28313-b3e8-41de-b57a-194fa97e0612",
            "label": "Black Pawn"
        }, {
            "x": 0.5024991307371349,
            "y": 0.020833333333333332,
            "x2": 0.5400512865090403,
            "y2": 0.1125,
            "id": "1ef39a86-a6b4-4427-bcbc-2fae75e23521",
            "label": "Black Pawn"
        }, {
            "x": 0.6193280598052852,
            "y": 0.96875,
            "x2": 0.6610526773296245,
            "y2": 1,
            "id": "4d9954e1-8461-4d11-829e-d1a213b4ddf0",
            "label": "Black Bishop"
        }, {
            "x": 0.7194671418636995,
            "y": 0.9145833333333333,
            "x2": 0.7848357093184979,
            "y2": 1,
            "id": "aba90884-eeaf-436b-b2de-6b858f89807d",
            "label": "Black Bishop"
        }, {
            "x": 0.6304546244784422,
            "y": 0.8916666666666667,
            "x2": 0.6833058066759388,
            "y2": 0.9875,
            "id": "a30ea559-e42d-4b21-8d57-439e984bf114",
            "label": "Black Pawn"
        }, {
            "x": 0.4148774339360223,
            "y": 0.32708333333333334,
            "x2": 0.46633779554937416,
            "y2": 0.4625,
            "id": "b1d3772c-d1d1-4178-bf51-7a7e7c78d924",
            "label": "Black Bishop"
        }, {
            "x": 0.4134866133518776,
            "y": 0.5375,
            "x2": 0.46911943671766343,
            "y2": 0.6708333333333333,
            "id": "9f01f922-7557-4106-8db3-1856a97846d0",
            "label": "White Bishop"
        }, {
            "x": 0.14505824061196107,
            "y": 0.2708333333333333,
            "x2": 0.2048635257301808,
            "y2": 0.4625,
            "id": "6860aeaa-3441-45ce-b66d-382e88a065cb",
            "label": "White King"
        }, {
            "x": 0.3328190194714882,
            "y": 0.2125,
            "x2": 0.3912334840055633,
            "y2": 0.3770833333333333,
            "id": "d08bb2a8-096b-438f-8d95-57b9689b0204",
            "label": "White Queen"
        }, {
            "x": 0.3425547635605007,
            "y": 0.1375,
            "x2": 0.38845184283727396,
            "y2": 0.25625,
            "id": "2a1697e9-1d68-476f-b800-390b22e7be28",
            "label": "White Knight"
        }, {
            "x": 0.13949495827538247,
            "y": 0.5375,
            "x2": 0.19790942280945759,
            "y2": 0.6729166666666667,
            "id": "2c12a431-16af-4926-a1f6-26c7bee53d98",
            "label": "White Knight"
        }, {
            "x": 0.2382432197496523,
            "y": 0.5666666666666667,
            "x2": 0.28831276077885953,
            "y2": 0.675,
            "id": "fa77179b-1818-4474-8f59-18967715d456",
            "label": "White Pawn"
        }, {
            "x": 0.2660596314325452,
            "y": 0.17083333333333334,
            "x2": 0.3091750695410292,
            "y2": 0.26875,
            "id": "c24db7e9-1571-4e55-8dca-7e33a7a428cc",
            "label": "White Pawn"
        }, {
            "x": 0.2660596314325452,
            "y": 0.0125,
            "x2": 0.30222096662030595,
            "y2": 0.10625,
            "id": "b2da76ae-cccc-4189-853a-6d75a6cd0b36",
            "label": "White Pawn"
        }, {
            "x": 0.41765907510431155,
            "y": 0.25833333333333336,
            "x2": 0.4566020514603616,
            "y2": 0.35208333333333336,
            "id": "1583f0df-81da-46e6-b3cb-aa78595026fc",
            "label": "White Pawn"
        }, {
            "x": 0.4246131780250348,
            "y": 0.6854166666666667,
            "x2": 0.47329189847009734,
            "y2": 0.7895833333333333,
            "id": "dd873720-24b8-4795-90ba-382e17ea2182",
            "label": "White Pawn"
        }, {
            "x": 0.22711665507649514,
            "y": 0.6770833333333334,
            "x2": 0.28553111961057026,
            "y2": 0.80625,
            "id": "1323aa31-5729-48e8-95cb-c5ce8f01aa03",
            "label": "White Rook"
        }, {
            "x": 0.18817367872044508,
            "y": 0.0020833333333333333,
            "x2": 0.23267993741307372,
            "y2": 0.10416666666666667,
            "id": "6ae756ee-6b8f-4110-ab46-56da13083ae5",
            "label": "White Rook"
        }],
        "238b26b3-40b1-47e1-9fb2-d5b609063b48.jpg": [{
            "x": 0.5094532336578581,
            "y": 0.47708333333333336,
            "x2": 0.5623044158553546,
            "y2": 0.6083333333333333,
            "id": "3bc9e7ea-1ba5-4525-96a5-6b38e2c13d1f",
            "label": "White Bishop"
        }]
    }
}

OpenAI CLIP Classification

CLIP is an impressive multimodal zero-shot image classifier that achieves impressive results in a wide range of domains with no fine-tuning.

Below, learn the structure of OpenAI CLIP Classification.

_tokenization.txt
An example picture from the Hard Hat dataset depicting a man wearing a hard-hat
An example picture from the Hard Hat dataset depicting several men wearing hard-hats
An example picture from the Hard Hat dataset depicting several people, some wearing hard hats
An example picture from the Hard Hat dataset depicting several people

Step 1: Create a free Roboflow public workspace

Roboflow is a universal conversion tool for computer vision annotation formats. The Public plan is the best way for those exploring personal projects, class assignments, and other experiments to try Roboflow. To convert your dataset, start by creating a free workspace on the Public plan.

Create Roboflow Workspace

Step 2: Upload your data into Roboflow

Once your account has been created, click Create New Project.

Roboflow's create project form, with Object Detection selected as the project type

Upload your data to Roboflow by dragging and dropping your IBM Cloud Annotations JSON images and annotations into the upload space.

Roboflow's upload page, with a drag-and-drop area for images, annotations, videos and PDFs

Step 3: Generate Dataset Version

Next, click "Generate New Version" to generate a new version of your dataset:

Roboflow's Generate a Dataset Version page, showing the source images and train/test split for a new version

You can then apply any preprocessing or augmentation steps to your dataset:

The augmentation step of a new dataset version, with 90° Rotate and Brightness added

Step 4: Export Dataset Version

After generating, you will be prompted to Export your dataset. You can choose to receive your dataset as a .zip file or a curl download link. Choose OpenAI CLIP Classification when asked in what format you want to export your data. You will see a dropdown with various options like this:

Roboflow's Download dialog, with the export format list open and COCO highlighted

Congratulations, you have successfully converted your dataset from IBM Cloud Annotations JSON format to OpenAI CLIP Classification format!

Video Tutorial

Convert Computer Vision Annotation Formats Tutorial

Want to dive deeper into converting annotation formats with Roboflow? In the tutorial below, we explore how to convert your data in the Roboflow dashboard. We also discuss rejecting annotations and train-test-validation splits.

Frequently Asked Questions

Yes! It is free to convert IBM Cloud Annotations JSON data into the OpenAI CLIP Classification format on the Roboflow platform.

If you have between a few and a few thousand images, converting data between these formats will be quick. But, the time it takes to convert between data formats increases with the more images you have.

Show guide

Convert IBM Cloud Annotations JSON to other formats

Convert other formats to OpenAI CLIP Classification

Related

Start where you are

Speak with an AI expert

Our team will help you start solving business problems on the first call.

  • Solution architecting
  • Live demonstration
  • Pricing and specifications
  • Feasibility assessment

Over 16,000 organizations build with Roboflow.

Rivian
Pella
Chobani
USG Corporation
BNSF Railway
American Woodmark
Outcomes
Patrick Industries
Peer Robotics
Create Roboflow Workspace