We ran seven tests across five state-of-the-art Large Multimodal Models (LMMs) on November 23rd, 2023. GPT-4V passed at four of seven tests and CogVLM passed at five of seven tests.
Here are the results:
Based on our tests, CogVLM may perform better than GPT-4V on a range of tasks. But, we encourage you to run your own analysis and experiment with different prompts to explore the strengths and weaknesses of each model further.
Download the raw image results from our analysis.