Show HN: GPT-4 with Vision Checkup
2 by zerojames | 0 comments on Hacker News.
When new Large Multimodal Models (LMMs) are released, there is excitement as we explore new capabilities. What can a model do? What can't a model do? What strange behaviors does the model exhibit? With that said, such analyses are frozen in time. At a hackathon toward the end of last year, the Roboflow team made a tool that runs the same set of tests with the GPT-4 with Vision API every day. This allows people to see how the model performs over time as updates are made. The last seven days of results are displayed on a web page; the rest of the data is archived in GitHub. We started the site with common vision tasks like OCR, object detection, and object counting. We welcome anyone to submit a PR to add new tasks, too!
No comments:
Post a Comment