What is SegFormer?

SegFormer is a computer vision framework used in semantic segmentation tasks, implemented with transformers.

About the model

Here is an overview of the

SegFormer

model:

Date of Release May 31, 2021
Model Type Semantic Segmentation
Architecture Transformers
Framework Used PyTorch
Annotation Format
Stars on GitHub 1300+

With ViT as a backbone showing great promise, various papers began to build on the idea and innovate to address issues of low resolution and high computational cost. And, while performance continued to improve with each new method, these papers seemed to focus solely on the design of the transformer encoder and neglected the decoder. Enter SegFormer. SegFormer sets itself apart with:

  • a new "positional-encoding-free and hierarchical Transformer encoder"
  • "a lightweight All-MLP decoder design"

The novel encoder is able operate at arbitrary resolutions without impacting performance. Additionally, the encoder is able to generate both high resolution and low resolution features in contrast to ViT. The decoder design is able to combine both local and global attention to produce high quality representations at low cost.

With these novel improvements, SegFormer sets a new SOTA on ADE20K, Cityscapes, and COCO-Stuff semantic segmentation datasets.

Check out YOLOv8, defining a new state-of-the-art in computer vision

YOLOv8 is here, setting a new standard for performance in object detection and image segmentation tasks. Roboflow has developed a library of resources to help you get started with YOLOv8, covering guides on how to train YOLOv8, how the model stacks up against v5 and v7, and more.

Learn about YOLOv8

Check out YOLOv8, defining a new state-of-the-art in computer vision

YOLOv8 is here, setting a new standard for performance in object detection and image segmentation tasks. Roboflow has developed a library of resources to help you get started with YOLOv8, covering guides on how to train YOLOv8, how the model stacks up against v5 and v7, and more.

Learn about YOLOv8

Check out YOLOv8, defining a new state-of-the-art in computer vision

YOLOv8 is here, setting a new standard for performance in object detection and image segmentation tasks. Roboflow has developed a library of resources to help you get started with YOLOv8, covering guides on how to train YOLOv8, how the model stacks up against v5 and v7, and more.

Learn about YOLOv8

Check out YOLOv8, defining a new state-of-the-art in computer vision

YOLOv8 is here, setting a new standard for performance in object detection and image segmentation tasks. Roboflow has developed a library of resources to help you get started with YOLOv8, covering guides on how to train YOLOv8, how the model stacks up against v5 and v7, and more.

Learn about YOLOv8

Model Performance

Explore this model on Roboflow

Deploy SegFormer to production

Roboflow offers a range of SDKs with which you can deploy your model to production.

No items found.

SegFormer Annotation Format

SegFormer

uses the

uses the

annotation format. If your annotation is in a different format, you can use Roboflow's annotation conversion tools to get your data into the right format.

Convert data between formats

Label data automatically with SegFormer

You can automatically label a dataset using

SegFormer

with help from Autodistill, an open source package for training computer vision models. You can label a folder of images automatically with only a few lines of code. Below, see our tutorials that demonstrate how to use

SegFormer

to train a computer vision model.

No items found.

Deploy a computer vision model today

Join 100k developers curating high quality datasets and deploying better models with Roboflow.

Get started
MANAGING over 100 million images for companies of all sizes

Join over 250,000 developers managing computer vision data on Roboflow.

VentureBeatTechCrunchInteresting EngineeringInternational Business TimesU.S. News & World ReportYahoo Finance