The napari hub is transitioning to a community-run implementation due to launch in June 2025.
Since October 1, 2024, this version is no longer actively maintained and will not be updated. New plugins and plugin updates will continue to be listed.

Napari Select Foreground

napari-rembg

AI-based foreground extraction in scientific and natural images.

EPFL Center for Imaging logo

Segment images using a collection of fast and lightweight generalist segmentation models in Napari. This plugin is based on the rembg project.

demo

Key features

  • Choose among five generalist segmentation models, including SAM (Segment Anything Model).
  • Quickly annotate individual objects by drawing bounding boxes around them.
  • Possibility to generate predictions via a remote web API and keep the installation lightweight on client machines.
  • Compatible with 2D, RGB, 2D+t, and 3D images (slice by slice).

Installation

You can install napari-rembg via pip. If you wish to use your local machine for the predictions (most users):

pip install "napari-rembg[local]"

If you wish to generate predictions from a web api, go for a minimal install:

pip install napari-rembg

Models

  • u2net: A pre-trained model for general use cases.
  • u2netp: A lightweight version of u2net.
  • silueta: Same as u2net with a size reduced to 43 Mb.
  • isnet: A pre-trained model for general use cases.
  • sam: Segment Anything Model pre-trained for any use cases (vit_b)

models

The models automatically get downloaded in the user's home folder in the .u2net directory the first time inference is run.

Usage

Start napari-rembg from the Plugins menu of Napari:

Plugins > Napari Select Foreground > Select foreground

Segment an image loaded into Napari

Select your image in the Image dropdown and press Run. The output segmentation appears in the Labels layer selected in the Mask field (if no layer is selected, a new one is created).

Segment individual objects using bounding boxes

  • Click on the Add button next to the ROI field. This adds a Shapes layer to the viewer.
  • Click and drag bounding boxes around objects in the image. Each time you draw a bounding box a segmentation is generated in the region selected.

screenshot

You can choose to auto-increment the label index to distinguish individual objects. Deselect that option to annotate a single foreground class.

Running the segmentation via a web API

You can run the rembg segmentation via a web API running in a docker container.

Advantages

  • The segmentation can be run on a remote machine with optimization (e.g. GPU).
  • The segmentation models will be downloaded inside the docker container instead of the user's file system.
  • You can minimally install the package with pip install napari-rembg on the client's machine. This will not install the rembg library, which can solve potential dependency conflicts or bugs.

Setup

See these instructions on how to set up the docker container and web API.

Usage

Start napari-rembg from the Plugins menu of Napari:

Plugins > Napari Select Foreground > Select foreground (Web API)

If you are looking for similar generalist segmentation plugins, check out these related projects:

Contributing

Contributions are very welcome.

License

Distributed under the terms of the BSD-3 license, "napari-rembg" is free and open source software.

Issues

If you encounter any problems, please file an issue along with a detailed description.


This napari plugin was generated with Cookiecutter using @napari's cookiecutter-napari-plugin template.

Version:

  • 0.0.7

Last updated:

  • 17 February 2024

First released:

  • 28 September 2023

License:

Supported data:

  • Information not submitted

Plugin type:

GitHub activity:

  • Stars: 0
  • Forks: 0
  • Issues + PRs: 0

Python versions supported:

Operating system:

Requirements:

  • magicgui
  • qtpy
  • napari[all] >=0.4.16