Napari Select Foreground
AI-based foreground extraction in scientific and natural images.
Segment images using a collection of fast and lightweight generalist segmentation models in Napari. This plugin is based on the rembg project.
Key features
- Choose among five generalist segmentation models, including SAM (Segment Anything Model).
- Quickly annotate individual objects by drawing bounding boxes around them.
- Possibility to generate predictions via a remote web API and keep the installation lightweight on client machines.
- Compatible with 2D, RGB, 2D+t, and 3D images (slice by slice).
Installation¶
You can install napari-rembg
via pip. If you wish to use your local machine for the predictions (most users):
pip install "napari-rembg[local]"
If you wish to generate predictions from a web api, go for a minimal install:
pip install napari-rembg
Models¶
- u2net: A pre-trained model for general use cases.
- u2netp: A lightweight version of u2net.
- silueta: Same as u2net with a size reduced to 43 Mb.
- isnet: A pre-trained model for general use cases.
- sam: Segment Anything Model pre-trained for any use cases (
vit_b
)
The models automatically get downloaded in the user's home folder in the .u2net
directory the first time inference is run.
Usage¶
Start napari-rembg
from the Plugins
menu of Napari:
Plugins > Napari Select Foreground > Select foreground
Segment an image loaded into Napari¶
Select your image in the Image
dropdown and press Run
. The output segmentation appears in the Labels
layer selected in the Mask
field (if no layer is selected, a new one is created).
Segment individual objects using bounding boxes¶
- Click on the
Add
button next to theROI
field. This adds aShapes layer
to the viewer. - Click and drag bounding boxes around objects in the image. Each time you draw a bounding box a segmentation is generated in the region selected.
You can choose to auto-increment the label index to distinguish individual objects. Deselect that option to annotate a single foreground class.
Running the segmentation via a web API¶
You can run the rembg
segmentation via a web API running in a docker
container.
Advantages
- The segmentation can be run on a remote machine with optimization (e.g. GPU).
- The segmentation models will be downloaded inside the docker container instead of the user's file system.
- You can minimally install the package with
pip install napari-rembg
on the client's machine. This will not install therembg
library, which can solve potential dependency conflicts or bugs.
Setup
See these instructions on how to set up the docker container and web API.
Usage
Start napari-rembg
from the Plugins
menu of Napari:
Plugins > Napari Select Foreground > Select foreground (Web API)
Related projects¶
If you are looking for similar generalist segmentation plugins, check out these related projects:
Contributing¶
Contributions are very welcome.
License¶
Distributed under the terms of the BSD-3 license, "napari-rembg" is free and open source software.
Issues¶
If you encounter any problems, please file an issue along with a detailed description.
This napari plugin was generated with Cookiecutter using @napari's cookiecutter-napari-plugin template.
Supported data:
- Information not submitted
Plugin type:
GitHub activity:
- Stars: 0
- Forks: 0
- Issues + PRs: 0