T-MIDAS

The napari-tmidas plugin consists of a growing collection of pipelines for fast batch processing of confocal and whole slide microscopy images of biological tissues. This is a WIP and based on the CLI version of T-MIDAS.

Features¶

Currently, napari-tmidas provides pipelines as widgets for batch image conversion / cropping / processing, ROI colocalization and label inspection (cf. Usage below).

Installation¶

(Video installation guides: https://www.youtube.com/@macromeer/videos)

First, install Napari in a virtual environment:

mamba create -y -n napari-tmidas -c conda-forge python=3.11
mamba activate napari-tmidas
python -m pip install "napari[all]"

Now you can install napari-tmidas via pip:

pip install napari-tmidas

It is recommended though to install the latest development version. Please also execute this command from time to time in the activated environment to benefit from newly added features:

pip install git+https://github.com/macromeer/napari-tmidas.git

To use the Batch Crop Anything pipeline, we need to install Segment Anything 2 (2D/3D):

cd /opt # if the folder does not exist: mkdir /opt && cd /opt
git clone https://github.com/facebookresearch/sam2.git && cd sam2
pip install -e .
curl -L https://dl.fbaipublicfiles.com/segment_anything_2/092824/sam2.1_hiera_large.pt -o checkpoints/sam2.1_hiera_large.pt
mamba install -c conda-forge ffmpeg # we also need ffmpeg

If you want to batch compress image data using Zstandard, use the package manager of your operating system to install it:

sudo apt-get install zstd # Pre-installed on Linux :man_shrugging:

brew install zstd            # for macOS (requires [Homebrew](https://brew.sh/)
pip install zstandard        # Windows with Python >= 3.7

And you are done!

Usage¶

To use the plugin, start napari in the activated virtual environment with this terminal command:

mamba run -n napari-tmidas napari

You can then find the installed plugin in the Plugins tab.

Microscopy Image Conversion¶

You can start this pipeline via Plugins > T-MIDAS > Batch Microscopy Image Conversion. Currently, this pipeline supports the conversion of .nd2, .lif, .ndpi, .czi and acquifer data. After scanning a folder of your choice for microscopy image data, select a file in the first column of the table and preview and export any image data it contains.

Image Processing¶

1. After opening Plugins > T-MIDAS > Batch Image Processing, enter the path to the folder containing the images to be processed (currently supports TIF, later also ZARR). You can also filter for filename suffix.

2. As a result, a table appears with the found images. You can click on them to inspect them in the viewer.

3. Next, select a processing function, set parameters if applicable and Start Batch Processing.

4. You can click on the images in the table to show them in the viewer. For example first click on one of the Original Files, and then the corresponding Processed File to see an overlay.

Note that whenever you click on an Original File or Processed File in the table, it will replace the one that is currently shown in the viewer. So naturally, you'd first select the original image, and then the processed image to correctly see the image pair that you want to inspect.

Processing Function Credits¶

The image processing capabilities are powered by several excellent open-source tools:

• Cellpose 4: Advanced cell segmentation
• Trackastra: Cell tracking and analysis
• CAREamics: Content-aware image restoration and enhancement

Batch Label Inspection¶

If you have already segmented a folder full of images and now you want to maybe inspect and edit each label image, you can use the Plugins > T-MIDAS > Batch Label Inspection, which automatically saves your changes to the existing label image once you click the Save Changes and Continue button (bottom right).

Crop Anything¶

This pipeline combines the Segment Anything Model (SAM) for automatic object detection with an interactive interface for selecting and cropping multiple objects from images. To launch the widget, open Plugins > T-MIDAS > Batch Crop Anything. Cropping works like this: Enter 2D view and go to the first z slice where the object to be cropped is appearing. Activate/select the points layer and click on the object. Terminal shows progress. You can then proceed to select another object (always do this in 2D mode)

ROI Colocalization¶

This pipeline quantifies colocalization between labeled regions of interest (ROIs) across multiple image channels. It determines the extent of overlap between ROIs in a reference channel and those in one or two other channels. The output is a table of colocalization counts. Optionally, the size of reference channel ROIs, as well as the total or median size of colocalizing ROIs in the other channels, can be included. Colocalization is determined using Boolean masking. The number of colocalizing instances is determined by counting unique label IDs within the overlapping regions. Typically, the reference channel contains larger structures, while other channels contain smaller, potentially nested, structures. For example, the reference channel might contain cell bodies, with the second and third channels containing nuclei and sub-nuclear objects, respectively.

Contributing¶

Contributions are very welcome. Tests can be run with tox, please ensure the coverage at least stays the same before you submit a pull request.

License¶

Distributed under the terms of the BSD-3 license, "napari-tmidas" is free and open source software

Issues¶

If you encounter any problems, please file an issue along with a detailed description.

---

This napari plugin was generated with copier using the napari-plugin-template.