Skip to content

Latest commit

 

History

History
87 lines (67 loc) · 3.12 KB

README-en.md

File metadata and controls

87 lines (67 loc) · 3.12 KB

ISAT with segment anything

Interactive semi-automatic annotation tool for image segmentation.

annotate.gif

Quick annotate for image segmentation by segment anything

Project updating,suggestions welcome

Demo Video:youtube

演示视频:bilibili

中文 English

Feature

  1. Support semantic segmentation and instance segmentation.
  2. Integrating SAM (segment anything model) for interactive semi-automatic annotation of image segmentation.
  3. Interactive correction mask, by clicking on the area of interest (not of interest) with the left (right) mouse button.
  4. Support manual creation of polygons.
  5. Support modifying polygons.
  6. Support for adjusting polygon occlusion.
  7. Support preview annotation result.
  8. ISAT format json, contains more information.
  9. Support opening JSON files annotated by labelme (please backup a copy before opening), and modify.
  10. Support exporting ISAT format json to VOC as single-channel png images.
  11. Support exporting ISAT format jsons to COCO format json.
  12. Support exporting COCO format json to ISAT format jsons.

INSTALL

1. Run the source code

(1) Create environment

conda create -n ISAT_with_segment_anything python==3.8
conda activate ISAT_with_segment_anything

(2) Install Segment anything

git clone [email protected]:facebookresearch/segment-anything.git
cd segment-anything
pip install -e .
cd ..

(3) Install ISAT_with_segment_anything

git clone https://github.com/yatengLG/ISAT_with_segment_anything.git
cd ISAT_with_segment_anything
pip install -r requirements.txt

(4) Download Segment anything pretrained checkpoint.

Download the checkpoint,and save in the path: ISAT_with_segment_anything/segment_any

  • H-checkpoint:sam_vit_h_4b8939.pth

    H checkpoint has best effect, but need more resources.VRAM needs at least 8G.

  • L-checkpoint:sam_vit_l_0b3195.pth

    L checkpoint has normal effect and normal resources.VRAM needs at least 7G.

  • B-checkpoint:sam_vit_b_01ec64.pth

    B checkpoint has pool effect, but need less resources.VRAM needs at least 6G.

(5) Run

python main.py

Explain

  1. The software needs to run well under the GPU and enought VRAM.
  2. If you don't have a GPU or don't have enought VARM, please manually draw polygons for labeling by ISAT.

Citation

@misc{ISAT with segment anything,
  title={{ISAT with segment anything}: Image segmentation annotation tool with segment anything},
  url={https://github.com/yatengLG/ISAT_with_segment_anything},
  note={Open source software available from https://github.com/yatengLG/ISAT_with_segment_anything},
  author={yatengLG and horffmanwang},
  year={2023},
}