A super-fast Python implementation of Seam carving for content-aware image resizing, and the forward energy function proposed in Improved seam carving for video retargeting.
With seam carving algorithm, the image could be intelligently resized while keeping the important contents undistorted. The carving process could be further guided, so that an object could be removed from the image without apparent artifacts.
Install a stable version from PyPI.
pip install seam-carving
Or install the latest version from GitHub.
pip install git+https://github.com/li-plus/seam-carving.git@master
To scale an image, use seam_carving.resize
method.
import numpy as np
from PIL import Image
import seam_carving
src = np.array(Image.open('fig/castle.jpg'))
src_h, src_w, _ = src.shape
dst = seam_carving.resize(
src, (src_w - 200, src_h),
energy_mode='backward', # Choose from {backward, forward}
order='width-first', # Choose from {width-first, height-first}
keep_mask=None
)
Image.fromarray(dst).show()
To remove an object from an image, use seam_carving.remove_object
method.
src = np.array(Image.open('fig/beach.jpg'))
mask = np.array(Image.open('fig/beach_girl.png').convert('L'))
dst = seam_carving.remove_object(src, drop_mask=mask, keep_mask=None)
Image.fromarray(dst).show()
For more examples, please refer to example/demo.py.
Resizing along the x-axis using original backward energy function.
Reduce the width of the bench image using backward & forward energy function.
The image width and height could be changed simultaneously. The order of vertical and horizontal seams has little to do with the final results. Currently we only support two kinds of seams-order: width-first
and height-first
. In width-first
mode, we remove/insert all vertical seams first, and then the horizontal ones, while height-first
is the opposite.
The protected mask is free from seam removal and insertion.
Specify an object mask to remove (red) and a mask to protect (green, optional).
We compare the performance of our implementation and other popular Python repos on castle.jpg. The image is narrowed or widened by 200 pixels using backward energy (BE) or forward energy (FE), respectively. Below is the running time (second) evaluated on a MacBook Pro.
Methods | BE -200px | BE +200px | FE -200px | FE +200px |
---|---|---|---|---|
vivianhylee/seam-carving | 192.63 | 217.04 | 109.33 | 108.53 |
sameeptandon/python-seam-carving | 91.67 | 124.21 | N/A | N/A |
andrewdcampbell/seam-carving | 91.38 | 90.89 | 98.47 | 102.84 |
dharness/seam_carving | 59.81 | 73.04 | N/A | N/A |
Ours | 2.30 | 3.26 | 4.60 | 5.40 |
- Avidan, S., & Shamir, A. (2007). Seam carving for content-aware image resizing. In ACM SIGGRAPH 2007 papers (pp. 10-es). [paper] [blog]
- Rubinstein, M., Shamir, A., & Avidan, S. (2008). Improved seam carving for video retargeting. ACM transactions on graphics (TOG), 27(3), 1-9. [paper]
- Das, A. (2019). Improved seam carving with forward energy. [blog]