Automatic texture guided color transfer and colorization
Authors: 
B. Arbelot, R. Vergne, T. Hurtut, J. ThollotAuthors Info & Claims
B. Arbelot, R. Vergne, T. Hurtut, J. ThollotAuthors Info & ClaimsAbstract
This paper targets two related color manipulation problems: Color transfer for modifying an image's colors and colorization for adding colors to a grayscale image. Automatic methods for these two applications propose to modify the input image using a reference that contains the desired colors. Previous approaches usually do not target both applications and suffer from two main limitations: possible misleading associations between input and reference regions and poor spatial coherence around image structures. In this paper, we propose a unified framework that uses the textural content of the images to guide the color transfer and colorization. Our method introduces an edge-aware texture descriptor based on region covariance, allowing for local color transformations. We show that our approach is able to produce results comparable or better than state-of-the-art methods in both applications.
References
[1]
{AP10} An X., Pellacini F.: User-controllable color transfer. Computer Graphics Forum (2010). 2
[2]
{APH*14} Aubry M., Paris S., Hasinoff S. W., Kautz J., Durand F.: Fast local laplacian filters: Theory and applications. ACM Trans. Graph. 33, 5 (2014), 167:1--167:14. 3, 5
[3]
{Bal06} Balas B. J.: Texture synthesis and perception: using computational models to study texture representations in the human visual system. Vision Research 46, 3 (2006), 299--309. 2
[4]
{BSPP13} Bonneel N., Sunkavalli K., Paris S., Pfister H.: Example-based video color grading. ACM Trans. Graph. 32, 4 (2013), 39:1--39:12. 2
[5]
{BT12} Bugeau A., Ta V.-T.: Patch-based image colorization. In Pattern Recognition (ICPR), 2012 21st International Conference on (2012), pp. 3058--3061. 2, 8, 9
[6]
{BTP14} Bugeau A., Ta V.-T., Papadakis N.: Variational exemplar-based image colorization. IEEE Trans. Image Processing 23, 1 (2014), 298--307. 2
[7]
{CHS08} Charpiat G., Hofmann M., Sch�lkopf B.: Automatic image colorization via multimodal predictions. In Proc. ECCV (2008), pp. 126--139. 2, 8, 9
[8]
{CLKL14} Cho H., Lee H., Kang H., Lee S.: Bilateral texture filtering. ACM Trans. Graph. 33, 4 (2014), 128:1--128:8. 2
[9]
{DX09} Dong Y., Xu D.: Interactive local color transfer based on coupled map lattices. In Proc. Computer-Aided Design and Computer Graphics (Aug 2009), pp. 146--149. 2
[10]
{FPC*15} Faridul H. S., Pouli T., Chamaret C., Stauder J., Reinhard E., Kuzovkin D., Tremeau A.: Colour mapping: A review of recent methods, extensions and applications. Computer Graphics Forum (2015). 2
[11]
{FSDH15} Frigo O., Sabater N., Demoulin V., Hellier P.: Optimal transportation for example-guided color transfer. In Computer Vision -- ACCV 2014, vol. 9005 of Lecture Notes in Computer Science. Springer International Publishing, 2015, pp. 655--670. 2, 8, 9
[12]
{GCR*12} Gupta R. K., Chia A. Y.-S., Rajan D., Ng E. S., Zhiyong H.: Image colorization using similar images. In Proc. ACM Int. Conference on Multimedia (2012), pp. 369--378. 2, 8, 9, 11
[13]
{HCS*09} Hong X., Chang H., Shan S., Chen X., Gao W.: Sigma set: A small second order statistical region descriptor. In Proc. IEEE CVPR (2009), pp. 1802--1809. 4, 6
[14]
{HJO*01} Hertzmann A., Jacobs C. E., Oliver N., Curless B., Salesin D. H.: Image analogies. In Proc. of the 28th annual conference on Computer graphics and interactive techniques (2001), SIGGRAPH '01, pp. 327--340. 2
[15]
{HLMCB15} Hristova H., Le Meur O., Cozot R., Bouatouch K.: Style-aware robust color transfer. In Proc. Computational Aesthetics (2015), pp. 67--77. 2, 8, 9, 11
[16]
{HST13} He K., Sun J., Tang X.: Guided image filtering. IEEE Trans. Pattern Analysis and Machine Intelligence 35, 6 (2013), 1397--1409. 3, 5
[17]
{ICOL05} Irony R., Cohen-Or D., Lischinski D.: Colorization by example. In Proc. EGSR (2005), pp. 201--210. 2
[18]
{JCT14} Jin S.-Y., Choi H.-J., Tai Y.-W.: A randomized algorithm for natural object colorization. Computer Graphics Forum 33, 2 (2014), 205--214. 2
[19]
{KCP15} Kuzovkin D., Chamaret C., Pouli T.: Descriptor-based image colorization and regularization. In Proc. Computational Color Imaging Workshop (2015), pp. 59--68. 2
[20]
{KEE13} Karacan L., Erdem E., Erdem A.: Structure-preserving image smoothing via region covariances. ACM Trans. Graph. 32, 6 (2013), 176:1--176:11. 2, 3, 4, 6
[21]
{LLW04} Levin A., Lischinski D., Weiss Y.: Colorization using optimization. ACM Trans. Graph. 23, 3 (2004), 689--694. 2
[22]
{LSZ12} Liu S., Sun H., Zhang X.: Selective color transferring via ellipsoid color mixture map. Journal of Visual Communication and Image Representation 23, 1 (2012), 173--181. 2
[23]
{OVB*15} Okura F., Vanhoey K., Bousseau A., Efros A., Drettakis G.: Unifying color and texture transfer for predictive appearance manipulation. Computer Graphics Forum (Proc. of the Eurographics Symposium on Rendering) 34, 4 (2015). 2
[24]
{PAB*15} Pierre F., Aujol J.-F., Bugeau A., Papadakis N., Ta V.-T.: Luminance-chrominance model for image colorization. SIAM Journal on Imaging Sciences 8, 1 (2015), 536--563. 8, 9
[25]
{PKD07} Piti� F., Kokaram A. C., Dahyot R.: Automated colour grading using colour distribution transfer. Comput. Vis. Image Underst. 107, 1-2 (2007), 123--137. 2, 8, 9
[26]
{PM90} Perona P., Malik J.: Scale-space and edge detection using anisotropic diffusion. IEEE Trans. Pattern Analysis and Machine Intelligence 12, 7 (1990), 629--639. 3, 5
[27]
{PR11} Pouli T., Reinhard E.: Progressive color transfer for images of arbitrary dynamic range. Computers & Graphics 35, 1 (2011), 67--80. 2, 8, 9
[28]
{RAGS01} Reinhard E., Ashikhmin M., Gooch B., Shirley P.: Color transfer between images. IEEE Comput. Graph. Appl. 21, 5 (2001), 34--41. 2, 6, 7, 8, 9
[29]
{SPDF13} Shih Y., Paris S., Durand F., Freeman W. T.: Data-driven hallucination of different times of day from a single outdoor photo. ACM Trans. Graph. 32, 6 (2013), 200:1--200:11. 2
[30]
{TJT05} Tai Y.-W., Jia J., Tang C.-K.: Local color transfer via probabilistic segmentation by expectation-maximization. In Proc. IEEE CVPR (2005), vol. 1, pp. 747--754 vol. 1. 2
[31]
{TM98} Tomasi C., Manduchi R.: Bilateral filtering for gray and color images. In Proc. ICCV (1998), pp. 839--. 3, 5
[32]
{TPM06} Tuzel O., Porikli F., Meer P.: Region covariance: A fast descriptor for detection and classification. In Proc. ECCV (2006), pp. 589--600. 3
[33]
{WAM02} Welsh T., Ashikhmin M., Mueller K.: Transferring color to greyscale images. ACM Trans. Graph. 21, 3 (2002), 277--280. 2, 8, 9
[34]
{XDG10} Xia G.-S., Delon J., Gousseau Y.: Shape-based invariant texture indexing. International Journal of Computer Vision 88, 3 (2010), 382--403. 2
[35]
{XHJF12} Xu Y., Huang S., Ji H., Ferm�ller C.: Scale-space texture description on sift-like textons. Computer Vision and Image Understanding 116, 9 (2012), 999--1013. 2
[36]
{XM06} Xiao X., Ma L.: Color transfer in correlated color space. In Proc. ACM Int. Conf. on Virtual Reality Continuum and its Applications (VRCIA) (2006), pp. 305--309. 2
[37]
{XYXJ12} Xu L., Yan Q., Xia Y., Jia J.: Structure extraction from texture via relative total variation. ACM Trans. Graph. 31, 6 (2012), 139:1--139:10. 2
[38]
{YJ*93} Yellott Jr J. I., et al.: Implications of triple correlation uniqueness for texture statistics and the julesz conjecture. JOSA A 10, 5 (1993), 777--793. 2
Index Terms
- Automatic texture guided color transfer and colorization
Recommendations
Color and texture descriptors
This paper presents an overview of color and texture descriptors that have been approved for the Final Committee Draft of the MPEG-7 standard. The color and texture descriptors that are described in this paper have undergone extensive evaluation and ...
Color texture analysis using CFA chromatic co-occurrence matrices
Most color cameras are fitted with a single sensor that provides color filter array (CFA) images, in which each pixel is characterized by one of the three color components (either red, green, or blue). To produce a color image, the two missing color ...
Color texture segmentation using feature distributions
A new method for color textured segmentation using feature distributions is proposed in this study. First, the distributions of color and local edge patterns are used to derive a homogeneity measure for color textured regions. Then, a coarse-to-fine ...
Comments
Information & Contributors
Information
Published In
Sponsors
- SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
- EUROGRAPHICS: The European Association for Computer Graphics
Publisher
Eurographics Association
Goslar, Germany
Publication History
Published: 07 May 2016
Check for updates
Qualifiers
- Research-article
Conference
Expressive '16
Sponsor:
- SIGGRAPH
- EUROGRAPHICS
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 151Total Downloads
- Downloads (Last 12 months)3
- Downloads (Last 6 weeks)0
Reflects downloads up to 19 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in