YTUP
Journals
About
Services
Guides
Sign InSubmit Article
HomeJournalsSigma Journal of Engineering and Natural Sciences10.14744/sigma.2022.00069
SJSigma Journal of Engineering and Natural Sciences
Get Alerted Download PDF
AbstractKeywordsIntroductionMaterials And MethodsResults And DiscussionLeopardMethodsMethodShare and CiteRelated Articles
Article Open Access1 January 2024

A new classification-based approach for multi-focus image fusion

Order Reprints Cite Share

Samet AYMAZ

* Author to whom correspondence should be addressed.

Sigma Journal of Engineering and Natural Sciences 2024, Vol. 42, Issue 1, pp. 11-25; doi.org/10.14744/sigma.2022.00069

Download PDF View DOI record

Abstract

Multi-focus image fusion combines two or more images of the same scene with different focus points to create a single detailed fully-focused image. The primary purpose of multi-focus im-age fusion methods is to transfer the correct focus information from the source images to the fused image. This study proposes a new classification mechanism based on focus metrics. This mechanism is designed to classify focused, non-focused and ambiguous regions. The most im-portant feature of the proposed mechanism is that it can detect ambiguous areas and transfer these regions to the fused image correctly. Firstly, each source image is split into non-over-lapping image patches of specified sizes in this study. Then, the generated image patches are classified using created classification mechanism. After the classification process, a decision map is created for each source image. These decision maps are then refined using morpho-logical operations. In the final stage of the designed study, a dynamic fusion rule is proposed. This fusion rule transfers focused and non-focused pixels to the fused image according to a specific rule. In contrast, ambiguous regions, frequently encountered in transitions from fo-cused to non-focused areas, are transferred to the fused image using the gradient-based fusion rule. In this way, the negative effect of the regions that the classification algorithms classified incorrectly on the fused image is reduced. In addition, in this study, the impact of image size on image fusion success is analyzed by using different image sizes in the classification mecha-nism. As a result, the proposed study is evaluated using objective and subjective metrics. The evaluations show that the proposed method is suitable for achieving multi-focus image fusion purposes.

Keywords: Classification; Focus Metrics; İmage Fusion; Scoring; SML; WAVV; SF

Introduction

In digital images, some problems arise since imaging devices can focus at limited depths. These problems complicate the analysis of images. Multi-focus image fusion methods are used to eliminate such issues. These methods

bring together meaningless pieces of the puzzle to create meaningful, easy-to-examine images. For this reason, these methods have an important place these days when digital imaging is becoming widespread. Multi-focus image fusion methods can be used in different areas. Health, combining images taken from space, combining images taken during

*Corresponding author. *E-mail address: sametaymaz5@gmail.com This paper was recommended for publication in revised form by Regional Editor Ahmet Selim Dalkilic Published by Yıldız Technical University Press, İstanbul, Turkey Copyright 2021, Yıldız Technical University. This is an open access article under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Sigma J Eng Nat Sci, Vol. 42, No. 1, pp. 11−25, February, 2024

the day and night are applications of this area. In short, these methods are widely used in almost every field of digital imaging. Digital imaging is vital for experts in different fields to make the right decisions. Detailed, easy-to-examine, and near-perfect images are needed to make the right decisions. Multi-focus image fusion methods aim to achieve this perfect image by transferring the correct information from the source images to the fused image and transferring the critical information (edge, corner, etc.) from the source images to the combined images. Many approaches are suggested in the literature to achieve this aim. These approaches are generally studied in two classes: spatial and transformation domains. In recent years, classification-based approaches have been added to these approaches. Spatial domain methods work by directly addressing pixel brightness levels. These methods can be used as block-based or pixel-based. The block-based methods allow processing by decomposing the image according to specific block size. It is faster than pixel-based methods but weaker at preserving details of source images. On the other hand, pixel-based methods are based on finding the importance of each pixel for the fused image. These methods are slower but allow for more detailed fused image creation. In the literature, there are different studies in the spatial domain. The first of these is proposed by Li et al. [1]. It is a block-based approach. In this approach, images are split into fixed-size blocks. Then, the spatial frequency metric is calculated for these blocks, and these values are transferred to the fused image according to a specific threshold value. Another approach is applied by Huang et al. [2]. In this approach, the image is divided into blocks, and focus metrics are calculated for these blocks. Finally, the fused image is created with the fusion rule based on the focus metrics. In addition, methods created using the blockbased Pulse-Coupled Neural Network (PCNN) method are available in the literature [3,4]. In recent years, pixel-based methods have been preferred more than block-based methods in the spatial domain. These methods are frequently used in the literature to provide more detailed fused image creation. The focus weight of each pixel is found and transferred to the fused image in these methods. Random-walkbased methods [5,6], Guided filtering-based methods [7-11], Bilateral filtering-based methods, Markov-random field-based methods [12], Independent Component Analysis (ICA)-based methods, and Sparse Representation (SR)-based methods [13] are the critical methods used in this field. In addition to spatial-based methods, transform-based methods are also frequently used for multi-focus image fusion. Since transform-based methods are suitable for separating essential and unimportant parts of the image, flexible approaches can be created easily. The most critical approaches in this field are wavelet-based and pyramid-based approaches. The first pyramid-based approach is applied by Burt et al. [14] in this field. In this study, the

fusion process is made using the Laplace pyramid. Another approach based on the Laplace pyramid is suggested by Jin et al. [15]. In this approach, Laplace components are combined with the help of a PCNN. Again, for the Laplace features, the fusion of images is made with the area tessellation process by Kou et al. [16]. In addition to pyramid-based approaches, methods based on Wavelet transform also find their place in the literature. Tian et al. [17] propose a wavelet-based approach. In this approach, the components formed after the wavelet transform are combined by statistical sharpness. Again, Aymaz et al. [18] combine Stationary Wavelet Transform (SWT) and Principal Component Analysis (PCA) methods to make a compelling fusion. In addition, there are PCNN-based [19], Support Vector Machine (SVM)-based [20,21], Fisher classifier-based, and Fuzzy sets-based [22,23] approaches applied to wavelet components in the literature. In addition to these studies, approaches based on classification have also been found in the literature in recent years. These approaches are generally learning-based. The important thing here is how accurately the classification can be made. Classification in multi-focus image fusion is usually based on classifying image blocks as focused or non-focused. There are primarily deep learning-based approaches for multi-focus image fusion in the literature. Although learning-based methods are successful in classification, they also have difficulties preparing the training set, creating the network, determining the hyperparameters, etc. There are different approaches based on the classification of image patches in the literature. Some of these approaches are the Two-stage learning-based approach [24], Deep Convolutional Neural Network (CNN)-based approach [25], Generative Adversarial Network (GAN)based approach [26], CNN-based approach [27], Ensemble CNN-based approach [28], Fuzzy CNN-based approach [29], Connection and dilated CNN-based approach [30], and Self-supervised mask-optimization-based approach [31]. The proposed study creates a scoring-based classification mechanism using focus metrics based on image blocks’ spatial and transformative properties. This approach requires no training. In addition, the difficulties found in learning-based approaches such as parameter determination and creating networks are not found in the proposed approach. In this approach, source images are divided into non-overlapping blocks. Focus metrics are calculated for these blocks, and a score is added to the image block with the enormous metric value. As a result, the image block with a significant score is labelled focused, and the small one is labelled non-focused. In addition to these, the transition regions from focused regions to the non-focused areas, which are ignored in the literature and where classification approaches often make mistakes, are also considered in this study. In other words, a three-class classification process is performed. The regions labelled with focus are directly transferred to the fused image. In contrast, areas belonging

Sigma J Eng Nat Sci, Vol. 42, No. 1, pp. 11−25, February, 2024

to the ambiguous class are transferred to the fused image using the gradient-based fusion rule. Thus, the errors caused by the classifier are minimized. Details of the proposed method will be given in other sections. The features that distinguish the proposed method from the methods in the literature are: • A new classification approach based on focus metrics • Addressing ambiguous areas as well as focused and non-focused areas • Analyzing the effect of different image sizes on the fusion • Application of two different fusion rules with dynamic fusion rule.

Materials And Methods

This study proposes a new classification-based approach to multi-focus image fusion. Unlike classical learning-based techniques, an innovative classification process based on focus metrics is applied in the proposed system. The Summodified Laplacian (SML), Variance of Wavelet (WAVV), and Spatial Frequency (SF) are chosen as focus metrics. As the first step of the method, source images are divided into overlapping image blocks. Classifications are usually carried out using a fixed image block size in the literature. The proposed work is evaluated for different image block sizes, which are 8x8, 16x16, and 32x32. Thus, the effect of block sizes on fusion is shown. Details of the methods designed for the proposed study will be presented in the following sections In addition, the two-step fusion rule is applied in the proposed study to minimize classification errors. In the regions where the classifiers can clearly distinguish the focused and non-focused areas, the corresponding pixel values in the source images are multiplied by the corresponding label value and transferred directly to the fused image. For indefinite parts, a gradient-based fusion rule is applied. After the proposed study, highly detailed, near-perfectly combined images are obtained. Finally, objective and subjective metrics are used in performance evaluation. Evaluation and comparison results show that the proposed approach applies multi-focus image fusion successfully. Figure 1 shows the flow of the proposed method. The New Classification Mechanism This study proposes a new classification mechanism based on focus metrics that do not require training, unlike the learning-based classification methods in the literature. In this mechanism, three metrics are chosen that highlight the spatial and transformative properties of the image blocks. The number of metrics can be increased, but since this method will adversely affect the working times, it is ensured that operations are performed with the minimum number of metrics. Selected metrics are SML, which brings edge information to the fore, WAVV for calculating frequency components and focus information, and SF for

Figure 1. The flow of the proposed method. extracting important points in images. Since focused regions contain more detail than non-focused regions, they can easily reach focus information using these metrics. In addition, the proposed mechanism also addresses the ambiguous areas that are important for the fused image, which are ignored in the methods in the literature. Classifiers often misclassify (same label value for each block) for the

Sigma J Eng Nat Sci, Vol. 42, No. 1, pp. 11−25, February, 2024

transition from focused to non-focused regions. This situation negatively affects the success of the methods. In the proposed approach to improve methods in the literature, a third class, the ambiguous class, is put forward. By applying the remarkable fusion rule for these regions, perfectly combined images can be created. The operation of the proposed mechanism for two source images is as follows step by step in Figure 2.

Focus Measurement Metrics Focus measurement metrics measure the degree of focus of blocks in images [32]. It also gives a degree of clarity to the images. Therefore, they are vital in classifying an image block as focused or non-focused. For this study, three focus metrics with different properties are selected. These metrics are WAVV, SML, and SF. Selected metrics reveal both spatial and transformational properties of image blocks. In addition, these metrics effectively highlight important parts of images, making them very suitable for multi-focus fusion purposes. SML: Sum-modified Laplacian metric is suggested by Nayar et al.[33]. This metric is based on the Laplace operator with quadratic derivatives and highlights essential parts of images. The metric calculation is illustrated with Equations (1-2). (1)

(2) SF: The SF metric is calculated based on the image gradient. Gradient takes higher values in important image parts, such as edges, corners, etc. This analysis makes it easy to find focused regions. Therefore, it is well suited for multi-focus compositing purposes. Equations (3-5) give the calculation of the SF metric. [34]. (3) In Equations (4-5), RF and CF represent the row and column frequencies. RF shows important information (edge, corner, etc.) in rows of images, while CF shows important information in columns of images.

(5) In these equations, M and N give the row and column sizes of source images, respectively. Also, f is the original signal. WAVV: Transformation-based methods facilitate the analysis of images. Wavelet transform is frequently preferred in the literature. This metric tries to reach the focus information by using the frequency components of the image parts. Figure 2. The flow chart of the new classification mechanism.

Two-Step Fusion Rule In this study, an innovative fusion approach is used. In classification-based methods for multi-focus image fusion,

Sigma J Eng Nat Sci, Vol. 42, No. 1, pp. 11−25, February, 2024

the fused images are created according to the classifier’s decision. This situation causes even a tiny error in classification to affect the combined image adversely. A two-step fusion approach is designed in the proposed study to turn this negative situation into a positive one. The classifier classifies the image blocks as focused, non-focused, and ambiguous. In the regions where the classifiers can clearly distinguish between focused and non-focused, the relevant decision map label value and the source image pixel value are multiplied and transferred to the fused image. The main problematic parts of the images are the transition points from the focused regions to the non-focused areas. At these points, classifiers often make mistakes. Therefore, in the proposed study, these parts are ambiguous and transferred to the fused image using the gradient-based fusion rule. The steps of the two-step fusion rule are shown in figure 3. The most significant feature that distinguishes the proposed study from the studies in the literature is the presence of ambiguous pixels. The images of the ambiguous pixels obtained for the Boat image as a result of the proposed method are given in Figure 4. When Figure 4 is examined, it is seen that ambiguous pixels appear in the transitions from focused regions to defocused regions in source images. In addition, it can be seen that the number of these pixels increases as the block size increases. Gradient-based Fusion Rule Multi-focus image fusion methods aim to transfer the correct focus and essential information (edge, corner, etc.) from the source images to the fused image. A gradient is a tool that highlights vital information of images that can best accomplish these purposes. This tool takes high values in crucial parts of the image (edge, corner, etc.) and low values in unimportant areas such as the background. In this study, a gradient-based fusion rule is applied, which is based on gradient analysis and determines the importance ratios

of each pixel for the merged image. This rule is used only when the classifier is unstable. Thus, detailed fused images are obtained. The step-by-step implementation of the gradient-based fusion rule is as follows; Step 1: This fusion rule works when the classifier gives label 2. First, the gradient magnitudes of each pixel in the source images are calculated using the 3x3 Sobel filter. The filter size is chosen small because every detail in the source images is significant for the fused image. Then, maps containing gradient magnitudes are obtained for each source image (Gmag1, Gmag2). Step 2: Then, the gradient magnitudes are proportioned, and each pixel’s importance ratios for the fused image are determined. Transferring a pixel directly to the fused image is risky. It is essential to transfer the pixels to the combined image by weighting to reduce this risk. The weights of the pixels are calculated using Equation (6) and Equation (7). (6) (7) Step 3: After the importance ratios of pixels in source images are calculated, the ambiguous regions are transferred to the combined image according to their importance ratios using Equation (8). (8) Performance Measurement Metrics Performance measurements are made in two different ways in multi-focus image fusion methods. These are objective and subjective metrics.

Sigma J Eng Nat Sci, Vol. 42, No. 1, pp. 11−25, February, 2024

Figure 4. Multi-focus Boat image, a) Right-focused source image, b) Left-focused source image, Ambiguous pixels after proposed classification method with c) 8x8 block size, d) 16x16 block size, e) 32x32 block size.

Objective Metrics QAB/F and Mutual Information (MI) metrics are the most popular objective metrics. These metrics are used when we do not have a reference image available. Since the datasets used in the literature generally do not contain original images, researchers use these metrics more frequently. With the help of these metrics, the correct amount of data transferred from the source images to the combined image can be measured. QAB/F Metric: The QAB/F metric measures the edge information transferred from the source images to the fused image. It is calculated using Equations (9-13) [35]. GAF (n, m) and AAF (n, m) show the relative strength and orientation values of input images A to F. These values are calculated using Equations (9-10).

The model and give the edges between the A and F images. Some constant values are used in these equations. The constants are Γg, κ g, σ g and Γα, κα, σα . These constants are the exact form of the sigmoid functions used to generate the edge strength values. The calculations of these values are given in Equations (11-12). (11)

(12) As a result, Equation (13) measures the amount of edge transferred from the source images to the fused image. (13) In Equation (13), the source images and the fused image are represented by A, B, and F, respectively. The edge relationship between the images A and F is represented by QAF , While the edge relationship represents the B and F images

Sigma J Eng Nat Sci, Vol. 42, No. 1, pp. 11−25, February, 2024

QBF. The weights wA (i, j) and wB (i, j) represent the required weights for QAF and QBF. In addition, the higher the value of this metric, the more successful the method. MI: The Mutual Information metric measures the correct amount of information transferred from the source images to the fused image. The metric is calculated using Equations (14-15). (14)

(15) In Equations (14-15), the IAF and IBF values indicate the amount of information between images A and B and between images B and F, respectively. In addition, the P in the equations represents the entropy information. (16) As a result, the total information transferred from source images to fused images is represented with MI. Subjective Metrics The most popular subjective metrics are Root Mean Square Error (RMSE) and Peak Signal Noise Ratio (PSNR). These metrics are used when we have a reference image. It is used to measure the similarity between the fused image and the original image. RMSE: The RMSE metric measures the similarity of the fused image resulting from the method and the original image from the dataset. It is calculated using the metric Equation (17) [36]. The smaller the result of this metric, the more successful the method. (17) In Equation (18), M and N show the row and column of images, respectively. In addition, the reference image and fused image are represented with IR and IF, respectively. PSNR: The PSNR metric shows how noise-resistant the fused image is compared to the original image. The higher the metric result, the more successful the proposed method is [36]. (18) In Equation (18), M and N show the row and column of images, respectively. In addition, the reference image and fused image are represented with IR and IF, respectively. In this Equation, L shows the maximum grey level.

Results And Discussion

This study proposes a new approach for multi-focus image fusion. This approach includes a new classification mechanism that does not require training and a flexible two-step fusion rule. In addition, the proposed study with different sizes of blocks is tried to show the effect of image block sizes on fusion success. These dimensions are chosen as 8x8, 16x16, and 32x32. Evaluations for each dimension are made separately. Very few datasets exist for multi-focus image fusion methods in the literature. The most popular of these datasets is the Lytro dataset [37], consisting of 20 color images, and the Durga Prasad dataset [38], grey-level images. In the proposed study, evaluations are made for the samples taken from both datasets. While making the evaluations, objective and subjective metrics are used. Objective metrics measure how much the correct focus information is transferred from the source images to the fused image, and essential information such as edges and corners of the source images are preserved without the need for a reference image. This paper uses the objective metrics QAB/F and MI, popularly used in the literature. These metrics effectively measure how well multi-focus image fusion goals are achieved. First, evaluations and visual results with images taken by Durga Prasad [38] will be given. The samples taken from this dataset are compared with nine different methods in the literature. The first of these methods is proposed by Chen et al. [39]. They used Multiwavelet transform to divide source images into frequency components. Then, the SML metrics of these components are calculated, and the larger values are transferred to the combined image. The second one is Hua et al.’s [40] method. They applied the random walks method to fuse images. In this study, focus metrics using local and global properties of images are used as a fusion rule. Zhang et al.’s [41] method classifies the focused regions with the Graf-based Visual Saliency method, and then the parts are smoothed by morphological operations. Also, the Shearlet transform is used for defocused areas, while the focused regions are transferred directly to the fused image in this method. Another approach is implemented by Li et al. [42]. First, the source images are divided into frequency components with the Nonsubsampled Counterlet Transform (NSCT) method. Then, the Energy of Gradient (EOG) metric for these components is calculated and combined according to the mean and the maximum rules. Nejati et al. [43] designed a new focus measure that handles the intersections of source images, and focused regions are separated from the defocused areas. Another approach in this area is proposed by Jiang et al. [23]. They offered a method based on SWT and fuzzy sets. Abdipour et al. [44] first split source images into sub-frequency components. Then, these components’ variance and spatial frequency information are calculated and combined. Chaudrary et al. [45] proposed a blockbased approach. This approach divides the source images

Sigma J Eng Nat Sci, Vol. 42, No. 1, pp. 11−25, February, 2024

into two subcomponents with neighbourhood filtering. Then, these subcomponents are combined using spatial frequency metrics, and a fused image is created. The last of the methods is recommended by Yang et al. [46]. They implement a Counterlet transform to divide source images into two subbands. While low subbands are transferred to the fused image with the PCNN method, the maximum SML metric is transferred to the combined image for high-frequency subbands. The proposed approach compared with these methods and comparison results are given in Table 1. The methods given in Table 1 use either spatial domain or transform domain methods to fuse source images. The proposed approach is superior to these methods as it can transfer the focus information directly to the fused image without any coefficients. The disadvantage of these studies is finding constant coefficients that accurately transfer the focus information to the fused image. When the evaluations are examined, it is seen that the proposed approach is objectively superior to the methods in the literature. In addition, the proposed method results related to these images are given in the figures. The visual results

of the proposed method for the dataset prepared by Durga Prasad [38] are presented in this section. Visual results of Flower and Leaf images are given in Figures 5 and 6, respectively. Figures 5-6 present the visual results of the proposed study on the dataset prepared by Durga Prasad. This dataset consists entirely of grey-level images. Figures 5-6 are created with a similar logic. The a and b images in the figures give source images with defocused regions taken from the relevant dataset. Since the proposed study focuses on classification into focused and non-focused areas, images showing classification success are added to the figures. After the proposed classification mechanism and morphological processes, give decision maps with c and d images. In addition, the fused image formed after the proposed study is shown with the e image. As can be seen from the figures, the proposed approach successfully creates decision maps and perfectly fused images with the help of these decision maps. Secondly, subjective evaluations are made for some samples taken from the dataset prepared by Durga Prasad [38]. Since it is difficult to find reference images, such metrics

Table 1. Objective Comparison Results for Durga Prasad [38] Dataset Images

Leopard

Metrics Chen et al. [39] Hua et al. [40] Zhang et al. [41] Li et al. [42] Nejati et al. [43] Jiang et al. [23] Abdipour et al. [44] Chaudhary et al. [45] Yang et al. [46] Proposed Method (with 8x8 Block Size) Proposed Method (with 16x16 Block Size) Proposed Method (with 32x32 Block Size)

Sigma J Eng Nat Sci, Vol. 42, No. 1, pp. 11−25, February, 2024

(c) (d) (e) Figure 5. Multi-focus Flower image. (a) Right-focused source image, (b) Left-focused source image, (c) Decision map for right-focused image After proposed classification method, (d) Decision map for left-focused image after proposed classification method and (e) Fused image.

(c) (d) (e) Figure 6. Multi-focus Leaf image. (a) Right-focused source image, (b) Left-focused source image, (c) Decision map for right-focused image after proposed classification method, (d) Decision map for left-focused image after proposed classification method, and (e) Fused image.

Sigma J Eng Nat Sci, Vol. 42, No. 1, pp. 11−25, February, 2024

are not preferred in the literature. In this study, RMSE and PSNR metrics, which are subjective, are used. The proposed method is compared with three different studies in the literature using these metrics. When Table 2 is examined, it is seen that the proposed approach obtains the closest fused images to the original images. In addition, as the image block sizes increase, it is seen that the success of the method decreases as it becomes more challenging to find the transition points from the focused regions to the defocused areas. Finally, the proposed approach is objectively compared with classification-based techniques. This comparison is meaningful as the proposed approach also includes a classification mechanism. Comparisons are made with nine different studies applied in the literature in recent years. Firstly, Liu et al. [25] proposed a system based on detecting focused regions by deep CNN. Secondly, Ma et al. [26] used GAN architecture to detect focused and defocused areas. Another approach using deep learning is suggested by Amin-Naji et al. [28]. This approach uses an ensemble-based CNN. Zhang et al. [27] proposed a different approach based on CNN. The first two convolution

layers are used to extract features, and these features are combined according to the max, min rule. Liu et al. [49] applied an adaptive sparse-based approach. This approach creates dictionaries for source images, and coefficients are made for each source image with the K-SVD algorithm. If the corresponding coefficient is higher, it is transferred to the fused vector, and the fused image is obtained. Gai et al. [24] proposed a two-stage CNN structure. In the first stage, images are separated as focused or non-focused with Densenet. In Phase 2, EDGAN architecture is applied to protect the edges in source images. In Bai et al.’s [52] method, source images are divided into subcomponents with a Quadtree structure, and these subcomponents are classified as focused or non-focused using the SML metric. Then, the results are improved by morphological operations, and a fused image is obtained. Zhang et al. [53] found the transition between the focused and non-focused regions and combined them. Gradient information is used when finding a boundary. Finally, Liu et al. [51] applied a transform and sparse-based approach. First, the source images are separated into low and high-frequency components using the transform-based method.

Table 2. Subjective Comparison Results for Durga Prasad [38] Dataset

Methods

Table 3. Objective Comparison Results for Lytro Dataset [37]

Method

Sigma J Eng Nat Sci, Vol. 42, No. 1, pp. 11−25, February, 2024

Low-frequency information is combined with a sparsebased system, while high-frequency information is combined with the maximum selection rule. The proposed approach compared with these methods and comparison results are given in Table 3. The methods for comparison in Table 3 aim to combine patches in source images by classifying them as focused and non-focused. These approaches generally use deep learning methods as classifiers. Although deep learning approaches produce typically successful results, they include difficulties such as determining parameters, creating a suitable network, and creating a training dataset. The proposed approach in this study makes classification without the need for these parameters. It also includes a two-step fusion rule that can minimize classification errors. Thanks to these features, the proposed approach produces successful results for multi-focus image fusion. Objective metric results for all examples from the Lytro [37] dataset are given in Table 3. When the metric results are examined, it is seen that the proposed approach is superior to the methods in the literature. This superiority arises because the proposed study is designed

following multi-focus image fusion purposes. In addition, visual results of the proposed approach for some images from the Lytro [37] dataset are given in this section. When the visuals are examined, it is seen that the visual results of the proposed approach are as good as the numerical results for fusion. This section gives Lytro-08, Lytro-01, and Lytro-10 from the related dataset. Figures 7-9 provide the visual results of the proposed study. All of these figures are organized in the same way. Images a and b in each figure represent source images with different focus values from ​​ the Lytro [37] dataset. Images c and d show the decision maps formed after the proposed classification mechanism and morphological operators. As can be seen from the decision maps, the proposed approaches successfully separated the focused and non-focused regions. Finally, after the proposed study, the f image gives the created fused image. The fused image is rendered perfectly, very close to the original. The Lytro [37] dataset consists of colour images. The proposed approach successfully combines both grey and colourlevel images.

Figure 7. Multi-focus Lytro-08 image. (a) Right-focused source image, (b) Left-focused source image, (c) Decision map for right-focused image after proposed classification method, (d) Decision map for left-focused image after proposed classification method and (e) Fused image

Sigma J Eng Nat Sci, Vol. 42, No. 1, pp. 11−25, February, 2024

(c) (d) (e) Figure 8. Multi-focus Lytro-01 image. (a) Right-focused source image, (b) Left-focused source image, (c) Decision map for right-focused image after proposed classification method, (d) Decision map for left-focused image after proposed classification method and (e) Fused image.

(c) (d) (e) Figure 9. Multi-focus Lytro-10 image. (a) Right-focused source image, (b) Left-focused source image, (c) Decision map for right-focused image after proposed classification method, (d) Decision map for left-focused image after proposed classification method and (e) Fused image.

Sigma J Eng Nat Sci, Vol. 42, No. 1, pp. 11−25, February, 2024

Share and Cite

AYMAZ, S.; AYMAZ, Ş.; KÖSE, C. A new classification-based approach for multi-focus image fusion. Sigma Journal of Engineering and Natural Sciences 2024, Vol. 42, pp. 11-25. https://doi.org/10.14744/sigma.2022.00069

Export:

Related Articles

Evaluation of health care systems using supervised and unsupervised machine learning approachesCanan BULUT, Tuğba SÖNAL et al., 1 January 2025Classification of breast cancer using ensemble machine learning with apache sparkDurga Pujitha KROTHA, Fathimabi SHAIK, 1 January 2025A hybrid model of random forest ensemble and resample for cardiotocography data classificationR. HEPHZIBAH, A. Hepzibah CHRISTINAL et al., 1 January 2025Application of an improved edge detection algorithm in fundus imagesGurkan KAPLAN, Alper ODABAS, 1 January 2025
Publication History
Published1 January 2024
Versionv1
AccessOpen Access
10.14744/sigma.2022.00069
Article Figures (9)
Figure 1Figure 2Figure 3Figure 4Figure 5Figure 6Figure 7Figure 8Figure 9
Related Articles
Evaluation of health care systems using supervised and unsupervised machine learning approachesCanan BULUT, Tuğba SÖNAL et al.Sigma Journal of Engineering and Natural Sciences, 1 January 2025Classification of breast cancer using ensemble machine learning with apache sparkDurga Pujitha KROTHA, Fathimabi SHAIKSigma Journal of Engineering and Natural Sciences, 1 January 2025A hybrid model of random forest ensemble and resample for cardiotocography data classificationR. HEPHZIBAH, A. Hepzibah CHRISTINAL et al.Sigma Journal of Engineering and Natural Sciences, 1 January 2025
Sigma Journal of Engineering and Natural Sciences coverSigma Journal of Engineering and Natural Sciences Download PDF

Subscribe to YTUP

Stay connected and receive the latest research updates directly in your inbox.

YTUP — Yıldız Technical University Publishing

Advancing knowledge and fostering innovation through high-quality, peer-reviewed academic publications.

About YTU

Discover

  • ›Articles
  • ›Journals
  • ›Research Topics
  • ›Open Access Policy

Guidelines

  • ›Author guidelines
  • ›Services for authors
  • ›Policies and publication ethics
  • ›Editor guidelines
  • ›Fee policy

Explore

  • ›Articles
  • ›Research Topics
  • ›Journals
  • ›How we publish

Support

  • ›Help center
  • ›Emails and alerts
  • ›Contact us
  • ›Submit
  • ›Career opportunities
YTU Logo

© 2026 Yıldız Technical University (Istanbul, Turkey)

Terms and ConditionsTerms of UsePrivacy PolicyPrivacy SettingsDisclaimer
Like this platform? Join our teamHave feedback or questions?
Supervisor