\section{Introduction}
Multiplicative noise, also known as speckle noise, typically occurs in active imaging system, for example, laser images, microscope images, and SAR (Synthetic Aperture Radar) images. While many general image denoising algorithms have focused on the additive noise setting, despeckling the multiplicative noise is also becoming important as the active sensors, e.g., SAR, are gradually becoming a significant source of remote sensing data in the field of geographic mapping, resource surveying, and military reconnaissance, etc.

During the last few decades, various different approaches have been proposed for the multiplicative noise despeckling; \emph{e.g.}, Bayesian methods \cite{lee1980digital,LEE1981380}, non-local filtering \cite{buades2005non,dabov2007image,rudin1992nonlinear}, total variation regularization \cite{huang2009new}, compressed sensing based \cite{HaoFenXu12}, and variational approaches \cite{AubAuj08}, etc. For more extensive survey on the topic, we refer the readers to \cite{argenti2013tutorial}.

In addition to the above mentioned classical approaches, the deep learning-based multiplicative noise despeckling methods have been recently considered, as in the additive noise denoising case, \emph{e.g.}, \cite{zhang2017beyond}. Namely, by casting the despeckling as a supervised learning problem, the CNN models are trained to learn a mapping from the noisy patch to the clean patch. For example, \cite{wang2017sar} proposed ID-CNN that uses exactly the same architecture as DnCNN on the Gamma-distributed multiplicative noise and introduced a total variation (TV) regularization; \cite{chierchia2017sar} transformed both clean and noisy images to the log domain then carried out the same process as in the additive noise case; \cite{zhang2018learning} proposed SAR-DRN, which added dilated convolution and skip connections to the ID-DCN architecture. As in the additive noise denoising case, the CNN-based models have achieved superior despeckling performances than the classical approaches.

Despite the impressive performance, above methods have one critical limitation, however. That is, once the supervised training of the network is done, the network parameters get frozen and no adaptation of the despeckling model to a given noisy image can be done. To overcome such limitation, \cite{cha2018neural} have recently proposed an adaptive method, dubbed as N-AIDE, for the \emph{additive noise} case that can carry out both the supervised training (on an offline dataset) and adaptive fine-tuning (on a given noisy data) of the network parameters. Later, N-AIDE was extended in \cite{cha2018fully} to implement a fully convolutional architecture and unknown noise variance estimation scheme. The crux of N-AIDE
is to design the neural network to learn pixelwise affine mappings with a specific conditional independence constraint and learn the network parameters by setting an unbiased estimate of the true mean-squared error (MSE) of the mappings as an optimizing objective.

In this paper, we show the framework of N-AIDE can be successfully extended to the multiplicative noise case as well and attain the state-of-the-art performance. Our contribution is threefold. First, we derive a new unbiased estimate of MSE for the multiplicative noise case while remaining in learning the pixelwise affine mappings with neural networks, as in N-AIDE. Our estimate of MSE can be interpreted to give an intuitive explanation of the adaptivity of our algorithm. Second, we devise a novel double-sided masked CNN architecture, dubbed as DoPAMINE (\underline{Do}uble-sided masked CNN for \underline{P}ixelwise \underline{A}daptive \underline{M}ult\underline{I}plicative \underline{N}oise d\underline{E}speckling), which maintains the conditional independence property of each pixel in any feature map given the surrounding input pixels. Such property is indispensable for applying the framework of N-AIDE, and obtaining such property with CNN architecture is not trivial as we elaborate below. Third, we propose a \emph{scale add} layer within the DoPAMINE architecture and show such simple layer can accelerate the training of our model that contains many add operations among the intermediate feature maps. Compared to the popular He initialization \cite{he2015delving} or Batch Normalization \cite{ioffe2015batch}, we show our Scale Add layer leads to a much stable and fast training of the base supervised model. Combining the three contributions, we show that our DoPAMINE significantly outperforms SAR-DRN \cite{zhang2018learning}, the current CNN-based state-of-the-art despeckling model, on a benchmark dataset. Furthermore, from real SAR image despeckling results, we show DoPAMINE has a knob to control the emphasis on either homogeneous regions or sharp edges and present that it can capture finer details of the images compared to SAR-DRN.

\section{Notations and Preliminaries}
\subsection{Multiplicative noise model}
We denote the vectorized original clean data and noise as $\mathbf{x}\in\mathbb{R}^d$ and $\mathbf{N}\in\mathbb{R}^d$, respectively. The noisy observation is then denoted as $\mathbf{Z} \in \mathbb{R}^d$, and the $i$-th element of $\mathbf{Z}$ is defined as

\begin{align}
Z_i = x_iN_i,\ \ \ i=1,2,\ldots,d\label{eq:mult_noise}
\end{align}
in which we assume $N_i$'s are independent with $\mathbb{E}(N_i)=1$ and $\text{Var}(N_i)=\sigma^2$ for all $i$. We do not assume $N_i$ to be identically distributed. We use uppercase letters to denote random variables or random vectors and do not make any stochastic assumptions on the original data $\mathbf{x}$. In the multiplicative noise despeckling literature, $N_i$'s are typically assumed to follow the Gamma distribution, but in this paper, we \emph{do not} require the noise to be Gamma-distributed.

The reconstructed data after despeckling is denoted as $\hat{\mathbf{x}}(\mathbf{Z})=\{\hat{x}_i(\mathbf{Z})\}_{i=1}^d$. Note the notation emphasizes the dependency on the entire $\mathbf{Z}$ for obtaining the reconstruction of the $i$-th element. The goodness of despeckling is typically measured with the mean-squared error (MSE) as in the additive noise case.

\subsection{N-AIDE and the unbiased  estimator}
\cite{cha2018neural} considered the additive noise denoising case and suggested to use the pixelwise affine mappings to obtain the reconstructions:
\begin{align}
\hat{x}_i(\textbf{Z}) = a(\mathbf{Z}^{-i})Z_i+b(\mathbf{Z}^{-i}),\ \ \ i=1,2,\ldots,d\label{eq:affine_mappings}
\end{align}
in which $\mathbf{Z}^{-i}$ denote the entire noisy data except for the $i$-th element. Namely, in (\ref{eq:affine_mappings}), the slope and bias constants for the $i$-th location become conditionally independent of $Z_i$ given $\mathbf{Z}^{-i}$ (due to the independence of noise and no stochastic assumption on $\mathbf{x}$). Now, to simplify the notation, we use $a_i$ and $b_i$ to denote $a(\mathbf{Z}^{-i})$ and $b(\mathbf{Z}^{-i})$, respectively. Furthermore, we denote $\mathbf{a}\in\mathbb{R}^d$ and $\mathbf{b}\in\mathbb{R}^d$ as vectorized slope and bias constants, hence, we can also express $\hat{\mathbf{x}}(\mathbf{Z})=\mathbf{a}\odot \mathbf{Z}+\mathbf{b}$, in which $\odot$ stands for the element-wise multiplication.

Using the conditional independence property, \cite{cha2018neural} devised an unbiased estimate of MSE for (\ref{eq:affine_mappings}) in the additive noise case, i.e.,
\begin{align}
    \mathbf{L}_{\text{add}}(\mathbf{Z},(a_i,b_i);\sigma^2) = (Z_i-\hat{x}_i(\mathbf{Z}))^2+\sigma^2(2a_i-1),\label{eq:additive esimate}
\end{align}
which is shown to satisfy
\begin{align}
&\mathbb{E}_{Z_i}\big[(x_i-\hat{x}_i(\mathbf{Z}))^2|\mathbf{Z}^{-i}\big] \nonumber \\
&=\mathbb{E}_{Z_i}\big[\mathbf{L}_{\text{add}}(\mathbf{Z},(a_i,b_i);\sigma^2) |\mathbf{Z}^{-i}\big].\label{eq:additive unbiased}
\end{align}
With above property, N-AIDE used fully-connected neural network to output $a_i$ and $b_i$ based on $\mathbf{C}_{k\times k}^{-i}$, the $k\times k$ two dimensional context patch with a hole at location $i$. The network parameters of N-AIDE were trained first by supervised training using the regular MSE and a separate supervised training set, then by adaptive fine-tuning using (\ref{eq:additive esimate}) and a given noisy image.

\begin{figure*}[ht]
    \centering
    \begin{subfigure}[b]{0.95\textwidth}
        \includegraphics[width=\textwidth]{Figures_fw_a2.pdf}
        \caption{An overall architecture of DoPAMINE.}
    \end{subfigure}

    \begin{subfigure}[b]{0.28\textwidth}
        \includegraphics[width=\textwidth]{Figures_fw_b2.pdf}
        \caption{A LU Conv 1 block.}
    \end{subfigure}
        \begin{subfigure}[b]{0.36\textwidth}
        \includegraphics[width=\textwidth]{Figures_fw_c2.pdf}
        \caption{A LU Conv 2 block. It repeated 20 times.}
    \end{subfigure}
        \begin{subfigure}[b]{0.30\textwidth}
        \includegraphics[width=\textwidth]{Figures_fw_d2.pdf}
        \caption{Receptive field of horizontal stack.}
    \end{subfigure}
    \caption{Full representation for DoPAMINE model. Best viewed in color.}
    \label{fig:DoPAMINE}
\end{figure*}

\section{Proposed Method}
\subsection{Unbiased estimator of MSE for multiplicative noise}

Following N-AIDE, we obtain the following lemma for the multiplicative noise case.

\begin{lemma}
For the affine mapping $\hat{x}_i(\mathbf{Z})$ defined in (\ref{eq:affine_mappings}) and the multiplicative noise case in (\ref{eq:mult_noise}),
\begin{align}
    \mathbf{L}_{\text{mult}}(\mathbf{Z},(a_i,b_i);\sigma^2) = (Z_i-\hat{x}_i(\mathbf{Z}))^2+\frac{Z_i^2\sigma^2}{1+\sigma^2}(2a_i-1)\label{eq:multiplicative esimate}
\end{align}
becomes an unbiased estimate of MSE, $(x_i-\hat{x}_i(\mathbf{Z}))^2$.
\end{lemma}
\emph{Proof:} The proof follows from the conditional independence of $(a_i,b_i)$ and $Z_i$ given $\mathbf{Z}^{-i}$. \qed

Given (\ref{eq:multiplicative esimate}), the training process of a neural network follows that of N-AIDE. Namely, assuming the noise distribution is known, as is the case in other despeckling algorithms, we first generate a supervised training dataset that contains both clean and multiplicative noise-corrupted images. Then, we define a neural network that outputs $a_i$ and $b_i$ for the input $\mathbf{C}_{k\times k}^{-i}$ and train its parameters with the supervised training set and the MSE loss function. The specific architecture of our neural network is given in the following section. After the supervised training, given a noisy image $\mathbf{Z}\in\mathbb{R}^d$ subject to despeckling, we define the  adaptive loss function as
\begin{align}
    \mathcal{L}_{\text{FT}}(\mathbf{Z},\sigma)\triangleq \frac{1}{d}\sum_{i=1}^d\mathbf{L}_{\text{mult}}(\mathbf{Z},(a_i,b_i);\sigma^2)\label{eq:fine_tune_loss}
\end{align}
to fine-tune the network parameters by minimizing it. As in N-AIDE, such fine-tuning achieves strong adaptivity of our method, which we highlight in the experimental section. Furthermore, in order to strengthen the adaptivity, we also define the data augmented fine-tuning (AFT) loss as in \cite[Section 3.2]{cha2018fully},
\begin{align}
    \mathcal{L}_{\text{AFT}}(\mathbf{Z},\sigma) = \frac{1}{8}\sum_{\mathbf{Z}^{(j)}\in\mathcal{A}(\mathbf{Z})}\mathcal{L}_{\text{FT}}(\mathbf{Z}^{(j)},\sigma),\label{eq:aft_loss}
\end{align}
in which $\mathcal{A}(\mathbf{Z})$ stands for the augmented dataset that consists of flipped and $(0^{\circ},90^{\circ},180^{\circ},270^{\circ})$-degrees rotated versions of $\mathbf{Z}$. Once the fine-tuning process is done, the noisy image $\mathbf{Z}$ is then despeckled by applying the learned affine mapping $(a_i,b_i)$ for each location.

\noindent\emph{Remarks:}
Although we are using the same pixelwise affine function form (\ref{eq:affine_mappings}) and the framework of N-AIDE, comparing (\ref{eq:multiplicative esimate}) with (\ref{eq:additive esimate}) clearly shows how the affine mappings are learned differently during fine-tuning for the multiplicative noise case compared to the additive noise case. Namely, in both estimators, we can interpret the second terms in (\ref{eq:multiplicative esimate}) and (\ref{eq:additive esimate}) as some sort of regularizations on the slope parameter $a_i$. That is, while the first squared error term will be minimized with $a_i=1$ and $b_i=0$, due to the existence of the second term, $a_i$ should shrink and the residual, $(1-a_i)Z_i$, would be corrected with $b_i$. Now, we see that the ``effective'' regularization parameter in (\ref{eq:additive esimate}) is fixed to a constant $\sigma^2$ for all $i$, whereas in (\ref{eq:multiplicative esimate}), it depends on $Z_i^2$. Hence, for the pixels with large $Z_i^2$ values, our model should output smaller slope parameter $a_i$ to minimize $\mathbf{L}_{\text{mult}}(\mathbf{Z},(a_i,b_i);\sigma^2)$ than the pixels with small $Z_i^2$ values, and vice versa. Note this tendency makes perfect sense for the multiplicative noise despeckling. Namely, since the noise gets multiplied to the original $x_i$ as in (\ref{eq:mult_noise}), the noise level may amplify significantly to result in very large $Z_i$ when $x_i$ has high intensity and $N_i>1$. In such case, it is reasonable to suppress the noise effect by shrinking $a_i$ and make the corrections with the bias term $b_i$ to accurately estimate $x_i$. In our experimental results below, we show how the learned $a_i$ and $b_i$ vary depending on the intensity of $Z_i$'s and how our adaptive fine-tuning makes corrections to achieve better despecklings.

\begin{table*}[ht]
    \centering
    \caption{PSNR and SSIM on UCML dataset.}
    \begin{tabular}{|c|*{4}{|c}|}
    \hline
\multirow{2}{*}{Model} & L=1.0 & L=2.0 & L=4.0 & L=8.0 \\ \cline{2-5}
                 & PSNR(dB) / SSIM & PSNR(dB) / SSIM & PSNR(dB) / SSIM & PSNR(dB) / SSIM \\ \hline
Noise image         & 5.763 / 0.073 & 8.773 / 0.118 & 11.785 / 0.178 & 14.795 / 0.253\\ \hline
SAR-DRN$_{S}$\cite{zhang2018learning}      & 22.86 / 0.738 & 24.189 / 0.780 & 25.664 / 0.823 & 27.191 / 0.861\\ \hline
SAR-DRN$_{B}$     & 22.746 / 0.732 & 24.151 / 0.778 & 25.583 / 0.821 & 27.057 / 0.857\\ \hline
DoPAMINE$_{S}$     & 22.957 / 0.743 & 24.329 / 0.786 & 25.767 / 0.826 & 27.268 / 0.863\\ \hline
DoPAMINE$_{S-AFT}$ & \textbf{23.308} / \textbf{0.756} & \textbf{24.701} / \textbf{0.798} & \textbf{26.123}  / \textbf{0.837} & \textbf{27.623} / \textbf{0.871}\\ \hline
DoPAMINE$_{B}$     & 22.909 / 0.739 & 24.291 / 0.782 & 25.694 / 0.822 & 27.159 / 0.859\\ \hline
DoPAMINE$_{B-AFT}$ & 23.293 / 0.755 & 24.678 / 0.797 & 26.103 / 0.836 & 27.593 / 0.870\\ \hline
    \end{tabular}
    \label{tab:PSNR}
\end{table*}

\subsection{DoPAMINE architecture}

As we mentioned in (\ref{eq:affine_mappings}), the main critical constraint that ensures the unbiasedness of (\ref{eq:multiplicative esimate}) is that for every pixel $i$, the $a_i$ and $b_i$ should be conditionally independent of $Z_i$ given $\mathbf{Z}^{-i}$. In N-AIDE \cite{cha2018neural}, a fully connected neural network was used, but due to the architectural simplicity, it could not outperform other deep learning baselines (which do not possess the adaptivity) that use convolutional architectures. Recently, in \cite{cha2018fully}, a nontrivial extension that uses fully \emph{convolutional} architecture was proposed and the resulting algorithm was shown to outperform several strong CNN-based state-of-the-arts for the additive noise case. The main challenge of using the fully convolutional architecture is that when a vanilla architecture, e.g., FCN \cite{long2015fully}, is used, the $i$-th pixel in a feature map may depend on $Z_i$, which would result in breaking the critical constraint mentioned above.

Here, we independently propose another fully convolutional architecture, DoPAMINE, that is summarized in Figure \ref{fig:DoPAMINE}. Two key ingredients of our architecture are the LU convolution, which is inspired by the PixelCNN \cite{van2016conditional}, and the scale add layer, which is simple but very effective in expediting the training of CNN models with many addition operations among the feature maps, like ResNet \cite{he2016deep}.

\subsubsection{LU Convolution}
The PixelCNN in \cite{van2016conditional} was developed as a generative model that can sequentially and conditionally generate images. The main gist in their model was to devise a masked convolution architecture that can generate each pixel conditioned on the pixels that has ``causal'' relationship with the pixel. In contrast, in our despeckling problem, we are not directly generating the reconstruction for pixel $i$, but are estimating $a_i$ and $b_i$ for the affine mapping, and the estimation is based on the ``double-sided, non-causal'' context of the pixel.

Hence, as shown in Figure \ref{fig:DoPAMINE}(a), we adopt the masked convolution architecture of PixelCNN twice in each layer $\ell$ to cover both the causal part (LU convolution) and the anti-causal part (RD convolution) for each pixel $i$. We then ``scale add'' (denoted as $\sqrt{+}$) the two feature maps from LU and RD convolutions to generate the resulting feature map $S_{\ell}$. By this construction,
one can see that any pixel $i$ on $S_{\ell}$ does not depend on $Z_i$ and is computed only based on the double-sided context (with corresponding receptive field) of $Z_i$.
Once we obtain $S_{\ell}$, we then repeatedly stack the LU and RD convolution layers up to $\ell=21$.
Now, since the RD convolution is just a $180^{\circ}$ rotated version of LU convolution, we just elaborate on the LU convolution more in details below.

As shown in Figure \ref{fig:DoPAMINE}(b)(c), the structure of LU convolution for layer 1 and layers $\ell=2\sim21$ are different. In LU Conv 1, the masked $1\times 3$ and $1\times 1$ filters are used to generate the horizontal stack feature map, $H_{1}^{LU}$, of which receptive field of the $i$-th pixel is given in Figure \ref{fig:DoPAMINE}(d). Note the ``scale add'' was also used to combine the feature maps from the two filters. The LU Conv 2 then uses differently masked filters such that the ``causal'' receptive fields can grow as layer increases as depicted in Figure \ref{fig:DoPAMINE}. The RD Conv Layers operates in the same way, hence, the final receptive field of a pixel in $S_{21}$ is $43\times43$.

Finally, we ``scale add'' all the feature maps from all the layers before passing them through the ResNet block depicted in Figure \ref{fig:DoPAMINE}. While PixelCNN only uses the last horizontal stack, we chose to directly use all the feature maps to use the low level features in our despeckling problem.

\subsubsection{Scale add layer}
He initialization \cite{he2015delving} and Batch Normalization (BN) \cite{ioffe2015batch} are widely used practice to accelerate training speed by good initialization and reducing covariate shift.
However, both methods also have some drawbacks. Namely, He initialization turns out to be disharmonious with addition layer, since it may significantly increase the variance of the resulting feature maps. This could be problematic in modern CNN architectures that have many addition layers among feature maps, \emph{e.g.}, ResNet \cite{he2016deep} or DenseNet \cite{huang2017densely}, as it may hinder fast training of the network. Moreover, batch normalization requires additional memory, and it is known to be not proper for non-i.i.d. or small sized mini-batches \cite{ioffe2017batch}. In addition, in standard models for pixel-wise reconstruction problems, \textit{e.g.}, FCN, PixelCNN and WaveNet\cite{van2016wavenet}, the batch normalization does not show as significant improvements as in the classification problems.

To address above drawbacks, we propose a simple \emph{scale add layer}, which can replace addition layers while preserving the variances of feature maps without introducing any additional parameters, memory, and batch statistics, as in batch normalization.
We denote $N$ number of feature maps as $\{\mathbf{Y}_i\}_{i=1}^N$. Then, the scale add layer, $SA$, is defined as:
\begin{align}
SA(\mathbf{Y}_1, \mathbf{Y}_2, ..., \mathbf{Y}_N) = \frac{1}{\sqrt{N}}\sum_{i=1}^N \mathbf{Y}_i.
\end{align}
With this simple scaling, reminiscent of the motivations of He and Xavier initialization, $SA$ equalizes the input and output feature map variances, while a simple addition layer will increase variance $N$ times.
Note if there are $L$ addition layers, then the order of variance for the final layer's feature map becomes $N^L$ \cite{he2015delving}.
In contrast, by assuming $Var[\mathbf{Y_i}]\approx C$  for all $i$ and all the feature maps are uncorrelated, the output variance of $SA$ can be calculated as:
\begin{align*}
&\text{Var}[SA(\mathbf{Y}_1, \mathbf{Y}_2, ..., \mathbf{Y}_N)] \\
& = \text{Var}[\frac{1}{\sqrt{N}}(\sum_{i=1}^N \mathbf{Y}_i)] \approx \frac{1}{N}\sum_{i=1}^N \text{Var}[\mathbf{Y_i}] = C.
\end{align*}
Thus, when combined with He initialization, which is known to control the variances of feature maps from ReLU activated convolution layers, one can see that the simple $SA$ can maintain the variance of the feature maps resulting from any number of additions. In the experimental section, we convincingly show this point.

\begin{figure*}[ht]
    \centering
    \makebox[20pt]{\raisebox{40pt}{\rotatebox[origin=c]{90}{Flevoland}}}%
    \begin{subfigure}[b]{0.18\textwidth}
        \includegraphics[width=\textwidth]{Figure_sar_RealSAR_Z_0.png}
        \caption{Noise image}
    \end{subfigure}
    \begin{subfigure}[b]{0.18\textwidth}
        \includegraphics[width=\textwidth]{Figure_sar_sar-drn.png}
        \caption{SAR-DRN$_S$}
    \end{subfigure}
    \begin{subfigure}[b]{0.18\textwidth}
        \includegraphics[width=\textwidth]{Figure_sar_dop_SL.png}
        \caption{DoPAMINE$_S$}
    \end{subfigure}
    \begin{subfigure}[b]{0.18\textwidth}
        \includegraphics[width=\textwidth]{Figure_sar_dop_B.png}
        \caption{DoPAMINE$_B$}
    \end{subfigure}
    \begin{subfigure}[b]{0.18\textwidth}
        \includegraphics[width=\textwidth]{Figure_sar_dop_AFT.png}
        \caption{DoPAMINE$_{B-AFT}$}
    \end{subfigure}

    \caption{Noise and despeckled Flevoland images. We trained supervised model with $L=4$, which is same as the number of look of image.}
    \label{fig:realSar}
\end{figure*}

\begin{table*}[ht]
    \centering
    \caption{ENL of noise image and despeckled images.}
\begin{tabular}{|c|*{8}{|c}||c|}
\hline
Model              & ENL1           & ENL2           & ENL3           & ENL4            & ENL5           & ENL6           & ENL7          & ENL8          & Avg            \\ \hline
Noise image        & 5.3            & 11.0           & 11.9            & 7.4            & 3.6            & 2.2           & 13.4           & 1.7           & 7.1            \\ \hline
DoPAMINE$_{S}$     & 34.8           & \textbf{573.7} & \textbf{1351.6} & 260.0          & 14.6           & 5.1           & \textbf{885.2} & 3.7           & 391.1          \\ \hline
DoPAMINE$_B$       & 23.6           & 120.7          & 131.3           & 44.0           & 23.2           & 12.0          & 226.5          & 11.5          & 74.1           \\ \hline
SAR-DRN$_{S}$      & 62.4           & 518.5          & 1284.3          & \textbf{476.2} & 15.6           & 4.5           & 689.1          & 3.2           & 381.7          \\ \hline
SAR-DRN$_B$        & 19.0           & 83.4           & 73.6            & 37.1           & 13.3           & 5.8           & 130.7          & 5.9           & 46.1           \\ \hline
DoPAMINE$_{B-AFT}$ & \textbf{142.5} & 531.0          & 1258.4          & 412.5          & \textbf{141.8} & \textbf{36.0} & 793.2          & \textbf{32.0} & \textbf{418.4} \\ \hline
\end{tabular}
    \label{tab:ENL}
\end{table*}

\section{Experiment}
\subsection{Benchmark dataset}
\subsubsection{Training detail}
We use UC Merced Land use dataset (UCML) \cite{yang2010bag} to train and test our model. The dataset contains 21 classes, and each class has 100 images with the resolution of $256\times256$. We chose the Airplane, River, and Building classes as our test set. For the supervised training set, we randomly sampled 400 images from the remaining 18 classes. Then, we cropped the images to 40$\times$40 patch size with stride 10, so that the total number of image patches in the supervised training set is 193,600. The batch size of supervised learning ($S$) and data augmented fine tuning ($AFT$) were 64 and 1, respectively. In contrast to $S$, we put full 256$\times$256 resolution of image during $AFT$.
The number of filters in each convolution layer of DoPAMINE was 64, except for last convolution layer that has two $1\times 1$ filters. Learning rate for $S$ was initially set to $10^{-3}$ and got halved for every 10 epochs. Learning rate for $AFT$ was $1.2\times10^{-5}$. The number of epochs for $S$ and $AFT$ were 30 and 10, respectively.

For generating the multiplicative noise, we used the Gamma distribution parameterized by $L$, which has the following density function
\begin{align*}
    p_{N_i}(n_i) = \frac{L^Ln_i^{L-1}e^{-n_i L}}{\Gamma(L)}.
\end{align*}
Note $E[N_i]$ and $Var[N_i]$ are $1$ and $1/L$, respectively. We tested on the benchmark dataset with four noise levels, $L=1,2,4,$ and $8$.
To avoid overfitting, we did the noise-augmented training during supervised learning, namely, randomly generated $N_i$ for every epoch and constructed new realization of noisy patches. Adam optimizer\cite{kingma2014adam} is used for both $S$ and $AFT$. Our model is implemented by Keras with Tensorflow backend, and trained on NVIDIA GTX 1080Ti with CUDA 9.2.

\subsubsection{Blind model}
In addition to the ordinary supervised model for each noise level, we also train a Blind model, of which weights are trained with various noise variances. Such blindly trained supervised model was first proposed in \cite{zhang2017beyond}. For training the blind model, we split cropped training images such that each group has 121 cropped images. Then, we generated different Gamma distributions for each group with $L$ sampled from  $U[0.5,12]$ to generate training data with multiple noise levels. We then shuffled all the images before training and carried out the ordinary mini-batch training with Adam.

Such blindly trained model is well-known to be robust to multiple noise levels. In our experimental results below, we show that when combined with the adaptive fine-tuning step, the blind model can be made as strong as the supervised model matched to a specific noise level.

\subsubsection{Metrics}
We use PSNR and SSIM, commonly used metrics, to evaluate the despeckling performances. The PSNR between $\textbf{x}\in[0,1]^d$ and $\mathbf{\hat{x}}$ is defined by:
\begin{align*}
    PSNR(\mathbf{x}, \mathbf{\hat{x}}) = 10 \log_{10} \frac{1}{\sum_{i=1}^d (x_i-\hat{x}_i)^2/d}
\end{align*}
Since the denominator is MSE between $\textbf{x}$ and $\mathbf{\hat{x}}$, the higher PSNR, the better.

Structural similarity, SSIM, is another metric defined as
\begin{align*}
    SSIM(\mathbf{x}, \mathbf{\hat{x}}) = \frac{(2\mu_x\mu_{\hat{x}}+c_1)(2\sigma_{x{\hat{x}}}+c_2)}{(\mu_x^2+\mu_{\hat{x}}^2+c_1)(\sigma_x^2+\sigma_{\hat{x}}^2+c_2)}
\end{align*}
and is designed to cover the weakness of PSNR, which is known to be sensitive to shift or brightness of the images

\begin{figure*}[ht]
    \centering
    \begin{subfigure}[t]{0.305\textwidth}
        \includegraphics[width=\textwidth]{Figures_variance_propagation.pdf}
        \caption{Initial variance of each conv layer in ResNet20 for Gaussian input.}
    \end{subfigure}
    \begin{subfigure}[t]{0.33\textwidth}
        \includegraphics[width=\textwidth]{Figures_convergence_DoPAMINE.pdf}
        \caption{The comparison of DoPAMINE\_SA and DoPAMINE\_Add\_BN on UCML dataset.}
    \end{subfigure}
    \centering
    \begin{subfigure}[t]{0.32\textwidth}
        \includegraphics[width=\textwidth]{Figures_ablation_1x1conv.pdf}
        \caption{Existence of ResNet blocks.}
    \end{subfigure}

    \begin{subfigure}[t]{0.32\textwidth}
        \includegraphics[width=\textwidth]{Figures_ablation_ABvsB.pdf}
        \caption{Affine mapping}
    \end{subfigure}
    \begin{subfigure}[t]{0.32\textwidth}
        \includegraphics[width=\textwidth]{Figures_ablation_FTvsAFT.pdf}
        \caption{Fine tuning and \textit{AFT}.}
    \end{subfigure}
    \caption{Results of Ablation study. The experiment setting is the same as benchmark experiment with $L=1.0$.}
    \label{fig:ablation}
\end{figure*}

\subsubsection{Results}
Table \ref{tab:PSNR} is the PSNR and SSIM results on the UCML test dataset. SAR-DRN \cite{zhang2018learning} is a state-of-the-art baseline model in despeckling that predicts residual $\mathbf{Z}-\mathbf{x}$ before doing despeckling. It is constructed by 7 dilated convolution layers and skip connections. We reproduced this model and compared with DoPAMINE. The subscript $_S$, $_B$, and $_{-AFT}$ represent supervised, blind, and the data augmented fine tuning ($AFT$), respectively.

From the table, we first note that the supervised models of DoPAMINE, DoPAMINE$_S$ and DoPAMINE$_B$, always outperforms SAR-DRN$_S$ and SAR-DRN$_B$, respectively, for all $L$, which shows the superiority of our network architecture for the supervised training. Second, we note DoPAMINE$_{S-AFT}$ achieved another gain of 0.3$\sim$0.4$dB$ over DoPAMINE$_S$, which shows the effectiveness and adaptivity of the fine-tuning step. Third, while the performance of DoPAMINE$_B$ is worse than that of DoPAMINE$_S$, we note the AFT of those blind models makes the final model DoPAMINE$_{B-AFT}$ perform almost as well as DoPAMINE$_{S-AFT}$. The implication of this result is the following: in order to attain high denoising performance for various noise levels, we just need to maintain a \emph{single} Blind supervised model as long as fine-tuning with the correct noise variance is possible. Note this approach is much more efficient and powerful than keeping separate supervised model for each noise level or just maintaining a blind model that cannot adapt to specific noise models, like SAR-DRN$_B$.

\subsection{Real SAR image}
In addition to the experiments on the benchmark dataset, we also despeckled real-world SAR-obtained images with 4 number of looks: Death Valley, Flevoland, and San Francisco Bay. These are also widely used benchmark images for SAR despeckling \cite{zhang2018learning}. We only report the result for Flevoland image with $512\times512$ resolution due to space limit.

In the real SAR images, the underlying clean $\textbf{x}$ is not available, hence PSNR or SSIM cannot be computed. Instead, Equivalent Number of Look (ENL) is one of the widely used metrics for the real SAR image despeckling \cite{argenti2013tutorial}. ENL is defined as
\begin{align}
    ENL = \frac{\mathbb{E}[\mathbf{\hat{X}}]^2}{\text{Var}[\hat{\mathbf{X}}]}\label{eq:enl}
\end{align}
and is typically evaluated in homogeneous areas. Note in (\ref{eq:enl}), the variance term is in the denominator, hence, the higher the ENL, the more homogeneous the area is.
However, (\ref{eq:enl}) is not an absolute metric since despeckling models typically have trade-offs between homogeneity and sharpness, namely, models with high ENL often tend to generate blurred images. Therefore, it is also important to visually verify the despeckled images.

\begin{figure*}[ht]
    \centering
    \makebox[20pt]{\raisebox{50pt}{\rotatebox[origin=c]{0}{$\textbf{a}$}}}%
    \begin{subfigure}[b]{0.11\textwidth}
        \includegraphics[width=\textwidth]{Figure_Ablation_test00.png}
        \caption{}
    \end{subfigure}
    \begin{subfigure}[b]{0.11\textwidth}
        \includegraphics[width=\textwidth]{Figure_Ablation_test30.png}
        \caption{}
    \end{subfigure}
    \begin{subfigure}[b]{0.11\textwidth}
        \includegraphics[width=\textwidth]{Figure_Ablation_test40.png}
        \caption{}
    \end{subfigure}
    \begin{subfigure}[b]{0.11\textwidth}
        \includegraphics[width=\textwidth]{Figure_Ablation_testAFT_A.png}
        \caption{}
    \end{subfigure}
    \makebox[20pt]{\raisebox{50pt}{\rotatebox[origin=c]{0}{$\textbf{b}$}}}%
    \begin{subfigure}[b]{0.11\textwidth}
        \includegraphics[width=\textwidth]{Figure_Ablation_test01.png}
        \caption{}
    \end{subfigure}
    \begin{subfigure}[b]{0.11\textwidth}
        \includegraphics[width=\textwidth]{Figure_Ablation_test31.png}
        \caption{}
    \end{subfigure}
    \begin{subfigure}[b]{0.11\textwidth}
        \includegraphics[width=\textwidth]{Figure_Ablation_test41.png}
        \caption{}
    \end{subfigure}
    \begin{subfigure}[b]{0.11\textwidth}
        \includegraphics[width=\textwidth]{Figure_Ablation_testAFT_B.png}
        \caption{}
    \end{subfigure}
    \caption{Visualization of $\textbf{a}$ and $\textbf{b}$ of DoPAMINE for Flevoland image. From left to right, DoPAMINE$_S$ trained by $L=1.0$, DoPAMINE$_S$ trained by $L=8.0$, DoPAMINE$_B$, and DoPAMINE$_{B-AFT}$ with $L=0.5$ for fine-tuning. }
    \label{fig:AandB}
\end{figure*}

\subsubsection{Results}
Figure \ref{fig:realSar} and Table \ref{tab:ENL} are the results of despeckled Flevoland.
In Table \ref{tab:ENL}, ENL 1 to 8 correspond to the ENL values on the regions marked with red boxes in Figure \ref{fig:realSar}(a). For supervised models, we used the models with $L=4$ for both SAR-DRN$_S$ and DoPAMINE$_S$, since the number of looks for the image was 4. For DoPAMINE$_{B-AFT}$, we set $L=0.5$, learning rate to $8\times 10^{-6}$, and the number of epochs to 6 for carrying out the fine-tuning.

In Table \ref{tab:ENL}, we observe that DoPAMINE$_{B-AFT}$ achieves the highest average ENL values compared to others. Note the ENL values for  DoPAMINE$_{B}$ is very low, but the AFT step improves the metric significantly and surpasses that of SAR-DRN$_S$. Figure \ref{fig:realSar} visualizes the despeckling results of comparing methods in Table \ref{tab:ENL}. We first observe that SAR-DRN$_S$ is more blurred than other images, especially left above region, which shows that high ENL values do not always translate to good despeckling quality in all image regions. In contrast, we can see that DoPAMINE$_B$ generates much sharper images than SAR-DRN$_S$ or DoPAMINE$_S$. However, it contains black spots in both dark and bright regions, while other models tend to contain black spots only in the dark regions. When checking the despeckling results on the benchmark dataset, we noticed that black spots typically occurs when $\sigma$ of the training set is smaller than that of the test image. Motivated by this, for DoPAMINE$_{B-AFT}$, we used smaller $L$ (\emph{i.e.}, larger $\sigma$) in the AFT loss (\ref{eq:aft_loss}), and the resulting image is given in Figure \ref{fig:realSar}(e). We can see from the figure that most of the black spots are now removed, while preserving the details and sharpness of the image. The magnified red box shows the difference of the despeckling more closely. We can clearly observe the quality of our DoPAMINE$_{B-AFT}$ is superior to other methods, showing the power of our method that can adaptively calibrate the image qualities by choosing appropriate $L$. Note that this is a unique property of DoPAMINE, as other deep learning based method cannot adapt to the noisy image.

\subsection{Ablation study}

\subsubsection{Scale add layer}
To validate the effectiveness of the scale add layer (SA), we carried out two experiments. In Figure \ref{fig:ablation}(a), we tested with widely used ResNet20 architecture to show the generality of our SA. The figure represents initial variance of the feature maps after each convolution layer of ResNet20 models, when the input to the network was standard zero mean Gaussian and the weights were initialized with the He initialization \cite{he2016deep}. Note ordinary ResNet20 architecture has many addition layers due to the skip connections. ResNet20-SA is the model with the same architecture, but with addition layer replaced with SA. Vanilla CNN is the model that does not have skip connections, hence it has no addition layers. From the figure, we clearly observe that He initialization alone is not enough to control the variances of the feature maps when there are many addition layers (or skip connections) in the architecture, since the variance of ResNet20 keeps exponentially increasing as the layer increases. Note for Vanilla CNN, the variance is kept to be constant, as expected with the He initialization. In contrast, we note ResNet20-SA still maintains the constant variance even though there are many skip-connections, since the SA re-scales the feature map so that the variance is controlled. This property suggests that the training of the network with SA may be accelerated compared to the one without it. Figure \ref{fig:ablation}(b) confirms such result and shows that our DoPAMINE$_S$ with SA is more stable and achieves high PSNR faster than the one with ordinary addition layer with batch normalization. In this case, when only the addition layer was used, the PSNR was too low to show in the same figure.

\subsubsection{ResNet blocks and training choices}
Figure \ref{fig:ablation}(c) shows the PSNR results of DoPAMINE$_S$ model with and without the final ResNet block shown in Figure \ref{fig:DoPAMINE}. We note the model with the ResNet block outperforms the one without it, which justifies our choice of the architecture.

Figure \ref{fig:ablation}(d) compares the models with and without the $a_i$ term in output of the network. Namely, the model without $a_i$ simply reconstructs $x_i$ only with the bias term $b_i$, hence, it does not use the noisy pixel $Z_i$. The curves in Figure \ref{fig:ablation}(d) that only have subscript `B' stand for those models. The figure shows both the supervised-only and fine-tuning results and confirms the necessity of using the slope parameter $a_i$ for learning the pixel-wise despeckling mappings.

Figure \ref{fig:ablation}(e) compared the PSNR of $FT$ and $AFT$ on DoPAMINE. We see the maximum PSNR of $AFT$ is 0.3$dB$ higher than $FT$, and this is in line with the findings in \cite{cha2018fully}. This result also show that the performance of $FT$ and $AFT$ is robust to epochs around 5 to 15.

\subsubsection{Visualization of $\textbf{a}$ and $\textbf{b}$}
Figure \ref{fig:AandB} visualizes the coefficients of the affine mappings, $\textbf{a}$ and $\textbf{b}$, for several variations of DoPAMINE. Note that Figure \ref{fig:AandB}(d),(h) are the $\textbf{a}$ and $\textbf{b}$ of the model for Figure \ref{fig:realSar}(e).
We can see that if
$\textbf{a}$ tends to have low values, $\textbf{b}$ become more homogeneous, but it loses sharpness. In contrast, if $\textbf{a}$ tends to have  high values, $\textbf{b}$ gets sharper, but it loses homogeneity.
Hence, we can say that the values that $\textbf{a}$ take determines the sharpness or homogeneity of an image.
Next, we describe how $\textbf{a}$ and $\textbf{b}$ are changed during $AFT$.
According to equation (5), $Z_i$ and $\sigma$ acts as effective regularization constant for $a_i$. We cannot control $Z_i$, however, by changing $\sigma$, we can control the values that $a_i$ takes. As a result, by adjusting $\sigma$, we can determine the amount of sharpness or homogeneity of the despeckled image.

\section{Concluding remarks}

In this paper, we showed that our DoPAMINE framework has an ability to fine-tune and outperforms the state-of-the-art model on both benchmark and real images.
There are several extendable future approaches. First, more complex mapping functions and their unbiased estimators can be derived. Second, we are going to check whether our framework can be applied to other domains, such as medical image despeckling.

\section*{Acknowledgments}

This work is supported in part by the Basic Science Research
Program through the National Research Foundation of
Korea [NRF-2016R1C1B2012170], by the ICT R\&D program
of MSIT/IITP [2016-0-00563], and by the ITRC support program  of MSIT/IITP [IITP-2018-0-01798].


\section{\bf Introduction and notations}

In the field of additive combinatorics a popular topic is to compare the densities of different sets (of, say, positive integers). The well-known theorem of Kneser  gives a description of the sets $A$ having lower density $\alpha$ such that the density of $A+A:=\{a+b\,:\, a,b\in A\}$ is less than $2\alpha$ (see for instance \cite{RO}). The analogous question with the product set $A^2:=\{ab\,:\, a,b\in A\}$ is apparently more complicated.

For any set $A\subset \mathbb{N}$ of natural numbers, we define the lower asymptotic density $\underline{\d}A$, the upper asymptotic density
$\overline{\d}A$ and the asymptotic density $\d A$ in the natural way:
$$
\underline{\mathbf{d}}A= \liminf_{n\to\infty}\frac{|A\cap[1,n]|}{n},
\quad
\overline{\mathbf{d}}A= \limsup_{n\to\infty}\frac{|A\cap[1,n]|}{n}
$$
known as the lower and upper asymptotic densities.
If the two values coincide, then we denote by $\mathbf{d}A$ the common value and call it the \textit{asymptotic density} of $A$.

Throughout the paper $\mathbb{N}$ denotes the set of positive integers and $\mathbb{N}_0:=\mathbb{N}\cup \{0\}$. We will use the notion
$A(x)=\{n\in A: n\leq x\}$ for $A\subseteq \mathbb{N}$ and $x\in \mathbb{R}$. For functions $f,g:\mathbb{N}\to \mathbb{R}_+$ we write $f=O(g)$ (or $f\ll g$), if there exists some $c>0$ such that $f(n) \leq cg(n)$ for large enough $n$.

In Section 2 we investigate the connection between the (upper-, lower-, and asymptotic) density of a set of integers and the density of its sumset. In Section 3 we give a partial answer to a question of Erd\H os by giving a necessary condition for the existence of the asymptotic density of the set of subset sums of a given set of integers.
Finally, in Section 4 we consider analogous problems for product sets.

\section{\bf Density of sumsets}

 For subsets $A,B$ of an additive monoid $G$,
the sumset $A+B$ is defined to be the set of all
sums $a+b$ with $a\in A$, $b\in B$. For $G=(\mathbb{N}_0,+)$ the following clearly hold:
\begin{align*}
\underline{\d}A&\le\overline{\d}A,\\
\underline{\d}A&\le\underline{\d}(A+A),\\
\overline{\d}A&\le\overline{\d}(A+A).
\end{align*}

\smallskip
We shall assume that our sets $A$ are normalized in the sense that $A$ contains $0$
and $\gcd(A)=1$.

First observe that there exists a set of integers $A$ not having an asymptotic density
such that its sumset $A+A$ has a density:
for instance $A=\{0\}\cup\bigcup_{n\ge0}[2^{2n},2^{2n+1}]$ has lower density $1/3$, upper density $2/3$
and its sumset $A+A$ has density $1$, since it contains every nonnegative integer.
For this kind of sets $A$, we denote
respectively
\begin{align*}
\underline{\d}A&=:\alpha_A,\\
\overline{\d}A&=:\beta_A,\\
\d(A+A)&=:\gamma_A,\\
(\alpha_A,\beta_A,\gamma_A)&=:p_A,
\end{align*}
and we have
$$
\alpha_A \le \beta_A \le \gamma_A.
$$
The first question arising from this is to decide whether or not for any
$p=(\alpha,\beta,\gamma)$ such that $0\leq \alpha\le \beta \le \gamma\leq 1$ there exists
a set $A$ of integers such that $p=p_A$. This question has no positive answer in general, though the following
weaker statement holds.

\begin{prop}\label{p1}
Let $0\le \alpha\le 1$. There exists a normalized set $A\subset\mathbb{N}$ such that
$\d A=\alpha$ and $\d(A+A)=1$.
\end{prop}

\begin{proof}
 Let $0\in B$ be a thin additive basis, that is, a basis containing 0 and satisfying $|B(x)|=o(x)$ as $x\to\infty$. Now, let $A=B\cup\{\lfloor n/\alpha\rfloor,\ n\ge1\}$. Then $A$ is a normalized set satisfying
 $A+A=\mathbb{N}_0$ and $\d A=\alpha$.

 (Note that $B=\{0,1,2,\dots,\lfloor 1/\alpha \rfloor\}$ is also an appropriate choice for $B$.)
\end{proof}

\begin{remark}
We shall mention that  Faisant et al \cite{Fa} proved the following related result:  for any $0\le  \alpha \le 1$ and any positive integer $k$, there exists a sequence $A$ such that
 $\d (jA)= j\alpha /k$, $j=1,\dots,k$.
\end{remark}

After a conjecture stated by Pichorides,  the related question about the characterisation of the two-dimensional
domains $\{(\underline{\d}B,\overline{\d}B)\,:\, B\subset A\}$ has been solved
(see \cite {GG} and \cite{FH}).

\smallskip
Note that if the density   $\gamma_A$ exists, then $\alpha_A$, $\beta_A$ and $\gamma_A$  have to satisfy some strong conditions.
For instance, by Kneser's theorem, we know that if for some set $A$ we have $\gamma_A<2\alpha_A$,
then $A+A$ is, except possibly a finite number of elements, a union of
arithmetic progressions in $\mathbb{N}$ with the same difference. This implies that
$\gamma_A$ must be a rational number. From the same theorem of Kneser, we
also deduce that if $\gamma_A<3\alpha_A/2$, then $A+A$ is an arithmetic progression
from some point onward. It means that $\gamma_A$ is a unit fraction, hence $A$ contains
any sufficiently large integer, if we assume that $A$ is normalized.

Another strong connection between $\alpha_A$ and $\gamma_A$ can be deduced from
Freiman's theorem on the addition of sets (cf. \cite{Fr}). Namely, every normalized set $A$ satisfies
$$
\gamma_A\ge\frac{\alpha_A}{2}+\min\Big(\alpha_A,\frac12\Big).
$$

A related but more surprising statement is the following:

\begin{prop}\label{p3}
There is a set of positive integers for which $\d(A)$ does exist and $\d(A+A)$ does not exist.
\end{prop}

\begin{proof}
Let us take $U=\{0,2,3\}$ and $V=\{0,1,2\}$,
then observe that
$$
U+(U\cup V)=\{0,1,2,3,4,5,6\}\quad
V+(U\cup V)=\{0,1,2,3,4,5\}.
$$
Let $(N_k)_{k\ge 0}$ be a sufficiently quickly increasing sequence of integers with $N_0=0$, $N_1=1$,
and define $A$ by
$$
A=(U\cup V)\cup\bigcup_{k\ge1}\Big((U+7\mathbb{Z})\cap[7N_{2k},7N_{2k+1}]\cup (V+7\mathbb{Z})\cap[7N_{2k+1},7N_{2k+2}]\Big).
$$
Then $A$ has density $3/7$. Moreover, for any $k\ge0$
$$
[7N_{2k},7N_{2k+1}]\subset A+A,
$$
thus $\overline{\d}(A+A)=1$, if we assume $\lim_{k\to\infty}N_{k+1}/N_k=\infty$.

 \noindent
We also have
$$
(A+A)\cap [14N_{2k-1},7N_{2k}]=(\{0,1,2,3,4,5\}+7\mathbb{N})\cap
[14N_{2k-1},7N_{2k}],
$$
hence $\underline{\d}(A+A) = 6/7$ using again the assumption that  $\lim_{k\to\infty}N_{k+1}/N_k=\infty$.
\end{proof}

\medskip

For any set $A$ having a density, let
\begin{align*}
{\d}A&=:\alpha_A,\\
\underline{\d}(A+A)&=:\underline{\gamma}_A,\\
\overline{\d}(A+A)&=:\overline{\gamma}_A,\\
(\alpha_A,\underline{\gamma}_A,\overline{\gamma}_A)&=:q_A,
\end{align*}
then we have
$$
\alpha_A\le \underline{\gamma}_A\le \overline{\gamma}_A.
$$
A question similar to the one   asked for $p_A$ can be stated as follows: given $q=(\alpha, \underline{\gamma}, \overline{\gamma})$
such that $0\le \alpha\le \underline{\gamma}\le \overline{\gamma}\leq 1$, does there exist a set $A$ such that $q=q_A$ ?

\smallskip
We further mention an interesting question of Ruzsa: does there exist $0<\nu<1$ and a constant $c=c(\nu)>0$ such that for any set $A$ having a  density,
$$
\underline{\d}(A+A)\geq c\cdot (\overline{\d}(A+A))^{1-\nu} (\d A)^{\nu}\,?
$$
Ruzsa proved (unpublished) that in case of an affirmative answer, we  necessarily have $\nu\ge 1/2$.

\section{\bf Density of subset sums}

\medskip

Let $A=\{a_1 < a_2 < \cdots \}$ be a sequence of positive integers. Denote the set of all subset sums of $A$ by
$$
P(A):=\Big\{\sum_{i=1}^k\varepsilon_ia_i \,:\, k\ge0,\ \varepsilon_i\in \{0,1\}\ (1\le i\le k) \Big\}.
$$
Zannier conjectured and Ruzsa proved that the condition $a_n\leq 2a_{n-1}$ implies that the density $\mathbf{d}(P(A))$ exists (see \cite{r1}).
Ruzsa also asked the following questions:
\begin{itemize}
\item[i)] Is it true that for every pair of real numbers $0\leq \alpha\leq \beta\leq 1$, there exists a sequence of integers for which $\underline{\mathbf{d}}(P(A))=\alpha; \ \overline{\mathbf{d}}(P(A))=\beta$\,? This question was answered positively in \cite{r2}.

\item[ii)] Is it true that the condition $a_n\leq a_1+a_2+\dots +a_{n-1}+c$ also implies that $\mathbf{d}(P(A))$ exists\,?

\end{itemize}

\noindent
We shall prove the following statement.

\begin{prop}\label{p33}
Let $(a_n)_{n=1}^\infty$ be a sequence of positive integers. Assume that for some function $\theta$ satisfying $\theta(k)\ll \frac{k}{(\log k)^2}$ we have $$|a_n-s_{n-1}|=\theta(s_{n-1})\text{ for every }n,$$
where $s_{n-1}:=a_1+a_2+\dots+a_{n-1}$.\\
\noindent
 Then $\mathbf{d}(P(A))$ exists.
\end{prop}

\begin{proof}
We first prove that there exists a real number $\delta$ such that
$$
|P(A)(s_n)|=\big(\delta+o(1)\big)s_n\quad \text{as $n \to \infty$.}
$$
Let $n\ge2$ be large enough. Then
$$
P(A)\cap[1,s_n]= \Big(P(A)\cap[1,s_{n-1}]\Big)\cup
\Big(P(A)\cap(s_{n-1},s_{n}-\theta(s_{n-1}))\Big).
$$
Since $a_n\ge s_{n-1}-\theta(s_{n-1})$, we have $P(A)\cap(s_{n-1},s_{n}]\supseteq a_n+P(A)\cap(\theta(s_{n-1}),s_{n-1}]$, thus
\begin{equation}\label{eq_low}
\Big|P(A)\cap[1,s_n]\Big|\ge 2\Big|P(A)\cap[1,s_{n-1}]\Big|-2\theta(s_{n-1})-1.
\end{equation}
On the other hand,
$$
P(A)\cap[1,s_n]\subseteq \left(P(A)\cap[1,s_{n-1}]\right)\cup \left(a_n+P(A)\cap[1,s_{n-1}]\right)\cup [s_n-\theta(s_n),s_n],
$$
since $a_{n+1}\geq s_n-\theta(s_n)$. Therefore,
\begin{equation}\label{eq_upp}
\Big|P(A)\cap[1,s_n]\Big|\le 2\Big|P(A)\cap[1,s_{n-1}]\Big|+\theta(s_{n})+1.
\end{equation}
Observe that $s_n=a_n+s_{n-1}\le 2s_{n-1}+\theta(s_{n-1})$,
hence letting
$$
\delta_n=\frac{\Big|P(A)\cap[1,s_n]\Big|}{s_n},
$$
we obtain from \eqref{eq_low} and \eqref{eq_upp} that
\begin{equation}\label{delta}
\delta_n-\delta_{n-1}=O\left(\frac{\theta(s_{n})}{s_n}\right).
\end{equation}
Now, we show that $s_n\gg 2^{n}$. Since
\begin{equation}\label{thetabecs}
s_n=s_{n-1}+a_n\geq 2s_{n-1}-\theta(s_{n-1})=s_{n-1}\left( 2-\frac{\theta(s_{n-1})}{s_{n-1}} \right),\end{equation}
the condition $\theta(k)\ll \frac{k}{(\log k)^2}$ implies that from \eqref{thetabecs} we obtain that $s_n\gg 1.5^n$. Therefore, in fact, for large enough $n$ we have $s_n\geq s_{n-1} \left(2- \frac{c}{n^2} \right)$ with some $c>0$. Now, let $10c<K$ be a fixed integer. For $K<n$ we have
$$s_n\geq s_K\prod\limits_{i=K+1}^{n} \left(2- \frac{c}{i^2} \right) \geq s_K \left[ 2^{n-k}-2^{n-k-1} \sum\limits_{i=K+1}^{n} \frac{c}{i^2}   \right]\gg 2^n,$$
since $\sum\limits_{i=K+1}^{n} \frac{c}{i^2}<1/10$.
Hence, $s_n\gg 2^{n}$ indeed holds.

Therefore, using the assumption on $\theta$ we obtain that $\frac{\theta(s_{n})}{s_n}\ll \frac{1}{n^2}$. So \eqref{delta} yields that
$$
\delta_n-\delta_{n-1}=O(n^{-2}).
$$
Therefore, the sequence $\delta_n$ has a limit which we denote by $\delta$.
Furthermore, observe that
\begin{equation}\label{deltakonv}
\delta_n=\delta+O(1/n).
\end{equation}

The next step is to consider an arbitrary sufficiently large positive integer $x$ and decompose it as
$$
x=a_{n_1+1}+a_{n_2+1}+\cdots+a_{n_j+1}+z,
$$
where $n_1>n_2>\cdots>n_j>k$ and $0\le z$ are defined in the following way. (Here $k$ is a fixed, sufficiently large positive integer.) The index $n_1$ is chosen in such a way that $a_{n_1+1}\le x<a_{n_1+2}$. If $x-a_{n_1+1}\geq a_{n_1}$, then $n_2=n_1-1$, otherwise $n_2$ is the largest index for which $x-a_{n_1+1}\geq a_{n_2+1}$. The indices $n_3,n_4,\dots$ are defined similarly. We stop at the point when the next index would be at most $k$ and set $z:=x-a_{n_1+1}-a_{n_2+1}-\cdots-a_{n_j+1}$. As $z\leq \theta(s_{n_1+1})+s_k$, we have
\begin{equation}\label{zkicsi}
z=o(x).
\end{equation}

Furthermore, let
$$
b_i=a_{n_1+1}+a_{n_2+1}+\cdots+a_{n_i+1},\quad i=0,1,\dots,j.
$$
(The empty sum is $b_0:=0$, as usual.)

Let $X_0:=(0,s_{n_1}-\theta(s_{n_1}))$ and for $1\leq i\leq j-1$ let $X_i:=(b_i+\theta(s_{n_i}),b_i+s_{n_{i+1}}-\theta(s_{n_{i+1}}))$ and consider
\begin{multline*}
X:=X_0\cup X_1 \cup \dots \cup X_{j-1}=\\
=(0,s_{n_1}-\theta(s_{n_1}))\cup (b_1+\theta(s_{n_1}),b_1+s_{n_2}-\theta(s_{n_2}))\cup
\dots \cup (b_{j-1}+\theta(s_{n_{j-1}}),b_{j-1}+s_{n_j}-\theta(s_{n_j})).
\end{multline*}

Note that in this union each element  appears at most once, since according to the definition of $\theta$ the sets $X_0,X_1,\dots,X_{j-1}$ are pairwise disjoint as
$$b_i+s_{n_{i+1}}-\theta(  s_{n_{i+1}}   )\leq b_{i+1}=b_i+a_{n_{i+1}+1}$$
holds for every $0\leq i\leq j-2$.

The set of those elements of $[1,x]$ that are not covered by $X$ is:
\begin{multline*}
[1,x]\setminus X=[s_{n_1}-\theta(s_{n_1}),b_1+\theta(s_{n_1})]\cup[b_1+s_{n_2}-\theta(s_{n_2}),b_2+\theta(s_{n_2})]\cup\dots \\
\cup [b_{j-2}+s_{n_{j-1}}-\theta(s_{n_{j-1}}),b_{j-1}+\theta(s_{n_{j-1}})]\cup [b_{j-1}+s_{n_j}-\theta(s_{n_j}),x].
\end{multline*}

Therefore,
$$|[1,x]\setminus X|\leq 3\sum\limits_{i=1}^{j} \theta(s_{n_i})+z.$$

Using $\sum\limits_{i=1}^{j} \theta(s_{n_i})\ll \sum\limits_{i=1}^{j} \frac{s_{n_i}}{n_i^2}\ll\frac{x}{k^2}$ and \eqref{zkicsi}, we obtain that $\left|[1,x]\setminus X\right|\leq (\varepsilon_k+o(1))x$, where $\varepsilon_k\to 0$ (as $k\to \infty$). (Note that $\varepsilon_k\ll 1/k^2$.)

That is, the set $X$ covers $[1,x]$ with the exception of a ``small'' portion of size $O(x/k^2)$. Therefore, by letting $k\to \infty$ the density of the uncovered part tends to 0.

Let us consider $P(A)\cap X_i$. If a sum is contained in $P(A)\cap X_i$, then the sum of the elements with indices larger than $n_{i+1}$ is $b_i$. Otherwise, the sum is either at most $b_i+\theta(s_{n_i})$ or at least $b_{i}+s_{n_{i+1}}-\theta(s_{n_{i+1}})$.

Therefore, $P(A)\cap X_i=(b_i+P(\{a_1,a_2,\dots,a_{n_{i+1}}\}))\cap X_i$.

Hence,
$$\delta_{n_{i+1}}s_{n_{i+1}}-2\theta(s_{n_{i+1}})-1\leq |P(A)\cap X_i|\leq \delta_{n_{i+1}}s_{n_{i+1}}.$$

Therefore,
\begin{multline}\label{PAalso}
|P(A)\cap[x]|\geq \sum\limits_{i=0}^{j-1} \left( \delta_{n_{i+1}}s_{n_{i+1}}-2\theta(s_{n_{i+1}})-1 \right) \geq \\
\geq \delta x -\delta z + \delta \sum\limits_{i=0}^{j-1} (s_{n_{i+1}}-a_{n_{i+1}+1})+\sum\limits_{i=0}^{j-1} (\delta_{n_{i+1}}-\delta)s_{n_{i+1}}-2\sum\limits_{i=0}^{j-1} \left(\theta(s_{n_{i+1}})+1 \right)
\end{multline}
and
\begin{multline}\label{PAfelso}
|P(A)\cap[x]|\leq \sum\limits_{i=0}^{j-1}  \delta_{n_{i+1}}s_{n_{i+1}} \leq \\
\leq \delta x -\delta z + \delta \sum\limits_{i=0}^{j-1} (s_{n_{i+1}}-a_{n_{i+1}+1})+\sum\limits_{i=0}^{j-1} (\delta_{n_{i+1}}-\delta)s_{n_{i+1}}
\end{multline}
Now, observe that
\begin{itemize}
    \item $|z|=o(x)$ by \eqref{zkicsi},
    \item $\sum\limits_{i=0}^{j-1} |s_{n_{i+1}}-a_{n_{i+1}+1}|=o(x)$ by using $|s_{n_{i+1}}-a_{n_{i+1}+1}|=\theta(s_{n_{i+1}})$ and $\sum\limits_{i=0}^{j-1} a_{n_{i+1}+1}\leq x$,
    \item $\sum\limits_{i=0}^{j-1} (\delta_{n_{i+1}}-\delta)s_{n_{i+1}}\ll x/k$ by using \eqref{deltakonv}. Letting $k\to \infty$ this term is also of size $o(x)$.
\end{itemize}
Hence, we obtain from \eqref{PAalso} and \eqref{PAfelso} that $|P(A)\cap[x]|=\delta x+o(x)$.

\end{proof}

\section{\bf Density of product sets}

For any semigroup $G$
and any subset $A\subseteq G$,  we denote by $A^2$ the product set
$$
A^2=A\cdot A=\{ab\,:\, a,b\in A\}.
$$

In this section we focus on the case $G=(\mathbb{N},\cdot)$, the semigroup (for multiplication) of all positive integers. The restricted case $G=\mathbb{N}\setminus\{1\}$ is even more interesting, since $1\in A$ implies $A\subset A^2$.

The sets of integers satisfying the small doubling
hypothesis $\mathbf{d}(A+A)=\mathbf{d}A$ are well described
through Kneser's theorem.  The similar question for the product set does not plainly lead to a strong description. We can restrict our attention to sets $A$ such that
$\gcd(A)=1$, since by setting $B:=\frac{1}{\gcd{A}}A$ we have $\mathbf{d}A=\frac{1}{\gcd(A)}\mathbf{d}B$ and $\mathbf{d}A^2=\frac{1}{(\gcd(A))^2}\mathbf{d}(B^2)$.

\begin{exe}
i) Let $A_{\mathrm{nsf}}$ be the set of all non-squarefree integers. Letting $A=\{1\}\cup A_{\mathrm{nsf}}$ we have  $A^2=A$ and
$$
\mathbf{d}A=1-\zeta(2)^{-1}.
$$
ii) However, while $\gcd(A_{\mathrm{nsf}})=1$, we have
$$
\mathbf{d}A_{\mathrm{nsf}}^2<\mathbf{d}A_{\mathrm{nsf}}=1-\zeta(2)^{-1}.
$$
iii) Furthermore, the set $A_{\mathrm{sf}}$ of all squarefree integers satisfies
$$
\mathbf{d}A_{\mathrm{sf}}=\zeta(2)^{-1} \text{ and }
\mathbf{d}A_{\mathrm{sf}}^2=\zeta(3)^{-1},
$$
since $A_{\mathrm{sf}}^2$ consists of all cubefree integers.\\[0.5em]
iv) Given a positive integer $k$, the set $A_k=\big\{n\in\mathbb{N}\,:\,
\gcd(n,k)=1\big\}$ satisfies
$$
A_k^2=A_k\quad\text{and}\quad \mathbf{d}A_k=\frac{\phi(k)}k,
$$
where $\phi$ is Euler's totient function.
\end{exe}

We have the following result:

\begin{prop}
For any positive $\alpha<1$ there exists a set $A\subset \mathbb{N}$ such that
$\mathbf{d}A>\alpha$ and  $\mathbf{d}A^2<\alpha$.
\end{prop}

\begin{proof}
Assume first that $\alpha<1/2$.\\
For $k\ge 1$ let $A_k=k\mathbb{N}=\{kn,\ n\ge1\}$, then $A_k^2=k^2\mathbb{N}$. Therefore, $\mathbf{d} A_k=1/k$ and $\mathbf{d} (A_k^2)=1/k^2$.
If $1/(k+1) \le \alpha < 1/k$, then $A_k$ satisfies the requested condition. Since $\bigcup\limits_{k\geq 2}\left[ \frac{1}{k+1},\frac{1}{k} \right)=(0,1/2)$, an appropriate $k$ can be chosen for every $\alpha\in (0,1/2).$ \\[0.5em]
Assume now that $1>\alpha\ge1/2$.\\
Let $p_1<p_2<\cdots$ be the increasing sequence of prime numbers and
$$
B_r:=\bigcup_{i=1}^rp_i\mathbb{N}.
$$
The complement of the set $B_r$ contains exactly those positive integers that are not divisible by any of $p_1,p_2,\dots,p_r$, thus we have
$$\mathbf{d}(B_r)=1-\prod_{i=1}^r\left(1-\frac1{p_i}\right)=:\gamma_r.$$
Similarly, the complement of the set $B_r^2$ contains exactly those positive integers that are not divisible by any of $p_1,\dots,p_r$ or can be obtained by multiplying such a number by one of $p_1,\dots,p_r$. Hence, we obtain that
$$\mathbf{d}(B_r^2)=1-\left(1+\sum\limits_{i=1}^r \frac{1}{p_i}\right)\prod_{i=1}^r\left(1-\frac1{p_i}\right)=:\beta_r.$$
Note that
\begin{equation}\label{intersect}
\beta_{r+1}=1-\left(1+\sum\limits_{i=1}^{r+1} \frac{1}{p_i}\right)\left(1-\frac{1}{p_{r+1}}\right)\prod_{i=1}^r\left(1-\frac1{p_i}\right)<1-\frac{3}{2}\cdot\frac{2}{3}\cdot\prod_{i=1}^r\left(1-\frac1{p_i}\right)=\gamma_r.
\end{equation}
As $(\beta_1,\gamma_1)=(1/4,1/2)$, moreover $(\beta_r)_{r=1}^\infty$ and $(\gamma_r)_{r=1}^\infty$ are increasing sequences satisfying \eqref{intersect} and $\lim \gamma_r =1$, we obtain that $[1/2,1)$ is covered by $\bigcup\limits_{r=1}^\infty (\beta_r,\gamma_r)$. That is, for every $\alpha\in[1/2,1)$ we have $\alpha\in (\beta_r,\gamma_r)$ for some $r$, and then $A=B_r$ is an appropriate choice.

\end{proof}

We pose two questions about the densities of $A$ and $A^2$.

\begin{quest}
 If $1\in A$ and $\mathbf{d}A=1$, then $\mathbf{d}(A^2)=1$, too.
Given two integers $k,\ell$, the set
 $$
 \{n\in\mathbb{N}\,:\, \gcd(n,k)=1\}\cup k\ell \mathbb{N}
 $$
 is multiplicatively stable.
What are the sets $A$ of positive integers such that $A^2=A$ or less
restrictively
$$
1\in A\text{ and }1>\mathbf{d}A^2=\mathbf{d}A>0\,?
$$
\end{quest}

\begin{quest}
It is clear that  $\mathbf{d}A>0$ implies  $\mathbf{d}A^2>0$, since
$A^2\supset (\min A)A$.

 For any $\alpha\in(0,1)$ we denote
 $$
 f(\alpha):=\inf_{A\subset\mathbb{N}; \ \mathbf{d}A=\alpha}\mathbf{d}A^2.
 $$
 Is it true that $f(\alpha)=0$ for any $\alpha$ or at least for $\alpha<\alpha_0$\,?
\end{quest}

The next result shows that the product set of a set having density 1 and satisfying a technical condition must also have density 1.

\begin{prop}\label{pp1}
Let $1\notin A$ be a set of positive integers with asymptotic density $\mathbf{d}A=1$.
Furthermore, assume that $A$ contains
an infinite subset of mutually coprime integers $a_1<a_2<\cdots$ such tha
$$
\sum_{i\ge1}\frac{1}{a_i}=\infty.
$$
Then the product set $A^2$ also has density $\mathbf{d}(A^2)=1$.
\end{prop}

\begin{proof}
Let $\varepsilon>0$ be arbitrary and choose a large enough $k$ such that
\begin{equation}\label{ep}
\sum_{i=1}^k \frac1a_i >-\log\varepsilon.
\end{equation}
Let $x$ be a large integer.
For any $i=1,\dots,k$, the set $A^2(x)$ contains all the products $a_ia$ with $a\le x/a_i$. We shall use a sieve argument. Let $A'$ be a finite subset of $A$ and  $X=[1,x]\cap\mathbb{N}$ for some $x>\max(A')$. For any $a\in A'$, let
$$
X_a=\Big\{n\le x\,:\, a\nmid n\text{ or }\frac na\not \in A\Big\}.
$$
Observe that
$$
X\setminus X_a=(aA)(x).
$$
Then
$$
(A'A)(x)=\bigcup_{a\in A'}\left(X\setminus X_a\right).
$$
By the inclusion-exclusion principle we obtain
$$
|(A'A)(x)|=\sum_{k=1}^{|A'|}(-1)^{j-1}\sum_{\substack{B\subseteq A'\\|B|=j}}\Big|\bigcap_{b\in B}\left(X\setminus X_b\right)\Big|,
$$
whence
\begin{equation}\label{szita}
\Big|\bigcap_{a\in A'}X_a\Big|= \sum_{j=0}^{|A'|}(-1)^{j}\sum_{\substack{B\subseteq A'\\|B|=j}}\Big|\bigcap_{b\in B}\left(X\setminus X_b\right)\Big|,
\end{equation}
where the empty intersection $\bigcap_{b\in \emptyset}\left(X\setminus X_b\right)$ denotes the full set $X$.

For any finite set of integers $B$ we denote by $\mathrm{lcm}(B)$ the least common multiple of the elements of $B$.
Now, we consider
$$
\bigcap_{b\in B}\left(X\setminus X_b\right)=\Big\{n\le x\,:\, \mathrm{lcm}(B)\mid n\text{ and }  \frac{n}{b}\in A \ (\forall b\in B) \Big\}.
$$
By the assumption $\mathbf{d}A=1$ we immediately get
$$
\Big|\bigcap_{b\in B}\left(X\setminus X_b\right)\Big|=\frac{x}{\mathrm{lcm}(B)}(1+o(1)).
$$
Plugging this into \eqref{szita}:
$$
\Big|\bigcap_{a\in A'(x)}X_a\Big|= x\sum_{k=0}^{|A'|}(-1)^{j}\sum_{\substack{B\subseteq A'\\|B|=j}}\frac1{\mathrm{lcm}(B)}+o(x).
$$

Since the elements of $A'=\{a_1,a_2,\dots,a_k\}$ are mutually coprime,
$$
x- |A'A(x)| = x\sum_{j=0}^k(-1)^j\sum_{1\le a_{i_1}<\cdots<a_{i_j}\le k}
\frac{1}{a_{i_1}a_{i_2}\dots a_{i_j}}+o(x)=x\prod_{i=1}^k\Big(1-\frac1{a_i}\Big)+o(x).
$$
(Note that for $j=0$ the empty product is defined to be 1, as usual.)
Since $1-u\le \exp(-u)$ we get
$$
x- |A'A(x)|  \le x\exp\Big(-\sum_{i=1}^k \frac1{a_i}\Big)+o(x)<\varepsilon x+o(x)
$$
by our assumption \eqref{ep}. Thus finally
$$
|A^2(x)|\ge |A'A(x)|>x(1-\varepsilon-o(1)).
$$
This ends the proof.
\end{proof}

\begin{remark}
Specially, the preceding result applies when $A$ contains a
sequence of prime numbers $p_1<p_2<\cdots$
such that
$\sum_{i\ge1}1/p_i=\infty$.
For this it is enough to assume that
$$
\liminf_{i\to\infty}\frac{i\log i}{p_i}>0.
$$
\end{remark}

However, we do not know how to avoid the assumption on the mutually coprime integers having infinite reciprocal sum. We thus pose the following question:

\begin{quest}
Is it true that $\mathbf{d}A=1$ implies $\mathbf{d}(A^2)=1$?
\end{quest}

\medskip

\subsection*{An example for a set $A$ such that $\mathbf{d}(A)=0$ and $\mathbf{d}(A^2)=1$.}

According to the fact that the multiplicative properties of the elements play an important role, one can build a set whose elements are characterized by their number of prime factors. Let
$$
A=\big\{n\in\mathbb{N}\,:\,\Omega(n)\le 0.75 \log\log n+1\big\},
$$
where $\Omega(n)$ denotes the number of prime factors (with multiplicity) of $n$.
An appropriate generalisation of the Hardy-Ramanujan theorem (cf. \cite{HR} and \cite{GT}) shows that the normal order of $\Omega(n)$ is $\log\log n$ and the Erd\H os-Kac theorem asserts that
$$
\mathbf{d}\left\{n\in\mathbb{N}\,:\, \alpha<\frac{\Omega(n)-\log\log n}{\sqrt{\log\log n}}<\beta\right\}=\frac1{\sqrt{2\pi}}\int_{\alpha}^{\beta}e^{-t^2/2}dt,
$$
which implies $\mathbf{d}A=0$. Now we prove that $\mathbf{d}A^2=1$. The principal feature in the definition of $A$ is that $A^2$  must contain almost all integers $n$ such that $\omega(n)\le 1.2 \log\log n$.

For $n\in\mathbb{N}$ let
$$
P_+(n):=\max\big\{p: p\text{ is a prime divisor of } n\big\}.
$$
Let us consider first the density of the integers $n$ such that
\begin{equation}\label{p+}
P_+(n) > n\exp(-(\log n)^{4/5}).
\end{equation}
Let $x$ be a large number and write
$$
\left|
\Big\{n\le x\,:\, P_+(n)\le n\exp(-(\log n)^{4/5})
\Big\}\right|=\left|
\Big\{n\le x\,:\, P_+(n)\le x\exp(-(\log x)^{4/5})
\Big\}\right|+o(x).
$$
By a theorem of Hildebrand (cf. \cite{Hi}) on the estimation  of $\Psi(x,z)$, the number of $z$-friable integers  up to
$x$, we conclude that the above cardinality is $x+o(x)$.
Hence, we may avoid the integers $n$ satisfying \eqref{p+}. By the same estimation we may also avoid those integers $n$ for which $P_+(n) < \exp((\log n)^{4/5})$.

Let $n$ be an integer such that $\Omega(n)\leq 1.2\log\log n$ and
$$
\exp((\log n)^{4/5})\le P_+(n)\le n\exp(-(\log n)^{4/5}).
$$
Our goal is to find a decomposition $n=n_1n_2$ with $\Omega(n_i)\le 0.75\log\log n_i+1$, $i=1,2$.

Let
$$
n=p_1p_2\dots p_{t-1}P_+(n),
$$
where $t=\Omega(n)$. We also assume that $p_1\le p_2\le \cdots\le p_{t-1}\le P_+(n)$. Let $m=\frac{n}{P_+(n)}$. Then
$$
\exp((\log n)^{4/5})\le m\le n\exp(-(\log n)^{4/5}).
$$
Let
$$
n_1=p_1p_2\dots p_{u-1}P_+(n)\text{ and }
n_2=p_u\dots p_{t-1},
$$
where $u=\lfloor(t-1)/2\rfloor$. Then
$n_2\ge \sqrt{m}$, which yields
$$
\log\log n_2\ge \log\log m -\log 2\ge 0.8\log\log n-\log 2.
$$
On the other hand,
$$
\Omega(n_2)=t-u\le \frac t2+1 \le 0.6 \log\log n+1\le 0.75 \log\log n_2+\frac{3\log 2}{4}.
$$
Now $n_1\ge  P_+(n)\ge \exp((\log n)^{4/5})$, hence
$$
\log\log n_1\ge 0.8\log\log n
$$
and
$$
\Omega(n_1)\le \frac {t-1}{2}\le 0.6 \log\log n\le 0.75 \log\log n_1$$
Therefore, the following statement is obtained:

\begin{prop}\label{pp3}
The set
$$
A=\big\{n\in\mathbb{N}\,:\,\Omega(n)\le 0.75 \log\log n+1\big\}
$$
has  density $0$ and its product set $A^2$ has density $1$.
\end{prop}

By a different approach we may extend the above result as follows.

\begin{thm}
For every $0\leq \alpha\leq \beta\leq 1$ there exists a set $A\subseteq \mathbb{N}$ such that $\mathbf{d}A=0$, $\underline{\d}(A\cdot A)=\alpha$ and $\overline{\d}(A\cdot A)=\beta$.
\end{thm}

\begin{proof}
We start with defining a set $Q$ such that $\d(Q)=0$ and $ \d(Q\cdot Q)=\beta$.
Let us choose a subset $P_0$ of the primes such that $\prod\limits_{p\in P_0}(1-1/p)=\beta$. Such a subset can be chosen, since $\sum 1/p=\infty$.
Now, let $p_k$ denote the $k$-th prime and let
$$
P_1=\{p_i: i\text{ is odd}\}\setminus P_0,
$$
$$
P_2=\{p_i: i\text{ is even}\}\setminus P_0.
$$
Furthermore, let
 $$
 Q_1=\{n: \text{all prime divisors of $n$ belong to $P_1$}\}
 $$
 and
 $$
 Q_2=\{n: \text{all prime divisors of $n$ belong to $P_2$}\}.
 $$
 Let $Q=Q_1\cup Q_2$. Clearly, $Q\cdot Q=Q_1\cdot Q_2$ contains exactly those numbers that do not have any prime factor in $P_0$, so $\d(Q\cdot Q)=\beta$. For $i\in\{1,2\}$ and $x\in\mathbb{R}$ the probability that an integer does not have any prime factor being less than $x$ from $P_i$ is $\prod\limits_{p< x, p\in P_i}(1-1/p)\leq \frac{1}{\beta}\prod\limits_{p< x, p\in P_i\cup P_0}(1-1/p)\leq \frac{1}{\beta}\exp\left\{-\sum\limits_{\substack{j:\ p_j< x, \\ j\equiv i\pmod{2}}}\frac{1}{p_j}\right\}=O\left( \frac{1}{\beta\sqrt{\log x}}\right)$. Therefore, $\d(Q_1)=\d(Q_2)=0$, and consequently $\d(Q)=0$ also holds.
  If $\alpha=\beta$, then $A=Q$ satisfies the conditions. From now on let us assume that $\alpha<\beta$.

Our aim is to define a subset $A\subseteq Q$ in such a way that $\underline{\d}(A\cdot A)=\alpha$ and $ \overline{\d}(A\cdot A)=\beta$. As $A\subseteq Q$ we will have  $\d(A)=0$ and $\overline{\d}(A\cdot A)\leq \beta$. The set $A$ is defined recursively. We  will define an increasing sequence of integers $(n_j)_{j=1}^\infty$ and sets $A_j$ ($j\in\mathbb{N}$)  satisfying the following conditions (and further conditions to be specified later):
\begin{itemize}
\item[(i)] $A_j\subseteq A_{j-1}$,
\item[(ii)] $A_j\cap [1,n_{j-1}]=A_{j-1}\cap [1,n_{j-1}]$,
\item [(iii)]$A_j\cap [n_j+1,\infty]=Q\cap [n_j+1,\infty]$.
\end{itemize}
That is, $A_j$ is obtained from $A_{j-1}$ by dropping out some elements of $A_{j-1}$ in the range $[n_{j-1}+1,n_j]$.
Finally, we  set $A=\bigcap\limits_{j=1}^\infty A_j$.

Let $n_1=1$ and  $A_1=Q$.
We  define the sets $A_j$ in such a way that the following condition holds for every $j$ with some $n_0$ depending only on $Q$:
$$
|(A_j\cdot A_j)(n)|\geq \alpha n \text{ for every $n\geq n_0$.}\leqno(*)
$$

Since $d(Q\cdot Q)=\beta>\alpha$, a threshold $n_0$ can be chosen in such a way that $(*)$ holds for $A_1=Q$ with this choice of $n_0$.
Now, assume that $n_j$ and $A_j$ are already defined for some $j$.
We continue in the following way depending on the parity of $j$:
\begin{itemize}
\item[Case I:] $j$ is odd.

Let $n_j<s$ be the smallest integer such that
$$|(A_j\setminus [n_j+1,s])\cdot (A_j\setminus [n_j+1,s])(n)|<\alpha n$$
for some $n\geq n_0$. We claim that such an $s$ exists, indeed it is at most $\lfloor n_j^2/\alpha \rfloor +1$.
For $s'=\lfloor n_j^2/\alpha \rfloor +1$ we have
$$|(A_j\setminus [n_j+1,s'])\cdot (A_j\setminus [n_j+1,s'])(s')|\leq n_j^2<\alpha s'.$$
Hence, $s$ is well-defined (and $s\leq s'$). Let $n_{j+1}:=s-1$ and $A_{j+1}:=A_j\setminus [n_j+1,s-1]$. (Specially, it can happen that $n_{j+1}=n_j$ and $A_{j+1}=A_j$.) Note that $A_{j+1}$ satisfies $(*)$.\\

\item[Case II:] $j$ is even.

Now, let $n_j< s$ be the smallest index for which $|(A_{j}\cdot A_{j})(s)|>(\beta-1/j)s$.

We have $\d(Q\cdot Q)=\beta$ and $A_{j}$ is obtained from $Q$ by deleting finitely many elements of it: $A_{j}=Q\setminus R$, where $R\subseteq [n_j]$. As $\d(Q)=0$, we have that
$$|((Q\cdot Q)\setminus (Q\setminus R)\cdot (Q\setminus R))(n)|\leq |R|^2+\sum\limits_{r\in  R} |Q(n/r)|=o(n),$$
 therefore, $\d(A_{j}\cdot A_{j})=\beta$. So for some $n>n_j$ we have that $(A_{j}\cdot A_{j})(n)>(\beta-1/j)n$, that is, $s$ is well-defined. Let $n_{j+1}:=s$ and $A_{j+1}=A_j$. Clearly, $A_{j+1}$ satisfies $(*)$.

\end{itemize}

This way an increasing sequence $(n_j)_{j=1}^\infty$ and sets $A_j (j\in \mathbb N)$ are defined, these satisfy conditions (i)-(iii). Finally, let us set $A:=\bigcap\limits_{j=1}^\infty A_j$. Note that $A(n_j)=A_j(n_j)$.

We have already seen that $A\subseteq Q$ implies that  $\d(A)=0$ and $\overline{\d}(A\cdot A)\leq \beta$. At  first we show that $\underline{\d}(A\cdot A)\geq \alpha$. Let $n\geq n_0$ be arbitrary. If $j$ is large enough, then $n_j>n$. As $A_j$ satisfies $(*)$ and $(A\cdot A)(n)=(A_j\cdot A_j)(n)$ we obtain that
$$|(A\cdot A)(n)|=|(A_j\cdot A_j)(n)|\geq \alpha n.$$
This holds for every $n\geq n_0$, therefore, $\underline{\d}(A\cdot A)\geq \alpha$.

As a next step, we show that $\underline{\d}(A\cdot A)=\alpha$. Let $j$ be odd. According to the definition of $n_{j+1}$ and $A_{j+1}$ there exists some $n\geq n_0$ such that
$$|((A_j\setminus \{n_{j+1}+1\})\cdot (A_j\setminus \{n_{j+1}+1\}))(n)|<\alpha n. $$
For brevity, let $s:=n_{j+1}+1$. As $A\subseteq A_j$ we get that $|(A\setminus \{s\})\cdot (A\setminus \{s\})(n)|<\alpha n$. Also, $$|(A\cdot A)\setminus ((A\setminus\{s\})\cdot (A\setminus\{s\})(n))|\leq 1+|A(n/s)| \leq 1+|Q(n/s)|,$$
since $A\subseteq Q$.  Thus $|(A\cdot A)(n)|\leq \alpha n+1+|Q(n/s)|\leq n(\alpha+1/n+1/s)$.
Clearly $s=n_{j+1}+1\leq n$, and as $j\to \infty$ we have $n_{j+1}\to \infty$, therefore $\underline{\d}(A\cdot A)=\alpha$.

Finally, we prove that $\overline{\d}(A\cdot A)=\beta$. Let $j$ be even. According to the definition of $A_{j+1}$ and $n_{j+1}$, we have $|(A_{j+1}\cdot A_{j+1})(n_{j+1})|>(\beta-1/j)n_{j+1}$. However, $(A\cdot A)(n_{j+1})=(A_{j+1}\cdot A_{j+1})(n_{j+1})$, therefore $\overline{\d}(A\cdot A)\geq \lim (\beta-1/j)=\beta$, thus $\overline{\d}(A\cdot A)=\beta$ as it was claimed.

\end{proof}