ecaluation: Added real-sel
This commit is contained in:
parent
f48dca02aa
commit
34404faeed
@ -1,2 +1,31 @@
|
|||||||
\section{Selection of events}
|
\section{Selection of events}
|
||||||
\label{sec:lmdk-sel-eval}
|
\label{sec:lmdk-sel-eval}
|
||||||
|
|
||||||
|
In this section we present the experiments that we performed, to test the methodology that we presented in Section~\ref{subsec:lmdk-sel-sol}, on real and synthetic data sets.
|
||||||
|
% With the experiments on the real data sets (Section~\ref{subsec:lmdk-expt-bgt}), we show the performance in terms of utility of our three {\thething} mechanisms.
|
||||||
|
% With the experiments on the synthetic data sets (Section~\ref{subsec:lmdk-expt-cor}) we show the privacy loss by our framework when tuning the size and statistical characteristics of the input {\thething} set $L$ with special emphasis on how the privacy loss under temporal correlation is affected by the number and distribution of the {\thethings}.
|
||||||
|
|
||||||
|
Figure~\ref{fig:real-sel} exhibits the performance of Skip, Uniform, and Adaptive (see Section~\ref{subsec:lmdk-mechs}) in combination with the {\thething} selection component.
|
||||||
|
|
||||||
|
\begin{figure}[htp]
|
||||||
|
\centering
|
||||||
|
\subcaptionbox{Copenhagen\label{fig:copenhagen-sel}}{%
|
||||||
|
\includegraphics[width=.5\linewidth]{evaluation/copenhagen-sel}%
|
||||||
|
}%
|
||||||
|
\hspace{\fill}
|
||||||
|
\subcaptionbox{HUE\label{fig:hue-sel}}{%
|
||||||
|
\includegraphics[width=.5\linewidth]{evaluation/hue-sel}%
|
||||||
|
}%
|
||||||
|
\subcaptionbox{T-drive\label{fig:t-drive-sel}}{%
|
||||||
|
\includegraphics[width=.5\linewidth]{evaluation/t-drive-sel}%
|
||||||
|
}%
|
||||||
|
\caption{The mean absolute error (a)~as a percentage, (b)~in kWh, and (c)~in meters of the released data for different {\thethings} percentages.}
|
||||||
|
\label{fig:real-sel}
|
||||||
|
\end{figure}
|
||||||
|
|
||||||
|
In comparison with the utility performance without the {\thething} selection component (Figure~\ref{fig:real}), we notice a slight deterioration for all three models.
|
||||||
|
This is natural since we allocated part of the available privacy budget to the {\thething} selection component which in turn increased the number of {\thethings}.
|
||||||
|
Therefore, there is less privacy budget available for data publishing throughout the time series for $0$\% and $100$\% {\thethings}.
|
||||||
|
Skip performs best in our experiments with HUE, due to the low range in the energy consumption and the high scale of the Laplace noise which it avoids due to its tendency to approximate.
|
||||||
|
However, for the Copenhagen data set and T-drive it attains greater mean absolute error than the user-level.
|
||||||
|
Overall, Adaptive has a consistent performance in terms of utility for all of the data sets that we experimented with.
|
||||||
|
Loading…
Reference in New Issue
Block a user