\section{Introduction}

The problem of \textit{supervised pattern discovery} is that of finding sets of observations that belong together, given a set of past patterns to learn from. This problem arises naturally in domains ranging from computer vision to crime data mining. We provide a formal definition and theoretical foundation for pattern discovery. Unlike the classical problem of classification, in pattern discovery we posit an infinite number of classes (``patterns"), each containing a finite number of observations. Also, in contrast to standard classification assumptions, we do not expect the observations to be chosen i.i.d. On the contrary, the observations within a pattern may be highly correlated, whereas the latent patterns are chosen i.i.d., and our goal is to locate these patterns among the full set of observations.
We briefly outline three motivating examples.

The first is a problem that is faced every day by crime analysts in police departments across the world \citep{Chen:2004,Nath06crimedm}. These analysts spend much of their time searching for patterns of crimes within databases of crime reports. The identification of emerging patterns of crime has been a key priority of the crime analysis profession since its inception. Analysts have knowledge of past patterns of crime, which they generalize to detect new patterns in recent crimes. Each pattern thus corresponds to the (group of) people committing the crimes. Since there are an unknown number of criminals in the world, and as patterns of crimes happen in myriad ways, we cannot assume a fixed, finite number of patterns. In addition, crimes committed by the same individual are certainly not i.i.d. On the other hand, the patterns are similar enough that sometimes the analysts can identify them. Thus, instead of the usual i.i.d.~assumption of observations made generally in machine learning, we might consider each observation (crime) as being generated by one of many latent processes (the criminals), chosen i.i.d. Observations generated by the same process are considered part of a single pattern, and all of the observations are visible simultaneously. Automated methods for crime pattern detection include a neural network approach \citep{Dahbur:2003} and a greedy pattern-building algorithm \citep{Wang:2013}. Others \citep{Lin03anoutlier-based,brown2003data} investigate the slightly easier task of finding pairs of related crimes.

As a second example, consider the following simplified perceptual organization-style problem,\footnote{Ideas from perceptual organization have proven to be very useful in the field of computer vision \citep{Sarkar:2003}.} which involves finding geometric patterns in an image (cf. \cite{Ferrari:2006,Zhu:2008}, and also \cite{Payet:2010} for an unsupervised variant). Each observation is a line segment in $\reals^{2}$. A robot or human might observe an image with more than one pattern in it: say, a star, a square, and a rhombus (see Figure \ref{subfig:simple-patterns}), which are placed according to a particular probability distribution within the space. The goal is to find the patterns, where each pattern consists of a subset of observations. In this case, a single observation can only be classified in the context of the other observations. We do not know in advance what constitutes a pattern; we have only a labeled set of other patterns to learn from. There may actually be an infinite number of pattern types. For instance, while a human might quickly recognize the two patterns in Figures \ref{subfig:complex-patterns}, there are an infinite number of other possible patterns they might also recognize in some other collection of line segments.

A final example that falls within the pattern discovery framework comes from personalized medicine \citep{Ginsburg:2001,Hamburg:2010}. In personalized medicine, an individual's molecular and genetic profile is used to develop a specialized treatment for that person. To accomplish this, patterns must be found within individuals' molecular/genetic profiles, the progressions of their symptoms, and the results of their treatments. These patterns are used  not just to decide between one or two possible treatments. Instead, a large number of treatment regimens may be discovered, with each regimen potentially applying to only a small number of patients. For example, personalized medicine approaches have found particular success in using genome-wide gene-expression data  for the treatment of cancer \citep{Sorlie:2001,vantVeer:2002,Wang:2011}.
``Cancer'' is a highly amorphous term. While certain cancers are caused by a few well-understood gene mutations, in many cancers there are a large number of infrequent mutations that each make a small contribution to tumorigenesis \citep{Vogelstein:2013}. For example, breast cancer is caused by hundreds if not thousands of different mutations, with only three point mutations and perhaps ten recurrent mutations occurring in more than 10\% of cases \citep{Kobolt:2012}. Thus, flexible pattern discovery methods are required \citep{Sorlie:2001,vantVeer:2002}. For a range of personalized medicine examples and references, see the proceedings of the recent NIPS 2010 Workshop on Predictive Models in Personalized Medicine\footnote{\url{https://sites.google.com/site/personalmedmodels/}}.

In this paper we develop a statistical learning theory framework for two versions of the problem of supervised pattern discovery, providing a theoretical foundation for applications that are already used in practice for pattern discovery. In particular, we develop uniform risk bounds that can be used for empirical risk minimization \citep{Vapnik:1998}. We call the first version of the pattern discovery problem \textit{block pattern discovery}. The block problem assumes there are collections of patterns. The collections are i.i.d.\ but the pattern-generating mechanisms within each collection are not necessarily independent. The second version is the {\em individual pattern problem}, in which the patterns are presented as a single collection and the pattern generating processes (with each generating a single pattern) are i.i.d.

To our knowledge, there are no other learning theory frameworks which, like pattern discovery, allow for an infinite number of latent patterns, each with a finite number of observations. Statistical learning theory for classification \citep{Vapnik:1998} supposes a finite number of possible classes each containing an infinite number of observations in the limit of infinite data, and many other supervised problems (e.g.\ supervised ranking) are similar. Supervised clustering \citep{Balcan:2008,Awasthi:2010} similarly posits a known, finite number of clusters to which observations in some fixed data set belong. In the clustering model there is a ``teacher'' who provides feedback about the correctness of the proposed clustering and the clustering rule is assumed to come from some known concept class. Algorithms operating within the framework are concerned with finding the true rule using a polynomial number of queries to the teacher. Finally, standard clustering is an {\em unsupervised} method \citep{HTF:2008}, whereas pattern discovery is concerned with {\em supervised learning}.

In addition to the theoretical work just described, there is a large body of work in the statistics, machine learning, and data mining communities on clustering (mixture modeling) with an infinite number of clusters (components). A popular approach to infinite mixture modeling is based on Bayesian non-parametric models, particularly the Dirichlet process (DP). Both unsupervised \citep{Rasmussen:1999,Neal:2000}
and semi-supervised \citep{Akova:2012} approaches have been developed. Note, however, that DP-based approaches produce clusters of infinite size in the infinite data limit, whereas we shall be interested in clusters that are of finite size even in the infinite data limit.

The remainder of the paper is organized as follows. In Section \ref{sec:block}, notation is established and the block pattern discovery problem is defined. In Section \ref{sec:block-bounds}, we give risk bounds for the block problem in terms of covering numbers. The individual pattern discovery problem is defined in Section \ref{sec:individual} while Section \ref{sec:individual-bounds} gives risk bounds for the individual pattern discovery problem based on an adaptation of the Rademacher complexity measure that is appropriate for pattern discovery.

\begin{figure*}[tbp]
\centering
\begin{subfigure}[b]{.3\textwidth}
	\centering
	\frame{\includegraphics[width=\textwidth]{simple-patterns.eps}}
	\caption{Three simple patterns}
	\label{subfig:simple-patterns}
\end{subfigure}
\qquad\qquad
\begin{subfigure}[b]{.3\textwidth}
	\centering
	\frame{\includegraphics[width=\textwidth]{complex-patterns.eps}}
	\caption{Two more complex patterns}
	\label{subfig:complex-patterns}
\end{subfigure}
\caption{Examples of block patterns using lines, with extra lines that do not belong to a multi-line pattern.}
\label{fig:block-patterns}
\end{figure*}

\section{The Block Pattern Discovery Problem} \label{sec:block}

We first investigate what we call the {\em block pattern discovery} problem. The observations are a sequence of i.i.d.\  {\em blocks}, where a {\em block} is a collection of patterns. For example, a single block could be images with lines that form patterns, as in Figures \ref{fig:block-patterns}a and \ref{fig:block-patterns}b. In order words, each line would be an observation, a set of lines would form a geometric pattern, and the image containing the geometric patterns would constitute a block. The goal is then to find the patterns in new groups of observations, such as in new images.

Let $\mcX$ be the observation space and define $\mathscr S (\mathcal X)$ to be the set of finite, non-empty subsets of $\mathcal X$. A pattern will consist of one or more observations from $\mcX$, so $\mathscr S (\mathcal X)$ defines the collection of all possible patterns that could be observed. Also, let $\mathscr S^{2}(\mathcal X) := \mathscr S(\mathscr S (\mathcal X))$ denote all finite collections of patterns. In other words, $x \in \mcX$ is a single observation; $P \in \mathscr S (\mathcal X)$ is a pattern, which consists of a finite number of observations; and $Q \in \mathscr S^{2}(\mathcal X)$ is a finite collection of patterns (i.e.\ $Q = \{P_{1},P_{2},\dots, P_{k}\}, P_{i} \in \mathscr S (\mathcal X)$). For example, in the crime pattern detection application, $x \in \mcX$ is a single crime, $P_{i} \in \mathscr S (\mathcal X)$ are the crime patterns---crimes committed by a single person or group---and $Q = \{P_{1},P_{2},\dots, P_{k}\} \in \mathscr S^{2}(\mathcal X)$ is the collection of crime patterns. Note that each observation can belong to only one pattern.

Define an (unknown) distribution $\mcD$ over collections of patterns, so $Q \sim \mcD$ is an element of $\mathscr S^{2}(\mathcal X)$ and can be written as $Q = \{ P_{1},\dots,P_{k} \}$, where each $P_{i} \in \mathscr S (\mathcal X)$ is a single pattern. Note that $k$ is itself random. $Q$ can be thought of as representing a labeled version of the observations --- that is, indicating which observations are part of the same pattern. Let $X_{Q} = \bigcup_{P \in Q} P \in \mathscr S (\mathcal X)$ be the set of observations associated with $Q$, which would correspond to an unlabeled dataset with latent patterns defined by $Q$.

Let $S : \mathscr S^{2}(\mathcal X) \to \mathscr S^{2}(\mathcal X)$ be a {\em selector function}, which maps each collection of patterns $Q \in \mathscr S^{2}(\mathcal X)$ to a subset of $\mathscr S( X_{Q})$, the subsets of observations derived from $Q$. The function $S(Q)$ is used to select out which subsets of the set of observations $X_{Q}$ the loss function will depend on. Since $S$ is a function of $Q$, these subsets can depend on the true patterns in the observations. We will be interested in choosing a {\em pattern discovery function} $f : \mathscr S (\mathcal X) \times \mathscr S (\mathcal X) \to [0,1]$. The function $f(X, U)$ outputs a score between 0 and 1, where 1 (resp. 0) indicates complete confidence that $U$ is part (resp. not part) of a pattern from $X$. Let $\mcF$ be a family of pattern discovery functions. We assume throughout that for $f \in \mcF$, $f(X, U) = 0$ if $U \not\subseteq X$, since in this case it is obvious that $U$ cannot be part of a pattern from $X$.

The {\em block loss functional} $\mcL_{S}$ under selector $S$ measures the performance of the pattern discovery function $f \in \mcF$ on a collection of patterns $Q \in \mathscr S^{2}(\mathcal X)$ and is defined to be
\begin{align}
\mcL_{S}(f; Q) =
\left[\frac{1}{Z_{Q,S}}\sum_{U \in S(Q)} \ell_{sp}^{2}(f, U, Q) \right]^{1/2},
\end{align}
where $Z_{Q,S} = |S(Q)|$ is the normalization function so $\mathcal L_{S} \in [0,1]$ and $\ell_{sp}(f, U, Q) \in [0,1]$ is the {\em local loss} of $f$ on a subset $U$ when the true pattern collection is $Q$. In the following section, we will focus on the case where $\ell_{sp}(f, U, Q) = |\mathbb I(U \subset P \in Q) - f(X_{Q}, U)|$, which penalizes $f$ for how far it is from the indicator of whether $U$ is part of a pattern.

One particular case of interest is when the selector function is $A : Q \mapsto \mathscr S(X_{Q})$, which selects all subsets of the data. This maximal selector can be thought of as the ideal one, in the sense that $\mcL_{A}$ considers the performance of $f$ on all possible subsets. However, since there are an exponential number of subsets, evaluating $\mcL_{A}$ is not usually practical. In such cases, a selector that picks out subsets deemed ``important'' could be used. For example, the selector might choose all subsets of true patterns as positive examples and subsets of true patterns with one additional data point not from that pattern as negative examples. This particular selector function is useful for training greedy algorithms that build patterns incrementally. These kinds of greedy algorithms for finding patterns have been used both in supervised settings (e.g.\ that of \citep{Wang:2013}) and unsupervised settings (e.g.\ work on set expansion \citep{WangCo2008,LethamRuHe13}).

\section{Risk Bounds for the Block Problem} \label{sec:block-bounds}

Let the true risk for $f \in \mcF$ be
\beqn R(f) = \bbE_{Q \sim \mcD} \mathcal L_{S}(f; Q) \eeqn
and the empirical risk for $f$ given $Q_{1},\dots,Q_{n} \overset{i.i.d.}{\sim} \mcD$ be
\beqn \hR_{n}(f) = \frac{1}{n} \sum_{i=1}^{n}\mathcal L_{S}(f; Q_{i}). \eeqn
We develop
bounds on the difference $L_{n}(f) = R(f) - \hR_{n}(f)$ between the true and empirical risk. These bounds adapt and expand on classical learning theory results to the new pattern detection problem. Indeed, our main goal in this section is to point out that certain pattern discovery problems can be framed such that they inherit standard i.i.d.~learning theory guarantees.

Because we have now packaged the block discovery problem into a learning theoretic framework, we can apply Rademacher complexity bounds, which we then relate to empirical $\ell_{2}$ covering numbers via Dudley's entropy bound. Define the loss class to be $\mcG := \mcL_{S} \circ \mcF := \{ g = \mcL_{S}(f; \cdot) \given f \in \mcF \}$, and  $\tilde\mcG = \{ Q \mapsto \mcL_{S}(f; Q) - \mcL_{S}(0; Q) \given f \in \mcF\}$ to be the offset loss class. Also define the empirical metric
\beqn d_{n}(g_{1}, g_{2}) =  \left[n^{-1}\sum_{i=1}^{n} (g_{1}(Q_{i}) - g_{2}(Q_{i}))^{2}\right]^{1/2}. \eeqn

\bdefn For metric space $(T, d)$, the {\bf $\eps$-covering number} $\mcN(T, d, \eps)$ is defined to be the smallest integer $K$ such that there are points $x_{1},\dots,x_{K} \in T$ satisfying $\bigcup_{i=1}^{K}B_{\eps}(x_{i}) \subseteq T$, where $B_{\eps}(x_{i})$ is the open ball in $T$ of radius $\eps$ centered at $x_{i}$.
\edefn

\bthm \label{cor:l2-bound-g-metric}
 Let $Q_{1},\dots,Q_{n} \overset{i.i.d.}{\sim} \mcD$. Then for any positive integer $n$ and any $0 < \delta < 1$, with probability $1 - \delta$ over samples of length $n$, every $f \in \mcF$ satisfies
\begin{align}
L_{n}(f) &\le \bbE  \int 24\sqrt{\frac{\log \mcN(\tilde\mcG, d_{n}, \eps)}{n}}\,d\eps + \sqrt{\frac{8 \ln (2/\delta)}{n}}. \label{eq:l2-bound-g}
\end{align}
\ethm
\bprf
We combine a Rademacher complexity bound with Dudley's entropy bound, in the Supplemental Material.
\eprf

We next derive a risk bound in terms the covering number for the underlying class $\mcF$ of pattern discovery functions. In some sense this is a more natural covering number to consider than the covering number of the shifted loss class $\tilde\mcG$ used in Theorem \ref{cor:l2-bound-g-metric}, since the ultimate goal is to choose a function from $\mcF$, not $\tilde\mcG$.
To obtain a relationship between covering numbers for $\mcF$ and $\tilde\mcG$, we must define a metric on $\mcF$ and relate it to the metric on $\tilde\mcG$. First, for $f_{1}, f_{2} \in \mcF$, define the (squared) metric for a single collection to be (with $Z := Z_{Q,S}$)
\beq \ell_{Q}^{2}(f_{1},f_{2}) := \frac{1}{Z}\sum_{U \in S(Q)} [f_{1}(X_{Q}, U) - f_{2}(X_{Q}, U)]^{2}. \eeq
The empirical metric we are interested in is
\beq \ell_{n}(f_{1},f_{2}) := \left[n^{-1}\sum_{i=1}^{n} \ell_{Q_{i}}^{2}(f_{1}, f_{2})\right]^{1/2}. \eeq
\bthm \label{thm:l2-bound-f-metric}
Under the same hypotheses as Theorem \ref{cor:l2-bound-g-metric},
\begin{align*}
L_{n}(f) &\le \bbE \int 24 \sqrt{\frac{\log \mcN(\mcF, \ell_{n}, \eps)}{n}}\,d\eps +  \sqrt{\frac{8 \ln (2/\delta)}{n}}.
\end{align*}
\ethm
\bprf
See the Supplementary Material.
\eprf
Hence, we can perform empirical risk minimization in the block pattern discovery framework.

\section{The Individual Pattern Discovery Problem} \label{sec:individual}

The block formulation of the pattern discovery problem applies to the examples from vision, crime, and medicine outlined in the introduction, but in many cases the structure of the problem may be different. Instead of working from blocks of patterns, and learning across blocks, we might wish to learn across patterns within a single block.
In the crime example, each pattern collection $Q_{i}$ represents an entire set of crimes, perhaps from several cities or different intervals of time. For a police department wanting to evaluate their pattern detection ability on individual patterns of crime, rather than crimes within blocks, we should try to predict when only a single pattern collection $Q$ is available.

In the {\em individual pattern  discovery} problem, the learner must use one collection $Q$ as training data instead of multiple collections $Q_{1},\dots,Q_{n}$. The task is then to partition newly observed data $X \in \mathscr S (\mathcal X)$ into patterns.  We assume the finite patterns arise from stochastic processes that are chosen i.i.d.~from an unknown probability distribution over processes. We allow these processes to take an arbitrary form (since, for example, a single criminal's crimes certainly are not i.i.d.). The task is to identify patterns in the observations that are not labeled as such. The individual pattern problem can thus be viewed as a kind of supervised, latent variable problem, where the pattern generating processes are the latent variables.

To formally define the individual pattern problem, let $\mcP$ be a distribution over patterns, so if $P \sim \mcP$, then $P \in \mathscr S (\mathcal X)$. We are given data $P_{1},\dots,P_{n} \overset{i.i.d.}{\sim} \mcP$, which together form a collection of patterns $Q = \{ P_{1},\dots,P_{n}\}$. Note that $i$ now indexes over patterns and $n$ denotes the number of patterns, not the number of pattern collections. Although the processes could themselves be random, since we assume all observations from each process are part of $Q$, all of the randomness of the processes can be absorbed into $\mcP$. It is therefore safe to equate each process with the pattern it generates.

As in the block case, we wish to choose a pattern discovery function $f : \mathscr S (\mathcal X) \to [0,1] \in \mcF$ to minimize a loss functional, though now $f$ does not have access to the whole set of observations $X_{Q}$, only the subset $U \subset X_{Q}$ that it is making a decision on. Writing $X$ in place of $X_Q$ when the underlying partition is unknown, the loss function is defined to be:
\[
\mathcal L_{\alpha}(f; P, X) &:= \frac{\alpha}{Z_{P}}\sum_{U \in \mathscr S(P)} \ell_{+}(f, U)   \label{eq:L-alpha} \\
& + \frac{1 - \alpha}{Z_{P,X}}\sum_{U \in S_{-}(P, X)} \ell_{-}(f, U), \nonumber
\]
where $Z_{P} = |\mathscr S(P)|$ and $Z_{P,X} = |S_{-}(P,X)|$ are normalization functions.
The functionals $\ell_{+}, \ell_{-} \in [0,1]$ define the losses on positive and negative examples, respectively.  $S_{-}(P,X)$ is the {\em negative example selector function}, which plays an analogous role to selector function for the block loss functional.  The weight factor $0 < \alpha < 1$ determines the relative importance of positive examples compared to negative examples, making the loss cost sensitive. It is necessary to weight the two sums, since otherwise in the limit as $n \to \infty$, the value of the loss could be determined solely by the negative examples. This is because as $n \to \infty$, $|X| \to \infty$ and thus $|S_{-}(P,X)| \to \infty$ while $|\mathscr S(P)|$ remains finite.

As with the general selector function $S$ for the block loss, choosing $S_{-}$ to select all negative examples would involve an exponentially large (in $|X|$) number of subsets. Therefore, instead we might define
\begin{equation}
S_{-}(P,X) = \{ U \cup \{ x \} \given U \in \mathscr S(P), x \in X \setminus P \}. \label{eq:negative-selector}
\end{equation}
That is, we look at how $f$ performs on sets that are almost patterns. This choice of selector is particularly relevant for greedy algorithms, and is used by \citet{Wang:2013}. We will assume that  $S_{-}$ takes the  form of equation \eqref{eq:negative-selector}, though our results can easily be adapted to other choices of $S_{-}$ that treat the elements of $X$ uniformly.

\section{Risk Bounds for the Individual Pattern Discovery Problem}
\label{sec:individual-bounds}

We will prove two results inspired by \citet{Bartlett:2002}. We will first introduce a new Rademacher complexity-like quantity to use in place of the covering number term. We will also show this quantity can be well-estimated empirically. As before, we define the empirical risk
\beqn \hR_{\alpha,n}(f) := n^{-1} \sum_{j=1}^{n} \mcL_{\alpha}(f, P_{j}, X_{Q}), \eeqn
the true risk $R_{\alpha,n}(f) := \bbE \hR_{\alpha,n}(f)$, and denote the difference by $L_{\alpha,n}(f) := \hR_{\alpha,n}(f) - R_{\alpha,n}(f)$. Note that unlike with the empirical risk $\hR_{n}$ in the block problem, the terms in the sum defining $\hR_{\alpha,n}(f)$ are not independent since they are all a function of $X_{Q}$. Recall that $\hR_{n}(f) = \frac{1}{n} \sum_{i=1}^{n}\mathcal L_{S}(f; Q_{i})$, where the $Q_{i}$'s are all independent of each other. Let
\begin{align}
\lefteqn{\hat\mcQ_{n}(\mcL_{\alpha}, \mcF)}   \\
&:= \bbE_{\veps}\bigg[\sup_{f \in \mcF} \big| n^{-1}\textstyle\sum_{i=1}^{n} \veps_{i} \mcL_{\alpha}(f, P_{i}, X_{Q})\big| \bigg| Q\bigg], \nonumber
\end{align}
where the $\veps_{i}$ are independent uniform $\{\pm 1\}$-valued random variables. Define the {\em quasi-Rademacher complexity} to be
\beqn
\mcQ_{n}(\mcL_{\alpha}, \mcF) := \bbE_{Q} \hat\mcQ_{n}(\mcL_{\alpha}, \mcF).
\eeqn
The quasi-Rademacher complexity is distinct from standard Rademacher complexity because the terms in the sum defining $\hat\mcQ_{n}(\mcL_{\alpha}, \mcF)$ are dependent via $X_{Q}$. Hence, like Rademacher complexity, it measures the ability of the function class $\mcF$ to fit random noise, though unlike Rademacher complexity, the loss function depends on all the observations.

The two main results in this section are based on McDiarmid's inequality  \citep{McDiarmid:1998}. For independent random variables $Y_{1},\dots,Y_{n}$ taking values in a set $V$, assume that the function $F : V^{n} \to \reals$ satisfies the condition that, for all $1 \le i \le n$,
\beqn
\sup_{y_{1},\dots,y_{n},y_{i}' \in V} |F(y_{1},\dots,y_{n}) - F(y_{1},\dots,y_{i}',\dots,y_{n})| \le c.
\eeqn
In ``expectation form,'' McDiarmid's inequality states that for any $0 < \delta < 1$, with probability at least $1 - \delta$,
\beqn
F(Y_{1},\dots,Y_{n}) \le \bbE F(Y_{1},\dots,Y_{n}) + \sqrt{\frac{n c^{2}\log(1/\delta)}{2}}.
\eeqn

In order to apply McDiarmid's inequality, we require the following lemma.
\blem \label{lem:loss-change}
Assuming $|P_{i}| \le B$ almost surely, then if one $P_{i}$ changes, the value of $\hR_{\alpha,n}(f)$ changes by at most $B_{\alpha}/n = \left(1 + 2(1-\alpha)B\right)/n$.
\elem
\bprf See the Supplemental Material. \eprf

To ensure generalization, we impose a constraint on the distribution of the number of observations $|P|$ in a pattern $P \sim \mcP$. The first result assumes that $|P|$ is bounded.
\bthm \label{thm:quasi-rademacher-bound}
Let $P_{1},\dots,P_{n} \overset{i.i.d.}{\sim} \mcP$ and assume $|P_{i}| \le B$ almost surely. Then for any positive integer $n$ and any $0 < \delta < 1$, with probability $1 - \delta$ over samples of length $n$, every $f \in \mcF$ satisfies
\beqn L_{\alpha,n}(f) \le 2\mcQ_{n}(\tilde\mcL_{\alpha}, \mcF) + \sqrt{\frac{8B_{\alpha}^{2} \ln (2/\delta)}{n}}, \eeqn
where $B_{\alpha} = 1 + 2(1-\alpha)B$ and $\tilde\mcL_{\alpha}(f; \cdot, \cdot) := \mcL_{\alpha}(f; \cdot, \cdot) - \mcL_{\alpha}(0; \cdot, \cdot)$ is the shifted loss.
\ethm
\bprf
See the Supplemental Material.
\eprf

Even though all of the $\mcL_{\alpha}$ terms in the risk are related through $X_{Q}$, we are able to control the effect of changing one $P_{i}$ on the losses $\mcL_{\alpha}(f; P_{j}, X_{Q})$ when $j \ne i$. This is the key to being able to design a bound for problems as complex as supervised pattern detection. If the distribution on $|P_{i}|$ is arbitrary, it is not in general possible to obtain bounds such as the one above. However, we can relax the assumption that the size is bounded and instead assume geometric tails for $|P_{i}|$. Under this weaker condition we achieve an $O(\sqrt{\log n / n})$ convergence  rate instead of $O(1 / \sqrt n)$.
\bthm \label{thm:quasi-rademacher-geom-bound}
Let $P_{1},\dots,P_{n} \overset{i.i.d.}{\sim} \mcP$ and assume that there exists a natural number $B_{0}$, a constant $C$, and a rate $0 < \lambda < 1$ such that for any $B \ge B_{0}$,  $\Pr[|P_{i}| > B] \le C\lambda^{B}$. Furthermore, assume that
\beqn B_{n} := \left\lceil\frac{\log(2Cn/\delta)}{\log(1/\lambda)}\right\rceil  \ge B_{0}. \label{eq:B-for-geom-bound} \eeqn
Then for any positive integer $n$ for which equation \eqref{eq:B-for-geom-bound} holds and all $0 < \delta < 1$, with probability $1 - \delta$ over samples of length $n$, every $f \in \mcF$ satisfies
\beqn L_{\alpha,n}(f) \le 2\mcQ_{n}(\tilde\mcL_{\alpha}, \mcF) + \sqrt{\frac{8B_{n,\alpha}^{2} \log(4/\delta)}{n}}, \eeqn
where
\beqn B_{n,\alpha} = 1 + 2(1-\alpha)B_{n}. \label{eq:B-n-alpha} \eeqn
\ethm
\bprf If we choose some fixed $B \ge B_{0}$, then consider the probability that the size of all patterns is at most $B$,
\beqa
\Pr[|P_{i}| \le B~\forall i = 1,\dots,n] &=& (1 - \Pr[|P_{i}| > B])^{n} \\
&\ge& 1 - n \Pr[|P_{i}| > B] \\
&\ge& 1 - nC\lambda^{B},
\eeqa
so the hypotheses required for Theorem \ref{thm:quasi-rademacher-bound} hold with probability at least $1 - nC\lambda^{B}$. If we set $nC\lambda^{B} \le \delta/2$ and make the substitution $\delta \to \delta/2$ in the statement of Theorem  \ref{thm:quasi-rademacher-bound}, by the union bound, with probability at least $1 - \delta$, every $f \in \mcF$ satisfies
\beq L_{\alpha,n}(f) \le 2\mcQ_{n}(\tilde\mcL_{\alpha}, \mcF) + \sqrt{\frac{8B_{\alpha}^{2} \ln (4/\delta)}{n}}. \eeq
Solving $nC\lambda^{B} \le \delta/2$ for $B$ implies that the minimal choice for $B$ is
\beq
B_{n} = \left\lceil\frac{\log(2Cn/\delta)}{\log(1/\lambda)}\right\rceil.
\eeq
The result now follows by substituting $B_{n}$ for $B$ in the expression for $B_{\alpha}$.
\eprf

{\em Remark 1.} The risk bound given in Theorem \ref{thm:quasi-rademacher-bound} shows that an important parameter in determining the difficulty of the pattern discovery problem is the size of the patterns. If the patterns $P_{1}, P_{2}, \dots$ contain a small number of elements (i.e., $B$ is small), then pattern discovery will be easier. We note that the cost paid for large $B$ is only linear in $B$. In the case of Theorem \ref{thm:quasi-rademacher-geom-bound} where patterns can be arbitrarily large, tighter risk bounds are possible when most of the patterns are small.

{\em Remark 2.} The theorems proven in this section are stated in terms of the number of patterns. However, risk bounds are typically given in terms of the number of observations made. While the bounds in terms of the number of patterns are tighter, they are, essentially, asymptotically equivalent to those stated in terms of the number of observations. To see this, first consider the case where $|P|$ is almost surely bounded by $B$ and let $m$ be the number of observations made. Then
\beq m = \sum_{i=1}^{n} |P_{i}| \le nB \eeq
Hence, the bound in Theorem \ref{thm:quasi-rademacher-bound} can be rewritten in terms of $m$, sacrificing at most a factor of $\sqrt B$.
\bcor  \label{cor:quasi-rademacher-bound}
Under the same hypotheses as Theorem \ref{thm:quasi-rademacher-bound}, if $m$ is the number of observations taken, then for any positive integer $n$ and any $0 < \delta < 1$, with probability $1 - \delta$ over samples of length $n$, every $f \in \mcF$ satisfies
\beqn L_{\alpha,n}(f) \le 2\mcQ_{n}(\tilde\mcL_{\alpha}, \mcF) + \sqrt{\frac{8B \cdot B_{\alpha}^{2} \ln (2/\delta)}{m}}.  \eeqn
\ecor

An analogous result for the case when $|P_{i}|$ has geometric tails can be state based on the following simple fact.
\blem \label{lem:obs-bound}
If $|P_{i}|$ has geometric tails, then the expected number of observations in a pattern is at most
\beqn B_{\lambda,C} :=  B_{0} + \frac{C\lambda^{B_{0}+1}}{1 - \lambda}(B_{0} + 1/(1 -\lambda)). \eeqn
\elem
\bprf The proof is given in the Supplementary Material and follows by standard geometric series properties.
\eprf

Since the tails of $|P_{i}|$ are geometric, the probability of $|P_{i}|$ being much greater than $B_{\lambda,C}$ is exponentially small. Thus, with high probability, the bound in Theorem \ref{thm:quasi-rademacher-geom-bound}, restated in terms of $m$ (as in Corollary \ref{cor:quasi-rademacher-bound}), is only worsened by a factor of $O(\sqrt{B_{\lambda,C}})$.

\subsection{Estimating $\mcQ_{n}$}
Like Rademacher complexity, quasi-Rademacher complexity can be empirically estimated efficiently.

\bthm
Assuming $|P_{i}| \le B_{0}$ almost surely~for $P_{i} \overset{i.i.d.}{\sim} \mcP$, then for any natural number $n$ and any $0 < \delta < 1$, with probability $1-\delta$ over $Q$ and $\veps$
\beqa
\bigg| \mcQ_{n}(\tilde\mcL_{\alpha}, \mcF) -  \sup_{f \in \mcF} |\hat\mcQ_{n}(\tilde\mcL_{\alpha}, f)| \bigg| \le \sqrt{\frac{8B_{\alpha}^{2} \ln (2/\delta)}{n}}
\eeqa
and with probability $1-\delta$ over $Q$
\beqa
\bigg| \mcQ_{n}(\tilde\mcL_{\alpha}, \mcF) - \hat\mcQ_{n}(\tilde\mcL_{\alpha}, \mcF) \bigg| \le \sqrt{\frac{8B_{\alpha}^{2} \ln (2/\delta)}{n}}
\eeqa
where
\beq \hat\mcQ_{n}(\tilde\mcL_{\alpha}, f) := n^{-1}\textstyle\sum_{i=1}^{n} \veps_{i} \mcL_{\alpha}(f, P_{i}, X_{Q}). \eeq
\ethm
\bprf A result analogous to Lemma \ref{lem:loss-change} can be proven for $\hat\mcQ_{n}(\tilde\mcL_{\alpha}, f)$ in place of $\hat\mcR_{n}(f)$, since they are the same up to changes in signs of the terms induced by the $\veps_{j}$. Thus, the proof is essentially identical. The theorem then follows from McDiarmid's inequality applied as in the proof of Theorem \ref{thm:quasi-rademacher-bound}. \eprf
Similar bounds can be obtained in the case that $|P_{i}|$ has a geometric tail (as long as equation \eqref{eq:B-for-geom-bound} holds) with the right hand sides of the inequalities in the previous theorem replaced by
\beq \sqrt{\frac{8 B_{n,\alpha}^{2} \log(4/\delta)}{n}}, \eeq
where $B_{n,\alpha}$ is given in Theorem \ref{thm:quasi-rademacher-geom-bound}.

\section{Algorithms and Applications for Individual Pattern Discovery}\label{sec:algs}

The theoretical guarantees in Section \ref{sec:individual} lead directly to the following general algorithm for individual pattern discovery. Before running this algorithm, the user:
\begin{enumerate}
\item chooses a parametric class of pattern discovery functions $f_{\beta}:\mathscr S (\mathcal X)\rightarrow [0,1]$, where $\beta \in \Gamma$; and
\item chooses a threshold $\theta\in [0,1]$. If a subset of observations $\hat{P}$ scores below $\theta$, that is $f_{\beta}(\hat{P})\leq\theta$ then we would not consider $\hat{P}$ a pattern.
\end{enumerate}
The algorithm is as follows: \\
\rule{.45\textwidth}{.1pt}
\begin{algorithm} \label{Alg:Ind}
~\newline
{\bf Input:}

\quad - Data consisting of the collection of

\quad ~~~observations $X$

\quad - Training patterns $P_1,\ldots,P_n$

\quad - Seed $S \subset X$ of a new potential pattern

\quad ~~~to be discovered.
\newline\newline
{\bf Output:} New pattern $\hat{P}$.
\newline\newline
Initialize $\hat{P}=S$. \vspace*{5pt}\\
Step 1. Train the pattern discovery algorithm on the known patterns $Q=\{P_1,\dots,P_n\}$ , as follows:
\(
\beta^{*} = \min_{\beta} \hR_{\alpha,n}(f_{\beta}) = \min_{\beta} n^{-1} \sum_{j=1}^{n} \mcL_{\alpha}(f_{\beta}, P_{j}, X_{Q})
\)
using the definitions from Section \ref{sec:individual} to define the loss function and selector function. Let
$f^{*} = f_{\beta^{*}}.$
\newline\newline
Step 2. Find new pattern.
\newline\newline
{\bf while} $f^{*}(\hat{P})>\theta$ {\bf do}

\quad Compute the best observation to add to the

\quad set $\hat{P}$:
      \(\hat{x}\in \textrm{argmax}_x f^{*}(\hat{P}\cup x).\)

\quad{\bf if} $f^{*}(\hat{P}\cup \hat{x})>\theta$ {\bf then}

\quad\qquad the pattern has a sufficiently high score,

\quad\qquad and we should add $\hat{x}$ to the pattern:
       \(\hat{P}\leftarrow \hat{P}\cup \hat{x}.\)
  \vspace*{5pt}
Return $\hat{P}$. \\
\rule{.45\textwidth}{.1pt}
\end{algorithm}

This algorithm has the advantage of being computationally tractable, and is directly motivated by our choice of selector function. In order to select the optimal parameter $\beta^{*}$, we need only consider subsets of the true patterns, along with an additional observation.
Also, for growing new patterns, the function $f^{*}$ was specifically trained to be able to distinguish observations that belong in the pattern from those that do not belong, which is ideal for this method.

\subsection{Application to Crime Pattern Detection} \label{sec:crimes}
An algorithm that is extremely similar to the one provided above was used by \citet{Wang:2013} to detect crime series in the city of Cambridge, MA. In that application:
\begin{itemize}
\item $X$ is a set of crimes, namely housebreaks, that happened between 1996 and 2007 in Cambridge, MA. Many details of each crime are available, including the date, time, day of the week, location, type of premise (apartment, house), location of entry (window, back door), means of entry (pried, cut screen), whether the dwelling was ransacked, etc.
\item $P_1,\ldots,P_n$ is a database of known crime patterns provided by the Cambridge police department that had been curated by their Crime Analysis Unit over the decade 1996-2007. Crimes in pattern $P_i$ were all hypothesized to have been committed by the same individual or group (they are ``crime series").
\item $f(P)$, $P \in \mathscr S (\mathcal X)$, is a nonlinear function of the details of crimes within the pattern,  called ``pattern-crime similarity," parameterized by a vector $\lambda$. In particular, within function $f$ is a linear combination of similarity measures between crimes, where $\lambda$ are the linear coefficients. For instance, if $j$ is the coefficient for location, and the value of the learned $\lambda_j$ is large, it means that location is an important factor in determining whether a set of crimes is indeed part of a crime series.
\item A loss function that is similar to (but slightly different than) the one provided in Section \ref{sec:individual} was used to train the algorithm on past patterns $P_1,\ldots,P_n$ along with the rest of the crimes $\mathcal{X}$ to determine values for vector $\lambda$.
\item A threshold similar to $\theta$ was used to determine when to stop growing the crime pattern. In particular, when the series becomes less cohesive after adding more crimes, the series is considered to be complete.
\end{itemize}
The algorithm of \citet{Wang:2013} has been successful in being able to detect patterns of crime in Cambridge, and in a blind test with Cambridge crime analysts, it has been able to locate 9 crimes that belong in patterns that were not previously identified as such, and it was able to exclude 8 crimes that analysts previously thought were part of a pattern (they now agree that these crimes are not part of a pattern). In one case, the exclusion of a crime from a pattern helped to narrow the suspect description down to one possible race and gender (white male).

\subsection{Application to Set Completion and ``Growing a List" in Information Retrieval} \label{sec:list-grow}
Another algorithm similar to Algorithm \ref{Alg:Ind} was used for the problem of set completion in information retrieval. A ``set completion engine" is a next generation search engine. It takes a few seed examples, of almost anything, and simply aims to produce more of them. For instance, a search starting with seed ``Boston Harborfest" and ``South Boston Street Festival" should yield a list of more large annual events in Boston. The algorithm of \citet{LethamRuHe13} for growing a list of items from a seed uses an algorithm similar to Algorithm \ref{Alg:Ind} in that at each iteration, a new item is added to the set. Here:
\begin{itemize}
\item $X$ is a set of all terms and phrases found on the internet.
\item $P_1,\ldots,P_n$ is a set of gold standard completed sets, such as the ``List of $\ldots$" articles on Wikipedia used for experiments of \citet{LethamRuHe13}.
\item $f(P)$, $P \in \mathscr S (\mathcal X)$, is a linear combination of similarities between terms, with coefficients chosen for the Bayesian Sets algorithm of \citet{GhahramaniHeller}. This algorithm is unsupervised, meaning that the training step in Algorithm \ref{Alg:Ind} is replaced with a Bayesian prior.
It would not be difficult to design a supervised algorithm that learns the prior hyper-parameters of Bayesian Sets, rather than having the user choose them. In the experiments of \citet{LethamRuHe13}, the parameters were chosen using a heuristic. The terms that are combined are indicator variables of the internet domains where items can be found.
\end{itemize}
In the case of growing a list, \citet{LethamRuHe13} showed that as long as the feature space and score $f$ are constructed correctly, the results coming from this algorithm are accurate enough to be used in practice, and are substantially more accurate than other methods currently in use for set completion, including Boo!Wa!\footnote{www.boowa.com} and Google Sets.\footnote{Google Sets is available through Google Spreadsheet.}

The present work thus provides theoretical foundations for the methodologies used by \citet{Wang:2013} and \citet{LethamRuHe13} that we discussed in the Sections \ref{sec:crimes} and \ref{sec:list-grow}.


\section{\@startsection {section}{1}{\z@}%
                               {-3.5ex \@plus -1ex \@minus -.2ex}%
                               {2.3ex \@plus.2ex}%
                               {\normalfont\large\bfseries}}
\makeatother

\newcommand*{\problem}{%
  \needspace{2\baselineskip}%
\section[]{{\color{lightgray}\hrule height 2pt}\hfill}
\subsection[]{{\color{lightgray}\hrule height 1.5pt}\hfill}
}

\begin{document}\thispagestyle{empty}

\vspace{0.5cm}

\def\arabic{footnote}{\arabic{footnote}}
\setcounter{footnote}{0}

\def\sigma{\sigma}
\def\nonumber{\nonumber}
\def\partial{\partial}
\def\left[{\left[}
\def\right]{\right]}
\def\left\{{\left\{}
\def\right\}{\right\}}

\newcommand{\begin{eqnarray}}{\begin{eqnarray}}
\newcommand{\end{eqnarray}}{\end{eqnarray}}
\newcommand{\begin{itemize}}{\begin{itemize}}
\newcommand{\end{itemize}}{\end{itemize}}
\renewcommand{\th}{\theta}
\newcommand{\overline{\theta}}{\overline{\theta}}

\vspace{0.5cm}
\begin{center}

{\large \bf
On the Starobinsky Model of Inflation from  Supergravity

}
\\[1.5cm]
{\large  F. Farakos$^{a}$, A. Kehagias$^{a,b}$ and A. Riotto$^{b}$}
\\[0.5cm]

\vspace{.3cm}
{\normalsize {\it  $^{a}$ Physics Division, National Technical University of Athens, \\15780 Zografou Campus, Athens, Greece}}\\

\vspace{.3cm}
{\normalsize { \it $^{b}$ Department of Theoretical Physics and Center for Astroparticle Physics (CAP)\\ 24 quai E. Ansermet, CH-1211 Geneva 4, Switzerland}}\\

\vspace{.3cm}

\end{center}

\vspace{3cm}

\hrule \vspace{0.3cm}
{\small  \noindent \textbf{Abstract} \\[0.3cm]
\noindent
We discuss how the higher-derivative Starobinsky model of inflation originates
from  ${\cal{N}}=1$ supergravity. It is known that,  in the old-minimal supergravity
description written
by employing a chiral compensator in the superconformal framework, the Starobinsky model  is equivalent to a no-scale model
with $F$-term potential. We show that the Starobinsky model can also be originated
within the so-called  new-minimal supergravity, where a linear compensator superfield
is employed.
In this formulation, the
Starobinsky model  is equivalent to standard supergravity coupled to a massive vector multiplet whose
lowest scalar component plays the role of the inflaton and the vacuum energy is provided by  a
 $D$-term potential. We also point out that higher-order  corrections to the  supergravity
 Lagrangian represent a threat to the   Starobinsky model as they can destroy the flatness of the inflaton potential in its scalar field
 equivalent description.

\vspace{0.5cm}  \hrule
\vskip 1cm

\def\arabic{footnote}{\arabic{footnote}}
\setcounter{footnote}{0}

\baselineskip= 19pt
\newpage
\section{Introduction}\pagenumbering{arabic}
If the perturbations during inflation \cite{lr} are originated by the same field driving inflation,
the inflaton, then the recent Planck data on the cosmic microwave background radiation anisotropies
have severely constrained the models of single-field inflation \cite{Ade:2013uln}.
Indeed, successful models have to predict a significant red tilt in the two-point correlator of the scalar
curvature perturbation, measured
by the spectral index $n_s=0.960\pm 0.007$, and a low enough amount of tensor perturbations quantified by the
current bound on the tensor-to-scalar ratio,   $r<0.08$. One of the models which better passes these constraints is
the higher-derivative $R^2$ Starobinsky model \cite{star}. It is described by the Lagrangian
(we set from now on the reduced Planckian mass to unity)
\begin{eqnarray}
\label{R^2} {\cal L}_{\text{star}} =\sqrt{-g}\left(R + \lambda_0  R^2\right), \,\,\, \ \lambda_0 > 0
\end{eqnarray}
and it contains,  besides the graviton, one additional degree of freedom.
The coupling constant $\lambda_0$ is positive in order to avoid instabilities.
Indeed, one can  rewrite the Lagrangian (\ref{R^2}) as \cite{Whitt:1984pd}
\begin{eqnarray}
\label{R2}
 {\cal L}_{\text{star}} =  \sqrt{-g}\left(R + \lambda_0  R\psi-\frac{1}{4} \lambda_0 \psi^2\right)
\end{eqnarray}
and, upon integrating out $\psi$, one gets back the original theory (\ref{R^2}).
Note that this is a classical equivalence.
After writing the expression (\ref{R2}) in the Einstein
frame by means of the conformal transformation
\begin{eqnarray}
g_{\mu\nu}\to e^{-2\phi}g_{\mu\nu}=\left(1+\lambda_0\psi\right)^{-1} g_{\mu\nu},
\end{eqnarray}
we get the equivalent scalar field version of the Starobinsky model
\begin{eqnarray}
 {\cal L}_{\text{star}} =  \sqrt{-g}\left[R-6\partial_\mu\phi\partial^\mu \phi-\frac{1}{4\lambda_0}(1-e^{-2\phi})^2\right]. \label{R3}
\end{eqnarray}
and the positivity of $\lambda_0$ is now obvious.
Inflation takes place when the scalar field is slowly-rolling along its potential plateau obtained for $\phi\gg 1$ and in order to achieve a sufficient number of e-folds the plateau must be at least as wide as ${\cal O }(5)$ in Planckian units.

In this paper we investigate the possibility of embedding   the  Starobinsky model into superconformal
theory and ${\cal{N}}=1$  supergravity.
This extension is not unique.
The reason is that there are two ways for
the graviton, sitting along with the gravitino,  to fill a supergravity multiplet and one needs  a set of auxiliary fields
to define the off-shell supergravity multiplet. The minimal case should contain only the gravitino as fermionic content. This
 means that we need a total of 12 bosonic degrees of freedom to match the 12 degrees of freedom of the gravitino.
This is the so-called (12+12) supergravity theories and there are two of them\cite{Gates:1983nr,Buchbinder:1995uq}: the old-minimal supergravity and the new-minimal one.
The auxiliary fields of the old-minimal supergravity are a complex scalar and a vector, whereas the new-minimal supergravity
has a gauge one-form (gauging an $R$-symmetry) and a gauge two-form field. In particular, at the two derivative level, these
two minimal supergravities are the same as they are related by some duality transformation of their auxiliary sectors. However,
when higher derivatives appear, this duality does not work and the two theories are different.
Earlier \cite{Cecotti:1987sa,ketov} and recent \cite{Ellis,linde,buch} embeddings of the Starobinsky model have been all based on the old-minimal
formulation of ${\cal{N}}=1$ supergravity.

An appropriate framework to discuss minimal supergravities is the superconformal calculus \cite{conf,Gates:1983nr,Buchbinder:1995uq,butter}
which we employ here.
To go to the desired Poincar\'e supergravity one fixes the appropriate compensator field and breaks the conformal symmetry.
This framework offers a connection between the different auxiliary field structure of the minimal Poincar\'e supergravities \cite{aux}.
Depending on the compensator, after gauge fixing
the superconformal symmetry, one recovers either old or new-minimal supergravity: with a chiral compensator, the old-minimal
supergravity is obtained whereas with  a real linear compensator superfield the new-minimal one is recovered.

The goal of this paper is two-fold: on one side, we wish to show that the Starobinsky model can be derived also from the
new-minimal formulation of supergravity in such a way that the vacuum energy driving inflation can be  identified with a $D$-term; on the other hand we want to point out that the  embedding of the Starobinsky model both in old- and new-minimal  supergravity
suffers of a potential problem deriving from the presence of higher-order corrections which may spoil the plateau of the potential of the scalar field driving inflation. This is reminiscent of the so-called $\eta$-problem \cite{lr} which arises when a model of inflation is embedded in  supersymmetry and the flatness of the potential is usually  spoiled by supergravity corrections \cite{lr}.

The paper is organized as follows. We describe the embedding  of the Starobinsky model within the old-minimal supergravity formulation in section 2 and within the new-minimal supergravity formulation in section 3. In section 4 we describe the potential danger represented by higher-order corrections in both formulations. Finally, we conclude in section 5.

\section{Starobinsky model  in the old-minimal supergravity }
We start by writing the Lagrangian that is appropriate to reproduce
the supergravity version of the  Starobinsky model in the old-minimal framework
\begin{eqnarray}
\label{OM1}
{\cal L} = -3 [S_0 \overline{S}_0]_D +3 \lambda_1 [ {\cal R} {\cal \overline{R}} ]_D,
\end{eqnarray}
with
\begin{eqnarray}
\label{R}
{\cal R} =-\frac{1}{4} S_0^{-1} \overline{\nabla}^2 \overline{S}_0.
\end{eqnarray}
Here  $S_0$ is the compensator chiral superfield, with scaling weight equal to $1$ and chiral weight $2/3$,
the curvature chiral superfield ${\cal R}$ has scaling weight equal to $1$ and chiral weight $2/3$ as well,
and $[{\cal{O}}]_D$ is the standard $D$-term density formula of conformal supergravity \cite{butter},
where ${\cal{O}}$ is a real superfield with scaling weight $2$ and vanishing chiral weight.
After gauge fixing the superconformal symmetry and choosing
\begin{eqnarray}
\label{S_0}
S_0 = 1,
\end{eqnarray}
the superspace geometry is described by the old-minimal formulation,
see for example Ref. \cite{W&B}.
Then Eq. (\ref{OM1}) becomes
\begin{eqnarray}
\label{OM1P}
{\cal{L}}= -3 \int {\rm d}^2 \Theta \, \, 2 \, {\cal{E}} \left\{ {\cal{R}}
+\frac{\lambda_1}{8} \Big{(} \overline{{\cal{D}}}\overline{{\cal{D}}} - 8 {\cal{R}} \Big{)} \Big{(} {\cal{R}} \overline{{\cal{R}}}  \Big{)}
\right\}+ {\rm h.c.}
\end{eqnarray}
It is easy to verify that the bosonic part
of  Eq. (\ref{OM1P}) contains the Lagrangian (\ref{R^2})
\begin{eqnarray}
{\cal L}\supset R+\lambda_1 R^2
\end{eqnarray}
and therefore is a good candidate for the supergravity theory we are after \cite{R2D2}.
The next step is to write the expression (\ref{OM1}) as  standard supergravity with additional degrees of freedom
in the same way we have traded the $R^2$ term in non-supersymmetric case (\ref{R^2}) by a scalar field
coupled to Einstein gravity in (\ref{R2}). This can be implemented by using appropriate Lagrange multipliers.
Hence,
we introduce a chiral superfield $J$ with scaling weight $1$ (chiral weight 2/3)
and a chiral Lagrange multiplier $\Lambda$ with scaling weight $2$ (chiral weight 4/3)
and the equivalent Lagrangian to (\ref{OM1}) is
 \cite{Cecotti:1987sa}
\begin{eqnarray}
\label{OM2}
{\cal L} = -3 [S_0 \overline{S}_0]_D +3 \lambda_1 [ J \overline{J} ]_D +3 ( [ \Lambda ( J - {\cal R}  )]_F +{\rm h.c.} )
\end{eqnarray}
where $[{\cal{O}}]_F$ is the standard $F$-term density formula of conformal supergravity \cite{butter},
with ${\cal{O}}$ a chiral superfield having scaling weight $3$ and chiral weight $2$.
Indeed, integrating out the Lagrange multiplier chiral superfield $\Lambda$ from Eq. (\ref{OM2}) we get
\begin{eqnarray}
\label{J1}
J = {\cal R}
\end{eqnarray}
and  Eq.  (\ref{OM1}) is reproduced by Eq. (\ref{OM2}).
By using the identity
\begin{eqnarray}
\label{FtoD}
[ \Lambda  {\cal R}    ]_F =  [ \Lambda \overline{S_0} S_0^{-1} ]_D,
\end{eqnarray}
Eq. (\ref{OM2}) can be recast in the form
\begin{eqnarray}
\label{OM3}
{\cal L} = -3 [S_0 \overline{S}_0]_D +3 \lambda_1 [ J  \overline{J} ]_D
-3 [ \Lambda \overline{S_0} S_0^{-1} ]_D - 3[ \overline{\Lambda} S_0 \overline{S}_0^{-1} ]_D
+3 ( [\Lambda J ]_F +{\rm h.c.} ),
\end{eqnarray}
and will lead to standard Poincar\'e supergravity.
By defining new chiral superfields ${\cal C}$ and ${\cal T}$ defined in terms of our original $J$ and $\Lambda$ as
\begin{eqnarray}
\label{TC}
{\cal C}= \sqrt{\lambda_1} S_0^{-1} J  \ ,~~~ \  {\cal T} = \frac{1}{2} + S_0^{-2} \Lambda,
\end{eqnarray}
Eq. (\ref{OM3}) turns out to be
\begin{eqnarray}
\label{OM4}
{\cal L} = -3 \Big{[}S_0 \overline{S}_0 ( {\cal T} + \overline{{\cal T}} - {\cal C} \overline{{\cal C}} )\Big{]}_D
+ 3\lambda_1^{-1/2} \left( \left[ {\cal C} \, \left({\cal T} -\frac{1}{2} \right) S_0^3 \right]_F +{\rm h.c.}\right).
\end{eqnarray}
We recognize in  Eq. (\ref{OM4}) the characteristic form of a no-scale model \cite{Cecotti:1987sa}. In particular, the fields
${\cal C}$ and ${\cal T}$ parametrize the scalar manifold $SU(2,1)/U(2)$.
Note that the theory  is not gauged and  the potential is due to an $F$-term, the second term in (\ref{OM4}).
We now gauge fix the superconformal symmetry in order for the
superspace to be described by the old-minimal formulation.
Then Eq. (\ref{OM4}) turns out to be
the standard old-minimal supergravity Lagrangian coupled to chiral superfields
\begin{eqnarray}
\label{OM5}
{\cal{L}}=\int {\rm d}^2 \Theta \, \, 2 \, {\cal{E}} \left\{
\frac{3}{8} \Big{(} \overline{{\cal{D}}}\overline{{\cal{D}}} - 8 {\cal{R}} \Big{)} e^{ - K/3 } + W
\right\}+ {\rm h.c.}
\end{eqnarray}
with K\"ahler potential
\begin{eqnarray}
\label{K1}
K = -3\, \ln\Big{(}{\cal T} + \overline{{\cal T}} - {\cal C} \overline{{\cal C}}\Big{)}
\end{eqnarray}
and superpotential
\begin{eqnarray}
\label{W1}
W=  \frac{3}{\sqrt{\lambda_1}} {\cal C} \left({\cal T} - \frac{1}{2}\right).
\end{eqnarray}
The bosonic sector of the final Lagrangian is
\begin{eqnarray}
\label{OM6}
e^{-1}{\cal L} = \frac{1}{2} R  - K_{i {\overline{j}}} \partial_{\mu} z^i \partial^{\mu} \overline{z}^{\overline{j}}
-\ V_F
\end{eqnarray}
with
\begin{eqnarray}
\label{VF1}
V_F =  e^{K} \left[ K^{i {\overline{j}}} (D_iW) (D_{\overline{j}}\overline{W}) -3 W \overline{W} \right], ~~~ \, i,j=1,2,
\end{eqnarray}
where $z^1=T$ and $z^2=C$ the scalar lowest components of the chiral superfields ${\cal T}$ and ${\cal C}$.
We have used the standard notation
\begin{eqnarray}
K_i=\frac{\partial K }{ \partial z^i}\, , ~~~K_{i {\overline{j}}} =
\frac{\partial^2 K(z,\overline{z})}{\partial z^i \partial\overline{z}^{\overline{j}}}\, , ~~~~
 \label{DW} D_iW=W_i +K_iW ,~~~~W_i=\frac{\partial W }{ \partial z^i}.
 \end{eqnarray}

The superpotential (\ref{W1}) belongs to a specific class of supergravity theories
studied in \cite{kal-lin}, where together with
a K\"ahler potential invariant under $C\to - C$,  a local extremum at $C=0$ appears.
This also happens in our case as there
is a local extremum at $C={\rm Im}\,T=0$ where we have the inflationary potential.
Indeed, by parametrizing  the complex scalar $T$ by two real scalar $\phi,b$, as
\begin{eqnarray}
\label{T}
T=\frac{1}{2}e^{\frac{2}{\sqrt{3}} \phi} + i b,
\end{eqnarray}
we find that there is an extremum at
$C=b =0,$
where the effective bosonic theory turns  out to be
\begin{eqnarray}
\label{OM7}
e^{-1}{\cal L} = \frac{1}{2} R  -   \partial_{\mu} \phi  \partial^{\mu} \phi
-\ \frac{3}{2 \lambda_1 } \,  \left(1-e^{-\frac{2}{\sqrt{3}} \phi}\right)^2 .
\end{eqnarray}
This is just the Starobinsky theory formulated in terms of the extra scalar degree of freedom.
However, there is a possibility  of a tachyonic instability for
excitations along
the inflationary trajectory $C=0$. Indeed, the mass of such excitations are \cite{kal-lin}
\begin{eqnarray}
m^2_{\pm}=-\left(K_{CC\bar{C}\bar{C}}\pm \big{|}K_{CC\bar{C}\bar{C}}-K_{CC}\big{|}\right)|f|^2+|\partial_Tf|^2
\end{eqnarray}
for a general superpotential $W=C f(T)$ and a K\"ahler potential invariant under $C\to -C$. It is easy to check that
in our case we have in fact a tachyonic instability during the inflationary phase. A remedy can be  modifying
the K\"ahler potential appropriately \cite{linde}. We may consider, for example, instead of (\ref{OM1}) the theory
\begin{eqnarray}
\label{OM21}
{\cal L} = -3 [S_0 \overline{S}_0]_D +3 \lambda_1 [ {\cal R} {\cal \overline{R}} ]_D
+ 3 \zeta \, [{\cal R} {\cal \overline{R}} \ {\cal F}\left({\cal R} {\cal \overline{R}} (S_0\overline{S}_0)^{-1} \right) ]_D .
\end{eqnarray}
After writing this theory as   standard supergravity as we have done for (\ref{OM1}) and gauge fixing $S_0 =1$,
the new term does not change the superpotential and  changes only the corresponding K\"ahler potential,
which turns out  to be
\begin{eqnarray}
\label{K7}
K = -3\, \text{ln}\,\big{(} {\cal T} + \overline{{\cal T}} - {\cal C} \overline{{\cal C}} [ 1
+ \zeta \, \lambda_1^{\, -1} \,  {\cal F} ({\cal C} \overline{{\cal C}} \, \lambda_1^{\, -1}) ] \big{) }.
\end{eqnarray}
As suggested in Ref. \cite{linde}, the choice
\begin{eqnarray}
{\cal F} = - \lambda_1 {\cal C} \overline{{\cal C}}+\cdots
\end{eqnarray}
will stabilize the inflationary trajectory and give rise to a consistent theory for appropriate values of $\zeta$.
A different approach to Starobinsky inflation in supergravity has been
followed in  Refs. \cite{ketov} where  appropriate F-supergravity
extension of f(R) gravity has been employed, dual to the standard approach
in terms of
K\"ahler potentials and superpotentials.

Let us now turn to the alternative derivation of the same Lagrangian in the new-minimal supergravity formulation.

\section{Starobinsky model in new-minimal supergravity}
In this section we want to show that there  is another way to write a supergravity which contains the Lagrangian (\ref{R^2}) in its bosonic sector.
The appropriate compensator for the new-minimal supergravity gauging
is a real linear multiplet ($L_0$) with scaling weight $2$ and vanishing weight under chiral rotations.
We employ now the following Lagrangian
\begin{eqnarray}
\label{NM1}
{\cal L} = [ L_0 V_R ]_D +  \frac{\lambda_2}{4} ( [ W^{\alpha}(V_R) W_{\alpha}(V_R)]_F +{\rm h.c.} ),
\end{eqnarray}
where
\begin{eqnarray}
\label{VR}
V_R &=& \text{ln}\,\left(\frac{L_0}{Y_0\overline{Y}_0}\right),
\\
\label{VRW}
W_{\alpha}(V_R) &=&-\frac{1}{4} \overline{\nabla}^2 \, \nabla_{\alpha} (  V_R )
\end{eqnarray}
and $Y_0$ a chiral superfield with scaling weight $1$.
After gauge fixing the superconformal symmetry and choosing
\begin{eqnarray}
\label{L_0}
L_0 = 1
\end{eqnarray}
the superspace geometry is described by the new-minimal formulation,
see for example Refs. \cite{Sohnius:1982fw,Ferrara:1988qxa}.
Indeed, fixing the superconformal symmetry by  $L_0=1$, we get that the
 graviton multiplet contains  four fields, the physical graviton $e_\mu^a$,
the gravitino $\psi_\mu$ and two auxiliary gauge fields $A_\mu$,
and $B_{\mu\nu}$ with corresponding gauge invariances
\begin{eqnarray}
\delta A_\mu=\partial_\mu\phi\, , ~~~~\delta b_{\mu\nu}=\partial_\mu b_\nu-\partial_\nu b_\mu.
\end{eqnarray}
In fact, $A_\mu$ gauges the $U(1)_R$ $R$-symmetry of the superconformal algebra, which survives
after the gauge fixing (\ref{L_0}).
Then, the desired theory is described by the following new-minimal Poincar\'e superspace density
\begin{eqnarray}
\label{NM1f}
{\cal{L}}=\int {\rm d}^2 \Theta  \, \, 2 \, {\cal{E}} \left\{
- \frac{1}{8}  \overline{{\cal{D}}}\overline{{\cal{D}}} V_R
+ \frac{\lambda_2}{4} \, W^{\alpha}(V_R) W_{\alpha}(V_R)  \right\}+ {\rm h.c.},
\end{eqnarray}
where now $V_R$ turns out to be the gauge multiplet of the supersymmetry algebra, namely
\begin{eqnarray}
\label{gaugemult}
V_R=\left(- H_\mu + \frac{1}{3} A_\mu,
- \frac{1}{3}\gamma_5\gamma^\nu
r_\nu,
-\frac{1}{6}\hat{\cal{R}} - H_\mu H^\mu \right),
\end{eqnarray}
where $r_\nu$ is the supercovariant gravitino field strength, $\hat{R}$ is the (supercovariant) Ricci scalar
and $H^\mu$ the Hodge dual of the (supercovariant) field strength for the auxiliary two-form \cite{Ferrara:1988qxa}.
The first terms in Eq. (\ref{NM1f}) is easily recognized as the Fayet-Iliopoulos term for the gauge multiplet,
whereas the second is its standard kinetic term.
Since the highest component $D_R$ of the gauge multiplet contains the Ricci
scalar ($D_R\sim R$), clearly we will get the desired
$D_R+\lambda_2 D_R^2\sim R+\lambda_2 R^2$ from the terms in  Eq. (\ref{NM1f}).
See Ref. \cite{Cecotti:1987qe} for a thorough discussion.

As a first step to write Eq. (\ref{NM1}) as standard Poincar\'e supergravity,
we consider $L_0$ as an unconstrained real superfield
(note that by employing the equation of motion for $Y_0$ we can make $L_0$ real linear again).
Then one can check that the following Lagrangian
\begin{eqnarray}
\label{NM2}
{\cal L} = [ L_0 V_R ]_D + \frac{\lambda_2}{4} ( [ W^{\alpha}(V) W_{\alpha}(V)]_F +{\rm h.c.} ) + [L' ( V - V_R)]_D
\end{eqnarray}
reproduces Eq. (\ref{NM1}) when we integrate out the real linear superfield $L'$ to find
\begin{eqnarray}
\label{L'1}
V= \text{ln}\,\left(\frac{L_0}{Y_0\overline{Y}_0}\right) - \text{ln}\,\Phi  - \text{ln}\,\overline{\Phi}  +c
\end{eqnarray}
and plug it back into Eq. (\ref{NM2}).
Now, in order to write the theory as standard supergravity, we go in the opposite direction.
We again perform a variation with respect to $L'$, but now we interpret the equation of motion as
\begin{eqnarray}
\label{L'2}
\text{ln}\,\left(\frac{L_0}{Y_0\overline{Y}_0}\right) = V + \text{ln}\,\Phi  + \text{ln}\,\overline{\Phi}  + c,
\end{eqnarray}
which can be solved for $L_0$ by
\begin{eqnarray}
\label{L'3}
\frac{L_0}{Y_0\overline{Y}_0} = \overline{\Phi} e^{V + c} \Phi.
\end{eqnarray}
The final step is to plug back Eq. (\ref{L'3}) (or (\ref{L'2})) into Eq. (\ref{NM2}) to get
\begin{eqnarray}
\label{NM3}
{\cal L} = [ Y_0 \overline{Y}_0 ( \overline{\Phi} e^{V + c} \Phi \ \text{ln}\,( \overline{\Phi} e^{V + c} \Phi ) )]_D
+\frac{\lambda_2}{4} ( [ W^{\alpha}(V) W_{\alpha}(V)]_F +{\rm h.c.} ).
\end{eqnarray}
The action (\ref{NM3}) is the dual action to (\ref{NM1})
\cite{Cecotti:1987qr,Cecotti:1987qe}.
Since $c$ is just an integration constant we can take $c=0$.
Note that our theory here is gauged and that the potential is thus due to the standard $D$-term, in contrast to the expression (\ref{OM4}).
Again gauge fixing superconformal invariance and setting
$$Y_0 = 1,$$
we recover the following standard ${\cal{N}}=1$ supergravity
\begin{eqnarray}
\label{NM4}
{\cal{L}}=\int {\rm d}^2 \Theta \, \, 2 \, {\cal{E}} \left\{
\frac{3}{8} \Big{(} \overline{{\cal{D}}}\overline{{\cal{D}}} - 8 {\cal{R}} \Big{)} e^{ - K/3 }
+ \frac{\lambda_2}{4} \, W^{\alpha} W_{\alpha}  \right\}+ {\rm h.c.},
\end{eqnarray}
with the K\"ahler potential
\begin{eqnarray}
\label{K2}
K = -3 \ln \left[-\frac{1}{3} \overline{\Phi} e^{V} \Phi \ln( \overline{\Phi} e^{V} \Phi )  \right].
\end{eqnarray}
In component form the expression (\ref{NM4}) reads (after rescaling $V \rightarrow 2V$)
\begin{eqnarray}
\nonumber
e^{-1}{\cal{L}}&=& \frac{1}{2} R
- K_{A {\overline{A}}} D_\mu A  \overline{D^\mu A} +\frac{1}{2} \left(K_A A + K_{\overline{A}} \overline{A}   \right)\, D
\\
\label{NM5}
 &-&2 \lambda_2
\left(  \frac{1}{2} F^{\mu\nu} F_{\mu\nu}
-\frac{i}{4} \epsilon^{\mu\nu\rho\sigma} F_{\mu\nu} F_{\rho\sigma}
- D^2 \right)
\end{eqnarray}
with
\begin{eqnarray}
D_\mu A = \partial_\mu A +i A_\mu A,
\end{eqnarray}
and after  integrating out the auxiliary $D$ we get
\begin{align}
\label{NM6}
e^{-1}{\cal{L}}&=\frac{1}{2} R -2 \lambda_2
\left(  \frac{1}{2} F^{\mu\nu} F_{\mu\nu}-
\frac{i}{4} \epsilon^{\mu\nu\rho\sigma} F_{\mu\nu} F_{\rho\sigma}
 \right)
- \frac{3}{ A\overline{A}  \left[\ln (A\overline{A}) \right]^{2} }
D_\mu A \,\overline{D_\mu A}
-\frac{9}{8 \lambda_2} \left[ 1 + \frac{1}{\ln(A \overline{A} )}  \right]^2.
\end{align}
With the redefinition
\begin{eqnarray}
\ln A=  - \frac{1}{2} e^{\frac{2}{\sqrt{3}} \phi } + i a,
\end{eqnarray}
the expression (\ref{NM6}) is finally written as (with $\lambda_2=1/4g^2$)

\begin{align}
\label{NM7}
 e^{-1}{\cal{L}}& = \frac{1}{2} R -
 \frac{1}{4g^2} F^{\mu\nu} F_{\mu\nu}+
\frac{i}{8g^2} \epsilon^{\mu\nu\rho\sigma} F_{\mu\nu} F_{\rho\sigma}
- 3 e^{ - \frac{4}{\sqrt{3}} \phi }\big{(}\partial_\mu a + A_\mu\big{)}^2\nonumber \\
 &
 -\partial_\mu \phi \partial^\mu \phi
-\frac{9}{2 } g^2\left( 1 -   e^{-\frac{2}{\sqrt{3}} \phi }  \right)^2.
\end{align}
This describes a massive vector with mass
\begin{eqnarray}
m_A=\sqrt{6} g\, e^{-2\phi/\sqrt{3}}
\end{eqnarray}
in Planck units, and a singlet scalar $\phi$. The latter can be considered as the inflaton field with a $D$-term potential
\begin{eqnarray}
\label{VD1}
 V_D = \frac{9}{2 }g^2 \left( 1 - e^{-\frac{2}{\sqrt{3}} \phi }  \right)^2.
\end{eqnarray}
Therefore, the $R^2$ new-minimal supergravity is described by standard supergravity
coupled to a massive vector superfield. The latter contains a real scalar in its lowest component (the $\phi$ field here)
and a massive $U(1)$ vector in its bosonic sector. Thus, the Starobinsky model stems from  the new-minimal supergravity  constructed
by means of a  massless vector multiplet and a chiral multiplet. The vector eats one of the scalars of the
chiral multiplet and becomes massive, whereas the other scalar of the chiral acquires a $D$-term potential. All together,
the massless vector and the two scalars of the chiral, rearrange themselves such that to form standard supergravity coupled
to a massive vector multiplet. Note that the scalar $\phi$ is what is usually fixed to zero by
imposing the Wess-Zumino gauge in exact gauge invariance.

\section{The  issue  of higher-order corrections}
Before concluding, we  would like to discuss a relevant issue that might represent a potential danger to the embedding of the the
Starobinsky model into supergravity: higher order corrections. As we shall see, both in the old- and new-minimal supergravity formulation of the Starobinsky model, one can add non-renormalizable higher-order corrections  which are admitted by the symmetries and might spoil the plateau of the inflaton potential necessary to drive inflation.

\subsection{Corrections in new-minimal supergravity}
Let us first discuss the possible corrections to the inflaton potential (\ref{VD1}) obtained in the new-minimal version.
These corrections are generated as  corrections
to the superconformal action (\ref{NM1}). However,
all possible non-renormalizable terms are  restricted by
gauge invariance. Possible corrections could arise from higher-order $D$-terms of the supersymmetric field strength $W_\alpha$.
In conformal superspace we may consider
\begin{eqnarray}
\nonumber
{\cal L} &=& [ L_0 V_R ]_D +  \frac{\lambda_2}{4} ( [ W^{\alpha}(V_R) W_{\alpha}(V_R)]_F +{\rm h.c.}  )
\\
\label{NM11}
&+& \frac{\xi}{16} [( W^{\alpha}(V_R) W_{\alpha}(V_R)  \overline{W}_{\dot{\alpha}}(V_R) \overline{W}^{\dot{\alpha}}(V_R)) (L_0)^{-2}]_D.
\end{eqnarray}
In the $L_0 = 1$ gauge, this theory will contain in it bosonic sector terms of the form
\begin{eqnarray}
\label{R4}
{\cal L } \supset R + \lambda_2 R^2 +\xi R^4,
\end{eqnarray}
which represent corrections to Starobinsky theory
 in the new-minimal supergravity framework.
To recover the dual theory, we write Eq. (\ref{NM11}) as
\begin{eqnarray}
\nonumber
{\cal L} &=& [ L_0 V_R ]_D +\frac{\lambda_2}{4} ( [ W^{\alpha}(V) W_{\alpha}(V)]_F +{\rm h.c.} )
\\
\label{NM12}
&+& \frac{\xi}{16} [( W^{\alpha}(V) W_{\alpha}(V)  \overline{W}_{\dot{\alpha}}(V) \overline{W}^{\dot{\alpha}}(V)) (L_0)^{-2}]_D+ [L' ( V - V_R)]_D.
\end{eqnarray}
Again we perform a variation with respect to $L'$, and we interpret the equation of motion as
\begin{eqnarray}
\label{L''2}
\text{ln}\,\left(\frac{L_0}{Y_0\overline{Y}_0}\right) = V + \text{ln}\,\Phi  + \text{ln}\,\overline{\Phi}  +c,
\end{eqnarray}
which can be solved for $L_0$
\begin{eqnarray}
\label{L''3}
\frac{L_0}{Y_0\overline{Y}_0} = \overline{\Phi} e^{V } \Phi.
\end{eqnarray}
We have also   set $c=0$ here.
The final step is to plug back (\ref{L''3}) (or (\ref{L''2})) into (\ref{NM12}), which gives
\begin{eqnarray}
\nonumber
{\cal L} &=& [ Y_0 \overline{Y}_0 ( \overline{\Phi} e^{V } \Phi \ \text{ln}\,( \overline{\Phi} e^{V } \Phi ) )]_D
+\frac{\lambda_2}{4}( [ W^{\alpha}(V) W_{\alpha}(V)]_F +{\rm h.c.} )
\\
\label{NM13}
&+& \frac{\xi}{16} [( W^{\alpha}(V) W_{\alpha}(V)  \overline{W}_{\dot{\alpha}}(V) \overline{W}^{\dot{\alpha}}(V))
(Y_0 \overline{Y}_0)^{-2} (\overline{\Phi} e^{V } \Phi)^{-2}]_D.
\end{eqnarray}
We now gauge fix the conformal symmetry and set $Y_0 = 1$ to recover the standard  supergravity theory that corresponds to (\ref{NM13})
\begin{eqnarray}
{\cal{L}}&=&\int {\rm d}^2 \Theta  \, \, 2 \, {\cal{E}} \left\{
\frac{3}{8} \Big{(} \overline{{\cal{D}}}\overline{{\cal{D}}} - 8 {\cal{R}} \Big{)} e^{ - K/3 }
+ \frac{\lambda_2}{4} \, W^{\alpha} W_{\alpha} \right.  \nonumber
\\
&-&\left.\frac{1}{4}\Big{(}\overline{{\cal{D}}}\overline{{\cal{D}}} - 8 {\cal{R}}\Big{)}
\left[ \frac{\xi}{32 (\overline{\Phi} e^{V }  \Phi)^2}  W^{\alpha} W_{\alpha}  \overline{W}_{\dot{\alpha}} \overline{W}^{\dot{\alpha}}\right]
 \right\}+ {\rm h.c.},  \label{EP1}
\end{eqnarray}
with
\begin{eqnarray}
\label{KEP1}
K &=& -3\,\text{ln}\,\left[-\frac{1}{3} \overline{\Phi} e^{V } \Phi \ \text{ln}\,( \overline{\Phi} e^{V } \Phi )\right].
\end{eqnarray}
Importantly, the K\"ahler potential is the same as in Eq. (\ref{K2}) and thus  there  are no corrections to
the K\"ahler potential.
In addition, the theory (\ref{EP1}) has been studied in Refs. \cite{Farakos:2013bca,Cecotti:1986jy},
where  now the general functions in the higher derivative gauge sector are fixed by the form of the integrated out $L_0$.
The component form reads (after rescaling $V \rightarrow 2V$)
\begin{eqnarray}
\nonumber
e^{-1}{\cal{L}}&=& \frac{1}{2} R
- K_{A {\overline{A}}} D_\mu A  \overline{ D^\mu A} +\frac{1}{2} \left(K_A A + K_{\overline{A}} \overline{A}   \right) D
\\
\nonumber
 &-& 2 \lambda_2
\left( \frac{1}{2} F^{\mu\nu} F_{\mu\nu}
- \frac{i}{4} \epsilon^{\mu\nu\rho\sigma} F_{\mu\nu} F_{\rho\sigma}
- D^2 \right)
\\
\label{U1}
&+&\frac{\xi}{ (\overline{A}  A)^2} e^{ \frac{-2 K}{3}}
\left[\frac{1}{4} (F^{\mu\nu} F_{\mu\nu})^2 - F^{\mu\nu} F_{\mu\nu} D^2 +
\frac{1}{16} (\epsilon^{\mu\nu\rho\sigma} F_{\mu\nu} F_{\rho\sigma} )^2 +D^4 \right].
\end{eqnarray}
To find the scalar potential we have to integrate over $D$.
Since we are interested only in the scalar potential in what follows we
ignore all other contributions to $D$, but those from $A$. For a more complete discussion, one may consult
\cite{Farakos:2013bca,Cecotti:1986jy}.
By defining  the functions
\begin{eqnarray}
\label{a}
a&=& -\frac{1}{2} [K_A A + K_{\overline{A}} \overline{A}   ],
\\
\label{b}
b&=& 2 \lambda_2,
\\
\label{c}
c&=& \frac{\xi e^{ \frac{-2 K}{3}} }{ (\overline{A}  A)^2},
\end{eqnarray}
the equation of motion for $D$ turns out to be
\begin{eqnarray}
\label{eqD}
0 = a + 2 b D + 4 c D^3.
\end{eqnarray}
The solution to Eq. (\ref{eqD}) was found in Ref.  \cite{Cecotti:1986jy}
and  is given by
\begin{eqnarray}
\label{solD}
D= \sqrt{\frac{2 b}{3 c}}  \sinh n,
\end{eqnarray}
with
\begin{eqnarray}
\label{n}
n = \frac{1}{3} \arcsinh \left(- \frac{3a}{4b} \sqrt{\frac{6 c}{b} }   \right).
\end{eqnarray}
The scalar potential reads
\begin{eqnarray}
\label{VD}
V_D=   \frac{4 \lambda_2 b}{3 c}  \cosh(2n) (\sinh n)^2.
\end{eqnarray}
\begin{figure}[H]
\begin{center}
\includegraphics[scale=0.6]{figureNM.pdf}
\caption{\small The scalar potential   for three different values of $s=\frac{\sqrt{\xi}}{4}
\left(\frac{3}{\lambda_2}\right)^{3/2} $: \, $i$) $s= 10^{-2}$ (long dashed line), $ii$) $s=10^{-4}$ (medium dashed line) and $iii$)
$s=10^{-6}$ (short dashed line). The horizontal line corresponds to $\xi=0$.}
\end{center}
\end{figure}
\noindent
To find the corrections to the inflaton potential (\ref{VD1}), we rewrite $n$ as
\begin{eqnarray}
\label{nn}
n = \frac{1}{3} \arcsinh \omega,
\end{eqnarray}
where
\begin{eqnarray}
\label{omega1}
\omega = \frac{\sqrt{\xi}}{8} \left(\frac{3}{\lambda_2}\right)^{\frac{3}{2}} \left(1 - e^{\frac{2}{\sqrt{3}} \phi}\right).
\end{eqnarray}
For  $\omega\ll  1$, the potential is written as
\begin{eqnarray}
V_D\approx  \frac{9}{8 \lambda_2} \left( 1 - e^{-\frac{2}{\sqrt{3}} \phi }  \right)^2-\frac{9\xi}{256\lambda_2^4}
e^{-\frac{4}{\sqrt{3}} \phi } \left( 1 - e^{\frac{2}{\sqrt{3}} \phi }  \right)^4,  ~~~~~\omega\ll1.
\end{eqnarray}
On the other side, if $|\omega|\gg1$ ($\phi\gg1$), the potential is approximately given by
\begin{eqnarray}
V_D\approx \frac{\lambda_2^2}{3\xi}e^{-\frac{4}{3\sqrt{3}} \phi },  ~~~~~\phi\gg 1.
\end{eqnarray}
We have plotted the potential  in Fig. 1 for various values of the parameter
$s=\frac{\sqrt{\xi}}{4}
\left(\frac{3}{\lambda_2}\right)^{3/2} $. If $s=0$ (i.e., $\xi=0$), the potential has a plateau for large positive  values
of $\phi$ and one recovers the nice feature of the Starobinsky model formulated in terms of the extra scalar degree of freedom. However, for  non-zero values of $s$, the plateau is restricted to smaller regions and it disappears for larger values of $s$ with a fall-off
$V_D\sim e^{-\frac{4}{3\sqrt{3}} \phi }$ after the plateau. Therefore, the higher-order corrections pose a problem to the Starobinsky model:
we know that successful inflation is achieved when the number of e-folds is about 60. This requires the field plateau to be as large as ${\cal O}(5)$ in Planckian units. This imposes the parameter $s$ to be smaller than about $10^{-4}$. Even so, one should explain why the initial value field is positioned on the plateau, instead of being on the fall-off region.

\subsection{Corrections in old-minimal supergravity}
Higher-order corrections are also expected in the old-minimal supergravity case.
It is straightforward to verify that the following superspace Lagrangian
\begin{eqnarray}
\label{OM11}
{\cal L} = -3 [S_0 \overline{S}_0]_D +3 \lambda_1 [ {\cal R} {\cal \overline{R}} ]_D
+ \xi  [ \nabla^{\alpha} ({\cal R} / S_0) \nabla_{\alpha} ({\cal R} / S_0)
\overline{\nabla}_{\dot{\alpha}}  ({\cal \overline{R}} / \overline{S}_0) \overline{\nabla}^{\dot{\alpha}}  ({\cal \overline{R}} / \overline{S}_0) ]_D
\end{eqnarray}
reproduces (\ref{R4}) after gauge fixing $S_0=1$.
We can rewrite (\ref{OM11}) as
\begin{eqnarray}
\label{OM12}
{\cal L} = -3 [S_0 \overline{S}_0]_D +3 \lambda_1 [ J  \overline{J} ]_D
+ \xi  [ \nabla^{\alpha} (J / S_0) \nabla_{\alpha} (J / S_0)
\overline{\nabla}_{\dot{\alpha}}  (\overline{J} / \overline{S}_0) \overline{\nabla}^{\dot{\alpha}} (\overline{J} / \overline{S}_0) ]_D
+3( [ \Lambda ( J - {\cal R}  )]_F +{\rm h.c.} ).
\end{eqnarray}
Now,  making the redefinitions (\ref{TC}), the  theory (\ref{OM12}) becomes
\begin{eqnarray}
\nonumber
{\cal L} &=& -3 [S_0 \overline{S}_0 ( {\cal T} + \overline{{\cal T}} - {\cal C} \overline{{\cal C}} )]_D
+ 3(\sqrt{\lambda_1})^{-1} ( [ {\cal C} \, ({\cal T} -\frac{1}{2} ) S_0^3 ]_F +{\rm h.c.})
\\
\label{OM13}
&+& \frac{\xi}{ \lambda_1^2} [ \nabla^{\alpha}  {\cal C} \nabla_{\alpha} {\cal C}
\overline{\nabla}_{\dot{\alpha}}  \overline{{\cal C}}
\overline{\nabla}^{\dot{\alpha}} \overline{{\cal C}} ]_D.
\end{eqnarray}
Again,  by gauge fixing $S_0=1$ we go to the old-minimal supergravity, and the Lagrangian  (\ref{OM13}) is written as
\begin{eqnarray}
\nonumber
{\cal{L}} &=& \int {\rm d}^2 \Theta \, \, 2 \, {\cal{E}} \left\{
\frac{3}{8} \Big{(} \overline{{\cal{D}}}\overline{{\cal{D}}} - 8 {\cal{R}} \Big{)} e^{ - K/3 } + W
\right\}+ {\rm h.c.}
\\
\label{OM14}
&+&\frac{\xi}{ \lambda_1^2} \int {\rm d}^2 \Theta \, \, 2 \, {\cal{E}} \left\{
\left(-\frac{1}{8}\right) \Big{(} \overline{{\cal{D}}}\overline{{\cal{D}}} - 8 {\cal{R}} \Big{)}
{\cal{D}} ^{\alpha} {\cal C} {\cal{D}}_{\alpha} {\cal C}
\overline{{\cal{D}}}_{\dot{\alpha}} \overline{{\cal C}} \ \overline{{\cal{D}}}^{\dot{\alpha}}  \overline{{\cal C}}
\right\}+ {\rm h.c.},
\end{eqnarray}
with K\"ahler potential
\begin{eqnarray}
\label{K6}
K = -3\, \text{ln}\,\big{(}{\cal T} + \overline{{\cal T}} - {\cal C} \overline{{\cal C}}\big{)}
\end{eqnarray}
and superpotential
\begin{eqnarray}
\label{W6}
W=  \frac{3}{\sqrt{\lambda_1}} {\cal C} \left({\cal T} - \frac{1}{2}\right).
\end{eqnarray}
Theories of the form (\ref{OM14}) have been discussed in Ref. \cite{Cecotti:1986jy}
and more recently extensivelly studied in \cite{Farakos:2013bca,EP}.
After integrating out the auxiliary fields (except $F_c$, the auxiliary field of the ${\cal C}$ superfield),
and performing the rescalings, the Lagrangian  becomes
\begin{eqnarray}
\label{OM15}
e^{-1}{\cal L} &=& \frac{1}{2}  R  - K_{i {\overline{j}}} \partial_{\mu} z^i \partial^{\mu} \overline{z}^{\overline{j}}
+\frac{16 \xi}{\lambda_1^2} \partial_{\mu} C \partial^{\mu} C \partial_{\nu} \overline{C} \partial^{\nu} \overline{C}
- V_T +  {\cal L}_{F_c},
\end{eqnarray}
with
\begin{eqnarray}
\label{LFC}
{\cal L}_{F_c} &=& {\cal A} F_c + \overline{{\cal A}} \  \overline{F}_c
+ {\cal B}  F_c \overline{F}_c + {\cal S}  (F_c \overline{F}_c)^2,
\\
\label{VT}
V_T &=& e^{K} \frac{1}{K_{T\overline{T}}} D_T W D_{\overline{T}}\overline{W} - 3 e^{K} W \overline{W}
\end{eqnarray}
and
\begin{eqnarray}
{\cal A} &=& e^{2K/3} \frac{K_{C {\overline{T}}}}{K_{T \overline{T}}} D_T W - e^{2K/3} D_C W,
\\
{\cal B} &=& e^{K/3} K_{C {\overline{C}}}
- e^{K/3} \frac{K_{T {\overline{C}}}K_{C {\overline{T}}}}{K_{T {\overline{T}}}}
-\frac{32 \xi}{\lambda_1^2}  e^{K/3} \partial^{\mu} C \partial_{\mu} \overline{C},
\\
{\cal S} &=& \frac{16 \xi}{\lambda_1^2} e^{2K/3}.
\end{eqnarray}
The equations of motion for $F_c$ are
\begin{eqnarray}
0={\cal A} + {\cal B} \overline{F}_c + 2 {\cal S}   F_c \overline{F}_c^2 \ \ , \ \
0=\overline{{\cal A}} + {\cal B} F_c + 2 {\cal S}   \overline{F}_c F_c^2,
\end{eqnarray}
which can be combined into the single equation
\begin{eqnarray}
\alpha = X (1 + \beta X )^2,
\end{eqnarray}
where
\begin{eqnarray}
\alpha &=& \frac{{\cal A} \overline{{\cal A}}}{{\cal B}^2},
\\
\beta &=& \frac{2 {\cal S}}{{\cal B}},
\\
X &=& F_c \overline{F}_c.
\end{eqnarray}
The solution to the above equation is then easily found to be
\begin{eqnarray}
X = \frac{2}{3 \beta} \big{(}\cosh m -1\big{)},
\end{eqnarray}
with
\begin{eqnarray}
m = \frac{1}{3 } \arccosh\Big{(}\frac{27}{2} \alpha \beta +1\Big{)}.
\end{eqnarray}
The final scalar potential will have the following compact form
\begin{eqnarray}
V_F = {\cal B} X + 3 {\cal S} X^2 + V_T.
\end{eqnarray}
To study the implications of the corrections on the inflaton potential we look again at the minimum
$C=\bar{C}=b=0$ with the redefinition (\ref{T}).
The inflaton field $\phi$
will now have a potential
\begin{eqnarray}
\label{VF9}
V_F = \frac{3 e^{-4 \phi/\sqrt{3}}}{8 s} \ \text{cosh}\ \frac{u}{3} \  \left( \text{sinh}\ \frac{u}{6}\right)^2,
\end{eqnarray}
with
\begin{eqnarray}
u = \arccosh\left\{ 1 + 36 \Big{(}-1 + e^{2 \phi/\sqrt{3}}\Big{)}^2 s  \right\}, \ \ s=\frac{\xi}{\lambda_1^3}.
\end{eqnarray}
The potential (\ref{VF9}) has been plotted  in Fig. 2 for various values of the parameter
$s$. If $s=0$ (i.e, $\xi=0$), the potential has a plateau for large positive values
of $\phi$. For non-zero values of $s$, the plateau is restricted to smaller regions of the scalar field and,
like for the new-minimal version,  it disappears for larger values of $s$ with a fall-off
$V_F \sim e^{-4 \phi / \sqrt{3}}  $ after the plateau.
\begin{figure}[H]
\begin{center}
\includegraphics[scale=0.6]{figureOM.pdf}
\caption{\small The scalar potential   for three different values of $s=\frac{\xi}{\lambda_1^3} $: \,
$i$) $s= 10^{-4}$ (long dashed line), $ii$) $s=10^{-8}$ (medium dashed line) and $iii$)
$s=10^{-12}$ (short dashed line). The horizontal line corresponds to $\xi=0$.}
\end{center}
\end{figure}
\noindent

\section{Conclusions}
In this paper we have discussed the embedding of the Starobinsky model of inflation within
${\cal{N}}=1$ supergravity. We have shown that the Starobinsky model can be derived from
the   new-minimal supergravity, where a linear compensator superfield
is employed. The
Starobinsky model  becomes equivalent to standard supergravity coupled to a massive vector multiplet whose
lowest scalar component plays the role of the inflaton and the vacuum energy is provided by  a
 $D$-term potential.  We have subsequently investigated the robustness of the model against higher-order corrections allowed by the symmetries and concluded that they may represent a threat to the success of the model as they may destroy the flatness of the potential. This is true both in the old- and in the new-minimal formulation. In this sense, the Starobinsky model suffers from the
same  difficulty  one encounters when trying to embed a model of inflation in supersymmetry  where the  flatness of the potential is easily destroyed by supergravity corrections \cite{lr}.

\section*{Aknowledgements}

The authors thank U.~Lindstr\"om for discussion.
 A.R. is supported by the Swiss National
Science Foundation (SNSF), project ``The non-Gaussian Universe" (project number: 200021140236).
This research was implemented under the “ARISTEIA” Action of the “Operational Programme
Education and Lifelong Learning” and is co-funded by the European Social Fund
(ESF) and National Resources.
This work is partially supported by European Union's Seventh
Framework Programme (FP7/2007-2013) under REA grant agreement n°329083.