\section{Introduction}

W. Nahm in 1982 \cite{Nahm1982} introduced a model for self-dual
multimonopoles in terms of three coupled matrix differential equations:
\begin{equation}
    \dot{T}_{i} = [T_{j},T_{k}],
    \quad T_{i}=T_{i}\left( t \right)\in M_{N,N}\left( \mathbb{C} \right),
    \label{eq:nahm}
\end{equation}
where the indices $i,j,k$ are cyclic permutations of the set
$\left\{ 1,2,3 \right\}$, and $N$ is a positive integer.
The system of three equations \eqref{eq:nahm} nowadays called Nahm's equations.

In \cite{Hitchinetal1995} some special cases of Nahm's equations
with particular symmetries were studied in connection with
the theory of monopoles.
The obtained systems of coupled two-dimensional differential
equations are known as the \emph{reduced Nahm systems}:
\begin{subequations}
    \begin{gather}
        \dot{x}= 2x^2+\frac{y^2}{8},
        \quad
        \dot{y} = -4 x y,
        \label{eq:tetra}
        \\
        \dot{x} = 2 x^2-48 y^2,
        \quad
        \dot{y}= -6 x y-8y^2,
        \label{eq:octa}
        \\
        \dot{x} = 2 x^2-y^2,
        \quad
        \dot{y} = -10 x y +y^2.
        \label{eq:icos}
    \end{gather}
    \label{eq:rnahm}
\end{subequations}
Due to the symmetry of the associated Nahm matrices the
systems \eqref{eq:rnahm} are called the
\emph{tetrahedral Nahm system},
\emph{octahedral Nahm system},
and \emph{icosahedral Nahm system} respectively.
The peculiarity of these systems is the fact that they
are \emph{algebraically integrable}, in the sense that they
possess an invariant elliptic curve, i.e. a genus one curve,
of degree three, four and six respectively.
For more information on the general Nahm equations in the
context of the modern theory of integrable systems we
refer to \cite{Ablowitz1991}.

In recent years arose the interest in the problem of finding good
discretisation of continuous systems.
By good discretisation, here we mean a discretisation, which
preserves as much as possible the properties of its continuous
counterpart.
Within this framework a procedure called
\emph{Kahan-Hirota-Kimura (KHK) discretisation} became popular as a way of
producing integrable discrete equations from systems of integrables ODEs.
Specifically, given a systems of first-order ordinary differential equations:
\begin{equation}
    \vec{\dot{x}}=\vec{F}\left( \vec{x} \right)
    \label{eq:firstord}
\end{equation}
its KHK is given by the following formula:
\begin{equation}
    \frac{\vec{x}_{n+1}-\vec{x}_{n}}{h} =
    2\vec{F}\left( \frac{\vec{x}_{n+1}+\vec{x}_{n}}{2} \right)
    -\frac{\vec{F}\left( \vec{x}_{n+1} \right)+\vec{F}\left( \vec{x}_{n}\right)}{2},
    \quad
    \vec{x}_{n} = \vec{x}\left( n h \right),\, h\to0^{+}.
    \label{eq:kahan}
\end{equation}
This formula was presented first by W. Kahan in a series of unpublished
lecture notes \cite{Kahan1993}, and applied by
K. Kimura and R. Hirota to produced an integrable discretisation of
the Lagrange top \cite{HirotaKimura2000},
This result attracted the interest of many scientists working
in the field of geometric discretisation theory \cite{KrantzParks2008},
from the Berlin school
\cite{PetreraPfadlerSuris2009,PetreraSuris2010,PetreraPfadlerSuris2011}.
In particular in \cite{PetreraPfadlerSuris2009} it was noticed
that when the function $\vec{F}$ in \eqref{eq:firstord} is
quadratic the discretisation rule \eqref{eq:kahan} give raise
to a birational map.
Later, some general integrability properties of the
KHK discretisation were unveiled through the
work of G. R.W. Quispel and his collaborators
\cite{CelledoniMcLachlanOwrenQuispel2013,CelledoniMcLachlanOwrenQuispel2014}.

In particular in \cite{PetreraPfadlerSuris2009,PetreraSuris2010,PetreraPfadlerSuris2011},
Petrera, Pfadler and Suris developed an algebraic approach for the
search of invariants for KHK discretisations, called the
\emph{Hirota--Kimura bases}.
With this approach they produced lots of examples,
yet besides invariants and preserved measures,
little was know about additional structures of the
discrete integrable systems they found.
For instance, in the conclusions of \cite{PetreraPfadlerSuris2011}
the authors write:
\begin{quote}
    ``Of course, it would be highly desirable to find some structures,
    like Lax representation, bi-Hamiltonian structure, etc., which would allow
    one to check the conservation of integrals in a more clever way,
    but up to now no such structures have been found for any of the
    [K]HK type discretizations.''
\end{quote}

In this paper, we give an answer to the above comment
made by Petrera, Pfadler and Suris in \cite{PetreraPfadlerSuris2011}.
That is, using a technique presented in \cite{Kimura2017Lax,Sogo2017},
we build the discrete analog of the reduced Nahm system
from their Lax representation.
Then, we show that this discretisation is equivalent to the
KHK discretisation discussed in \cite{PetreraPfadlerSuris2011}.
These Lax pairs are used to produce invariants,
and proving integrability of the discrete Nahm systems.

The plan of the paper is the following: in section \ref{sec:laxcont}
we give a review of the literature on the Lax pair for the continuous
and discrete Nahm systems.
In section \ref{sec:laxreddiscr} we use such construction to produce
the Lax pairs for the reduced Nahm systems \eqref{eq:rnahm} and prove
integrability.
In the final section \ref{sec:concl} we give some conclusions and an
outlook for further researches.
Moreover, we show with an example that there exists Nahm systems
whose Lax pair does not provide integrability,
yet the system is KHK discretisable, and both the continuous
and discrete systems are algebraically integrable.
This shows, that despite the success obtained in explaining the
integrability of the Euler top \cite{Kimura2017Lax,Sogo2017,Kimura2017JPhysA},
and of the reduced Nahm systems \eqref{eq:rnahm},
the Nahm equation approach cannot solve the general problem of
characterisation of the integrability of KHK discretisations.

\section{Lax pair for the continuous and discrete Nahm systems}
\label{sec:laxcont}

In the literature several different forms of the Lax pair
for the Nahm equations have been proposed.
For instance, recently in \cite{Kimura2017Lax} it was
proposed the following form:
\begin{subequations}
    \begin{align}
        A\left( \lambda \right) &=
        \begin{pmatrix}
            T_{1} & -T_{2}
            \\
            T_{2} & T_{1}
        \end{pmatrix}
        + \lambda
        \begin{pmatrix}
            0 & 2T_{3}
            \\
            -2T_{3} & 0
        \end{pmatrix}
        + \lambda^{2}
        \begin{pmatrix}
            T_{1} & T_{2}
            \\
            -T_{2} & T_{1}
        \end{pmatrix}
        ,
        \label{eq:Akimura}
        \\
        B \left( \lambda \right) &=
        \begin{pmatrix}
            0 & T_{3}
            \\
            -T_{3} & 0
        \end{pmatrix}
        + \lambda
        \begin{pmatrix}
            T_{1} & T_{2}
            \\
            -T_{2} & T_{1}
        \end{pmatrix}
        \label{eq:Bkimura}
    \end{align}
    \label{eq:LPkimura}
\end{subequations}
The above matrices are such that the system \eqref{eq:nahm} is
equivalent to the following compatibility condition:
\begin{equation}
    \dot{A} = \left[ A,B \right].
    \label{eq:LPcomp}
\end{equation}

The Lax pair \eqref{eq:LPkimura} consists of $2N\times 2N$ matrices.
In this paper to avoid too cumbersome formulas we consider
the inverse matrix complexifcation of the matrices in \eqref{eq:LPkimura}:
\begin{equation}
    M =\begin{pmatrix}
        M_{1} & -M_{2}
        \\
        M_{2} & M_{1}
    \end{pmatrix}
    \implies
    M = M_{1} + \imath M_{2}.
    \label{eq:decompl}
\end{equation}
That is, we consider the following
Lax pair for the Nahm system \eqref{eq:nahm}:
\begin{subequations}
    \begin{align}
        A\left( \lambda \right) &= T_{1} +\imath T_{2}
         -2\imath\lambda T_{3}+ \lambda^{2} \left( T_{1} -\imath T_{2} \right),
        \label{eq:Anahm}
        \\
        B \left( \lambda \right) &= -\imath T_{3} +\lambda \left( T_{1} -\imath T_{2} \right).
        \label{eq:Bnahm}
    \end{align}
    \label{eq:LPnahm}
\end{subequations}
The compatibility condition \eqref{eq:LPcomp} gives again
the Nahm equations \eqref{eq:nahm} taking its real and
imaginary part.

Associated to the matrix $B\left( \lambda \right)$
there exists a unique family of unitary matrices resolving the
differential equation $\dot V = V B$, with initial condition
$V\left( 0 \right)=I_{N}$.
As proven in \cite{Lax1968} this implies that the
spectrum of the matrix $A\left( \lambda \right)$ does not depend
on the independent variable $t$.
So, the coefficients of the characteristic polynomial
of $A\left( \lambda \right)$:
\begin{equation}
    p_{A} \left( \mu \right) = \det \left(  A\left( \lambda \right)-\mu I_{N}  \right),
    \label{eq:detpol}
\end{equation}
do not depend on $t$.
That is, the coefficients of the characteristic polynomial \eqref{eq:detpol}
are first integrals of the Nahm system \eqref{eq:nahm}.
Moreover, since the system \eqref{eq:nahm} does not depend on
the variable $\lambda$ too,
for each coefficient we can have multiple first integrals.

\begin{remark}
    Equation \eqref{eq:detpol} yields at least $N$ first integrals,
    but there is no \emph{a priori} guarantee that these
    first integrals are functionally independent and/or non-trivial.
    This implies that the integrability of the system \eqref{eq:nahm}
    must be proved case by case using the appropriate form of the
    matrices $T_{i}$.
    \label{rem:indip}
\end{remark}

In \cite{Kimura2017JPhysA}, followed by \cite{Kimura2017Lax,Sogo2017}, was
introduced a method to discretise the compatibility condition \eqref{eq:LPcomp}.
Consider the discrete time interval:
\begin{equation}
    t_{n} = n h, \quad h\to 0^{+},
    \label{eq:tn}
\end{equation}
hence we define $f_{n}\equiv f(t_{n})$.
Then, the compatibility condition \eqref{eq:LPcomp} can be
discretised as:
\begin{equation}
    \frac{A_{n+1}\left( \lambda \right)-A_{n}\left( \lambda \right)}{h}
    = A_{n+1}\left( \lambda \right)B_{n}\left( \lambda \right)
    -B_{n+1}\left( \lambda \right)A_{n}\left( \lambda \right).
    \label{eq:LPdiscr}
\end{equation}
The corresponding system of difference equations is given by:
\begin{equation}
    \frac{T_{i,n+1}-T_{i,n}}{h}
    =
    T_{j,n+1}T_{k,n}-T_{k,n+1}T_{j,n},
    \label{eq:dnahm}
\end{equation}
where the indices $i,j,k$ are cyclic permutations of the set
$\left\{ 1,2,3 \right\}$.

\begin{remark}
    In principle a different discretisation of the compatibility
    condition \eqref{eq:LPcomp} can be given:
    \begin{equation}
        \frac{A_{n+1}\left( \lambda \right)-A_{n}\left( \lambda \right)}{h}
        = A_{n}\left( \lambda \right)B_{n+1}\left( \lambda \right)
        -B_{n}\left( \lambda \right)A_{n+1}\left( \lambda \right),
        \label{eq:LPdiscrinv}
    \end{equation}
    yield the following system of difference equations:
    \begin{equation}
        \frac{T_{i,n+1}-T_{i,n}}{h}
        =
        T_{j,n}T_{k,n+1}-T_{k,n}T_{j,n+1},
        \label{eq:dnahminv}
    \end{equation}
    where the indices $i,j,k$ are cyclic permutations of the set
    $\left\{ 1,2,3 \right\}$.
    However, by direct computation it is possible to show that,
    in the cases considered in this paper,
    condition \eqref{eq:dnahminv} is equivalent to
    \eqref{eq:dnahm} up to the transformation:
    \begin{equation}
        \vec{x}_{n+i} \longleftrightarrow \vec{x}_{n-i},
        \label{eq:equiv}
    \end{equation}
    where $\vec{x}_{n}$ is the vector of the dynamical variables.
    That is, the evolution defined from \eqref{eq:dnahm} is the
    opposite of the evolution defined by \eqref{eq:dnahminv}.
    We notice that this is a general fact when dealing with
    KHK discretisation as pointed out in \cite{PetreraPfadlerSuris2009}.
    \label{rem:inversediscr}
\end{remark}

Equation \eqref{eq:LPdiscr} can be rearranged as:
\begin{equation}
    A_{n+1}\left( \lambda \right) \left( I_{N}-hB_{n}\left( \lambda \right) \right)
    =
    \left( I_{N}-hB_{n+1}\left( \lambda \right) \right)A_{n}\left( \lambda \right).
    \label{eq:LPdiscr2}
\end{equation}
Introducing the matrices:
\begin{equation}
    L_{n}\left( \lambda \right) = A_{n}\left( \lambda \right),
    \quad
    M_{n}\left( \lambda \right) = I_{N}-hB_{n}\left( \lambda \right),
    \label{eq:LPdiscrdef}
\end{equation}
which allows us to rewrite \eqref{eq:LPdiscr2} as:
\begin{equation}
    L_{n+1}\left( \lambda \right)M_{n}\left( \lambda \right)
    =
    M_{n+1}\left( \lambda \right)L_{n}\left( \lambda \right).
    \label{eq:LPdiscr3}
\end{equation}
Following \cite{Suris2003book,Suris1990} we have that equation
\eqref{eq:LPdiscr3} implies that the spectral data of the matrix
$L_{n}\left( \lambda \right)M_{n}^{-1}\left( \lambda \right)$ are constant
along the evolution.
Indeed, from \eqref{eq:LPdiscr3}, the matrices
$L_{n+1}\left( \lambda \right) M_{n+1}^{-1}\left( \lambda \right)$ and
$L_{n}\left( \lambda \right)M_{n}^{-1}\left( \lambda \right)$ are conjugate,
so that they have the same characteristic polynomial.
This implies that the that the coefficients of the
characteristic polynomial of $L_{n}\left( \lambda \right)M_{n}^{-1}\left( \lambda \right)$
are conserved quantities (invariants) for the system \eqref{eq:dnahm}.
Alternatively, using Binet's rule, we have
that the coefficients of the
characteristic polynomial of $L_{n}\left( \lambda \right)$ with respect
to $M_{n}\left( \lambda \right)$:
\begin{equation}
    p_{L,M} \left( \mu \right) =
    \det \left(  L_{n}\left( \lambda \right)-\mu M_{n}\left( \lambda \right)  \right),
    \label{eq:discrdetpol}
\end{equation}
divided by $\det M_{n}\left( \lambda \right)$ are constants of motions.
That is, writing such characteristic polynomial in the following way:
\begin{equation}
    p_{L,M} \left( \mu \right) =
    \left( -1 \right)^{N}\det M_{n}\left( \lambda \right)\mu^{N}+
    c_{N-1}\left( \lambda \right)\mu^{N-1}+
    \dots
    +c_{0}\left( \lambda \right),
    \label{eq:discrdetpol2}
\end{equation}
we can write these invariants in the following way:
\begin{equation}
    H_{0} = \frac{c_{0}\left( \lambda \right)}{\det M_{n}\left( \lambda \right)},
    \,
    H_{1} = \frac{c_{1}\left( \lambda \right)}{\det M_{n}\left( \lambda \right)},
    \,
    \dots,
    \,
    H_{N-1} = \frac{c_{N-1}\left( \lambda \right)}{\det M_{n}\left( \lambda \right)}.
    \label{eq:H0N}
\end{equation}
Finally, we note that the same consideration on functional independence
of the invariants \eqref{eq:H0N} given in Remark \ref{rem:indip} apply.

\section{Discrete reduced Nahm systems}
\label{sec:laxreddiscr}

In \cite{Hitchinetal1995} where considered three special cases of Nahm's
equations \eqref{eq:nahm} corresponding to symmetry groups of regular
solids, namely \emph{tetrahedral}, \emph{octahedral},
and \emph{icosahedral} symmetry.

Assume we are a given $G\subset SO\left( 3 \right)$,
a symmetry group of regular solid.
Then, the $G$-invariant Nahm matrices $T_{i}$ have
the following form:
\begin{equation}
    T_{i}\left( t \right) = x\left( t \right) \rho_{i} + y\left( t \right) S_{i}.
    \label{eq:hitchint}
\end{equation}
Here $\rho\colon\mathbb{R}^{3}\to\mathfrak{su}\left( k \right)$ is
a representation of $\mathfrak{so}\left( 3 \right)$ on $\mathbb{C}^{k}$,
while $\left( S_{1},S_{2},S_{3} \right)$ is a $G$-invariant vector in the
symmetric power space $S^{2k}V\subset \mathbb{R}^{3}\otimes\mathfrak{su}\left( k \right)$
where $V$ is the representation corresponding to $G$ in $SU\left( 2 \right)$.

In the following we will consider the tetrahedral, octahedral,
and icosahedral symmetry cases, with the definitions of the
$G$-invariant Nahm matrices $T_{i}$ given in \cite{Hitchinetal1995}.
The discretisation of these continuous systems was obtained
in \cite{PetreraPfadlerSuris2011} using the KHK discretisation procedure
and proved to be integrable by constructing the invariant with
the so-called Hirota--Kimura bases \cite{PetreraPfadlerSuris2009}.
Here we will prove that the KHK discretisation follows from the
discretisation of the Lax pairs and the invariant can be found using
the associated characteristic polynomial \eqref{eq:discrdetpol}.

\begin{remark}
    We note that the results of \cite{PetreraPfadlerSuris2009} on
    the discrete Nahm systems where generalised simultaneously and
    independently in
    \cite{CelledoniMcLachlanMcLarenOwrenQuispel2017,PetreraZander2017}.
    Some comments on the geometry of these systems were given
    in \cite{CarsteaTakenawa2013}.
    Later, in \cite{VanDerKampCelledoniMcLachlanMcLarenOwrenQuispel2019}
    it was proved how to construct the tetrahedral and the octahedral case
    discrete cases using generalised Manin transform.
    Finally, in \cite{GJ_biquadratic} it was pointed out that in the octahedral
    case the geometric
    construction of \cite{VanDerKampCelledoniMcLachlanMcLarenOwrenQuispel2019}
    induces non-standard features on the procedure of resolution of
    singularities, proving the existence of families of particular solutions.
    \label{rem:gen}
\end{remark}

\subsection{Tetrahedral symmetry}
\label{sec:tetra}

Consider the reduced Nahm system with tetrahedral symmetry \eqref{eq:tetra}.
Its Lax pair is given by:
\begin{subequations}
    \begin{align}
        A\left( \lambda \right) &=
        \begin{pmatrix}
            0&2 \imath\lambda  \left( 2 x +\frac{y}{2}  \right) &-\imath\left({\lambda}^{2}-1\right) \left( 2 x- \frac{y}{2}  \right)
            \\
            -2 \imath\lambda  \left( 2 x -\frac{y}{2} \right) &0&-\left({\lambda}^{2}+1\right)\left( 2 x +\frac{y}{2}  \right)
            \\
            \imath\left({\lambda}^{2}-1\right) \left( 2 x+ \frac{y}{2}  \right)  &
            \left({\lambda}^{2}+1\right)\left( 2 x -\frac{ y}{2}  \right) &0
        \end{pmatrix},
        \label{eq:tetraL}
        \\
        B\left( \lambda \right) &=
        \begin{pmatrix}
            0&\imath \left( 2 x + \frac{y}{2}  \right) &-\imath \lambda  \left( 2 x - \frac{y}{2} \right)
            \\
            -\imath \left( 2 x -\frac{y}{2}  \right) &0& -\lambda  \left( 2 x +\frac{y}{2} \right)
            \\
            \imath\lambda  \left( 2 x +\frac{y}{2} \right) &\lambda  \left( 2 x -\frac{y}{2}  \right) &0
        \end{pmatrix}.
        \label{eq:tetraM}
    \end{align}
    \label{eq:tetraLM}
\end{subequations}
Considering the characteristic polynomial \eqref{eq:detpol}
we obtain the invariant given in \cite{Hitchinetal1995}:
\begin{equation}
    H = y (y^2+48x^2).
    \label{eq:tetraH}
\end{equation}
Note that the level curves of the invariant $H$ \eqref{eq:tetraH}
are genus one (elliptic) curves.

From \eqref{eq:LPdiscrdef} we obtain the following
discrete Lax Pair:
\begin{subequations}
    \begin{align}
        L_{n}\left( \lambda \right) &=
        \begin{pmatrix}
            0&2 \imath\lambda  \left( 2 x_{n} +\frac{y_{n}}{2}  \right) &-\imath\left({\lambda}^{2}-1\right) \left( 2 x_{n}- \frac{y_{n}}{2}  \right)
            \\
            -2 \imath\lambda  \left( 2 x_{n} -\frac{y_{n}}{2} \right) &0&-\left({\lambda}^{2}+1\right)\left( 2 x_{n} +\frac{y_{n}}{2}  \right)
            \\
            \imath\left({\lambda}^{2}-1\right) \left( 2 x_{n}+ \frac{y_{n}}{2}  \right)  &
            \left({\lambda}^{2}+1\right)\left( 2 x_{n} -\frac{y_{n}}{2}  \right) &0
        \end{pmatrix},
        \label{eq:tetraLd}
        \\
        M_{n}\left( \lambda \right) &=
        \begin{pmatrix}
            1&-\imath h \left( 2 x_{n} +\frac{y_{n}}{2}  \right) &\imath \lambda h  \left( 2 x_{n} - \frac{y_{n}}{2} \right)
            \\
            \imath h \left( 2 x_{n} -\frac{y_{n}}{2}  \right) &1& \lambda h \left( 2 x_{n} +\frac{y_{n}}{2} \right)
            \\
            -\imath\lambda h \left( 2 x_{n} +\frac{y_{n}}{2} \right) &-\lambda h \left( 2 x_{n} -\frac{y_{n}}{2}  \right) &1
        \end{pmatrix}.
        \label{eq:tetraMd}
    \end{align}
    \label{eq:tetraLMd}
\end{subequations}
The corresponding compatibility conditions are:
\begin{subequations}
    \begin{align}
        \frac{x_{n+1}-x_{n}}{h} &= 2 x_{n+1} x_{n}+\frac{1}{8} y_{n+1} y_{n},
        \\
        \frac{y_{n+1}-y_{n}}{h} &= -2 \left(x_{n} y_{n+1}+x_{n+1} y_{n}\right),
    \end{align}
    \label{eq:tetrad}
\end{subequations}
and coincide with the KHK discretisation of the reduced
Nahm system with tetrahedral symmetry \eqref{eq:tetra},
originally presented in \cite{PetreraPfadlerSuris2011}.
The characteristic polynomial of \eqref{eq:tetraLd} with
respect to \eqref{eq:tetraMd}:
\begin{equation}
    \begin{aligned}
        p_{L,A} \left( \mu \right)&=
    \left(1-4 h^2 x_{n}^2+ \frac{h^2 y_{n}^2}{4}+12 h^3 x_{n}^2 \lambda^2 y_{n}+ \frac{h^3 y_{n}^3}{4} \lambda^2\right) \mu^3
        \\
        &-h^2 \lambda^3 y_{n} (48 x_{n}^2+y_{n}^2) \mu^2
        + \frac{h y_{n}}{4} (48 x_{n}^2+y_{n}^2) (5 \lambda^4-1) \mu
        \\
        &-\frac{\lambda y_{n}}{2} (48 x_{n}^2+y_{n}^2) (\lambda-1) (\lambda+1) (\lambda^2+1).
    \end{aligned}
    \label{eq:ptetra}
\end{equation}
From equation \eqref{eq:H0N} we could get three different invariants,
yet they will be necessarily dependent.
So, we choose:
\begin{equation}
    H_{0}\left( \lambda \right) =
    -\frac{1}{2} \frac{\lambda y_{n}(48 x_{n}^2+y_{n}^2) (\lambda-1) (\lambda+1) (\lambda^2+1)}{
        \displaystyle
    1-4 h^2 x_{n}^2+ \frac{h^2 y_{n}^2}{4}+12 h^3 x_{n}^2 \lambda^2 y_{n}+ \frac{h^3 y_{n}^3}{4} \lambda^2}.
    \label{eq:H0tetra}
\end{equation}
This invariant is dependent on $\lambda$, therefore to find a
non-trivial invariant we can expand in Taylor series with respect to $\lambda$,
that is
$H_{0}\left( \lambda \right) = \sum_{k=0}^{\infty}h_{0,k}\lambda^{k}$,
and take the first non-constant element:
\begin{equation}
    h_{0,1} =
    -\frac{1}{2} \frac{ y_{n}(48 x_{n}^2+y_{n}^2)}{
    1-4 h^2 x_{n}^2+ \displaystyle\frac{h^2 y_{n}^2}{4}}.
    \label{eq:H0tetra2}
\end{equation}
This is an invariant for \eqref{eq:tetrad}.

\subsection{Octahedral symmetry}
Consider the reduced Nahm system with tetrahedral symmetry \eqref{eq:octa}.
Its Lax pair is given by:
\begin{subequations}
    \begin{align}
        A\left( \lambda \right) &=
        \begin{pmatrix}
            2 \lambda  \left( 3 x+4 y \right) &6 {\lambda}^{2} \left( x -2y\right) &0&-120 y
            \\
            -2 x+4 y   &2 \lambda  \left( x   -12 y  \right) &8 {\lambda}^{2} \left(x+3 y\right) &0
            \\
            0&-2 x -6 y   &-2 \lambda\left( x -12 y    \right) &6 {\lambda}^{2} \left( x   -2 y    \right)
            \\
            10 {\lambda}^{2}y/3   &0&-2 x   +4 y   &-2 \lambda  \left( 3 x+4 y \right)
        \end{pmatrix},
        \label{eq:octaL}
        \\
        B\left( \lambda \right) &=
        \begin{pmatrix}
            3x +4 y   &6 \lambda  \left( x-2 y\right) &0&0
            \\
            0&x   -12 y   &8 \lambda  \left( x   +3 y    \right) &0
            \\
            0&0&-\left(x   -12 y\right)   &6 \lambda  \left( x -2 y\right)
            \\
            10\lambda y/3   &0&0&-\left(3 x   +4 y\right)
        \end{pmatrix}.
        \label{eq:octaM}
    \end{align}
    \label{eq:octaLM}
\end{subequations}
Considering the characteristic polynomial \eqref{eq:detpol}
we obtain the invariant given in \cite{Hitchinetal1995}:
\begin{equation}
    H = y(x+3y)(x-2y)^2.
    \label{eq:octaH}
\end{equation}
Note that the level curves of the invariant $H$ \eqref{eq:octaH}
are genus one (elliptic) curves.

From \eqref{eq:LPdiscrdef} we obtain the following
discrete Lax Pair:
\begin{subequations}
    \begin{align}
        L_{n}\left( \lambda \right) &=
        \begin{pmatrix}
            2 \lambda  \left( 3 x_{n}+4 y_{n} \right) &6 {\lambda}^{2} \left( x_{n} -2y_{n}\right) &0&-120 y_{n}
            \\
            -2 x_{n}+4 y_{n}   &2 \lambda  \left( x_{n}   -12 y_{n}  \right) &8 {\lambda}^{2} \left(x_{n}+3 y_{n}\right) &0
            \\
            0&-2 x_{n} -6 y_{n}   &-2 \lambda\left( x_{n} -12 y_{n}    \right) &6 {\lambda}^{2} \left( x_{n}   -2 y_{n}    \right)
            \\
            10 {\lambda}^{2}y_{n}/3   &0&-2 x_{n}   +4 y_{n}   &-2 \lambda  \left( 3 x_{n}+4 y_{n} \right)
        \end{pmatrix},
        \label{eq:octaLd}
        \\
        M_{n}\left( \lambda \right) &=
        \begin{pmatrix}
            1-h\left(3x_{n} +4 y_{n}\right)   &1- 6 \lambda h  \left( x_{n}-2 y_{n}\right) &0&0
            \\
            0&1-h\left(x_{n}   -12 y_{n}\right) &1- 8 \lambda h \left( x_{n}   +3 y_{n}    \right) &0
            \\
            0&0&1+h\left(x_{n}   -12 y_{n}\right)   &1- 6 h \lambda  \left( x_{n} -2 y_{n}\right)
            \\
            -10\lambda h y_{n}/3   &0&0&1+h\left(3 x_{n}+4 y_{n}\right)
        \end{pmatrix}.
        \label{eq:octaMd}
    \end{align}
    \label{eq:octaLMd}
\end{subequations}
The corresponding compatibility conditions are:
\begin{subequations}
    \begin{align}
        {\frac {x_{{n+1}}-x_{{n}}}{h}} &=2 x_{{n+1}}x_{{n}}-48 y_{{n+1}}y_{{n}},
        \\
        \frac {y_{{n+1}}-y_{{n}}}{h} &=-3 \left(x_{{n+1}}y_{{n}}+ x_{{n}}y_{n+1}\right)
        -8 y_{n} y_{n+1}.
    \end{align}
    \label{eq:octad}
\end{subequations}
and coincide with the KHK discretisation of the reduced
Nahm system with octahedral symmetry \eqref{eq:octa},
originally presented in \cite{PetreraPfadlerSuris2011}.
Proceeding in analogous ways as in section \ref{sec:tetra},
that is taking the first non-constant element of the Taylor series of
$H_{0}\left( \lambda \right)$, we obtain the following
invariant:
\begin{equation}
    h_{0,0} =
    {\frac {-960y_{{n}} \left( x_{{n}}+3 y_{{n}} \right)  \left( x_{{n}}-2 y_{{n}} \right) ^{2}}{%
            \left[1- h^{2}\left(x_{{n}}-12y_{{n}}\right)^{2} \right]
    \left[ 1-h^{2}  \left(3 x_{{n}}+4 y_{{n}}\right)^{2} \right] }}.
    \label{eq:H0octa}
\end{equation}

\subsection{Icosahedral symmetry}
Consider the reduced Nahm system with tetrahedral symmetry \eqref{eq:icos}.
Its Lax pair is given by:
\begin{subequations}
    \begin{align}
        L\left( \lambda \right) &=
        \begin{pmatrix}
                \frac{2\lambda}{5} \left( 25 x +y \right) &
                {\lambda}^{2} \left( 10 x -y  \right) &0&0&-168 y &336 \lambda y
                \\
                -2 x + \frac{y}{5} &2 \lambda  \left( 3 x -y  \right) &
                4 {\lambda}^{2}\left( 4 x +y  \right) &0&0&168 y
                \\
                0&-2 x -\frac{y}{2} &2 \lambda  \left( x +2 y \right) &
                6 {\lambda}^{2} \left( 3 x -y  \right) &0&0
                \\
                0&0&-2x +2/3 y &-2 \lambda  \left( x +2 y  \right) &4 {\lambda}^{2}
         \left( 4 x +y  \right) &0
            \\
            {\frac {7 {\lambda}^{2}y}{120}}&0&0&-2 x -\frac{y}{2} &
            -2 \lambda \left( 3 x -y \right) &{\lambda}^{2} \left( 10 x -y \right)
            \\
            {\frac {7 \lambda y}{300}}&-{\frac {7 {\lambda}^{2}y}{120}}&0&0&-2 x+\frac{y}{5} &-\frac{2}{5}\lambda  \left( 25 x +y  \right)
        \end{pmatrix},
        \label{eq:icosL}
        \\
        M\left( \lambda \right) &=
        \begin{pmatrix}
            5 x +\frac{y}{5} &\lambda  \left( 10 x -y\right) &0&0&0&168 y
            \\
            0&3 x -y &4 \lambda  \left( 4 x +y   \right) &0&0&0
            \\
            0&0&x +2 y &6 \lambda  \left( 3 x -y  \right) &0&0
            \\
            0&0&0&-x -2 y &4 \lambda  \left( 4 x +y  \right) &0
            \\
            {\frac {7 \lambda y}{120}}&0&0&0&-3 x +y & \lambda  \left( 10 x -y  \right)
            \\
            {\frac {7 y}{600}}&-{\frac {7 \lambda y }{120}}&0&0&0&-5 x - \frac{y}{5}
        \end{pmatrix}.
        \label{eq:icosM}
    \end{align}
    \label{eq:icosLM}
\end{subequations}
Considering the characteristic polynomial \eqref{eq:detpol}
we obtain the invariant given in \cite{Hitchinetal1995}:
\begin{equation}
    H = y(3x-y)^2(4x+y)^3.
    \label{eq:icosH}
\end{equation}
Note that the level curves of the invariant $H$ \eqref{eq:icosH}
are genus one (elliptic) curves.

\begin{landscape}
From \eqref{eq:LPdiscrdef} we obtain the following
discrete Lax Pair:
\begin{subequations}
    \begin{align}
        L_{n}\left( \lambda \right) &=
        \begin{pmatrix}
                \frac{2\lambda}{5} \left( 25 x_{n} +y_{n} \right) &
                {\lambda}^{2} \left( 10 x_{n} -y_{n}  \right) &0&0&-168 y_{n} &336 \lambda y_{n}
                \\
                -2 x_{n} + \frac{y_{n}}{5} &2 \lambda  \left( 3 x_{n} -y_{n}  \right) &
                4 {\lambda}^{2}\left( 4 x_{n} +y_{n}  \right) &0&0&168 y_{n}
                \\
                0&-2 x_{n} -\frac{y_{n}}{2} &2 \lambda  \left( x_{n} +2 y_{n} \right) &
                6 {\lambda}^{2} \left( 3 x_{n} -y_{n}  \right) &0&0
                \\
                0&0&-2x_{n} +2/3 y_{n} &-2 \lambda  \left( x_{n} +2 y_{n}  \right) &4 {\lambda}^{2}
         \left( 4 x_{n} +y_{n}  \right) &0
            \\
            {\frac {7 {\lambda}^{2}y_{n}}{120}}&0&0&-2 x_{n} -\frac{y_{n}}{2} &
            -2 \lambda \left( 3 x_{n} -y_{n} \right) &{\lambda}^{2} \left( 10 x_{n} -y_{n} \right)
            \\
            {\frac {7 \lambda y_{n}}{300}}&-{\frac {7 {\lambda}^{2}y_{n}}{120}}&0&0&-2 x_{n}+\frac{y_{n}}{5} &-\frac{2}{5}\lambda  \left( 25 x_{n} +y_{n}  \right)
        \end{pmatrix},
        \label{eq:icosLd}
        \\
        M_{n}\left( \lambda \right) &=
        \begin{pmatrix}
            1-h\left(5 x_{n} +\frac{y_{n}}{5}\right) &-\lambda h \left( 10 x_{n} -y_{n}\right) &0&0&0& -168 h y_{n}
            \\
            0& 1-h\left(3 x_{n} -y_{n}\right) &-4h \lambda  \left( 4 x_{n} +y_{n}   \right) &0&0&0
            \\
            0&0&1-h\left(x_{n} +2 y_{n}\right) &-6h \lambda  \left( 3 x_{n} -y_{n}  \right) &0&0
            \\
            0&0&0&1+h\left(x_{n} +2 y_{n}\right) &-4 h\lambda  \left( 4 x_{n} +y_{n}  \right) &0
            \\
            -{\frac {7h \lambda y_{n}}{120}}&0&0&0&1+h\left(3 x_{n} -y_{n}\right) & -\lambda h \left( 10 x_{n} -y_{n}  \right)
            \\
            -{\frac {7h y_{n}}{600}}&{\frac {7h \lambda y_{n} }{120}}&0&0&0&1+h\left(5 x_{n} + \frac{y_{n}}{5}\right)
        \end{pmatrix}.
        \label{eq:icosMd}
    \end{align}
    \label{eq:icosLMd}
\end{subequations}
\end{landscape}
The corresponding compatibility conditions are:
\begin{subequations}
    \begin{align}
        {\frac {x_{n+1}-x_{n}}{h}} &= 2x_{n+1} x_{n} - y_{n+1} y_{n},
        \\
        {\frac {y_{n+1}-y_{n}}{h}} &=-5 \left(x_{n}y_{n+1}+x_{n+1} y_{n}\right)
        + y_{n} y_{n+1}.
    \end{align}
    \label{eq:icosd}
\end{subequations}
and coincide with the KHK discretisation of the reduced
Nahm system with icoshedral symmetry \eqref{eq:icos},
originally presented in \cite{PetreraPfadlerSuris2011}.
Proceeding in analogous ways as in section \ref{sec:tetra},
that is taking the first non-constant element of the Taylor series of
$H_{0}\left( \lambda \right)$, we obtain the following invariant:
\begin{equation}
    h_{0,1} ={\frac {112 y_{{n}}
        \left( 3 x_{{n}}-y_{{n}} \right) ^{2}
        \left( 4 x_{{n}}+y_{{n}} \right) ^{3}}
            \left[1-{h}^{2}\left( 25 x_{n}^{2}+2 x_{n}y_{n}+2 y_{{n}}^{2}\right)\right]
            \left[ 1-h^{2}\left(x_{{n}}-2 y_{{n}}\right)^{2} \right]
            \left[ 1-h^{2}\left(3 x_{{n}}-y_{{n}}\right)^{2} \right] }}.
    \label{eq:H0icos}
\end{equation}

\section{Conclusions}
\label{sec:concl}

In this paper we discretised the reduced Nahm systems \cite{Hitchinetal1995}
using the technique employed for the Euler top presented in
\cite{Kimura2017Lax,Sogo2017,Kimura2017JPhysA}.
Our results shows that the discretisation is analog to the so-called
Kahan--Hirota--Kimura discretisation.
We proved that such Lax pairs are ``bona fide''.
That is, they can be used to produce (all) the invariants of the associated
systems, and hence to prove integrability.
A Lax pair that cannot be used to produce (all) the invariants
of a given system is called a \emph{fake Lax pair}
\cite{CalogeroNucci1991,HayButler2013,HayButler2015}.

We conclude this paper noting that, unfortunately
Nahm systems and their generalisations are not enough to
explain the integrability of all KHK discretisable systems.
To this end we consider the following system, which is a particular
case of the coupled Euler top introduced in \cite{Golseetal2008}:
\begin{subequations}
    \begin{align}
        \dot{x}_1 &=x_2 x_3,
        \label{eq:e1nd}
        \\
        \dot{x}_2 &= x_1 x_3 ,
        \label{eq:e2nd}
        \\
        \dot{x}_3 &= x_{1}x_{2}+ x_{4}x_5,
        \label{eq:e3nd}
        \\
        \dot{x}_4  &=x_3 x_5,
        \label{eq:e4nd}
        \\
        \dot{x}_5 &=x_3 x_4.
        \label{eq:e5nd}
    \end{align}
    \label{eq:end}
\end{subequations}
This system is na\"ively integrable.
We say that system of difference equations is na\"ively integrable
when it possesses $N-1$ functionally independent first integrals
(invariants), where $N$ is the number of degrees of freedom.
In \cite{PetreraPfadlerSuris2011} it was proved that the system
\eqref{eq:end} possesses five first integrals, four of which are functionally
independent, proving na\"ive integrability.

It is easy to see that the system \eqref{eq:end} arises from the
following Nahm system:
\begin{subequations}
    \begin{align}
        T_{1} &=
        \begin{pmatrix}
            1&-x_1 &0
             \\
             x_1  &1& x_4
             \\
             0&-x_4 &1
         \end{pmatrix},
        \label{eq:T1nd}
        \\
        T_{2} &=
        \begin{pmatrix}
            1&0& x_3
            \\
            0&1&0
            \\
            -x_{3} &0&1
        \end{pmatrix},
        \label{eq:T2nd}
         \\
         T_{3} &=
         \begin{pmatrix}
             1& x_5 &0
             \\
             -x_5 & 1 & x_2
             \\
             0&-x_2 &1
         \end{pmatrix}.
        \label{eq:T3nd}
    \end{align}
    \label{eq:nahmnd}
\end{subequations}

So, the system \eqref{eq:end} has a Lax pair given by
\eqref{eq:LPnahm}:
\begin{subequations}
    \begin{align}
        A\left( \lambda \right) &=
        \begin{pmatrix}
            \left( 1-\imath \right) {\lambda}^{2}-2 \imath\lambda+1+i &
            -{\lambda}^{2}x_1  -2 \imath\lambda x_5 - x_1 &
            -\imath{\lambda}^{2} x_3 +\imath x_3
            \\
            {\lambda}^{2} x_1 +2 \imath \lambda x_5  + x_1 &
            \left( 1-\imath \right) {\lambda}^{2}-2 \imath\lambda+1+i &
            {\lambda}^{2} x_4 -2 \imath \lambda x_2 + x_4
            \\
            \imath{\lambda}^{2} x_3 -\imath x_3 &
            -{\lambda}^{2} x_4 +2 \imath\lambda x_2 - x_4 &
            \left( 1-\imath \right) {\lambda}^{2}-2 \imath \lambda+1+\imath
        \end{pmatrix},
        \label{eq:ACET2}
        \\
        B\left( \lambda \right) &=
        \begin{pmatrix}
            -\imath+ \left( 1-\imath \right) \lambda&
            -\imath x_5 -\lambda x_1 &
            -\imath x_3
            \\
            \imath x_5 +\lambda x_1 &
            -\imath+ \left( 1-\imath \right) \lambda&
            -\imath x_2 +\lambda x_4
            \\
            \imath\lambda  x_3 &
            \imath x_2 -\lambda x_4 &
            -\imath+ \left( 1-\imath \right) \lambda
        \end{pmatrix},
        \label{eq:BCET2}
    \end{align}
    \label{eq:LaxCET2}
\end{subequations}
and the characteristic polynomial \eqref{eq:detpol} of $L\left( \lambda \right)$
is:
\begin{equation}
    \begin{aligned}
        p_{L}\left( \mu \right)
        &=
        {\mu}^{3}
        + \left( 3-3 \imath \right)  \left( \imath\lambda-{\lambda}^{2}-\imath-\lambda \right) {\mu}^{2}
        \\
        &+
        \left[
            \begin{gathered}
                \left(  \mathcal{I}_{1} -6 \imath \right) {\lambda}^{4}
                +4 \imath \left( \mathcal{I}_{2} -3+3 \imath \right) {\lambda}^{3}
                -4 \mathcal{I}_{3} \lambda^{2}
                +4 \imath \left( \mathcal{I}_{2} -3 -3 \imath \right) \lambda
                + \mathcal{I}_{1} +6 \imath
            \end{gathered}
        \right]\mu
        \\
        &-\left( 1-\imath \right)
        \left( \mathcal{I}_{1} - 2 \imath \right) {\lambda}^{6}
        +2 \imath \left[
            2 \left(\imath-1\right) \mathcal{I}_{2} + \mathcal{I}_{1}-6 \imath \right] {\lambda}^{5}
        \\
        &- \frac{3-\imath}{5}
        \left[ 5 \mathcal{I}_1+(12+4\imath)\mathcal{I}_2 -(8-4\imath)\mathcal{I}_3-12+6\imath \right] \lambda^{4}
        \\
    &+4 \imath
    \left( 4+\mathcal{I}_{1}-2\mathcal{I}_{2}-2\mathcal{I}_{3} \right) {\lambda}^{3}
        \\
        &+ \frac{3+\imath}{5} \left( 12+6\imath -5\mathcal{I}_1-4(3-\imath) \mathcal{I}_2 +4(2+\imath)\mathcal{I}_3  \right) {\lambda}^{2}
    \\
    &-2 \imath\left[ 2 \left(1+\imath\right) \mathcal{I}_{2} -\mathcal{I}_{1} -6 i \right] \lambda
        - \left( 1+i \right)  \left( \mathcal{I}_{1} +2 i \right)
    \end{aligned}
    \label{eq:pCET2}
\end{equation}
where:
\begin{equation}
    \mathcal{I}_{1} = x_1^{2}- x_3^{2}+ x_4^{2},
    \quad
    \mathcal{I}_{2} = x_1 x_5  - x_4 x_2,
    \quad
    \mathcal{I}_{3} = x_{2}^{2}-x_{3}^{2}+x_{5}^{2}.
    \label{eq:ndint}
\end{equation}
Taking the coefficients of \eqref{eq:pCET2} with respect to
$\lambda$ and $\mu$ we obtain that the three functions in \eqref{eq:ndint}
are the only independent invariants given by $L\left( \lambda \right)$.
This shows that the Lax pair \eqref{eq:LaxCET2} does not prove
the na\"ive integrability of the system \eqref{eq:end}.
In this sense the Lax pair \eqref{eq:end} is fake in the sense of
\cite{CalogeroNucci1991,HayButler2013,HayButler2015}.

Now consider the discrete Nahm system \eqref{eq:LPdiscrinv}
corresponding to the Nahm matrices \eqref{eq:nahmnd}:
\begin{subequations}
    \begin{align}
        T_{1,n} &=
        \begin{pmatrix}
            1&-x_{1,n} &0
             \\
             x_{1,n}  &1& x_{4,n}
             \\
             0&-x_4 &1
         \end{pmatrix},
        \label{eq:T1ndd}
        \\
        T_{2,n} &=
        \begin{pmatrix}
            1&0& x_{3,n}
            \\
            0&1&0
            \\
            -x_{3,n} &0&1
        \end{pmatrix},
        \label{eq:T2ndd}
         \\
         T_{3,n} &=
         \begin{pmatrix}
             1& x_{5,n} &0
             \\
             -x_{5,n} & 1 & x_{2,n}
             \\
             0&-x_{2,n} &1
         \end{pmatrix}.
        \label{eq:T3ndd}
    \end{align}
    \label{eq:nahmndd}
\end{subequations}
Unfortunately, we obtain the compatibility conditions are overdetermined,
in the sense that we have more compatibility conditions than
independent variables.
For instance, let us consider the first discrete Nahm equation
$T_{1,n+1}-T_{1,n} = h\left( T_{2,n+1}T_{3,n}-T_{3,n+1}T_{2,n} \right)$
writing down the coefficients explicitly:
\begin{subequations}
    \begin{align}
        x_{1,n+1}-x_{1,n}&=h \left( x_{3,n+1}x_{2,n}- x_{5,n}+ x_{5.n+1} \right),
        \\
        x_{3,n+1}-x_{3,n} &=0,
        \label{eq:cet2discrwrongx3p}
        \\
        x_{1,n+1}-x_{1,n} &=h \left( {  x}_{2,{n+1}}{  x}_{3,{n}}-{  x}_{5,{n}}+{  x}_{5,{n+1}} \right),
        \\
        {  x}_{4,{n+1}}-{  x}_{4,{n}} &=h \left( {  x}_{5,{n+1}}{  x}_{3,{n}} +{  x}_{2,{n}}-{  x}_2,{{n+1}} \right) ,
        \\
        {  x}_{4,{n+1}}-{  x}_{4,{n}} &=h \left( {  x}_{3,{n+1}}{  x}_{5,{n}}+{  x}_{2,{n}}-{  x}_{2,{n+1}} \right).
    \end{align}
    \label{eq:cet2discrwrong}
\end{subequations}
It is clear that \eqref{eq:cet2discrwrongx3p} implies that the discrete
time evolution of $x_{3,n}$ is trivial. So, the discrete Nahm system
\eqref{eq:cet2discrwrong} cannot be a discretisation of the integrable
system \eqref{eq:end}.

On the other hand in \cite{PetreraPfadlerSuris2011} it was proven that
the KHN discretisation of the system \eqref{eq:end} exists and it is
algebraically integrable.
More precisely, using the method of the Hirota--Kimura bases \cite{PetreraPfadlerSuris2009},
the authors proved that such KHK discretisation preserves all five invariants
of its continuous counterpart \eqref{eq:end}.
We note that the functionally independent invariants of such KHK discretisation
can be found directly, that is without using the Hirota--Kimura bases,
with the method of \cite{FalquiViallet1993}.
See also \cite{Gubbiotti_Levi70} for an explanation of the method in the
case of difference equations.

So, to conclude, this example shows that, although very useful
in several case, the Nahm's equations approach is not enough
to explain integrability of quadratic vector equations in both
the continuous and the discrete case.

\section*{Acknowledgements}

This research was supported by Dr. M. Radnovi\v{c}'s grant
DP160101728 and by Prof. N. Joshi and Dr. Milena Radnovi\v{c}'s
grant DP200100210 from the Australian Research Council.

The author expresses his gratitude to Prof. N. Joshi,
Prof. G. R. W. Quispel and Dr. D. T. Tran
for their helpful discussions during the preparation of this paper.
We thank the anonymous referee, whose comments led to a great
improvement of the paper.

\bibliographystyle{plain}


\section{INTRODUCTION}{\label{INTRODUCTION}}
The state $\phi(2170)$ was observed by the Babar Collaboration via the process $e^+ e^- \to \gamma \phi f_0(980)$~\cite{Aubert:2006bu}, and later confirmed by Belle, BESII, and BESIII Collaborations~\cite{Shen:2009zze,Ablikim:2007ab,Ablikim:2014pfc, Ablikim:2017auj}.
However, the available information of the $\phi(2710)$, only obtained from the $e^+e^-$ collision experiments,  is not enough to distinguish different interpretations, such as  $c\bar{c}$, tetraquark state, hybrid, $\Lambda \bar{\Lambda}$ or $\phi f_0(980)$ molecule. The information about the $\phi(2170)$ production in other processes will be helpful to shed light on its nature.

As we know, the associate production of hadrons by photon has been extensively studied since it provides an excellent
tool to learn details of the hadron spectrum~\cite{Xie:2013mua,Wang:2014jxb,Wang:2016dtb,Wang:2017hug}. The intense photon beams can be used to study the strangeonium-like states because of the strong affinity of the photon for $s\bar{s}$.
It should be pointed out that, in Fig.~25 of Ref.~\citenum{Busenitz:1989gq}, the $K\bar K$
 distribution of the reaction $\gamma N \to K^+ K^-N$ shows an enhancement around 2150~MeV exists, which could be associated to a resonance with the same quantum numbers as $\phi(1680)$, i.e. $J^{PC}=1^{--}$. Thus, it is natural to associate this structure to the $\phi(2170)$, which implies that the $\phi(2170)$ photo-production should be accessible experimentally.
In addition, $\Gamma(\phi(2170)\rightarrow\eta\phi)/\Gamma(\phi(2170)\rightarrow\phi f_0(980))=(1.7\pm 0.7\pm 1.3)/(2.5\pm 0.8\pm 0.4)$~\cite{PDG2018}
indicates that the coupling of the $\phi(2170)$ to the $\phi f_0(980)$ channel is of the same order of magnitude as its coupling to $\eta \phi$ channel, which suggests that the $\phi(2170)$ has a sizeable coupling to the $\eta\phi$ channel.  All the above factors encourage us to study the  $\phi(2170)$ production in the reaction of $\gamma p \to \eta \phi p$ within the effective Lagrangian approach.

\section{FORMALISMS}{\label{sec:formalism}}
\begin{figure*}[t]
  \centering
  \includegraphics[width=0.8\textwidth]{feynman.eps}
  \caption{Feynman diagrams for the $\gamma p\to\eta \phi p$ reaction. (a) the contribution of the $t$-channel $\pi^0$ and $\eta$ exchanges with the intermediate states $N$ and $N^*$. (b) the contribution of the  intermediate states $\phi(2170)$ production.}
  \label{fig:feyn}
\end{figure*}

In this section, we will present the mechanisms for the reaction,
\begin{equation}
\gamma (p_1, s_1)+ p(p_2,s_2) \to \phi (p_3, s_3) +\eta (p_4) + p (p_5,s_5),
\end{equation}
by considering the tree level diagram as depicted in Fig.~\ref{fig:feyn}. We consider the background contribution of the $t$-channel $\pi^0$ and $\eta$ exchanges with the final state $\eta p$ producing through the intermediate states $N$ and $N^*$, as shown in Fig.~\ref{fig:feyn}(a). The $\phi(2170)$ can be directly produced by $t$-channel $\pi^0$ and $\eta$ exchanges, and then decays to $\eta\phi$, which is shown in Fig.~\ref{fig:feyn}(b).

Then the differential cross section for the reaction $\gamma p\to \eta\phi p$ can be expressed as,
\begin{eqnarray}
 d\sigma(\gamma p\to \eta\phi p) &=& \frac{1}{8E_\gamma} \bar\sum |\mathcal{M}_{\rm total}|^2 \times \nonumber \\
&& \frac{d^3p_3}{2E_3} \frac{d^3p_4}{2E_4} \frac{m_p d^3p_5}{E_5} \delta^4(p_1+p_2-p_3-p_4-p_5),
\end{eqnarray}
with
\begin{eqnarray}
\mathcal{M}_{\rm total} = \mathcal{M}^\pi_N+\mathcal{M}^\pi_{N^*}+\mathcal{M}^\eta_N+\mathcal{M}^\eta_{N^*}+\mathcal{M}_{\phi^*},
\end{eqnarray}
where $E_3$, $E_4$, and $E_5$ are the energies of the $\phi$, $\eta$, and outgoing proton, respectively, and $E_\gamma$ is the photon energy in the laboratory frame. The details of the scattering amplitudes are given in Ref.~\citenum{Zhao:2019syt}.

\section{RESULT AND DISCUSSION}{\label{sec:results}}

\begin{figure}[h]
\centering
\includegraphics[width=0.4\textwidth]{dcs1x.eps}
 \includegraphics[width=0.4\textwidth]{tcs.eps}
 \caption{Left: The $\eta\phi$ mass distribution of the $\gamma p\to\eta\phi p$ reaction with $E_\gamma=8$~GeV in the presence of $\Gamma(\phi(2170)\rightarrow\eta\phi)\simeq6.6$~MeV. The curves labeled as `B' and `$\phi^*$'stand for the contributions of the background and the intermediate $\phi(2170)$ production, respectively. The curve labeled as `T' corresponds to the total contributions. Right: Total cross section of the $\gamma p\to\phi\eta p$ reaction.}
  \label{fig:dcs}
  \end{figure}
With the above formalisms, we calculate the total and differential cross sections for the $\gamma p\to\eta \phi p$ reaction by using a Monte Carlo multi-particle phase space integration program.
The $\eta\phi$ mass distribution of the $\gamma p\to \eta\phi p$ reaction with $E_\gamma=8$~MeV is shown in the left panel of Fig.~\ref{fig:dcs}.
 As we can see, there is a peak structure around 2180~MeV, which is associated to the resonance $\phi(2170)$. As shown in Ref.~\citenum{Zhao:2019syt}, there still exists a bump structure even with the low limit of the couplings of the $\phi(2170)$.

  It should be pointed out that for the photo-production, there is a contribution from Pomeron exchange, whose effect is dominant at large center-of-mass energy and forward angle. However, in this paper only the $\eta\phi$ mass distribution is relevant to the signal of $\phi(2170)$, and the comprehensive mechanism involved the Pomeron exchange dose not change too much the shape of the $\eta\phi$ mass distribution.

In the right panel of Fig.~\ref{fig:dcs}, we show the total cross section of the $\gamma p\to\eta\phi p$ reaction. Very recently, the reaction of $\gamma p\to\eta \phi p$ is also suggested to study the nucleon resonances production in Ref.~\citenum{Fan:2019lwc} where the total cross section at $E_\gamma=3.8$~GeV is around $8\sim 10$~nb, which is consistent with our prediction.

\section{Conclusions}
\label{sec:conclusion}
Motivated by the small enhancement around $2150$~MeV in the $K^+K^-$ mass distribution of the $\gamma p\to K^+K^-p$ reaction measured by Omega Photon Collaboration, and the clues that the branching ratio Br$(\phi(2170)\to \eta \phi)$ is of the same order as Br$(\phi(2170)\to \phi f_0(980))$, we propose to search for the resonance $\phi(2170)$ in the $\gamma p\to\eta\phi p$ reaction. Our calculations show that there will be a peak, at least a bump structure around 2180~MeV in the $\eta\phi$ mass distribution of $\gamma p\to\phi\eta p$ reaction.

Finally, it should be noted that the GlueX Collaboration has proposed to search for the $\phi(2170)$ in the photoproduction~\cite{AlekSejevs:2013mkl}, and the $\gamma p \to \eta\phi p$ reaction has been selected as a particularly suitable process to search for strangeonium states by the CLAS12 Collaboration~\cite{Filippi:2015wea}. Our predictions should be useful for the future experimental study.

\section*{Acknowledgements}

This work is partly supported by the National Natural
Science Foundation of China under Grant Nos. 11505158, 11605158. It is also supported by the Academic Improvement Project of Zhengzhou University.

\bibliographystyle{ws-procs9x6}


\section{Introduction}

Referring Expression Grounding (REG), \textit{i}.\textit{e}., localizing the targeted instance (referent) in an image given a natural language description, is a longstanding task for multimodal understanding. Considering different granularities of localization, there are two sub-types of REG: 1) \emph{Referring Expression Comprehension (REC)}~\cite{hu2017modeling,hu2016natural,yu2016modeling,yu2017joint}, where the referents are localized by bounding boxes (bboxes). 2) \emph{Referring Expression Segmentation (RES)}~\cite{hu2016segmentation,liu2017recurrent,shi2018key,margffoy2018dynamic}, where the referents are localized by segmentation masks. Both tasks are important for many downstream high-level applications such as visual question answering~\cite{antol2015vqa}, navigation~\cite{chen2019touchdown}, and autonomous driving~\cite{kim2019grounding}.

State-of-the-art REG methods can be classified into two major categories: one-stage, proposal-free methods and two-stage, proposal-driven methods. For the one-stage methods~\cite{chen2018real,yang2019fast,liao2020real}, they regard REG as a generalized object detection (or segmentation) task, and the whole textual expression is treated as a specific object category. Although these one-stage methods achieve faster inference speed, their grounding performance, especially for complex expressions (\textit{e}.\textit{g}., RefCOCOg), is still behind the two-stage counterpart. The main reasons for the differences are two-fold: 1) The one-stage methods naturally focus on the local content, \textit{i}.\textit{e}., they fail to perform well in the expressions which need global reasoning. For example in Figure~\ref{fig:motivation} (a), when grounding "\emph{a cat laying down on a white towel next to some keys}", it is even difficult for humans to identify the referent \texttt{cat} without considering its contextual objects \texttt{towel} and \texttt{keys}. 2) The one-stage methods do not exploit the linguistic structure of expressions, \textit{i}.\textit{e}., they are not sensitive to linguistic variations in expressions. For instance, when changing the expression in Figure~\ref{fig:motivation} (a) to "\emph{cute cat with stripes looking toward the cat on a white towel}", they tend to refer to the same object (\#1)~\cite{akula2020words}. On the contrary, two-stage methods~\cite{yu2018mattnet,liu2019learning,liu2019improving} intuitively are more similar to the human way of reasoning: 1) detecting proposals with a detector, and then 2) grounding the referent to one of the proposals. In general, two-stage methods with perfect proposals\footnote{For the RefCOCO-like datasets, two-stage methods can use ground-truth regions in COCO~\cite{lin2014microsoft} as proposals.} can achieve more accurate and explainable grounding results than the one-stage methods.

\begin{figure}[t]
	\centering
	\includegraphics[width=0.95\linewidth]{images/motivation.pdf}
	\vspace{-0.5em}
	\caption{\textbf{(a):} A typical example from RefCOCOg dataset. \textbf{(b):} Recall of the referent (IoU>0.5) vs. number of proposals on the RefCOCO testB set. Real case denotes the actual situation in SOTA two-stage methods. \textbf{(c):} An example of filtered proposals from MAttNet~\cite{yu2018mattnet} with threshold 0.65. The dashline denotes the missing referent.}
	\vspace{-1.5em}
	\label{fig:motivation}
\end{figure}

Unfortunately, when using the results from off-the-shelf detectors as proposals, two-stage methods' performance drops dramatically. This is also the main weakness of two-stage solutions often criticized by competing methods in the literature, \textit{i}.\textit{e}., the performance of two-stage methods is heavily limited by the proposal quality. In this paper, we argue that this huge performance gap between the detected and ground-truth proposals is mainly caused by the \textbf{mismatch} between the roles of proposals in the two stages: \emph{the first-stage network generates proposals solely based on the detection confidence, while the second-stage network just assumes that the generated proposals will contain all right instances in the expression}. More specifically, for each image, a well pre-trained detector can detect hundreds of detections with a near-perfect recall of the referent and contextual objects (\textit{e}.\textit{g}., as shown in Figure~\ref{fig:motivation} (b), recall of the referent can reach up to 96.58\% with top-100 detections). However, to relieve the burden of the referent grounding step in the second stage, current two-stage methods always filter proposals simply based on their detection confidences. These heuristic rules result in a sharp reduction of the recall (\textit{e}.\textit{g}., decrease to 80.77\% as in Figure~\ref{fig:motivation} (b)), and bring in the mismatch negligently. To illustrate this further, we show a concrete example in Figure~\ref{fig:motivation} (c). To ground the referent at the second stage, we hope that the proposals contain the referent \texttt{person} and its contextual object \texttt{pizza}. In contrast, the first-stage network only keeps bboxes with high detection confidence (\textit{e}.\textit{g}., \texttt{knife}, \texttt{book}, and \texttt{cup}) as proposals, but actually misses the critical referent \texttt{person} (red bbox).

In this paper, we propose a novel algorithm Ref-NMS, to rectify the mismatch of detected proposals at the conventional first stage. In particular, for each expression, Ref-NMS regards all nouns in the expression as critical objects, and introduces a lightweight relatedness module to predict a probability score for each proposal to be a critical object. The higher predicted score denotes the higher relevance between a proposal and the expression. Then, we fuse the relatedness scores and classification scores, and exploit the fused scores as the suppression criterion in Non-Maximum Suppression (NMS). After NMS, we can filter out the proposals with little relevance to the expression. Finally, all proposals and the expression are fed into the second-stage grounding network, to obtain the referent prediction.

We demonstrate the significant performance gains of Ref-NMS on three challenging REG benchmarks. It's worth noting that the Ref-NMS can be generalized and easily integrated into any state-of-the-art two-stage method to further boost its performance on both REC and RES. Our method is robust and efficient, opening the door for many downstream applications such as multimodal summarization.

\section{Related Work}

\noindent\textbf{Referring Expression Comprehension (REC).} The current overwhelming majority of REC methods are in a two-stage manner~\cite{zhang2018grounding,zhuang2018parallel,wang2019neighbourhood,yang2019dynamic,yu2018mattnet,niu2019variational}: proposal generation and referent grounding. To the best of our knowledge, existing two-stage works all focus on the second stage. Specifically, they tend to design a more explainable reasoning process by structural modeling~\cite{yu2018mattnet,liu2019improving,liu2019learning,hong2019learning}, or more effective multi-modal interaction mechanism~\cite{yang2019dynamic,wang2019neighbourhood}. However, their performance is strictly limited by the proposals from the first stage. Recently, another emerging direction to solve REC is in a one-stage manner~\cite{chen2018real,yang2019fast,liao2020real}. Although one-stage methods achieve faster inference speed empirically, they come at a cost of lost interpretability and poor performance in composite expressions. In this paper, we focus on the two-stage REC methods, and try to rectify the overlooked mismatch.

Phrase grounding~\cite{akbari2019multi,dogan2019neural} is another closely related task to the REC. Similarly, there are two types of solutions: proposal-free and proposal-driven methods. In theory, Ref-NMS can also be applied to the proposal-driven methods and further boost their performance. We leave this for future works.

\noindent\textbf{Referring Expression Segmentation (RES).} Unlike REC, most of RES works are one-stage methods~\cite{hu2016segmentation,liu2017recurrent,shi2018key,margffoy2018dynamic,li2018referring}. They typically resort to FCN~\cite{long2015fully} and utilize a "concatenation-convolution" design to combine the two different modalities: they first concatenate the expression feature with visual features at each location, and then use several conv-layers to fuse the multimodal features for mask generation. To further improve mask qualities, they usually enhance their backbones with more effective features by multi-scale feature fusion~\cite{margffoy2018dynamic}, feature progressive refinement~\cite{li2018referring,chen2019see}, or novel attention mechanisms~\cite{shi2018key,ye2019cross}. Besides, with the development of two-stage instance segmentation networks (\textit{e}.\textit{g}., Mask R-CNN~\cite{he2017mask}), two-stage REC methods can be extended to solve the RES problem simply by replacing the object detection network at the second stage to an instance segmentation network. Analogously, Ref-NMS can be easily integrated into any two-stage RES method.

\noindent\textbf{Non-Maximum Suppression (NMS).} NMS is a de facto standard post-processing step adopted by numerous modern object detectors, which removes duplicate bboxes based on detection confidence. Except for the most prevalent GreedyNMS, multiple improved variants have been proposed in the last few years. Generally, they can be categorized into three groups: 1) Criterion-based~\cite{jiang2018acquisition,tychsen2018improving,tan2019learning,yang2019learning}: they utilize other scores instead of classification confidence as the criterion to remove bboxes by NMS, \textit{e}.\textit{g}., IoU scores. 2) Learning-based~\cite{hosang2017learning,hu2018relation}: they directly learn an extra network to remove duplicate bboxes. 3) Heuristic-based~\cite{bodla2017soft,liu2019adaptive}: they dynamically adjust the thresholds for suppression according to some heuristic rules. In this paper, we are inspired by the criterion-based NMS, and design the Ref-NMS, which uses both expression relatedness and detection confidence as the criterion.

\begin{figure}[t]
	\centering
	\includegraphics[width=0.98\linewidth]{images/two-stage-models.pdf}
	\caption{\textbf{Upper}: A typical two-stage REG framework, which uses heuristic filter rules to obtain expression-agnostic proposals at the first-stage, and feeds them into the second stage for referent grounding. \textbf{Below}: The Ref-NMS model can generate expression-aware proposals by considering the expression at the first stage.}
	\label{fig:two-stage-models}
\end{figure}

\section{Approach}

In this section, we first revisit the typical two-stage REG framework in Section~\ref{sec:revisit}, and then introduce the details about Ref-NMS in Section~\ref{sec:ref-nms}, including the relatedness module and training objectives.

\subsection{Revisiting Two-Stage REG Framework}\label{sec:revisit}
The two-stage framework is the most prevalent pipeline for REG. As shown in Figure~\ref{fig:two-stage-models}, it consists of two separate stages: proposal generation at the first-stage and referent grounding at the second-stage.

\noindent\textbf{Proposal Generation.} Given an image, current two-stage methods always resort to a well pre-trained detector to obtain a set of initially detected bboxes, and utilize an NMS to remove duplicate bboxes. However, even after NMS operation, there are still thousands of bboxes left (\textit{e}.\textit{g}., each image in RefCOCO has an average of 3,500 detections). To relieve the burden of the following referent grounding step, all existing works further filter these bboxes based on their detection confidences. Although this heuristic filter rule can reduce the number of proposals, it also results in a drastic drop in the recall of both the referent and contextual objects (Detailed results are reported in Table~\ref{tab:hit-rate}.).

\noindent\textbf{Referent Grounding.} In the training phase, two-stage methods usually use the ground-truth regions in COCO as proposals, and the number is quite small (\textit{e}.\textit{g}., each image in RefCOCO has an average of 9.84 ground-truth regions). For explainable grounding, state-of-the-art two-stage methods always compose these proposals into graph~\cite{yang2019dynamic,wang2019neighbourhood} or tree~\cite{liu2019learning,hong2019learning} structures, \textit{i}.\textit{e}., as the number of proposals increases linearly, the number of computation increases exponentially. Therefore, in the test phase, it is a must for them to filter detections at the first stage.

\begin{figure}[t]
	\centering
	\includegraphics[width=1.0\linewidth]{images/architecture.pdf}
	\caption{The overview of Ref-NMS model. Given an image, the model uses a pre-trained detector to generate thousands of initial bboxes. Then, hundreds of filtered bboxes and the expression are fed into the relatedness module to predict their relatedness scores. Lastly, the fused scores are used as the suppression criterion of NMS.}
	\label{fig:architecture}
\end{figure}

\subsection{Ref-NMS}\label{sec:ref-nms}

\subsubsection{Relatedness Module}

An overview of the Ref-NMS model is shown in Figure~\ref{fig:architecture}. The core of Ref-NMS is the relatedness module. Given an image and a pre-trained detector, we can receive thousands of initial bboxes. To reduce the computation of the relatedness module, we first use a threshold $\delta$ to filter the bboxes with classification confidence, and obtain a filtered bbox set $\mathcal{B}$. For each bbox $\bm{b}_i \in \mathcal{B}$, we use a region visual encoder $e_v$ (\textit{i}.\textit{e}., an RoI Pooling layer and a convolutional head network) to extract the bbox feature $\bm{v}_i \in \mathbb{R}^v$. Meanwhile, for the referring expression $Q$, we use an expression encoder $e_q$ (\textit{i}.\textit{e}., a Bi-GRU) to output a set of word features $\{\bm{w}_1, ..., \bm{w}_{|Q|}\}$, where $\bm{w}_j \in \mathbb{R}^q$ is the $j$-th word feature. For each bbox $\bm{b}_i$, we use a soft-attention mechanism to calculate a unique expression feature $\bm{q}_i$ by:
\begin{equation} \label{eq:1}
\bm{v}^a_i = \text{MLP}_a (\bm{v}_i), \quad a_{ij} = \text{FC}_s ([\bm{v}^a_i; \bm{w}_j]), \quad \alpha_{ij} = \text{softmax}_j(a_{ij}),  \quad \bm{q}_i = \textstyle{\sum_j} \alpha_{ij} \bm{w}_j,
\end{equation}
where $\text{MLP}_a$ is a two-layer MLP mapping $\bm{v}_i \in \mathbb{R}^v$ to $\bm{v}^a_i \in \mathbb{R}^q$, $\text{FC}_s$ is a FC layer to calculate the similarity between bbox feature $\bm{v}^a_i$ and word feature $\bm{w}_j$, and $[;]$ is a concatenation operation. Then, we combine the two modal features and predict the relatedness score $r_i$:
\begin{equation}
\bm{v}^b_i = \text{MLP}_b(\bm{v}_i), \quad \bm{m}_i = \text{L2Norm}(\bm{v}^b_i \odot \bm{q}_i), \quad \hat{r}_i = \text{FC}_r(\bm{m}_i), \quad r_i = \text{sigmoid}(\hat{r}_i),
\end{equation}
where $\text{MLP}_b$ is a two-layer MLP mapping $\bm{v}_i \in \mathbb{R}^v$ to $\bm{v}^b_i \in \mathbb{R}^q$, $\odot$ is the element-wise multiplication, L2Norm represents $l_2$ normalization, and $\text{FC}_r$ is a FC layer mapping $\bm{m}_i \in \mathbb{R}^q$ to $\hat{r}_i \in \mathbb{R}$.

\noindent\textbf{Score Fusion.} After obtaining the relatedness score $r_i$ for bbox $\bm{b}_i$, we multiple $r_i$ with the classification confidence $c_i$ for bbox $\bm{b}_i$ from the original detector, and utilize the multiplication of two scores $s_i$ as the suppression criterion of the NMS operation, \textit{i}.\textit{e}., $s_i = r_i \times c_i$.

\subsubsection{Training Objectives for Ref-NMS}
To learn the relatedness score for each bbox, we need the ground-truth annotations for all mentioned instances (\textit{i}.\textit{e}., both referent and contextual objects) in the expression. However, current REG datasets only have annotations about the referent. Thus, we need to generate pseudo ground-truths for contextual objects. Specifically, we first assign POS tags to each word in the expression using the spaCy POS tager~\cite{spacy2} and extract all nouns in the expression. Then, we calculate the cosine similarity between GloVe embeddings~\cite{pennington2014glove}  of extracted nouns and categories of ground-truth regions in COCO\footnote{Two-stage methods always use a detector pretrained on COCO. Thus, we don't use extra or more annotations.}. Lastly, we use threshold $\gamma$ to filter regions as the pseudo ground-truths.

In the training phase, we regard all the pseudo ground-truth bboxes and annotated referent bboxes as foreground bboxes. And we use two following types of training objectives for the Ref-NMS:

\noindent\textbf{Binary XE Loss.} For each bbox $\bm{b}_i \in \mathcal{B}$, if it has a high overlap (\textit{i}.\textit{e}., IoU>0.5) with any foreground bbox, its ground-truth relatedness score $r^*$ is set to 1, otherwise $r^*=0$. Then the relatedness score prediction becomes a binary classification problem. We can use the binary cross-entropy (XE) loss as the training objective:
\begin{equation}
\begin{aligned}
L = -\frac{1}{|\mathcal{B}|} \textstyle{\sum^{|\mathcal{B}|}_{i=1}} r^*_i \log(r_i) + (1-r^*_i) \log(1-r_i).
\end{aligned}
\end{equation}

\noindent\textbf{Ranking Loss.} Generally, if a bbox has a higher IoU with foregound bboxes, the relatedness between the bbox and expression should be higher, \textit{i}.\textit{e}., we can use the ranking loss as the training objectives:
\begin{equation}
L = \frac{1}{N} \textstyle{\sum_{(\bm{b}_i, \bm{b}_j), \rho_i < \rho_j}} \max (0, r_i - r_j + \alpha),
\end{equation}
where $\rho_i$ denotes the largest IoU value between bbox $\bm{b}_i$ and foreground bboxes, $N$ is the total number of pos-neg training pairs, and $\alpha$ is a constant to control the ranking margin, set as 0.1. To select the pos-neg pair $(\bm{b}_i, \bm{b}_j)$, we follow the sampling-after-splitting strategy~\cite{tan2019learning}. Specifically, we first divide the bbox set $\mathcal{B}$ into 6 subsets based on a quantization $q$-value: $q_i = \lceil \text{max}(0, \rho_i - 0.5)/0.1  \rceil$, \textit{i}.\textit{e}., the bbox with higher IoU value has larger $q$-value. Then, all bboxes with $\rho > 0.5$ are selected as positive samples. For each positive sample, we rank the top-$h$ bboxes as negative samples based on predicted relatedness scores from the union of subsets with smaller $q$-value.

\subsubsection{Implementation Details}

\noindent\textbf{Language Settings.} We build a vocabulary for each dataset by filtering the words less than 2 times, and exploit the 300-d GloVe embeddings~\cite{pennington2014glove}  as the initialization of word embeddings. We use an "unk" symbol to replace all words out of the vocabulary. The largest length of sentences is set to 10 for RefCOCO and RefCOCO+, 20 for RefCOCOg. The hidden size of the encoder $e_q$ is set to 256.
\noindent\textbf{Visual Settings.} For visual encoder $e_v$, we use the same head network of the Mask R-CNN with ResNet-101 backbone\footnote{https://github.com/lichengunc/mask-faster-rcnn} as prior works~\cite{yu2018mattnet}, and utilize the pre-trained weights as initialization. The weights of the original detector (\textit{i}.\textit{e}., the gray part in Figure~\ref{fig:architecture} ) are fixed during the training phase.
\noindent\textbf{Parameter Settings.} The whole model is trained with Adam optimizer. The initial learning rate is initialized to 4e-4 and 5e-3 for the head network and the rest of network. We set the batch size as 8. The thresholds $\delta$ and $\gamma$ are set to 0.05 and 0.4, respectively. For ranking loss, the top-h is set to 100.

\section{Experiments}
\subsection{Datasets and Evaluation Metrics}

\noindent\textbf{Datasets.} We evaluate the Ref-NMS on three challenging REG datasets collected from the COCO images~\cite{lin2014microsoft}: 1) \textbf{RefCOCO}~\cite{yu2016modeling}:  It consists of 142,210 referring expressions for 50,000 objects in 19,994 images. These expressions are collected in an interactive game interface~\cite{kazemzadeh2014referitgame}, and the average length of each expression is 3.5 words. All expression-referent pairs are split into train, validation, testA, and testB sets. The testA set contains the images with multiple people and the testB set contains the images with multiple objects. 2) \textbf{RefCOCO+}~\cite{yu2016modeling}: It consists of 141,564 referring expressions for 49,856 objects in 19,992 images. Similar to RefCOCO, these expressions are collected from the same game interface, and have train, val, testA, and testB splits. Compared to RefCOCO, these expressions don't include absolute locations. 3) \textbf{RefCOCOg}~\cite{mao2016generation}: It consists of 104,560 referring expressions for 54,822 objects in 26,711 images. These expressions are collected in a non-interactive way, and the average length of each expression is 8.4 words. We follow the same split as~\cite{nagaraja2016modeling}.

\noindent\textbf{Evaluation Metrics.} For the REC task, we use the top-1 accuracy as the evaluation metric. When the IoU between bbox and ground truth is larger than 0.5, the prediction is correct. For the RES task, we use the overall IoU and Pr@X (the percentage of samples with IoU higher than X)\footnote{Due to the limited space, all RES results with the Pr@X metric are provided in the supplementary materials.} as metrics.

\subsection{Ablation Studies}

\subsubsection{Recall Analyses of the Referent and Contextual Objects}

\noindent\textbf{Settings.} To evaluate the effectiveness of the Ref-NMS to improve the recall of both referent and contextual objects, we compare Ref-NMS with plain GreedyNMS used in the baseline detector (\textit{i}.\textit{e}., ResNet-101 based Mask R-CNN). Since we only have annotated ground-truth bboxes for the referent, we calculate the recall of pseudo ground-truths to approximate the recall of contextual objects. The results are reported in Table~\ref{tab:hit-rate}, and more detailed results are provided in the supplementary materials.

\noindent\textbf{Results.} From Table~\ref{tab:hit-rate}, we have the following observations. When using top-100 bboxes as proposals, all three methods can achieve near-perfect recall ($\approx$ 97\%) for the referent and acceptable recall ($\approx$ 90\%) for the contextual objects, respectively. However, when the number of proposals decreases to a very small number (\textit{e}.\textit{g}., <10 in the real case), the recall of the baseline all drops significantly (\textit{e}.\textit{g}., 15.81\% for the referent and 20.34\% for the contextual objects on RefCOCO testB). In contrast, Ref-NMS can help narrow the gap over all dataset splits. Especially, the improvement is more obvious in the testB set (\textit{e}.\textit{g}., 7.51\% and 4.85\% absolute gains for the recall of referent on RefCOCO and RefCOCO+), where the categories of referents are more diverse and the recalls are relatively lower.

\addtolength{\tabcolsep}{-3pt}
\begin{table}[t]
	\small
	\begin{center}
		\scalebox{0.82}{
			\begin{tabular}{| c| c | c c c | c c c | c c || c c c | c c c | c c |}
				\hline
				 & \multirow{3}{*}{Ref-NMS} & \multicolumn{8}{c||}{Referent} & \multicolumn{8}{c|}{Contextual Objects} \\
				\cline{3-18}
				& & \multicolumn{3}{c|}{RefCOCO} & \multicolumn{3}{c|}{RefCOCO+} & \multicolumn{2}{c||}{RefCOCOg} & \multicolumn{3}{c|}{RefCOCO} & \multicolumn{3}{c|}{RefCOCO+} & \multicolumn{2}{c|}{RefCOCOg} \\
				& & val & testA & testB &  val & testA & testB & val & test & val & testA & testB &  val & testA & testB & val & test \\
				\hline
				\parbox[t]{2mm}{\multirow{3}{*}{\rotatebox[origin=c]{90}{N=100}}} &  & 97.60 & 97.81 & 96.58 & 97.79 & 97.78 & 96.99 & 97.18 & 96.91 & 90.14 & 89.85 & 90.53 & 89.53 & 88.47 & 90.69 & 90.56 & 90.30 \\
				& B & 97.75 & 98.59 & 97.08 & 97.96 & 98.39 & 97.50 & 97.61 & 97.44 & 90.38 & 90.31 & 90.64 & 89.67 & 88.88 & 91.04 & 90.36 & 90.37  \\
				& R & 97.62 & 98.02 & 96.78 & 97.71 & 98.06 & 97.14 & 97.18 & 97.08 & 90.22 & 89.83 & 90.63 & 89.70 & 88.62 & 90.71 & 90.67 & 90.30  \\
				\hline
				\parbox[t]{2mm}{\multirow{3}{*}{\rotatebox[origin=c]{90}{Real}}} &  & 88.84 & 93.99 & 80.77 & 90.71 & 94.34 & 84.11 & 87.83 & 87.88 & 74.97 & 78.60 & 70.19 & 76.34 & 77.45 & 73.52 & 75.69 & 75.87 \\
				& B & \textbf{92.51} & \textbf{95.56} & \textbf{88.28} & \textbf{93.42} & \textbf{95.86} & \textbf{88.95} & \textbf{90.28} & \textbf{90.34} & \textbf{78.75} & \textbf{80.14} & \textbf{76.47} & \textbf{78.44} & \textbf{78.82} & \textbf{77.49} & 76.12 & 76.57  \\
				& R & 90.50 & 94.75 & 83.87 & 91.62 & 95.14 & 86.42 & 89.01 & 88.96 & 76.79 & 79.12 & 72.99 & 77.66 & 78.44 & 75.59 & \textbf{76.68} & \textbf{76.73}  \\
				\hline
			\end{tabular}
		}
	\end{center}
	\caption{Recall (\%) of the referent and contextual objects. The baseline detector is the ResNet-101 based Mask R-CNN with plain GreedyNMS. B denotes the Ref-NMS with binary XE loss, R denotes the Ref-NMS with ranking loss. Real denotes the real case used in the state-of-the-art two-stage methods.}
	\vspace{-1em}
	\label{tab:hit-rate}
\end{table}
\addtolength{\tabcolsep}{3pt}

\addtolength{\tabcolsep}{-3pt}
\begin{table}[t]
	\small
	\begin{center}
		\scalebox{0.81}{
			\begin{tabular}{| l | c c c | c c c | c c || c c c | c c c | c c |}
				\hline
				\multirow{3}{*}{Models} & \multicolumn{8}{c||}{Referring Expression Comprehension} & \multicolumn{8}{c|}{Referring Expression Segmentation} \\
				\cline{2-17}
				& \multicolumn{3}{c|}{RefCOCO} & \multicolumn{3}{c|}{RefCOCO+} & \multicolumn{2}{c||}{RefCOCOg} & \multicolumn{3}{c|}{RefCOCO} & \multicolumn{3}{c|}{RefCOCO+} & \multicolumn{2}{c|}{RefCOCOg} \\
				& val & testA & testB &  val & testA & testB & val & test & val & testA & testB &  val & testA & testB & val & test \\
				\hline
				MAttNet~\cite{yu2018mattnet}  & 76.65 & 81.14 & 69.99 & 65.33 & 71.62 & 56.02 & 66.58 & 67.27 & 56.51 & 62.37 & 51.70 & 46.67 & 52.39 & 40.08 & 47.64 & 48.61 \\
				MAttNet$^\dagger$ & 76.92 & 81.19 & 69.58 & 65.90 & \textcolor{red}{\textbf{71.53}} & 57.23 & 67.52 & 67.55 & 57.14  &  62.34  & 51.48  & 47.30  & \textcolor{red}{\textbf{52.37}} & 41.14 & 48.28  & 49.01 \\
				~~+Ref-NMS B & \textcolor{red}{\textbf{78.82}} & \textcolor{red}{\textbf{82.71}} & \textcolor{red}{\textbf{73.94}} & \textcolor{red}{\textbf{66.95}} & 71.29 & \textcolor{red}{\textbf{58.40}} & \textcolor{blue}{68.89} & \textcolor{red}{\textbf{68.67}} & \textcolor{red}{\textbf{59.75}} & \textcolor{red}{\textbf{63.48}} & \textcolor{red}{\textbf{55.66}} & \textcolor{red}{\textbf{48.39}} & 51.57 & \textcolor{red}{\textbf{42.56}} & \textcolor{blue}{49.54} & \textcolor{red}{\textbf{50.38}} \\
				~~+Ref-NMS R & \textcolor{blue}{77.98} & \textcolor{blue}{82.02} & \textcolor{blue}{71.64} & \textcolor{blue}{66.64} & \textcolor{blue}{71.36} & \textcolor{blue}{58.01} & \textcolor{red}{\textbf{69.16}} & \textcolor{blue}{67.63} & \textcolor{blue}{58.32} & \textcolor{blue}{62.96} & \textcolor{blue}{53.68} & \textcolor{blue}{47.87} & \textcolor{blue}{51.85} & \textcolor{blue}{41.41} & \textcolor{red}{\textbf{50.13}} & \textcolor{blue}{49.07} \\
				\hline
				NMTree~\cite{liu2019learning} & 76.41 & 81.21 & 70.09 & 66.46 & 72.02 & 57.52 & 65.87 & 66.44 & 56.59 & 63.02 & 52.06 & 47.40 & 53.01 & 41.56 & 46.59 & 47.88 \\
				NMTree$^\dagger$ & 76.54 & 81.32 & 69.66 & 66.65 & 71.48 & 57.74 & 65.65 & 65.94 & 56.99 & \textcolor{blue}{62.88} & 51.90 & 47.75 & \textcolor{blue}{52.36} & 41.86 & 46.19 & 47.41 \\
				~~+Ref-NMS B & \textcolor{red}{\textbf{78.67}} & \textcolor{red}{\textbf{82.09}} & \textcolor{red}{\textbf{73.78}} & \textcolor{red}{\textbf{67.15}} & \textcolor{blue}{71.76} & \textcolor{blue}{58.70} & \textcolor{red}{\textbf{67.30}} & \textcolor{red}{\textbf{66.93}} & \textcolor{red}{\textbf{59.95}} & \textcolor{red}{\textbf{63.25}} & \textcolor{red}{\textbf{55.64}} & \textcolor{red}{\textbf{48.68}} & 52.30 & \textcolor{red}{\textbf{42.64}} & \textcolor{red}{\textbf{48.14}} & \textcolor{red}{\textbf{48.59}} \\
				~~+Ref-NMS R &  \textcolor{blue}{77.81} & \textcolor{blue}{81.69} & \textcolor{blue}{71.78} & \textcolor{blue}{67.03} & \textcolor{red}{\textbf{71.78}} & \textcolor{red}{\textbf{58.79}} & \textcolor{blue}{66.81} & \textcolor{blue}{66.31} & \textcolor{blue}{58.42} & 62.69 & \textcolor{blue}{53.60} & \textcolor{blue}{48.27} & \textcolor{red}{\textbf{52.65}} & \textcolor{blue}{42.18} & \textcolor{blue}{47.72} & \textcolor{blue}{48.09} \\
				\hline
				CM-A-E~\cite{liu2019improving}  & 78.35 &	83.14 & 71.32 &	68.09 &	73.65 &	58.03 & 67.99 & 68.67  & --  & -- & --  & --  & --  & --  & --  & -- \\
				CM-A-E$^\dagger$ & 78.35 & 83.12 & 71.32 & 68.19 & 73.04 & 58.27 & 69.10 & 69.20 & 58.23  & 64.60 & 53.14  & 49.65  & \textcolor{red}{\textbf{53.90}}  & 41.77  & 49.10  & 50.72 \\
				~~+Ref-NMS B & \textcolor{red}{\textbf{80.70}} & \textcolor{red}{\textbf{84.00}} & \textcolor{red}{\textbf{76.04}} & \textcolor{blue}{68.25} & \textcolor{red}{\textbf{73.68}} & \textcolor{red}{\textbf{59.42}} & \textcolor{red}{\textbf{70.55}} & \textcolor{red}{\textbf{70.62}} & \textcolor{red}{\textbf{61.46}} & \textcolor{red}{\textbf{65.55}} & \textcolor{red}{\textbf{57.41}} & \textcolor{blue}{49.76} & \textcolor{blue}{53.84} & \textcolor{red}{\textbf{42.66}} & \textcolor{red}{\textbf{51.21}} & \textcolor{red}{\textbf{51.90}}  \\
				~~+Ref-NMS R & \textcolor{blue}{79.55} & \textcolor{blue}{83.58} & \textcolor{blue}{73.62} & \textcolor{red}{\textbf{68.51}} & \textcolor{blue}{73.14} & \textcolor{blue}{58.38} & \textcolor{blue}{69.77} & \textcolor{blue}{70.01} & \textcolor{blue}{59.72} & \textcolor{blue}{64.87} & \textcolor{blue}{55.63} & \textcolor{red}{\textbf{49.86}} & 52.62 & \textcolor{blue}{41.87} & \textcolor{blue}{50.13} & \textcolor{blue}{51.44} \\
				\hline
			\end{tabular}
		}
	\end{center}
	\caption{Performances of different architectures on REC and RES. The metrics are top-1 accuracy (\%) for REC and overall IoU (\%) for RES. All baselines use the ResNet-101 based Mask R-CNN as first-stage networks. The \textcolor{red}{\textbf{best}} and \textcolor{blue}{second best} methods under each setting are marked in according formats. $^\dagger$ denotes our implementation.}
	\label{tab:model-agnostic}
\end{table}
\addtolength{\tabcolsep}{3pt}

\subsubsection{Architecture Agnostic}

\noindent\textbf{Settings.} Since the Ref-NMS model is agnostic to the second stage network, it can be easily integrated into any referent grounding architectures. To evaluate the effectiveness and generality of Ref-NMS to boost the grounding performance of different backbones, we incorporated the Ref-NMS into multiple state-of-the-art two-stage methods including: \textbf{MAttNet}~\cite{yu2018mattnet} , \textbf{NMTree}~\cite{liu2019learning}, and \textbf{CM-A-E}~\cite{liu2019improving}. All results are reported in Table~\ref{tab:model-agnostic}.

\noindent\textbf{Results.} From Table~\ref{tab:model-agnostic}, we can observe that both variants of Ref-NMS can consistently improve the grounding performance over all three backbones on both REC and RES. The improvement is more significant on the testB set (\textit{e}.\textit{g}., 4.72\% and 3.23\% absolute performance gains for CM-A-E in REC and RES), which meets our expectation, \textit{i}.\textit{e}., the improvements of grounding performance have a strong positive correlation with the improvements of the recall of critical objects. Compared between two variants of Ref-NMS, in most of cases, Ref-NMS B achieves better grounding performance. We argue that the reason may come from the imbalance of positive and negative samples in each level.

\begin{table}[t]
	\small
	\begin{center}
		\scalebox{0.9}{
			\begin{tabular}{|l | l | c | c c c | c c c | c c|}
				\hline
					& \multirow{2}{*}{Models} & \multirow{2}{*}{Backbone} & \multicolumn{3}{c|}{RefCOCO} & \multicolumn{3}{c|}{RefCOCO+} & \multicolumn{2}{c|}{RefCOCOg}  \\
					&  &  & val & testA & testB & val & testA & testB & val & test \\
				\hline
					\parbox[t]{2mm}{\multirow{3}{*}{\rotatebox[origin=c]{90}{one-s.}}} & SSG~\cite{chen2018real}~\tiny{arXiv18} &  darknet53 & -- & 76.51 & 67.50 & -- & 62.14 & 49.27 & 58.80 & -- \\
					& FAOA~\cite{yang2019fast}~\tiny{ICCV19} & darknet53 & 71.15 & 74.88 & 66.32 & 56.86 & 61.89 & 49.46 & 59.44 & 58.90 \\
					& RCCF~\cite{liao2020real}~\tiny{CVPR20} & dla34 & -- & 81.06 & 71.85 & -- & 70.35 & 56.32 & -- & 65.73 \\
				\hline
				\hline
					\parbox[t]{2mm}{\multirow{10}{*}{\rotatebox[origin=c]{90}{two-stage}}} & VC~\cite{zhang2018grounding}~\tiny{CVPR18} & vgg16 & -- & 73.33 & 67.44 & -- & 58.40 & 53.18 & -- & -- \\
					& ParalAttn~\cite{zhuang2018parallel}~\tiny{CVPR18} & vgg16 & -- & 75.31 & 65.52 & -- & 61.34 & 50.86 & -- & -- \\
					& LGRANs~\cite{wang2019neighbourhood}~\tiny{CVPR19} & vgg16 & -- & 76.60 & 66.40 & -- & 64.00 & 53.40 & -- & -- \\
					& DGA~\cite{yang2019dynamic}~\tiny{ICCV19} & vgg16 &	-- & 78.42 & 65.53 & -- & 69.07 & 51.99 & -- & 63.28 \\
					& NMTree~\cite{liu2019learning}~\tiny{ICCV19} & vgg16 &	71.65 &	74.81 &	67.34 &	58.00 &	61.09 & 53.45 & 61.01 & 61.46 \\
					& MAttNet~\cite{yu2018mattnet}~\tiny{CVPR18} &	res101 & 76.65 & 81.14 & 69.99 & 65.33 & 71.62 & 56.02 & 66.58 & 67.27 \\
					& RvG-Tree~\cite{hong2019learning}~\tiny{TPAMI19} & res101 & 75.06 & 78.61 & 69.85 & 63.51 & 67.45 & 56.66 & 66.95 & 66.51 \\
					& NMTree~\cite{liu2019learning}~\tiny{ICCV19} & res101 & 76.41 & 81.21 & 70.09 & 66.46 & 72.02 & 57.52 & 65.87 & 66.44 \\
					& CM-A-E~\cite{liu2019improving}~\tiny{CVPR19}	& res101 &	78.35 &	83.14 & 71.32 &	68.09 &	73.65 &	58.03 & 67.99 & 68.67 \\
					& \cellcolor{mygray-bg}{\textbf{CM-A-E+Ref-NMS}} & \cellcolor{mygray-bg}{res101} &
					\cellcolor{mygray-bg}{\textbf{80.70}} & \cellcolor{mygray-bg}{\textbf{84.00}} & \cellcolor{mygray-bg}{\textbf{76.04}} & \cellcolor{mygray-bg}{\textbf{68.25}} & \cellcolor{mygray-bg}{\textbf{73.68}} & \cellcolor{mygray-bg}{\textbf{59.42}} & \cellcolor{mygray-bg}{\textbf{70.55}} & \cellcolor{mygray-bg}{\textbf{70.62}} \\
				\hline
			\end{tabular}
		}
	\end{center}
	\caption{Top-1 accuracies (\%) of state-of-the-art models on referring expression comprehension.}
	\vspace{-1.5em}
	\label{tab:sota_rec}
\end{table}

\begin{table}[t]
	\small
	\begin{center}
		\scalebox{0.9}{
			\begin{tabular}{| l | l | c c c | c c c | c c |}
				\hline
				& \multirow{2}{*}{Models} & \multicolumn{3}{c|}{RefCOCO} & \multicolumn{3}{c|}{RefCOCO+} & \multicolumn{2}{c|}{RefCOCOg}  \\
				& & val & testA & testB & val & testA & testB &  val & test \\
				\hline
					\parbox[t]{2mm}{\multirow{6}{*}{\rotatebox[origin=c]{90}{one-stage}}} & RMI~\cite{liu2017recurrent}~\tiny{ICCV17} & 41.17 & 41.35 & 41.87 & 28.26 & 29.16 & 26.86 & -- & -- \\
					& DMN~\cite{margffoy2018dynamic}~\tiny{ECCV18} & 49.78 & 54.83 & 45.13 & 38.88 & 44.22 & 32.29 & -- & -- \\
					& RRN~\cite{li2018referring}~\tiny{CVPR18} & 55.33 & 57.26 & 53.95 & 39.75 & 42.15 & 36.11 & -- & -- \\
					& CMSA~\cite{ye2019cross}~\tiny{CVPR19} & 58.32 & 60.61 & 55.09 & 43.76 & 47.60 & 37.89 & -- & -- \\
					& STEP~\cite{chen2019see}~\tiny{ICCV19} & 60.04 & 63.46 & 57.97 & 48.19 & 52.33 & 40.41 & -- & -- \\
					& BRINet~\cite{hu2020bi}~\tiny{CVPR20} & 60.98 & 62.99 & 59.21 & 48.17 & 52.32 & 42.41 & -- & -- \\
				\hline
				\hline
					\parbox[t]{2mm}{\multirow{4}{*}{\rotatebox[origin=c]{90}{two-stage}}}  & MAttNet~\cite{yu2018mattnet}~\tiny{CVPR18} & 56.51 & 62.37 & 51.70 & 46.67 & 52.39 & 40.08 & 47.64 & 48.61 \\
					& NMTree~\cite{liu2019learning}~\tiny{ICCV19} & 56.59 & 63.02 & 52.06 & 47.40 & 53.01 & 41.56 & 46.59 & 47.88 \\
					& CM-A-E$^\dagger$~\cite{liu2019improving}~\tiny{CVPR19} & 58.23  & 64.60 & 53.14  & 49.65  & \textbf{53.90}  & 41.77  & 49.10  & 50.72 \\
					& \cellcolor{mygray-bg}{\textbf{CM-A-E+Ref-NMS}} &  \cellcolor{mygray-bg}{\textbf{61.46}} & \cellcolor{mygray-bg}{\textbf{65.55}} & \cellcolor{mygray-bg}{\textbf{57.41}} & \cellcolor{mygray-bg}{\textbf{49.76}} & \cellcolor{mygray-bg}{53.84} & \cellcolor{mygray-bg}{\textbf{42.66}} & \cellcolor{mygray-bg}{\textbf{51.21}} & \cellcolor{mygray-bg}{\textbf{51.90}} \\
					\hline
			\end{tabular}
		}
	\end{center}
	\caption{Overall IoU (\%) of state-of-the-art models on referring expression segmentation. All methods utilize ResNet-101 as backbone. $^\dagger$ denotes that the results are from our reimplementation using official released codes.}
	\vspace{-1.5em}
	\label{tab:sota_res}
\end{table}

\subsection{Comparisons with State-of-the-Arts}

We incorporate Ref-NMS (with the binary XE loss) into the model CM-A-E~\cite{liu2019improving}, which is dubbed \textbf{CM-A-E+Ref-NMS}, and compare it against the state-of-the-art methods on both REC and RES.

\textbf{Settings.} For the state-of-the-art REC methods, from the viewpoint of one-stage and two-stage, we can group them into: 1) Two-stage methods: \textbf{VC}~\cite{zhang2018grounding}, \textbf{ParalAttn}~\cite{zhuang2018parallel}, \textbf{LGRANs}~\cite{wang2019neighbourhood}, \textbf{DGA}~\cite{yang2019dynamic}, \textbf{NMTree}~\cite{liu2019learning}, \textbf{MAttNet}~\cite{yu2018mattnet}, \textbf{RvG-Tree}~\cite{hong2019learning}, and \textbf{CM-A-E}~\cite{liu2019improving}; 2) one-stage methods: \textbf{SSG}~\cite{chen2018real}, \textbf{FAOA}~\cite{yang2019fast}, and \textbf{RCCF}~\cite{liao2020real}. Analogously, for the state-of-the-art RES methods, we group them into: 1) Two-stage methods: \textbf{MAttNet}~\cite{yu2018mattnet}, \textbf{NMTree}~\cite{liu2019learning}, and \textbf{CM-A-E}~\cite{liu2019improving}; 2) one-stage methods: \textbf{RMI}~\cite{liu2017recurrent}, \textbf{DMN}~\cite{margffoy2018dynamic}, \textbf{RRN}~\cite{li2018referring}, \textbf{CMSA}~\cite{ye2019cross}, \textbf{STEP}~\cite{chen2019see}, and \textbf{BRINet}~\cite{hu2020bi}.

\textbf{Results.} The REC and RES results are reported in Table~\ref{tab:sota_rec} and Table~\ref{tab:sota_res}. For the REC, CM-A-E+Ref-NMS achieves a new record-breaking performance that is superior to all existing REC methods on three benchmarks. Ref-NMS improves the strong baseline CM-A-E with an average of 2.64\%, 0.53\%, and 2.26\% absolute performance gains over RefCOCO, RefCOCO+, and RefCOCOg, respectively. For the RES, CM-A-E+Ref-NMS achieves a new state-of-the-art performance of two-stage methods over most of the dataset splits. Similarly, Ref-NMS improves CM-A-E with an average of 2.82\%, 0.31\%, and 1.65\% absolute performance gains over the three datasets.

\subsection{Qualitative Results}

We illustrate the qualitative results between CM-A-E+Ref-NMS  and baseline CM-A-E on REC in Figure~\ref{fig:visualization}. From the results in line (b), we can observe that Ref-NMS can assign high attention weights on more relevant words to individual referents (\textit{e}.\textit{g}., umbrella, man, and zebra). The results in line (c) show that the generated pseudo ground-truth bboxes can almost contain all contextual objects in the expression, except a few objects whose categories are far different from the categories of COCO (\textit{e}.\textit{g}., sweater, armrest, and grass). By comparing the results between line (d) and line (e), we have the following observations: 1) The baseline method always detects more false-positive proposals (\textit{i}.\textit{e}., the blue bboxes), and misses some critical objects (\textit{i}.\textit{e}., the red and green bboxes). Instead, Ref-NMS helps the model generate more expression-aware proposals. 2) Even for the failed cases in CM-A-E+Ref-NMS (\textit{i}.\textit{e}., the last two columns), Ref-NMS still generates more reasonable proposals (\textit{e}.\textit{g}., with less false positive proposals), and the grounding errors mainly come from the second stage.

\begin{figure}[t]
	\centering
	\includegraphics[width=1.0\linewidth]{images/visualization.pdf}
	\caption{Qualitative REC results on RefCOCOg showing comparisons between correct (green tick) and wrong referent grounds (red cross) by CM-A-E and CM-A-E+Ref-NMS. \textbf{(a):} The input image and referring expressions. \textbf{(b)}: The visualiation of word attention weights $\alpha$ (cf. Eq.~\eqref{eq:1}) for each referent object. \textbf{(c):} The annotated referent ground-truth bbox (red) and generated pseudo ground-truth bboxes for contextual objects (green). \textbf{(d)} and \textbf{(e)} denote the proposals and final grounding results from two methods. We only show the proposals and the final predicted referent bbox is illustrated in dash line. The denotations of bbox colors are as follows. \textbf{Red}: The bbox hits (IoU>0.5) the referent ground-truth bbox; \textbf{Green}: The bboxes hit the pseudo ground-truth bboxes; \textbf{Blue}: The false positive proposal predictions.}
	\label{fig:visualization}
\end{figure}

\section{Conclusions and Future Works}

In this paper, we focused on the two-stage referring expression grounding, and discussed the overlooked mismatch problem between the roles of proposals in different stages. Particularly, we proposed a novel approach dubbed Ref-NMS to calibrate this mismatch. Ref-NMS tackles the problem by considering the expression at the first stage, and learns a relatedness score between each detected proposal and the expression. The multiplication of the relatedness scores and classification scores serves as the suppression criterion for the NMS operation. Meanwhile, Ref-NMS is agnostic to the referent grounding step, and can be integrated into any state-of-the-art two-stage method. We validated the effectiveness through extensive comparative and ablative experiments. Moving forward, we plan to 1) extend Ref-NMS into bounding boxes from Selective Search or EdgeBox, instead of pre-trained detectors; and 2) apply Ref-NMS into other proposal-drive tasks which suffer from the same mismatch issue, \textit{e}.\textit{g}., phrase grounding, visual relationship detection, and VQA.

{\small
\bibliographystyle{plain}