\section{Introduction}
In June 2015, the operators of the online discussion site Reddit banned several communities under new anti-harassment rules. \cite{chandrasekharan2017you} used this opportunity to combine rich online data with computational methods to study a current question: Does eliminating these ``echo chambers'' diminish the amount of hate speech overall? Exciting opportunities like these, at the intersection of ``thick'' cultural and societal questions on the one hand, and the computational analysis of rich textual data on larger-than-human scales on the other, are becoming increasingly common.

Indeed, computational analysis is opening new possibilities for exploring challenging questions at the heart of some of the most pressing contemporary cultural and social issues. While a human reader is better equipped to make logical inferences, resolve ambiguities, and apply cultural knowledge than a computer, human time and attention are limited. Moreover, many patterns are not obvious in any specific context, but only stand out in the aggregate. For example, in a landmark study, \cite{doi:10.1080/01621459.1963.10500849} analyzed the authorship of \textit{The Federalist Papers}  using a statistical text analysis by focusing on style, based on the distribution of function words, rather than content. As another example, \cite{long2016literary} studied what defines English haiku and showed how computational analysis and close reading can complement each other. Computational approaches are valuable precisely because they help us identify patterns that would not otherwise be discernible.

Yet these approaches are not a panacea. Examining thick social and cultural questions using computational text analysis carries significant challenges. For one, texts are culturally and socially situated. They reflect the ideas, values and beliefs of both their authors and their target audiences, and such subtleties of meaning and interpretation are difficult to incorporate in computational approaches. For another, many of the social and cultural concepts we seek to examine are highly contested --- hate speech is just one such example. Choices regarding how to operationalize and analyze these concepts can raise serious concerns about conceptual validity and may lead to shallow or obvious conclusions, rather than findings that reflect the depth of the questions we seek to address.

These are just a small sample of the many opportunities and challenges faced in computational analyses of textual data. New possibilities and frustrating obstacles emerge at every stage of research, from identification of the research question to interpretation of the results.
In this article, we take the reader through a typical research process that involves measuring social or cultural concepts using computational methods, discussing both the opportunities and complications that often arise. In the Reddit case, for example, hate speech is measured, however imperfectly, by the presence of particular words semi-automatically extracted from a machine learning algorithm. Operationalizations are never perfect translations, and are often refined over the course of an investigation, but they are crucial.

We begin our exploration with the identification of research questions, proceed through data selection, conceptualization, and operationalization, and end with analysis and the interpretation of results.
The research process sounds more or less linear this way, but each of these phases overlaps, and in some instances turns back upon itself.
The analysis phase, for example, often feeds back into the original research questions,  which may continue to evolve for much of the project. At each stage, our discussion is critically informed by insights from the humanities and social sciences, fields that have focused on, and worked to tackle, the challenges of textual analysis---albeit at smaller scales---since their inception.

In describing our experiences with computational text analysis, we hope to achieve three primary goals. First, we aim to shed light on thorny issues not always at the forefront of discussions about computational text analysis methods. Second, we hope to provide a set of best practices for working with thick social and cultural concepts. Our guidance is based on our own experiences and is therefore inherently imperfect. Still, given our diversity of disciplinary backgrounds and research practices, we hope to capture a range of ideas and identify commonalities that will resonate for many. And this leads to our final goal: to help promote  interdisciplinary collaborations. Interdisciplinary insights and partnerships are essential for realizing the full potential of any computational text analysis that involves social and cultural concepts, and the more we are able to bridge these divides, the more fruitful we believe our work will be.

 \paragraph*{Context and intended audience}
 This article is a result of a workshop organized in 2017 by Maria Liakata and Dong Nguyen at the Alan Turing Institute on ``Bridging disciplines in analysing text as social and cultural data''. The primary audience of this article are most likely readers who are interested in doing interdisciplinary text analysis, with a computer science, humanities, or social sciences background. We expect that this text may be especially useful for courses on text as data.

\section{Research questions}
\label{sec:develop_research_questions}
We typically start by identifying the questions we wish to explore.
Can text analysis provide a new perspective on a ``big question'' that has been attracting interest for years?
Or can we raise new questions that have only recently emerged, for example about social media?

For social scientists working in computational analysis, the questions are often grounded in theory, asking: How can we explain what we observe?
These questions are also influenced by the availability and accessibility of  data sources. For example, the choice to work with data from a particular social media platform may be partly determined by the fact that it is freely available, and this will in turn shape the kinds of questions that can be asked.   A key output of this phase are the concepts to measure, for example: influence; copying and reproduction; the creation of patterns of language use; hate speech.

Computational analysis of text motivated by these questions is  \textbf{insight driven}: we aim to describe a phenomenon or explain how it came about. For example, what can we learn about how and why hate speech is used or how this changes over time? Is hate speech one thing, or does it comprise multiple forms of expression? Is there a clear boundary between hate speech and other types of speech, and what features make it more or less ambiguous?
In these cases, it is critical to communicate  high-level patterns
in terms that are recognizable.

This contrasts with much of the work in computational text analysis, which tends to focus on  automating tasks that humans perform inefficiently. These tasks range from core linguistically motivated tasks that constitute the backbone of natural language processing, such as part-of-speech tagging and parsing, to filtering spam and detecting sentiment.
Many tasks are motivated by applications, for example to  automatically block online trolls.  Success, then, is often measured by performance, and communicating why a certain prediction was made---for example, why a document was labeled as positive sentiment, or why a word was classified as a noun---is less important than the accuracy of the prediction itself.
The approaches we use and what we mean by `success' are thus guided by our research questions.

Domain experts and fellow researchers can provide feedback on questions and help with dynamically revising them. For example, they may say ``\textit{we already think we know that''}, ``\emph{that's too na\"ive}'', \emph{``that doesn't reflect social reality''} (negative); ``\textit{two major camps in the field would give different answers to that question}'' (neutral); ``\textit{we tried to look at that back in the 1960s, but we didn't have the technology}'' (positive); and ``\textit{that sounds like something that people who made that archive would love}'', ``\textit{that's a really fundamental  question}'' (very positive).

Sometimes we also hope to connect to multiple  disciplines. For example, while focusing on
the humanistic concerns of an archive, we could also ask social questions such as ``\textit{is this archive more about collaborative processes, culture-building or norm creation?}'' or ``\textit{how well does this archive reflect the society in which it is embedded?}"
\cite{murdock2017exploration} used quantitative methods to tell a story about Darwin's intellectual development---an essential biographical question for a key figure in the history of science. At the same time, their methods connected Darwin's development to the changing landscape of Victorian scientific culture, allowing them to contrast Darwin's ``foraging'' in the scientific literature of his time to the ways in which that literature was itself produced. Finally, their methods provided a case study, and validation of technical approaches, for cognitive scientists who are interested in how people explore and exploit sources of knowledge.

Questions about potential ``dual use'' may also arise.
Returning to our introductory example,  \cite{chandrasekharan2017you} started with a deceptively simple question: if an internet platform eliminates forums for hate speech, does this impact hate speech in other forums?
The research was motivated by the belief that a rising tide of online hate speech was (and is) making the internet increasingly unfriendly for disempowered groups, including minorities, women, and LBGTQ individuals. Yet the possibility of dual use  troubled the researchers from the onset.
Could the methodology be adopted to target the speech of groups like Black Lives Matter?
Could it be adopted by repressive governments to minimize online dissent? While these concerns remained, they  concluded that hypothetical dual use scenarios did not outweigh the tangible contribution this research could offer towards making the online environment more equal and just.

\section{Data}
\label{sec:data}
The next step involves deciding on the data sources, collecting and compiling the dataset,
and inspecting its metadata.

\subsection{Data acquisition}
Many scholars in the humanities and the social sciences work with sources that are not available in digital form, and indeed may never be digitized. Others work with both analogue and digitized materials, and the  increasing digitization of archives has  opened opportunities to study these archives in new ways.
We can go to the canonical archive or open up something that nobody has studied before. For example, we might focus on major historical moments (French Revolution, post-Milosevic Serbia) or critical epochs (Britain entering the Victorian era, the transition from Latin to proto-Romance). Or, we could look for records of how people conducted science, wrote and consumed literature, and worked out their philosophies.

\subsubsection{Born-digital data}
A growing number of researchers work with born-digital sources or data\footnote{See \cite{salganik2017bit} for an extensive discussion.}.
Born-digital data, e.g., from social media, generally do not involve direct elicitation from participants and therefore enable unobtrusive measurements \citep{jaf2016tim,webb1966unobtrusive}.
In contrast, methods like surveys sometimes elicit altered responses from participants,
who  might adapt their responses to what they think is expected.
Moreover, born-digital data is often massive, enabling large-scale studies of language and behavior in a variety of social contexts.

Still, many scholars in the social sciences and humanities work with multiple data sources. The variety of sources typically used  means that more than one data collection method is often  required.
For example,  a project examining coverage of a UK General Election, could draw data from  traditional media, web archives, Twitter and Facebook, campaign manifestos, etc. and might combine textual analysis of these materials with surveys, laboratory experiments, or field observations offline.
In contrast, many computational studies based on born-digital data have focused on one specific source, such as Twitter.

The use of born-digital data raises  ethical  concerns.
Although early studies often treated privacy as a binary construct, many now acknowledge its complexity \citep{doi:10.1080/1369118X.2012.678878}. Conversations on private matters can be posted online, visible for all, but social norms
regarding what should be considered public information may differ from
the data's explicit visibility settings. Often no informed consent has been obtained, raising concerns and challenges regarding publishing content and potentially harmful secondary uses \citep{doi:10.1177/0038038517708140,salganik2017bit}.

Recently, concerns about potential harms stemming from secondary uses have led a number of digital service providers to restrict access to born-digital data. Facebook and Twitter, for example, have reduced or eliminated public access to their application programming interfaces (APIs) and expressed hesitation about allowing academic researchers to use data from their platforms to examine certain sensitive or controversial topics. Despite the seeming abundance of born-digital data, we therefore cannot take its availability for granted.

\subsubsection{Data quality}
Working with data that someone else has acquired
presents additional problems related to provenance and contextualisation. It may not always be possible to determine the criteria applied during the creation process. For example, why were certain newspapers digitized but not others, and what does this
say about the collection? Similar questions arise with the use of born-digital data. For instance, when using the Internet Archive’s Wayback Machine to gather data from archived web pages, we need to consider what pages were captured, which are likely missing, and why.

We must often repurpose born-digital data (e.g., Twitter was not designed to measure public opinion), but data biases may lead to spurious
results and limit justification for generalization.\footnote{\cite{olteanu2016social} give an overview of biases in social data.}
In particular, data collected via black box APIs designed for commercial, not research, purposes are likely to introduce biases into the inferences we draw, and the closed nature of these APIs means we rarely know what biases
are introduced, let alone how severely they might impact our research \citep{tromble2017we}.
These, however, are not new problems. Historians, for example, have always understood that their sources were produced within particular contexts and for particular purposes, which are not always apparent to us.

Non-representative data can still be useful for making comparisons within a sample.
In the introductory example  on hate speech \citep{chandrasekharan2017you}, the Reddit forums do not present a comprehensive or balanced picture of hate speech: the writing is almost exclusively in English, the targets of hate speech are mainly restricted (e.g., to black people, or women), and the population of writers is shaped by Reddit's demographics, which skew towards young white men. These biases limit the generalizability  of the findings, which cannot be extrapolated to other languages, other types of hate speech, and other demographic groups. However, because the findings are based on measurements on the same sort of hate speech and the same population of writers, as long as the collected data are representative of this specific population,  these biases do not pose an intractable validity problem if claims are properly restricted.

The size of many newly available datasets is one of their most appealing characteristics. Bigger datasets often make statistics more robust.  The size needed for a computational text analysis depends on the research goal: When it involves studying rare events, bigger datasets are needed. However,  larger is not always better. Some very large archives are  ``secretly'' collections of multiple and distinct processes that no in-field scholar would consider related.  For example, Google Books is frequently used to study cultural patterns, but the over-representation of scientific articles in Google books can be problematic \citep{10.1371/journal.pone.0137041}.  Even very large born-digital datasets usually cover limited timespans compared to, e.g., the Gutenberg archive of British novels.

This stage of the research also raises important questions about fairness. Are marginalized groups, for example, represented in the tweets we have collected? If not, what types of biases might result from analyses relying on those tweets?

Local experts and ``informants'' can help navigate the data. They can help understand the role an archive plays in the time and place.  They might tell us: Is this the central archive, or a peripheral one? What makes it unusual?
Or they might tell us how certain underrepresented communities use a social media platform and advise us on strategies for ensuring our data collection includes their perspectives.

However, when it is practically infeasible to navigate the data in this way---for instance, when we cannot determine what is missing from Twitter's Streaming API or what webpages are left out of the Internet Archive---we should be open about the limitations of our analyses, acknowledging the flaws in our data and drawing cautious and reasonable conclusions from them. In all cases, we should report the choices we have made when creating or re-using any dataset.

\subsection{Compiling data}
After identifying the data source(s), the next step is compiling the data.
This step is fundamental: if the sources cannot support a convincing result, no result will be convincing.
In many cases, this involves defining a ``core" set of documents and a ``comparison" set.  We often have a specific set of documents in mind: an author's work, a particular journal, a time period. But if we want to say that this ``core" set has some distinctive property, we need a ``comparison" set. Expanding the collection beyond the documents that we would immediately think of has the beneficial effect of increasing our sample size. Having more sources increases the chance that we will notice something consistent across many individually varying contexts.

Comparing sets of documents can sometimes support  causal inference, presented as a contrast between a treatment group and a control. In \cite{chandrasekharan2017you}, the treatment consisted of the text written in the two forums that were eventually closed by Reddit. However, identifying a control group required a considerable amount of time and effort. Reddit is a diverse platform, with a wide variety of interactional and linguistic styles; it would be pointless to compare hate speech forums against forums dedicated to, say, pictures of wrecked bicycles.\footnote{https://www.reddit.com/r/bustedcarbon/} Chandrasekharan et al. used a matching design, populating the control group with forums that were as similar as possible to the treatment group, but were not banned from Reddit.
The goal is to estimate the counterfactual scenario: in this case, what would have happened had the site not taken action against these specific forums?
An ideal control would make it possible to distinguish the effect of the treatment --- closing the forums --- from other idiosyncratic properties of texts that were treated.

We also look for categories of documents that might not be useful. We might remove documents that are meta-discourse, like introductions and notes, or documents that are in a language that is not the primary language of the collection, or duplicates when we are working with archived web pages.
However, we need to carefully consider the potential consequences of information we remove. Does its removal alter the data, or the interpretation of the data, we are analyzing? Are we losing anything that might be valuable at a later stage?

\subsection{Labels and metadata}
 Sometimes all we have is documents, but often we want to look at documents in the context of some additional information, or metadata. This additional information could tell us about the creation of documents (date, author, forum), or about the reception of documents (flagged as hate speech, helpful review).
  Information about text segments can be extremely valuable, but it is also prone to errors, inconsistencies, bias, and missing information.
  Examining metadata is a good way to check a collection's balance and representativeness. Are sources disproportionately of one form? Is the collection missing a specific time window? This type of curation can be extremely time consuming as it may require expert labeling, but it often leads to the most compelling results.
 Sometimes metadata are also used as target labels to develop machine learning models.
 But using them as a ``ground truth''  requires caution. Labels sometimes mean something different than we expect. For example, a down vote for a social media post could indicate that the content is offensive, or  that the voter simply disagreed with the expressed view.

\section{Conceptualization}

\label{sec:conceptualization}
A core step in many analyses is translating social and cultural concepts (such as hate speech, rumor, or conversion) into measurable quantities. Before we can develop measurements for these concepts (the operationalization step, or the ``implementation'' step as denoted by \cite{piper2017think}), we need to define them. In the conceptualization phase we often start with questions such as: who are the domain experts, and how have they approached the topic? We are looking for a definition of the concept that is flexible enough to apply on our  dataset, yet formal enough for computational research. For example, our introductory study on hate speech \citep{chandrasekharan2017you} used  a statement on hate speech produced by  the European Union Court of Human Rights. The goal was not to implement this definition directly in software but to use it as a reference point to anchor  subsequent analyses.

If we want to move beyond the use of ad hoc definitions,
it can be useful to distinguish between what political scientists  Adcock and Collier call the ``background concept'' and the ``systematized concept'' \citep{adcock2001measurement}.
The background concept comprises the full and diverse set of meanings that might be associated with a particular term. This involves  delving into theoretical, conceptual, and empirical studies to assess how a concept has been defined by  other scholars and, most importantly, to determine which definition is most appropriate for the particular research question and the theoretical framework in which it is situated. That definition, in turn, represents the systematized concept: the formulation that is adopted for the study.

It is important to consider that for social and cultural concepts there is no absolute ground truth. There are often multiple valid definitions for a concept (the ``background'' concept in the terms of Adcock and Collier), and definitions might be contested over time. This may be uncomfortable for computer scientists, whose primary measure of success is often based on comparing a model's output  against ``ground truth'' or a ``gold standard'', e.g.,  by comparing a sentiment classifier's output against manual annotations.
However, the notion of ground truth is uncommon  in the humanities and the social sciences and it is often taken too far in machine learning.
\citet[p. 1]{kirschenbaum2007remaking} notes that in literary criticism and the digital humanities more broadly \emph{``interpretation, ambiguity, and argumentation are prized far
above ground truth and definitive conclusions"}. \citet[p. 2]{W13-1401} draw attention to the different attitudes of literary scholars and computational linguists towards ambiguity, stating that ``\textit{In Computational Linguistics [..] ambiguity
is almost uniformly treated as a problem to be
solved; the focus is on disambiguation, with the assumption
that one true, correct interpretation exists.}"
The latter is probably true for tasks such as spam filtering, but in the social sciences and the humanities many relevant concepts are fundamentally unobservable, such as latent traits of political actors \citep{lowe2013validating} or cultural fit in organizations \citep{doi:10.1287/mnsc.2016.2671}, leading to validation challenges. Moreover, when the  ground truth comes from people, it may be influenced by ideological priors, priming, simple differences of opinion or perspective, and many other factors \citep{doi:10.1177/2053951715602908}. We return to this issue in our discussions on validation and analysis.

\section{Operationalization}
\label{sec:operationalization}

In this phase we develop measures (or, ``operationalizations'', or ``indicators'') for the concepts of interest, a process called ``operationalization''. Regardless of whether we are working with computers,  the output produced coincides with Adcock and Collier's ``scores''---the concrete translation and output of the systematized concept into numbers or labels \citep{adcock2001measurement}.
Choices  made during this phase are  always tied to the question ``Are we measuring what we intend to measure?'' Does our operationalization match our conceptual definition? To ensure validity we must recognize gaps between what is important and what is easy to measure.
We first discuss  modeling considerations. Next, we describe several frequently used computational approaches and  their limitations and strengths.

\subsection{Modeling considerations}

\paragraph*{Variable types}

The variables (both predictors and outcomes)  are rarely simply  binary or categorical. For example, a study on language use and age could focus on chronological age (instead of, e.g., social age \citep{Eckert1997}). However, even then, age can be modeled in different ways.
Discretization\footnote{Reducing a continuous variable to a discrete variable.} can make the modeling easier and various NLP studies  have modeled age as a categorical variable \citep{survey2015}.
But any discretization raises questions: How many categories?  Where to place the boundaries?
 Fine distinctions might not always be meaningful for the analysis we are interested in, but categories that are too broad can threaten validity.
 Other interesting variables include time, space, and even the social network position of the author.
 It is often preferable to keep the variable in its most precise form.
 For example, \cite{nguyen2017kernel} perform exploration in the context of hypothesis testing by using latitude and longitude coordinates --- the original metadata attached to geotagged social media such as tweets --- rather than aggregating into administrative units such as counties or cities.
This is necessary when such administrative units are unlikely to be related to the target concept, as is the case in their analysis of dialect differences.
Focusing on precise geographical coordinates also makes it possible to recognize fine-grained effects, such as language variation across the geography of a city.

 \paragraph*{Categorization scheme}
 Using a particular classification scheme means deciding which variations are visible, and which ones are hidden \citep{bowker1999sorting}. We are looking for a categorization scheme for which it is feasible to collect a large enough labeled document collection (e.g., to train supervised models), but which is also fine-grained enough for our purposes. Classification schemes rarely exhibit the ideal properties, i.e., that they are consistent, their categories are mutually exclusive, and that the system is complete  \citep{bowker1999sorting}.
Borderline cases are  challenging, especially with social and cultural concepts, where the boundaries are often not clear-cut.  The choice of scheme can also have ethical implications \citep{bowker1999sorting}. For example, gender is usually represented as a binary variable  in NLP  and computational models tend to learn gender-stereotypical patterns. The operationalization of gender in NLP has been challenged only recently \citep{bamman2014gender,koolen2017these,nguyen142014gender}.

\paragraph*{Supervised vs. unsupervised}
Supervised and unsupervised learning are the most common approaches to learning from data. With supervised learning, a model learns from \emph{labeled} data (e.g., social media messages labeled by sentiment) to infer (or predict) these labels from unlabeled texts.
 In contrast, unsupervised learning uses \emph{unlabeled} data. Supervised approaches are especially suitable when we have a clear definition of the concept of interest and when labels are available (either annotated or native to the data).
Unsupervised  approaches, such as topic models, are  especially useful for exploration. In this setting, conceptualization and operationalization may occur simultaneously, with theory emerging from the data \citep{doi:10.1002/asi.23786}.
Unsupervised approaches are  also used when there is a clear way of measuring a concept, often based on strong assumptions. For example, \cite{murdock2017exploration} measure ``surprise'' in an analysis of Darwin's reading decisions based on the divergence between two probability distributions.

\paragraph*{Units of interest}
From an analysis perspective, the unit of text that we are labeling (or annotating, or coding), either automatic or manual, can sometimes be different than one's final unit of analysis.  For example, if in a study on media frames in news stories, the theoretical framework and research question point toward frames at the story level (e.g., what is the overall causal analysis of the news article?), the story must be the unit of analysis. Yet it is often difficult to validly and reliably code a single frame at the story level. Multiple perspectives are likely to sit side-by-side in a story. Thus, an article on income inequality might point to multiple causes, such as globalization, education, and tax policies. Coding at the sentence level would detect each of these causal explanations individually, but this information would need to be somehow aggregated to determine the overall story-level frame. Sometimes scholars solve this problem by  only examining headlines and lead paragraphs, arguing that based on journalistic convention, the most important information can be found at the beginning of a story. However, this leads to a return to a shorter, less nuanced analysis.

From a computational perspective, the unit of text can also make  a huge difference, especially when we are using bag-of-words models, where word order within a unit does not matter.
Small segments, like tweets, sometimes do not have enough information to make their semantic context clear. In contrast,  larger segments, like novels, have too much variation, making it difficult to train focused models. Finding a good segmentation sometimes means combining short documents and subdividing long documents. The word ``document" can therefore be misleading. But it is so ingrained in the common NLP lexicon that we use it anyway in this article.

\paragraph*{Interpretability}
For insight-driven text analysis, it is often critical that high-level patterns can be communicated. Furthermore, interpretable models make it easier to find spurious features, to do error analysis, and to support interpretation of results. Some approaches  are  effective  for prediction, but harder to interpret.  The value we place on interpretability can therefore influence the approach we choose. There is an increasing interest in developing interpretable or transparent models in the NLP and machine learning communities.\footnote{e.g. the  Fairness, Accountability, and Transparency (FAT$^*$) conference.}

\subsection{Annotation}
Many studies involve human coders. Sometimes the goal is to fully code the data, but in a computational analysis we often use the labels (or annotations)  to train machine learning models to automatically recognize them, and to identify language patterns that are associated with these labels.
For example, for a project analyzing rumors online \citep{zubiaga2016analysing}, conversation threads were annotated along different dimensions, including rumor versus non-rumor and  stance towards a rumor.

The collection of annotation choices make up an annotation scheme (or ``codebook'').
Existing schemes and annotations can be useful as starting points.
Usually settling on an annotation scheme requires several iterations, in which the guidelines are updated and annotation examples are added.
For example, a political scientist could use a mixed deductive-inductive strategy for developing a codebook. She starts by laying out a set of theory-driven deductive coding rules, which means that the broad principles of the coding rules are laid out without examining examples first. These are then tested (and possibly adjusted) based on a  sample of the data.
 In line with Adcock and Collier's notion of ``content validity'' \citep{adcock2001measurement}, the goal is to assess whether the codebook adequately captures the systematized concept. By looking at the data themselves, she gains  a better sense of whether some things have been left out of the coding rules and whether anything is superfluous, misleading, or confusing. Adjustments are made and the process is  repeated, often with another researcher involved.

The final annotations can be collected using a crowdsourcing platform, a smaller number of highly-trained annotators, or a group of experts. Which type of annotator to use should be informed by the complexity and specificity of the concept. For more complex concepts, highly-trained or expert annotators tend to produce more reliable results. However, complex concepts can sometimes be broken down into micro-tasks that can be performed independently in parallel by crowdsourced annotators. Concepts from highly specialized domains may require expert annotators. In all cases, however, some training will be required, and the training phase should involve continual checks of inter-annotator agreement (i.e. intercoder reliability) or checks against a gold standard (e.g. quizzes in crowdsourcing platforms).

We also need to decide how inter-annotator agreement will be measured and what an acceptable level of agreement would be.  Krippendorff's alpha is frequently used in the social sciences, but the right measure depends on the type of data and task.
For manual coding, we can continually check  inter-annotator agreement and begin introducing checks of  \textit{intra}-annotator agreement, too.
For most communication scholars using only manual content analysis, an acceptable rate of agreement is achieved when Krippendorf's alpha reaches 0.80 or above.
When human-coded data are used to  validate machine learning algorithms, the reliability of the human-coded data is even more important.
Disagreement between annotators can  signal   weaknesses of the annotation scheme, or highlight the inherent ambiguity in what we are trying to measure. Disagreement itself can be meaningful and can be integrated in subsequent analyses   \citep{aroyo2013crowd,Demeester2016}.

\subsection{Data pre-processing}
Preparing the data can be a complex and time-consuming process, often involving working with partially or wholly unstructured data.
The pre-processing steps have a big impact on the operationalizations, subsequent analyses and reproducibility efforts \citep{fokkens-EtAl:2013:ACL2013}, and they are usually tightly linked to what we intend to measure. Unfortunately, these steps tend to be underreported, but documenting the pre-processing choices made is essential and is analogous to recording the decisions taken during the production of a scholarly edition or protocols in biomedical research.
Data may also vary enormously in quality, depending on how it has been generated. Many historians, for example, work with text produced from an analogue original using Optical Character Recognition (OCR). Often, there will be limited information available regarding the accuracy of the OCR, and the degree of accuracy may even vary within a single corpus (e.g. where digitized text has been produced over a period of years, and the software has gradually improved). The first step, then, is to try to correct for common OCR errors. These will vary depending on the type of text, the date at which the `original' was produced, and the nature of the font and typesetting.

One  step that almost everyone takes  is to tokenize the original character sequence into  the words and word-like units. Tokenization is a more subtle and more powerful process than people expect.  It is often done using regular expressions or scripts that have been circulating within the NLP community. Tokenization heuristics, however, can be  badly confused by emoticons, creative orthography (e.g., U\$A, sh!t), and missing whitespace.
Multi-word terms are also challenging. Treating them as a single unit can dramatically alter the patterns in text. Many words that are individually ambiguous have clear, unmistakable meanings as terms, like ``black hole" or ``European Union". However, deciding what constitutes a multi-word term is a difficult problem.
In writing systems like Chinese, tokenization is a research problem in its own right.

Beyond tokenization, common  steps include lowercasing,  removing punctuation, stemming (removing suffixes), lemmatization (converting inflections to a base lemma), and normalization, which has never been clearly defined\footnote{\citep{sproat2001} make a good first step, but this work precedes the wave of research on social media, and does not include many things that are considered normalization today.}, but often includes grouping abbreviations like ``U.S.A." and ``USA", ordinals like ``1st" and ``first", and variant spellings like ``noooooo". The main goal of these  steps is to improve the ratio of tokens (individual occurrences) to types (the distinct things in a corpus).
Each step requires making additional assumptions about which distinctions are relevant: is ``apple'' different from ``Apple''? Is ``burnt'' different from ``burned''? Is ``cool" different from ``coooool"?
Sometimes these steps can actively hide useful patterns, like social meaning \citep{eisenstein:2013:NAACL-HLT}. Some of us  therefore try do as little modification as possible.

From a multilingual perspective, English and Chinese have an unusually simple inflectional system, and so it is statistically reasonable to treat each inflection as a unique word type. Romance languages have considerably more inflections than English; many indigenous North American languages have still more.
For these languages, unseen data is far more likely to include previously-unseen inflections, and therefore, dealing with inflections is more important. On the other hand, the resources for handling inflections vary greatly by language, with European languages dominating the attention of the computational linguistics community thus far.

We sometimes also remove words that are not relevant to our goals, for example by calculating vocabulary frequencies. We construct a ``stoplist'' of words that we are not interested in. If we are looking for semantic themes we might remove function words like determiners and prepositions. If we are looking for author-specific styles, we might remove all words except function words. Some words are generally meaningful but too frequent to be useful within a specific collection.
We sometimes also remove very infrequent words. Their occurrences are too low for robust patterns and removing them  helps reducing the vocabulary size.

The choice of processing steps can be guided by theory or knowledge about the domain as well as experimental investigation. When we have labels, predictive accuracy of a model is a way to assess the effect of the processing steps.
 In unsupervised settings, it is more challenging to understand the effects of different steps. Inferences drawn from unsupervised settings can be sensitive to  pre-processing choices  \citep{denny-spirling-2018}.
 Stemming has been found to provide little measurable benefits for topic modeling and can sometimes even be harmful \citep{TACL868}.
 All in all, this again highlights the need to document these steps.

Finally, we can also mark up the data, e.g.,  by identifying entities  (people, places, organizations, etc.) or parts of speech.
Although many NLP tools are available for such tasks, they are often challenged by linguistic variation, such as orthographic variation in historical texts  \citep{doi:10.2200/S00436ED1V01Y201207HLT017} and social media \citep{eisenstein:2013:NAACL-HLT}. Moreover, the performance of NLP tools often drops when applying them outside the training domain, such as applying tools developed on newswire texts to texts written by younger authors \citep{hovyage2015}.
Problems (e.g., disambiguation in named entity recognition) are sometimes resolved using considerable manual intervention. This combination of the automated and the manual, however, becomes more difficult as the scale of the data increases, and the `certainty' brought by the latter may have to be abandoned.

\subsection{Dictionary-based approaches}
Dictionaries are frequently used to code texts in  content analyses \citep{neuendorf2016content}.
Dictionaries consist of one or more categories (i.e. word lists). Sometimes the output is simply the number of category occurrences (e.g., positive sentiment), thus weighting words within a category equally. In some other cases, words are assigned continuous scores.
The  high transparency of dictionaries makes them sometimes more suitable than  supervised machine learning models.  However, dictionaries should only be used if the scores assigned to words
match how the words are used in the data  (see \cite{grimmer-stewart-2013} for a detailed discussion on limitations).
There are many off-the-shelf dictionaries available (e.g., LIWC \citep{liwc2010}).
 These are often well-validated, but applying them on a new domain may not be appropriate without additional validation. Corpus- or domain-specific dictionaries can overcome limitations of general-purpose dictionaries.

The dictionaries are often manually compiled, but increasingly they are constructed semi-automatically (e.g., \cite{fast2016empath}).
When we semi-automatically create a word list, we use automation to identify an initial word list, and human insight to filter it. By automatically generating the initial words lists, words can be identified that human annotators might have difficulty intuiting. By manually filtering the lists, we use our theoretical understanding of the target concept to remove spurious features.

In the introduction study,
SAGE \citep{eisenstein2011sparse} was used to obtain a list of words that distinguished the text in the treatment group (subreddits that were closed by Reddit) from text in the control group (similar subreddits that were not closed).
The researchers then returned to the hate speech definition provided by the European Court of Human Rights, and manually filtered the top SAGE words based on this definition. Not all identified words fitted the definition. The others included: the names of the subreddits themselves, names of related subreddits, community-specific jargon that was not directly related to hate speech, and terms such as \textit{IQ} and \textit{welfare}, which were frequently used in discourses of hate speech, but had significant other uses. The word lists provided the measurement instrument for their main result, which is that the use of hate speech throughout Reddit declined after the two treatment subreddits were closed.

\subsection{Supervised models}
Supervised learning is frequently used to scale up analyses. For example,  \cite{nguyenemnlp2015}  wanted to analyze the motivations of  Movember campaign participants.
 By developing a classifier based on a small set of annotations, they were able to expand the analysis to over 90k participants.

The choice of supervised learning model  is often guided by the task definition and the label types.
 For example, to identify stance towards rumors  based on sequential annotations, an algorithm for learning from sequential \citep{zubiaga-EtAl:2016:COLING} or time series data \citep{lukasik-EtAl:2016:P16-2} could be used.
The features (sometimes called variables or predictors) are used by the model to make the predictions.
They may vary from content-based features such as single words,  sequences of words, or information about their syntactic structure,  to meta-information such as user or network information. Deciding on the  features  requires experimentation and expert insight and is often called feature engineering.
For insight-driven analysis, we are often  interested in \emph{why} a prediction has been made and features that can be interpreted by humans may be preferred. Recent neural network approaches often use simple features as input (such as word embeddings or character sequences), which requires  less feature engineering but make  interpretation more difficult.

Supervised models are powerful, but they can latch on to spurious features of the dataset. This is particularly true for datasets that are not well-balanced, and for annotations that are noisy. In our introductory example on hate speech in Reddit \citep{chandrasekharan2017you}, the annotations are automatically derived from the forum in which each post appears, and indeed, many of the posts in the forums (subreddits) that were banned by Reddit would
be perceived by many as hate speech. But even in banned subreddits, not all of the content is hate speech (e.g., some of the top features were self-referential  like the name of the subreddit) but a classifier would learn a high weight for these features.

Even when expert annotations are available on the level of individual posts, spurious features may remain. \cite{waseem-hovy:2016:N16-2} produced expert annotations of hate speech on Twitter. They found that one of the strongest features for sexism is the name of an Australian TV show, because people like to post sexist comments about the contestants. If we are trying to make claims about what inhibits or encourages hate speech, we would not want those claims to be tied to the TV show's popularity.
Such problems are inevitable when datasets are not well-balanced over time, across genres, topics, etc. Especially with social media data, we lack a clear and objective definition of `balance' at this time.

The risk of supervised models latching on to spurious features reinforces the need for interpretability. Although the development of supervised models is usually performance driven,  placing more emphasis on interpretability could  increase the adoption of these models in insight-driven analyses.
One way would be to only use  models that are already somewhat   interpretable, for example models that use a small number of  human-interpretable features. Rather than imposing such restrictions,
there is also work on generating post-hoc  explanations for individual predictions  (e.g., \cite{Ribeiro:2016:WIT:2939672.2939778}), even when the underlying model itself is very complex.

\subsection{Topic modeling}
Topic models (e.g., LDA \citep{blei2003latent}) are  usually unsupervised and therefore less biased towards human-defined categories. They are  especially suited for insight-driven analysis,  because they are constrained in ways that make their output interpretable. Although there is no guarantee that a  ``topic'' will correspond to a recognizable theme or event or discourse, they often do so in ways that other methods do not. Their easy applicability without supervision and ready interpretability make topic models good for exploration.
Topic models are less successful for many performance-driven applications. Raw word features are almost always better than topics for search and document classification. LSTMs and other neural network models are better as language models. Continuous word embeddings have more expressive power to represent fine-grained semantic similarities between words.

A topic model provides a different perspective on a collection. It creates a set of probability distributions over the vocabulary of the collection, which, when combined together in different proportions, best match the content of the collection. We can sort the words in each of these distributions in descending order by probability, take some arbitrary number of most-probable words, and get a sense of what (if anything) the topic is ``about''. Each of the text segments also has its own distribution over the topics, and we can sort these segments by their probability within a given topic to get a sense of how that topic is used.

One of the most common questions about topic models is how many topics to use, usually with the implicit assumption that there is a ``right'' number that is inherent in the collection. We prefer to think of this parameter as more like the scale of a map or the magnification of a microscope. The ``right'' number is determined by the needs of the user, not by the collection. If the analyst is looking for a broad overview, a relatively small number of topics may be best. If the analyst is looking for fine-grained phenomena, a larger number is better.

After fitting the model, it may be necessary to circle back to an earlier phase. Topic models find consistent patterns. When authors repeatedly use a particular theme or discourse, that repetition creates a consistent pattern. But other factors can also create similar patterns, which look as good to the algorithm. We might notice a topic that has highest probability on French stopwords, indicating that we need to do a better job of filtering by language. We might notice a topic of word fragments, such as ``\textit{ing}'', ``\textit{tion}'', ``\textit{inter}'', indicating that we are not handling end-of-line hyphenation correctly. We may need to add to our stoplist or change how we curate multi-word terms.

\subsection{Validation}
The output of our measurement procedures  (in the social sciences often called the ``scores'') must now be assessed in terms of their reliability and validity with regard to the (systemized) concept. Reliability aims to capture repeatability, i.e. the extent to which a given tool provides consistent results.

Validity assesses the extent to which a given measurement tool measures what it is supposed to measure.
In NLP and machine learning, most models are primarily evaluated  by  comparing the  machine-generated labels  against an annotated sample. This approach presumes that the human output is the ``gold standard" against which performance should be tested. In contrast,
when the reliability is measured based on the output of different annotators, no coder is taken as the standard and  the likelihood of coders reaching agreement by chance (rather than because they are ``correct") is factored into the resulting statistic.  Comparing against a ``gold standard''  suggests that the threshold for human inter- and intra-coder reliability should be particularly high.

Accuracy, as well as other measures such as precision, recall and F-score, are sometimes presented as a measure of validity, but if we do not have a genuinely objective determination of what something is supposed measure---as is often the case in text analysis---then accuracy is perhaps a better indication of reliability than of validity. In that case, validity needs to be assessed based on other  techniques like those we discuss later in this section.  It is also worth asking  what level of accuracy is sufficient for our analysis and to what extent there may be an upper bound, especially when the labels are native to the data or when the notion of a ``gold standard'' is not appropriate.

For some in the humanities, validation takes the form of close reading, not designed to confirm whether the model output is correct, but to present what  \citet[pp. 67-68]{piper2015novel} refers to as a form of ``\textit{further discovery in two directions}''. Model outputs tell us something about the texts, while a close reading of the texts alongside those outputs tells us something about the models that can be used for more effective model building. Applying this circular, iterative process to 450 18th-century novels written in three languages, Piper was able to uncover a new form of ``\textit{conversional novel}'' that was not previously captured in ``\textit{literary history's received critical categories}'' \citep[p. 92]{piper2015novel}.

Along similar lines,  we can subject both the machine-generated output and the human annotations  to another round of content validation. That is, take a stratified random sample, selecting observations from the full range of scores, and ask: Do these make sense in light of the systematized concept? If not, what seems to be missing? Or is something extraneous being captured? This is primarily a qualitative process that requires returning to theory and interrogating the systematized concept, indicators, and scores together.
This type of validation is rarely done in NLP, but it is especially important when it is difficult to assess what drives a given machine learning model.
If there is a mismatch between the scores and systematized concept at this stage, the codebook may need to be adjusted, human coders retrained, more training data prepared, algorithms adjusted, or in some instances, even a new analytical method adopted.

Other types of validation are also possible, such as comparing with
other approaches that aim to capture the same concept, or comparing the output with external measures (e.g., public opinion polls, the occurrence of future events).
We can also go beyond only evaluating the labels (or point estimates). \cite{lowe2013validating}
used human judgments to not only assess the positional estimates from a scaling method  of latent political traits but  also to assess uncertainty intervals.
Using different types of validation can increase our
confidence in the approach,
especially when there is no clear notion of ground truth.

Besides focusing on rather abstract evaluation measures, we could also assess  the models in task-based settings  using human experts. Furthermore, for insight-driven analyses, it can be more useful to focus on improving explanatory power  than making small improvements in predictive performance.

\section{Analysis}
\label{sec:analysis}
In this phase, we use our models to explore or answer our research questions.
For example, given a topic model we can look at the connection between
 topics and metadata elements. Tags such as ``hate speech" or metadata information imply a certain way of organizing the collection. Computational models provide another organization, which may differ in ways that provide more insight into how these categories manifest themselves, or fail to do so.

Moreover, when using a supervised approach,  the ``errors'', i.e.  disagreement
between the system output and human-provided labels,  can point towards interesting cases for closer analysis and help us reflect on our conceptualizations. In  the words of \cite{long2016literary}, they can be ``\emph{opportunities for interpretation}''.
Other types of ``failures'' can be insightful as well. Sometimes there is a ``\textit{dog that didn't bark}'' \citep{holmes1892}--i.e., something that everyone thinks we should have found, but we did not. Or, sometimes the failures are  telling us about the existence of something in the data that nobody noticed, or thought important, until then (e.g., the large number of travel journals in Darwin's reading lists).

 Computational text analysis is not a replacement for but rather an addition to the approaches one can take to analyze social and cultural phenomena using textual data. By moving back and forth between large-scale computational analyses and small-scale qualitative analyses, we can combine their strengths so that we can identify large-scale and long-term trends, but also tell individual stories.
For example, the Reddit study on hate speech \citep{chandrasekharan2017you} raised various  follow-up questions: Can we distinguish  hate speech from people talking about hate speech? Did  people  find new ways to express hate speech? If so, did the total amount of online hate speech decrease after all?
As possible next steps, a qualitative discourse analyst might examine a smaller corpus to investigate whether commenters were indeed expressing hate speech in new ways; a specialist in interview methodologies might reach out to commenters to better understand the role of online hate speech in their lives. Computational text analysis represents a step towards better understanding social and cultural phenomena, and it is in many cases better suited towards opening questions rather than closing them.

\section{Conclusion}
\label{sec:conclusion}
Insight-driven computational  analysis of text is becoming increasingly common.
It not only helps us see more broadly, it  helps us see
subtle patterns more clearly and allows us to explore radical new questions about culture and society.
In this article we have consolidated our experiences,
as scholars from very different disciplines, in analyzing text as social and cultural data and described how the research process often unfolds.
Each of the steps in the process is time-consuming and labor-intensive. Each presents challenges. And especially when working across disciplines, the research often involves a fair amount of  discussion---even negotiation---about what means of operationalization and approaches to analysis  are appropriate and feasible.
And yet, with a bit of perseverance and mutual understanding, conceptually sound and meaningful work results so that we
can truly make use of  the exciting opportunities  rich textual data offers.

\section{Acknowledgements}
This work was supported by The Alan Turing
Institute under the EPSRC grant EP/N510129/1.
Dong Nguyen is supported with an Alan Turing Institute Fellowship (TU/A/000006). Maria Liakata is a Turing fellow at 40\%. We would also like to thank the participants of the
``Bridging disciplines in analysing text as social and cultural data'' workshop held at the Turing Institute (2017) for insightful discussions.  The workshop was funded by a Turing Institute seed funding award to Nguyen and Liakata.

\bibliographystyle{plainnat}


\section{Introduction}
The objective of this brief note is to explore connections between the violation of the St.-Venant compatibility conditions in the theory of linear elasticity leading to the elastic theory of defects \cite{kroner1981continuum}, and its counterpart expression of incompatibility in classical fluid mechanics embodied in the Navier-Stokes equations. A modified `defect Navier-Stokes' model is postulated and some preliminary observations on its implications are made. A main purpose is to stimulate  a cooperative  exchange between fluid mechanists who are interested in high Reynolds number flows and solid mechanists who are engaged in defect theory related to dislocation--disclination dynamics.

\section{Kinematics of defects in the velocity field}
Consider the situation when the spatial velocity gradient field in a flowing fluid becomes singular on a surface of discontinuity, when viewed from a macroscopic length scale. Denote the \emph{`singular'} part of the velocity gradient by $L^{(s)}$. Then, one can define the \emph{`regular'} part as
\begin{equation}\label{eqn:Lr}
\supr{L} := \nabla \, v - \sups{L},
\end{equation}
where $v$ is the spatial velocity field of the fluid particles (the symbol $\nabla$ is meant as a distributional gradient). Thus, $L^{(r)}$ is an integrable field, containing, roughly speaking, at most bounded discontinuities. Similarly, now consider the gradient of the regular part of the velocity gradient; this may as well contain a singular part, $K^{(s)}$, and we again define the regular part of $\nabla L^{(r)}$ as
\begin{equation}\label{eqn:Yr}
Y^{(r)} := \nabla L^{(r)} - K^{(s)} = \nabla^2 \, v - \left( \nabla L^{(s)} + K^{(s)} \right).
\end{equation}
Thus, $\nabla L^{(s)} + K^{(s)}$ may be considered as the singular part of the second-gradient of the velocity field.
We note that
\begin{equation}\label{eqn:curl_r_s}
\begin{split}
curl \, L^{(r)} & = - curl \, L^{(s)},\\
curl \, Y^{(r)} & = - curl \, K^{(s)}.
\end{split}
\end{equation}
(all tensors will be expressed w.r.t a fixed orthonormal basis of a rectangular Cartesian coordinate system and all spatial derivatives are w.r.t the coordinates of the said system parametrizing the current configuration of the body; a $curl$ of a tensor amounts to a `row-wise' $curl$ based on the last index of the matrix of the tensor - this has an invariant meaning). In the theories we envisage, we expect the `singular parts' to also be integrable functions, at least, so partial differential equations, in some appropriate weak form, has a chance of being formulated for their evolution. Physically, this implies that we are adopting a microscopic point of view that resolves, with additional integrable fields, these macroscopically singular concentrations, the latter assumed to be manifestations of viewing, from a distance (or over a macrosocpic scale), localized smooth concentrations on a microscopic scale.  This is expected to be organized by the modified structure of the governing equations of the theory and its constitutive equations. With this understanding, the regular parts of fields are not expected to have any `large' concentrations even on `thin' sets (of full measure), at most containing bounded discontinuities.

In order to make a connection with Weingarten's theorem \cite{wein, delph_wein, volt, delph_volt, acharya2019_wein_volt}, we will consider the restricted case where $K^{(s)}$, a third-order tensor, is skew in its first two indices, which can also be expressed in terms of a second order tensor $\omega^{(s)}$ as
\begin{equation}\label{eqn:omega_k}
K^{(s)} = X \inprod{1} \omega^{(s)}, \  K^{(s)}_{ijk} = e_{ijs}\omega^{(s)}_{sk}.
\end{equation}
Then,
\[
e_{rmk}\, \sups{K}_{ijk,m} = e_{ijs} e_{rmk}\, \sups{\omega}_{sk,m},
\]
and we define the velocity-disclination density or \emph{v-disclination density} as
\begin{equation}\label{eqn:visclination}
\theta = - curl \, \sups{\omega}, \qquad \theta_{sr} = - e_{rmk} \sups{\omega}_{sk,m}.
\end{equation}
We also define the velocity-dislocation density or \emph{v-dislocation density} as
\begin{equation}\label{eqn:vislocation}
\alpha := - \supr{Y} \inprod{2} X = curl \, \supr{L} + \sups{K} \inprod{2} X = - curl \, \sups{L} + \sups{K} \inprod{2} X.
\end{equation}
Since
\[
\sups{K}_{ijk}e_{jkl} = -e_{jis}e_{jkl} \sups{\omega}_{sk} = - \left(\delta_{ik}\delta_{sl} - \delta_{il} \delta_{sk} \right) \sups{\omega}_{sk} = - \left( \sups{\omega}_{li} - \sups{\omega}_{kk} \delta_{il} \right),
\]
we note that
\begin{equation}\label{eqn:ahat}
\widehat{\alpha} := \alpha + \left(\sups{\omega}\right)^T - tr\left(\sups{\omega}\right) I = -curl \, \sups{L}
\end{equation}
is a $curl$ of a field.

Physically, the support of the $curl$ of  the singular part of the gradient of a field, when concentrated around a curve, represents the termination of a surface of discontinuity of the field in question.

Since both $\widehat{\alpha}$ and $\theta$ are defined through the $curl$ operation, they admit natural balance statements related to topological charge of lines/cylinders of support where these fields are concentrated \cite{ach_frac}. These cylinders cannot end in the body so that they are closed loops or run from boundary to boundary of the body (mathematically, a $curl$ is divergence-free). The conservation law for topological charge carried by these fields can be expressed, in the Eulerian setting, in the form \cite[Sec. 3]{acharya2007jump}
\begin{subequations}\label{eqn:conserv_law}
\begin{align}
\label{eqn:conserv_law_1}
\parderiv{\theta}{t} & = - curl \left(\theta \times \left(v + V^{(\theta)}\right) \right),\\
\label{eqn:conserv_law_2}
\parderiv{\widehat{\alpha}}{t} & = - curl \left( \widehat{\alpha} \times \left(v + V^{(\widehat{\alpha})} \right) \right),
\end{align}
\end{subequations}
where $V^{(\theta)}$ and $V^{(\widehat{\alpha})}$ are the spatial velocities of the $v$-disclination and $v$-dislocation defect fields, respectively, relative to the fluid particles. These are to be constitutively specified.

To see the connection of the kinematic structure above to the St.-Venant compatibility condition of linear elasticity theory, we have from \eqref{eqn:ahat}
\begin{equation}\label{eqn:Stvenant}
\begin{split}
& e_{rqi} \left( \alpha^T \right)_{li,q} + e_{rqi} \sups{\omega}_{li,q} - e_{rql} \left( \sups{\omega}_{kk,q} \right)  = - e_{rqi} e_{lkj}\sups{L}_{ij,kq} = - e_{rqi} e_{lkj} \sups{D}_{ij,kq}\\
\implies & \left( curl\, \widehat{\alpha}^T \right)_{sym} = \left( curl\, \alpha^T \right)_{sym} - \theta_{sym}  = - curl \left(curl\,\sups{D}\right)^T =:  - inc\, \sups{D},
\end{split}
\end{equation}
noting that $(inc\, A)_{sym} = 0$, for $A$ skew-symmetric and $\sups{D} := \sups{L}_{sym}$. The symbol $inc$ is the St.-Venant compatibility operator, and we see that in the presence of $v$-dislocations and $v$-disclinations in the body, $\sups{D}$ cannot generally be represented as the symmetrized gradient of a velocity vector field, and neither can $\supr{D}$ from \eqref{eqn:Lr} and linearity of the operator $inc$.
\section{A minimally modified Navier-Stokes system and discussion}
Assume that $V^{(\theta)} = V^{(\widehat{\alpha})} = 0$, i.e., the $v$-disclination and $v$-dislocation defects move with the fluid velocity, and consider the system
\begin{subequations}\label{eqn:N-S_system}
\begin{align}
\label{eqn:mod_NS_2}
\parderiv{\widehat{\alpha}}{t} & = - curl \left( \widehat{\alpha} \times  v \right),\\
\label{eqn:mod_NS_5}
- inc\, \sups{D} & = \left( curl\, \widehat{\alpha}^T \right)_{sym},\\
\label{eqn:mod_NS_6}
\parderiv{\rho v}{t} + div (\rho v \otimes v) & = div \left( -p I + \mathbb{C} \left(D - \sups{D} \right)\right),\\\label{eqn:mod_NS_7}
\left( \mathbb{C} \left( D - \sups{D} \right)\right) \inprod{2} D & \geq 0,\\
\label{eqn:mod_NS_8}
\frac{d \rho}{dt} + \rho \, div \, v & = \parderiv{\rho}{t} + div\, (\rho \,v)  = 0,
\end{align}
\end{subequations}
where $D = (\nabla v)_{sym}$, and $\frac{d \rho}{dt}$ is the material time derivative of the mass density $\rho$. For a  compressible fluid $\mathbb{C}$ is a constant, positive-definite, isotropic, fourth-order tensor, characterized by two scalar constants, the bulk and shear viscosities $(\mathbb{C} = \lambda I \otimes I + 2 \mu \mathbb{I})$, where $I$ is the second-order identity and $\mathbb{I}$ is the fourth-order identity tensor on the space of symmetric tensors, and within a purely mechanics setting the scalar $p$ is then the constitutively determined `thermodynamic pressure,' typically a function of the density $\rho$. For an incompressible fluid it follows that $\frac{d \rho}{dt} = div \, v = 0$, and $\mathbb{C}$ is then characterized by a single constant $(\mathbb{C} = 2 \mu \mathbb{I}, \mu > 0)$ and the field $p$ is now not determined constitutively, but instead through the field equations \eqref{eqn:N-S_system} and prescribed boundary and initial conditions. Equations \eqref{eqn:mod_NS_6}-\eqref{eqn:mod_NS_7}-\eqref{eqn:mod_NS_8} represent the balance of linear momentum, the second law of thermodynamics within a purely mechanics setting, and the balance of mass, respectively.

In the system \eqref{eqn:N-S_system}, \eqref{eqn:conserv_law_1} is not included since \eqref{eqn:Stvenant} shows that it is sufficient to consider the evolution of only $\widehat{\alpha}$ to understand the effect of the defect fields $\widehat{\alpha}, \theta$ on the solution for the velocity field (and mass density) through \eqref{eqn:mod_NS_6}-\eqref{eqn:mod_NS_7}-\eqref{eqn:mod_NS_8}. In general, the evolution of $\widehat{\alpha}$ and $\theta$ together define the evolution of the $v$-dislocation density, $\alpha$, from \eqref{eqn:visclination}-\eqref{eqn:ahat}, a special simplifying case being the assumption that $\theta = 0$.

We make the following observations:
\begin{enumerate}
\item  We first consider the restricted case wherein we assume that $div \, \left( \mathbb{C} \sups{D} \right) = 0$.

In this case, the model may be interpreted as follows: when the fluid velocity field is such that the $D$ field is regular, i.e., $\sups{D} = 0$, then we have the standard N-S system. When $\sups{D} \neq 0$ in the domain, we consider two further cases:
\begin{itemize}
\item Assume $\sups{K} = 0$, $\sups{\omega} = 0$ (which implies $\theta = 0$) i.e., the gradient of the regular part of the velocity gradient is regular.

Then, every singular solution of the classical N-S system \eqref{eqn:mod_NS_6} and  \eqref{eqn:mod_NS_8} now needs to satisfy an additional nonlocal differential inequality \eqref{eqn:mod_NS_7} arising from $\sups{D}$ being a functional of the velocity field obtained by solving the system \eqref{eqn:mod_NS_5}
and \eqref{eqn:mod_NS_2} with $\widehat{\alpha}$ replaced by $\alpha$.

There are obvious `gauge invariances' here, e.g., $\sups{D}$ is unique up to additions of symmetrized gradients of vector fields \eqref{eqn:mod_NS_5}, and considering the set of all possible $\sups{D}$ fields corresponding to each velocity field that solves  \eqref{eqn:mod_NS_6} and \eqref{eqn:mod_NS_8}, \eqref{eqn:mod_NS_7} appears to be a statement of convexity of the set (with $D$ being a point on its boundary). If boundary (and interior) conditions are invoked to supply uniqueness of solutions to \eqref{eqn:mod_NS_5}\footnote{For instance, as subsequently mentioned in the text, if $D^{(s)}$ is \emph{defined} as $D^{(s)} := inc \, \chi$ where $\chi$ is a solenoidal symmetric tensor field, then $\chi$ satisfies the inhomogeneous biharmonic equation, a fourth-order elliptic equation whose conditions for well-posedness are well-understood (see, e.g., \cite{rektorys1977variational}). Such boundary conditions may be imposed, justified by the requirement that $D^{(s)}$ should vanish when the rhs of \eqref{eqn:mod_NS_5} vanishes. },
then \eqref{eqn:mod_NS_7} is a nonlocal inequality constraint.

The similarity of notions of yield functions in rigid plasticity is to be noted.
\item Suppose now $\sups{K} \neq0$. The situation is mathematically as in the previous case but the physical meaning of the variable $\widehat{\alpha}$, and consequently the set of admissible $D^{(s)}$ fields for a given $v$ field is different, and this difference arises from the differing initial conditions (and inflow boundary conditions) that are imposed on $\widehat{\alpha}$ in \eqref{eqn:mod_NS_2} and that are compatible with the conditions $\sups{K} = 0$ and $\sups{K} \neq 0$. For example, suppose, for a certain 2-d flow, that both the $v$-dislocation and the $v$-disclination fields, $\alpha$ and $\theta$, are not identically $0$, but vanish outside a simply connected subregion $\Omega$ that is strictly contained within the (simply connected) 2-d flow domain  with  the $v$-disclination strength $\int_\Omega \theta \, \nu \,da \neq 0$, where $\nu$ is the outward unit normal to $\Omega$. Then the field $\widehat\alpha$ cannot vanish outside any subregion of the flow domain that contains $\Omega$ because, by \eqref{eqn:ahat}, $\widehat{\alpha} = 0$ would require the field $\omega^{(s)}$ (and, consequently $K^{(s)}$)  to vanish there as well. But, because of \eqref{eqn:visclination} (and an application of Stokes theorem), this contradicts the hypothesis that the $v$-disclination strength does not vanish.

\end{itemize}
As an aside, following the procedures of the stress-function approach to linear elasticity \cite{kroner1981continuum}, if we assume the restricted ansatz $\sups{D} = inc \, \chi$ with $\chi$ symmetric and $div \, \chi = 0$, then $div\, \sups{D} = 0$, and  $ inc \,\sups{D} = \Delta^2 \chi$, where $\Delta^2$ is the biharmonic operator, $\Delta^2(\cdot) = (\cdot)_{,jjkk}$, thus giving familiar structure to the solutions of \eqref{eqn:mod_NS_5} \footnote{If the fluid is incompressible, then in the restricted case under consideration we have   $div\, D^{(s)} = 0$. Thus, if the fluid domain is nonparaphractic (i.e., no embedded holes) we may apply the representation $D^{(s)} = inc \,\chi$ with $div\, \chi = 0$ without loss of completeness. In \cite{Ach-Fos}, we restrict the general theory presented here to the study of velocity dislocations in incompressible fluid dynamics, and, assuming $div \,D^{(s)} = 0$, we give an elementary example of the theory for the case of plane Poiseuille flow of an incompressible fluid between parallel plates. The fluid is driven by a steadily increasing pressure gradient. At a specified Reynolds number the classical steady laminar flow is assumed to switch to an incompatible steady flow, which we determine. A description of the nonsteady transition that takes place between these two steady flows is left for a future study.}.
\item Of course, through \eqref{eqn:mod_NS_6}, it is possible to consider the more general situation of $div \left( \mathbb{C} \sups{D} \right) \neq 0$, in which case there is a direct coupling between the velocity and $\sups{D}$ fields. Note that due to space-time filtering in the usual way (see, e.g., \cite{babic1997average}), a different contribution than the usual Reynolds stress tensor will appear in the averaged total stress tensor from the average of the $\sups{D}$ field. To see this, consider the case of an incompressible fluid and the following averaging operator:

For any microscopic field $q$ (viewed as a function of the variables $(x',t')$), the meso/macroscopic space-time averaged field $\bar{q}$ is given by
\begin{equation}\label{eqn:avg_oper}
\overline{q}(x,t)  := \frac{1}{\int_{\Omega(x)} \int_{I(t)} w(x-x', t-t')dx' dt'  } {\int_{\Lambda} \int_{B} w(x-x', t-t')\, q(x',t') \, dx' dt'},
\end{equation}
where $B$ is the flow domain and $\Lambda$ is a sufficiently large interval of time. $\Omega(x)$ is a bounded region within the domain around the point $x$ with linear dimension of the spatial resolution of the model to be developed, and $I(t)$ is a  bounded interval contained in $\Lambda$. The weighting function $w$ is non-dimensional and non-negative scalar valued, and assumed to be  smooth in the variables $x, x', t,$ and $ t'$. For fixed $x$ and $t$, $w$ has support in $\Omega(x) \times I(t)$ when viewed as a function of $x'$ and $t'$. Considering \eqref{eqn:N-S_system} as a system for microscopic fields (with differential operators in terms of the microscopic space-time variables) and applying the averaging operator \eqref{eqn:avg_oper} to each equation of the system, noting that for an incompressible fluid $\rho$ is a constant and that $\partial_{x_i} w = - \partial_{x'_i} w, \partial_t w = - \partial_{t'} w$, one obtains (up to a `layer' around $\partial B$) the \emph{averaged} equations
\begin{subequations}\label{eqn:avg_N-S_system}
\begin{align}
& \parderiv{\overline{\widehat{\alpha}}}{t}  = - curl \left( \overline{\widehat{\alpha}} \times  \overline{v}  + \overline{{\sf F}^{\,\widehat{\alpha} \times v}} \right), \notag\\
& {\sf F}^{\,\widehat{\alpha} \times v} (x,x',t,t')  := \widehat{\alpha}\left(x',t'\right) \times v\left(x',t'\right) - \overline{\widehat{\alpha}}(x,t) \times \overline{v}(x,t), \notag\\
& \overline{{\sf F}^{\,\widehat{\alpha} \times v}}  = \overline{\widehat{\alpha} \times v} - \overline{\widehat{\alpha}} \times \overline{v}, \ \mbox{ equivalently} \  \ \overline{{\sf F}^{\,\widehat{\alpha} \times v}} (x,t)  = \overline{\left(\widehat{\alpha} - \overline{\widehat{\alpha}}(x,t)\right) \times \left(v - \overline{v}(x,t)\right) }\,(x,t),  \notag\\
& - inc\, \overline{\sups{D}}  = \left( curl\, \overline{\widehat{\alpha}}^T \right)_{sym}, \notag\\
\label{eqn:avg_linmom}
& \parderiv{\rho \overline{v}}{t} + div (\rho \overline{v} \otimes \overline{v})  = div \left( -\overline{p} I + \mathbb{C} \left(\overline{D} - \overline{\sups{D}}\right) - \overline{{\sf F}^{\,\rho v \otimes v}} \right), \\
&{\sf F}^{\,\rho v \otimes v} (x,x',t,t') := \rho \, \left( v(x',t') \otimes v(x',t') - \overline{v}(x,t) \otimes \overline{v} (x,t) \right), \notag\\
& \overline{{\sf F}^{\,\rho v \otimes v}} = \rho\, \overline{v \otimes v} - \rho \, \overline{v} \otimes \overline{v}, \ \mbox{ equivalently} \  \  \overline{{\sf F}^{\,\rho v \otimes v}}(x,t) = \rho\, \overline{(v - \overline{v}(x,t)) \otimes (v - \overline{v}(x,t))}\, (x,t), \notag\\
\label{eqn:avg_sec_law}
&0 \leq  \left( \mathbb{C} \left( \overline{D} - \overline{\sups{D}} \right)\right) \inprod{2} \overline{D} + \overline{{\sf F}^{\mathbb{C}(D - D^{(s)}) \inprod{2} D} }, \\
 &{\sf F}^{\left(\mathbb{C}\left( D - D^{(s)} \right)\right) \inprod{2} D} \left(x,x',t,t'\right)  := \left( \mathbb{C}\left( D\left(x',t'\right) - D^{(s)}\left(x',t'\right) \right)\right) \inprod{2} D\left(x',t'\right)  \notag\\
& \qquad \qquad \qquad \qquad \qquad \qquad \quad - \left( \mathbb{C}\left( \overline{D} - \overline{D^{(s)}} \right)\left(x,t\right)\right) \inprod{2} \overline{D}\left(x,t\right), \notag\\
& div \, \overline{v}  = 0,  \notag
\end{align}
\end{subequations}
where all differential operators are w.r.t. the coordinates $(x,t)$, and we note that it is only under very special circumstances that averages of products are equal to products of averages. The `independent' fields of the averaged model above are $( \overline{\widehat{\alpha}}, \overline{v})$. While the fields $\overline{\sf F^{(\cdot)}}$ are well-defined in terms of the fields of the `microscopic' system \eqref{eqn:N-S_system}, they cannot, in general, be expressed as functionals of the independent fields of the averaged model, such expressions being referred to as `closure' relations. It is clear, given the microscopic model \eqref{eqn:N-S_system}, that evolution equations for the $\overline{\sf F^{(\cdot)}}$ fields can as well be written down, in which case they become (the $\overline{\sf F^{(\cdot)}}$s) additional independent fields and they, in turn, give rise to further higher-order `fluctuations,' and without closure, the cycle continues. In this manner an infinite hierarchy of equations arises but, of course, it is the closure equations for the fluctuations up to any given/inferred retained level that are of paramount fundamental importance as well as the determination of at what level, if at all, the microscopic dynamics \eqref{eqn:N-S_system} implies a closed averaged model.
\item From work in \cite{garg2015study}, nucleation of the defect field $\widehat{\alpha}$ with null initial conditions can be expected due to the coupling of $\widehat{\alpha}$ to the velocity field $v$ in \eqref{eqn:conserv_law}.
\item

A different modification is to have $V^{(\theta)}, V^{(\widehat{\alpha})}$ constitutively specified, increasing the ad-hoc nature of the model. An interesting and strong difference between defect dynamics in elasticity and the present fluid model is that in solids, the defect fields in the \emph{inverse deformation gradient} have an effect upon the stored energy and the Second Law of Thermodynamics constrains the constitutive specification of the defect velocity fields. In the viscous fluid case being discussed, the defects in the velocity field do not affect the stored energy, and the Second Law, as it stands, does not appear to provide any direct guidance, at least of the type available in solids, on the constitutive specification of the defect velocities. Thus, for this modification, the Second Law, as it stands in classical fluid dynamics, may not be adequate, and a critical examination of the physical admissibility of additional energy related contributions due to the existence of  defects in fluids is warranted.

\item An interesting question is whether or not $v$-dislocations and $v$-disclinations can be experimentally observed in flow visualizations. For example, one situation which may be amenable to identification of singularities through analysis of flow visualization is when these defects are isolated, i.e., consider the case of a 2-d flow in which the fields $\alpha$ and $\theta$ are localized and vanish outside a subregion $\Omega$ of the 2-d flow domain. The line integral of $L^{(r)}$ on a closed loop in `good' far-field fluid can presumably be evaluated and when $\widehat{\alpha} = 0$, we see that \eqref{eqn:ahat} and \eqref{eqn:curl_r_s} require this integral to vanish  regardless of the contour. When $Y^{(r)} = \nabla L^{(r)}$, which by \eqref{eqn:Yr} requires $K^{(s)} = 0$, i.e., the `regular flow curvature' field does not have a singular part, then $\sups{\omega}$ vanishes and, because of \eqref{eqn:curl_r_s}, \eqref{eqn:ahat}, and Stokes theorem we see that  the closed-loop integral of $L^{(r)}$ is a constant on all contours that encircle $\Omega$ and given by $\int_\Omega \alpha  \nu \, da$, where $\nu$ is the outward unit normal to $\Omega$. Thus the non-zero constancy of the closed-loop integral on the said contours when $\int_\Omega \alpha  \nu \, da \neq 0$ is a necessary condition for the the absence of `flow-curvature' singularities, i.e., the absence of $\sups{K}$ and $curl \,Y^{(r)} = 0$. The experimental identification of such isolated `singularities' can also help in testing the assumption that these defects potentially move with the fluid velocity.

\item A primary remaining question is if the structure of this model can be useful in the study of the N-S equations (especially as applied to high Reynolds number flows), since for such flows it poses additional constraints on solutions of the classical N-S system, alternative to those that are traditional within the theory of turbulence.

We note that the classical N-S system and its various idealizations model the observed behavior of real fluids remarkably well. Robust computational capabilities for approximating the solutions of such systems are well developed and much used for practical purposes. It is perhaps fair to state that the main challenges that remain in understanding the N-S equations relate to mathematical questions of well-posedness of solutions, and the theoretical and practical questions of developing models for, and computing, the effective response of turbulent fluids at larger length scales than the viscous length scale approaching atomic dimensions. In what follows, we provide some (speculative) remarks about the possibilities of our proposed model in aiding the study of some such issues.

Here, we consider various idealizations of the compressible and incompressible fluid within a thermodynamic setting. Since our efforts relate to improving models of discontinuities in classical continuum mechanics, it is worthwhile to first recall and comment upon the well-known expression of mass balance at a surface of discontinuity: $\llbracket \rho (v \cdot n  - u_n) \rrbracket = 0$ \cite{truesdell1960classical,landau_lif}, where $n$ represents the unit normal to the surface of discontinuity, $u_n$ is the normal velocity of the surface of discontinuity, and $\llbracket (\cdot ) \rrbracket$ represents the `jump' of $(\cdot )$ across the surface. This makes it clear that for a (homogeneous) incompressible fluid, shocks, i.e., $\llbracket v \cdot n \rrbracket \neq 0$, are not allowed. Discontinuities in the tangential velocity (slip surfaces or vortex sheets) are allowed in both compressible and incompressible fluids. As is well-known, flat tangential discontinuities in the inviscid, incompressible case are unstable (the Kelvin-Helmholtz instability, \cite[Sec. 29, 84]{landau_lif}), giving way to a turbulent region, with similar phenomena arising in the viscous and compressible \cite[Sec. 84]{landau_lif},\cite{fjordholm2017construction} cases. We remark that in the setting of this note, the singular part of the velocity gradient $\sups{L}$ is a field that can be non-vanishing in `thin' sets of full measure. The sets can be time-dependent and `curved' in space, with their `terminations,' i.e. the locations where $\widehat{\alpha} = -curl\, \sups{L} \neq 0$, serving as the `core' of the vortices that we believe are so abundantly seen in well-developed turbulent regions following such instabilities.

The explicit thermomechanical governing equations for the various flow idealizations are:
\begin{itemize}
\item {\bf Case I - the compressible, viscous fluid}
\begin{subequations}\label{eqn:comp_viscous}
\begin{align}
\label{eqn:mod_cv_3}
& \parderiv{\rho}{t} + div\, (\rho \,v) = 0, \\
\label{eqn:mod_cv_4}
& \parderiv{}{t}(\rho E) + div (\rho Ev) = div (T v - q); \qquad E:= \varepsilon(\rho, \eta) + \frac{1}{2} \rho \, v\cdot v; \qquad q := - \kappa \nabla \vartheta,\\
& T:= - \hat{p}(\rho, \eta) I + \lambda\, tr \left(D - \sups{D}\right)I + 2\mu \left(D - \sups{D} \right); \qquad \hat{p}(\rho, \eta): = \rho^2 \parderiv{\varepsilon}{\rho} (\rho, \eta), \notag\\
\label{eqn:mod_cv_5}
& \parderiv{}{t}(\rho v) + div (\rho v \otimes v) = div\, T, \\
\label{eqn:mod_cv_6}
& \left( \lambda\,  tr\left(D - \sups{D}\right)I + 2\mu \left(D - \sups{D} \right) \right) \inprod{2} D  \geq 0; \qquad 0< \vartheta := \parderiv{\varepsilon}{\eta} (\rho, \eta),\\
\label{eqn:mod_cv_1}
& \parderiv{\widehat{\alpha}}{t} = - curl \left( \widehat{\alpha} \times  v \right),\\
\label{eqn:mod_cv_2}
& - inc\, \sups{D} = \left( curl\, \widehat{\alpha}^T \right)_{sym},
\end{align}
\end{subequations}
where balance of energy (the First Law of thermodynamics) has also been included with $\varepsilon$ being the internal energy density per unit mass, $\vartheta$ is the absolute temperature, $\eta$ the entropy density per unit mass, $q$ is the heat flux vector, and $\kappa$ is the diffusivity. The inequalities $\lambda + \frac{2}{3} \mu > 0$, $\mu > 0$, and $\kappa > 0$ hold, and we note from \eqref{eqn:mod_cv_6} that $\eta$ may be expresed as a function $\vartheta$ and $\rho$.

Here and in the following Cases along with their various assumptions on $\lambda$ and $\mu$, the ansatz
\[
div \,( \mathbb{C} \sups{D}) = 0  \implies div\, \left( \lambda \,tr \left(\sups{D}\right)I + 2\mu \sups{D} \right) = 0,
\]
may be a helpful simplifying feature. \emph{In what follows, this ansatz will be assumed in all Cases discussed.}

We note that system \eqref{eqn:mod_cv_3} and \eqref{eqn:mod_cv_5} are exactly their classical counterparts, but the thermodynamic statements \eqref{eqn:mod_cv_4}, \eqref{eqn:mod_cv_6} include the effects of $\sups{D}$. Existence of weak solutions in space dimension 3 for the classical N-S equations for this case has been proven in \cite{bresch2007existence} but uniqueness of solutions, or the lack of it, has not yet been proven. Our modified system for $(\rho, v, \eta)$ is not the same as the classical case as just outlined, and it remains to be seen whether the full system \eqref{eqn:comp_viscous} can aid in the mathematical study of the compressible, linearly viscous fluid for high Reynolds number flows.
\item {\bf Case II - the compressible, inviscid fluid under adiabatic conditions, i.e., the compressible Euler equations}

This idealization applies particularly to gases for which it is reasonable to assume the bulk viscosity $\lambda + \frac{2}{3} \mu = 0$ and $q = 0$.

In order to develop the governing system for this case, we first consider this idealization as a special case of the compressible viscous fluid, i.e., Case I, under the ansatz that $\lambda + \frac{2}{3} \mu = 0$ and $q = 0$. Noting that $\mu > 0$ in Case I, this ansatz implies that \emph{\eqref{eqn:mod_cv_6}$_1$ is equivalent to
\begin{equation}\label{eqn:diss_ind_mu}
\left(D - \sups{D} \right)_{dev} \inprod{2} D_{dev} \geq 0,
\end{equation}
a statement independent of $\mu$}, where $( \cdot)_{dev}$ refers to the deviatoric part of a second-order tensor.  Hence, under the ansatz $\lambda + \frac{2}{3} \mu = 0$ and $q = 0$, system \eqref{eqn:comp_viscous} can be written as stated with \eqref{eqn:mod_cv_6} replaced by  $\left(D - \sups{D} \right)_{dev} \inprod{2} D_{dev} \geq 0$. Now, taking the formal limit  $\mu \to 0$ in this specialization of \eqref{eqn:comp_viscous}, we obtain the system
\begin{subequations}\label{eqn:comp_inviscid}
\begin{align}
\label{eqn:mod_cinv_3}
& \parderiv{\rho}{t} + div\, (\rho \,v) = 0, \\
\label{eqn:mod_cinv_4}
& \parderiv{}{t} (\rho E) + div (\rho Ev) = div (-\hat{p}(\rho, \eta) v); \qquad E:= \varepsilon(\rho, \eta) + \frac{1}{2} \rho \, v\cdot v, \\
\label{eqn:mod_cinv_5}
& \parderiv{}{t}(\rho v) + div (\rho v \otimes v) = div (- \hat{p}(\rho, \eta) ); \qquad \hat{p}(\rho, \eta): = \rho^2 \parderiv{\varepsilon}{\rho} (\rho, \eta), \\
\label{eqn:mod_cinv_6}
& \left(D - \sups{D} \right)_{dev} \inprod{2} D_{dev} \geq 0,\\
\label{eqn:mod_cinv_1}
& \parderiv{\widehat{\alpha}}{t} = - curl \left( \widehat{\alpha} \times  v \right),\\
\label{eqn:mod_cinv_2}
& - inc\, \sups{D} = \left( curl\, \widehat{\alpha}^T \right)_{sym}.
\end{align}
\end{subequations}
The equations \eqref{eqn:mod_cinv_3},\eqref{eqn:mod_cinv_4},\eqref{eqn:mod_cinv_5} form the classical system for $(\rho, v, \eta)$ for this case. In the classical setting, shocks and tangential discontinuities are known to arise and persist in this case, for special problems. Within this setting, the existence of global weak solutions for representative problems containing a wide class of initial data  is not known (with very practically demonstrable consequences \cite{fjordholm2017construction}), let alone uniqueness; an excellent discussion is provided in \cite{ fjordholm2017construction} including computational aspects. As discussed previously, the equations \eqref{eqn:mod_cinv_6}, \eqref{eqn:mod_cinv_1}, \eqref{eqn:mod_cinv_2} provide additional constraints on weak `solutions' of the classical theory, were they to exist, and may be expected to affect the uniqueness of such solutions. These equations may also be expected to constrain the entropy-measure-valued solutions and statistical solutions that have been defined \cite{fjordholm2017construction,fjordholm2017statistical}, following a distinguished history of work by L. Tartar, R. J. DiPerna, and C. Foias.
\item {\bf Case III - the incompressible, viscous fluid under isothermal conditions}

The governing equations in this case become
\begin{subequations}\label{eqn:incomp_viscous}
\begin{align}
\label{eqn:mod_incv_3}
& div\, v = 0, \\
\label{eqn:mod_incv_5}
& \parderiv{}{t}(\rho v) + div (\rho v \otimes v) = \frac{1}{\rho} div \left(- p I +
2 \mu \left( D - \sups{D} \right)\right), \\
\label{eqn:mod_incv_6}
& \left(D - \sups{D} \right)_{dev} \inprod{2} D_{dev} \geq 0,\\
\label{eqn:mod_incv_1}
& \parderiv{\widehat{\alpha}}{t} = - curl \left( \widehat{\alpha} \times  v \right),\\
\label{eqn:mod_incv_2}
& - inc\, \sups{D} = \left( curl\, \widehat{\alpha}^T \right)_{sym},
\end{align}
\end{subequations}
where $\rho > 0$ is a given constant mass density, $\mu >0$ holds, and $p$ now is a field not determined by a constitutive assumption but determined as part of the solution to a particular problem that is posed.

Again, \eqref{eqn:mod_incv_3},\eqref{eqn:mod_incv_5} are exactly the classical equations for $(p, v)$, and \eqref{eqn:mod_incv_6},\eqref{eqn:mod_incv_1},\eqref{eqn:mod_incv_2} provide further constraints on solutions of \eqref{eqn:mod_incv_3},\eqref{eqn:mod_incv_5} due to the incompatibility of the fluid motion. The status of the mathematical study of \eqref{eqn:mod_incv_3},\eqref{eqn:mod_incv_5} may be found in \cite{bardos2013mathematics}. Global weak  (Leray-Hopf) solutions in 3-d are known to exist, but the status of their uniqueness is not known \cite{guillod2017numerical}(some very `rough' weak solutions have recently been shown to be non-unique \cite{buckmaster2019nonuniqueness}).
\item {\bf Case IV - the incompressible, inviscid fluid under isothermal conditions, i.e., the incompressible Euler equations}

Viewing this case as a formal limit of $\mu \to 0$ in \eqref{eqn:incomp_viscous}, the governing equations in this case become
\begin{subequations}\label{eqn:incomp_inviscid}
\begin{align}
\label{eqn:mod_incinv_3}
& div\, v = 0, \\
\label{eqn:mod_incinv_5}
& \parderiv{}{t}(\rho v) + div (\rho v \otimes v) = \frac{1}{\rho} div \left(- p I \right), \\
\label{eqn:mod_incinv_6}
& \left(D - \sups{D} \right)_{dev} \inprod{2} D_{dev} \geq 0,\\
\label{eqn:mod_incinv_1}
& \parderiv{\widehat{\alpha}}{t} = - curl \left( \widehat{\alpha} \times  v \right),\\
\label{eqn:mod_incinv_2}
& - inc\, \sups{D} = \left( curl\, \widehat{\alpha}^T \right)_{sym},
\end{align}
\end{subequations}
where where $\rho > 0$ is a given constant mass density, and $p$ is again a non-constitutive fundamental field to be determined.

The constraints provided by the proposed model \eqref{eqn:incomp_inviscid} to the classical system consisting of \eqref{eqn:mod_incinv_3}, \eqref{eqn:mod_incinv_5} are the same as in Case III. For the classical system, non-unique, \emph{dissipative}, H\"{o}lder continuous weak solutions have recently been constructed, as described in the excellent review \cite{delellis_szekel}, rigorously establishing Onsager's conjecture on anomalous dissipation in the incompressible Euler equations (i.e., there exists (continuous) velocity fields whose total kinetic energy strictly decreases in time if the velocity field satisfies the condition $|v(x,t) - v(y,t)| < C |x - y|^h \ \forall x,y,t$ ($x,y$ are locations, $t$ is time) with  $ h < \frac{1}{3}$, where $C >0 $ is a constant independent of $x,y,t$), as well as far-reaching connections to the geometric isometric embedding problem.
\end{itemize}

Finally, we note that in Cases I and III above, and without the restriction $div\, \left( \mathbb{C} \sups{D} \right) = 0$, the equations as averaged according to the scheme in \eqref{eqn:avg_oper}-\eqref{eqn:avg_N-S_system} have an added contribution to the averaged stress tensor arising from $\overline{\sups{D}}$ that is expected to affect the coarse-scale modeling of turbulence by our model. (We note that the averaging operator  \eqref{eqn:avg_oper} can easily be adjusted to not include any averaging in time if desired, e.g., as is done in Large Edddy Simulations (LES) for modeling intermittency.) In all Cases, the averages of the `dissipation', \eqref{eqn:mod_cv_6}, \eqref{eqn:mod_cinv_6}, \eqref{eqn:mod_incv_6}, and \eqref{eqn:mod_incinv_6} have added contributions in comparison to their classical counterparts.

\end{enumerate}
\bibliographystyle{alpha}