How your writing style predicts your book's success ~ statistically


John Mavin of The Writer's Studio at Simon Frazer University
surrounded by manuscripts entered in the school's First Book Competition.
If only there were a way to analyze a manuscript and accurately predict its potential success rather than the seemingly random and bewildering process of an editor's opinion, opinion's so frequently wrong.  I mean, Philip Roth's Portnoy's Complaint was rejected by over forty publishers before finding success, and that's just one of hundreds if not thousands of examples.

One professor thinks she has a tool to bring some science to the process of selecting books for publication, and not a writing or literature teacher either, but a professor of computer science.

Stony Brook Department of Computer Science Assistant Professor Yejin Choi thinks she has a tool to bring some science to that art as described in the paper she co-authored, Success with Style: Using Writing Style to Predict the Success of Novels.

Introducing statistical stylometry
"Predicting the success of literary works poses a massive dilemma for publishers and aspiring writers alike," Choi said. "We examined the quantitative connection between writing style and successful literature. Based on novels across different genres, we investigated the predictive power of statistical stylometry in discriminating successful literary works, and identified the stylistic elements that are more prominent in successful writings."

Statistical stylometry is the statistical analysis of variations in literary style between one writer or genre and another. The study reports, for the first time, that the discipline can be effective in distinguishing highly successful literature from its less successful counterpart, achieving accuracy rates as high as 84%.  Their analysis of the styles of writing is amazingly accurate, up to 84% for novels 89% for movies, based on their stylistic analysis when compared to the actual success the work achieved.

Dr. Choi and her colleagues in the College of Engineering and Applied Sciences -- Vikas Ashok, a teaching assistant in the Department of Computer Science, and Song Feng, a fifth year PhD student in the same department - make the following conclusions that will effect your writing:

Successful books make more frequent use of
  1. Conjunctions such as "and," "but," "or" to join sentences and prepositions. 
  2. Prepositions, nouns, pronouns, determiners (words that precede nouns to indicate whether the noun is specific or general, e.g. "your letter"), and 
  3. Adjectives are also predictive of highly successful books.
  4. Verbs that describe thought-processing ("recognized," "remembered") and 
  5. Verbs that simply serve the purpose of quotes ("say"). 
Less successful books are characterized by
  1. A higher percentage of verbs, adverbs, and foreign words as follows ~
    • Topical words that could be almost cliché ("love"), typical locations, and extreme ("breathless") and negative ("bruised") words.
    • Verbs that explicitly describe actions and emotions ("wanted," "took," "promised," "cried," "cheered").
Recommended reading
click on image
About the study
For practical purposes, the researchers defined "success" by download counts from Project Gutenberg, which houses 42,000 books that are available for free download in electronic format. Dr. Choi and her team scrutinized eight genres -- adventure, mystery, historical fiction, fiction, science-fiction, love stories, short stories, and poetry. They also studied a number of books not included at Project Gutenberg, ranging from A Tale of Two Cities by Charles Dickens, through The Old Man and the Sea by Ernest Hemingway, to The Lost Symbol by Dan Brown.

"For a small number of novels, we also considered award recipients -- such as Pulitzer and Nobel prizes -- and Amazon sales records in order to define a novel's success," Choi says. "Additionally, we extended our empirical study to movie scripts, where we quantified a film's success based on the average review scores at imdb.com."

The researchers took 1000 sentences from the beginning of each book. They performed systematic analyses based on lexical and syntactic features that have been proven effective in Natural Language Processing (NLP) tasks such as authorship attribution, genre detection, gender identification, and native language detection.

"To the best of our knowledge, our work is the first that provides quantitative insights into the connection between the writing style and the success of literary works," Choi says. "Previous work has attempted to gain insights into the 'secret recipe' of successful books. But most of these studies were qualitative, based on a dozen books, and focused primarily on high-level content -- the personalities of protagonists and antagonists and the plots. Our work examines a considerably larger collection -- 800 books -- over multiple genres, providing insights into lexical, syntactic, and discourse patterns that characterize the writing styles commonly shared among the successful literature."

Says Dr. Choi, "Our research sets forth an understanding of the connection between successful writing style and readability. We also shed light on the connection between sentiment/connotation and literary success, and put forward comparative insights between successful writing styles of fiction and nonfiction."
*  *  *  *  *

Story Source:  Materials provided by Stony Brook University. Stony Brook University. "Some elements of writing style differentiate successful fiction." ScienceDaily, January, 2014

Comments

Post a Comment

Popular posts from this blog

An unexpected way to recover from a breakup

Image
Breaking up is truly hard to do. And recovery from a breakup can be even harder. Your friends may counsel you to put the whole thing out of your mind. But new research suggests that repeatedly reflecting on a break-up -- even through participation in a research study -- actually speeds emotional recovery. "Breakups are ubiquitous -- most adults have experienced at least one in their life -- and are typically very distressing," says Grace Larson of Northwestern University. After studying divorce and breakups for years using longitudinal, multi-method designs, Larson and her then-adviser David Sbarra of the University of Arizona wanted to study whether these research techniques on their own were affecting participants. One concern they had was that the studies could be harming participants, Larson says. "At first glance, it might seem like repeatedly reminding participants that they had just broken up -- and asking them to describe the breakup over and over --
Read more

Greek Bronze Age ended 100 years earlier than thought

Image
Source: www.shef.ac.uk The charred remains of Assiros Toumba in Greece. Writing historical fiction set in the Greek Bronze Age?  Or simply enjoy reading this genre'?  Here's a study you may find interesting. C onventional estimates for the collapse of the Aegean civilization may be incorrect by up to a century, according to new radiocarbon analyses. While historical chronologies traditionally place the end of the Greek Bronze Age at around 1025 BCE, this latest research suggests a date 70 to 100 years earlier. www.weather-forecast.com Archaeologists from the University of Birmingham selected 60 samples of animal bones, plant remains and building timbers, excavated at Assiros in northern Greece, to be radiocarbon dated and correlated with 95.4% accuracy using Bayesian statistical methodology at the University of Oxford and the Akademie der Wissenschaften Heidelberg, Germany. Researcher Dr Ken Wardle says, 'These new results tell a story that is totall
Read more

Mood Instability and Your Characters

Image
You're putting together a character who's mood simply bounces all over the place, happy one moment, in a fit of rage the next.  Researchers at King's College London note that this sort of mood instability is part of a number of mental health disorders.  So how do you structure the personality and behavior of a character like this?  Below is the King's College report, along with a brief description from mentalhealth.com, of typical behavior, sometimes in the extreme, of a person who is very emotionally unstable.  This is offered strictly as a guide for crafting character in fiction - and NOT for the amateur diagnosis of the state of someone's mental health.  That is always best left to trained professionals. Another note about emotionally unstable behavior:  as any parent will tell you, this is how adolescents and teen-agers often behave.  It's a normal part of growing up - but it is a matter of degree .  In the extreme, however, this behavior can be diag
Read more

How the lives of Georgian gaolbirds and highwaymen shaped modern Britain

Image
Writing historical fiction requires solid research of available materials and databases.  The key word here is available.   So news of a new publicly accessible database that allows an author to research a very interesting past era is priceless almost beyond words.   I expect some exciting fiction to come out of this announcement. Here's the story, with a link to the source in the attribution. *  *  *  *  * London Lives, a landmark project led by Professor Bob Shoemaker from the University of Sheffield and Professor Tim Hitchcock from the University of Sussex, has uncovered a mass of extraordinary new evidence which reveals how the lives of thousands of 18th-century poor and criminal Londoners helped shape modern Britain. Based on evidence made available in a publicly available database, the study sheds new light on the everyday lives of thieves, prostitutes, vagrants, highwaymen, con-men, paupers and jailbirds, revealing how their daily fight for survival led to t
Read more

Remember faces but not names? You got it wrong.

Image
Source:   Daily Excelsior So, you think you're good at remembering faces, but terrible with names? New research has revealed we are actually better at remembering names than faces The cringe-worthy experience of not being able to remember an acquaintance's name leads many of us to believe we are terrible with names. However, new research has revealed this intuition is misleading; we are actually better at remembering names than faces. With the Christmas party season fast approaching, there will be plenty of opportunity to re-live the familiar, and excruciatingly-awkward, social situation of not being able to remember an acquaintance's name. This cringe-worthy experience leads many of us to believe we are terrible at remembering names. However, new research has revealed this intuition is misleading; we are actually better at remembering names than faces. The authors of the study, from the University of York, suggest that when we castigate ourselves f
Read more