Summarize(text = str_c(x, collapse = ' ')) Group_by(linenumber = ceiling(row_number() / 10)) %>% This is in a function because we are going to use this a bunch of times. Much nicer! Then let’s calculate the sentiment for each chunk of text. My favorite is probably the dplyr one shared by the knowledgeable/generous David Robinson. I got a couple of suggestions to avoid my use of a for loop for chunking the text in my last post. Now that we have the texts for Jane Austen’s novels, let’s concatenate the ~70-character lines into larger chunks. We’ll see! Options for Sentiment Analysis Matthew Jockers talks about using a corpus of tens of thousands of novels, but doesn’t give information on how to access a publicly available version of this corpus. Some of the processing to get these texts into an R package is easy to automate, but some of it isn’t the Project Gutenberg headers and footers seem to not be standard in length, etc. Wouldn’t it be great to have a really big sample of books easily accessible in R? I am still considering how to implement such a thing, though. I have been pondering doing something more ambitious along these lines. The data objects appear to be quite similar, however, as we both used the Project Gutenberg UTF-8 plain text files and performed similar processing. Undeterred, I decided to put together this package anyway with all of Jane Austen’s completed published works. library(dplyr)Īs I was working on this package, I discovered that three of the novels are already available within the stylo package this package was built for stylometric analysis of text (that sounds SO FUN…) and the texts for three of Jane Austen’s books are in the novels data set in that package, along with 6 novels by the Brontë sisters. Let’s load them, along with the libraries we’ll need for this analysis. Each text is in a character vector with elements of about 70 characters. Now they are all ready for text analysis. The UTF-8 plain text for each novel was sourced from Project Gutenberg and then I processed them a bit to remove the Project Gutenberg headers and footers as well as blank lines and NA lines, etc. You can read more details in the documentation and README, but the package contains the full text of the 6 completed, published novels of Jane Austen. The package is available on Github and can be installed via devtools. I decided to make an R package for her texts, for easy access for myself and anybody else who would like to do some text analysis on a nice sample of prose. It was just so much fun that I wanted to extend some of that work and compare across her body of writing. In my last post, I did some natural language processing and sentiment analysis for Jane Austen’s most well-known novel, Pride and Prejudice.

Northanger abbey gutenberg