Preparing IMDB Movie Review Data for NLP Experiments

The Data Science Lab Dr. James McCaffrey of Microsoft Research shows how to get the raw source IMDB data, read the movie reviews into memory, parse and tokenize the reviews, create a vocabulary dictionary and convert the reviews to a numeric form. A common dataset for natural language processing (NLP) experiments is the IMDB movie review data.