Category Archives: R Programming

Extract Data Tables from PDF Files in R

A new method to extract data tables from PDF files is introduced. Most of the data scraping tools available are browser-based.  The common tools are also manual in nature and limited to one table at a time. A solution is outlined to extract multiple tables at once.  The solution combines the R programming language with the open-source Java program Tabula. The result is a convenient method that transforms documents into databases.

Benefit Statement
The ability to train a machine to extract data tables from PDF files has several benefits:

Posted in Data, Misc Tricks, R Data Import, R Programming | Leave a comment

Popularity of R Programming Language

TIOBE IndexThe popularity of R is rapidly increasing and is well on its way to being a top 10 programming language.  The TIOBE index is a standard indicator of the popularity of all programming languages.  The TIOBE index confirms that a subset of languages – those for computational statistics and data analysis – are gaining increased attention. The clear winner of the pack is the open source programming language R.

Posted in Data Science, R Programming | Leave a comment

R Source Code

WordcloudSource code access is one of the great benefits of R.  Source code is available for base R and over 5,000 open source packages.  There are many reasons to view source code: to know what software does when documentation is vague or incomplete; to combine code objects in custom scripts or libraries; and to change source code as needed.  The following post defines the different types of R source code available and how to access R sources.

Posted in R Packages, R Programming | Leave a comment

Fast File Reads (fread) for Large Data

freadThe standard way to read text files into R is to use the read.table() command.  However, many users struggle with time delays when loading large data sets.  An alternative command that offers significant speed improvements is fread(), or fast read, which can found in the data.table package.  The following code loads a tab delimited file with a million elements and reveals that fread() reduces load time by almost 99%, as confirmed by the benchmark performance stats at left.  The function is still under development, but it is available for download and doesn’t suffer from stability issues.  Instead, expect argument structure and command syntax to change over time.

Posted in Faster R, R Data Import, R Packages, R Programming | Leave a comment

Custom Beamer Template

Click to enlarge

Click to enlarge

Beamer is a \LaTeX{}~ document class that is by far the most practical tool for making presentations involving data science, business analytics, or general research. It is widely used in most conferences and easily lends itself to data intensive reporting and repetitive batch processing.

A custom beamer template is presented that is easy to extend or modify.  The benefits of the beamer document are numerous:

Posted in LaTeX, Misc Tricks, R Programming | Leave a comment

Correlation Plots in R

The standard function for correlation plots in R is pairs(), which generates a matrix of scatter plots based on all pairwise combinations of variables in a data object.  The standard graph looks something like this after a little color enhancement:” plot13Click to enlarge

The code behind this plot is simple:

Posted in Data Science, ggplot2, R Graphics, R Programming | Leave a comment

R Syntax Highlighter

Pretty RPretty R is an online tool and r syntax highlighter that transforms R source code into HTLM code for website development.  The result is easy to read R code for high quality web presentations. The Pretty R webpage is a good learning tool as it provides the HTML code details required to deliver syntax highlighting that complies with R documentation from inside-r.org.

Posted in Misc Tricks, R Programming | Leave a comment