Medical Care Expense Analysis and Linear Regression in R

In this R tutorial, we will be analyzing and visualizing medical care expenses. For this tutorial, we will be using the lm() package to fit a linear regressional model to data in R.

Health insurance companies must make money to stay afloat. In order to do so, it must collect more in yearly premiums than it spends on medical care for its beneficiaries. Investors invest money and time to develop models that will accurately forecast medical expenses for the insured population.

The goal of this tutorial is to analyze patient data to estimate the average medical care expense for such population segments. These estimated can be used to create actuarial tables that set the price of patients yearly premiums, which may be high or low, depending on the expected treatment costs.

Install and Load Packages

Below are the packages and libraries that we will need to load to complete this tutorial:

Download and Load the Medical Care Expense Dataset

Since we will be using the medical care expenses dataset, you will need to download this dataset. This dataset is already packaged and available for an easy download from the dataset page or directly from here Medical Care Expenses – insurance.csv

View the Medical Care Expense Dataset

head() function

Now, let’s take a look at the data and see by using the command head():

As one can see from the above, the data provided for each person is age, sex, BMI, children, smoker, region, and expenses.

lm() function

The method that will be used for insurance data is lm(). An lm() sample is provided below:

The above will be used to fit a linear regression model to data with R. The R formula syntax uses the tilde character to describe the model; the dependent variable ‘expenses’ goes to the left of the tilde character, while the independent variables go to the right, separated by the + sign. Using the ., will add all independent variable to the right of the tilde sign as shown below:

Histogram of expenses

By creating the histogram, the expenses range from $1122 to $63770, but most of the expense range from $0 and $15000.

Correlation Matrix for age, BMI, children, and expenses

Scatterplot Matrix Using pairs()

Scatterplot Matrix Using pairs.panels()

The below scatterplot is using pairs.panels(). This will give a better visual of the data and as you can see below above the diagonal, the scatterplots have been replaced with a correlation matrix/ On the diagonal, a histogram depicting the distribution of values for each feature is shown. Also, the scatterplots below the diagonal are now presented with additional visual information.

Correlation Ellipse

The oval-shaped object on each scatterplot is called a correlation ellipse. This shows a visual of the correlation strength. The dot at the center of the correlation ellipse indicates the point at the mean values for the x and y-axis variables. The correlation between the two variables is indicated by the shape of the ellipse is shown by the shape more stretched, the stronger the correlation. When there’s a perfect rounded oval, such as the BMI and children, this indicated a very weak correlation.

lm() function

The lm() function will return a regression model object that can be used to make predictions. Interactions between independent variables can be specified using the * operator.

Improving Model Performance

The below break down for the lm() and using summary() is showing residuals and coefficients. The residuals section provides a statistical summary for the prediction errors. Some of these errors are quite substantial. As one can see, 50 percent of the errors fall into the 1Q and 3Q values. This means that predictions were between $2850.90 over the true value and $1383.90 were under the true value.

For each of the estimated regression coefficient, the p-value provides an estimate of the probability that the true coefficient is given zero given the value of the estimate. The below model we created, has several highly significant variables, and they seem to be related to the outcomes in logical ways.

The coefficient of determination, also known as the multiple R-squared value, provides a measure of how well our model as a whole explains the values of the dependent variable. This means that the closer the value is to 1.0, the better the model explains the data. As one can see the below data, the adjusted R-squared data is 0.7509, this shows us that the 75 percent of the variation is in the dependent variable.

The next question, How can we improve model performance?

The key difference between regression modeling and other machine learning approaches is that regression typically leaves feature selection and model specification to the user.

Adding non-linear relationships

The below will add age and age2 to the lm() formula using expenses ~ age + age2 form. This will allow the model to separate the linear and non-linear impact of age on medical expenses.

Converting a numeric variable to a binary indicator

A feature called ifelse() will be used to convert a numeric variable to a binary indicator.

Putting it all together

From the above model improvements, we can view improvement in the regression formula:

1. Adding a non-linear term for age
2. Created BMI index of 30
3. Specified an interaction between BMI and smoking (expenses ~ bmi30*smoker)

As one can see from the above performance, the adjusted R-squared has improved greatly from the previous 0.75 to 0.87. This states that 87 percent of the variation of medical treatment costs. The higher-order age 2 term is statistically significant, as is the obesity indicator, bmi30. The interaction between obesity and smoking suggests a massive effect; in addition to the increased costs over $13,304 for smoking alone, obese smokers spend another $19,810 per year. This suggests that smoking exacerbates diseases associated with obesity.