Lab 05 - La Quinta is Spanish for next to Denny’s, Pt. 2
Wrangling spatial data
In this lab we revisit the Denny’s and La Quinta Inn and Suites data we visualized in the previous lab.
Learning goals
- Working with spatial data
- Writing and using a custom function
Getting started
Go to the course GitHub organization and locate your homework repo, clone it in RStudio and open the R Markdown document. Knit the document to make sure it compiles without errors.
Warm up
Before we introduce the data, let’s warm up with some simple exercises. Update the YAML of your R Markdown file with your information, knit, commit, and push your changes. Make sure to commit with a meaningful commit message. Then, go to your repo on GitHub and confirm that your changes are visible in your Rmd and md files. If anything is missing, commit and push again.
Packages
We’ll use the tidyverse package for much of the data wrangling and visualisation and the data lives in the dsbox package. These packages are already installed for you. You can load them by running the following in your Console:
library(tidyverse)
library(dsbox)
Data
Remember that the datasets we’ll use are called dennys
and laquinta
from the dsbox package. Since the datasets are distributed with the package, we don’t need to load them separately; they become available to us when we load the package. You can find out more about the datasets by inspecting their documentation, which you can access by running ?dennys
and ?laquinta
in the Console or using the Help menu in RStudio to search for dennys
or laquinta
. You can also find this information here and here.
Exercises
- Filter the Denny’s dataframe for Alaska (AK) and save the result as
dn_ak
. How many Denny’s locations are there in Alaska?
<- dennys %>%
dn_ak filter(state == "AK")
nrow(dn_ak)
[1] 3
- Filter the La Quinta dataframe for Alaska (AK) and save the result as
lq_ak
. How many La Quinta locations are there in Alaska?
<- laquinta %>%
lq_ak filter(state == "AK")
nrow(lq_ak)
[1] 2
Next we’ll calculate the distance between all Denny’s and all La Quinta locations in Alaska. Let’s take this step by step:
Step 1: There are 3 Denny’s and 2 La Quinta locations in Alaska. (If you answered differently above, you might want to recheck your answers.)
Step 2: Let’s focus on the first Denny’s location. We’ll need to calculate two distances for it: (1) distance between Denny’s 1 and La Quinta 1 and (2) distance between Denny’s 1 and La Quinta (2).
Step 3: Now let’s consider all Denny’s locations.
- How many pairings are there between all Denny’s and all La Quinta locations in Alaska, i.e. how many distances do we need to calculate between the locations of these establishments in Alaska?
In order to calculate these distances we need to first restructure our data to pair the Denny’s and La Quinta locations. To do so, we will join the two data frames. We have six join options in R. Each of these join functions take at least three arguments: x
, y
, and by
.
x
andy
are data frames to joinby
is the variable(s) to join by
Four of these join functions combine variables from the two data frames:
These are called **mutating joins**.
inner_join()
: return all rows fromx
where there are matching values iny
, and all columns fromx
andy
.left_join()
: return all rows fromx
, and all columns fromx
andy
. Rows in x with no match in y will have NA values in the new columns.right_join()
: return all rows fromy
, and all columns fromx
andy
. Rows in y with no match in x will have NA values in the new columns.full_join()
: return all rows and all columns from bothx
andy
. Where there are not matching values, returns NA for the one missing.
And the other two join functions only keep cases from the left-hand data frame, and are called filtering joins. We’ll learn about these another time but you can find out more about the join functions in the help files for any one of them, e.g. ?full_join
.
In practice we mostly use mutating joins. In this case we want to keep all rows and columns from both dn_ak
and lq_ak
data frames. So we will use a full_join
.
Let’s join the data on Denny’s and La Quinta locations in Alaska, and take a look at what it looks like:
<- full_join(dn_ak, lq_ak, by = "state") dn_lq_ak
Warning in full_join(dn_ak, lq_ak, by = "state"): Detected an unexpected many-to-many relationship between `x` and `y`.
ℹ Row 1 of `x` matches multiple rows in `y`.
ℹ Row 1 of `y` matches multiple rows in `x`.
ℹ If a many-to-many relationship is expected, set `relationship =
"many-to-many"` to silence this warning.
dn_lq_ak
# A tibble: 6 × 11
address.x city.x state zip.x longitude.x latitude.x address.y city.y zip.y
<chr> <chr> <chr> <chr> <dbl> <dbl> <chr> <chr> <chr>
1 2900 Denali Ancho… AK 99503 -150. 61.2 3501 Min… "\nAn… 99503
2 2900 Denali Ancho… AK 99503 -150. 61.2 4920 Dal… "\nFa… 99709
3 3850 Debarr … Ancho… AK 99508 -150. 61.2 3501 Min… "\nAn… 99503
4 3850 Debarr … Ancho… AK 99508 -150. 61.2 4920 Dal… "\nFa… 99709
5 1929 Airport… Fairb… AK 99701 -148. 64.8 3501 Min… "\nAn… 99503
6 1929 Airport… Fairb… AK 99701 -148. 64.8 4920 Dal… "\nFa… 99709
# ℹ 2 more variables: longitude.y <dbl>, latitude.y <dbl>
- How many observations are in the joined
dn_lq_ak
data frame? What are the names of the variables in this data frame.
.x
in the variable names means the variable comes from the x
data frame (the first argument in the full_join
call, i.e. dn_ak
), and .y
means the variable comes from the y
data frame. These varibles are renamed to include .x
and .y
because the two data frames have the same variables and it’s not possible to have two variables in a data frame with the exact same name.
Now that we have the data in the format we wanted, all that is left is to calculate the distances between the pairs.
🧶 ✅ ⬆️ Knit, commit, and push your changes to GitHub with an appropriate commit message. Make sure to commit and push all changed files so that your Git pane is cleared up afterwards.
- What function from the tidyverse do we use the add a new variable to a data frame while keeping the existing variables?
One way of calculating the distance between any two points on the earth is to use the Haversine distance formula. This formula takes into account the fact that the earth is not flat, but instead spherical.
This function is not available in R, but we have it saved in a file called haversine.R
that we can load and then use:
<- function(long1, lat1, long2, lat2, round = 3) {
haversine # convert to radians
= long1 * pi / 180
long1 = lat1 * pi / 180
lat1 = long2 * pi / 180
long2 = lat2 * pi / 180
lat2
= 6371 # Earth mean radius in km
R
= sin((lat2 - lat1)/2)^2 + cos(lat1) * cos(lat2) * sin((long2 - long1)/2)^2
a = R * 2 * asin(sqrt(a))
d
return( round(d,round) ) # distance in km
}
This function takes five arguments:
- Longitude and latitude of the first location
- Longitude and latitude of the second location
- A parameter by which to round the responses
Calculate the distances between all pairs of Denny’s and La Quinta locations and save this variable as
distance
. Make sure to save this variable in THEdn_lq_ak
data frame so that you can use it later.Calculate the minimum distance between a Denny’s and La Quinta for each Denny’s location. To do so we group by Denny’s locations and calculate a new variable that stores the information for the minimum distance.
<- dn_lq_ak %>%
dn_lq_ak_mindist group_by(address.x) %>%
summarise(closest = min(distance))
- Describe the distribution of the distances Denny’s and the nearest La Quinta locations in Alaska. Also include an appripriate visualization and relevant summary statistics.
🧶 ✅ ⬆️ Knit, commit, and push your changes to GitHub with an appropriate commit message. Make sure to commit and push all changed files so that your Git pane is cleared up afterwards.
Repeat the same analysis for North Carolina: (i) filter Denny’s and La Quinta Data Frames for NC, (ii) join these data frames to get a completelist of all possible pairings, (iii) calculate the distances between all possible pairings of Denny’s and La Quinta in NC, (iv) find the minimum distance between each Denny’s and La Quinta location, (v) visualize and describe the distribution of these shortest distances using appropriate summary statistics.
Repeat the same analysis for Texas.
Repeat the same analysis for a state of your choosing, different than the ones we covered so far.
Among the states you examined, where is Mitch Hedberg’s joke most likely to hold true? Explain your reasoning.
🧶 ✅ ⬆️ Knit, commit, and push your changes to GitHub with an appropriate commit message. Make sure to commit and push all changed files so that your Git pane is cleared up afterwards and review the md document on GitHub to make sure you’re happy with the final state of your work.