8 Raster GIS operations in R with terra
8.1 Reading in data
Ok, now to look at handling rasters. As with sf, the terra package has one function -rast()
- that can read in just about any raster file format, which it assigns it’s own class SpatRaster
. Let’s get started and read in the digital elevation model (DEM) for the City of Cape Town.
library(terra)
<- rast("data/cape_peninsula/CoCT_10m.tif")
dem
class(dem)
## [1] "SpatRaster"
## attr(,"package")
## [1] "terra"
#Typing the name of a "SpatRaster" class data object gives you the details dem
## class : SpatRaster
## dimensions : 9902, 6518, 1 (nrow, ncol, nlyr)
## resolution : 10, 10 (x, y)
## extent : -64180, 1000, -3804020, -3705000 (xmin, xmax, ymin, ymax)
## coord. ref. : GCS_WGS_1984
## source : CoCT_10m.tif
## name : 10m_BA
## min value : -35
## max value : 1590
The coord. ref.
field shows GCS_WGS_1984
, which is Geographic Coordinates, but perhaps there is a projected CRS too? from which we can deduce that the coordinate reference system is Transverse Mercator Lo19. If you just want to know the CRS from a SpatRaster, you just call crs()
like so:
crs(dem)
## [1] "PROJCRS[\"GCS_WGS_1984\",\n BASEGEOGCRS[\"WGS 84\",\n DATUM[\"World Geodetic System 1984\",\n ELLIPSOID[\"WGS 84\",6378137,298.25722356049,\n LENGTHUNIT[\"metre\",1]]],\n PRIMEM[\"Greenwich\",0,\n ANGLEUNIT[\"degree\",0.0174532925199433]],\n ID[\"EPSG\",4326]],\n CONVERSION[\"Transverse Mercator\",\n METHOD[\"Transverse Mercator\",\n ID[\"EPSG\",9807]],\n PARAMETER[\"Latitude of natural origin\",0,\n ANGLEUNIT[\"degree\",0.0174532925199433],\n ID[\"EPSG\",8801]],\n PARAMETER[\"Longitude of natural origin\",19,\n ANGLEUNIT[\"degree\",0.0174532925199433],\n ID[\"EPSG\",8802]],\n PARAMETER[\"Scale factor at natural origin\",1,\n SCALEUNIT[\"unity\",1],\n ID[\"EPSG\",8805]],\n PARAMETER[\"False easting\",0,\n LENGTHUNIT[\"metre\",1],\n ID[\"EPSG\",8806]],\n PARAMETER[\"False northing\",0,\n LENGTHUNIT[\"metre\",1],\n ID[\"EPSG\",8807]]],\n CS[Cartesian,2],\n AXIS[\"easting\",east,\n ORDER[1],\n LENGTHUNIT[\"metre\",1,\n ID[\"EPSG\",9001]]],\n AXIS[\"northing\",north,\n ORDER[2],\n LENGTHUNIT[\"metre\",1,\n ID[\"EPSG\",9001]]]]"
Similar to st_crs()
, you can define a projection using the syntax:
crs(your_raster) <- "your_crs"
, where the new CRS can be in WKT, and EPSG code, or a PROJ string.
For reprojecting, you use the function project()
. We’ll look at it later.
8.2 Cropping
Ok, before we try to anything with this dataset, let’s think about how big it is… One of the outputs of calling dem
was the row reading dimensions : 9902, 6518, 1 (nrow, ncol, nlyr)
. Given that we are talking about 10m pixels, this information tells us that the extent of the region is roughly 100km by 65km and that there are ~65 million pixels! No wonder the file is ~130MB.
While R can handle this, it does become slow when dealing with very large files. There are many ways to improve the efficiency of handling big rasters in R (see this slightly dated post for details if you’re interested), but for the purposes of this tutorial we’re going to take the easy option and just crop it to a smaller extent, like so:
<- crop(dem, ext(c(-66642.18, -44412.18, -3809853.29, -3750723.29))) dem
Note that the crop()
function requires us to pass it an object of class SpatExtent
. Just like st_crop()
from sf, crop()
can derive the extent from another data object.
One silly difference, is that if you pass it the coordinates of the extent manually (as above), you first need to pass it to the ext()
function, and they need to follow the order xmin, xmax, ymin, ymax (as opposed to xmin, ymin, xmax, ymax as you do for st_crop()
). Keep your eye out for these little differences, because they will trip you up…
Ok, so how big is our dataset now?
dem
## class : SpatRaster
## dimensions : 5330, 1977, 1 (nrow, ncol, nlyr)
## resolution : 10, 10 (x, y)
## extent : -64180, -44410, -3804020, -3750720 (xmin, xmax, ymin, ymax)
## coord. ref. : GCS_WGS_1984
## source(s) : memory
## name : 10m_BA
## min value : -15
## max value : 1084
…still >10 million pixels…
8.3 Aggregating / Resampling
Do we need 10m data? If your analysis doesn’t need such fine resolution data, you can resample the raster to a larger pixel size, like 30m. The aggregate()
function in the raster package does this very efficiently, like so:
<- aggregate(dem, fact = 3, fun = mean) dem30
##
|---------|---------|---------|---------|
=========================================
Here I’ve told it to aggregate by a factor of 3 (i.e. bin 9 neighbouring pixels (3x3) into one) and to assign the bigger pixel the mean of the 9 original pixels. This obviously results in some data loss, but that can be acceptable, depending on the purpose of your analysis. Note that you can pass just about any function to fun =
, like min()
, max()
or even your own function.
dem30
## class : SpatRaster
## dimensions : 1777, 659, 1 (nrow, ncol, nlyr)
## resolution : 30, 30 (x, y)
## extent : -64180, -44410, -3804030, -3750720 (xmin, xmax, ymin, ymax)
## coord. ref. : GCS_WGS_1984
## source(s) : memory
## name : 10m_BA
## min value : -15.000
## max value : 1083.556
Ok, so we’ve reduced the size of the raster by a factor of 9 and only have a little over 1 million pixels to deal with. Much more reasonable! Now let’s have a look at what we’re dealing with.
8.4 Basic plotting
Now that we’ve reduced the size of the dataset, we can try the base plotting function:
plot(dem30)
Or with the Tidyverse…
Note that ggplot()
doesn’t accept rasters, so we need to give it a dataframe with x and y columns for the coordinates, and a column containing the values to plot. This is easily done by coercing the raster into a dataframe, like so:
#call tidyverse libraries and plot
library(tidyverse)
%>% as.data.frame(xy = TRUE) %>%
dem30 ggplot() +
geom_raster(aes(x = x, y = y, fill = `10m_BA`))
# Note that I had to know that the column name for the elevation data is "10m_BA"... and that you need to use ` ` around a variable name when feeding it to a function if it starts with a digit.
Ok, how different does our 30m raster look to the 10m version?
%>%
dem as.data.frame(xy = TRUE) %>%
ggplot() +
geom_raster(aes(x = x, y = y, fill = `10m_BA`))
Not noticeably different at this scale!
8.5 Disaggregating
One way to explore the degree of data loss is to disagg()
our 30m DEM back to 10m and then compare it to the original.
<- disagg(dem30, fact = 3, method = "bilinear") dem10
Note that I’ve tried to use bilinear interpolation to give it a fair chance of getting nearer the original values. You can google this on your own, but it essentially smooths the data by averaging across neighbouring pixels.
Now, how can I compare my two 10m rasters?
8.6 Raster maths!
The raster and terra packages make this easy, because you can do maths with rasters, treating them as variables in an equation. This means we can explore the data loss by calculating the difference between the original and disaggregated DEMS.
Note that when aggregating you often lose some of the cells along the edges, and that you can’t do raster maths on rasters with different extents… We can fix this by cropping the larger raster with the smaller first.
<- crop(dem10, dem)
dem10
<- dem - dem10 #maths with rasters! diff
And plot the result!
%>%
diff as.data.frame(xy = TRUE) %>%
ggplot() +
geom_raster(aes(x = x, y = y, fill = `10m_BA`))
If you look really closely, you’ll see the outline of the cliffs of Table Mountain, where you’d expect the data loss to be worst. The colour ramp tells us that the worst distortion was up to 100m, or about 10% of the elevation range in this dataset, but don’t be fooled by the extremes! Let’s have a look at all the values as a histogram.
%>%
diff as.data.frame(xy = TRUE) %>%
ggplot() +
geom_histogram(aes(`10m_BA`))
## `stat_bin()` using `bins = 30`. Pick better value with `binwidth`.
Looks like most values are within 10 or so metres of their original values, so the data loss really wasn’t that bad!
8.7 Focal and terrain calculations
In addition to maths with multiple rasters, you can do all kinds of calculations within a raster using focal()
. This essentially applies a moving window, calculating values for a neighbourhood of cells as it goes, using whatever function you supply (mean, max, your own, etc).
The function terrain()
is a special case of focal()
, optimized for calculating slope, aspect, topographic position index (TPI), topographic roughness index (TRI), roughness, or flow direction.
Here I’ll calculate the slope and aspect so that we can pass them to the function shade()
to make a pretty hillshade layer.
<- terrain(dem30, "aspect", unit = "radians")
aspect
<- terrain(dem30, "slope", unit = "radians")
slope
<- shade(slope, aspect)
hillshade
plot(hillshade)
Probably prettier with Tidyverse:
%>%
hillshade as.data.frame(xy = TRUE) %>%
ggplot() +
geom_raster(aes(x = x, y = y, fill = hillshade)) + #note that the hillshade column name in this case is "hillshade"
scale_fill_gradient(low = "grey10", high = "grey90")
Nice ne?
8.8 Raster stacks
Another nice thing about rasters is that if you have multiple rasters “on the same grid” (i.e. with the same pixel size, extent and CRS) then you can stack them and work with them as a single object. library(raster)
users will be familiar with stack()
, but in terra you just use the base function c()
, like so:
<- c(dem30, slope, aspect, hillshade)
dstack
dstack
## class : SpatRaster
## dimensions : 1777, 659, 4 (nrow, ncol, nlyr)
## resolution : 30, 30 (x, y)
## extent : -64180, -44410, -3804030, -3750720 (xmin, xmax, ymin, ymax)
## coord. ref. : GCS_WGS_1984
## source(s) : memory
## names : 10m_BA, slope, aspect, hillshade
## min values : -15.000, 0.000000, 0.000000, -0.4906481
## max values : 1083.556, 1.370826, 6.283185, 0.9999974
As you can see the “dimensions” now report 4 layers, and there are 4 names. Some of the names don’t look all that informative though, so let’s rename them.
names(dstack) <- c("elevation", "slope", "aspect", "shade")
8.9 Extracting raster to vector
Ok, enough fooling around. More often than not, we just want to extract data from rasters for further analyses (e.g. climate layers, etc), so let’s cover that base here.
Extract to points
First, let’s get some points for two species in the Proteaceae, Protea cynaroides and Leucadendron laureolum…
library(rinat)
library(sf)
#Call data for two species directly from iNat
<- get_inat_obs(taxon_name = "Protea cynaroides",
pc bounds = c(-35, 18, -33.5, 18.5),
maxresults = 1000)
<- get_inat_obs(taxon_name = "Leucadendron laureolum",
ll bounds = c(-35, 18, -33.5, 18.5),
maxresults = 1000)
#Combine the records into one dataframe
<- rbind(pc,ll)
pc
#Filter returned observations by a range of attribute criteria
<- pc %>% filter(positional_accuracy<46 &
pc <0 &
latitude!is.na(latitude) &
== "false" &
captive_cultivated == "research")
quality_grade
#Make the dataframe a spatial object of class = "sf"
<- st_as_sf(pc, coords = c("longitude", "latitude"), crs = 4326)
pc
#Set to the same projection as the elevation data
<- st_transform(pc, crs(dem30)) pc
Now let’s extract the data to the points.
NOTE!!! terra doesn’t play nicely with sf objects at this stage, so you need to coerce them into terra’s own vector format using vect()
.
<- extract(dem30, vect(pc)) # note vect()
dat
head(dat)
## ID 10m_BA
## 1 1 867.0000
## 2 2 612.0000
## 3 3 810.3333
## 4 4 876.2222
## 5 5 573.2222
## 6 6 749.3333
Nice, but not all that handy on it’s own. Let’s add the elevation column to our points layer, so we can match it with the species names and plot.
$dem <- dat$`10m_BA`
pc
%>% ggplot() +
pc geom_boxplot(aes(scientific_name, dem))
(Hmm… do you think those Leucadendron laureolum outliers that must be near Maclear’s Beacon could actually be Leucadendron strobilinum?)
Ok, that’s handy, but what if we have data lots of rasters? We don’t want to have to do that for every raster! This is where raster stacks come into their own!
#extract from stack
<- extract(dstack, vect(pc))
dat
#bind columns to points to match the names
<- cbind(as.data.frame(pc), dat)
edat
#select columns we want and tidy data into long format
<- edat %>%
edat ::select(scientific_name, elevation, slope, aspect, shade) %>%
dplyrpivot_longer(c(elevation, slope, aspect, shade))
#panel boxplot of the variables extracted
%>% ggplot() +
edat geom_boxplot(aes(scientific_name, value)) +
facet_wrap(~name, scales = "free")
Something I should have mentioned is that if you would like each point to sample a larger region you can add a buffer =
argument to the extract()
function, and a function (fun =
) to summarize the neighbourhood of pixels sampled, like so:
$dem30 <- extract(dem30, vect(pc), buffer = 200, fun = mean)$X10m_BA #Note the sneaky use of $ to access the column I want
pc
%>% ggplot() +
pc geom_boxplot(aes(scientific_name, dem30))
Extract to polygons
Now let’s try that with our vegetation polygons.
#Get historical vegetation layer
<- st_read("data/cape_peninsula/veg/Vegetation_Indigenous.shp") veg
## Reading layer `Vegetation_Indigenous' from data source
## `/Users/jasper/GIT/spatial-r/data/cape_peninsula/veg/Vegetation_Indigenous.shp'
## using driver `ESRI Shapefile'
## Simple feature collection with 1325 features and 5 fields
## Geometry type: POLYGON
## Dimension: XY
## Bounding box: xmin: -63972.95 ymin: -3803535 xmax: 430.8125 ymax: -3705149
## Projected CRS: WGS_1984_Transverse_Mercator
#Crop to same extent as DEM
<- st_crop(veg, ext(dem30)) #Note that I just fed it the extent of the DEM
veg
#Best to dissolve polygons first - otherwise you get repeat outputs for each polygon within each veg type
<- veg %>% group_by(National_) %>%
vegsum summarize()
#Do extraction - note the summary function
<- extract(dem30, vect(vegsum), fun = mean, na.rm = T)
vegdem
#Combine the names and vector extracted means into a dataframe
<- cbind(vegdem, vegsum$National_)
vegdem
#Rename the columns to something meaningful
names(vegdem) <- c("ID", "Mean elevation (m)", "Vegetation type")
#Plot
%>% ggplot() +
vegdem geom_col(aes(y = `Mean elevation (m)`, x = `Vegetation type`)) +
theme(axis.text.x = element_text(angle = 90, vjust = 0.5, hjust=1))
Ok, I did a lot of things there…, but you get it right? Note that I applied a function to the extract()
to summarize the output, because each polygon usually returns multiple raster cell values. You can choose (or code up) your own function.
Here’s a different approach…
8.10 Rasterizing
Rasterizing essentially means turning a vector layer into a raster. To rasterize, you need an existing raster grid to rasterize to, like dem30
in this case.
#Make the vegetation type a factor
$National_ <- as.factor(vegsum$National_)
vegsum
#Rasterize
<- rasterize(vect(vegsum), dem30, field = "National_")
vegras
#Plot
%>%
vegras as.data.frame(xy = TRUE) %>%
ggplot() +
geom_raster(aes(x = x, y = y, fill = National_))
I’m sure this plot is a surprise to those who worked with raster. Usually rasters want to work with numbers. terra can work with (and rasterize) data of class “factor”, opening up all kinds of opportunities.
8.11 Visualizing multiple datasets on one map
What about if we want to plot multiple datasets on one map?
This is easy, if you can feed each dataset into a separate ggplot function. Here’s the veg types with contours and the iNaturalist records we retrieved earlier.
ggplot() +
geom_raster(data = as.data.frame(vegras, xy = TRUE),
aes(x = x, y = y, fill = National_)) +
geom_contour(data = as.data.frame(dem30, xy = TRUE),
aes(x = x, y = y, z = `10m_BA`), breaks = seq(0, 1100, 100), colour = "black") +
geom_sf(data=pc, colour = "white", size = 0.5)
For more inspiration on mapping with R, check out https://slingsby-maps.myshopify.com/. I’ve been generating the majority of the basemap (terrain colour, hillshade, contours, streams, etc) for these in R for the past few years.
8.12 Cloud Optimized GeoTiffs (COGs)!!!
I thought I’d add this as a bonus section, reinforcing the value of standardized open metadata and file formats from the Data Management module.
First, let’s open a connection to our COG, which is stored in the cloud. To do this, we need to pass a URL to the file’s online location to terra.
<- "/vsicurl/https://storage.googleapis.com/grootbos-tiff/grootbos_cog.tif"
cog.url
<- rast(cog.url)
grootbos
grootbos
## class : SpatRaster
## dimensions : 100024, 121627, 3 (nrow, ncol, nlyr)
## resolution : 0.08, 0.08 (x, y)
## extent : 35640.41, 45370.57, -3828176, -3820175 (xmin, xmax, ymin, ymax)
## coord. ref. : LO19
## source : grootbos_cog.tif
## colors RGB : 1, 2, 3
## names : grootbos_cog_1, grootbos_cog_2, grootbos_cog_3
This has given us the metadata about the file, but has not read it into R’s memory. The file is ~1.8GB so it would do bad things if we tried to read the whole thing in…
Now let’s retrieve a subset of the file. To do this we need to make a vector polygon for our region of interest, like so:
<- vect(data.frame(lon = c(19.433975, 19.436451),
roi lat = c(-34.522733, -34.520735)),
crs = "epsg:4326")
And transform it to the same projection as the COG:
<- project(roi, crs(grootbos)) roi
And then extract our ROI
<- crop(grootbos, roi)
roi_ras
roi_ras
## class : SpatRaster
## dimensions : 2758, 2853, 3 (nrow, ncol, nlyr)
## resolution : 0.08, 0.08 (x, y)
## extent : 39845.61, 40073.85, -3821732, -3821512 (xmin, xmax, ymin, ymax)
## coord. ref. : LO19
## source(s) : memory
## colors RGB : 1, 2, 3
## names : grootbos_cog_1, grootbos_cog_2, grootbos_cog_3
## min values : 28, 47, 56
## max values : 255, 255, 255
Now we have a raster with 3 layers in memory. There are Red Green and Blue, so we should be able to plot them, like so:
plotRGB(roi_ras)
This somewhat arbitrary looking site is where we did some fieldwork with the 2022 class…