EDA of Weather Data in All Years
Data Description
The weather data is downloaded from http://ipm.ucanr.edu/WEATHER/index.html, by choosing Fresno County and station Parlier, then Daily Data. We select the span from May to October in 2016, 2017 and 2018.
According to the definition in the page of data selection http://ipm.ucanr.edu/calludt.cgi/WXSTATIONDATA?MAP=&STN=PARLIER.A, and the page of definitions http://ipm.ucanr.edu/WEATHER/abtwxvars.html, the descriptions of weather variables we use are as follows:
Each weather metric in this station is for 00:00 - 23:59 on the same date.
## Variable Description
## 1 Station Database name
## 2 Date Date: year-month-day
## 3 Precip Precipitation, amount
## 4 Air.max Air temperature, maximum
## 5 Air.min Air temperature, minimum
## 6 Air.avg Average of maximum air temperature and minimum air temperature
## 7 Soil.max Soil temperature, maximum
## 8 Soil.min Soil temperature, minimum
## 9 Soil.avg Average of maximum soil temperature and minimum soil temperature
## 10 Solar Solar radiation
## 11 ETo Reference evapotranspiration
## 12 RH.max Relative humidity, maximum
## 13 RH.min Relative humidity, minimum
## Units
## 1
## 2 yyyy-mm-dd
## 3 Inches
## 4 Fahrenheit
## 5 Fahrenheit
## 6 Fahrenheit
## 7 Fahrenheit
## 8 Fahrenheit
## 9 Fahrenheit
## 10 Langleys
## 11 Inches
## 12 Percent
## 13 PercentHere are measurement details about station PARLIER.A variables:
- Air temperature: Daily max/min measured at 1.5 m (4.92 ft).
- Precipitation: Daily total measured in a 20 cm (8 in) diameter gauge.
- Soil temperature: Daily max/min measured at a 15 cm (6 in) depth.
- Solar radiation: Daily global radiation measured by Licor pyranometer at 2 m (6.5 ft).
- Evapotranspiration: Calculated from CIMIS hourly values.
- Humidity: Daily max/min relative humidity measured at 1.5 m (4.92 ft).
- Comments: Located on a clover plot, to the west of an almond orchard and to theüeast of a paved airstrip.
## Station Date Precip Air.max Air.min Air.avg Soil.max Soil.min
## 1 PARLIER.A 2016-05-01 0.00 85 52 68.5 72 64
## 2 PARLIER.A 2016-05-02 0.00 88 53 70.5 74 65
## 3 PARLIER.A 2016-05-03 0.00 86 54 70.0 73 66
## 4 PARLIER.A 2016-05-04 0.00 81 59 70.0 73 67
## 5 PARLIER.A 2016-05-05 0.15 71 55 63.0 71 67
## 6 PARLIER.A 2016-05-06 0.43 70 55 62.5 70 65
## Soil.avg Solar ETo RH.max RH.min
## 1 68.0 644 0.25 85 18
## 2 69.5 653 0.24 84 15
## 3 69.5 529 0.20 84 23
## 4 70.0 446 0.17 87 34
## 5 69.0 346 0.11 91 46
## 6 67.5 376 0.11 95 57We provide some simple EDA of the weather data from Parlier station during the sampling season.
Correlation between weather metrics
First we plot a heatmap of the correlation of the different weather metrics we have.
Weather metrics in all years
For each weather metric, we plot the weather metric over the entire growing season (black link). The red dots indicate the times at which we sampled the data. For each metric, the years are first plotted separately, and then overlaid.
PCA of weather metrics
We can also visualize how the weather at the sampled time points different holistically across the metrics by doing a PCA plot of the weather data. Each point is labeled with the format of “Timepoint.Year” (e.g. 21.1 means Day21 in Year1).
PCA based on weather data throughout the experiment in each year
## Standard deviations (1, .., p=10):
## [1] 2.516214e+00 1.277283e+00 9.160842e-01 8.532691e-01 5.473624e-01
## [6] 3.038069e-01 2.076598e-01 1.868351e-01 4.273234e-16 2.118953e-16
##
## Rotation (n x k) = (10 x 10):
## PC1 PC2 PC3 PC4 PC5
## Air.max -0.3602118 0.07001502 0.187505769 0.282303874 -0.403026574
## Air.min -0.3583470 -0.23522474 -0.106394021 -0.054052706 -0.403033213
## Air.avg -0.3812270 -0.08262316 0.047864170 0.126620186 -0.427615667
## Soil.max -0.3636307 -0.20623138 0.043476123 0.024365492 0.485961079
## Soil.min -0.3664996 -0.25548535 -0.004132933 -0.019496808 0.252122472
## Soil.avg -0.3702723 -0.23446332 0.019638002 0.002180417 0.372748453
## Solar -0.2194360 0.50391797 0.213357638 -0.560210383 0.017243564
## ETo -0.3176270 0.39758539 0.083839090 -0.310109784 0.036971181
## RH.max 0.1634921 -0.22398267 0.942715578 0.019383083 -0.001055246
## RH.min 0.1306955 -0.55496644 -0.087606384 -0.699994388 -0.227921057
## PC6 PC7 PC8 PC9 PC10
## Air.max 0.59554057 -0.109603829 0.173295903 4.373863e-01 6.424113e-03
## Air.min -0.58246196 0.251057025 -0.261277366 4.110788e-01 6.037721e-03
## Air.avg 0.02631487 0.069108690 -0.039526099 -7.996823e-01 -1.174534e-02
## Soil.max 0.30484135 0.276692632 -0.501678588 5.973233e-03 -4.066881e-01
## Soil.min -0.24944318 -0.256783135 0.658818197 6.130232e-03 -4.173774e-01
## Soil.avg 0.02444672 0.006587078 0.087320071 -1.193386e-02 8.125179e-01
## Solar 0.03560837 0.515938849 0.266081150 -4.857226e-17 6.071532e-18
## ETo -0.11669416 -0.700934554 -0.362695777 6.938894e-17 1.507041e-17
## RH.max -0.16856466 -0.034619518 -0.066332990 -4.163336e-17 1.788934e-18
## RH.min 0.32608236 -0.137626026 -0.006728202 8.326673e-17 4.830121e-17
PCA based on weather data only on sampling timepoints
## Standard deviations (1, .., p=8):
## [1] 1.9674751 1.3601913 0.9828771 0.9028032 0.5168536 0.3644272 0.2492238
## [8] 0.1891111
##
## Rotation (n x k) = (8 x 8):
## PC1 PC2 PC3 PC4 PC5 PC6
## Air.max -0.4451974 -0.01811285 -0.06522019 0.36725372 -0.48897807 -0.63366330
## Air.min -0.4180871 0.29090889 0.19763895 -0.08863993 -0.53814337 0.55834314
## Soil.max -0.4318575 0.29935603 -0.10478304 -0.01072552 0.53497533 -0.25233257
## Soil.min -0.4401725 0.32316304 0.01144926 0.01177947 0.33499565 0.21286428
## Solar -0.2411291 -0.50161765 -0.37048188 -0.43487780 -0.09848536 0.03840527
## ETo -0.3867351 -0.41228044 -0.14747090 -0.24181296 0.11863207 0.08459384
## RH.max 0.1310838 0.24922954 -0.87867529 0.27814160 -0.09513771 0.22249015
## RH.min 0.1478493 0.48711885 -0.12041530 -0.72942368 -0.20014332 -0.34584371
## PC7 PC8
## Air.max 0.07577340 0.12637978
## Air.min -0.14987892 -0.26428770
## Soil.max -0.37350366 -0.47266818
## Soil.min 0.20310583 0.70905479
## Solar -0.52503599 0.27753168
## ETo 0.68831829 -0.32438846
## RH.max 0.08852418 -0.06985036
## RH.min 0.18372901 0.02958838
