Introduction

This document will reanalyze the program metrics in research and instruction to determine the robustness of the conclusions drawn on the basis of those metrics. The research metrics, with definitions, are as follows:

  1. sri: Academic Analytics SRI score when comparing units to Public AAU Institutions. If a unit has multiple SRI scores available, they were averaged.

  2. total_sponsored_awards_inc_nuf_rsch_pub_serv_teach_avg_awards_budget: Average sponsored awards for FY20-24. Included are all sponsor types: federal, industry, state agencies, associations/nonprofits and the NU Foundation, for purpose codes research, teaching and public service divided by total state appropriated budget.

  3. research_awards_growth_inc_nuf_fy20_fy24: Growth of sponsored research awards from FY20 to FY24. Included are all sponsor types: federal, industry, state agencies, associations/nonprofits and the NU Foundation. This was calculated by taking the dollar growth over the time period of FY24 – FY20 as a percentage of total growth for the institution resulting in that unit’s share of the overall growth dollars for the institution over the reported time period.

  4. p1_expenditures_normalized: The average competitively funded federal research support as defined by the AAU membership policy, federal research expenditures less USDA research expenditures adding in awards from USDA Agriculture Food and Research Initiative (AFRI). Expenditures and AFRI awards are credited to departments using NuRamp routing forms. For PI/co-PIs who routed their credit through a unit outside a department, efforts were made to credit a department using the individual’s HR tenure org unit, primary org unit and any secondary appointments. This is normalized by the average of the full-time employees with faculty status who are on the tenure track or tenured as reported to the National Center for Education Statistics IPEDS Data Center.

  5. awards_normalized: NCR highly prestigious awards, including national academy memberships in engineering, medicine and science. The data source AAU uses for highly prestigious awards is Academic Analytics (AcA) and only awards for T/TT faculty in benchmarked AcA units is reported to the AAU. This is normalized by the average of the full-time employees with faculty status who are on the tenure track or tenured as reported to the National Center for Education Statistics IPEDS Data Center. This is normalized by the average of the full-time employees with faculty status who are on the tenure track or tenured as reported to the National Center for Education Statistics IPEDS Data Center.

  6. books_normalized: The total number of books published over the time period 2014-2023. The data source AAU uses for highly prestigious awards is Academic Analytics (AcA) and only books published for T/TT faculty in benchmarked AcA units are reported to the AAU. This is normalized by the average of the full-time employees with faculty status who are on the tenure track or tenured as reported to the National Center for Education Statistics IPEDS Data Center.

  7. citations_normalized: The total number of books published over the time period 2014-2023. The data source AAU uses for highly prestigious awards is Academic Analytics (AcA) and only books published for T/TT faculty in benchmarked AcA units are reported to the AAU. This is normalized by the average of the full-time employees with faculty status who are on the tenure track or tenured as reported to the National Center for Education Statistics IPEDS Data Center.

The teaching metrics, with definitions, are:

  1. instructional_sch_4Y_share_growth: Change in share (percentage) of total instructional SCH from AY2020 to AY2024.

  2. all_majors_share_growth: Change in share (percentage) of total (duplicated) majors from AY2020 to AY2024. Majors is the sum of undergraduate, graduate, and professional students.

  3. instructional_sch_2024: Sum of SCH attributed to instructors’ home departments in 2024.

  4. total_majors_n_2024: Total number of majors in 2024.

  5. instructional_sch_to_instructional_fte_2024: Instructional SCH divided by apportioned teaching FTE.

  6. budget_to_sch_2024: Total original state aided budget divided by SCH.

  7. total_realizable_base_tuition_less_budget_2024: This is estimated by total_realizable_base_tuition less original state-aided budget, apportioned for percent_teaching. total_realizable_base_tuition is calculated by taking the base tuition rate for undergraduate, graduate, and professional courses for residents and non-residents (6 tuition rate) and multiplying that rate by the number of SCH generated at each rate. This is the total tuition dollars minus the instruction budget.

  8. avg_retention_rate_2024: Average of first-year to second-year retention rates of last 5 cohorts. Note that average retention rates for units with average starting cohorts less than 5 were nullified.

  9. ratio_completions_majors_2024: Ratio of all degree completions (all majors attached to a degree) to all majors, including non-primary, in 2024.

Given these metrics for each academic program, we can calculate Z-scores for each metric, either across the entire university, or by pooling similar programs, and then average the Z-scores to get an average Z-score for research and an average for teaching.

Research Metrics

Although pools were created, the metrics calculated across the entire university were the ones that were used to guide decision-making, so it makes sense to start there. Here is the raw data for research metrics for each unit.

name pool sri total_sponsored_awards_inc_nuf_rsch_pub_serv_teach_avg_awards_budget research_awards_growth_inc_nuf_fy20_fy24 p1_expenditures_normalized awards_normalized books_normalized citations_normalized
ALEC Agriculture 0.300 1.857 47308.81 18806.534 0.000 0.112 9.287
Agricultural Economics Agriculture -0.400 0.857 378258.71 21382.544 0.000 0.048 13.700
Agronomy and Horticulture Agriculture -0.050 1.358 -457256.10 102704.887 0.000 0.098 84.482
Animal Science Agriculture -0.400 0.704 6508702.23 37935.398 0.027 0.108 24.391
Biochemistry Agriculture -0.200 1.724 2690083.36 267494.407 0.000 0.048 91.089
Biological Systems Engineering Agriculture -0.500 1.594 5507774.27 105640.430 0.000 0.032 49.090
Entomology Agriculture -0.700 0.691 -995753.79 38948.875 0.000 0.060 41.018
Food Science and Technology Agriculture 0.100 0.755 1374818.36 62032.891 0.000 0.081 166.848
Plant Pathology Agriculture -0.400 0.607 279876.05 92264.159 0.154 0.077 70.033
School of Natural Resources Agriculture -0.200 1.273 4026357.44 114637.956 0.027 0.385 95.616
Veterinary Medicine Agriculture -0.100 0.223 2421015.28 100838.897 0.000 0.159 46.955
Nebraska Coop Agriculture NA 0.000 0.00 0.000 0.000 0.000 0.000
Architecture Architecture -0.200 0.142 89564.00 262.556 0.000 0.546 10.239
Community & Regional Planning Architecture 0.300 1.226 1099616.25 21759.020 0.000 0.000 61.041
Interior Design Architecture -0.550 0.011 0.00 0.000 0.000 0.000 0.404
Landscape Architecture Architecture -0.400 0.060 10300.00 0.000 0.000 0.156 0.266
Raikes School Business NA 0.022 0.00 0.000 0.000 0.000 0.000
College of Law Business and Law NA 0.327 1797348.12 460.924 0.000 0.000 0.000
Finance Business and Law -0.500 0.057 -20192.00 0.000 0.000 0.117 9.073
Management Business and Law -0.100 0.051 34518.00 1571.024 0.000 0.000 26.449
Marketing Business and Law -0.400 0.017 0.00 476.042 0.000 0.000 14.103
Accountancy Business and Law -0.100 0.052 -45000.00 0.000 0.000 0.221 21.743
Supply Chain Management & Analytics Business and Law -0.100 0.064 42658.00 4167.455 0.000 2.717 44.065
Journalism Communications -0.300 0.594 29182.00 0.000 0.000 0.263 5.513
Advertising Communications -0.300 0.000 0.00 20.654 0.000 0.215 4.591
Broadcasting Communications -0.600 0.000 0.00 0.000 0.000 0.185 0.056
Communication Studies Communications 0.400 0.037 30806.50 0.000 0.000 1.015 19.349
Sports Communication Communications NA 0.000 0.00 0.000 0.000 0.000 4.500
Educational Administration Education -0.100 0.061 4079.00 9687.999 0.000 0.392 9.882
Educational Psychology Education -0.300 0.847 -555019.09 97012.054 0.000 0.965 42.445
Special Education Education -0.450 3.649 -3900591.35 104350.918 0.000 0.237 26.734
TLTE Education -0.300 0.343 -214828.20 14080.921 0.000 0.573 8.472
TMFD Education -0.500 0.134 -380357.50 8749.036 0.000 0.385 48.269
CYFS Education -0.400 0.579 11523.81 16824.712 0.000 0.107 29.322
Nutrition & Health Sciences Education -0.700 1.978 -4301601.35 125368.303 0.158 0.105 86.738
Chemical Engineering Engineering -0.900 0.720 338416.05 53492.083 0.000 0.414 58.434
Architectural Engineering Engineering 1.100 0.593 -419240.54 28259.986 0.000 0.077 30.768
Electrical & Computer Engineering Engineering -0.600 0.707 -761185.89 153424.384 0.000 0.511 114.502
School of Computing Engineering -0.100 0.703 3488240.88 146473.717 0.000 0.379 77.120
Mechanical & Materials Engineering Engineering -0.400 1.312 -1137628.46 156900.453 0.000 0.213 116.037
Civil and Environmental Engineering Engineering -0.300 2.226 4608974.20 221849.932 0.000 0.720 65.513
Music Fine Arts -0.300 0.093 0.00 172.394 0.000 0.313 0.117
Theatre & Film Fine Arts -0.767 0.312 0.00 571.673 0.000 0.000 1.297
Art Art History & Design Fine Arts -0.500 0.095 68704.85 1506.418 0.000 0.240 0.106
Classics & Religious Studies Humanities -0.250 0.034 -30081.00 0.000 0.134 0.806 0.142
English Humanities 0.000 0.151 126906.50 9752.522 0.311 1.809 0.393
History Humanities -0.100 0.383 110819.00 5726.073 0.439 1.593 0.293
Modern Languages & Literatures Humanities 0.000 0.080 170458.00 0.000 0.000 2.205 0.869
Philosophy Humanities -0.500 0.027 -70943.00 0.000 0.000 0.631 2.018
Chemistry Sciences -0.700 1.574 -1420286.44 231961.071 0.000 0.630 100.292
Earth and Atmospheric Sciences Sciences -0.900 0.811 395383.02 96055.087 0.000 0.068 27.878
Mathematics Sciences -0.300 0.444 -1005567.55 49424.916 0.000 0.246 9.756
Physics & Astronomy Sciences -0.300 2.437 10397285.85 455321.549 0.000 0.342 303.033
Biological Sciences Sciences -0.200 1.019 -1338229.41 158481.884 0.000 0.117 67.142
CSMCE Sciences NA 0.000 0.00 0.000 0.000 0.000 0.000
Statistics Sciences -0.100 0.362 -455843.15 74518.631 0.000 0.109 34.019
Economics Social Sciences -0.400 0.226 487500.19 6971.771 0.000 0.073 8.956
Ethnic Studies Social Sciences NA 0.036 0.00 3947.454 0.097 1.001 5.535
Political Science Social Sciences -0.300 0.141 609878.00 2682.387 0.000 2.167 12.666
Psychology Social Sciences -0.600 2.176 1726882.72 126452.755 0.000 0.376 54.230
Sociology Social Sciences 0.100 0.921 -1949052.67 127594.561 0.000 0.273 16.237
Womens & Gender Studies Social Sciences NA 0.114 -53451.80 4863.730 0.000 0.687 34.618
SGIS Social Sciences -0.300 0.171 -22847.57 12167.183 0.393 0.497 11.596
Because these metrics are measured on very different scales, they cannot easily be combined in a single synthetic measure of research productivity. That is why we calculate Z-scores, which normalize the data in each column by subtracting the mean of the column and dividing by the standard deviation of the column. This puts every metric on the same scale - they all have a mean equal to zero and a standard deviation equal to one. Thus a unit with a positive value for a metric is doing better than the average unit in that metric. Here are the Z-scores for each unit, across each metric.
name pool Z_sri Z_total_sponsored_awards_inc_nuf_rsch_pub_serv_teach_avg_awards_budget Z_research_awards_growth_inc_nuf_fy20_fy24 Z_p1_expenditures_normalized Z_awards_normalized Z_books_normalized Z_citations_normalized
ALEC Agriculture 1.7421079 1.6218685 -0.1948818 -0.4382573 -0.3160963 -0.5211908 -0.5512885
Agricultural Economics Agriculture -0.3548194 0.2988200 -0.0409580 -0.4074841 -0.3160963 -0.6326849 -0.4629109
Agronomy and Horticulture Agriculture 0.6936443 0.9616673 -0.4295536 0.5639975 -0.3160963 -0.5455801 0.9546144
Animal Science Agriculture -0.3548194 0.0963935 2.8102941 -0.2097427 -0.0070849 -0.5281592 -0.2488062
Biochemistry Agriculture 0.2443027 1.4459030 1.0342652 2.5325831 -0.3160963 -0.6326849 1.0869304
Biological Systems Engineering Agriculture -0.6543804 1.2739067 2.3447653 0.5990657 -0.3160963 -0.6605584 0.2458317
Entomology Agriculture -1.2535025 0.0791939 -0.6800073 -0.1976356 -0.3160963 -0.6117798 0.0841767
Food Science and Technology Agriculture 1.1429859 0.1638690 0.4225391 0.0781274 -0.3160963 -0.5751957 2.6041283
Plant Pathology Agriculture -0.3548194 -0.0319422 -0.0867155 0.4392720 1.4464130 -0.5821641 0.6652496
School of Natural Resources Agriculture 0.2443027 0.8492081 1.6557625 0.7065507 -0.0070849 -0.0455987 1.1775910
Veterinary Medicine Agriculture 0.5438638 -0.5399928 0.9091224 0.5417063 -0.3160963 -0.4393123 0.2030749
Nebraska Coop Agriculture NA -0.8350326 -0.2168850 -0.6629213 -0.3160963 -0.7163055 -0.7372758
Architecture Architecture 0.2443027 -0.6471597 -0.1752291 -0.6597848 -0.3160963 0.2348787 -0.5322231
Community & Regional Planning Architecture 1.7421079 0.7870249 0.2945434 -0.4029867 -0.3160963 -0.7163055 0.4851700
Interior Design Architecture -0.8041609 -0.8204791 -0.2168850 -0.6629213 -0.3160963 -0.7163055 -0.7291851
Landscape Architecture Architecture -0.3548194 -0.7556497 -0.2120945 -0.6629213 -0.3160963 -0.4445386 -0.7319487
Raikes School Business NA -0.8059256 -0.2168850 -0.6629213 -0.3160963 -0.7163055 -0.7372758
College of Law Business and Law NA -0.4023958 0.6190565 -0.6574150 -0.3160963 -0.7163055 -0.7372758
Finance Business and Law -0.6543804 -0.7596189 -0.2262763 -0.6629213 -0.3160963 -0.5124803 -0.5555742
Management Business and Law 0.5438638 -0.7675572 -0.2008308 -0.6441537 -0.3160963 -0.7163055 -0.2075913
Marketing Business and Law -0.3548194 -0.8125408 -0.2168850 -0.6572344 -0.3160963 -0.7163055 -0.4548402
Accountancy Business and Law 0.5438638 -0.7662341 -0.2378144 -0.6629213 -0.3160963 -0.3313024 -0.3018367
Supply Chain Management & Analytics Business and Law 0.5438638 -0.7503575 -0.1970449 -0.6131366 -0.3160963 4.0169685 0.1451979
Journalism Communications -0.0552583 -0.0491418 -0.2033126 -0.6629213 -0.3160963 -0.2581343 -0.6268690
Advertising Communications -0.0552583 -0.8350326 -0.2168850 -0.6626745 -0.3160963 -0.3417549 -0.6453335
Broadcasting Communications -0.9539414 -0.8350326 -0.2168850 -0.6629213 -0.3160963 -0.3940178 -0.7361543
Communication Studies Communications 2.0416690 -0.7860798 -0.2025570 -0.6629213 -0.3160963 1.0519216 -0.3497805
Sports Communication Communications NA -0.8350326 -0.2168850 -0.6629213 -0.3160963 -0.7163055 -0.6471560
Educational Administration Education 0.5438638 -0.7543267 -0.2149879 -0.5471878 -0.3160963 -0.0334040 -0.5393726
Educational Psychology Education -0.0552583 0.2855895 -0.4750228 0.4959906 -0.3160963 0.9648168 0.1127547
Special Education Education -0.5045999 3.9927714 -2.0310391 0.5836611 -0.3160963 -0.3034288 -0.2018837
TLTE Education -0.0552583 -0.3812270 -0.3168010 -0.4947097 -0.3160963 0.2819153 -0.5676102
TMFD Education -0.6543804 -0.6577441 -0.3937882 -0.5584048 -0.3160963 -0.0455987 0.2293899
CYFS Education -0.3548194 -0.0689875 -0.2115253 -0.4619322 -0.3160963 -0.5299013 -0.1500548
Nutrition & Health Sciences Education -1.2535025 1.7819574 -2.2175477 0.8347361 1.4921924 -0.5333855 0.9997945
Chemical Engineering Engineering -1.8526246 0.1175623 -0.0594887 -0.0239016 -0.3160963 0.0049221 0.4329606
Architectural Engineering Engineering 4.1385963 -0.0504649 -0.4118726 -0.3253258 -0.3160963 -0.5821641 -0.1210963
Electrical & Computer Engineering Engineering -0.9539414 0.1003627 -0.5709104 1.1698957 -0.3160963 0.1739054 1.5558140
School of Computing Engineering 0.5438638 0.0950705 1.4054860 1.0868626 -0.3160963 -0.0560512 0.8071783
Mechanical & Materials Engineering Engineering -0.3548194 0.9008070 -0.7459928 1.2114211 -0.3160963 -0.3452391 1.5865549
Civil and Environmental Engineering Engineering -0.0552583 2.1100734 1.9267359 1.9873115 -0.3160963 0.5380034 0.5747292
Music Fine Arts -0.0552583 -0.7119891 -0.2168850 -0.6608618 -0.3160963 -0.1710296 -0.7349327
Theatre & Film Fine Arts -1.4542084 -0.4222415 -0.2168850 -0.6560920 -0.3160963 -0.7163055 -0.7113013
Art Art History & Design Fine Arts -0.6543804 -0.7093430 -0.1849306 -0.6449255 -0.3160963 -0.2982025 -0.7351530
Classics & Religious Studies Humanities 0.0945222 -0.7900490 -0.2308756 -0.6629213 1.2175157 0.6878236 -0.7344320
English Humanities 0.8434248 -0.6352523 -0.1578612 -0.5464170 3.2432568 2.4351456 -0.7294054
History Humanities 0.5438638 -0.3283050 -0.1653434 -0.5945172 4.7081996 2.0588529 -0.7314080
Modern Languages & Literatures Humanities 0.8434248 -0.7291887 -0.1376055 -0.6629213 -0.3160963 3.1250155 -0.7198727
Philosophy Humanities -0.6543804 -0.7993103 -0.2498804 -0.6629213 -0.3160963 0.3829569 -0.6968621
Chemistry Sciences -1.2535025 1.2474458 -0.8774563 2.1080998 -0.3160963 0.3812148 1.2712355
Earth and Atmospheric Sciences Sciences -1.8526246 0.2379597 -0.0329935 0.4845586 -0.3160963 -0.5978430 -0.1789733
Mathematics Sciences -0.0552583 -0.2475991 -0.6845717 -0.0724882 -0.3160963 -0.2877500 -0.5418960
Physics & Astronomy Sciences -0.0552583 2.3892366 4.6188634 4.7763776 -0.3160963 -0.1205088 5.3314557
Biological Sciences Sciences 0.2443027 0.5131538 -0.8392918 1.2303129 -0.3160963 -0.5124803 0.6073526
CSMCE Sciences NA -0.8350326 -0.2168850 -0.6629213 -0.3160963 -0.7163055 -0.7372758
Statistics Sciences 0.5438638 -0.3560891 -0.4288964 0.2272828 -0.3160963 -0.5264171 -0.0559897
Economics Social Sciences -0.3548194 -0.5360237 0.0098499 -0.5796361 -0.3160963 -0.5891325 -0.5579173
Ethnic Studies Social Sciences NA -0.7874029 -0.2168850 -0.6157647 0.7940557 1.0275323 -0.6264284
Political Science Social Sciences -0.0552583 -0.6484828 0.0667675 -0.6308773 -0.3160963 3.0588158 -0.4836185
Psychology Social Sciences -0.9539414 2.0439210 0.5862833 0.8476910 -0.3160963 -0.0612775 0.3487686
Sociology Social Sciences 1.1429859 0.3834951 -1.1233839 0.8613311 -0.3160963 -0.2407134 -0.4121033
Womens & Gender Studies Social Sciences NA -0.6842051 -0.2417453 -0.6048189 -0.3160963 0.4805142 -0.0439938
SGIS Social Sciences -0.0552583 -0.6087913 -0.2275114 -0.5175714 4.1817358 0.1495161 -0.5050470

We can also visualize this data by plotting the individual metrics for each program (Fig. 1). There is not a lot to see here except that some units have very similar scores for each metric, whereas other units can have wide variation in Z-score depending on which metric is being examined.

## Warning: Removed 7 rows containing missing values or values outside the scale range
## (`geom_interactive_point()`).

Figure 1: Individual metric Z-scores for each unit. Mouse over to identify the metric represented by each point.

However, what the University has done is to pool these individual Z-scores into an overall research metric by averaging them. Averaging weights each metric the same; for units that don’t have a value for a particular metrics (e.g., they don’t have an SRI), the average is calculated across the remaining six metrics, which implicitly weights those metrics a bit more than in other units, but still equally within a unit. Fig. 2 shows the average research score for each unit, arranged by pool for ease of finding units, even though the Z-scores were not calculated within a unit.

Figure 2: Average research score for each unit, organized by pool. Mouse over to identify each point to unit.

The University also considered, although ultimately did not use, metrics that were calculated based on the pool each unit was placed into. In this case, to calculate the Z-score, the mean and standard deviation were calculated within a pool of units, rather than across the entire university. Figure 3 is the equivalent of Fig. 1, showing the Z-scores for each metric for each unit.

## Warning: Removed 44 rows containing missing values or values outside the scale range
## (`geom_interactive_point()`).

Figure 3: Individual metric Z-scores for each unit when Z-scores were computed within a pool. Mouse over to identify the metric represented by each point.

Figure 4 is the equivalent of Fig. 2, showing the average research score, when Z-scores were calculated within pools.

## Warning: Removed 3 rows containing missing values or values outside the scale range
## (`geom_interactive_point()`).

Figure 4: Average research score for each unit when individual Z-scores were calculated within pools. Mouse over to identify each point to unit.

Instructional Metrics Across the University

Here are the raw data for instructional metrics for each unit.

name pool instructional_sch_4Y_share_growth all_majors_share_growth instructional_sch_2024 total_majors_n_2024 instructional_sch_to_instructional_fte_2024 budget_to_sch_2024 total_realizable_base_tuition_less_budget_2024 avg_retention_rate_2024 ratio_completions_majors_2024
ALEC Agriculture 0.0002856 -0.0018326 6618.80 149 570.19 205.01 1092199.71 0.9174 0.2819
Agricultural Economics Agriculture -0.0018129 -0.0013908 6245.00 327 764.38 261.50 616379.59 0.9211 0.2446
Agronomy and Horticulture Agriculture -0.0012897 -0.0004808 10442.11 347 518.22 258.24 1910448.73 0.8839 0.2594
Animal Science Agriculture -0.0017958 -0.0023322 6467.00 406 595.87 333.13 554651.85 0.8706 0.2562
Biochemistry Agriculture 0.0008973 0.0005319 4703.10 419 631.80 189.41 1505954.62 0.8805 0.2267
Biological Systems Engineering Agriculture -0.0040599 -0.0023668 4922.42 324 493.72 301.89 823372.36 0.9142 0.2623
Entomology Agriculture 0.0003191 0.0005570 3485.00 124 771.02 168.12 1008544.02 NA 0.2016
Food Science and Technology Agriculture 0.0033570 -0.0012666 6352.11 138 625.83 228.61 829131.92 0.9189 0.4855
Plant Pathology Agriculture -0.0002511 0.0002467 709.00 64 236.18 702.52 16759.59 NA 0.1875
School of Natural Resources Agriculture 0.0010176 0.0010343 8188.39 495 523.34 304.62 1060098.27 0.8134 0.2444
Veterinary Medicine Agriculture -0.0001780 -0.0000220 1919.31 144 427.46 1139.21 -988438.73 0.8179 0.1597
Nebraska Coop Agriculture NA NA 120.00 NA NA NA NA NA NA
Architecture Architecture 0.0025541 0.0032436 8061.00 403 663.31 174.21 1394805.58 0.8483 0.2680
Community & Regional Planning Architecture 0.0002444 0.0007432 1034.00 41 369.42 219.84 350355.97 NA 0.3659
Interior Design Architecture -0.0002476 0.0019887 2592.00 158 522.37 147.97 416360.82 0.9154 0.2215
Landscape Architecture Architecture 0.0000636 -0.0001583 466.00 38 277.38 263.96 108147.00 NA 0.1316
Raikes School Business 0.0018204 NA 3032.40 NA 862.70 340.54 63927.28 NA NA
College of Law Business and Law 0.0022083 0.0035221 13998.76 465 613.31 292.42 5326597.83 NA 0.3398
Finance Business and Law -0.0036245 -0.0067249 14043.00 1070 1550.00 100.96 4919996.84 0.8940 0.2402
Management Business and Law 0.0018514 0.0023313 20650.00 645 1937.15 67.55 6789269.44 0.8426 0.2915
Marketing Business and Law 0.0018855 0.0042545 12272.00 751 1524.66 69.30 5082139.89 0.8590 0.2650
Accountancy Business and Law 0.0012937 0.0021775 17531.00 657 1853.17 114.85 5838755.52 0.8793 0.2953
Supply Chain Management & Analytics Business and Law 0.0018464 -0.0006396 9317.00 122 1217.91 95.80 3428170.20 0.8983 0.3934
Journalism Communications -0.0044955 -0.0013509 4086.50 162 583.79 191.98 4864392.76 0.9073 0.2222
Advertising Communications 0.0006865 -0.0048878 10806.00 646 871.10 100.45 1473387.09 0.9231 0.2817
Broadcasting Communications -0.0013442 0.0006822 2935.50 212 511.14 203.17 -128750.75 0.8857 0.1887
Communication Studies Communications -0.0003331 -0.0016913 10886.00 160 1209.02 80.59 3876870.45 0.8442 0.3250
Sports Communication Communications 0.0036503 0.0066267 2838.00 429 656.94 NA NA 0.8733 0.1422
Educational Administration Education -0.0007162 -0.0015043 2843.00 188 259.16 479.98 190309.19 NA 0.2979
Educational Psychology Education -0.0001863 0.0017586 9203.00 114 939.66 174.69 3049129.91 NA 0.2982
Special Education Education -0.0018971 -0.0028754 8568.00 467 367.65 142.43 3424933.54 0.9129 0.3041
TLTE Education -0.0016796 -0.0034539 13888.00 999 656.05 170.62 3425841.54 0.8794 0.2152
TMFD Education -0.0014535 -0.0015231 3018.00 98 656.09 196.85 811267.09 0.7692 0.2143
CYFS Education 0.0006768 -0.0034046 9633.00 547 514.03 187.18 3093648.64 0.8500 0.3199
Nutrition & Health Sciences Education -0.0011543 0.0021528 10691.00 1049 843.47 113.78 5596563.49 0.8527 0.1849
Chemical Engineering Engineering 0.0003850 -0.0004593 2426.00 189 319.21 573.25 10279.20 0.8911 0.1534
Architectural Engineering Engineering 0.0034216 0.0034889 12071.94 1089 561.28 243.72 -381211.26 0.8508 0.2075
Electrical & Computer Engineering Engineering 0.0009910 0.0017169 7864.00 306 426.23 421.73 -927018.97 0.8252 0.1797
School of Computing Engineering 0.0048025 0.0071102 17358.00 1162 934.48 207.10 4551740.25 0.8459 0.1575
Mechanical & Materials Engineering Engineering -0.0007383 0.0025480 11384.06 767 660.90 232.40 2637344.47 0.8423 0.1695
Civil and Environmental Engineering Engineering -0.0008785 0.0013980 7275.00 395 490.39 318.55 35411.43 0.8792 0.1646
Music Fine Arts 0.0038943 0.0001050 20830.00 371 751.31 189.72 5513672.39 0.8654 0.2156
Theatre & Film Fine Arts -0.0027078 0.0033580 5429.00 238 400.66 394.99 1179349.27 0.8750 0.1471
Art Art History & Design Fine Arts 0.0017059 0.0021304 11000.00 432 656.72 151.96 2288855.24 0.8447 0.1968
Classics & Religious Studies Humanities 0.0056992 -0.0008392 7951.00 34 1827.82 69.87 2593110.92 NA 0.4412
English Humanities -0.0026772 -0.0019559 21403.00 366 910.04 141.36 6231783.26 0.7964 0.2459
History Humanities -0.0029373 -0.0003234 13022.50 198 1221.85 109.54 3680413.74 0.8864 0.2475
Modern Languages & Literatures Humanities -0.0015760 -0.0024591 14218.50 179 572.10 144.06 4150436.94 0.8605 0.2514
Philosophy Humanities -0.0001172 0.0006145 5989.00 90 1618.65 94.24 2067751.03 NA 0.1556
Chemistry Sciences 0.0030767 -0.0006956 21704.90 198 2022.82 81.65 8656406.91 0.8080 0.2020
Earth and Atmospheric Sciences Sciences -0.0010143 -0.0005203 4671.00 111 680.90 224.92 1487970.49 0.7745 0.2342
Mathematics Sciences -0.0060076 -0.0037396 31698.75 381 1518.28 85.02 10843140.20 0.8390 0.2572
Physics & Astronomy Sciences -0.0022363 -0.0003983 12268.00 184 1061.98 134.16 4546975.81 0.7723 0.1630
Biological Sciences Sciences 0.0004908 0.0057907 23372.00 810 1568.59 95.22 5352768.67 0.8624 0.2074
CSMCE Sciences -0.0000384 NA 770.25 NA 1925.63 61.34 NA NA NA
Statistics Sciences -0.0013281 0.0003265 6775.00 66 1278.30 165.68 2635845.67 NA 0.0909
Economics Social Sciences -0.0064238 -0.0041222 14435.00 225 2136.30 63.78 6194470.23 0.8797 0.2933
Ethnic Studies Social Sciences -0.0000026 -0.0004835 279.00 14 89.67 1327.28 107892.57 NA 0.2857
Political Science Social Sciences -0.0014493 -0.0031561 7768.00 335 927.63 163.58 2013696.05 0.8672 0.3164
Psychology Social Sciences 0.0019163 0.0080852 25616.00 1303 2330.25 54.67 10023955.95 0.8087 0.2210
Sociology Social Sciences -0.0026855 -0.0027933 7254.00 124 1405.27 125.02 2097544.90 0.7255 0.1855
Womens & Gender Studies Social Sciences -0.0002415 -0.0002117 669.00 32 430.23 229.36 695714.32 NA 0.2188
SGIS Social Sciences 0.0018139 -0.0023259 11923.00 270 932.50 120.91 3925296.84 0.8512 0.3000

Similarly, Fig. 5 plots the Z-scaled instructional metrics for each unit. You can mouse over each point to see which metric is being plotted. Interestingly, here we see much more spread within each unit. There are few units whose metrics are very tightly grouped; the norm is to have some metrics on which a unit scores quite well, and some where it scores quite low.

## Warning: Removed 31 rows containing missing values or values outside the scale range
## (`geom_interactive_point()`).

Figure 5: Z-scaled instructional metrics for each unit.

Fig. 6 shows the average instructional score for each unit when Z-scores are calculated across the entire University.

Figure 6: Average instructional score for each unit.

Similarly, we can recalculate the individual Z-scores within each pool of units and plot those. Fig. 7 is the equivalent of Fig. 5.

## Warning: NAs introduced by coercion
## Warning: NAs introduced by coercion
## Warning: NAs introduced by coercion
## Warning: NAs introduced by coercion
## Warning: NAs introduced by coercion
## Warning: Removed 36 rows containing missing values or values outside the scale range
## (`geom_interactive_point()`).

Figure 7: Z-scaled instructional metrics for each unit when Z-scores are calculated within each pool.

Finally, Fig. 8 shows the average instructional score when individual metric Z-scores were calculated within a pool.

## Warning: Removed 1 row containing missing values or values outside the scale range
## (`geom_interactive_point()`).

Figure 8: Average instructional score for each unit when individual metric Z-scores are calculated within a pool.

Combining research and instruction

Fig. 9 shows research and teaching scores plotted together when component metric Z-scores are calculated across the entire University.

## Warning: Removed 3 rows containing missing values or values outside the scale range
## (`geom_interactive_point()`).

Figure 9: Research and teaching scores when individual metrics are calculated across the entire University.

## Warning: Removed 3 rows containing missing values or values outside the scale range
## (`geom_interactive_point()`).

Figure 10: Research and teaching scores when individual metrics are calculated across the entire University, highlighting the programs that have been chosen for elimination or restructuring.

Fig. 11 shows research and teaching scores plotted together when component metric Z-scores are calculated within pools.

## Warning: Removed 3 rows containing missing values or values outside the scale range
## (`geom_interactive_point()`).

Figure 11: Research and teaching scores when individual metrics are calculated across the entire University.

Fig. 12 shows research and teaching scores plotted together when component metric Z-scores are calculated within pools, highlighting programs that are being eliminated or realigned.

## Warning: Removed 3 rows containing missing values or values outside the scale range
## (`geom_interactive_point()`).

Figure 12: Research and teaching scores when individual metrics are calculated across the entire University.

Finally, we can combine research and teaching into a single composite score based on the weight given by each unit to research and instruction. research_weight is calculated as (percent_research)/(percent_teaching + percent_research); instruction_weight is calculated as (percent_teaching)/(percent_teaching + percent_research). percent_teaching is calcuated as sum(appointment_apportionment_percent_teaching_fte) / sum(appointment_apportionment_fte); that is, it is the percent of FTE in a unit that is apportioned to teaching. For example, if a department has 10 faculty, and 10 FTE, and everyone in the department’s apportionment is 50% research, 40% teaching, and 10% service, then the percent_teaching is 0.4; if two of those 10 people were actually 80% teaching, then the percent_teaching would be \((8*0.4 + 2*0.8)/10 = 4.8/10 = 0.48\). percent_research is calculated similarly.

## Warning: Removed 3 rows containing missing values or values outside the scale range
## (`geom_interactive_point()`).

Figure 13: Weighted research and teaching scores when individual metrics are calculated across the entire University.

## Warning: Removed 3 rows containing missing values or values outside the scale range
## (`geom_interactive_point()`).

Figure 14: Weighted overall score for each unit, by pool.