Model Madness 2019 - Conference Championship Results, Simple Composite Model

in model-madness •  6 years ago 

Today is Selection Sunday. It is the most important day in college basketball and the day when we finally get a chance to look at the overall bracket and begin using the models that have been developed over the past couple of weeks to pick winners and losers. We are first going to go over the results of the predictions of the models and then describe a quick and dirty final model - a simple democratic composite model.


orange.png

So, here are the results of all of the conference tournaments. I made projections for all 32 tourneys with the EDM and SPM models, with the MASPM and EDLM models coming in for the later tourneys since they were developed later.

Results of Projections:

ConferenceEDMSPMMASPMEDLMActual
Atlantic SunLipscomb (6-1)Lipscomb (6-1)Liberty
Big SouthRadford (8-2)Radford (7-3)Gardner-Webb
PatriotColgate (8-1)Lehigh (6-3)Colgate
HorizonNorthern Kentucky (6-1)Northern Kentucky (7-0)Northern Kentucky
NortheastSacred Heart (3-4)Saint Francis (PA) (4-3)Fairleigh Dickinson
Ohio ValleyBelmont (6-1)Belmont (5-2)Murray State
MAACQuinnipiac (4-6)Rider (3-7)Quinnipiac (3-7)Iona
Missouri ValleyLoyola (IL) (5-5)Drake (5-5)Drake (5-5)Bradley
West CoastGonzaga (5-4)Gonzaga (4-5)Gonzaga (4-5)Saint Mary's
SouthernWofford (7-2)Wofford (9-0)Wofford (9-0)Wofford
America EastVermont (5-2)Vermont (5-2)Vermont (5-2)Vermont
ColonialHofstra (7-2)Hofstra (6-3)Hofstra (7-2)Northeastern
SummitSDSU (3-1)SDSU (3-1)SDSU (3-1)NDSU
MEACNorfolk State (5-5)Norfolk State (5-5)Norfolk State (6-4)Norfolk State (5-5)NC Central
MACBuffalo (9-2)Buffalo (6-5)Buffalo (7-4)Buffalo (8-3)Buffalo
ACCVirginia (11-3)Virginia (9-5)Virginia (9-5)UNC (10-4)Duke
Sun BeltGeorgia Southern (6-3)Georgia State (7-2)Georgia State (7-2)Georgia State (7-2)Georgia State
SWACPrairie View A&M (6-1)Prairie View A&M (6-1)Prairie View A&M (6-1)Prairie View A&M (6-1)Prairie View A&M
Big SkyMontana (8-2)Montana (7-3)Montana (7-3)Montana (7-3)Montana
Atlantic-10VCU (6-7)VCU (5-8)VCU (5-8)VCU (7-6)Saint Louis
Mountain WestNevada (8-2)Nevada (7-3)Nevada (7-3)Nevada (7-3)Utah State
Pac-12Washington (9-2)Washington (8-3)Washington (8-3)Washington (7-4)Oregon
SouthlandAbilene Christian (4-3)Abilene Christian (4-3)Abilene Christian (4-3)Sam Houston State (4-3)Abilene Christian
Big EastVillanova (6-3)Villanova (7-2)Villanova (7-2)Villanova (6-3)Villanova
SECTennessee (9-4)Kentucky (8-5)Kentucky (8-5)LSU (10-3)Auburn
Big 12Kansas State (4-5)Kansas (5-4)Kansas State (4-5)Kansas State (1-8)Iowa State
Conference USASouthern Miss (8-3)Old Dominion (9-2)Old Dominion (10-1)Old Dominion (9-2)Old Dominion
Big WestUC Irvine (5-2)UC Irvine (5-2)UC Irvine (5-2)UC Irvine (4-3)UC Irvine
WACNew Mexico State (6-1)New Mexico State (6-1)New Mexico State (6-1)New Mexico State (5-2)New Mexico State
IvyYale (2-1)Yale (3-0)Yale (2-1)Harvard (2-1)Yale
AmericanHouston (8-3)Houston (6-5)Houston (8-3)Houston (7-4)Cincinnati
Big TenMichigan State (7-6)Michigan (8-5)Michigan State (9-4)Michigan State (9-4)Michigan State
Record200-89 (.692)190-99 (.657)159-81 (.663)119-63 (.654)EDM Wins

The first model that I built (EDM) ended up being the best predictor of individual games being the only model winning more than twice as much as it lost (.692). The SPM had the most perfect brackets with 3. The MASPM was the only other model to get a perfect bracket having 1. The important thing to note is that these perfect tournaments were typically smaller tournaments with very few upsets. Even though the SPM had the most perfect brackets, it also had the second worst record by percentage (.657). Our newest model, the EDLM ended up performing the worst (.654).


Now that we have these results, we can design our final model: A composite model. This model is the most simple of them all. We let the other teams vote on which team they have winning at a particular point in the bracket and the team with the most votes for a game progresses in the bracket. Pretty simple, but there are a couple of edge cases to consider.

The first is what occurs during a tie. We have four models that are voting members, so how do we break ties? We could select the higher seed as a safe pick. We could select the lower seed as an upside pick. We could use a fifth model as reference like the Elo Model I described earlier in this series. In our case, we will make the EDM model the priority model. It performed best during the conference tournaments so we'll give it a little more weight in the decision making process for our composite model.

The other edge case happens with the EDLM. This model doesn't generate scores but probabilities. With the other models, we'll simply pick the team with the higher rating. But with the EDLM we can't do that. We should pick the team of those available with the highest probability to that point in the tournament which may not match the selection of the pure EDLM since each round is selected by the composite model. We also need to fix the probabilities to the results of prior rounds when considering games in later rounds.

We could treat games as independent of each other to simplify the complex probability trees, but as mentioned in the last post, games are entirely dependent on the prior game in the single elimination setting. In either case, if the other three models are in agreement, we don't have to generate probabilities and if the EDM and one other model is in agreement, a calculation can be skipped since the EDM has the tie-breaker priority.

So, that is all for this post. A short one today. We are done with the development phase and are now on to the trial phase. The big tournament for prediction purposes starts Thursday afternoon. I'll try to post each model's predictions before then, maybe once a day. Tonight, we'll know the teams. I will also provide some potential upset picks by each model to help anyone look for a trendy pick to help them in their brackets. Happy picking!

Authors get paid when people like you upvote their post.
If you enjoyed what you read here, create your account today and start earning FREE STEEM!
Sort Order:  

Congratulations @statsplit! You have completed the following achievement on the Steem blockchain and have been rewarded with new badge(s) :

You published more than 90 posts. Your next target is to reach 100 posts.

You can view your badges on your Steem Board and compare to others on the Steem Ranking
If you no longer want to receive notifications, reply to this comment with the word STOP

To support your work, I also upvoted your post!

Do not miss the last post from @steemitboard:

Are you a DrugWars early adopter? Benvenuto in famiglia!
Vote for @Steemitboard as a witness to get one more award and increased upvotes!