SABR
GAMES and SIMULATIONS
COMMITTEE

Statistical accuracy comparison between DMB and OOTP and Action Sports for 2016 season

This is my 2nd statistical accuracy comparison (the 1st one did NOT include Action Sports). I used the 2016 As Played Season to compare the statistical accuracy of DMB, OOTP and Action Sports. For all of them, I ran the sim 5 times.

For Team Batting, it looks like the accuracy of DMB and OOTP were very close, with Action Sports slightly below DMB and OOTP.

Team Batting
Avg OBP SLG Sim
0.255 0.322 0.417 Actual
0.254 0.32 0.416 DMB Avg
0.257 0.324 0.422 OOTP Avg
0.259 0.324 0.425 AS Avg

For Team Pitching, I left BABIP blank for Action Sports, because that stat isn’t readily available without some additional calculations. DMB was slightly better than OOTP, with AS’ ERA off by 7.1%

Team Pitching
ERA BABIP OPS Sim
4.19 0.297 0.739 Actual
4.20 0.295 0.736 DMB Avg
4.40 0.298 0.746 OOTP Avg
4.49 0.749 AS Avg

For Runs Scored, DMB was the closest to actual runs scored, with OOTP and Action Sports trailing behind.

Team Runs Scored    
RS Sim Percent Delta
21744 Actual
22097 DMB Avg 1.62%
22814 OOTP Avg 4.92%
23294 AS Avg 5.42%

For Division Standings, the AL West gave the biggest discrepancy, with all 3 vendors showing on average that Houston winning the division. DMB matched the division winner in 5 of 6 races, OOTP and AS matched the division winner in 4 of 6 races,

Team Real W DMB Wins OOTP Wins AS Wins
AL East Boston 93 99 102 88
AL East Baltimore 89 88 80 87
AL East Toronto 89 92 94 82
AL East New York Yankees 84 77 73 82
AL East Tampa Bay 68 73 73 84
Real W DMB Wins OOTP Wins AS Wins
AL Central Cleveland 94 90 95 87
AL Central Detroit 86 81 91 90
AL Central Kansas 81 81 69 73
AL Central Chicago White Sox 78 83 73 75
AL Central Minnesota 59 63 67 63
Real W DMB Wins OOTP Wins AS Wins
AL West Texas 95 86 83 79
AL West Seattle 86 84 82 86
AL West Houston 84 87 87 95
AL West Los Angeles Angels 74 71 70 76
AL West Oakland 69 67 72 69
Real W DMB Wins OOTP Wins AS Wins
NL East Washington 95 98 93 97
NL East New York Mets 87 86 82 93
NL East Miami 79 80 78 83
NL East Philadelphia 71 65 67 78
NL East Atlanta 68 72 80 68
Real W DMB Wins OOTP Wins AS Wins
NL Central Chicago 103 104 115 112
NL Central St. Louis 86 82 91 97
NL Central Pittsburgh 78 80 71 73
NL Central Milwaukee 73 69 79 77
NL Central Cincinnati 68 67 66 66
Real W DMB Wins OOTP Wins AS Wins
NL West Los Angeles Dodgers 91 91 92 93
NL West San Francisco 87 90 95 83
NL West Colorado 75 86 73 61
NL West Arizona 69 70 76 64
NL West San Diego 68 66 64 66

 

This is where Action Sports lagged quite a bit behind DMB and OOTP to replay an entire season. In this case, I only ran the sim one time per vendor. Consider these times as relative based on my PC specs, but I would expect similar results in any PC hardware configuration.

Time to run a season Time (min:sec)
DMB 1:58
OOTP 1:20
Action sports 24:35
+ posts
0 0 votes
Article Rating
Subscribe
Notify of
guest

0 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments