Stockfish Testing Queue

Finished - 40836 tests

14-01-18 hwi see_simp diff
ELO: 1.72 +-2.9 (95%) LOS: 87.5%
Total: 20000 W: 3741 L: 3642 D: 12617
20000 @ 15+0.05 th 1 Test simplification for regressions
14-01-18 joa k_ebonus diff
ELO: -32.83 +-3.0 (95%) LOS: 0.0%
Total: 20000 W: 3095 L: 4979 D: 11926
20000 @ 15+0.05 th 1 PP: Measure k-factor for ebonus
14-01-18 joa k_mbonus diff
ELO: -0.31 +-2.6 (95%) LOS: 40.9%
Total: 25000 W: 4600 L: 4622 D: 15778
25000 @ 15+0.05 th 1 PP: Measure k-factor for mbonus
14-01-18 joa k-factor diff
ELO: -35.77 +-3.1 (95%) LOS: 0.0%
Total: 20000 W: 3121 L: 5173 D: 11706
20000 @ 15+0.05 th 1 PP: Removing k-factor altogether
14-01-18 jos 3fold_fix diff
ELO: -1.55 +-3.3 (95%) LOS: 17.6%
Total: 13256 W: 1984 L: 2043 D: 9229
20000 @ 60+0.05 th 1 LTC: We don't need to check for 3-fold-repetition 2 half-moves back, as this can never be true. It always takes at least 2 full moves to repeat a position. This should save us some checks. Make sure, there is no regression.
14-01-18 jos kingAttWeight^ diff
LLR: -2.96 (-2.94,2.94) [-1.50,4.50]
Total: 13903 W: 2530 L: 2599 D: 8774
sprt @ 15+0.05 th 1 RookWeight, Take 5.
14-01-18 jos kingAttWeight diff
LLR: -2.96 (-2.94,2.94) [-1.50,4.50]
Total: 19703 W: 3621 L: 3675 D: 12407
sprt @ 15+0.05 th 1 QueenWeight, Take 4.
14-01-18 hwi see_simp diff
ELO: -1.98 +-2.6 (95%) LOS: 7.1%
Total: 20000 W: 2971 L: 3085 D: 13944
20000 @ 60+0.05 th 1 Test simplification for regressions
14-01-18 joa kpdistance diff
ELO: 0.23 +-2.9 (95%) LOS: 56.0%
Total: 20000 W: 3712 L: 3699 D: 12589
20000 @ 15+0.05 th 1 Measuring minKPdistance
14-01-18 inf pptune diff
LLR: -2.97 (-2.94,2.94) [-1.50,4.50]
Total: 21269 W: 3919 L: 3969 D: 13381
sprt @ 15+0.05 th 1 Try 5, 25000 iterations + simplifications (A new SPSA run with reduced ck and rk)
14-01-19 inf pptune diff
LLR: -2.97 (-2.94,2.94) [-1.50,4.50]
Total: 17808 W: 3311 L: 3370 D: 11127
sprt @ 15+0.05 th 1 Try 6, 25000 iterations + simplification (variation)
14-01-19 bin randommove_fix diff
ELO: 1.56 +-3.7 (95%) LOS: 79.8%
Total: 16511 W: 3983 L: 3909 D: 8619
20000 @ 1+0.05 th 1 confirm Joona fix for instant moves when low on time
14-01-19 inf pptune diff
LLR: -2.97 (-2.94,2.94) [-1.50,4.50]
Total: 24254 W: 4515 L: 4557 D: 15182
sprt @ 15+0.05 th 1 Try 7, 25000 iterations (Try one time without simplifications)
14-01-19 bin randommove_fix diff
ELO: 5.96 +-12.9 (95%) LOS: 81.7%
Total: 1458 W: 394 L: 369 D: 695
20000 @ 0.05+0.05 th 1 confirm Joona fix for instant moves when low on time (at lower TC)
14-01-19 inf pptune diff
LLR: -2.97 (-2.94,2.94) [-1.50,4.50]
Total: 11688 W: 2197 L: 2272 D: 7219
sprt @ 15+0.05 th 1 Try 9
14-01-19 bin randommove_fix diff
ELO: -155.85 +-5.2 (95%) LOS: 0.0%
Total: 17287 W: 3911 L: 11184 D: 2192
20000 @ 0.5+0 th 1 Joona fix + instant mate
14-01-19 inf pptune diff
LLR: -2.95 (-2.94,2.94) [-1.50,4.50]
Total: 14167 W: 2595 L: 2663 D: 8909
sprt @ 15+0.05 th 1 Try 8: Simplification only, with original values (Corrected bench)
14-01-19 pec mbonus diff
LLR: -2.97 (-2.94,2.94) [0.00,6.00]
Total: 18829 W: 2884 L: 2901 D: 13044
sprt @ 60+0.05 th 1 Speculative LTC for neutral patch at STC at low priority. just random shot from looking at results of measurement test
14-01-19 inf material diff
LLR: -2.97 (-2.94,2.94) [-1.50,4.50]
Total: 19817 W: 3640 L: 3694 D: 12483
sprt @ 15+0.05 th 1 PawnValueMg + 3, PawnValueEg + 3. Maybe has a chance considering all the various bonuses added recently.
14-01-19 joa simpler_pp_eval diff
ELO: -1.67 +-2.6 (95%) LOS: 10.8%
Total: 25000 W: 4633 L: 4753 D: 15614
25000 @ 15+0.05 th 1 PP: Removing more stuff
14-01-19 jos kingAttWeight^ diff
LLR: -2.96 (-2.94,2.94) [-1.50,4.50]
Total: 13134 W: 2408 L: 2479 D: 8247
sprt @ 15+0.05 th 1 Increase kingAttackersWeight. Final take 1.
14-01-19 jos kingAttWeight diff
LLR: -3.00 (-2.94,2.94) [-1.50,4.50]
Total: 5555 W: 972 L: 1064 D: 3519
sprt @ 15+0.05 th 1 Increase kingAttackersWeight. Final take 2.
14-01-19 joa simpler_pp_eval diff
ELO: -4.00 +-2.7 (95%) LOS: 0.2%
Total: 25000 W: 4637 L: 4925 D: 15438
25000 @ 15+0.05 th 1 PP: Removing more stuff 2
14-01-19 joa simpler_pp_eval diff
ELO: -8.72 +-3.0 (95%) LOS: 0.0%
Total: 20000 W: 3626 L: 4128 D: 12246
20000 @ 15+0.05 th 1 PP: Removing more stuff 3
14-01-19 bin randommove_fix diff
ELO: 3.02 +-3.6 (95%) LOS: 94.8%
Total: 20000 W: 5808 L: 5634 D: 8558
20000 @ 0.5+0.02 th 1 Joona fix + instant mate (last try)
14-01-19 inf material diff
LLR: -2.94 (-2.94,2.94) [-1.50,4.50]
Total: 38685 W: 7272 L: 7275 D: 24138
sprt @ 15+0.05 th 1 PawnValueMg + 2, PawnValueEg + 2
14-01-19 pec tm_fix diff
ELO: 1.58 +-3.3 (95%) LOS: 82.2%
Total: 20000 W: 4891 L: 4800 D: 10309
20000 @ 5 th 1 There is possibility that recent time management fix weakened engine at TC without increment.
14-01-19 inf material diff
LLR: -2.97 (-2.94,2.94) [-1.50,4.50]
Total: 8541 W: 1506 L: 1589 D: 5446
sprt @ 15+0.05 th 1 PawnValue + 2, all the rest -1
14-01-19 inf material diff
LLR: -2.96 (-2.94,2.94) [-1.50,4.50]
Total: 26624 W: 4891 L: 4927 D: 16806
sprt @ 15+0.05 th 1 PawnValue + 1, all the rest -1
14-01-19 pec tm_fix diff
ELO: -2.40 +-5.2 (95%) LOS: 18.4%
Total: 10000 W: 2915 L: 2984 D: 4101
10000 @ 1+0.01 th 1 very short tc. There is possibility that recent time management fix weakened engine at TC without increment.
14-01-19 pec tm_fix diff
ELO: 5.07 +-3.7 (95%) LOS: 99.6%
Total: 20000 W: 6164 L: 5872 D: 7964
20000 @ 2 th 1 One more test at fixed very short tc. There is possibility that recent time management fix weakened engine at TC without increment.
14-01-19 pec tm_fix diff
ELO: 62.85 +-3.8 (95%) LOS: 100.0%
Total: 20000 W: 7850 L: 4271 D: 7879
20000 @ 1+0.01 th 1 Measure elo at very short tc
14-01-19 joa simpler_pp_eval diff
ELO: -2.15 +-2.9 (95%) LOS: 7.4%
Total: 20000 W: 3634 L: 3758 D: 12608
20000 @ 15+0.05 th 1 PP: Removing more stuff 1
14-01-19 joa kingAttackWeights diff
ELO: -2.88 +-2.9 (95%) LOS: 2.7%
Total: 20000 W: 3623 L: 3789 D: 12588
20000 @ 15+0.05 th 1 KS: Measure kingAttackWeights (Knight)
14-01-19 pec tm_fix diff
ELO: 2.36 +-4.3 (95%) LOS: 86.0%
Total: 10000 W: 2023 L: 1955 D: 6022
10000 @ 15 th 1 See if there are any time losses at 15'' + no increment. There is possibility that recent time management fix weakened engine at TC without increment.
14-01-19 joa kingAttackWeights diff
ELO: -3.21 +-2.9 (95%) LOS: 1.6%
Total: 20000 W: 3653 L: 3838 D: 12509
20000 @ 15+0.05 th 1 KS: Measure kingAttackWeights (Bishop)
14-01-19 joa kingAttackWeights diff
ELO: -2.59 +-3.0 (95%) LOS: 4.3%
Total: 20000 W: 3704 L: 3853 D: 12443
20000 @ 15+0.05 th 1 KS: Measure kingAttackWeights (Rook)
14-01-19 joa kingAttackWeights diff
ELO: -3.13 +-3.0 (95%) LOS: 2.1%
Total: 20000 W: 3816 L: 3996 D: 12188
20000 @ 15+0.05 th 1 KS: Measure kingAttackWeights (Queen)
14-01-19 pec move_importance diff
LLR: -2.96 (-2.94,2.94) [-1.50,4.50]
Total: 11128 W: 1980 L: 2056 D: 7092
sprt @ 15+0.05 th 1 move importance for pv_instability
14-01-19 joa tm_fix diff
ELO: 1.26 +-4.5 (95%) LOS: 71.0%
Total: 11000 W: 2636 L: 2596 D: 5768
20000 @ 1+0.05 th 1 typical tuning tc.
14-01-19 gli less_pv diff
LLR: 2.96 (-2.94,2.94) [-1.50,4.50]
Total: 78877 W: 14706 L: 14396 D: 49775
sprt @ 15+0.05 th 1 Remove most PV distinctions
14-01-19 joa tm_fix diff
ELO: 0.10 +-3.1 (95%) LOS: 52.6%
Total: 20000 W: 4090 L: 4084 D: 11826
20000 @ 5+0.05 th 1 and with a bit more time.
14-01-19 joa simpler_pp_eval diff
ELO: -2.21 +-3.0 (95%) LOS: 7.4%
Total: 20000 W: 3779 L: 3906 D: 12315
20000 @ 15+0.05 th 1 PP: PP: Removing more stuff 4
14-01-19 inf material diff
LLR: -2.95 (-2.94,2.94) [-1.50,4.50]
Total: 12530 W: 2291 L: 2363 D: 7876
sprt @ 15+0.05 th 1 PawnValue - 3 (As joergoster suggested)
14-01-19 inf material diff
LLR: 2.95 (-2.94,2.94) [-1.50,4.50]
Total: 17642 W: 3349 L: 3198 D: 11095
sprt @ 15+0.05 th 1 PawnValue - 5
14-01-19 inf material diff
LLR: -2.96 (-2.94,2.94) [-1.50,4.50]
Total: 30442 W: 5615 L: 5641 D: 19186
sprt @ 15+0.05 th 1 PawnValue - 7
14-01-19 sg followup_moves diff
LLR: -2.96 (-2.94,2.94) [-1.50,4.50]
Total: 5568 W: 1014 L: 1105 D: 3449
sprt @ 15+0.05 th 1 update followup moves: replace ttMove with non-capture/promotion
14-01-19 jos null_rep diff
LLR: -2.97 (-2.94,2.94) [-1.50,4.50]
Total: 14358 W: 2647 L: 2715 D: 8996
sprt @ 15+0.05 th 1 Include null moves in repetition detection.
14-01-20 pec tm_fix diff
ELO: 14.37 +-3.4 (95%) LOS: 100.0%
Total: 20000 W: 5445 L: 4618 D: 9937
20000 @ 5 th 1 Measure elo at 5+0
14-01-20 pec tm_fix diff
ELO: -2.26 +-2.9 (95%) LOS: 6.4%
Total: 20000 W: 3571 L: 3701 D: 12728
40000 @ 15+0.05 th 1 Measure elo at an normal STC