λ0 λ1 λ2 λ3 0.140 0.429 0.245 0.186 ======================= λ0 λ1 λ2 λ3 0.000 0.000 0.000 1.000 ======================= Boost λ0 λ1 λ2 λ3 Cross entr. Perplexity 0 0.140 0.429 0.245 0.186 10.220 1192.703 0.1 0.126 0.386 0.220 0.267 10.224 1196.392 0.2 0.112 0.343 0.196 0.349 10.254 1221.057 0.3 0.098 0.300 0.171 0.430 10.306 1265.949 0.4 0.084 0.257 0.147 0.512 10.382 1334.214 0.5 0.070 0.214 0.122 0.593 10.485 1433.491 0.6 0.056 0.172 0.098 0.674 10.625 1579.323 0.7 0.042 0.129 0.073 0.756 10.818 1805.336 0.8 0.028 0.086 0.049 0.837 11.103 2199.220 0.9 0.014 0.043 0.024 0.919 11.600 3104.684 0.95 0.007 0.021 0.012 0.959 12.092 4367.084 0.99 0.001 0.004 0.002 0.992 13.165 9181.867 ======================= Discount λ0 λ1 λ2 λ3 Cross entr. Perplexity 1 0.140 0.429 0.245 0.186 10.220 1192.703 0.9 0.144 0.439 0.250 0.167 10.223 1195.343 0.8 0.147 0.448 0.256 0.149 10.228 1199.563 0.7 0.150 0.458 0.261 0.130 10.236 1205.592 0.6 0.153 0.468 0.267 0.112 10.245 1213.751 0.5 0.156 0.478 0.273 0.093 10.258 1224.509 0.4 0.160 0.488 0.278 0.074 10.274 1238.594 0.3 0.163 0.497 0.284 0.056 10.296 1257.237 0.2 0.166 0.507 0.289 0.037 10.325 1282.837 0.1 0.169 0.517 0.295 0.019 10.368 1321.596 0 0.172 0.527 0.301 0.000 10.489 1436.721 ======================= Coverage Pos Un. Unigram Un. Bigram Un. Trigram Unigram Bigram Trigram 2000 13.369 3.591 0.788 8.214 3.135 0.765 4000 21.875 7.510 1.691 17.283 7.314 1.955 6000 32.189 11.429 2.779 25.957 10.989 3.090 8000 41.900 14.806 3.448 34.307 14.319 3.875 10000 50.771 18.706 5.003 42.746 18.183 5.519 12000 59.473 23.349 7.901 51.235 23.043 8.654 14000 67.026 26.796 8.798 59.809 26.847 9.759 16000 73.669 30.834 10.473 68.783 32.042 12.204 18000 76.850 32.894 11.686 78.152 38.591 16.743 20000 84.025 36.001 12.284 86.441 42.036 17.538 20003 84.025 36.007 12.289 86.446 42.041 17.543 ======================= Data Unigram Bigram Trigram train 35304 112415 145065 heldout 12863 31663 37122 test 7136 15872 18390