λ0 λ1 λ2 λ3 0.070 0.254 0.492 0.184 ======================= λ0 λ1 λ2 λ3 0.000 0.000 0.000 1.000 ======================= Boost λ0 λ1 λ2 λ3 Cross entr. Perplexity 0 0.070 0.254 0.492 0.184 7.468 177.053 0.1 0.063 0.229 0.443 0.265 7.470 177.247 0.2 0.056 0.203 0.394 0.347 7.497 180.581 0.3 0.049 0.178 0.345 0.429 7.546 186.918 0.4 0.042 0.152 0.295 0.510 7.620 196.713 0.5 0.035 0.127 0.246 0.592 7.722 211.097 0.6 0.028 0.102 0.197 0.673 7.860 232.393 0.7 0.021 0.076 0.148 0.755 8.053 265.669 0.8 0.014 0.051 0.098 0.837 8.341 324.279 0.9 0.007 0.025 0.049 0.918 8.850 461.499 0.95 0.004 0.013 0.025 0.959 9.361 657.744 0.99 0.001 0.003 0.005 0.992 10.500 1448.257 ======================= Discount λ0 λ1 λ2 λ3 Cross entr. Perplexity 1 0.070 0.254 0.492 0.184 7.468 177.053 0.9 0.072 0.260 0.503 0.165 7.472 177.525 0.8 0.073 0.265 0.514 0.147 7.478 178.229 0.7 0.075 0.271 0.525 0.129 7.485 179.198 0.6 0.076 0.277 0.536 0.110 7.496 180.480 0.5 0.078 0.283 0.548 0.092 7.509 182.140 0.4 0.080 0.288 0.559 0.073 7.526 184.281 0.3 0.081 0.294 0.570 0.055 7.547 187.071 0.2 0.083 0.300 0.581 0.037 7.576 190.823 0.1 0.084 0.305 0.592 0.018 7.617 196.297 0 0.086 0.311 0.603 0.000 7.704 208.488 ======================= Coverage Pos Un. Unigram Un. Bigram Un. Trigram Unigram Bigram Trigram 2000 18.956 9.956 4.171 9.809 7.749 4.075 4000 30.253 18.653 8.491 19.758 15.823 8.719 6000 38.608 26.352 12.702 29.672 23.828 13.399 8000 46.044 33.280 16.208 39.561 31.787 17.733 10000 52.215 39.059 19.113 49.395 39.546 21.833 12000 59.430 44.922 21.485 59.074 46.425 25.047 14000 66.329 50.491 23.788 68.733 53.555 28.402 16000 76.329 55.179 25.169 77.752 58.799 30.302 18000 84.557 59.180 26.349 86.636 64.104 32.202 20000 92.500 62.937 27.426 95.545 69.053 34.027 20003 92.500 62.937 27.426 95.550 69.053 34.027 ======================= Data Unigram Bigram Trigram train 8077 58014 116730 heldout 3859 19479 32728 test 3160 11923 17454