The International Corpus of English (ICE) drawn from English speakers from various places in the world, initiated by [Greenbaum (1991)](https://www.cambridge.org/core/journals/english-today/article/abs/ice-the-international-corpus-of-english/47808205394C538393C3FD8E62E5E701).

The International Corpus of English (ICE) drawn from English speakers from various places in the world, initiated by [Greenbaum (1991)](https://www.cambridge.org/core/journals/english-today/article/abs/ice-the-international-corpus-of-english/47808205394C538393C3FD8E62E5E701).

Bits/byte: Average number of bits per byte according to model probabilities.

The International Corpus of English (ICE) drawn from English speakers from various places in the world, initiated by [Greenbaum (1991)](https://www.cambridge.org/core/journals/english-today/article/abs/ice-the-international-corpus-of-english/47808205394C538393C3FD8E62E5E701).

Denoised inference runtime (s): Average time to process a request to the model minus performance contention by using profiled runtimes from multiple trials of SyntheticEfficiencyScenario.

The International Corpus of English (ICE) drawn from English speakers from various places in the world, initiated by [Greenbaum (1991)](https://www.cambridge.org/core/journals/english-today/article/abs/ice-the-international-corpus-of-english/47808205394C538393C3FD8E62E5E701).

# eval: Number of evaluation instances.

The International Corpus of English (ICE) drawn from English speakers from various places in the world, initiated by [Greenbaum (1991)](https://www.cambridge.org/core/journals/english-today/article/abs/ice-the-international-corpus-of-english/47808205394C538393C3FD8E62E5E701).

# train: Number of training instances (e.g., in-context examples).

The International Corpus of English (ICE) drawn from English speakers from various places in the world, initiated by [Greenbaum (1991)](https://www.cambridge.org/core/journals/english-today/article/abs/ice-the-international-corpus-of-english/47808205394C538393C3FD8E62E5E701).

truncated: Fraction of instances where the prompt itself was truncated (implies that there were no in-context examples).

The International Corpus of English (ICE) drawn from English speakers from various places in the world, initiated by [Greenbaum (1991)](https://www.cambridge.org/core/journals/english-today/article/abs/ice-the-international-corpus-of-english/47808205394C538393C3FD8E62E5E701).

# prompt tokens: Number of tokens in the prompt.

The International Corpus of English (ICE) drawn from English speakers from various places in the world, initiated by [Greenbaum (1991)](https://www.cambridge.org/core/journals/english-today/article/abs/ice-the-international-corpus-of-english/47808205394C538393C3FD8E62E5E701).

# output tokens: Actual number of output tokens.

The International Corpus of English (ICE) drawn from English speakers from various places in the world, initiated by [Greenbaum (1991)](https://www.cambridge.org/core/journals/english-today/article/abs/ice-the-international-corpus-of-english/47808205394C538393C3FD8E62E5E701).

# trials: Number of trials, where in each trial we choose an independent, random set of training instances.

min=0.693, mean=0.849, max=0.925, sum=5.096 (6)

min=0.984, mean=1.104, max=1.13, sum=6.625 (6)

min=200, mean=489.833, max=694, sum=2939 (6)

min=1701.758, mean=1985.928, max=2046.332, sum=11915.57 (6)

min=0.739, mean=0.895, max=0.972, sum=5.368 (6)

min=0.736, mean=0.818, max=0.835, sum=4.907 (6)

min=0.714, mean=0.868, max=0.943, sum=5.21 (6)

min=0.852, mean=0.948, max=0.968, sum=5.688 (6)

min=0.685, mean=0.836, max=0.909, sum=5.019 (6)

min=0.661, mean=0.799, max=0.865, sum=4.795 (6)

min=1912.511, mean=3008.538, max=4149.314, sum=18051.229 (6)

min=0.682, mean=0.83, max=0.901, sum=4.977 (6)

min=0.715, mean=0.865, max=0.94, sum=5.192 (6)

min=0.723, mean=0.822, max=0.88, sum=4.93 (6)

min=1.423, mean=1.848, max=3.327, sum=11.09 (6)

min=2767.13, mean=3699.737, max=5072.545, sum=22198.421 (6)

min=1.701, mean=8.892, max=39.588, sum=53.349 (6)

min=0.645, mean=0.715, max=0.765, sum=4.292 (6)

min=1.141, mean=1.146, max=1.156, sum=6.874 (6)

min=1996.2, mean=2038.937, max=2049, sum=12233.619 (6)

min=0.758, mean=0.875, max=0.951, sum=5.249 (6)

min=0.932, mean=0.944, max=0.947, sum=5.666 (6)

min=1999.803, mean=2039.314, max=2047.999, sum=12235.885 (6)

min=0.8, mean=0.916, max=0.993, sum=5.499 (6)

min=0.68, mean=0.69, max=0.692, sum=4.139 (6)

min=0.835, mean=0.954, max=1.029, sum=5.724 (6)

min=0.526, mean=0.533, max=0.534, sum=3.195 (6)

min=0.953, mean=1.112, max=1.205, sum=6.673 (6)

min=0.564, mean=0.571, max=0.573, sum=3.429 (6)

min=0.756, mean=0.923, max=1.016, sum=5.537 (6)

min=0.815, mean=1.009, max=1.114, sum=6.055 (6)

min=0.828, mean=1.024, max=1.159, sum=6.141 (6)

min=1974.454, mean=2011.814, max=2019.999, sum=12070.887 (6)

min=0.975, mean=0.984, max=0.995, sum=5.902 (6)

min=0.768, mean=0.943, max=1.06, sum=5.656 (6)

min=0.68, mean=0.752, max=0.803, sum=4.513 (6)

min=0.486, mean=0.511, max=0.553, sum=3.067 (6)

min=1997.234, mean=2039.669, max=2048.976, sum=12238.016 (6)

min=0.659, mean=0.742, max=0.796, sum=4.453 (6)

min=0.908, mean=0.951, max=1.006, sum=5.704 (6)

min=1999.426, mean=2039.888, max=2048.974, sum=12239.329 (6)

min=0.661, mean=0.741, max=0.794, sum=4.444 (6)

min=0.932, mean=0.994, max=1.015, sum=5.964 (6)

min=0.677, mean=0.764, max=0.819, sum=4.581 (6)

min=0.324, mean=0.331, max=0.339, sum=1.985 (6)

min=0.753, mean=0.85, max=0.892, sum=5.1 (6)

min=1996.331, mean=2038.685, max=2047.984, sum=12232.112 (6)

min=0, mean=0.016, max=0.029, sum=0.098 (6)

min=0.818, mean=0.918, max=0.973, sum=5.51 (6)

min=0.842, mean=0.977, max=1.018, sum=5.861 (6)

min=0.238, mean=0.239, max=0.239, sum=1.433 (6)

min=0.83, mean=0.958, max=1.005, sum=5.748 (6)

min=0.119, mean=0.12, max=0.12, sum=0.721 (6)

min=0.885, mean=1.048, max=1.122, sum=6.29 (6)

min=0.133, mean=0.134, max=0.134, sum=0.801 (6)

min=0.948, mean=1.136, max=1.221, sum=6.818 (6)

min=0.144, mean=0.144, max=0.144, sum=0.864 (6)

min=0.72, mean=0.838, max=0.895, sum=5.028 (6)

min=2588.629, mean=3374.319, max=3780.026, sum=20245.913 (6)

min=0.726, mean=0.823, max=0.874, sum=4.937 (6)

min=0.28, mean=0.317, max=0.337, sum=1.904 (6)

min=1.022, mean=1.192, max=1.269, sum=7.153 (6)

min=0.156, mean=0.156, max=0.156, sum=0.937 (6)

min=1.13, mean=1.326, max=1.401, sum=7.957 (6)

min=0.167, mean=0.168, max=0.169, sum=1.011 (6)

min=1.672, mean=1.975, max=2.065, sum=11.85 (6)

min=0.119, mean=0.12, max=0.12, sum=0.719 (6)

ICE (International Corpus of English)

ice_gender:female

min=1.127, mean=1.127, max=1.127, sum=1.127 (1)

min=2039.48, mean=2039.48, max=2039.48, sum=2039.48 (1)

min=0.946, mean=0.946, max=0.946, sum=0.946 (1)

min=0.833, mean=0.833, max=0.833, sum=0.833 (1)

min=0.922, mean=0.922, max=0.922, sum=0.922 (1)

min=0.966, mean=0.966, max=0.966, sum=0.966 (1)

min=0.888, mean=0.888, max=0.888, sum=0.888 (1)

min=0.85, mean=0.85, max=0.85, sum=0.85 (1)

min=3050.888, mean=3050.888, max=3050.888, sum=3050.888 (1)

min=0.88, mean=0.88, max=0.88, sum=0.88 (1)

min=0.917, mean=0.917, max=0.917, sum=0.917 (1)

min=0.867, mean=0.867, max=0.867, sum=0.867 (1)

min=1.431, mean=1.431, max=1.431, sum=1.431 (1)

min=3580.979, mean=3580.979, max=3580.979, sum=3580.979 (1)

min=1.893, mean=1.893, max=1.893, sum=1.893 (1)

min=0.746, mean=0.746, max=0.746, sum=0.746 (1)

min=1.144, mean=1.144, max=1.144, sum=1.144 (1)

min=2044.125, mean=2044.125, max=2044.125, sum=2044.125 (1)

min=2045.509, mean=2045.509, max=2045.509, sum=2045.509 (1)

min=0.969, mean=0.969, max=0.969, sum=0.969 (1)

min=0.691, mean=0.691, max=0.691, sum=0.691 (1)

min=1.008, mean=1.008, max=1.008, sum=1.008 (1)

min=0.534, mean=0.534, max=0.534, sum=0.534 (1)

min=1.174, mean=1.174, max=1.174, sum=1.174 (1)

min=0.573, mean=0.573, max=0.573, sum=0.573 (1)

min=0.952, mean=0.952, max=0.952, sum=0.952 (1)

min=1.041, mean=1.041, max=1.041, sum=1.041 (1)

min=1.067, mean=1.067, max=1.067, sum=1.067 (1)

min=2017.721, mean=2017.721, max=2017.721, sum=2017.721 (1)

min=0.985, mean=0.985, max=0.985, sum=0.985 (1)

min=0.983, mean=0.983, max=0.983, sum=0.983 (1)

min=0.78, mean=0.78, max=0.78, sum=0.78 (1)

min=0.514, mean=0.514, max=0.514, sum=0.514 (1)

min=2046.318, mean=2046.318, max=2046.318, sum=2046.318 (1)

min=0.774, mean=0.774, max=0.774, sum=0.774 (1)

min=0.924, mean=0.924, max=0.924, sum=0.924 (1)

min=2045.722, mean=2045.722, max=2045.722, sum=2045.722 (1)

min=0.763, mean=0.763, max=0.763, sum=0.763 (1)

min=0.999, mean=0.999, max=0.999, sum=0.999 (1)

min=0.787, mean=0.787, max=0.787, sum=0.787 (1)

min=0.326, mean=0.326, max=0.326, sum=0.326 (1)

min=0.865, mean=0.865, max=0.865, sum=0.865 (1)

min=2045.321, mean=2045.321, max=2045.321, sum=2045.321 (1)

min=0.022, mean=0.022, max=0.022, sum=0.022 (1)

min=0.944, mean=0.944, max=0.944, sum=0.944 (1)

min=1.018, mean=1.018, max=1.018, sum=1.018 (1)

min=0.239, mean=0.239, max=0.239, sum=0.239 (1)

min=0.986, mean=0.986, max=0.986, sum=0.986 (1)

min=0.12, mean=0.12, max=0.12, sum=0.12 (1)

min=1.084, mean=1.084, max=1.084, sum=1.084 (1)

min=0.134, mean=0.134, max=0.134, sum=0.134 (1)

min=1.173, mean=1.173, max=1.173, sum=1.173 (1)

min=0.144, mean=0.144, max=0.144, sum=0.144 (1)

min=0.895, mean=0.895, max=0.895, sum=0.895 (1)

min=3518.653, mean=3518.653, max=3518.653, sum=3518.653 (1)

min=0.872, mean=0.872, max=0.872, sum=0.872 (1)

min=0.324, mean=0.324, max=0.324, sum=0.324 (1)

min=1.241, mean=1.241, max=1.241, sum=1.241 (1)

min=0.156, mean=0.156, max=0.156, sum=0.156 (1)

min=1.376, mean=1.376, max=1.376, sum=1.376 (1)

min=0.169, mean=0.169, max=0.169, sum=0.169 (1)

min=2.05, mean=2.05, max=2.05, sum=2.05 (1)

gender: female

ice_gender:male

min=0.883, mean=0.883, max=0.883, sum=0.883 (1)

min=1.128, mean=1.128, max=1.128, sum=1.128 (1)

min=2042.905, mean=2042.905, max=2042.905, sum=2042.905 (1)

min=0.931, mean=0.931, max=0.931, sum=0.931 (1)

min=0.834, mean=0.834, max=0.834, sum=0.834 (1)

min=0.904, mean=0.904, max=0.904, sum=0.904 (1)

min=0.967, mean=0.967, max=0.967, sum=0.967 (1)

min=0.871, mean=0.871, max=0.871, sum=0.871 (1)

min=3000.471, mean=3000.471, max=3000.471, sum=3000.471 (1)

min=0.863, mean=0.863, max=0.863, sum=0.863 (1)

min=0.901, mean=0.901, max=0.901, sum=0.901 (1)

min=0.849, mean=0.849, max=0.849, sum=0.849 (1)

min=1.423, mean=1.423, max=1.423, sum=1.423 (1)

min=3584.816, mean=3584.816, max=3584.816, sum=3584.816 (1)

min=1.75, mean=1.75, max=1.75, sum=1.75 (1)

min=0.738, mean=0.738, max=0.738, sum=0.738 (1)

min=1.15, mean=1.15, max=1.15, sum=1.15 (1)

min=2048.155, mean=2048.155, max=2048.155, sum=2048.155 (1)

min=0.906, mean=0.906, max=0.906, sum=0.906 (1)

min=0.947, mean=0.947, max=0.947, sum=0.947 (1)

min=2047.776, mean=2047.776, max=2047.776, sum=2047.776 (1)

min=0.692, mean=0.692, max=0.692, sum=0.692 (1)

min=0.929, mean=0.929, max=0.929, sum=0.929 (1)

min=1.015, mean=1.015, max=1.015, sum=1.015 (1)

min=1.048, mean=1.048, max=1.048, sum=1.048 (1)

min=2019.815, mean=2019.815, max=2019.815, sum=2019.815 (1)

min=0.976, mean=0.976, max=0.976, sum=0.976 (1)

min=0.962, mean=0.962, max=0.962, sum=0.962 (1)

min=0.773, mean=0.773, max=0.773, sum=0.773 (1)

min=0.516, mean=0.516, max=0.516, sum=0.516 (1)

min=2048.762, mean=2048.762, max=2048.762, sum=2048.762 (1)

min=0.765, mean=0.765, max=0.765, sum=0.765 (1)

min=0.932, mean=0.932, max=0.932, sum=0.932 (1)

min=2048.615, mean=2048.615, max=2048.615, sum=2048.615 (1)

min=0.759, mean=0.759, max=0.759, sum=0.759 (1)

min=1.007, mean=1.007, max=1.007, sum=1.007 (1)

min=0.782, mean=0.782, max=0.782, sum=0.782 (1)

min=0.339, mean=0.339, max=0.339, sum=0.339 (1)

min=2047.764, mean=2047.764, max=2047.764, sum=2047.764 (1)

min=0.013, mean=0.013, max=0.013, sum=0.013 (1)

min=0.93, mean=0.93, max=0.93, sum=0.93 (1)

min=1.013, mean=1.013, max=1.013, sum=1.013 (1)

min=1.062, mean=1.062, max=1.062, sum=1.062 (1)

min=1.148, mean=1.148, max=1.148, sum=1.148 (1)

min=3513.665, mean=3513.665, max=3513.665, sum=3513.665 (1)

min=1.208, mean=1.208, max=1.208, sum=1.208 (1)

min=1.341, mean=1.341, max=1.341, sum=1.341 (1)

min=2.001, mean=2.001, max=2.001, sum=2.001 (1)

gender: male

ice_subset:ea

min=0.984, mean=0.984, max=0.984, sum=0.984 (1)

min=1701.758, mean=1701.758, max=1701.758, sum=1701.758 (1)

min=0.829, mean=0.829, max=0.829, sum=0.829 (1)

min=0.736, mean=0.736, max=0.736, sum=0.736 (1)

min=0.805, mean=0.805, max=0.805, sum=0.805 (1)

min=0.852, mean=0.852, max=0.852, sum=0.852 (1)

min=0.776, mean=0.776, max=0.776, sum=0.776 (1)

min=0.749, mean=0.749, max=0.749, sum=0.749 (1)

min=1912.511, mean=1912.511, max=1912.511, sum=1912.511 (1)