Corali-Lang Benchmark: Detailed Analysis

GEMMA 4 31B


From the results it can be seen that Gemma 4 31B has more or less the same capabilities as Gemma 4 26B A4B, but it is more difficult to understand the context than Gemma 4 26B A4B so it can make mistakes.

The answer “Findad” is wrong, while “Discoverad” is less appropriate for story question number 5. However, the application of the Corali language with the suffix -ad was successful, so the weakness lies in understanding the context, not the ability to read and apply patterns.

The strength of this model
– can understand long contexts, unfazed by misleading Coral’s fashion descriptions,
– can learn a new language: Corali language without being fixated on English,
– can absorb data from narratives, not just explicit rules
– can read Corali language patterns well and apply them to other English words

The weakness of this model
– make mistakes when understanding the context

Categories: AI Benchmark

Cookies Notice

Our website use cookies. If you continue to use this site we will assume that you are happy with this.