Corali-Lang Benchmark: Detailed Analysis

GEMMA 4 26B A4B


For the Gemma 4 26B A4, the results were more or less the same as those for the Gemini 3 Flash Preview and Gemini 3.1 Pro Preview. The only drawback was that in story question number 4, there was one incorrect answer “finishad” due to a misunderstanding of the context, but for the application of the Corali language with the addition of -ad, the model was able to understand correctly.

The strength of this model
– can understand long contexts, unfazed by misleading Coral’s fashion descriptions,
– can learn a new language: Corali language without being fixated on English,
– can absorb data from narratives, not just explicit rules
– can read Corali language patterns well and apply them to other English words

The weakness of this model
– make mistakes when understanding the context

Categories: AI Benchmark

Cookies Notice

Our website use cookies. If you continue to use this site we will assume that you are happy with this.