Google ships EmbeddingGemma 2, an open multimodal embedding model for RAG
| Parameter | Before | Now |
|---|---|---|
| Base architecture | Not specified | Gemma 4-based decoder |
| Parameters | Not specified | 270M (text/code) up to 740M (full multimodal) |
| Embedding space | Not specified | Shared 768-dimensional space across modalities |
| Context window | Not specified | 8,192 tokens |
| Dimension truncation | Not specified | Matryoshka Representation Learning, 768 down to 128 dimensions |
| Code retrieval benchmark (MTEB Code) | EmbeddingGemma 1 baseline | +14% score vs EmbeddingGemma 1 |
| License | Not specified | Apache 2.0 |