@Test
    public void testWordPieceEmbedding() {
        var tester = new EmbedderTester(new WordPieceEmbedder.Builder(vocabulary).build());
        tester.assertEmbedded("what was the impact of the manhattan project",
                              "tensor(x[8])",
                              2054, 2001, 1996, 4254, 1997, 1996, 7128, 2622);
    }
Tests the WordPiece embedder

@author bratseth
linguistics-components/src/test/java/com/yahoo/language/wordpiece/WordPieceEmbedderTest.java