@Test
    void testTokenIteratorNext() {
        HitField hf = new HitField("boo", "hei paa deg");
        assertEquals(3, hf.getTokenizedContent().size());
        ListIterator<?> l = hf.tokenIterator();
        FieldPart p = (FieldPart) l.next();
        assertEquals("hei", p.getContent());
        p = (FieldPart) l.next();
        assertEquals("paa", p.getContent());
        p = (FieldPart) l.next();
        assertEquals("deg", p.getContent());
        assertEquals(false, l.hasNext());
    }
Tests the FieldTokenIterator class

@author Steinar Knutsen
container-search/src/test/java/com/yahoo/prelude/hitfield/test/TokenFieldIteratorTestCase.java