>>101175352
okay seems like it's a classic case of llama.cpp tokenization being fucked, special tokens are getting mangled
2 -> '<bos>'
968 -> ' <'
2997 -> 'start'
235298 -> '_'
559 -> 'of'
235298 -> '_'
15508 -> 'turn'
235313 -> '>'
1645 -> 'user'
108 -> '
'
2195 -> 'test'
235322 -> '<'
615 -> 'end'
235298 -> '_'
559 -> 'of'
235298 -> '_'
15508 -> 'turn'
235313 -> '>'
108 -> '
'