Fix WordPieceDecoder crash on empty input and ByteFallbackDecoder trailing byte drop - #358

Fix WordPieceDecoder crash on empty input and ByteFallbackDecoder trailing byte drop#358

pcuenca merged 6 commits into

huggingface:mainhuggingface/swift-transformers:mainfrom

john-rocky:fix/decoder-empty-input-and-trailing-bytesjohn-rocky/swift-transformers:fix/decoder-empty-input-and-trailing-bytesCopy head branch name to clipboard