feat: implement the complete bpe function (#119)

* implement the complete bpe function
---------

Co-authored-by: leejet <leejet714@gmail.com>
This commit is contained in:
旺旺碎冰冰
2023-12-23 12:11:07 +08:00
committed by GitHub
parent 8f6b4a39d6
commit 0e64238e4c
4 changed files with 95 additions and 11 deletions

View File

@@ -7,7 +7,7 @@ IndentCaseLabels: false
ColumnLimit: 0
AccessModifierOffset: -4
NamespaceIndentation: All
FixNamespaceComments: false
FixNamespaceComments: false
AlignAfterOpenBracket: true
AlignConsecutiveAssignments: true
IndentCaseLabels: true