Skip to content

fix incorrect vocabs when loading from utf-8 binary - #38

Open
thangntt2 wants to merge 1 commit into
medallia:masterfrom
thangntt2:fix_utf8_binary
Open

fix incorrect vocabs when loading from utf-8 binary#38
thangntt2 wants to merge 1 commit into
medallia:masterfrom
thangntt2:fix_utf8_binary

Conversation

@thangntt2

Copy link
Copy Markdown

Hi. I'm very grateful for your work in porting Word2vec to Java and it's a great job, I think. But I have a trouble when parse UTF-8 binary file (from Vietnamese corpus), the Vocabs was incorrect. So I fixed it by some ugly line of code :D. Review it and turn it to your clean code.
P/S If you wanna get an UTF-8 binary example, email me at thangtq@seespace.co and sorry for my Eng :D
I look forward to hearing from you.

@woidda

Copy link
Copy Markdown

should be also fixed in #34

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@thangntt2@woidda