Support batch size > 1 - #80

xwang365 wants to merge 2 commits into

Support batch size > 1#80
xwang365 wants to merge 2 commits into
FasterDecoding:mainfrom
xwang365:bs_develop

bs>1 update and server (#2)