Any end-end inference example with Google Colab & HuggingFace

[ramsrigouthamg]

Hi Team,

Thanks a lot for this.

Few questions -

1. Is the speedup only for GPU or the inference on CPU is also boosted?

2. Wondering if an inference example with T5/BART summarization from Huggingface etc can be provided in a colab notebook or so. Easier to adopt.

Sorry if it is a bit of a stretch to request this. Appreciate you reading this.

[yuyan2do]

Here is a colab notebook to do inference with BART.

https://github.com/microsoft/fastseq/blob/main/examples/EL-attention/README.md#example-usage

[teakay]

Hi, I tried to install using pip. But i got this error :

ModuleNotFoundError Traceback (most recent call last) Cell In[2], line 1
----> 1 import fastseq

File /opt/conda/lib/python3.10/site-packages/fastseq/init.py:9
6 from fastseq.logging import set_default_log_level
7 set_default_log_level()
----> 9 import fastseq.models # pylint: disable=wrong-import-position
10 import fastseq.optimizer # pylint: disable=wrong-import-position

ModuleNotFoundError: No module named 'fastseq.models'