Batch text processing

[Definelymes]

Hi, I was wondering if there is a feature (or would be in future) to process multiple texts at a same time instead of processing them one by one in sequential manner.

[urchade]

You can do it like this:

def batch_predict_entities(self, texts, labels, flat_ner=True, threshold=0.5):
        """
        Predict entities for a batch of texts.
        texts:  List of texts | List[str]
        labels: List of labels | List[str]
        ...
        """

[Definelymes]

Thank you very much, I tried this approach and came accross this issue:
#63

Is there any plan to resolve it anytime soon on the new releases?

[urchade]

Fixed now. You can install v0.1.9 @Definelymes

[Hitish99]

Hi @urchade Urchade
Can you please share that while batch inference text are processed in parallel or concurrent?

[urchade]

Hi, The batch processing are processed in parallel @Hitish99