TCB: Accelerating Transformer Inference Services with Request Concatenation.

Boqian Fu Fahao Chen Peng Li Deze Zeng

Published in: ICPP (2022)

Keyphrases

web services
user requests
service oriented
service providers
power system
probabilistic inference
information services
ubiquitous computing
service oriented architecture
context aware
service composition
service discovery
user centric
expert systems
service requests