Zero-Space Cost Fault Tolerance for Transformer-based Language Models on ReRAM.
Bingbing LiGeng YuanZigeng WangShaoyi HuangHongwu PengPayman BehnamWujie WenHang LiuCaiwen DingPublished in: CoRR (2024)
Keyphrases
- fault tolerance
- language model
- fault tolerant
- language modeling
- distributed systems
- n gram
- document retrieval
- probabilistic model
- retrieval model
- language modelling
- load balancing
- information retrieval
- test collection
- speech recognition
- query expansion
- statistical language models
- response time
- group communication
- database replication
- peer to peer
- mobile agents
- context sensitive
- fault management
- language model for information retrieval
- term dependencies
- relevance model
- translation model
- replicated databases
- ad hoc information retrieval
- vector space model
- smoothing methods
- query terms
- failure recovery
- vector space
- text classification
- single point of failure
- language models for information retrieval
- low dimensional
- database systems