Login / Signup

Metron: Holistic Performance Evaluation Framework for LLM Inference Systems.

Amey AgrawalAnmol AgarwalNitin KediaJayashree MohanSouvik KunduNipun KwatraRamachandran RamjeeAlexey Tumanov
Published in: CoRR (2024)
Keyphrases
  • main contribution
  • inference process
  • theoretical framework
  • distributed systems
  • intelligent systems
  • computer systems
  • probabilistic inference
  • neural network
  • learning environment
  • graphical models
  • belief networks