DICE: Detecting In-distribution Contamination in LLM's Fine-tuning Phase for Math Reasoning.
Shangqing TuKejian ZhuYushi BaiZijun YaoLei HouJuanzi LiPublished in: CoRR (2024)
Keyphrases
- fine tuning
- viable alternative
- fine tuned
- fine tune
- uniformly distributed
- real time
- spatial distribution
- genetic algorithm
- reasoning systems
- reasoning process
- automated reasoning
- spatial reasoning
- probabilistic reasoning
- knowledge representation
- knowledge base
- artificial intelligence
- production rules
- automatic detection
- steady state
- general purpose
- power law
- qualitative reasoning
- probability distribution
- learning phase
- domain knowledge
- uncertain information
- expert systems
- multi agent
- reasoning mechanisms