NYU CTF Dataset: A Scalable Open-Source Benchmark Dataset for Evaluating LLMs in Offensive Security.
Minghao ShaoSofija JancheskaMeet UdeshiBrendan Dolan-GavittHaoran XiKimberly MilnerBoyuan ChenMax YinSiddharth GargPrashanth KrishnamurthyFarshad KhorramiRamesh KarriMuhammad ShafiquePublished in: CoRR (2024)
Keyphrases
- benchmark datasets
- open source
- open source software
- security problems
- information security
- security requirements
- intrusion detection
- security issues
- information assurance
- pedestrian detection
- access control
- statistical databases
- functional requirements
- highly scalable
- computer security
- security analysis
- security systems
- terms of classification accuracy
- security policies
- security management
- security mechanisms
- security threats
- sensitive data
- security protocols
- web scale
- database
- database systems