Double Sliding Window Chunking Algorithm for Data Deduplication in Ocean Observation.
Shuai GuoXiaodong MaoMeng SunShuang WangPublished in: IEEE Access (2023)
Keyphrases
- sliding window
- high speed data streams
- input data
- fixed size
- data streams
- stream data
- data sets
- window size
- preprocessing
- database
- data sources
- boyer moore
- sensor data
- space efficient
- data structure
- walsh hadamard transform
- variable size
- disk resident data
- limited memory
- memory space
- historical data
- data points
- search algorithm
- data mining