Component donation: bloomfilterprocessor

[atoulme]

Building and distributing outside this repository

• I understand I can use and distribute my component outside of this repository.

Existing component implementation

https://github.com/atoulme/bloomfilterprocessor

Components covering similar use cases

logdedupprocessor is similar but doesn't use bloom filters.

The purpose and use-cases of the component

Dedup logs efficiently with bloom filters. Bloom filters is an efficient data structure to check the presence of an element in a set with a controlled false positive rate.

Example configuration for the component

processors:
  bloomfilter:
    capacity: 100000000
    false_positive_rate: 0.1
    rotation_interval: 5m
    force_rotation: false

Telemetry data types supported

logs

Code Owners

atoulme TODO TODO

Sponsor (optional)

TODO

Additional context

Not in a hurry to get this in ; testing our new criteria for component inclusion and having fun with computer science!

Tip

_{React with 👍 to help prioritize this issue. Please use comments to provide useful context, avoiding +1 or me too, to help us triage it. Learn more here.}

[ishaish103]

@atoulme having this would be great as ive implemented something really similar myself for my needs