Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

serialization + kryo support #23

Open
eyalfa opened this issue Feb 19, 2017 · 6 comments
Open

serialization + kryo support #23

eyalfa opened this issue Feb 19, 2017 · 6 comments

Comments

@eyalfa
Copy link
Contributor

eyalfa commented Feb 19, 2017

Hi,
currently the BloomFilter and its buffer are not serializable, can this be added?
same goes for kryo support, can be added with an optional dependency (I've actually already implemented this as part of my spark application)

another related issue, the provided to/from stream methods work one long at a time. haven't really benchmarked this but my intuition is that this is slowwwww. I suggest modify the current methods or add new ones that takes/allocates a buffer and leverage unsafe's ability to copy memory ranges (spark tungsten's style)

will you be willing to accept pull requests?

thanks,
Eyal.

@alexandrnikitin
Copy link
Owner

Hi Eyal,

Thank you for the suggestions! Yes, definitely! Pull requests are welcome!

@eyalfa
Copy link
Contributor Author

eyalfa commented Mar 21, 2017

@alexandrnikitin, I'm happy I could assist with the Java serialization support😎
I'd like to move on to kryo support, do you prefer the serializers as part of the core bloom filters library with an optional dependency on kryo, or an additional sub project with a strong dependency on kryo?

@alexandrnikitin
Copy link
Owner

Great! I think a sub project for kryo is a better option.

@eyalfa
Copy link
Contributor Author

eyalfa commented Mar 21, 2017 via email

@kdsandip
Copy link

have you added kryo support to this bloomfilter??/

@alexandrnikitin
Copy link
Owner

Not yet. As I see @eyalfa has done some work in the fork's branch https://github.com/eyalfa/bloom-filter-scala/commits/kryo_support @kdsandip Would you have time to review and continue the work?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants