fix: pinecone metadata format

[jamescalam]

Related Issues

• fixes Error with classification with PineconeDocumentStore #3659

Proposed Changes:

The linked issue is caused by incompatibility for multilevel metadata dictionaries in Pinecone. To fix the issue, I added metadata processing steps to flatten (and 'un-flatten') the metadata dictionaries.

How did you test it?

Using this notebook

Notes for the reviewer

N/A

Checklist

• I have read the contributors guidelines and the code of conduct
• I have updated the related issue with new insights and changes
• I added tests that demonstrate the correct behavior of the change
• I've used the conventional commit convention for my PR title
• I documented my code
• I ran pre-commit hooks and fixed any issue

[ZanSara]

Hello @jamescalam, thank you for this fix! Would you mind adding a few tests in the Pinecone test suite? We have recently improved the test suite and this is a good occasion to add another test. https://github.com/deepset-ai/haystack/blob/main/test/document_stores/test_pinecone.py I'll review the code in the meantime.

[jamescalam]

Hello @jamescalam, thank you for this fix! Would you mind adding a few tests in the Pinecone test suite? We have recently improved the test suite and this is a good occasion to add another test. https://github.com/deepset-ai/haystack/blob/main/test/document_stores/test_pinecone.py I'll review the code in the meantime.

@ZanSara great thanks! I added a new test at the end of the current set of tests. It writes a multilayer metadata dictionary, filters for it, and returns and tests that it is in the same format as when it was added.

[ZanSara]

Thank you for the test! I left a couple more questions.

[ZanSara]

Thank you! 😊