Hybrid doc search e2e fails with DuplicateDocumentError

[julian-risch]

Here is the test run https://github.com/deepset-ai/haystack/actions/runs/9342231146/job/25710027363
which fails with a DuplicteDocumentError.

We are calling write_documents twice, writing documents with the same content once without embeddings and once with embeddings:

hybrid_pipeline.get_component("bm25_retriever").document_store.write_documents(documents)
        doc_embedder = SentenceTransformersDocumentEmbedder(model="sentence-transformers/all-MiniLM-L6-v2")
        doc_embedder.warm_up()
        embedded_documents = doc_embedder.run(documents=documents)["documents"]
>       hybrid_pipeline.get_component("embedding_retriever").document_store.write_documents(embedded_documents)

The error occurs since we merged feat: Add memory sharing between different instances of InMemoryDocumentStore