Skip to content
Advertisement

How to specify a column for Prediction in Haystack?

I am using an OpenSearchDocumentStore to store my data an feed it to my Haystack pipeline, the data includes uuids and other information, that are not relevant for the prediction but need to stack in the DocumentStore (I was told). Now I wonder if there is a way or need to specify a special Inputtext “column” for the retriever and reader.

Advertisement

Answer

Other information that are not relevant for retrieval should stay in the meta field of Documents. For example you could create documents like:

doc = Document(
    content="this is relevant for retrieval", 
    meta={"uuid": "1234",  "comment": "this won't be used for retrieval"}
)
User contributions licensed under: CC BY-SA
4 People found this is helpful
Advertisement