Allow documents to be loaded locally for Knowledge Injection

[murthyrudra]

I have updated the knowledge.json in v3 schema to include an optional field named folder which points to the local filesystem. For this update, I had to make the fields repo and commit optional instead of required.

The users can specify the folder as follows in the qna.yaml file in the taxonomy

document_outline: |
  The document contains information about Electromagnetism.
document:
  folder: /user/murthyrudra/documents/
  patterns:
    - "*.md"

[bjhargrave]

This change would also be a move to v4 since it is adding a new feature and anyone using the new feature would need to be able to specify their dependence by declaring the document is v4.

Has such a change like this been discussed and agreed in a design doc for the whole project since many parts of instructlab will need coordinated changes?

[bjhargrave]

I don't think you have properly specified the oneOf choice here correctly in JSON schema. It is one of either repo+commit or folder.