I am facing issues while converting the prompt completion data set into a jsonl file. I am keeping the dataset in a text file and then converting into a jsonl file.
my data set is below:
{"prompt":"Property Usage=Principal Residence, Transaction Type=Purchase, Number of Units=1 Unit", "completion":"The Maximum LTV,CLTV,HCLTV for FRM is 95% and ARM is 95% for property usage Principal residence, transaction type purchase and number of units is one"}
{"prompt":"Property Usage=Principal Residence, Transaction Type=Purchase, Number of Units=2 Unit", "completion":"The Maximum LTV,CLTV,HCLTV for FRM is 85% and ARM is 85% for property usage Principal residence, transaction type purchase and number of units is one"}
When it gets converted into jsonl:
{"prompt":"","completion":"{\"prompt\":\"Property Usage=Principal Residence, Transaction Type=Purchase, Number of Units=1 Unit\", \"completion\":\"The Maximum LTV,CLTV,HCLTV for FRM is 95% and ARM is 95% for property usage Principal residence, transaction type purchase and number of units is one\"}"}
{"prompt":"","completion":"{\"prompt\":\"Property Usage=Principal Residence, Transaction Type=Purchase, Number of Units=2 Unit\", \"completion\":\"The Maximum LTV,CLTV,HCLTV for FRM is 85% and ARM is 85% for property usage Principal residence, transaction type purchase and number of units is one\"}"}
The prompt and completion is not as per the fine tuning model when it gets converted. Kindly help how to do a proper conversion.
Top comments (0)