Must also allow configurable parameters for temperature and max tokens. The preview version of 3.5. turbo and 4 chat mode includes a system parameter so when out of preview, we will need to specify the system parameter. We do not want to inject data into the system parameter so best practice is to inject into a 'user' entry in the transcript which may require transcript management features. Please get in touch with me to discuss what we've done in this regard.
Must also allow configurable parameters for temperature and max tokens. The preview version of 3.5. turbo and 4 chat mode includes a system parameter so when out of preview, we will need to specify the system parameter. We do not want to inject data into the system parameter so best practice is to inject into a 'user' entry in the transcript which may require transcript management features. Please get in touch with me to discuss what we've done in this regard.