Comment by bethecloud

open-assistant from LAION is in the process of creating an OSS RLHF dataset for a personal assistant, may be useful for this project