How do you know that there are no other components besides the brain that cause there to be subjective experience? One might very well suspect that there is something more, considering that no arrangement of physical parts has come close to qualitatively being the same as a subjective experience.
Your soul could be observing your body and being affected by it. While your memories and feelings are in the body, your subjective experience of them may not be.
Your soul could be observing your body and being affected by it. While your memories and feelings are in the body, your subjective experience of them may not be.