Question

I know you had gone alone to see the hermit... change the voice

Answer 1

It was known by me that you had gone alone to see the hermit.

Answer 2

Hey Dude,
The answer will be

It was known to me that you had gone to see the hermit alone.