It's perfectly OK for fiction to have a little nugget of reality wrapped inside it to add flavor. I sometimes use characters from my childhood, real settings from my childhood, and snippets of real happenings. However, I use them as building blocks in totally fictional stories.
For example: The one time that I really remember my father spanking me, I barely remember the spanking itself, but I vividly remember him casting about my bedroom in search of an appropriate implement. He considered and rejected a belt, and then he tore a wooden hanger apart and swished the dowel rod in the air before casting it away. Finally he settled on a scrap of knotty pine paneling left over from the construction of my bedroom. That scene is in the story "Knotty Pine", but the story itself is fiction.
My two recent "Gym" stories were fiction based on ancient memories of real characters and my actual elementary school gymnasium which, disgustingly enough, also served as our cafeteria.
I guess it's good that if all of my stories were based on actual spankings (experienced or witnessed), my story list would be much shorter.

Guy