Unsure

I read on here about being surprised, and I had a similar experience a couple of years ago.
One afternoon I was over at a friend’s place and we were just hanging out together and feeling bored. We joked about fooling around together just for fun, so we got naked and started doing that. I had never done that with another guy, and I don’t think that he had either. But it was fun and exciting. He admitted that he as curious about what it would be like to have another guy do it to him. So I had anal sex with him. It was an interesting experience for both of us doing that together as guys. And we both actually rather enjoyed it.
Needless to say we had anal sex a number more times and without realizing or intending to, we found ourselves starting to have this guy affair. While we both more or less liked it, we also felt unsure and uncomfortable about where this was leading to. So we both decided to call to quits. We weren’t the best of friends, so our friendship more or less faded after that.
Now, looking back, I wonder if we weren’t being over cautious, and I half think that it wouldn’t have been necessarily all that bad if our relationship had continued like it was. During that time afterwards I didn’t go on to become involved in any sort of serious male-female relationships so would have been a bad thing enjoying something with another guy? I have serious asked myself this and of course he moved away so now I will never know.