Wondering

Two years ago a friend and I started fooling around together just for fun, and we thoroughly enjoyed doing this and it became a regular thing for us.
Nearby to where we live is a small artistically oriented town with a number of gays. We started going there to hang out where nobody knows us and we can be openly together in public and not have to worry about it. It just feels so good being able to be ourselves.
Now we are planning to move there and live openly together. Although neither of us think of ourselves as being gay as such. My question is can there be a difference?