I've used OpenGL but i really don't like this due to limitations...
I'd like you to explain to me where OpenGL has that much limitations. In the world we live in today there are only 2 logical choices. OpenGL and DX. Where OpenGL might have even more rendering features that DX.
Even most game engines today use OpenGL and DX. (Where the user can choose a rendering device).
Unless you mean that the wrappers released for Java does not make efficient use of the library, I think you are mistaken. Because with my experience OpenGL has very little limitations. Although I must say, OpenGL is pretty hard if you have never used it before. Also if you have little knowledge with 3D math, OpenGL also doesn't help very much. So I don't think OpenGL is the problem. I think because you are new to 3D, the logic might seem very odd to you, making the library look limited.
You know what I think you need? Instead of using the powerful low-level access library of OpenGL, maby you should use a high-level, more limited, library built up from OpenGL. Try this
link. The logic makes more sense, and it's easier to use.