I think what you are experiencing is similar to me and why I downsized and tried different fin set-ups. If you ever want to drive farther south and meet up- fun, beautiful punchy beach break to try.The Ghost is epic. The last time I was in Indo I rode a 3 board Pyzel quiver and it was insane. 5'11 round tail phantom, 6'1 radius, and 6'2 ghost. I still have two ghosts in my quiver and they are undoubtedly awesome boards. I have really solid memories of surfing uncrowded well overhead plate glass race tracks on the radius and having the time of my life.
Definitely going to switch up the fins (smaller thrusters, try it as a quad). See how it goes like that. If the board is meant to be for better surf and it has to be kind of pushy and round then I'm skeptical. The board is just too chunky and corky for me to believe it will be fun in those conditions but you never know. Definitely think this just might not be my jam and it's going to be a YOLO gone wrong.
These are the typical waves that I am surfing the MG in (picture is not me)