The problem is Optimization and the lack thereof in Unity based games with very high View Distance. I've been searching everywhere, people even with upto GTX 1080's and far better CPU's have been experiencing lag and I just remembered one other Unity based game that looked similar and had the same problem Starforge. It is fun however, it had some serious lag issues. Just bought and started playing this game recently.