Windows Core

For very basic configuration the login terminal has got you covered (if you close it run sconfig).

For most GUI administration start Computer Manager from another server and connect to Windows Core server (Or for windows 10 use RSAT).

From everything else run powershell