Simply click "Configuration Files" > Open GameUserSettings.ini [ Text Editor ]
Add the following line to the file under the [ServerSettings] section.
Click "SAVE" at the top left. Restart your server and then login to the server. You will now find that you can build inside caves.
If you would like to purchase an Ark server click here