There are two ways to remove the labels from the map.
You can simply drag the labels outside the box as shown below:
You can also access the “Base map” section and select the “base map labels.” Now you will have access to an overview of all the labels where you can easily enable or disable each one of the labels.