The excursion boats go to a number of beaches on their trips around the island including Paliorema (where there is an abandoned mine), Tsigrado, and some of the other beaches mentioned above. The highlight of the trip though is dropping anchor at Kleftiko and jumping off the boats to swim around the giant rock formations in sea so blue you will spend as much time taking pictures as you will swimming. Not all the boats get close to the rocks so ask when you go to book. The Delfini which goes from Kypos and the catamaran owned by Captain Nikos will get you right up to the rocks.
Within the bay there is the town beach of Adamas, called Papikinou which is a long sandy beach shaded by trees, right next to the road that circles the bay. There is a beach in front of the power plant where you can see old people swimming in the thermal springs. Whether these are actually thermal springs or normal springs that are heated by the power plant I don't know. But I suppose it does not matter if it makes them feel good.
Further along the bay is a long sandy beach called Mavra Gremna and beyond that the beach called Hivadolimni with its salt water lake. Among the beaches I did not make it to but looked incredible in the local guidebook: Gerakas, Triades, Agios Ioannis, Firiplaka and Agia Kyriaki. You would need a month to see all the beaches on Milos and an off-road vehicle and a zodiac would help. But if you are coming for Greece to swim and would not mind spending your time between popular sandy beaches and isolated coves and rocks where you can be alone and swim in the clothes you were born in, you can't beat Milos.
Read more about the Greek islands at: www.greecetravel.com
