Botany Bay is a shallow bay south of the center of Sydney. It is mostly surrounded by suburbs and industrial areas, and some runways of the Sydney International Airport are built on dams in the bay. In the midst of all these industrial buildings, though, you will find a beautiful coastline and park landscape! The Botany Bay National Park protects the northern and southern entry to the bay and is often used as picknick location. The coast has some spectacularly coloured washed-out sandstone cliffs.
Btw, there is a large campground in the Botany Bay area which also has reasonably-priced (though maybe a bit dusty) cabins!