Borra Caves were formed as a result of the flow of Gosthani River on the limestone deposits. These caves are known for stalactite and stalagmite formations such as Shiva-Parvathi.
Four storied Undavalli Caves are located 8 km away from Vijayawada. This cave belongs to the 7th century BC and is one of the earliest types of caves in this region.