These are the twin hills 7 Kms from Bhubaneshwar. The 135 ft high Udaygiri and 118 ft high Khandagiri hills have ancient caves. Khandagiri means "Broken Hill" and Udaygiri means "Hill of the Sunrise." The caves on the two low hills of Udaygiri and Khandagiri give ample proof of Jain and Buddhist occupation. This served as the site of an ancient Jain monastery, which was carved into cave like chambers in the face of the hill. The twin hills of Kumargiri and Kumarigiri known as Khandagiri and Udaygiri contain varieties of rock-cut caves. Dating back to the 2nd century BC, some of the caves have beautiful carvings.
The Rani Gumpha (Queen's Cave) - one of the largest and double-storied is ornately embellished with beautiful carvings. In the Hati Gumpha (Elephant Cave), King Kharavela carved out the chronicles of his reign. It is a magnificent specimen of Pali records so far found in India.