A castle located in the city of Takatsuki in Osaka, it was said to have been built as a small fort in 990, but is first mentioned by name in written records of the Battle of Katsura-kawara of 1527 when Yakushiji Kuninaga of Yamazaki Castle attacked Hatano Motokiyo, and Takatsuki Castle fell.

When Miyoshi Nagayoshi made Akutagawayama Castle his main castle in 1553, Takatsuki Castle became one of his supporting castles with Irie Harutsugu as its lord. After Nagayoshi died in 1564, the Miyoshi Three took control of the region, but when Nobunaga attacked Settsu, both Akutagawayama and Takatsuki fell on Sept. 28, 1568.

Wada Koremasa took over both castles the next year, but perished at the Battle of Shirai-kawara.

Takayama Tomoteru and his son Takayama Ukon took control of the castle in 1576.