Although built as a pleasure building, Jinjira Palace later became a cruel prison of deep sorrow. The family of Nawab Sarfaraz Khan and the family of the last independent Nawab of Bengal, Sirajuddaula, were imprisoned in this palace for several years. As a result of the conspiracy of the traitor Mir Jafar’s son Miran, Alivardi Khan’s wife Sharifunnesa, Alivardi Khan’s daughter and Sirajuddaula’s mother Amena Begum, Sirajuddaula’s aunt Ghaseti Begum, wife Lutfunnesa and infant daughter Umme Johra were imprisoned.