it's a shame that
辛い時しか会えないのが残念だわ
It’s a shame we can only see each other when things are tough.
— 鏡 (1975)
今日あなたといっしょに行けないのが残念だ。
It's a shame I can't go with you today.
君が来られないのが残念だ。
It's a shame you can't come.
彼女がここにいないのが残念だ。
It's a shame she's not here.