having said that

Từ điển Oxford Advanced Learner 8th

ˌhaving ˈsaid that idiom
(informal)used to introduce an opinion that makes what you have just said seem less strong
•I sometimes get worried in this job. Having said that, I enjoy doing it, it's a challenge.
Main entry: ↑say_idiom