Is there a way to restrict the visibility of flagged objects? 

No. It is not possible to restrict the visibility of flagged objects in the Manage reports tab. Admins and applicable admin groups can view all flagged comments, content, and chat messages from across the Fuse instance.