Brady, a minority owner at the club, expressed concern about Rooney's management style on his podcast.
Rooney, who was sacked after 83 days, labelled Brady's remarks as "very unfair".
He suggested Brady did not fully understand football, particularly the lighter training days before a match, and contrasted it with the NFL's shorter season.