But now we know. “Robert [Downey Jr.] tried to talk us into doing [the Avengers movies] and we said ‘no,’” Joe Russo recalled to Omelete. “Weirdly, because we said we wouldn’t come back.