Ralph Fiennes Hopes to One Day Do a Movie with ‘Far Too Handsome’ Brother Joseph: ‘He’s a Brilliant Actor’ (Exclusive)

Ralph Fiennes is eager to collaborate onscreen with his younger brother Joseph Fiennes.

“He’s a brilliant actor. One day, I hope we do a film together,” the Conclave actor, 62, tells PEOPLE during an installment of My Life in Pictures. “I have no idea what kind of film it would be. It’d be nice if it wasn’t serious.”

“He’s far too handsome,” he adds of his brother, laughing.

Having starred in movies including Schindler’s List, Harry Potter and Maid in Manhattan, Ralph has plenty of memories to reflect on as he looks at throwback pictures during the interview.

One photo features the actor and his brother together at an afterparty in 2005. Ralph — dressed up in a tuxedo — throws his arms around Joseph, who is wearing a t-shirt and jeans. 

“He looks like he’d like to get away from my grip,” Ralph says. “He looks like, ‘Get the f— off me,’ right?””

He adds: “If he was here, we’d have a laugh.”

Almost eight years separate the siblings but much like Ralph, Joseph, 54, has made a name for himself in Hollywood with roles in films like Shakespeare in Love and TV shows, including Hulu’s The Handmaid’s Tale.

But, the siblings are only two brothers in a big, multi-talented family. 

In the series, Ralph also reacted to a photo from 1972, which shows him and five of his six siblings — Joseph, Martha, Magnus, Sophie and Jacob — outside of their childhood home in Southern England. Their brother Michael is not pictured.

“I can hear my dad going, ‘Come on, look at the camera, that’s it,’ ” Ralph laughs. “I can hear his voice.”

Growing up, Ralph says they were “very much an arts family” and it holds to this day.

While Jacob and Michael did not pursue the arts professionally, the rest of the siblings did. Magnus is now a composer and record producer. He has worked on shows like Hustle and Murphy’s Law and films including Johnny English and The Next Best Thing. He’s even worked with artists like Shakira, the Spice Girls and Seal.

Never miss a story — sign up for PEOPLE’s free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer​​, from celebrity news to compelling human interest stories.

Sisters Martha and Sophie pursued directing careers. Martha is known for the movie Chromophobia, while Sophie helmed The Pervert’s Guide to Cinema and other documentaries. 

Four of the siblings brought their creative forces together for Martha’s directorial debut movie, Onegin in 1999. Ralph had the leading role, Magnus composed the music and Sophie had a minor acting role.

Ralph also recalls to PEOPLE a lesson his mother “instilled” in all her children.

“My mother, whatever any of her children did, she was encouraging,” Ralph says. “But do it thoroughly. Don’t just skim the surface of anything you’re interested in.”

He adds: “I guess she instilled in us a sense of, ‘You have to be tenacious and keep going and not give up.”