From Static to Dynamic: How Bob de Jong is Revolutionizing Art and Filmmaking with AI

Share This Post

Share

Hi guys! Today, we’re happy to dive into an exclusive conversation with Bob de Jong, founder of DiepNep and a pioneer in applying artificial intelligence to art and filmmaking. 

Bob de Jong, a 36-year-old Dutch artist and filmmaker, is renowned for his expertise in creating synthetic, AI-driven digital images for film. Specializing in hyper-realistic recreations, such as those of celebrities like Morgan Freeman, his innovative work has placed him at the forefront of digital visual filmmaking.

Bob de Jong. Revolutionizing Art and Filmmaking with AI

Bob’s contributions to the entertainment and media industries include collaborations with major players like HBO, Apple TV, and FOX Entertainment. His cutting-edge approach has enhanced high-profile productions with AI-generated content.

Over the past few years, we’ve collaborated with DiepNep to share some of your deepfakes, which went viral and sparked widespread discussion. We’re excited to learn more about Bob’s journey and future projects. 

Let’s start with a few questions!

Hey Bob! Could you introduce yourself and tell us how your journey into artificial intelligence first took shape? What inspired you to explore this field, and what key moments brought you to where you are today?

Hey there! Thanks so much for having me for this interview. First of all, I’m an Amsterdam-based artist and filmmaker. My journey into the arts began at 16 when my passion for painting started. This led me to paint extensively and develop a desire to merge artistic creativity with philosophical thought.

I started by studying graphic design and later moved on to film school, where I studied audiovisual design and discovered my love for storytelling and moving images. Although I initially hesitated to pursue film due to my desire to remain an autonomous artist, it eventually became central to my work. My naturally impatient nature often pushes me to test the boundaries of what is traditionally considered impossible, prompting me to explore areas where few have ventured.

By 2012, I was already experimenting with VR goggles, which later opened the door to AI. Working on the frontier of experimental new technologies has allowed me to continuously expand my artistic vision and push creative boundaries further.

Bob de Jong. Revolutionizing Art and Filmmaking with AI
Bob de Jong

Can you explain what artificial intelligence (AI) is in simple terms for our readers who may not be familiar with the concept? How is AI used in the world of filmmaking and visual arts?

AI functions as a digital brain that learns and recognizes patterns from extensive data. It mimics human intelligence, enabling it to make decisions, identify patterns, and create new content and ideas.

Think of teaching a child to catch a ball: they may struggle at first, but with practice, they start to predict the ball’s path. AI works similarly, refining its capabilities through repeated examples and experience.

What specific software do you use to transform static artwork into videos?

I frequently receive questions about the tools I use, but I always emphasize that it’s not just about the tools themselves, it’s about how they are used.

While tools like Stable Diffusion are valuable for achieving greater control over visual outputs, true artistry comes from approaching each scene with a unique perspective. Creating AI-driven art requires a customized, project-specific approach that transcends simple copy-and-paste methods.

One aspect that is often overlooked, even by professionals, is the quality of input data: high-quality results depend on high-quality input. Simply put: poor data in means poor data out.

Can you describe the creative and technical process you follow to turn a static artwork into an animated video?

The process begins with selecting artworks that capture the desired emotion and narrative. My approach as a filmmaker is to feel as if I’m holding a virtual camera and being present in the scene, searching for the emotional essence and the types of images I want to create.

I identify elements that match the feeling I wish to convey, choosing visuals and planning sequences that evoke specific emotions, whether it’s the glow of an early morning or a sense of nostalgia. For me, it’s not just about achieving photorealism; it’s about capturing the emotion behind it.

I’m not a purist about theoretical accuracy, like the exact placement of objects or the precise weather, but I strive for an emotional and human sense of correctness. My goal as an artist is to capture that feeling authentically. Once I start training the visual data, the synthesis process begins, requiring a delicate balance.

Ironically, the more control you seek, the less effective the AI becomes at delivering your vision. This can be frustrating but is also part of the joy of the artistic process.

Bob de Jong

AI models are trained by analyzing large sets of data, learning patterns, and generating outputs that look like human-made content. These training datasets can include both licensed and publicly available materials. This raises important legal questions about where this data comes from and how it’s used.

For my projects, I use a large collection of material that I’ve created over my career, along with licensed images, to ensure everything stays ethical and legal. However, many AI tools and models don’t always make it clear where their training data comes from. It feels like dealing with hidden connections where originality and transparency are hard to prove.

This is why it’s so important for the industry and policymakers to discuss how to keep data secure and fairly compensate the artists whose work contributes to these models. Right now, many artists are forced to become amateur legal experts, arguing about copyright and the legality of their work on social media.

This is discouraging because no artist starts out expecting to spend their time debating laws instead of creating art. To me, it feels like a way of coping with the fear that new technology brings. I understand these worries deeply. I have them too, as someone who’s dedicated my life to creating. It’s unsettling to see tasks that used to take weeks now completed in seconds. This fear often shows up in debates, pushing artists to learn complicated legal issues.

But while staying informed is important, I believe artists should focus more on adapting to changes and let policymakers handle the complex legal details. Having clear rules and fair practices is essential so that we can continue creating and innovating.

Despite the challenges AI brings, it also opens up new possibilities for growth and creativity. By adapting to these changes and supporting better guidelines, we can keep our artistic integrity and explore the new opportunities technology offers.

Could you share with us a significant project you’ve completed with DiepNep?

One of the most meaningful projects I worked on was with the Dutch police on a cold case involving a murdered child. It was an incredibly emotional experience, especially when the victim’s sister hugged me at the end of the project. Seeing her gratitude and heartfelt emotion was deeply touching and something I will never forget, I still get goosebumps talking about it.

It showed that technology, which many people fear, can create empathy and human connection. This belief in the positive power of technology has also driven my work with companies like HBO, Apple TV, and Fox Entertainment. For example, I recently supervised the AI process of de-aging Natalie Portman for Apple TV’s show Lady in the Lake.

I’ve also worked on many commercials featuring Lionel Messi, creating digital versions of him that are nearly identical to the real person. Messi often spends a lot of time in studios for brand commitments, which can be tiring for an athlete of his level. By making realistic digital representations, we’ve helped him save time and focus more on what he loves most: his family and football.

These projects show how innovative technology can improve both work and personal life, proving that AI can be a powerful tool to support human experiences.

What are the main challenges you encounter in your work, and what opportunities do you see emerging?

Balancing technological precision with artistic authenticity is one of the biggest challenges I face. Addressing public concerns about AI being impersonal or even threatening is another.

For instance, during my work on the Back in Time series, I had to find ways to make the AI-driven visuals feel genuine and emotionally resonant, not just technically impressive. This experience reinforced the importance of striking the right balance between the capabilities of AI and the human touch needed to evoke real emotion.

However, the opportunities are vast: AI introduces new storytelling methods and democratizes creative tools. As technical barriers lower, filmmaking becomes more accessible, almost like writing, familiar to many but mastered by few. This shift suggests that the future of film will rely less on financial resources or technical expertise, turning it into a purer art form where true originality is celebrated.

Those who push creative boundaries will stand out, much like in fashion, where styles evolve to counter mainstream trends. Art that defies norms becomes valuable, showcasing one of the most fascinating aspects of creativity: its boundless power to be unique.

Your deepfake projects, especially the viral Morgan Freeman video, have sparked substantial debate and garnered significant attention online.
How has this success impacted your career, and what broader social impact do you believe AI could have on filmmaking?

The viral success of my deepfake projects has indeed been transformative. The overwhelming response, particularly to the Morgan Freeman video, opened doors to collaborations with major industry players like HBO, marking a pivotal moment in my journey as a director. This experience not only validated my creative approach but also broadened my role beyond post-production into creative leadership.

On a broader scale, AI has the potential to democratize filmmaking, enabling independent creators to achieve high-quality effects and storytelling that were once limited to large studios. This shift could disrupt traditional power structures, giving more diverse voices a platform and expanding the range of stories being told.

However, with these advancements come new ethical challenges. As AI-generated content becomes more prevalent, we’ll need clear guidelines around issues like copyright, data transparency, and preventing misuse of AI for misleading deepfakes. Establishing ethical standards will be crucial to ensuring that AI’s impact on filmmaking remains positive, inclusive, and responsible.

What are your long-term plans, and how do you think the role of AI in your work will evolve?

What I strive to do is show the world that AI can add a truly human palette, creating art that captures genuine emotional and empathetic qualities. For instance, with my New York City History ‘’Time Travel’’ project, I received a lot of positive feedback from ‘’former AI skeptics’’ who embraced the way I approached it.

It’s incredibly satisfying to help people see things from a new perspective and recognize the potential of AI in ways they hadn’t before.

Looking ahead, I plan to dive deeper into the intersection of technology, art, and philosophy. I aim to create projects that explore human nature and our collective identity, challenging our collective ego as we encounter the profound intelligence and creativity that AI brings. I want to guide people through my art, taking them by the hand to collectively step over that feared bridge into this new realm.

I see AI evolving as an essential partner in my creative process, continuing to open new avenues for artistic exploration. As AI technology advances, with more sophisticated models and an improved understanding of human-like creativity, I foresee even greater potential to push boundaries and develop richer, more interactive experiences.

I plan to adapt by staying at the forefront of these developments, learning, and experimenting to integrate these new capabilities seamlessly into my projects. This evolution will allow me to craft art that is not only more technically impressive but emotionally resonant and impactful.

What advice would you give to filmmakers who want to start exploring the use of AI in their work?

Start simple and experiment with basic tools before progressing to more complex applications. For instance, tools like RunwayML or simpler AI-driven video editing apps can be a great entry point for newcomers. View AI as a collaborator in your creative process, not as a replacement.

Learn about the ethical implications, stay curious, and don’t be afraid to fail; those moments often lead to the most profound discoveries. Ultimately, AI’s potential lies not just in creating but in how we engage with it as an artistic partner. It mirrors our most human qualities, our imperfections, stories, and the unique ways we communicate who we are.

This journey of artistic evolution, from the early days of cave paintings 40,000 years ago to AI-driven digital art, highlights that our drive to stand out and create meaning is as timeless as art itself.

It invites us to see technology not as a disruptor but as part of the next chapter in art’s long history. It reflects our desire to push boundaries, seek meaning, and share our vision with the world.

Thank you fam for reading, if you wanna learn more about the work of Bob de Jong, go check his Instagram page and, in case you missed our previous mag piece, go check it out!

Much love!
FilmmakersWorld Team

Don’t forget to subscribe to our newsletter so you don’t miss the new articles we publish! Thank you!

Subscribe to FilmmakersWorld Newsletter

Subscribe to FilmmakersWorld Newsletter

Related Posts

Behind The Scenes of the Polène Craftsmanship Campaign directed by Boulawayne

Today, we are with Director @Boulawayne to explore the...

Filmmakersworld at Sony Future Filmmaker Awards – SFFA 2023

Filmmakersworld at Sony Future Filmmaker Awards (SFFA) in Los Angeles, Culver City (CA)February 22-23-24, 2023

A new Motion Control System by Michael Ziganek: LOKI

Sponsored Content by Zinemamotion.comHere we go guys with a...

Pattern – A creative and intense short film by Tom Wakeling

Today we are with English director Tom Wakeling, who...

FATMAN: Exterior and Interior Lighting Breakdowns by Cinematographer Johnny Derango

Johnny Derango is an established, sought-after Director of Photography....

Zinema Motion – A success story made in Germany

Paid Partnership with Zinemamotion.comHere we go again guys with...

Share

Share This Post