EDITOR'S PICKSApplying AI and 3D Skills for an International Client Project

Applying AI and 3D Skills for an International Client Project

Applying AI and 3D Skills for an International Client Project
David  Pinzón – Multimedia Producer | 3D Designer

David  Pinzón

Hello, I’m David, a multimedia producer and 3D designer from Cali, Colombia. A year ago, I studied at Libel Academy and completed a master’s program in Character Creator 4 (CC4) and ZBrush. This course provided me with a solid foundation in ZBrush, Character Creator 4, Blender, and Substance Painter. It allowed me to hone my skills and techniques in 3D design.

Although my professional background is in multimedia production, I decided to delve deeply into 3D design. I traveled to San José, Costa Rica, for an internship at a Virtual Production studio. There, I rediscovered my passion for 3D design. I created my first virtual environment using Unreal Engine 5.

My favorite tools for working include ZBrush, Blender, Substance Painter, and Character Creator. Each of these tools enables me to explore different aspects of design and elevate my ideas to new heights.

What I love most about being a 3D designer is the ability to create worlds and characters from scratch. I can bring my ideas to life. It pushes my creativity to the limit. It’s incredible to see how my designs come to life and interact with people in real-time.

One of the most notable projects in my career was creating a 3D character for an event in Malaysia. This character was designed in Character Creator and refined in ZBrush. It was integrated into Unreal Engine and connected with artificial intelligence. This enabled real-time verbal interaction during the event. This project not only allowed me to apply my technical skills. It also allowed me to use my ability to innovate and solve problems. This was especially true when we had to set everything up remotely using Pixel Streaming technology.

One of the most notable projects in my career was creating a 3D character for an event in Malaysia. This character was designed in Character Creator and refined in ZBrush. It was integrated into Unreal Engine and connected with artificial intelligence for real-time verbal interaction during the event. This project not only allowed me to apply my technical skills. It also allowed me to use my ability to innovate and solve problems.

David  Pinzón – Multimedia Producer | 3D Designer

Character Creator and ZBrush integrated with Unreal Engine and artificial intelligence for real-time verbal interaction during event

“Would you recommend the union of these two software? ZBrush and Character Creator?

Totally! The truth is that I believe it is a lot easier to reach final results that look really professional. The truth is that I believe it is a lot easier to reach final results that look really professional.

It helped me so much being able to integrate Character Creator to my design workflow, because not only could I achieve a base for the character, but also a base that I could later animate with ease.

So we can say that we save many spaces (labor), and many moments to say it that way, to reach the final result.

How did you achieve your first 3D contract?

Well I was super happy because in a matter of months I was able to find a very good project. Through a client in Colombia we were able to take a project in Malaysia for an international event. It was a very good experience. The truth is that I had very good tools that allowed me to reach that final result.

What would you recommend to 3D Designers?

To research well the facilities we have with artificial intelligence and these new tools. They have served me much in saving effort, and in having this plus that in the final result.

David  Pinzón – Multimedia Producer | 3D Designer

Workflow Description

Project Objective

The objective of the project was to present a 3D avatar at an international event in Malaysia.

The avatar could interact in real-time with the presenter and audience through artificial intelligence.

To achieve this, a combination of tools where used from the original character base, to the advanced design.

Later, artificial intelligence was used for the voice and lipsync of the talking avatar.

This was later used on a hologram to greet attendees at the event.

Character Creator and ZBrush integrated with Unreal Engine and artificial intelligence for real-time verbal interaction during event

Reallusion Tools Used

For the base design of the character, I used Character Creator 4 (CC4). Afterwards, I made adjustments and customized the character in ZBrush.

Main Challenges and Solutions

One of the main challenges was the need to prepare everything from Character Creator for remote execution. We used Unreal Engine’s Pixel Streaming technology, relying on third-party services to ensure the best quality.

Steps from Conceptualization to Project Completion

Planning Stage:

  1. Executive Approval: In the early stages of the project, iClone was instrumental in creating and presenting preliminary animations. Company executives then approved these animations.

Avatar Design

  1. Base Design: I used Character Creator to get a solid and easily manipulable base.
  2. Customization: I customized the character in ZBrush to give it a unique look.
  3. Texture Editing: I edited colors and textures in Substance Painter.

Integration into Unreal Engine

  1. Integration: I integrated the finished character into Unreal Engine using the “Unreal Auto Setup” tool.
  2. Adjustments: I made adjustments to the lighting and camera in Unreal.

Implementation of Artificial Intelligence

  1. AI Integration: I used Convai technology to integrate artificial intelligence into the character.
  2. Training: I trained the character with the necessary information for the event. I gave it a name. I provided a voice generated by Eleven Labs.
  3. Lip Sync Synchronization: I synchronized the lip sync using tools provided by Convai.

Remote Projection

  1. Projection Setup: I used Eagle 3D Streaming technology for projection via Pixel Streaming.
  2. Server Setup: I set up the project on their servers. I ensured the quality needed to obtain a remote connection link.
  3. Opening & Presentation at Event: iClone was used to generate the introduction to the event. It was also used to create some supporting videos. These videos were shown throughout the presentation.

This project allowed me to combine various tools and technologies innovatively. I achieved a unique interactive experience for the event in Malaysia.

Follow David Pinzón:

ArtStation:
https://www.artstation.com/dapin

Website:
https://www.digitalrising.us/

Related Posts

More

Choose the Perfect QA Role

Hey there! Software development is a complex field, and...

Upcoming Events, October + November 2024

Hello, cartoon fans, I'm back with a whole lot...

Art’s Purpose – Animated Spirit

“Art is not, as the metaphysicians say, the manifestation...

Create Walking Talking Mario for Live Performance

https://www.youtube.com/watch?v=4-wWqYY8L3g Hello, I’m Scott Evans, founder of Digital Puppets, an...

Tyler Perry Pauses $800 Million Studio Expansion Due to Open AI’s Sora

March 18th, 2024: Renowned filmmaker and producer Tyler...