Hello there! We're a team of R&D engineers who are passionate about hardware, software, and AI. With a deep background in 3D modeling and visualization, we love bringing the physical world into the digital realm.
Today, we want to share the story behind the creation of ComplexScan AUTOBOX v1 — our professional system for photogrammetric 3D scanning. This project was a natural evolution of our earlier work, including a series of transparent glass turntables for 360-degree photography, known as ComplexScan Transparent, and an open-source DIY project called PhotoPizza.
Back in 2019, we joined the objet.art project (ArtClub Digital Heritage) with a crucial mission: to develop a 3D scanning technology that could capture art objects and cultural artifacts with the highest possible fidelity.
The goal wasn't just to create beautiful 3D models. We needed to produce textures so detailed that they would accurately reflect the material's true optical properties and colors. This level of quality is vital for art historians and restoration experts to analyze, preserve, and exhibit these priceless pieces. We were aiming for sub-millimeter accuracy, with a margin of error as low as 0.1 to 0.001 mm, depending on the object's size. On top of that, the entire process had to be flexible and scalable enough to work in various environments.
We began by exploring the existing technologies, mainly laser scanning and photogrammetry. Laser scanning, while popular, didn't quite fit our needs. It meant investing in expensive equipment and struggled with complex shapes or shiny surfaces, often resulting in artifacts and inaccuracies. Plus, the cameras on handheld laser scanners were typically not good enough for the high-quality textures we were after.
Here’s a peek at what was considered the upper limit for laser scanning at the time:
As you can see, when you zoom in, the flaws in both the geometry and the texture become apparent. This led us to look closer at photogrammetry.
Photogrammetry is a technique that builds a 3D model from a series of photos of an object, taken from various angles.
To see what it was capable of, we photographed a variety of objects on our PhotoPizza turntable and ran them through the most popular software available:
Here’s a glimpse of how the technology works its magic:
And here is the stunning result:
In the end, we went with RealityCapture. It delivered the best texture quality, incredible model detail, and processed the raw data faster than any other option.
The beauty of photogrammetry is its limitless resolution. The quality of the final 3D model is only constrained by the camera's resolution, the lens, and the number of photos you take. You can create detailed models of microscopic objects using a microscope or even model celestial bodies using images from a telescope. It's an incredibly flexible and powerful method.
A look at RealityCapture in action:
But everything hinges on getting high-quality source images, captured from every conceivable angle and under perfect lighting. This is the foundation for everything that follows.
Of course, it wasn't all smooth sailing. We had a few creative puzzles to solve:
To tackle these challenges head-on, we decided to build our own specialized equipment from the ground up.
We took a modular approach. The light sources were designed as active tiles that could be connected to create a larger light matrix, allowing us to scale the setup for any scene. Each light source had a wireless controller for real-time adjustments and active cooling with sensors to prevent overheating. We also designed them to hold polarizing filters for cross-polarization lighting and provided illumination from below to banish unwanted shadows.
Here’s a 3D model of our prototype:
Then came the fun part: manufacturing and assembly. Having our own laser cutter was a game-changer:
To control our new modular hardware, we developed custom software that could manage any number of drives and lighting modules:
With the prototype ready, we put it to the test. The results spoke for themselves:
Next, we took our show on the road, organizing shoots at the prestigious State Museum Hermitage in St. Petersburg, Russia:
With the technology proven, it was time to scale up. We got hands-on, personally scanning several Japanese netsuke figures for ArtClub and the Hermitage Museum to refine our workflow before building a larger team.
Speaking of tricky shapes, check out how we handled the intricate holes in these netsuke figures.
These holes, called himotoshi, were used to thread a cord that attached the netsuke to a kimono's sash, along with small pouches or boxes.
After presenting our project, we were ready for the next phase. To handle the growing workload, we needed to assemble a team of talented 3D modelers and photographers. We created test assignments, found the right people, and continued to push the boundaries of the technology together. We had the privilege of working with incredible objects of material culture, touching history with our own hands. Each new artifact was a fresh challenge, a new puzzle of complex materials and shapes to solve.
This dagger with its white jade handle, for instance, features intricate carvings inlaid with precious stones: