Easily Create 3D Models from Photos and Videos on Mac - Free!
Science & Technology
Introduction
Converting photos or videos to 3D models has become simpler with the advent of photogrammetry applications. Previously, enthusiasts relied on software like Meshroom or Reality Capture, which required an Nvidia graphics card. However, with the introduction of Apple M1 Max and its architecture, these programs became unsupported on Macs due to the lack of support for external GPUs. Fortunately, starting with macOS Monterey, Apple introduced the Object Capture API, enabling easy photogrammetry on Macs for free.
Almost immediately after, apps began to emerge in the App Store that utilize this new functionality. One such app is Photo Catch, which streamlines the process of creating 3D models from photos and videos. While numerous apps are now available, they largely serve the same purpose. Below, we will explore how to use Photo Catch effectively.
Getting Started with Photo Catch
When using Photo Catch, users can choose between inputting a set of photos or a single video. The app also offers a multimedia option that combines multiple media types into one project, although some features are behind a paywall and aren't part of Apple's API. For most users, the free features of the app will suffice unless professional-grade output is necessary.
Creating Models from Photos
Let's take a look at how to create a 3D model from a set of images. For example, I have a folder on my desktop filled with 47 images of a lion statue taken with a Google Pixel 3 XL. Despite being taken with rather average equipment, I can select this folder in Photo Catch and simply click on “Create Model.” While the app allows for customization of detail levels—affecting the computing time—it often works well with the default settings.
Within minutes, I received a 3D model complete with textures, cropped specifically to highlight the desired object. Unlike other software like Meshroom or Reality Capture, where users typically need to spend additional time trimming and refining the model, Photo Catch yields immediate, usable results. This capability greatly simplifies the process for those looking to integrate 3D models into websites or games without extensive post-processing.
Speed and Performance
What makes this process even more impressive is the speed. Traditional photogrammetry software like Meshroom can take around 15 minutes for a production that still requires refinement. Reality Capture performs faster than Meshroom, yet both are still slower than what the Apple Object Capture API can deliver. Interestingly, the inexpensive MacBook Air I used outpaces my much more expensive PC in terms of photogrammetry speed, effectively making this advanced technology accessible to more users.
Creating Models from Videos
In response to questions from viewers, I decided to test the video capability. I filmed a Superman statue by walking around it, capturing footage from multiple angles. Upon loading the video into Photo Catch, I configured it to extract every 12th frame for processing. After marking the first and last desirable frames, I once again clicked “Create Model,” and in just a few minutes, I obtained a detailed 3D representation of the statue.
Exporting Your Models
For those interested in further processing or 3D printing the models, Photo Catch allows for exports in two formats: OBJ and USDZ. The OBJ format is universally supported by 3D printing software, making it an ideal choice for those looking to create physical models. The second format, USDZ, is optimized for faster display on Apple devices, although it is not compatible with typical construction or printing programs.
Conclusion
Apple has successfully democratized photogrammetry through its Object Capture API, making it accessible and efficient for Mac users. With apps like Photo Catch, creating detailed 3D models from both photos and videos is easier than ever.
Keywords
- Photogrammetry
- 3D Models
- Object Capture API
- Photo Catch
- macOS Monterey
- Meshroom
- Reality Capture
- OBJ Format
- USDZ Format
FAQ
What is photogrammetry?
Photogrammetry is the process of creating 3D models from photographs or videos by analyzing the spatial relationships between images.
Can I use a video instead of photos for creating 3D models?
Yes, you can use videos to create 3D models by extracting frames from the video using applications like Photo Catch.
Is Photo Catch free?
Photo Catch provides a significant amount of functionality for free, though some advanced features are available via in-app purchases.
What file formats can I export 3D models in?
You can export your 3D models in OBJ format, which is compatible with most 3D printing software, as well as USDZ format for quicker display on Apple devices.
How does the Object Capture API improve photogrammetry?
The Object Capture API significantly speeds up the photogrammetry process, allowing for quick conversion of photos and videos into detailed 3D models, often faster than traditional software solutions.