augmented-reality

Augmented reality

Phantom Photo Match is a standalone program that helps creating augmented reality from photographs. By mathematically reproducing a photo's exact perspective properties, it becomes possible to render 3D graphics that match up the photo, blending together reality and artificial visuals.

Reproduce the camera perspective from a photo

Manually reproducing the correct 3D perspective to make your 3D geometry match up to a photo is a nearly impossible task. There are lots of variables to take into account, and they all have to be balanced towards each other to get an acceptable result. Not only is this a frustrating process, it is time consuming as well. Phantom Photo Match automates this process and provides an accurate & fast solution, with an intuitive and straight-forward interface.

Intelligent & powerful back-end algorithm

Phantom Photo Match’s back-end algorithm can automatically adapt to different situations, as long as you have clear reference lines in your photo. Based on the reference lines and origin node, the algorithm can calculate the camera position (3D), camera target (3D), field of view and up-vector (3D). If you require the perspective data to be entered in a different way (such as position, target, focal length and rotation), that is available as well.

Example 1: Architectural exterior enhancement

(before → after)

Example 2: Architectural interior enhancement

(before → after)

Example 3: Louvre Titan fleet fly-by

(before → after)

Example 4: Backyard Bulborb

(before → after)

standalone-by-design

STANDALONE BY DESIGN

Phantom Photo Match is designed as standalone software. It is entirely designed around its primary focus: to provide accurate & fast photo matching. That means that whatever modeling/rendering package you are using, odds are Phantom Photo Match is compatible with it. If not, please contact so support can be realised!

multi-tool-support

Multi-tool support

The export section of the GUI can be customized towards a specific package, to create an optimal workflow. The following packages are supported currently*:

*If your package is not listed, please contact us and we might be able to bring support.

null

OctaneRender™ standalone
Supported

null

Rhinoceros® standalone software
Supported

OctaneRender™ plugin for Rhinoceros®
Supported

null

Blender® standalone software
Supported

OctaneRender™ plugin for Blender®
Supported

null

OctaneRender™ plugin for Autodesk® Revit®
Supported

workflow-explained

Workflow explained

The following steps give insight in how the Phantom Photo Match GUI (graphical user interface) works.

Step 1: Reference image

Press the IMPORT IMAGE button to import a photo.

Step 2: Perspective match

You will now see the reference lines (marked red/green) and the origin node in the center of the photo. Drag the red/green nodes around to match them up to the perspective lines in your photo. The angle between the red/green lines should be perpendicular (90°) in real life.

While dragging the nodes around, you will see that Phantom Photo Match calculates the new perspective data in realtime.

You can freely zoom in/out of the photo while doing so. The graphics engine supports interpolation so when zooming in/out, the image will be smooth instead of pixelated (optional).

Step 3: Geometry match & export

Press the IMPORT OBJ button to import a reference model.

Drag the ORIGIN node around to determine where your geometry should be placed inside the photo.

Use the SCENE SCALE tool in the bottom-right corner of the GUI to determine the size of your geometry in your photo. This determines the distance of the camera perspective to the geometry in the scene; the scale of the geometry itself stays the exact same!

The property SCENE ROTATION allows you to rotate the entire scene.

You can now export the data in one of two ways.

1. Click the properties in the top-right corner of the GUI to paste them to your clipboard. They can then be pasted into your rendering tool of choice.

2. Go to IMPORT / EXPORT › EXPORT OCT CAMERA and XML data will be exported into your clipboard. Simple press CTRL+V inside Octane Render standalone to instantly create a camera with the right properties.

All done!

bonus-feature-environment-mapping

Bonus feature: environment mapping

Apart from the photo matching algorithm, Phantom Photo Match also features the ability to paint environment maps.

What is environment mapping?

An environment map is an image used for the lighting in your scene. It allows you to bring in tints of color from the environment. That way the scene is blended in much better with the background image behind it. Using the paint tools, you can smoothly paint around colors as you like. The image can be exported as *.PNG and used in your rendering tool as-is.

Easy color picking

The colors you paint on the environment map can be picked from a color sheet, or picked from your imported image. This can be the exact color of a single pixel, but you can also select an average color tint by letting Phantom Photo Match temporarily blur the imported image.

See the difference

The rendered geometry now shows hints of color from the environment map. It picks up a green tint from the grass and hedges, and shows a darker bottom. The geometry now fits into the background image in a much more realistic and pleasing way.