top of page

Stype RedSpy 3.0 使用手冊

已更新:2023年9月7日



RedSpy 3.0

使用手冊


RedSpy 3.0 使用手冊
RedSpy 3.0 使用手冊






RedSpy 3.0 is an optical camera tracking system. The system is made out of a small, custom made infrared camera that is combined with gyro and acceleration sensors. This camera and sensors determine their position in space by recognizing specific markers in a nearby environment. It attaches to an existing camera, detects the necessary positional data (pan, tilt, roll, zoom, focus), processes it, and sends this tracking data to a render engine. This combination allows you to put virtual graphics into a real life set and achieve the effect of augmented or virtual reality.





RedSpy 3.0 配件及內容物
RedSpy 3.0 配件及內容物

RedSpy 3.0 配件及內容物
RedSpy 3.0 配件及內容物

RedSpy 3.0 配件及內容物
RedSpy 3.0 配件及內容物


RedSpy 3.0 主機介紹
RedSpy 3.0 主機介紹


RedSpy 3.0 main unit
RedSpy 3.0 main unit


As was mentioned, the ring of LEDs on the RS camera emits IR light and when this light hits the markers, it is reflected in the same direction it came from (towards the camera). This characteristic is called retro-reflectivity.



We can pick some color that fits best with the color of the ceiling (or floor if needed). The material is retro- reflective and so it won't disturb other cameras if they don't have direct light pointing from the camera to the markers because the markers only reflect the light in the direction from where the light came from.


Marker size and distance

We use square markers.


Size of markers = 1/400 of the max. distance


Average distance between markers = (Avg. distance from RS cam to marker grid ) x 0.145


If your ceiling, truss or any other surface you use is comprised of differing sections in height, you can use different marker sizes in the same map. One marker size per different tier of the grid on that part of the ceiling. If you use the RS on a jib, or anything with variable height,it is best to take the middle distance from the markers to the camera for the calculation. For example, if the RS camera on the jib is 7 meters away from the markers in its lowest position, and 3 meters at its highest position, the distance for the calculation should be 5 meters.


Markers should always be oriented straight down, so when putting them on a round surface, you should keep this in mind, and not stick them around the surface.



Detailed example:

Min distance of RedSpy to the grid 1m Max distance of RedSpy to the grid 3m Avg. distance of RedSpy to the grid 2m

Avg.distance between markers= Avg. dist to RS cam x 0.145


= 2m x 0.145= 0.29m


In practice, we would use random 25-35cm, or even 20-40cm, spacing for this.


Size of markers = max distance / 400

= 3 m / 400

= 0.75cm


This is a standard size. The range goes from 0.5cm2-7.5cm2, and we round up or down depending on the particular conditions.


Density of markers:


Normally we say that the minimum number of visible stickers in the RS cam FOV for it to have good tracking is around 18. In certain conditions good results have been seen using moving graphics with only 4-5 stickers. To be safe we stick with 18 as minimum for optimal tracking and that's how we calculate the density on the ceiling(grid).

Usually the customer defines the minimum distance and then we provide the required density of the markers. Then you can go as far as the minimum distance times 3.3 to get the maximum distance. So, if your minimum distance from the grid is 1 meter, maximum is 3. meters. Similarly, if your minimum distance from the ceiling is 2 meters, then maximum is 6.6 meters.


RedSpy 3.0 使用手冊
RedSpy 3.0 使用手冊

How are the markers used for tracking:


During operation, the system will continuously monitor every individual marker, comparing its position in the previous frame, with the position in the current frame. Using this pixel distance between the marker position in the current and previous frames, the system will calculate the camera movement in 3D space.




Mounting

There are multiple possibilities for mounting the necessary RS components. The RS camera always has to be mounted on the camera body (or base plate if the SC is attached it rigidly), using one of the mounts provided with RS kit. Ideally, RS camera should be pointing directly towards the marker grid, whether it is on the floor or the ceiling. The way you mount the camera determines angle offsets you will be setting soon. Angular offsets between RS camera CCD and studio camera CCD should be as close to 90° or 0° (180°) as possible, to simplify the fine-tuning process.


RedSpy 3.0 安裝照片
RedSpy 3.0 安裝照片


Mounting - for Mapping

RedSpy 3.0 安裝照片
RedSpy 3.0 安裝照片

While mapping it is preferable to have the RS camera as far away from the markers as possible. Thus we usually map with the RS camera in hand or fixed to some sort of dolly, and only mount to the Video cam after the mapping. If the markers are on the floor mounting on a crane, lift, pole or something similar may be useful for maximizing distance to optimize mapping accuracy (e.g. reduce curvature).

RedSpy 3.0 安裝照片
RedSpy 3.0 安裝照片


Cable connections

Power supply for the RS main unit should be connected with its two chords and plugged into PWR plug on the RS main unit.


Power supply characteristics:

INPUT 100-240 V, 50-60 Hz 4A OUTPUT NOMINAL VALUE 15 V, 15 A, 225 W OUTPUT FOR RS 15.0V, 3A (mean) / 6A (max)


Touch screen HDMI cable should be plugged into the HDMI socket on the touch screen, and its other side into HDMI and USB ports on the RS main unit. USB cable is used for touch screen functionality. Make sure to connect the touch screen power supply as well. (see page 11)


The diagram below shows how the RS tracking system connects to the rest of the AR/VR hardware, including genlock requirements.

RedSpy 3.0 系統安裝照片
RedSpy 3.0 系統安裝照片

How to collect zoom and focus data from the lens

If you are using a lens with internal virtual encoders (20-pin matching those as described on the following page), you have to connect the RS camera to the lens. Use one of the cables labeled LENS, depending on the lens manufacturer (Fujinon or Canon), and plug it into the LENS plug. Make sure virtual encoders on the lens are enabled. If, for any reason,you want to use external encoders, pick the right gears and put them on RS external zoom/focus encoders. Mount the encoders on the lens using the mount provided as shown on the following page.



RedSpy 3.0 Canon Fujinon connecting
RedSpy 3.0 Canon Fujinon connecting

RedSpy 3.0 encoders install
RedSpy 3.0 encoders install