Image stabilisation – improving camera usability

June 2015 Surveillance, Editor's Choice

Gusts of wind tearing at a surveillance camera can make it shake or vibrate enough to make images come out as useless blur. A heavy truck, or a train, passing close by can have similar consequences.

A number of different technical solutions have been developed to cope with the problem, with varying degrees of success. However, the introduction of efficient gyroscopes in combination with cutting-edge software programming has accelerated the process towards robust, real-time image stabilisation.

Vibration impact on video output

Improvements in video quality have made the problem with blurry images more apparent. Increasing pixel density, higher resolution and more powerful zooms have not only made cameras more sensitive to vibrations, but have also made viewers more susceptible and prone to noticing them.

Naturally, operators and integrators are aware of these challenges and are trying to address them. For example, vibration can be reduced by choosing sturdier mounts or less exposed locations for the installation.

Image stabilisation makes the entire video surveillance system more versatile and cost efficient by making better use of each camera’s potential, for example by maintaining image quality in zoom shots when vibrations otherwise may have affected the video quality.

Image stabilisation techniques

Image stabilisation techniques are used in consumer products such as digital still cameras and video cameras. Today, there are two methods to tackle the problem – optical image stabilisation and electronic image stabilisation.

Optical image stabilisation

An optical image stabilisation system usually relies on gyroscopes or accelerometers to detect and measure camera vibrations. The readings, typically limited to pan and tilt, are then relayed to actuators that move a lens in the optical chain to compensate for the camera motion. In some designs, the favoured solution is instead to move the image sensor, for example using small linear motors.

Either method is able to compensate the shaking of camera and lens, so that light can strike the image sensor in the same fashion as if the camera was not vibrating. Optical image stabilisation is particularly useful when using long focal lengths and also works well in low light conditions.

The main disadvantage of an optical solution is the price.

Electronic image stabilisation</i>

Electronic image stabilisation, also known as digital image stabilisation, has primarily been developed for video cameras.

Figures 1 and 2. Left image, a close-up without electronic image stabilisation, showing both horizontal and vertical motion blur. Right image, a snapshot from the vibrating camera with electronic image stabilisation activated.
Figures 1 and 2. Left image, a close-up without electronic image stabilisation, showing both horizontal and vertical motion blur. Right image, a snapshot from the vibrating camera with electronic image stabilisation activated.

Electronic image stabilisation relies on different algorithms for modelling camera motion, which then are used to correct the images. Pixels outside the border of the visible image are used as a buffer for motion and the information on these pixels can then be used to shift the electronic image from frame to frame, enough to counterbalance the motion and create a stream of stable video.

Although the technique is cost efficient, mainly because there is no need for moving parts, it has one shortcoming which is its dependence on the input from the image sensor. For instance, the system can have difficulties in distinguishing perceived motion caused by an object passing quickly in front of the camera from physical motion induced by vibrations.

Rolling shutter distortion

Many video cameras, especially cameras with CMOS sensors, come with a rolling shutter. Unlike a global shutter, which exposes all pixels at the same time in a single snapshot, the rolling shutter catches the image by scanning across the frame, line by line. In other words, all parts of the image are not captured at the same time, but each line is exposed during a slightly different time window. Shakes or vibrations of the camera will therefore result in each exposed line being slightly moved in relation to the other lines, causing a warped or wobbled image. Fast moving objects may also appear distorted in a similar way.

Figure. 3. Shows the principle of global shutter distortion.
Figure. 3. Shows the principle of global shutter distortion.

Rolling shutter distortion induced by vibrations can be avoided with optic stabilisation, which instantaneously compensates for the motion. Electronic stabilisation methods have a slight disadvantage in this case. The rolling shutter must first scan at least one line before the digital processing to stabilise the image can begin. Nevertheless, this method works very well and the technology is improving rapidly.

An outstanding combination

The development of affordable gyroscopes together with more efficient algorithms for modelling camera motion has made stabilisation techniques more available.

It has also enabled the creation of hybrid systems that use gyroscope measurements, not to move the lens, but to process the images digitally according to those gyroscopic signals. Axis has chosen this combined method because of its versatility. The solution is designed to cover a wide band of frequencies as well as coping with high and low amplitudes. Advanced gyroscopes together with optimised algorithms make a robust and reliable system. Even in poor lighting environments the system performs very well since it is relying on gyroscopic information, rather than video content, for motion calculations. For the same reason, the system can always distinguish between perceived motion caused by passing objects and physically induced vibrations.

Benefits and applications in video surveillance

A surveillance camera mounted in an exposed location such as on a high pole or a street sign near a busy road, can be shaken by winds or passing traffic, which will blur the video. This is especially true when a powerful telescopic zoom is used. When zooming in on a distant object, the field of view becomes narrower and any shake or tremble will be amplified in the camera – and the amplitude of the shake will increase proportionally to the amount of zoom used.

Therefore, image stabilisation should be regarded as a prerequisite for cameras with zoom lenses, so they can be used optimally also in windy weather or other unfavourable circumstances. Having cameras that are less sensitive to vibrations also makes installation more flexible and allows for multiple mounting options. In the end, fewer cameras may be needed to satisfy surveillance requirements.

A perhaps less obvious advantage of image stabilisation is that privacy masking can be made more precise. On a camera without any stabilisation system, the effects of possible shakes and vibrations would have to be compensated by increasing the masked off area in the image.

Finally, stabilised images will save bandwidth use and storage space. Advanced video compression formats, such as H.264, are based on motion compensation. In short, this method uses the image of a single frame as a baseline and then only saves information about changes in the picture. A well stabilised image will contain comparatively less movement and thus require less bandwidth and storage.

Conclusion

Hardware and software development are making efficient video stabilisation techniques affordable for an ever-increasing range of network cameras. This progress not only secures smooth, comfortable video monitoring in real time. It also enhances image usability, improves camera operability, makes installation more flexible and, finally, improves the overall cost efficiency of a network camera surveillance system.

For more information contact Axis Communications, +27 (0)11 548 6780, [email protected], www.axis.com



Credit(s)




Share this article:
Share via emailShare via LinkedInPrint this page



Further reading:

Safer spaces through smart surveillance
NEC XON Surveillance
Advances in facial recognition technology are transforming surveillance from a mere recording tool into an intelligent, integrated system that enhances real-time safety, moving beyond the traditional expansion of CCTV efforts.

Read more...
Next generation of AI-powered video telematics
IoT & Automation Surveillance Transport (Industry)
Webfleet, Bridgestone’s fleet management solution in South Africa, has launched Webfleet Video 2.0, an AI-powered solution designed to enhance fleet safety, security, compliance with local regulations and operational efficiency through real-time video insights.

Read more...
Key design considerations for a control room
Leaderware Editor's Choice Surveillance Training & Education
If you are designing or upgrading a control room, or even reviewing or auditing an existing control room, there are a number of design factors that one would need to consider.

Read more...
Smart cities and the role of video security
Surveillance Integrated Solutions
As cities around the world continue to embrace smart technology, including IoT that not only connects to people, but also the surrounding activity, the integration of advanced video security systems is crucial to ensure safety and efficiency in environments.

Read more...
How intrusion protection helps secure O&G operations
Surveillance Perimeter Security, Alarms & Intruder Detection Industrial (Industry)
For O&G operators in Africa, physical security remains one of the biggest considerations, particularly when it comes to perimeter protection and the ability to mitigate intruder-related incidents.

Read more...
Axis secures the Waterfront
Surveillance Entertainment and Hospitality (Industry) Retail (Industry)
Axis Communications shares insight into its longstanding partnership with the V&A Waterfront, one of Africa’s premier retail and mixed-use precincts, through its latest, updated customer success story.

Read more...
Advanced surveillance storage from ASBIS
Infrastructure Surveillance Products & Solutions
From a video storage solutions perspective, SkyHawk drives, designed for DVRs and NVRs, offer high capacity, optimised firmware, and a reliability workload rating of hundreds of terabytes per year.

Read more...
Open and collaborative logistics systems
Hikvision South Africa Surveillance Logistics (Industry) AI & Data Analytics
E-commerce and other high-volume logistics operations need open and collaborative technology ecosystems that drive efficiencies, throughput and digital transformation. Hikvision discusses the benefits of harnessing open and collaborative systems in the logistics market.

Read more...
4K HDR camera for mobility
Surveillance Transport (Industry)
e-con Systems has introduced a 4K HDR front-view camera, engineered to deliver reliable, long-range imaging for mobility applications such as delivery robots, autonomous vehicles, and off-road vehicles.

Read more...
The future of the surveillance channel
Duxbury Networking Technews Publishing Elvey Security Technologies SMART Security Solutions Surveillance
The video surveillance market has evolved from camera-based specifications to integrated solutions that solve customers’ problems. Moreover, the growth of AI and cloud has changed the channel even more, with more to come.

Read more...