How does a phone turn a dark scene into a bright photo?
Your phone's night mode does not take one long exposure. It takes a burst of short ones, lines them up and averages them.
โถ Start the storyYour phone does not take one night photo. It takes a burst of them and merges them, because the problem in the dark is a counting problem. Image noise comes largely from shot noise, the natural variation in the number of photons entering the lens, which matters most for smartphone cameras, with their small lenses and sensors. A second source is read noise: random errors when each pixel's charge is converted to a number. The signal-to-noise ratio rises with the square root of the exposure time or faster, so a longer exposure gives a cleaner picture. But it is hard to hold still in dim light, and whatever you are photographing probably will not hold still either.
Google's answer, HDR+, introduced in 2014, captures a burst of frames, aligns them in software and merges them. Its main purpose is dynamic range, but merging also reduces the impact of shot and read noise. Each frame uses a short exposure to stay sharp, and pieces of frames that cannot be aligned are rejected. The idea of averaging frames is as old as digital imaging: astrophotographers call it exposure stacking, and the hard part is alignment when the camera is handheld.
Step 1: Burst of short frames
Many underexposed pictures, each sharp
Step 2: Align in software
Reject pieces that do not match
Step 3: Merge
Averaging cuts shot and read noise
Step 4: White balance and tone
A learned colour model and brightening, a "look"
Night Sight pushes this further. Single-picture phones struggle at 30 lux, merging phones do well down to 3 lux, and Night Sight aimed at the range between 3 and 0.3 lux with no flash. A handheld sky shot took 15 frames of 333 ms each, 5 seconds of capture; on a tripod, 6 frames of 1 second.
The result is not a record of what your eyes saw. In very dim light humans stop seeing in colour, because the cone cells stop functioning, leaving rod cells. Night Sight makes pictures brighter than reality, which its own authors call a "look".
Quiz me
0/3
Recap
Averaging many short, aligned frames cuts noise because the signal-to-noise ratio rises with the square root of the light collected.
๐ก A trick to remember it ยท Many quick glimpses, lined up and averaged, beat one long stare in the dark.
Surprising fact ยท In very dim light your own eyes lose colour vision, but a night-mode photo can show colours you could not see.
Connects to
- ๐ง How did two girls fool Conan Doyle and the experts with cardboard fairies?
- ๐ต Why can't more megapixels beat the diffraction limit?
- ๐ฒ Why does your camera sensor record only one colour per pixel?
- ๐๏ธ Why is film grainy and digital noisy, and are they the same thing?
- ๐ How can a few stickers make an AI read a stop sign as a speed limit?
Sources (2)
No source, no claim. Every fact in this lesson (22 claims) cites at least one of these.