March 01, 2020

Putting Robots to Work on the Past


Putting Robots to Work on the Past

In 1896, Frenchman Charles Moisson, one of the few cameramen working for Lumiere company, was in Moscow to attend the coronation of Russia's last tsar, Nicholas II. He made a widely-known short clip of bustling Tverskaya street, showing the corner of the still-standing National Hotel and passing walkers and carriages.

Now Russian techie Denis Shiryaev [about] has put Moisson's camera work through several neural networks, to enhance and colorize the original monochrome clip. Internet users have praised his work as an incredible "time machine" that gives us a glimpse of the past that looks more realistic than ever.

We asked Shiryaev about his interest in using the work of robots to produce this nostalgia-laced result. For more technical information about his work, click on the clip to read the YouTube description in Russian and English.

 

RL: In a nutshell, how does this work? Do you upload the video into a program? What else does it need to know about the video to get the colors right?

DS: I put the video through an ensemble of neural networks, each of which plays a role. One cleans the video of noise, another creates additional frames to make the video play more smoothly, a third one increases the resolution, and finally one "colors" the video. Each algorithm has been honed on its own set of data, for example, the coloring neural network knows that people's faces are usually beige, grass is green and the sky is blue, because that's how the neural network was trained. 

RL: Do you think the result would be better if the video was colored by hand?

DS: Robots and algorithms are cheaper and faster than human work. Restoration can definitely be done by people, but with each year, work by algorithms will improve. People historically lose the competition to robots, and in five years' time neural networks will not only improve data that exists in an image, but also add additional faces, objects, and anything else. In fact, restoration is basically not done purely by hand anymore, because restorers use a lot of computer programs to enhance the image.

RL: Why do you choose clips like these to work with? Are you nostalgic for the era before the internet?

DS: I like history and that the image comes alive when you put it through the different algorithms. I choose the clips based on my own taste and the advice by YouTube commentators, who suggest other ideas for restoration.

 

 

RL: Reading the comments, especially to the clip "Arrival of the Train", it seems that a lot of people are struck by the thought that "everyone in the video is now dead" even the little children. Isn't it strange that a restored video from 1896 draws this response? 

DS: Old clips that we usually see look different from videos that we're normally used to seeing on the internet. People on them are usually seen running to the sound of music or the projector noise, so the videos look "ancient" and you don't associate yourself with the people in them. When I restore the clips, people come alive and the clip stops seeming artificial. You can no longer get rid of the feeling that all of those people are real.

 

Like this post? Get a weekly email digest + member-only deals

Some of our Books

At the Circus
January 01, 2013

At the Circus

This wonderful novella by Alexander Kuprin tells the story of the wrestler Arbuzov and his battle against a renowned American wrestler. Rich in detail and characterization, At the Circus brims with excitement and life. You can smell the sawdust in the big top, see the vivid and colorful characters, sense the tension build as Arbuzov readies to face off against the American.

Stargorod: A Novel in Many Voices
May 01, 2013

Stargorod: A Novel in Many Voices

Stargorod is a mid-sized provincial city that exists only in Russian metaphorical space. It has its roots in Gogol, and Ilf and Petrov, and is a place far from Moscow, but close to Russian hearts. It is a place of mystery and normality, of provincial innocence and Black Earth wisdom. Strange, inexplicable things happen in Stargorod. So do good things. And bad things. A lot like life everywhere, one might say. Only with a heavy dose of vodka, longing and mystery.

Marooned in Moscow
May 01, 2011

Marooned in Moscow

This gripping autobiography plays out against the backdrop of Russia's bloody Civil War, and was one of the first Western eyewitness accounts of life in post-revolutionary Russia. Marooned in Moscow provides a fascinating account of one woman's entry into war-torn Russia in early 1920, first-person impressions of many in the top Soviet leadership, and accounts of the author's increasingly dangerous work as a journalist and spy, to say nothing of her work on behalf of prisoners, her two arrests, and her eventual ten-month-long imprisonment, including in the infamous Lubyanka prison. It is a veritable encyclopedia of life in Russia in the early 1920s.

Fearful Majesty
July 01, 2014

Fearful Majesty

This acclaimed biography of one of Russia’s most important and tyrannical rulers is not only a rich, readable biography, it is also surprisingly timely, revealing how many of the issues Russia faces today have their roots in Ivan’s reign.

A Taste of Chekhov
December 24, 2022

A Taste of Chekhov

This compact volume is an introduction to the works of Chekhov the master storyteller, via nine stories spanning the last twenty years of his life.

Frogs Who Begged...
November 01, 2010

Frogs Who Begged...

The fables of Ivan Krylov are rich fonts of Russian cultural wisdom and experience – reading and understanding them is vital to grasping the Russian worldview. This new edition of 62 of Krylov’s tales presents them side-by-side in English and Russian. The wonderfully lyrical translations by Lydia Razran Stone are accompanied by original, whimsical color illustrations by Katya Korobkina.

How Russia Got That Way
September 20, 2025

How Russia Got That Way

A fast-paced crash course in Russian history, from Norsemen to Navalny, that explores the ways the Kremlin uses history to achieve its ends.

Steppe
July 15, 2022

Steppe

This is the work that made Chekhov, launching his career as a writer and playwright of national and international renown. Retranslated and updated, this new bilingual edition is a super way to improve your Russian.

About Us

Russian Life is a publication of a 30-year-young, award-winning publishing house that creates a bimonthly magazine, books, maps, and other products for Russophiles the world over.

Latest Posts

Our Contacts

Russian Life
73 Main Street, Suite 402
Montpelier VT 05602

802-223-4955