March 01, 2020

Putting Robots to Work on the Past


Putting Robots to Work on the Past

In 1896, Frenchman Charles Moisson, one of the few cameramen working for Lumiere company, was in Moscow to attend the coronation of Russia's last tsar, Nicholas II. He made a widely-known short clip of bustling Tverskaya street, showing the corner of the still-standing National Hotel and passing walkers and carriages.

Now Russian techie Denis Shiryaev [about] has put Moisson's camera work through several neural networks, to enhance and colorize the original monochrome clip. Internet users have praised his work as an incredible "time machine" that gives us a glimpse of the past that looks more realistic than ever.

We asked Shiryaev about his interest in using the work of robots to produce this nostalgia-laced result. For more technical information about his work, click on the clip to read the YouTube description in Russian and English.

 

RL: In a nutshell, how does this work? Do you upload the video into a program? What else does it need to know about the video to get the colors right?

DS: I put the video through an ensemble of neural networks, each of which plays a role. One cleans the video of noise, another creates additional frames to make the video play more smoothly, a third one increases the resolution, and finally one "colors" the video. Each algorithm has been honed on its own set of data, for example, the coloring neural network knows that people's faces are usually beige, grass is green and the sky is blue, because that's how the neural network was trained. 

RL: Do you think the result would be better if the video was colored by hand?

DS: Robots and algorithms are cheaper and faster than human work. Restoration can definitely be done by people, but with each year, work by algorithms will improve. People historically lose the competition to robots, and in five years' time neural networks will not only improve data that exists in an image, but also add additional faces, objects, and anything else. In fact, restoration is basically not done purely by hand anymore, because restorers use a lot of computer programs to enhance the image.

RL: Why do you choose clips like these to work with? Are you nostalgic for the era before the internet?

DS: I like history and that the image comes alive when you put it through the different algorithms. I choose the clips based on my own taste and the advice by YouTube commentators, who suggest other ideas for restoration.

 

 

RL: Reading the comments, especially to the clip "Arrival of the Train", it seems that a lot of people are struck by the thought that "everyone in the video is now dead" even the little children. Isn't it strange that a restored video from 1896 draws this response? 

DS: Old clips that we usually see look different from videos that we're normally used to seeing on the internet. People on them are usually seen running to the sound of music or the projector noise, so the videos look "ancient" and you don't associate yourself with the people in them. When I restore the clips, people come alive and the clip stops seeming artificial. You can no longer get rid of the feeling that all of those people are real.

 

Like this post? Get a weekly email digest + member-only deals

Some of Our Books

The Little Golden Calf

The Little Golden Calf

Our edition of The Little Golden Calf, one of the greatest Russian satires ever, is the first new translation of this classic novel in nearly fifty years. It is also the first unabridged, uncensored English translation ever, and is 100% true to the original 1931 serial publication in the Russian journal 30 Dnei. Anne O. Fisher’s translation is copiously annotated, and includes an introduction by Alexandra Ilf, the daughter of one of the book’s two co-authors.
Moscow and Muscovites

Moscow and Muscovites

Vladimir Gilyarovsky's classic portrait of the Russian capital is one of Russians’ most beloved books. Yet it has never before been translated into English. Until now! It is a spectactular verbal pastiche: conversation, from gutter gibberish to the drawing room; oratory, from illiterates to aristocrats; prose, from boilerplate to Tolstoy; poetry, from earthy humor to Pushkin. 
The Best of Russian Life

The Best of Russian Life

We culled through 15 years of Russian Life to select readers’ and editors’ favorite stories and biographies for inclusion in a special two-volume collection. Totalling over 1100 pages, these two volumes encompass some of the best writing we have published over the last two decades, and include the most timeless stories and biographies – those that can be read again and again.
A Taste of Russia

A Taste of Russia

The definitive modern cookbook on Russian cuisine has been totally updated and redesigned in a 30th Anniversary Edition. Layering superbly researched recipes with informative essays on the dishes' rich historical and cultural context, A Taste of Russia includes over 200 recipes on everything from borshch to blini, from Salmon Coulibiac to Beef Stew with Rum, from Marinated Mushrooms to Walnut-honey Filled Pies. A Taste of Russia shows off the best that Russian cooking has to offer. Full of great quotes from Russian literature about Russian food and designed in a convenient wide format that stays open during use.
The Frogs Who Begged for a Tsar

The Frogs Who Begged for a Tsar

The fables of Ivan Krylov are rich fonts of Russian cultural wisdom and experience – reading and understanding them is vital to grasping the Russian worldview. This new edition of 62 of Krylov’s tales presents them side-by-side in English and Russian. The wonderfully lyrical translations by Lydia Razran Stone are accompanied by original, whimsical color illustrations by Katya Korobkina.
The Latchkey Murders

The Latchkey Murders

Senior Lieutenant Pavel Matyushkin is back on the case in this prequel to the popular mystery Murder at the Dacha, in which a serial killer is on the loose in Khrushchev’s Moscow...
Stargorod: A Novel in Many Voices

Stargorod: A Novel in Many Voices

Stargorod is a mid-sized provincial city that exists only in Russian metaphorical space. It has its roots in Gogol, and Ilf and Petrov, and is a place far from Moscow, but close to Russian hearts. It is a place of mystery and normality, of provincial innocence and Black Earth wisdom. Strange, inexplicable things happen in Stargorod. So do good things. And bad things. A lot like life everywhere, one might say. Only with a heavy dose of vodka, longing and mystery.
Life Stories: Original Fiction By Russian Authors

Life Stories: Original Fiction By Russian Authors

The Life Stories collection is a nice introduction to contemporary Russian fiction: many of the 19 authors featured here have won major Russian literary prizes and/or become bestsellers. These are life-affirming stories of love, family, hope, rebirth, mystery and imagination, masterfully translated by some of the best Russian-English translators working today. The selections reassert the power of Russian literature to affect readers of all cultures in profound and lasting ways. Best of all, 100% of the profits from the sale of this book are going to benefit Russian hospice—not-for-profit care for fellow human beings who are nearing the end of their own life stories.
Survival Russian

Survival Russian

Survival Russian is an intensely practical guide to conversational, colloquial and culture-rich Russian. It uses humor, current events and thematically-driven essays to deepen readers’ understanding of Russian language and culture. This enlarged Second Edition of Survival Russian includes over 90 essays and illuminates over 2000 invaluable Russian phrases and words.
Bears in the Caviar

Bears in the Caviar

Bears in the Caviar is a hilarious and insightful memoir by a diplomat who was “present at the creation” of US-Soviet relations. Charles Thayer headed off to Russia in 1933, calculating that if he could just learn Russian and be on the spot when the US and USSR established relations, he could make himself indispensable and start a career in the foreign service. Remarkably, he pulled it of.

About Us

Russian Life is a publication of a 30-year-young, award-winning publishing house that creates a bimonthly magazine, books, maps, and other products for Russophiles the world over.

Latest Posts

Our Contacts

Russian Life
PO Box 567
Montpelier VT 05601-0567

802-223-4955