Kyle Steinfeld

Using the pix2pix model ported to tensorflow, we developed a process for relating depthmaps extracted from Google Street View panoramas with the corresponding photographic information. A number of separate models were produced using limited geographic areas of selected cites. With these depthmap-to-panoramic cityscape models trained, we are able to generate new images from unrelated depthmaps which resembled photographic images of the selected cities. This is demonstrated using a javascript app (not currently online) and documented in still images and a series of videos.

A rough description of our process is available here.

Images and Videos Courtesy of Kyle Steinfeld