Kapp was born and raised in New York City and continues to live there to this day. He is married to the artist Cecily Kahn, daughter of the artists Wolf Kahn and Emily Mason. Kapp earned his BFA from Windham College, Vermont and his MFA from Queens College, New York. His work has been exhibited throughout the U.S., Europe and Japan and has been included in exhibitions at the Brattleboro Museum of Art, Vermont, the Kyoto Municipal Museum of Art, Japan, The Painting Center, New York and the Center for Maine Contemporary Art. Collections include the Art Gallery of Hamilton, Ontario, Colby College Museum of Art, Massachusetts Institute of Technology, the Museum of Fine Arts, Houston and the Portland Art Museum, Oregon. Kapp also spends part of each year in Friendship, Maine.