Techart Conference

Liam Somerville

■ Abstract

In recent projects Somerville has been utilising AI video to 3D motion data body tracking using Rokoko Vision as seen in the music video and live AV music performances with experimental pop duo Plastiq. This do-it-yourself/ bedroom motion capture technology has become so accessible and really exciting for digital artists/game developers. Another AI motion capture tool is the Smart/Depth Camera, which can output colour and depth data which can be used for a range of digital art applications. Smart cameras with AI body tracking models will allow for wireless, controller free motion capture which opens doors for new XR music experiences with onstage motion capture. It is predicted that soon AI will replace the depth camera and the depth data can be created using only a 2D image such as a webcam. Somerville goes on to discuss many benefits and applications of using AI in the film and art industry especially in automation of menial tasks such as scheduling, finance and preproduction pitch documents as well as VFX tasks like background removal, greenscreen keying, character replacement and compositing. Somerville discusses how the automation of labour in the VFX industry may impact entry level animator jobs which smashes the current career pathway, however also believes that this will allow solo artists to achieve more with less resources. Somerville discusses how he is not interested in using AI prompt to image material in his work as he feels there is a sameness in the genre, he states how he uses AI as a tool only to smooth workflow and achieve motion capture without expensive hardware.

■ Bio

Liam Somerville (aka CAPITAL WASTE) is a cinematographer and video artist living and working on Kaurna Country in Adelaide, South Australia. Known for both their glitchy, analog aesthetic and DIY, high-tech approach to real-time animation their unorthodox mash of technologies provide a unique flavour of multimedia visual stimulation. Their most recent installation- PROJECT : EARTH at the 2024 Adelaide Fringe Festival saw 30,000 audience members and won a weekly Best Film & Digital or Interactive Award. CAPITAL WASTE’s music video, Killer by Plastiq is playing on MTV and claimed a handful of awards including Best Experimental Award at London Music Video Awards 2023. Meanwhile his live visuals have been witnessed at Unsound Festival, National Gallery of Victoria, WOMADelaide, Fringe Festival, Adelaide Botanic Gardens, Illuminate Adelaide and Denver Museum of Science.

At the moment CAPITAL WASTE is obsessed with the virtual 3D world and inputting human interactions and dynamic movement into the often sterile digital space using realtime game development engines to create gallery works, VR experiences, projection installations and music videos such as ESCHATECH VR (2024), marine_digital¬_conservation_SA_2023.exe (2023) and Universal Killer (2023).

As a cinematographer their recent projects include DOP for rock-doco on the iconic Aussie rock band The Angels: Kickin’ Down The Door (2022) and Video Nasty: The Making of Ribspreader (2020) as well as commercial work for television commercials and music videos.