The Care-full Design Lab is looking for a Creative Technologist to assist with the Polyphonic Motions and Melodic Motions research projects. This role will involve assisting with the current development of an online application, which transforms physical movements captured via webcam into collaborative artistic audiovisual outputs. The platform is co-designed with and used by artists with intellectual disability and has three key aims:
- To create an inclusive and playful online space for remote collaboration
- To enable new creative and aesthetic possibilities through uses of digital media
- To decentre standardised interactions and creatively embrace unique differences in movements, and motor skills and coordination, aided by machine learning
The role will see you continue the development of our current, documented prototype. Presently, the prototype uses Unity with Agora and PoseNet. This role would suit someone with programming and software development skills in the Unity environment across two inter-related areas as shown below. If you have experience in one or both areas, we encourage you to apply:
1. General development
Required: Unity Engine development experience for iOS, Android, Mac, and Windows platforms
Desirable: AR/XR, Webcam Interaction, Machine Learning, TensorFlow, PoseNet, Pose Estimation, OpenCV, AudioHelm, FMOD Experience
2. Networking / Multi-User
Required: Unity Multiplayer / Networking Development Experience, Webcam / Video Chat Development Experience, Back End User Authentication and Security Experience
Desirable: WebRTC, Heroku, Photon, Playfab, Agora Video SDK, Amazon AWS (Cognito, Kinesis, Amplify, Media Services) Experience
Key Responsibilities
- Developing the browser-based tool described above
- Testing and evaluation for iterations based on directions from the research team
- Documentation of development
- Desktop and field research in related areas
- Regular collaboration and communication through meetings
- Technical support as necessary – e.g. at participatory workshops with members of Fog Theatre and the RMIT Research Team
Timeframe
- Approximately 2-3 day per week (with some flexibility) for 1-2 months between June 2022 – September 2022, with a possibility for extension.
- Key dates may involve 3-4 scheduled workshops during the life of the project.
Other hours may be undertaken flexibly around other activities. - A schedule will be defined jointly at the outset of the collaboration
Payment
Pay will be offered at the standard RMIT Research Assistant casual rate of $47.66/hr + 10% superannuation.
Application requirements
- CV and Portfolio (sample of research and creative work)
- Cover letter describing your interest in this project and any relevant background experience
- Response to the selection criteria
We welcome you to submit your application to the team Alan We welcome you to submit your application to the team Alan (alan.nguyen@rmit.edu.au), Kate (kate.geck@rmit.edu.au), and Jaz (jaz.hee-jeong.choi@rmit.edu.au) no later than 27 May 2022. Please include ‘MOTIONS Creative Technologist application’ in the email subject.
Selection criteria
- Demonstrated experience with programming and development in Unity.
- Strong capacity to apply technology to creative contexts, particularly those that involve visuals, music, sound, and movement.
- Research experience in human-computer-interaction design.
- Ability to work both autonomously and collaboratively with team leaders, colleagues and other partners with diverse disciplines and backgrounds.
- Demonstrated respect for working with people of diverse backgrounds and/or abilities
The Project – Melodic/Polyphonic Motions
The two interrelated projects will involve the co-design of an interactive platform for real-time kinetic audiovisual performance by artists with intellectual disability; as well as the co-creation of a movement-based performance work using this platform. Members of the RMIT Care-full Design Lab will work with artists from Fog Theatre in Melbourne.
Melodic Motions will challenge existing technologies that demand adherence to standardised motions, and instead creatively embrace involuntary movements and unique differences in motor skills and coordination, aided by machine learning.
Polyphonic Motions will focus on enabling possibilities for real-time collaboration, further exploring participatory and engagement opportunities with diverse artists and audiences.
