Senior Research Scientist - Audio & Video AI

Company Description

Join the team redefining how the world experiences design.

Hey, g'day, mabuhay, kia ora,你好, hallo, vítejte!

Thanks for stopping by. We know job hunting can be a little time consuming and you're probably keen to find out what's on offer, so we'll get straight to the point. 

Where and how you can work

Our flagship campus is in Sydney. This role is preferred to be based out of our Sydney office, where the majority of this team is located. 

Job Description

About the team:

This role is in the audio-video storytelling research team, which is part of the larger video storytelling research team in Canva Research. The audio-video storytelling team has a focus on audio research but also carries out video and design research where audio is present. We make audio storytelling accessible and intuitive for everyone.

About the role:

In your role as Senior Research Scientist, you’ll be at the heart of our mission to make advanced machine learning design tools easy for everyone to use. Your work will help create new features that make it simpler and more fun for Canva users to bring their ideas to life. By developing and integrating these cutting-edge technologies, you’ll help us achieve our goal of empowering the world to design. Your contributions will enhance user experiences, drive Canva’s growth, and keep us at the forefront of the design industry. Together, we’ll make a real impact and shape the future of design.

At the moment, this role is focused on:

• Working closely with Research Engineers on research in audio, video and multimodal AI, with a focus on audio, translating theory into practical applications

• Determining and leading research initiatives aligned with short-term product goals and longer-term strategic goals

• Turning research insights and academic breakthroughs into practical use cases and advancing those findings

• Interpreting experimental results and translating them into actionable insights

• Continually tracking the state-of-the-art and identifying opportunities to incorporate new technologies into our research

• Designing, developing, and implementing innovative model architectures and algorithms for audio, video and multimodal content generation and analysis

• Optimizing and scaling models for efficiency, latency, and throughput across large distributed systems

• Collaborating closely with cross-functional stakeholders across Canva to build aligned, technically feasible, and high-impact solution

You’re probably a match if you have:

• Led the development, training, and iteration of foundational or open models based on both internal research and external advancements

• A publication record or evidence of research impact in academia or industry

• Have a deep understanding of AI models, including Diffusion Models, GANs, or Transformers, and can speak to their real-world application

• Adapted and fine-tuned pre-trained models to develop greater model control and quality

• Successfully worked with large-scale AI models for audio and/or video tasks such as TTS, music generation, speech enhancement, video conditioned audio generation or vice versa.

• You’re proficient in Python, PyTorch or Jax, and cloud computing platforms, ensuring efficient model training and deployment.

• Communicate clearly, collaborate with kindness, and value knowledge-sharing and co-creation across teams

• You are curious! Always looking to stay ahead of industry trends by tracking AI literature, competitors, and emerging technologies.

If you’re excited about audio, even if you don’t tick every single box, we’d still love to hear from you.

Additional Information

Achieving our crazy big goals motivates us to work hard - and we do - but you'll experience lots of moments of magic, connectivity and fun woven throughout life at Canva, too. We also offer a range of benefits to set you up for every success in and outside of work.

Here's a taste of what's on offer:

• Equity packages - we want our success to be yours too
• Inclusive parental leave policy that supports all parents & carers
• An annual Vibe & Thrive allowance to support your wellbeing, social connection, office setup & more
• Flexible leave options that empower you to be a force for good, take time to recharge and supports you personally

Check out lifeatcanva.com for more info.

Other stuff to know

We make hiring decisions based on your experience, skills and passion, as well as how you can enhance Canva and our culture. We see AI as a powerful amplifier of creativity and technology at Canva. We’re evolving how we assess AI skills in our Technology hiring experience - you’ll tackle interactive, real-time challenges that reflect the kind of work we do. In some interviews, you may also be asked to solve a problem using an AI tool to show how you approach challenges with tech by your side.

Please note that interviews are conducted virtually.