Twelve Labs and FBRC.AI are excited to bring together the best multimodal AI talent and the strongest AI community in Los Angeles for a groundbreaking 24hr hackathon focused on AI applications in media and entertainment.
Multimodal AI is revolutionizing the media and entertainment industry, enabling new possibilities from script writing and location scouting in pre-production to object removal and scene stabilization in post-production. One of the most innovative and powerful ways that multimodal AI is transforming M&E is through video understanding - allowing computers to interpret video with the same nuanced context as humans by analyzing visual, audio, textual and other data types together.
Participants will develop AI-powered solutions for challenges including:
Video Editing with Johnny Harris: Develop an AI-powered video editing tool that can analyze Johnny Harris' Switzerland bunker footage and script to automate the process of finding relevant clips and creating montages based on the script.
Highlight Reel Generation with Drew Binsky: Develop an AI-powered tool that can analyze Drew Binsky's travel footage and automatically generate engaging highlight reels that capture the best moments from his adventures around the world.
Sports Press Conference Summarization and Highlight Generation: Develop an AI-powered tool that can automatically generate concise summaries and engaging highlight reels from sports press conference videos. The goal is to help fans and media quickly grasp the key takeaways and most memorable moments without watching the entire press conference.
AWS-Powered Video Q&A Chatbot with RAG: Develop an AI-powered chatbot that can answer questions about a library of movie and TV show trailers using the RAG (Retrieval-Augmented Generation) approach. The chatbot should provide an engaging and informative Q&A experience for users interested in learning more about upcoming releases.
Twelve Labs' multimodal AI is already used by major sports leagues, film studios, and creators for intelligent video applications like asset management, post-production workflows, user engagement, and contextual advertising. This hackathon will expand the possibilities even further.
1st Place: $2,500 + 100 Video Hours in Twelve Labs API credits
2nd Place: $1,500 + 75 Video Hours in Twelve Labs API credits
3rd Place: $1,000 + 50 Video Hours in Twelve Labs API credits
Vivek Gangasani (AI/ML Solutions Architect working with Generative AI startups on AWS)
Pranav Murthy (Senior Gen AI/ML Specialist Solutions Architect at AWS, WW Tech Lead SageMaker Studio)
Brad Boim (Senior Director, Asset Management and Post Production at NFL Media)
Eric Peters (Director, Post Production and Media Administration at NFL Media)
Simran Butalia (Principal M&E GenAI Consultant at Butalia Media Consulting)
Rachel Joy Victor (Co-Founder at FBRC.ai)
Manish Maheshwari (Product Manager - Developer Experience at Twelve Labs)
Soyoung Lee (Co-Founder and Head of Business Development at Twelve Labs)
We're proud to partner with these innovative companies and organizations:
AWS can provide credits as prizes for the winning teams:
1st Place: $10,000 in AWS credits
2nd Place: $5,000 in AWS credits
3rd Place: $5,000 in AWS credits
Participants will have access to Amazon Bedrock, a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API, along with a broad set of capabilities you need to build generative AI applications with security, privacy, and responsible AI.
Using Amazon Bedrock, you can easily experiment with and evaluate top FMs for your use case, privately customize them with your data using techniques such as fine-tuning and Retrieval Augmented Generation (RAG), and build agents that execute tasks using your enterprise systems and data sources. Since Amazon Bedrock is serverless, you don't have to manage any infrastructure, and you can securely integrate and deploy generative AI capabilities into your applications using the AWS services you are already familiar with.
Learn more about Amazon Bedrock developer experience
Fireworks.ai provides a fast, reliable platform for developers to run and tune generative artificial intelligence (AI) models at scale, like Llama 3 and Stable Diffusion 3. The company's mission is to democratize AI for developers and businesses. Use Fireworks to provide your users with delightful, responsive experiences by delivering up to 4x lower latency than alternative solutions with zero compromise on model quality.
More Resources:
Website: Fireworks.ai
API quickstart
All models
Image generation (Stable Diffusion)
Image understanding (Fire-llava)
Embedding models guide
Credits: $20 credits provided to all hackathon participants through this form. $1,000 in credits will be assigned to the hackathon submission with the best Fireworks usage!
Vast.ai is a market based cloud computing platform focused on reducing the costs and friction of compute-intensive workloads, enabling anyone to easily leverage large-scale GPU liquidity. We have thousands of GPUs available now at cloud.vast.ai.
More Resources:
Website: cloud.vast.ai
Promotion: Receive $20 in credits for all new users signing up through this form. Plus, an exclusive $1,000 in credits for the most innovative use of Vast.ai in a hackathon entry!
9am - Arrivals & Breakfast
10am - Introduction from Twelve Labs and FBRC.ai
10:30am - Team Formation
11am - Hacking Begins
1pm - Lunch
2pm - Sponsored Workshops (Twelve Labs, AWS, and more)
6pm - Dinner
9am - Breakfast
11am - Project Submissions
11:30am - Presentations and Demos from Teams
1pm - Lunch & Judging
2pm - Wrap-up
3-5pm - Networking
June 8, 2024 - June 9, 2024
FBRC.ai
7033 Trolleyway S, Playa Del Rey, CA 90293, USA
$31,000