通用创意智能 CGICreative General Intelligence (CGI)

探索机器创造力的边界Expand the Boundaries of Machine Creativity

智能创意工作流 ICWIntelligent Creative Workflow (ICW)

拓展人类创造力的边界Expand the Boundaries of Human Creativity

创意人工智能研究院 AIGC Research

AI for Creativity (AI4C) Research AI for Creativity (AI4C) Research

  • 创新Innovation
  • 创意Creativity
  • 科学Science
  • 艺术Art

研究领域Research Areas

  • AI × 艺术 AI × Art
  • 影视制作 TV & Filmmaking
  • 世界模型 World Model
  • 创意智能 Creative Intelligence

技术是画笔,想象是色彩,合作是画布。我们共同绘制未来的创意图景。 Technology is the brush, imagination the color, and collaboration the canvas. Together, we paint the future of creativity.


01 Chapter

PhilosophyPhilosophy

核心理念Core Philosophy

秉持“以 AIGC 技术赋能艺术创作与内容生产,开启独立创作时代”的核心理念,本计划以影视级动画作为研究切入点。电影是视听艺术的综合载体,天然融合音乐、画面、色彩、叙事、动效与情感等多重创作要素,为人工智能理解“创作”提供了极具代表性的多模态样本。We anchor our research in film-grade animation because cinema is a unified vessel of audio-visual art — music, image, color, narrative, motion, emotion — which makes it the richest multimodal sample for an AI that tries to understand creation rather than merely imitate it.

  • 电影级标准Cinematic Standard

    我们关注的不只是生成质量本身,而是镜头语言、视听协同、叙事节奏、角色一致性与情感传达等真正决定作品完成度的关键维度。Beyond raw generation quality, we care about cinematography, audio-visual coherence, narrative pacing, character consistency, and emotional delivery.

  • 设计思维Design Thinking

    让 AI 具备顶层创作设计能力,从被动的素材生成器进化为具备设计思维、能够参与创作决策的创意智能体。We want AI to evolve from a passive generator into a creative agent capable of top-level design decisions across modalities.

  • 工作流落地Workflow Landing

    真正进入 2D / 3D 动画的工业化生产流水线,让生成式系统从繁琐工作流走向更纯粹的创意流。Generative systems must enter the real 2D / 3D animation pipeline — turning a tangled workflow into a clean creative flow.


02 Chapter

Research DirectionsResearch Directions

实验室与工作室Labs & Studio

通用创意智能实验室负责基础研究,智能影像叙事实验室聚焦应用研究,星联无限灵感工作室专注创作实践。The Creative General Intelligent Lab leads foundational research, the Intelligent Cinema Narrative Lab focuses on applied research, and the StarX Infinite Inspiration Studio specializes in creative practice.

通用创意智能实验室 Creative General Intelligent Lab

探索机器创造力的边界|从“理解人类创作”出发,融合顶层设计思维、类脑启发与科学赋能。 Exploring the boundaries of machine creativity | Starting with an understanding of human creation, we combine high-level design thinking, brain-inspired insights, and scientific empowerment.

我们旨在打破传统 AI“只能机械生成、无法理解创作”的局限,研究人类艺术创作的意图、过程与认知机制,赋予AI类似人类导演或设计师的“设计思维 (Design Thinking)”,并借鉴神经科学探索下一代创意智能架构。

  1. 跨模态美学对齐:优秀的艺术作品源于对声音、画面与故事的整体想象。我们致力于文字、音乐、色彩、情感与动态效果等设计元素的深度对齐,赋予 AI 美学感知、创作推理与全景构思能力。
  2. 大模型的可解释性与轻量化:从微观(神经元激活表征)、中观(子网络与注意力机制协同)到宏观(整体泛化与涌现能力)三个尺度,深度剖析生成式大模型的内在机理。通过揭示这些“黑盒”规律,指导算法优化与架构精简,实现“以小博大”的高效、轻量化计算。
  3. 类脑启发与科学赋能:向内借鉴 (仿真驱动的类脑研究):将神经机制与脑网络转化为可计算模型,探索下一代智能架构;向外赋能 (AI驱动的神经科学):同时运用生成式 AI 与数据分析反哺神经科学研究,辅助探索神经连接及疾病机理研究,发掘并解决具有重大价值的科学难题,促进 AI 与脑科学双向发展。

We aim to move beyond traditional AI's limitation of mechanically generating content without understanding creativity. We study the intentions, processes, and cognitive mechanisms behind human artistic creation, equip AI with design thinking akin to that of human directors or designers, and draw on neuroscience to explore next-generation creative intelligence architectures.

  1. Cross-modal Aesthetic Alignment: Outstanding artworks emerge from a holistic vision of sound, visuals, and story. We pursue deep alignment across design elements such as text, music, color, emotion, and motion, enabling AI to perceive aesthetics, reason creatively, and conceive works as a whole.
  2. Interpretability and Lightweighting of Large Models: We analyze generative models at three scales: micro (neuron activation patterns), meso (coordination among subnetworks and attention mechanisms), and macro (overall generalization and emergent capabilities). By revealing how these black boxes work, we guide algorithmic optimization and architectural refinement to achieve efficient, lightweight computation that does more with less.
  3. Brain-inspired Research and Scientific Empowerment: Inward inspiration (simulation-driven brain-inspired research) turns neural mechanisms and brain networks into computable models to explore next-generation intelligent architectures. Outward empowerment (AI-driven neuroscience) uses generative AI and data analysis to advance neuroscience, help investigate neural connectivity and disease mechanisms, identify and solve significant scientific challenges, and promote progress in both AI and brain science.
  • 多模态感知 Multimodal Perception
  • 跨模态对齐 Cross-modal Alignment
  • 创作推理 Creative Reasoning
  • 设计思维 Design Thinking
  • 美学感知 Aesthetic Perception
  • 类脑研究 Brain-inspired Research
  • 神经科学 Neuroscience

智能影像叙事实验室 Intelligent Cinema Narrative Lab

拓展人类创造力的边界|从"赋能人类创作"出发,以智能工具支持影像叙事与影视级内容生产。 Expanding the boundaries of human creativity | Starting from the goal of empowering human creators, we use intelligent tools to support visual storytelling and cinematic content production.

我们聚焦影像叙事与影视创作,将前沿 AI 能力转化为创作者可用的工具,减少动画和影视制作中的重复劳动,让创作者更专注于故事与表达。

  1. 全维度多模态交互:研究从音频、原画、三维资产到时空视频的内容形态,探索动作、音频与多模态协同驱动的创作方式。
  2. 影像叙事与镜头语言:围绕长视频下的角色一致性、动作连续性、剧情对齐与镜头语言,研究能够服务完整故事表达的智能影像方法。
  3. 创作流程落地:重新思考并推动生成式 AI 融入影视制作流程,发掘当下创作流中的"灯下黑"问题,开创AI原生的后期制作新形态,从繁琐工作流(Workflow)走向自由创意流(Creative Flow)。

We focus on visual storytelling and filmmaking, turning cutting-edge AI capabilities into tools creators can use and reducing repetitive work in animation and film production so creators can focus on story and expression.

  1. Full-spectrum Multimodal Interaction: We study content forms ranging from audio and concept art to 3D assets and spatiotemporal video, exploring creation driven by motion, audio, and multimodal collaboration.
  2. Visual Storytelling and Cinematic Language: For long-form video, we study character consistency, action continuity, plot alignment, and cinematic language to develop intelligent visual methods that support complete storytelling.
  3. Creative Workflow in Practice: We rethink and advance the integration of generative AI into filmmaking, uncover overlooked problems in today's creative process, and pioneer AI-native forms of post-production, moving from cumbersome workflows (Workflow) toward free creative flow (Creative Flow).
  • 全维度多模态交互 Full-spectrum Multimodal Interaction
  • 影像叙事 Visual Storytelling
  • 镜头语言 Cinematic Language
  • 数字资产生产 Digital Asset Production
  • 影视创意流 Cinematic Creative Flow
  • AI原生后期制作 AI-native Post-production

星联无限灵感工作室 StarX Infinite Inspiration Studio

探索人机共创的边界|从“连接研究与创作”出发,让无限灵感成为可展示、可迭代的作品。 Exploring the boundaries of human–AI co-creation | Starting by connecting research with creative practice, we turn ideas into works that can be shared and refined.

星联无限灵感工作室连接创意智能研究与真实创作实践,探索人工智能技术与影像、故事及视觉表达的融合,让灵感从构思走向作品,并将创作中的经验反馈给研究。

  1. 灵感共创:围绕故事构思、视觉设计与跨媒介表达,探索人机协同创作的发散、收敛与迭代。
  2. 作品实践:结合实验室研究与创作者经验,制作并迭代可展示的影像作品与创意原型。
  3. 创作反馈:从真实创作过程提炼需求与问题,推动智能创作工具和影像叙事方法持续改进。

StarX Infinite Inspiration Studio connects creative intelligence research with real creative practice. We explore how AI can work with visual storytelling and expression, helping ideas become tangible works and bringing lessons from making back into research.

  1. Co-creating Ideas: Across story concepts, visual design, and cross-media expression, we explore divergence, convergence, and iteration in human–AI co-creation.
  2. Creative Practice: We combine laboratory research with creators' experience to make and refine visual works and creative prototypes that can be shared.
  3. Learning from Creation: We draw needs and questions from real creative work to keep improving intelligent tools and visual storytelling methods.
  • 人机共创 Human-AI Co-creation
  • 故事表达 Storytelling
  • 跨媒介表达 Cross-media Expression
  • 影像创作 Visual Creation
  • 作品实践 Creative Practice

03 Chapter

Publications & ProjectsPublications & Projects

代表成果Featured Work

整体布局与单点突破|每项工作都有清晰的研究动机,彼此衔接成一条连贯的研究脉络,逐步回答一系列具体问题。An overarching vision with focused breakthroughs | Each piece of work starts from a clear research motivation; together, they form a coherent line of inquiry that progressively addresses a series of concrete questions.

Act2Cut

SIGGRAPH Asia 2026 SIGGRAPH Asia 2026

多镜头视频叙事的动作连续性建模。 Continuous Multi-shot Video Narrative Match on Action-Cut.

聚焦电影语言中“动作匹配剪辑”这一长期被忽视的关键问题,让生成式视频系统具备跨镜头动作连续性理解,强调叙事动作与电影语法之间的协同。 Tackling the long-overlooked “match on action” problem in cinematic language, Act2Cut enables generative video systems to understand action continuity across shots — narrative motion, not just surface frame similarity.

ViStoryBench

CVPR 2026 CVPR 2026

面向视觉故事讲述的综合性基准测试。 A Comprehensive Benchmark Suite for Story Visualization.

针对定制化视觉故事讲述这一电影生成的核心任务,构建系统性评测框架,衡量模型在角色一致性、风格稳定性、剧情对齐、构图质量与故事可视化方面的真实能力。 Targeting customized visual storytelling — the core task of cinematic generation — ViStoryBench defines a systematic evaluation framework for character consistency, style stability, plot alignment, compositional quality, and visualization.

StyleMe3D

ArXiv 2025 ArXiv 2025

3D 高斯下的解耦先验风格化。 Stylization with Disentangled Priors on 3D Gaussians.

在 3D 高斯表示下探索可控、可交互、可扩展的风格化生成,通过多编码器与解耦先验实现稳定的风格控制,体现团队对 3D 作为创作媒介的长期判断。 Multi-encoder, disentangled-prior stylization for 3D Gaussian representations — exploring controllable, interactive, scalable 3D creation as a long-term creative medium.

Awesome-PaperDaily

持续追踪 AIGC 前沿进展的开源知识整理项目。 Following the advance of AIGC, day by day.

体现团队在知识组织、趋势追踪与社区共享方面的持续投入,不仅服务于内部研究,也希望与更广泛社区共同推动 AIGC 发展。 An open knowledge curation project that tracks AIGC frontiers — reflecting our continued investment in knowledge organization, trend tracking, and community contribution.


04 Chapter

TeamTeam

团队成员Team Members

AIGC Research 由一支关注创意人工智能、生成式模型与跨学科基础研究的小型团队组成,并与工业界、学术界导师保持持续合作,共同推进从基础问题到创作系统落地的全链路研究。AIGC Research is a small team focused on creative AI, generative models, and cross-disciplinary fundamentals. We collaborate with both industry and academic advisors across the full chain — from foundational questions to deployed creative systems.

核心成员Core Members

庄才林Cailin Zhuang

团队成员Team Member

复旦大学在读博士Ph.D. student, Fudan University

展开Expand 收起Collapse

研究方向为 AIGC,关注创意人工智能与影视级内容生成。Working on AIGC, creative intelligence, and cinematic content generation.

庄才林 微信二维码
微信二维码WeChat QR

胡耀淇Yaoqi Hu

团队成员Team Member

独立研究者Independent researcher

展开Expand 收起Collapse

专注于开源社区贡献(Hugging Face)、企业级数据工作流开发,并在多媒体与视觉生成领域具有深厚的研究积累。Focuses on open-source community contributions on Hugging Face, enterprise data workflow development, and multimedia and visual generation research.

胡耀淇 微信二维码
微信二维码WeChat QR

董政Zheng Dong

团队成员Team Member

独立研究者Independent researcher

展开Expand 收起Collapse

简介待补充。Bio coming soon.

郭一铭Yiming Guo

团队成员Team Member

上海大学本科在读B.S. student, Shanghai University

展开Expand 收起Collapse

简介待补充。Bio coming soon.

合作导师Advisors

程巍Wei Cheng

工业界导师Industry Advisor

阶跃星辰 · 研究科学家StepFun · Research Scientist

研究方向为生成式人工智能。Research on generative AI.

朱思语Siyu Zhu

学术界导师Academic Advisor

复旦大学·正教授 上海创智学院·全时导师Fudan University · Full Professor Shanghai Innovation Institute · Full-time Mentor

李梦甜Mengtian Li

学术界导师Academic Advisor

上海大学 · 上海电影学院Shanghai University · Shanghai Film Academy

研究方向为AI电影。Research on AI filmmaking.

夏清玲Qingling Xia

学术界导师Academic Advisor

重庆理工大学·两江人工智能学院Chongqing University of Technology · School of AI

研究方向为生物医学工程。Research on biomedical engineering.

合作机构Partners


05 Chapter

Get in TouchGet in Touch

合作与联系Open to collaboration

如果您对我们的研究方向、项目合作、学术交流、开源共建或创意生产系统落地感兴趣,欢迎与我们取得联系。让我们共同塑造一个全新的创意世界。If our research directions, open-source efforts, academic exchanges, or creative production systems resonate with you, we warmly invite you to connect. Let's shape a novel creative world together.

微信公众号WeChat

微信公众号

扫码关注 AIGC ResearchScan to follow AIGC Research