ÉϺ£µçӰѧԺÔÚÍÆËã»úÊÓ¾õ¹ú¼Ê¶¥»áCVPR2025Éϰ䷢×êÑгɾÍ

°ä²¼¹¦·ò£º2025-03-11Ͷ¸å£ºÍõ³¬ ²¿ÃÅ£ºÉϺ£µçӰѧԺ ä¯ÀÀ´ÎÊý£º

½üÈÕ£¬ÉϺ£µçӰѧԺӰÊÓ¹¤³Ìϵл־·å¡¢ÀîÃÎÌðÀÏʦÍŶӵÄ×êÑй¤×÷¡¶FilmComposer: LLM-Driven Music Production for Silent Film Clips¡·³É¹¦±»ÍÆËã»úÊÓ¾õ¹ú¼Ê¶¥¼¶Ñ§Êõ»áÒé The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2025£¨CVPR£©Â¼Óã¬ÕâÊǼÌÈ¥ÄêAIÒôЧÌìÉú´´Ð³ɾÍSonicVisionLM£¨CVPR 2024£©ºó£¬ÍŶÓÔÚ´óÄ£Ð͸³ÄÜÓ°ÊÓ´´Ôì×êÑÐÖлñµÃµÄÓÖÒ»¸öÍ»ÆÆ£¬Ò²ÊÇб¦GGÉϺ£µçӰѧԺ¼¼ÊõÓëÒÕÊõÉî¶ÈÈںϵÄ×îгɾÍ¡£

CVPR×÷ΪÖйúÍÆËã»úѧ»áÍÆ¼öµÄAÀà¹ú¼Ê¶¥¼¶»áÒ飬ÔÚÍÆËã»úÊÓ¾õÁìÓòÓµÓи߶ȹú¼ÊÓ°ÏìÁ¦£¬ÆäËùÊÕ¼ÂÛÎIJ»½ö´ú±í¸ÃÁìÓò×îÇ°ÑØµÄ¼¼ÊõÍ»ÆÆ£¬¸ü³ÖÐøÒýÁìѧ¿Æ·¢Õ¹·½Ïò¡£Æ¾¾ÝȨÍþµÄGoogle Scholar Citation×îÐÂͳ¼Æ£¬CVPRµÄH5-indexΪ440£¬Î»ÁÐÈ«Çò³ö°æÎïµÚ¶þÃû£¬½ö´ÎÓÚ¡¶Nature¡·£¬¹¤³ÌÓëÍÆËã»úÀà³ö°æÎïµÚÒ»£¬·ºÈËΪÖÇÄÜÁìÓòµÚÒ»¡£

±¾×êÑгõ´ÎÒýÈëAIGC¼¼ÊõʵÏÖµçÓ°ÅäÀÖ×Ô¶¯ÌìÉú£¬Äܹ»ÏÔÖøÓÅ»¯µçÓ°ÅäÀÖÔì×÷Á÷³Ì£¬½µ±¾ÔöЧ£¬Í¬Ê±Òý·¢´´×÷DZÄÜ¡£¾ßÌåÀ´Ëµ£¬ÂÛÎÄͨ¹ý´óÄ£ÐÍÇý¶¯ÓëÖÇÄÜÌåЭͬ£¬Ìá³öÁ˿ɿصÄÅäÀÖÌìÉú¿ò¼ÜFilmComposer£¬·ÂÕÕÁËÒôÀÖ¼ÒÕæÊµµÄÅäÀÖ¹ý³Ì£¬Äܹ»ÓÐЧǶÈëÏÖʵÒôÀÖÔì×÷¹ÜÏߣ¬¾ß±¸Ç¿½»»¥ÐԺ͸ߴ´×÷×ÔÓɶÈ¡£ÔÚ¼¼ÊõÉÏÕë¶ÔÅäÀÖÓëӰƬͬ²½·¢Õ¹µÄÄÑÌ⣬ÒÔ¼°ÅäÀÖµÄÓ°ÊÓ¼¶Æ·ÖÊ¡¢Ç¿ÒôÀÖÐÔÒªÇó£¬×îÖÕʵÏÖÁËÅäÀÖÓëӰƬÔÚÓïÒå¡¢½ÚÅÄ¡¢½øÕ¹µÈ·½ÃæµÄÓÐЧ¶ÔÆë£¬ÒÔ¼°¶ÔÅäÀÖÒôÖʺÍרҵÐԵĴó·ù¼ÓÇ¿¡£ÂÛÎIJ½ÖèÔÚÌìÉúÒôÀÖµÄÖÊÁ¿¡¢Òô»­Ò»ÖÂÐÔ¡¢·á˶¶ÈºÍÒôÀÖÐÔ·½Ãæ¶¼´ïµ½Á˵±ÏÈˮƽ¡£Í¬Ê±£¬ÂÛÎÄΪѧÊõÉçÇø¹±Ï×Á˹«¿ªµÄ¸ßÖÊÁ¿µÄµçÓ°ÅäÀÖÊý¾Ý¼¯MusicPro-7k£¬7418¸ö¶ÀÁ¢Ìõ¿î£¬Ã¿¸öÌõ¿îÔ̺¬Ò»¶ÔµçӰƬ¶ÎºÍÅäÀÖ¡¢Îı¾ÃèÊö¡¢Ö÷ÐýÂɺͽÚÅĵã¡£

ÂÛÎÄÔ­ÎÄ¡¢´úÂëºÍÊý¾Ý¼¯Ïê¼ûÏîÄ¿Ö÷Ò³£ºhttps://apple-jun.github.io/FilmComposer.github.io/£¨ÏîÄ¿Ö÷ҳչʾÁ˾­µäӰƬµÄÅäÀÖÉú¹¦³ÉЧʾÀý£©¡£¸ÃÂÛÎĵÄѧÉúÒ»×÷ΪºÎÆäÀÖ£¬Êý×ÖýÌå´´Ò⹤³Ì˶ʿ×êÑÐÉú¶þÄê¼¶ÔÚ¶Á£»Ñ§Éú¶þ×÷ΪÖìÓ׼ѣ¬Êý×ÖýÌå´´Ò⹤³Ì˶ʿ×êÑÐÉúÒ»Äê¼¶ÔÚ¶Á¡£

640.jpg

FilmComposerʾÒâͼ£ºÈý¸öÖØÒªÄ £¿é±ðÀëΪÊÓ¾õ´¦ÖᢽÚÅĿɿصÄÒôÀÖÌìÉúÄ£ÐÍ¡¢¶àÖÇÄÜÌåÆÀ¹À±àÇúÓë»ìÒô£¬ÊäÈëµÄµçӰƬ¶Î˳´Îͨ¹ýÕâЩÄ £¿é£¬×îÖյõ½Ò»¶Î²¨ÐÎÒôÀÖÊä³ö¡£Èý¸öÄÚº¬ÀÔì×µÄÀ¶É«¿éչʾÁËÆëÈ«µÄÒôÀÖÔì×÷¹ý³Ì£¬´Ó´òµã£¬µ½×÷Çú£¬±àÇúºÍ»ìÒô¡£

ÀÏʦÍŶӽéÉÜ£º

640 (1).jpg

л־·å£¬¹¤Ñ§²©Ê¿£¬ÏÖΪб¦GGÉϺ£µçӰѧԺӰÊÓ¹¤³Ìϵ¡¢ÉϺ£µçÓ°ÌØÐ§¹¤³Ì¼¼Êõ×êÑÐÖÐÐĸ±½ÌÊÚ£¬²©Ê¿Éúµ¼Ê¦£¬ÖØÒª×êÑз½ÏòÎªÍÆËã»úͼÐÎѧ¡¢ÍÆËã»úÊÓ¾õ¡£ÖйúµçÓ°µçÊÓ¼¼Êõѧ»áµçÓ°¸ßм¼ÊõרҵίԱ»áίԱ£¬ÖйúÍÆËã»úѧ»áCAD/CGרί»áÖ´ÐÐίԱ£¬¹ú¼ÊÆÚ¿¯The Visual Computer±àί¡£

³Ðµ£¹ú¶ÈÌìÈ»¿ÆÑ§»ù½ð¡¢ÉϺ£ÊпÆÎ¯¿Æ¼¼¹¥¹Ø¡¢ÉϺ£ÊнÌί¿ÆÑд´ÐµȶþÊ®ÓàÏ°ä·¢¸ßˮƽÂÛÎÄ40ÓàÆª£¬ÆäÖйú¼Ê¶¥¼¶ÆÚ¿¯Óë»áÌÖÂÛÎÄ15ƪ£¬³ö°æ×¨Öø1±¾£¬ÉêÇë¹ú¶È·¢ÏÖרÀûºÍÈí¼þÖøÊöȨ18Ïî£¬Ôø¸°Ïã¸Û³ÇÊдóÑ§ÍÆËã»ú¿ÆÑ§Ïµ×÷½Ó¼ûѧÕߣ¬ÈÙ»ñ2014ÄêÉϺ£ÊпƼ¼½øÈ¡¶þµÈ½±£¬2017Äêб¦GG²Ì¹ÚÉîÓÅÁ¼ÇàÀÏ´óʦ½±£¬2022ÄêÖйúÍÆËã»úͼÐÎѧ´ó»á×î¼ÑÂÛÎĽ±£¬2022ÄêÉϺ£Êн²ÊڳɾͶþµÈ½±£¬2023ÄêCAD/Graphics 2023¹ú¼ÊѧÊõ»áÒé×î¼ÑÂÛÎĽ±¼°2024Äêб¦GGÓÅÁ¼±¾¿ÆÉúÈ«³Ìµ¼Ê¦¡£

640 (2).jpg

ÀîÃÎÌ𣬹¤Ñ§²©Ê¿£¬²©Ê¿ºó£¬ÏÖб¦GGÉϺ£µçӰѧԺ¡¢ÉϺ£µçÓ°ÌØÐ§¹¤³Ì¼¼Êõ×êÑÐÖÐÐĽ²Ê¦¡£ÖØÒª×êÑз½ÏòÎªÃæÏòÓ°ÊÓ¡¢ÓÎÏ·ÓëÒÕÊõÁìÓòµÄÊý×ÖÄÚÈÝÀí½âÓëÌìÉú¡£ÒÔµÚÒ»/ͨѶ×÷Õß°ä·¢CCF A/SCI-Q1ÂÛÎÄ10ÓàÆª£¬¹ú¶ÈÊÚȨרÀû¶àÏî¡£»ñCAD/Graphics 2023¹ú¼ÊѧÊõ»áÒé×î¼ÑÂÛÎĽ±£¬Chinagraph 2024µç×Ӿ糡ÓÅÁ¼¼¼Êõ½±¡£

Ö÷³Ö¹úÌìÈ»ÇàÄê¿ÆÑ§»ù½ð£¬ÉϺ£ÊпÆÎ¯¡°¿Æ¼¼´´ÐÂÐж¯´òËã¡±ÃæÉÏ»ù½ð£¬²Î¼Ó¹ú¶È³ÁµãÑз¢´òËã¡¢¹ú¶ÈÉç¿Æ³Á´ó¡¢¹úÌìÈ»ÃæÉÏ»ù½ð£¨4Ï¡£µ£ÈÎÍÆËã»úÊÓ¾õ¹ú¼Ê¶¥¼¶»áÒé¼°ÆÚ¿¯ CVPR¡¢ICCV¡¢ECCV¡¢ICLR¡¢ICML¡¢NeurIPS¡¢TPAMI¡¢TIPµÈÉó¸åÈË£¬¹ú¼ÊÆÚ¿¯The Visual ComputerÆÚ¿¯±àί¡£ÈÎÖйúÍÆËã»úѧ»áCAD/CGרί»áÖ´ÐÐίԱ£¨ÃØÊé´¦³ÉÔ±£©£¬Í¼ÐÎѧÓë»ìºÏÏÖʵGAMESÖ´ÐÐίԱ£¬CSIGÊý×ÖÓéÀÖÓëÖÇÄÜÌìÉúרί»á¡¢ÈýάÊÓ¾õרί»á¡¢¶àýÌåרί»áÖ´ÐÐίԱ¡£

640 (3).jpg

ºÎÆä΢£¬µçÓ°Ôì×÷רҵ˶ʿ£¬¸ß¼¶¹àÒôʦ£¬ÏÖΪб¦GGÉϺ£µçӰѧԺÀÏʦ¡£×ÊÉîµçÓ°ÒôЧÉè¼ÆÊ¦£¬ÃÀ¹úÒôЧ¼ô¼­Ê¦Ð­»á£¨MPSE£©»áÔ±£¬ÒôƵ¹¤³Ìѧ»á£¨AES£©»áÔ±¡£

ÔÚÓ°ÊÓÉùÒôÉè¼ÆÁìÓòÓµÓзá˶¾­Ñé£¬Ôø²Î¼Ó¶à²¿¹ú¼ÊÓ°ÊÓÎÄÕµÄÉùÒôÔì×÷£¬»ñÃÀ¹úÒôЧ¼ô¼­¹¤»á½±£¨½ð¾íÖá½±£©×î¼ÑÉùÒôÉè¼ÆÌáÃû¡¢Îå´óÖÞ¹ú¼ÊµçÓ°½Ú×î¼ÑÉùÒôÉè¼Æ½±¡£ÎÄÕÂÔ̺¬°¬ÃÀ½±ÈëΧÎÄÕ¡¶Ctrl Alt Delete¡·¡¢ºÃÀ³Îë·Ã̸ϵÁÓ×¶Behind the Spotlight¡·¡¢Netflix¾ªã¤¾ç³¡ÎÄÕ¡¶Till Death Do Us Part¡·µÈ¡£

¡¾ÍøÕ¾µØÍ¼¡¿