{"id":64,"date":"2025-05-05T16:57:36","date_gmt":"2025-05-05T14:57:36","guid":{"rendered":"https:\/\/projects.dimes.unical.it\/music4d\/?page_id=64"},"modified":"2025-12-16T11:06:46","modified_gmt":"2025-12-16T10:06:46","slug":"project-overview","status":"publish","type":"page","link":"https:\/\/projects.dimes.unical.it\/music4d\/project-overview\/","title":{"rendered":"Project Overview"},"content":{"rendered":"\n<div style=\"font-family: 'Segoe UI', sans-serif;color: #2c2c2c;padding: 60px 20px;max-width: 1100px;margin: auto;background: #fefefe;border-radius: 16px\">\n\n\u00a0 \u00a0 <h1 style=\"text-align: center;font-size: 42px;margin-bottom: 10px;color: #1a1a1a\"> <strong>MUSIC4D \u2013 Project Overview<\/strong><\/h1>\n\u00a0 <p style=\"text-align: center;font-size: 18px;color: #666\">When emotion, artificial intelligence, and music merge<\/p>\n\n\u00a0 <hr style=\"margin: 40px auto;border: none;height: 2px;width: 60%;background: linear-gradient(to right, #ccc, #eee)\">\n\n\u00a0 \u00a0 <section style=\"margin-bottom: 50px\">\n\u00a0 \u00a0 <p style=\"font-size: 17px;line-height: 1.8;text-align: center;max-width: 800px;margin: auto\">\n\u00a0 \u00a0 \u00a0 <strong>MUSIC4D<\/strong> is a multidisciplinary project that merges performing arts, artificial intelligence, and robotics in a creative synergy. The heart of the project is a system capable of perceiving the audience&#8217;s emotional state and generating musical responses in real-time, giving rise to a unique interactive performance.\n\u00a0 \u00a0 <\/p>\n\u00a0 <\/section>\n\n\n<section style=\"margin-bottom: 60px\">\n\u00a0 <h2 style=\"font-size: 28px;margin-bottom: 20px\"><strong>Project Goals<\/strong><\/h2>\n\u00a0 <div>\n\u00a0 \u00a0 <div style=\"flex: 1 1 45%;background: #f8f8f8;padding: 20px 25px;border-radius: 12px;margin-bottom: 15px\">\n\u00a0 \u00a0 \u00a0 <h4 style=\"margin-bottom: 10px\">\ud83d\udca1 Emotional Interaction<\/h4>\n\u00a0 \u00a0 \u00a0 <p>Create a dialogue between the audience and the performance through emotion recognition.<\/p>\n\u00a0 \u00a0 <\/div>\n\u00a0 \u00a0 <div style=\"flex: 1 1 45%;background: #f8f8f8;padding: 20px 25px;border-radius: 12px;margin-bottom: 15px\">\n\u00a0 \u00a0 \u00a0 <h4 style=\"margin-bottom: 10px\">\ud83e\uddec Multimodal Intelligence<\/h4>\n\u00a0 \u00a0 \u00a0 <p>Integrate generative AI to interpret the audience&#8217;s voice, face, and behavior.<\/p>\n\u00a0 \u00a0 <\/div>\n\u00a0 \u00a0 <div style=\"flex: 1 1 45%;background: #f8f8f8;padding: 20px 25px;border-radius: 12px;margin-bottom: 15px\">\n\u00a0 \u00a0 \u00a0 <h4 style=\"margin-bottom: 10px\">\ud83c\udfbc Musical Adaptation<\/h4>\n\u00a0 \u00a0 \u00a0 <p>Modify musical key, rhythm, and intensity in response to the emotional environment.<\/p>\n\u00a0 \u00a0 <\/div>\n\u00a0 \u00a0 <div style=\"flex: 1 1 45%;background: #f8f8f8;padding: 20px 25px;border-radius: 12px;margin-bottom: 15px\">\n\u00a0 \u00a0 \u00a0 <h4 style=\"margin-bottom: 10px\">\ud83e\udd16 Robot Performer<\/h4>\n\u00a0 \u00a0 \u00a0 <p>Utilize a Unitree robot to amplify engagement in the performance.<\/p>\n\u00a0 \u00a0 <\/div>\n\u00a0 <\/div>\n<\/section>\n\n\n\n\u00a0 \u00a0 <section style=\"margin-bottom: 60px\">\n\u00a0 \u00a0 <h2 style=\"font-size: 28px;margin-bottom: 20px\"><strong>Technologies Used<\/strong><\/h2>\n\u00a0 \u00a0 <ul style=\"padding-left: 0;font-size: 16px;line-height: 1.7\">\n\u00a0 \u00a0 \u00a0 <li>\u2705 VLM Models for multimodal recognition (images, text, voice)<\/li>\n\u00a0 \u00a0 \u00a0 <li>\u2705 Algorithms for emotion analysis via deep learning<\/li>\n\u00a0 \u00a0 \u00a0 <li>\u2705 APIs for dynamic, real-time music control<\/li>\n\u00a0 \u00a0 \u00a0 <li>\u2705 Integrated sensors on <strong>Unitree<\/strong> robot<\/li>\n\u00a0 \u00a0 \u00a0 <li>\u2705 NVIDIA Groot for advanced movement, perception, and autonomous control management.<br>\n \u00a0 \u00a0 \u00a0<li>\u2705 Integration with orchestral instruments and digital audio\n\nstreams<\/li>\n\u00a0 \u00a0 <\/ul>\n\u00a0 <\/section>\n\n\u00a0 \u00a0 <section style=\"margin-bottom: 60px;background: #fff8f3;border-left: 6px solid #ff914d;padding: 30px 25px;border-radius: 12px\">\n\u00a0 \u00a0 <h2 style=\"font-size: 28px;margin-bottom: 15px\">\ud83c\udf0d <strong>Expected Impact<\/strong><\/h2>\n\u00a0 \u00a0 <p style=\"font-size: 16px;line-height: 1.7\">\nMusic 4D redefines the role of technology in art. The project opens new scenarios in entertainment, immersive education, and cognitive-emotional therapy. Future applications include interactive shows and sensory installations on audience members for a double check between generative AI models and sensory data.\n\u00a0 \u00a0 <\/p>\n\u00a0 <\/section>\n\n\u00a0 \u00a0 <section style=\"margin-bottom: 60px\">\n\u00a0 \u00a0 <h2 style=\"font-size: 28px;margin-bottom: 15px\">\ud83d\udcc5 <strong>Project Timeline<\/strong><\/h2>\n\u00a0 \u00a0 <table style=\"width: 100%;border-collapse: collapse;font-size: 16px\">\n<tbody><tr style=\"background: #f0f0f0\">\n\u00a0 \u00a0 \u00a0 \u00a0 <th style=\"text-align: left;padding: 12px\">Phase<\/th>\n\u00a0 \u00a0 \u00a0 \u00a0 <th style=\"text-align: left;padding: 12px\">Description<\/th>\n\u00a0 \u00a0 \u00a0 \u00a0 <th style=\"text-align: left;padding: 12px\">Status<\/th>\n\u00a0 \u00a0 \u00a0 <\/tr>\n\u00a0 \u00a0 \u00a0 <tr>\n\u00a0 \u00a0 \u00a0 \u00a0 <td style=\"padding: 12px\">Phase 1<\/td>\n\u00a0 \u00a0 \u00a0 \u00a0 <td style=\"padding: 12px\">Study of AI models and prototype design<\/td>\n\u00a0 \u00a0 \u00a0 \u00a0 <td style=\"padding: 12px\">\u2714\ufe0f Completed<\/td>\n\u00a0 \u00a0 \u00a0 <\/tr>\n\u00a0 \u00a0 \u00a0 <tr>\n\u00a0 \u00a0 \u00a0 \u00a0 <td style=\"padding: 12px\">Phase 2<\/td>\n\u00a0 \u00a0 \u00a0 \u00a0 <td style=\"padding: 12px\">Integration of VLMs<\/td>\n\u00a0 \u00a0 \u00a0 \u00a0 <td style=\"padding: 12px\">\u2714\ufe0f Completed<\/td>\n\u00a0 \u00a0 \u00a0 <\/tr>\n\u00a0 \u00a0 \u00a0 <tr>\n\u00a0 \u00a0 \u00a0 \u00a0 <td style=\"padding: 12px\">Phase 3<\/td>\n\u00a0 \u00a0 \u00a0 \u00a0 <td style=\"padding: 12px\">Integration of &#8220;Tutti-bot&#8221; robotic framework<\/td>\n\u00a0 \u00a0 \u00a0 \u00a0 <td style=\"padding: 12px\">\u2714\ufe0f Completed<\/td>\n\u00a0 \u00a0 \u00a0 <\/tr>\n\u00a0 \u00a0 \u00a0 <tr>\n\u00a0 \u00a0 \u00a0 \u00a0 <td style=\"padding: 12px\">Phase 4<\/td>\n\u00a0 \u00a0 \u00a0 \u00a0 <td style=\"padding: 12px\">Testing with audience and orchestra<\/td>\n\u00a0 \u00a0 \u00a0 \u00a0 <td style=\"padding: 12px\">\ud83d\udd04 In progress<\/td>\n\u00a0 \u00a0 \u00a0 <\/tr>\n\u00a0 \u00a0 \u00a0 <tr>\n\u00a0 \u00a0 \u00a0 \u00a0 <td style=\"padding: 12px\">Phase 5<\/td>\n\u00a0 \u00a0 \u00a0 \u00a0 <td style=\"padding: 12px\">Final presentation and impact evaluation<\/td>\n\u00a0 \u00a0 \u00a0 \u00a0 <td style=\"padding: 12px\">\ud83d\udd53 Planned<\/td>\n\u00a0 \u00a0 \u00a0 <\/tr>\n\u00a0 \u00a0 <\/tbody><\/table>\n\u00a0 <\/section>\n\n\u00a0 \u00a0 <div style=\"text-align: center;margin-top: 30px\">\n\u00a0 \u00a0 <a href=\"https:\/\/projects.dimes.unical.it\/music4d\/contatti\/\" style=\"background: #ff6f3c;color: white;padding: 12px 24px;font-size: 16px;border-radius: 8px;text-decoration: none\">\n\u00a0 \u00a0 \u00a0 \ud83d\udce9 Contact us or find out more\n\u00a0 \u00a0 <\/a>\n\u00a0 <\/div>\n<\/div>\n\n\n\n<blockquote class=\"wp-block-quote\"><p>&#8220;Emotion is not just listened to. It is interpreted, returned, and amplified.&#8221;<\/p><\/blockquote>\n","protected":false},"excerpt":{"rendered":"<p>\u00a0 \u00a0 MUSIC4D \u2013 Project Overview \u00a0 When emotion, artificial intelligence, and music merge \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 MUSIC4D is a multidisciplinary project that merges performing arts, artificial intelligence, and robotics in a creative synergy. The heart of the project is a system capable of perceiving the audience&#8217;s emotional state and &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/projects.dimes.unical.it\/music4d\/project-overview\/\" class=\"more-link\">Leggi tutto<span class=\"screen-reader-text\"> &#8220;Project Overview&#8221;<\/span><\/a><\/p>\n","protected":false},"author":7,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":[],"_links":{"self":[{"href":"https:\/\/projects.dimes.unical.it\/music4d\/wp-json\/wp\/v2\/pages\/64"}],"collection":[{"href":"https:\/\/projects.dimes.unical.it\/music4d\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/projects.dimes.unical.it\/music4d\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/projects.dimes.unical.it\/music4d\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/projects.dimes.unical.it\/music4d\/wp-json\/wp\/v2\/comments?post=64"}],"version-history":[{"count":25,"href":"https:\/\/projects.dimes.unical.it\/music4d\/wp-json\/wp\/v2\/pages\/64\/revisions"}],"predecessor-version":[{"id":164,"href":"https:\/\/projects.dimes.unical.it\/music4d\/wp-json\/wp\/v2\/pages\/64\/revisions\/164"}],"wp:attachment":[{"href":"https:\/\/projects.dimes.unical.it\/music4d\/wp-json\/wp\/v2\/media?parent=64"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}