CFAs: Robust and trustworthy GenerativeAI for Robotics and Industrial Automation

Scope

• Proposals integrating Generative AI in robotics and industrial automation are expected to substantially contribute to productivity gains, including for instance in engineering industries, the automotive sector, food production or other sectors related to manufacturing industries. All proposals will have to demonstrate their expected impact on the competitiveness of the selected application sector.
• Proposals aiming for Type A outcomes should adhere to the Type A scope, while proposals aiming for Type B outcomes should follow the Type B scope.
• Type A Scope:
  • While it is widely acknowledged that current use of generative AI has the potential to impact certain tasks in robotics such as improving user interaction or providing explanations about why a robot system made a particular decision, these are, in general, not within the critical operating flow of a robot. To reach next level of autonomy, generative AI must also enable robots to learn from their experiences, simulate realistic environments for training in challenging conditions, and enhance planning, decision making and control while considering the physical constraints imposed both by the environment and by the physical construction of the robot. This includes integrating ‘Human-in-the-loop’ mechanisms, where AI systems collaborate with human operators to enhance decision-making processes and adaptability, particularly in dynamic environments.
  • This represents a significant advancement in robotics, requiring the development of AI models that can effectively navigate the complexities of the physical world while ensuring safety. Generative AI is expecting to bring such a step-change in robots precision, adaptability, versatility and robustness, enabling them to efficiently achieve real world tasks such as complex moves (navigation, manipulations, etc.) with higher level of autonomy and precision.
  • In the context of advancing robotics capabilities, the use of generative AI stands as a transformative force, amplifying robots’ learning, interaction, and operational abilities. By enabling robots to learn from experiences, simulate diverse environments for training, and enhance human-robot interaction, it drives adaptability and efficiency. Additionally, generative AI facilitates the augmentation of robot situational awareness and planning capabilities, empowering them to predict outcomes of various actions, thereby elevating their autonomy and decision-making prowess.
  • Training current generative AI models, in particular Large AI models, requires high volumes of data to achieve effective levels of performance. The vast amount of data required present a significant challenge when it comes to robotics. Further research is necessary to find the appropriate balance between the quality, adequacy, and volume of data with regards to the performance of the AI model. Moreover, model distillation techniques may play a key role for the portability of the generative AI solution at the edge, in power-limited devices. The training data should come from the real world or from physical aware simulations of the real world. Where relevant, in particular in the context of human interaction, training data should encompass diverse individual characteristics, such as gender, age, racial and ethnical background, to mitigate potential bias and discriminations.
  • Proposals should detail strategies to leverage cutting-edge generative AI techniques to enhance the adaptability and reliability of these models across complex and dynamic scenarios, as well as how to ensure human-centricity and environmental considerations. The goal is to train and fine-tune generative AI models that meet the necessary standards for ensuring the safe operation of robotics hardware. These models should empower robots to autonomously plan and execute actions while maintaining high levels of performance and generalization capabilities.
  • Research activities should explore the training methodologies for these foundation models, emphasizing their ability to process multimodal data and derive actionable insights to inform robotic decision-making processes.
  • The proposals are also expected to include the validation of the trained models through applications. Proposals should detail methodologies for conducting rigorous testing procedures, incorporating both simulation-based evaluations and physical experiments. These tests aim to evaluate the performance and scalability of developed foundation models.
  • The research will be driven by impactful scenarios defined by major manufacturing industry players who should be well integrated in the consortium. They should be deeply involved in the proposed work in order to provide the use-case, the corresponding data and they will play an important role to accompany the validation process. They will define a number of representative real-world use-cases with gradually increased level of complexity to drive the technology development. They will provide existing relevant data and collect further data necessary to train and fine-tune the models, but also to validate the solutions. Given the sensitivity of sharing industrial data, manufacturers present in the consortium have to define upfront mechanisms to collectively provide and pool a sufficiently large dataset for training the models (this might involve a trusted third party as intermediary), ensuring sufficient quality and quantity of data needed to train the models. If necessary, they will have to put in place mechanisms to acquire data from sources outside the consortium.
  • Proposals are expected to enhance the accuracy and robustness of generative AI systems in robotics, ensuring that the solutions developed are trustworthy and reliable in their applications, hence in line with the AI Act requirements.
  • Proposals should address both the safety of robotic operations, ensuring protection against physical risks, and cybersecurity measures to safeguard against digital threats and ensure system integrity.
  • The emphasis lies in creating and disseminating general-purpose models and tools rather than being limited to narrowly focused solutions. Projects should also build on or seek collaboration with existing and upcoming projects and develop synergies and ensure complementarities with other relevant European (e.g. projects funded under HORIZON-CL4-2024-HUMAN-03-01: Advancing Large AI Models: Integration of New Data Modalities and Expansion of Capabilities), national or regional initiatives, funding programmes and platforms.
• Type B Scope:
  • The objective is to enhance productivity and provide a competitive advantage to EU industry in the transition towards more sustainable, zero-carbon production, addressing the uncertainties and tensions on supply chains and the lack of highly-skilled workers. A new generation of digital technologies will integrate generative Artificial Intelligence, robotics, and advanced human interfaces in industry-grade applications with a high degree of autonomy. This will enable the development, production, and operation of complex and advanced high-tech products at lower cost while improving sustainability and flexibility, ultimately becoming a powerful tool for accelerating innovation in both processes and products.
  • The manufacturing sector should strongly benefit from increased levels of automation made possible by breakthroughs provided by AI, in particular by the family of technologies know as generative AI, including (e.g.) AI foundation models, large language models, transformers, multimodal generative AI. The main objective of this Type B is the development of Generative AI solutions dedicated to the manufacturing sector and making use of manufacturing data available in production lines.
  • Proposals should address at least one of the following use-cases:
    • Robustness and trustworthiness of digital technologies and data management at industry-grade quality, to raise the automation levels on production sites and across industry and supply chains;
    • Enhanced product and process qualification/certification and compliance assessment through higher levels of automation, digitalisation and data management, taking into account related requirements;
    • Automation of manufacturing processes to achieve higher reliability, efficiency and sustainability;
    • Automated tools for fast and large-scale deployment and reconfiguration of production assets and for rapid innovation cycles.
  • Proposals should accomplish these objectives exploiting the most suitable approach(es) among the ones described below:
    • The integration of applications exhibiting advanced developments of generative AI model(s) specifically designed for manufacturing, providing measurable advantages in one of more of these key areas: manufacturing cost, increased productivity, quality, flexibility, resilience, sustainability, circularity, time to market and usability. Applications can target factory-floor operations and/or management of data, knowledge and documentation associated to products and production (for use-case 1 or 2);
    • Development and integration of digital production systems capable of significantly increasing productivity and managing high-mix production with close to zero time needed for re-purposing and capability to manage different mixes of materials and components (for use-case 3);
    • Development of deployment tools to automate the management of production lines, namely through automatic configuration, integration with legacy systems, placement of data translators and connectors, and deployment of machines and sensors on the shop floor (for use-case 4).
  • Proposals should indicate which approach they are targeting. Proposals may combine several approaches above, indicating which is the main approach, provided there is added value in such a combined approach; arbitrary combinations without integration are excluded.
  • The use of generative AI techniques is encouraged for all the approaches. The applicants will specifically describe how they will secure the acquisition of quality manufacturing data from real-world industrial use cases of industry partners or companies outside the consortium in the context of the data volume necessary to train and finetune the models used in the proposal.

Funding Information

• Budget (EUR) – Year 2025: 85 000 000
• Contributions: 40000000 to 45000000

Expected Outcomes

• Proposals are expected to address one area of the expected outcomes, either Type A or Type B. The type should be clearly identified within the proposal.
• Type A GenAI4EU: Generative AI for Robotics for industrial automation. Project results are expected to contribute to all the following expected outcomes:
  • Development of advanced foundation models for robotics, fostering increased autonomy and generalization capabilities, thus enabling robots to dynamically learn and comprehend their physical surroundings in real-time, ensuring adaptability and reliability across diverse and complex scenarios.
  • Validation of the model through fine-tuning and downstream application to address industrial automation use-cases
• Type B Trustworthy and robust generative AI for improved manufacturing. Project results are expected to further advance foundation models and reliable industrial solutions and to contribute to some of the following expected outcomes, depending on the use-cases addressed in the proposals:
  • Increased productivity by high quality, flexible and resource-efficient industrial automation, both on the shop floor and in engineering/business processes;
  • Significantly improved facilitation of product and process certification and compliance assessment, as well as reliability, efficiency and sustainability of manufacturing processes, supporting easier high-mix production and manufacturing of products based on sustainable and advanced technologies; and
  • Significantly facilitated installation, commissioning and decommissioning of production facilities, through tools that enable faster industrialisation of factory automation well beyond the pilot phase, while reducing the need for manual on-site interventions.
  • Applicants will justify their selection by the expected business dimension of their use cases, while ensuring a critical mass of resources in the project to ensure significant outcomes in these.

Eligibility Criteria

• Entities eligible to participate:
  • Any legal entity, regardless of its place of establishment, including legal entities from nonassociated third countries or international organisations (including international European research organisations) is eligible to participate (whether it is eligible for funding or not), provided that the conditions laid down in the Horizon Europe Regulation have been met, along with any other conditions laid down in the specific call/topic.
  • A ‘legal entity’ means any natural or legal person created and recognised as such under national law, EU law or international law, which has legal personality and which may, acting in its own name, exercise rights and be subject to obligations, or an entity without legal personality.
• To become a beneficiary, legal entities must be eligible for funding.
• To be eligible for funding, applicants must be established in one of the following countries:
  • the Member States of the European Union, including their outermost regions:
    • Austria, Belgium, Bulgaria, Croatia, Cyprus, Czechia, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Ireland, Italy, Latvia, Lithuania, Luxembourg, Malta, Netherlands, Poland, Portugal, Romania, Slovakia, Slovenia, Spain, Sweden.
  • the Overseas Countries and Territories (OCTs) linked to the Member States:
    • Aruba (NL), Bonaire (NL), Curação (NL), French Polynesia (FR), French Southern and Antarctic Territories (FR), Greenland (DK), New Caledonia (FR), Saba (NL), Saint Barthélemy (FR), Sint Eustatius (NL), Sint Maarten (NL), St. Pierre and Miquelon (FR), Wallis and Futuna Islands (FR).
  • countries associated to Horizon Europe;
    • Albania, Armenia, Bosnia and Herzegovina, Canada, Faroe Islands, Georgia, Iceland, Israel, Kosovo, Moldova, Montenegro, New Zealand, North Macedonia, Norway, Serbia, Tunisia, Türkiye, Ukraine, United Kingdom.

For more information, visit EC.