Poland's Ministry of Digital Affairs Attempts to Regulate Forbidden AI Systems under EU AI Act

Ministry of Digital Affairs in Poland tackles prohibited AI systems to protect fundamental rights

On 31 December 2024, Poland’s Ministry of Digital Affairs concluded its public consultation on the implementation of the European Union’s Artificial Intelligence (AI) Act, focusing specifically on prohibited AI systems.

This action reflects the country’s commitment to aligning with the EU’s broader efforts to establish a uniform regulatory framework for AI while addressing national concerns about machine learning (ML) and AI-related risks.

The consultation centred on Article 5 of the EU Regulation 2024/1689, which lists prohibited AI practices. These include systems that manipulate human behaviour to the detriment of individuals, exploit vulnerable groups, or pose unacceptable risks to fundamental rights.

Ministerstwo Cyfryzacji zaprasza do udziału w pracach nad wdrożeniem AI Act - Ministerstwo Cyfryzacji - Portal Gov.pl

Od 1 sierpnia 2024 r. rozpoczął się proces wprowadzania w życie przepisów Rozporządzenia o sztucznej inteligencji (AI Act) w Unii Europejskiej. Celem tego aktu prawnego jest stworzenie jednolitych ram regulacyjnych, które poprawią funkcjonowanie rynku wewnętrznego UE w obszarze sztucznej inteligencji, skupiając się na rozwoju, wprowadzaniu do obrotu, oddawaniu do użytku oraz wykorzystywaniu systemów AI.

Ministerstwo Cyfryzacji

Prohibited AI Systems Under Scrutiny

The EU AI Act categorises certain AI practices as prohibited due to their high risk of causing harm. Poland’s consultation sought feedback on these practices, which include:

• Manipulative AI Systems: Technologies designed to subliminally influence individuals’ decisions in harmful ways.
• Exploitation of Vulnerable Groups: AI systems targeting children, the elderly, or individuals with disabilities for manipulative purposes.
• Social Scoring by Governments: Systems that evaluate individuals’ trustworthiness based on behaviour, a practice reminiscent of China’s social credit system.
• Real-Time Biometric Surveillance: Systems used in public spaces for mass surveillance without adequate safeguards.

Ministerstwo Cyfryzacji zaprasza do udziału w pracach nad wdrożeniem AI Act - Ministerstwo Cyfryzacji - Portal Gov.pl

Od 1 sierpnia 2024 r. rozpoczął się proces wprowadzania w życie przepisów Rozporządzenia o sztucznej inteligencji (AI Act) w Unii Europejskiej. Celem tego aktu prawnego jest stworzenie jednolitych ram regulacyjnych, które poprawią funkcjonowanie rynku wewnętrznego UE w obszarze sztucznej inteligencji, skupiając się na rozwoju, wprowadzaniu do obrotu, oddawaniu do użytku oraz wykorzystywaniu systemów AI.

Ministerstwo Cyfryzacji

The consultation also explored practical challenges related to identifying, monitoring, and enforcing these prohibitions, particularly as AI systems become increasingly integrated into daily life.

Educating Businesses and the Public

A key aspect of the Ministry’s initiative is raising awareness among affected businesses and the general public. The Ministry has emphasised the importance of educating stakeholders about the AI Act’s requirements and their implications.

Businesses involved in AI development must understand the boundaries of permissible activities to avoid penalties and contribute to a trustworthy AI ecosystem.

For the public, the Ministry’s efforts include explaining how the AI Act protects their fundamental rights and what safeguards are in place against potentially harmful AI systems.

This dual focus on businesses and citizens aims to foster a culture of accountability and informed participation in the digital economy.

The AI Act: How Europe Plans to Regulate Artificial Intelligence

The EU’s AI Act sets the stage for global AI regulation, introducing a risk-based framework that balances innovation with safeguards. Its potential to inspire international standards echoes the GDPR’s transformative impact on data privacy.

Technology LawElena U. Cumberland

Challenges in Implementation

Implementing prohibitions on certain AI systems presents significant challenges. Identifying manipulative or exploitative AI practices requires sophisticated monitoring mechanisms and technical expertise.

Additionally, ensuring compliance across various sectors—from healthcare to advertising—requires coordinated efforts between regulators and industry stakeholders.

The consultation process also revealed concerns about balancing regulation with innovation.

Stakeholders expressed fears that overly stringent rules could stifle the development of beneficial AI applications, particularly in sectors like education and healthcare where AI has transformative potential.

Poland’s Role in Shaping EU AI Standards

Poland’s proactive approach to implementing the EU AI Act demonstrates its commitment to playing a leading role in shaping AI governance within the bloc. The country sets an example for other EU member states navigating similar regulatory challenges.

Poland’s efforts to regulate forbidden AI systems highlight the importance of collaboration, education, and vigilance in ensuring that AI technologies serve the public good without compromising fundamental rights.