44 Amendments of Patrizia TOIA related to 2020/2216(INI)
Amendment 4 #
Draft opinion
Paragraph 1
Paragraph 1
1. Highlights that European leadership can be a reality; notes that a second wave of digitalisation lies ahead; underlines that a common EU approach can make Europe the most innovative region in the world by 2030; stresses that digital revolution must contribute to sustainable development and benefit all citizens, while balancing the economic, ethical and environmental dimensions; further recognises that AI is an engine for sustainable transformation;
Amendment 6 #
Draft opinion
Paragraph 1 a (new)
Paragraph 1 a (new)
1 a. Recommends that Europe must analyse the challenges for consumers created by AI and make the EU’s consumer rights standards fit for the 21st century. Therefore it must establish an AI European Certificate of Compliance with Ethical Principles to ensure European citizens trust on AI; This Certificate should be granted by an independent, public certification organisation after a thorough assessment of compliance with the Ethical Requirements put forward by the High Level Expert Group on AI. The certification criteria and requirements for assessing the compliance will be drawn by this body in cooperation with the Commission and the Member States. Suggests that certification and auditing mechanisms at both the national and EU levels for automated data processing and decision-making techniques should be developed to ensure their compliance with ethical principles and values. Monitoring of compliance should be proportionate to the nature and degree of risk associated with the operation of the artificial intelligence application or system;
Amendment 10 #
Draft opinion
Paragraph 1 a (new)
Paragraph 1 a (new)
1 a. Demands that digital connectivity should be a key element to address; calls to the Commission to urgently address the existing digital divide and analyse the impact of digital technologies with regards to unequal access to technology, on the depopulation phenomenon and disparities in connectivity across the Member States;
Amendment 14 #
Draft opinion
Paragraph 1 b (new)
Paragraph 1 b (new)
1 b. The shaping of a fair digital sector must go hand-in-hand with educational aspects, socialisation, fair working conditions, work-life balance, democracy, good governance and strong public services;
Amendment 17 #
Draft opinion
Paragraph 1 c (new)
Paragraph 1 c (new)
1 c. Highlights that science, innovation and R&D will be indispensable to attain the objectives of inclusive digital transformation and European digital sovereignty;
Amendment 27 #
Draft opinion
Paragraph 2
Paragraph 2
2. Recognises that the EU has an enormously strong SME sector; recalls that this second wagve of digitalisation could lead to a strong industrial development of SMEs; reinforces the need to accelerate the digitalisation of SMEs and help them overcome barriers in adopting AI applications; calls for a goal of 500 digital unicorns within 10 years;
Amendment 32 #
Draft opinion
Paragraph 2 a (new)
Paragraph 2 a (new)
2 a. Recognizes that the less digitally mature sectors are facing both internal and external barriers to the adoption of the AI that need to be clearly identified; stresses that for the most part, and especially for SMEs, barriers to the adoption of AI are similar to those hindering digitalisation;
Amendment 35 #
Draft opinion
Paragraph 2 c (new)
Paragraph 2 c (new)
2 c. Stresses that the successful development and deployment of AI in Europe is dependent on increasing the availability of high-quality data; highlights that using biased data sets can inadvertently lead to biased AI applications and notes especially the risk for reproducing gender, cultural, ethnic, social, disability or sexual orientation biases; underlines the need to acknowledge and address all bias in data- based systems both in their development and use;
Amendment 38 #
Draft opinion
Paragraph 3
Paragraph 3
3. Emphasises that the COVID crisis provides an opportunity to speed up digitalisation; calls for financial incentives for SMEs that want to enter new markets; calls for new and open frameworks of access to data for European SMEs and start-ups in order to support their growth by empowering the training, testing and development of AI-enabled systems and applications. Calls for an inclusive digitisation of our societies that will serve the interests of the citizens by taking into account accessibility and affordability considerations. Calls for coordinated actions to address Europe’s digital divide that has been worsened due to the COVID and for a fair and cooperative digital modernisation of the public sector that would aim at a value-based digital transformation by promoting fundamental rights and democratic values.
Amendment 41 #
Draft opinion
Paragraph 3
Paragraph 3
3. Emphasises that the COVID crisis provides an opportunity to speed up digitalisation; calls for financial incentives for SMEs that want to enter new markets; recognises the concern that large firms have better capabilities to take advantage of the opportunities provided by AI which could lead to overconcentration in the market of large firms and multinationals;
Amendment 44 #
Draft opinion
Paragraph 3
Paragraph 3
3. Emphasises that the COVID crisis provides an opportunity to speed up digitalisation; calls for financial incentives for SMEs, start - ups and for companies and subjects of the social economy that want to enter new markets;
Amendment 46 #
Draft opinion
Paragraph 3 a (new)
Paragraph 3 a (new)
3 a. Recognises that the EU is lagging behind in the AI global competition; emphasises that the focus on services for citizens and businesses creates a global market segment in which the EU can lead, respecting its structural principles and values , including our Digital Identity, which are focusing on upholding fundamental rights, strong ethical aspects, legal safeguards and liability, thus protecting our democratic societies and citizens;
Amendment 49 #
Draft opinion
Paragraph 3 b (new)
Paragraph 3 b (new)
3 b. Calls for Commission to develop innovative and proportionate rules for a trustworthy digital society, ensuring it should be fully inclusive, fair and accessible for all;
Amendment 51 #
Draft opinion
Paragraph 3 c (new)
Paragraph 3 c (new)
3 c. Highlights that we need a European legal framework on AI, robotics and related technologies that addresses ethical principles and fundamental rights in their development, deployment and use; notes that such framework should agree on ethical and technical standards to govern the use of new technologies, such as AI;
Amendment 52 #
Draft opinion
Paragraph 3 d (new)
Paragraph 3 d (new)
3 d. Stresses that AI products and services may deliver different experiences to different consumers; highlights the importance of gender and ethnic diversity in digital careers to achieve digital products and services that fully address and represent the diverse set of experiences and needs of European consumers;
Amendment 64 #
Draft opinion
Paragraph 5
Paragraph 5
5. Calls on the Commission to stop funding big companies and distributing the remaining funds by a shotgun approach; calls for winners to be picked and grown larger; suggests prioritising future areas for digital economic structureshighlights that large technology companies and platforms with strategic market status in the DSM may leverage their positions not only in terms of the market but also in terms of access to and control of data, resulting in possible concentration of AI innovation and future imbalances in the DSM; calls for winners to be picked and grown larger; suggests prioritising future areas for digital economic structures; Highlights the need to support SMEs to master the twin transition to sustainability and digitalisation by safeguarding that they have access to the right skills, expertise and funding. Highlights the need for this support to acquire abroad geographical coverage across Europe, including remote, rural and island areas and aim at strengthening the digital capabilities and infrastructure in smaller places at the periphery of Europe;
Amendment 67 #
Draft opinion
Paragraph 5 a (new)
Paragraph 5 a (new)
5 a. Warns against the use of predictive technologies or perception manipulation techniques for market purposes from Big tech companies and pledges to safeguard that sensitive personal data, transactions data and metadata will not be used for profit by big corporations without citizens awareness and clear consent. Calls for these techniques to be classified in the highest category of the risk level scale proposed by the Commission given their specific and extremely sensitive nature as well as their potential misuses Calls the European Data Protection Board to issue Guidelines on this issue and highlights the need to safeguard algorithmic transparency of AI technologies and applications. Stresses the need for the establishment of a thorough system of traceability of AI systems that will be under human oversight, understandable by the consumers and which meets data subjects’ reasonable expectations;
Amendment 74 #
Draft opinion
Paragraph 7
Paragraph 7
7. Calls for massive investment in clusters of excellence; calls to the Commission to facilitate the development of digital innovation hubs across the Member States in order to ensure the capacity-building, sharing of best practices in AI development and deployment and to mobilise the research and innovation along the entire value chain; recognises that such digital innovation hubs can also contribute to attract the access to talent and research capabilities in AI;
Amendment 79 #
Draft opinion
Paragraph 7 a (new)
Paragraph 7 a (new)
7 a. Calls to the Commission to initiate cross-sectoral dialogues, giving priority to healthcare, rural administrations and public service operators in order to present an action plan to facilitate the development, research and adoption of AI applications;
Amendment 81 #
Draft opinion
Paragraph 7 b (new)
Paragraph 7 b (new)
7 b. Calls for more investment in research, innovation, science and the scientific community, which is the driving force of the technological and digital revolution;
Amendment 85 #
Draft opinion
Paragraph 8
Paragraph 8
8. Demands measures to end to the brain drain and attract the best minds to the EU; considers that the new Skills Agenda for Europe must address the challenges of adapting and raising new qualifications that reinforce the green and digital transition, including ethical aspects of AI;
Amendment 87 #
Draft opinion
Paragraph 8 a (new)
Paragraph 8 a (new)
8 a. Recognizes the need to protect the citizens and workers potentially at risk of displacement due to AI; calls to the Commission to develop strategies to manage digital transition by supporting reskilling programs, improving professional education, ensuring greater access to talent and provide long-life trainings for the current and future workforce with particular focus on SMEs; notes that education and transparency of new data driven technologies is important for the workforce to be able to understand, and be part of, the fair implementation; stresses the right of employees to know where and how their data is collected; Calls on social partners to explore the potential of digitalisation, data and AI to increase sustainable productivity, improve the well-being of their workforces while respecting workers’ rights as well as investing in awareness rising and digital literacy schemes;
Amendment 88 #
Draft opinion
Paragraph 8 a (new)
Paragraph 8 a (new)
8 a. Suggests that the EU must ensure minimum standards of fair working conditions for platform workers in line with the European Pillar of social rights as a requirement to allow access of platforms to the EU Digital single market. Suggests that the EU should introduce rules that control the growing digitisation of workplace monitoring and also to introduce mechanisms and methodologies that assess the relevant risks that have been augmented due to the increasing blurring between office and home environments. Calls for the EU to establish collective bargaining agreements and umbrella protection mechanisms for all platform workers;
Amendment 91 #
Draft opinion
Paragraph 8 a (new)
Paragraph 8 a (new)
8 a. Calls for measures aimed to increasing and supporting training projects and actions for women in the digital sector, as well as projects and actions for the employment and career paths of women in the digital sector;
Amendment 93 #
Draft opinion
Paragraph 8 b (new)
Paragraph 8 b (new)
8 b. Stresses that 90% of jobs require basic digital skills while 42% of EU citizens lack basic digital skills1a; _________________ 1a https://ec.europa.eu/digital-single- market/en/digital-economy-and-society- index-desi
Amendment 94 #
Draft opinion
Paragraph 8 c (new)
Paragraph 8 c (new)
8 c. Calls for promoting the creation and expansion of digital knowledge and support the research programmes and networks created among European universities in order to help European businesses and entrepreneurs attract the best talent and become the vanguard of digital innovation worldwide. Skills shortages and mismatches can be prevented by improving and facilitating connections between the education and training systems and the needs of companies to innovate;
Amendment 96 #
Draft opinion
Paragraph 8 d (new)
Paragraph 8 d (new)
8 d. Stresses that in order for new digitalisation wave to be successful, one of the crucial challenges is to provide sufficient digital skills for European digital sector; recalls that women are under-represented at all levels in the digital sector in Europe, from students (32% at Bachelor, Master or equivalent level)up to top academic positions (15%) and that the gap is largest in ICT specialist skills and employment, where only 18% are women in the EU2a _________________ 2a https://ec.europa.eu/digital-single- market/en/news/digital-economy- scoreboard-shows-women-europe-are- less-likely-work-or-be-skilled-ict
Amendment 97 #
Draft opinion
Paragraph 9
Paragraph 9
9. Recognises that AI deployment is key to European competitiveness in the digital era; highlights that to facilitate the uptake of AI in Europe, a common European approach is needed to avoid internal market fragmentation; calls for promoting AI technologies aimed at improving public services with collective benefits; stresses that AI can help to break down the silos by linking and streamlining public services to improve administration for the benefit of citizens and businesses as well as provide real- time data bases for services and decision making;
Amendment 99 #
Draft opinion
Paragraph 9
Paragraph 9
9. Recognises that AI deployment is key to European competitiveness in the digital era; highlights that to facilitate the uptake of AI in Europe, a common European approach is needed to avoid internal market fragmentation, ensure the safety of data of Europeans and guarantee that they will not be processed by non-EU bodies for profit-making and/or political purposes or used to train algorithms shared with authoritarian regimes;
Amendment 105 #
Draft opinion
Paragraph 9 a (new)
Paragraph 9 a (new)
9 a. States that increased digitalisation will bring new energy needs but also contribute to bring efficiency with providing better understanding of processes and leading to their improvements; recognises that AI can help to identify where energy improvements can be made for energy and costs savings; furthermore AI can better help to measure energy efficiency, improve energy management and access to renewable storage;
Amendment 115 #
Draft opinion
Paragraph 10
Paragraph 10
10. Considers that access to big data is key for the development of AI; calls for a new approach to data regulationreiterates the need for a new approach to data ownership by data subjects in the context of AI-enabled systems to ensure privacy and control of aggregated data or metadata built on data points containing information including, but not limited to, time, location, transactions; calls for a new approach to data regulation; stresses that privacy and data protection must be guaranteed at all stages of the AI system’s life cycle and notes that any big data processing operation should be subject to an ex-ante and extensive Data Protection Impact Assessment;
Amendment 116 #
Draft opinion
Paragraph 10
Paragraph 10
10. Considers that access to big data is a key for the development of AI; calls for a new approach to data regulation; underlines the importance of level playing field and EU wide interoperability when using the exponentially increasing amount of the industrial and public data; recalls that success of the Union’s data economy as well as AI development and deployment primary depends on the wider ICT ecosystem, closing the digital divide, upskilling and reskilling of workforce, developing the IoT, fibre, quantum, block;
Amendment 118 #
Draft opinion
Paragraph 10 a (new)
Paragraph 10 a (new)
Amendment 120 #
Draft opinion
Paragraph 10 a (new)
Paragraph 10 a (new)
10 a. Recalls that access to data must result from a transparent trade-off with citizens; recognises that when citizens authorize the use of the data, receiving as counterpart better services of general interest and a more competitive offer from the market; states that transparency and monitoring of the use of data must be ensured;
Amendment 122 #
Draft opinion
Paragraph 10 b (new)
Paragraph 10 b (new)
10 b. Demands that any artificial intelligence, robotics and related technologies system, shall be developed, deployed or used with "privacy by default" and in a manner that prevents the possible identification of individuals from data that were previously processed based on anonymity or pseudonymity, and the generation of new, inferred, potentially sensitive data and forms of categorisation through automated means (metadata). Calls the Commission to develop robust anonymisation and pseudonymisation techniques and identify best practices that will meet the processing requirements of the GDPR;
Amendment 126 #
Draft opinion
Paragraph 10 c (new)
Paragraph 10 c (new)
10 c. Strongly emphasises the need to protect consumers from microtargeting practises and suggests that it should be flagged and coupled with their right to request a report on the use of behavioural analytics that were used to achieve consumers targeting. Is of the opinion that targeted advertisement practises should be explainable and offer to consumers options of choosing the desired personalization level/percentage of microtargeting. (ex. on a scale 0-100%). Strongly considers that the use of these practices should be subject to specific safeguards such as the informed and explicit consent of their owner, who should have the right to access effective remedies in case of misuse;
Amendment 129 #
Draft opinion
Paragraph 11
Paragraph 11
11. Warns against overregulating AI and discourages any "one-size-fits-all" approach to regulation; recalls that regulation must be balanced, agile, permanently evaluroportionated , and based on soft regulation except for high-risk areasthe current legislative instruments and best practices except for high-risk areas where a new regulatory approach should be devised;
Amendment 134 #
Draft opinion
Paragraph 11
Paragraph 11
11. Warns against overregulating AI; recalls that regulation must be balanced, agile, permanently evaluated, and based on soft regulation except for high-risk areas; recognises that a regulatory approach to the definition of risk focusing only on high-risk sectors (healthcare, transport, energy and parts of the public sector) and high-risk uses or purposes can lead to potential loopholes;
Amendment 135 #
Draft opinion
Paragraph 11 a (new)
Paragraph 11 a (new)
11 a. Recommends that determining the risk level and the classification of sectors as high or low-risk, should always derive from an impartial, regulated, inclusive, independent and external assessment that considers ethical harms that can arise from artificial intelligence, robotics and related technologies in society, either because of poor (unethical) design, inappropriate application, or misuse; Such an assessment needs to balance attention to abstract principles with specificity; Recommends that determining the risk level and the classification of sectors as high or low-risk, should always derive from an impartial, regulated, inclusive, independent and external assessment that considers ethical harms that can arise from artificial intelligence, robotics and related technologies in society, either because of poor (unethical) design, inappropriate application, or misuse; Such an assessment needs to balance attention to abstract principles with specificity; Strongly recommends that a broad and inclusive debate and stakeholder consultation will contribute to creating trust among citizens regarding the assessment and classification of risks;
Amendment 139 #
Draft opinion
Paragraph 11 a (new)
Paragraph 11 a (new)
11 a. Notes that data-driven technologies, including AI are becoming the dominant force in the digital economy; states that any regulatory framework will need to address the question of production and use, interoperability, access to and sharing of data, reskilling of workforce and data management, in particularly SMEs;
Amendment 141 #
Draft opinion
Paragraph 11 b (new)
Paragraph 11 b (new)
11 b. Requests the Commission to determine the risk level of sectors by taking into account non-quantifiable risks and pay particular attention to the identification and characterisation of the hazard, the assessment of the likelihood of its occurrence and the characterisation of risk. Asks the Commission to pay particular attention to carefully evaluate all the uncertainties and transparently report on them, even when these cannot be modelled or expressed in quantitative terms. Requests the Commission to apply the Ethical Requirements put forward by the High Level Expert Group at the risk management level and consider the need for introducing a precautionary approach towards high level or potentially irreversible risks;
Amendment 143 #
Draft opinion
Paragraph 11 b (new)
Paragraph 11 b (new)
11 b. Supports the creation of "ecosystem of trust" as stated in the Commission's White paper on AI that should give citizens sufficient confidence to take up AI applications and provide to companies and public organisation the legal certainty to innovate in AI deployment;
Amendment 151 #
Draft opinion
Paragraph 12 a (new)
Paragraph 12 a (new)
12 a. Calls on the Commission and the Member States to consider the creation of a European regulatory agency for AI and algorithmic decision-making tasked with 1) Auditing the AIAs of high-level impact systems to approve or reject the proposed uses of algorithmic decision-making in highly sensitive and/or safety-critical application domains (private health-care, for instance) 2) Investigating suspected cases of rights violations by algorithmic decision-making systems, for both individual decision instances (singular aberrant outcomes, for example) and statistical decision patterns (discriminatory bias, for instance) 3) Assessing compliance with the proposed Ethics Requirements and conduct periodical ethics reviews and audits;
Amendment 153 #
Draft opinion
Paragraph 12 a (new)
Paragraph 12 a (new)
12 a. Highlights that EU continues its international cooperation on AI with like- minded countries and global players with the approach of EU rules and values; calls on the Commission to closely monitor international level playing field in AI development and deployment;