Activities of Gwendoline DELBOS-CORFIELD related to 2020/2017(INI)
Shadow opinions (2)
OPINION on artificial intelligence in education, culture and the audiovisual sector
OPINION on artificial intelligence in education, culture and the audiovisual sector
Amendments (19)
Amendment 6 #
Draft opinion
Recital A a (new)
Recital A a (new)
Aa. whereas Artificial Intelligence (AI) and digitalisation is fundamentally transforming our reality and the basis on which it is being shaped and regulated today will highly influence our future societies; whereas the lack of diversity in designing and financing AI is concentrating an increasingly large amount of power and capital in the hands of a select subset of people, which tend to be white, wealthy, highly-educated male and to underrepresent women and discriminated groups; whereas the development of AI under these circumstances have a high risk of perpetuating or even increasing gender and other inequalities; whereas there is a need to advocate for a human centred approach anchored in human rights and ethics for the development and use of AI;
Amendment 9 #
Draft opinion
Recital B
Recital B
B. whereas gender inequalities and discrimination, stereotypes and the accumulation of discriminations on grounds of race, ethnic or social origin, sexual orientation, gender identities and expression, religion or belief, residence status and disability have been reproduced through the design, input and use of artificial intelligence (AI) systems; whereas incomplete and inaccurate datasets and incorrect bias can distorts the reasoning of an AI system, and jeopardise gender equality in society; and are likely to make machine learning algorithms generate incorrect outputs, and therefore jeopardise gender equality in society; whereas data on disadvantaged groups and intersectional forms of discrimination tend to be incomplete and even absent; whereas addressing these biases requires greater vigilance, technical solutions and the development of clear requirements of fairness, accountability and transparency;
Amendment 13 #
Draft opinion
Paragraph 2
Paragraph 2
2. Recalls that AI may give rise to biases and thus to various forms of discrimination, especially where the training data used for machine-learning and AI is already biased in that it reflects existing discrimination in society; in this regard, recalls that everyone’s rights must be ensured and that AI initiatives that lead to discriminatory processes should not be allowed;
Amendment 15 #
Draft opinion
Recital C
Recital C
C. whereas gender inequalities are also created and replicated through the language and images disseminated by the media and AI-powered applications; whereas education, culture programmes and audiovisual contents are a fundamental tool for combatting gender stereotypes and therefore clear monitoring and an ethical and regulatory framework must be in place ahead of implementing automatized solutions for these key sectors of society;
Amendment 16 #
Draft opinion
Paragraph 3
Paragraph 3
3. Notes that AI-poweredthe use of AI in education brings a wide range of possibilities and opportunities, while at the same timeincluding raising awareness of the potentials and risks; points out that if applied to the students themselves AI posinges risks regarding equal access to education and learning equalities; calls for the non- discriminatory use of AI in the education sector; recalls the risks and discrimination arising from recently developed AI tools used for school admission the use of which would be unlawful under Union data protection law; reminds that automated decisions about natural persons based on profiling, where they lead to legal or similar effects, are strictly limited and always require the right to human intervention and to explicability under the General Data Protection Regulation; underlines that this should be strictly adhered to especially in the education system, where decisions about future chances and opportunities are taken;
Amendment 29 #
Draft opinion
Paragraph 4
Paragraph 4
4. Welcomes the Commission’s plan to update the Digital Education Action Plan in order to make better use of data and AI-based technologies so as to make educational systems fit for the digital age; stresses that generaleducational systems fit for the digital age, through making better use of data and improving education on data and AI-based technologies ; stresses that this is an important element to ensure there is more public awareness of AI at all levels, including awareness of AI risks relating to privacy and bias, which is essential for preparing everyoneenabling the public to make informed decisions; invites the Commission and Member States to include the above in educational action plans as well as in programmes which support the arts in order to illustrate the risks and biases of AI;
Amendment 33 #
Draft opinion
Paragraph 1
Paragraph 1
1. Considers that AI has great potential to promote gender equality provided thbut further and important efforts need to be put from a regulatory point of view to eliminate conscious and unconscious bias are eliminated; stresses the need for AI to respect the principles and values of equality and non- discrimination between women and men; stresses, further, the importance of a risk-based approachdifferentiated and transparent risk-based approach based on the potential harm for the individual as well as for society and of continuous monitoring of existing and new algorithms;
Amendment 38 #
Draft opinion
Paragraph 5
Paragraph 5
5. Recalls that data protection and privacy can be particularly affected by AI; defendunderlines the principles established in the General Data Protection Regulation as guibinding principles for AI deployment; calls for stronger protection and safeguards in the education sector where children’s data are concerned;
Amendment 43 #
6. Underlines the need for explicability of AI algorithm-based automated individual decisions and the possibility of human verification, human intervention, and for due process, including the right of appeal, especifically, but not limited to, for decisions taken within the framework of prerogatives of public power, as enshrined in the GDPR;
Amendment 43 #
Draft opinion
Paragraph 2
Paragraph 2
2. Calls for policies targeted at increasing the participation of women in the fields related to science, technology, engineering and mathematics (STEM) and AI, at combatting sexism in particularly male dominated work environments such as of AI and programming and the adoption of a multi-level approach to address the gender gap in all levels of education and employment in the digital sector;
Amendment 47 #
Draft opinion
Paragraph 7
Paragraph 7
7. Calls on the Commission to assess the risks of AI assisting the spread of disinformation in the digital environment and to propose recommendations, among others, for action against any AI-powered threats to free and fair elections and democracy; underlines that AI is also involved in the spread of disinformation about the Covid-19 pandemic; calls on the Commission to develop a regulatory framework that does not lead to censorship of individual content uploaded by users of social networks, but addresses the ways in which the content moderation algorithms are optimised towards engagement of their users; is seriously concerned that such optimisation favours content that is more outrageous and triggers more emotions, therefore giving a disadvantage to truthful and sober content;
Amendment 47 #
Draft opinion
Paragraph 2 a (new)
Paragraph 2 a (new)
2a. Calls on the European Commission in respect of the obligation of gender mainstreaming and ahead any further legislation or policy to develop a comprehensive gender analysis on the potential impacts of AI in all sectors, including media, culture and education, in order to assess the risks and outline recommendations to correct potential negative gender equality outcomes for individuals and the society as a whole;
Amendment 50 #
Draft opinion
Paragraph 3
Paragraph 3
3. Calls on the Commission and Member States to take into account AI from a gender perspective when developing policy and legislation, and, if necessary,integrate the gender perspective in AI and to conduct systematic gender impact assessments when developing policy and legislation; Calls for the introduction in future AI regulations and programmes of gender equality targets and requirements for financing, developing and testing AI systems before they are applied with the view to eliminate potential discriminations or violations of other rights; Calls to adapt current legislation, including EU programmes to that end;
Amendment 52 #
Draft opinion
Paragraph 8
Paragraph 8
8. Notes that AI tools have the potentialare already used to fight illegal content online, with unclear results; but strongly recalls, ahead of the Digital Services Act expected for the end of this year, that such tools should always respect fundamental rights, especially freedom of expression, and should not lead to a general monitoring of the internetobligation to monitor the internet, nor to a general obligation to actively seek facts or circumstances indicating illegal activity;
Amendment 55 #
Draft opinion
Paragraph 3 a (new)
Paragraph 3 a (new)
3a. Underlines the importance of ensuring that the interests of women experiencing multiple forms of discrimination, marginalised and vulnerable groups are adequately taken into account and represented in any future regulatory framework; Notes with concern that marginalised groups risk of suffering new technological, economic and social divides with the development of AI;
Amendment 65 #
Draft opinion
Paragraph 5
Paragraph 5
5. Highlights the importance of the development and deployment of AI applications in the educational, cultural and audiovisual sectors in collecting more accurate and sex-disaggregated and other equality data, and applying modern machine learning de- biasing techniques, if needed, to correct stereotype gender bias, which may have negative impacts; Stresses the necessity to have complete, reliable and timely data and that its availability and access constitutes a prerequisite for installing AI-enhanced data analytics systems;
Amendment 68 #
Draft opinion
Paragraph 5 a (new)
Paragraph 5 a (new)
5a. Notes that for the purpose of analysing the impacts of algorithmic systems on citizens, access to data should be extended to appropriate parties notably independent researchers, media and civil society organisations, while fully respecting Union data protection and privacy law;
Amendment 69 #
Draft opinion
Paragraph 5 b (new)
Paragraph 5 b (new)
5b. Calls on the Commission to include education in the regulatory framework for high-risk AI applications given the importance of ensuring that education continues to contribute to the public good and given the high sensitivity of data on pupils, students and other learners; emphasises that in the education sector, this deployment should involve educators, learners and wider society and take their needs and the expected benefits into account in order to ensure that AI is used purposefully and ethically;
Amendment 71 #
Draft opinion
Paragraph 5 c (new)
Paragraph 5 c (new)
5c. Calls on the Commission to encourage the use of EU programmes such as Horizon Europe, Digital Europe and Erasmus+ to promote multi- disciplinary research, pilot projects, experiments, development of tools including training, for the identification of gender biases in AI, and awareness raising campaigns for the general public;