BETA

Summary for scraper logs from the 2025-01-20

Summary of log messages

LevelCount
Exceptions73
error290
warning1976
info24808
debug0

Summary of changes

TypeAddedUpdated
mep 0 2
dossier 0 4
amendment 10105 0
mep_activity 714 0

Dossier events without known bodies

EventCount
"Initial period for examining delegated act 2.0 month(s)"1247
"Initial period for examining delegated act 3.0 month(s)"460
"Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"86
"Initial period for examining delegated act 1.0 month(s)"68
"Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"30
"Initial period for examining delegated act extended at Council's request by 2.0 month(s)"19
"Initial period for examining delegated act extended at Council's request by 1.0 month(s)"11
"Initial period for examining delegated act extended at Council's request by 3.0 month(s)"7
"Initial period for examining delegated act 4.0 month(s)"6
"Initial period for examining delegated act extended at Parliament's request by 3.0 month(s)"5
"Urgent procedure requested by a committee"3
"Initial period for examining delegated act extended at Parliament's request by 4.0 month(s)"1
"Matter referred back to the committee responsible for reconsideration"1
TimeModuleLevelMessage
2025-01-20T00:36:13.643350dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:36:13.649187dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:13.653199dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:13.654739dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:13.656674dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:13.658458dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:13.660510dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)"
2025-01-20T00:36:13.667913dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:36:16.000376dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:16.178958dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:16.273818dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:16.530129dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:17.382379dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:17.389305dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:17.677393dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0059(COD)&l=en
2025-01-20T00:36:17.938944dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:18.268376dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:18.269154dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 3.0 month(s)"
2025-01-20T00:36:18.494674dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:19.377414dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:19.946610dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:20.255065dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:20.379187dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:20.853548dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:20.854418dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 3.0 month(s)"
2025-01-20T00:36:22.637202dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:23.275091dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:23.489550dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:23.704590dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:24.349125mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2016/0195(NLE)&l=en'} (ValueError())
2025-01-20T00:36:24.350479mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:36:24.355131dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:24.485742dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:36:26.207787dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:26.476126dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:26.477130dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en
2025-01-20T00:36:26.588710dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:26.845601dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:27.346103dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:27.346953dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:28.646104dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:28.896673dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:29.008852dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:29.378362dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:29.848682dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:29.951416dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:31.335405dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:31.693828dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:31.802272dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:32.197702dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:32.438645mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2016/0038(NLE)&l=en'} (ValueError())
2025-01-20T00:36:32.439634mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:36:32.648040dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:32.727456dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:34.060297dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:34.397031dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:34.506779dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:34.507425dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:36:34.846317dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:36:35.209789dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:35.289645dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:36:36.740300dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:36.742221dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 3.0 month(s)"
2025-01-20T00:36:36.826320dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:37.103109dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:37.673983dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:37.676553dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:38.088822dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:38.183719dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:38.336974dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:39.503110dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:39.508353dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:39.591908dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:39.592605dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:36:40.700396dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:40.702742dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:40.703382dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 4.0 month(s)"
2025-01-20T00:36:40.796801dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:40.912606dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:41.799430dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:42.184492dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:42.606226dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:36:42.607252dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:36:42.862700dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:43.242628dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:43.358185dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:43.496640dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:43.583586dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0063(COD)&l=en
2025-01-20T00:36:43.911270dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:44.414784dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:45.879322dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:45.880956dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:46.475225dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:46.810248dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:47.373114dossiererrorunknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed']
2025-01-20T00:36:47.373682mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0212(COD)&l=en'} (ValueError('bad html in EP key players, committee header'))
2025-01-20T00:36:47.374688mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 194, in scrape_ep_key_players
    raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header
2025-01-20T00:36:47.375240dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:48.732363dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:49.332134dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:49.374980dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0060(COD)&l=en
2025-01-20T00:36:50.008603dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:50.944187dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:51.452528dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:52.771034dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:53.002331dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:53.160672dossiererrorunknown committee header in EP key players ['Former committee for opinion on the legal basis', 'Former rapporteur for opinion', 'Appointed']
2025-01-20T00:36:53.161144mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0273(NLE)&l=en'} (ValueError('bad html in EP key players, committee header'))
2025-01-20T00:36:53.161891mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 194, in scrape_ep_key_players
    raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header
2025-01-20T00:36:54.087913dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:54.089978dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:54.092144dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:36:54.378259dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:54.580830dossiererrorunknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed']
2025-01-20T00:36:54.581214mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2013/0186(COD)&l=en'} (ValueError('bad html in EP key players, committee header'))
2025-01-20T00:36:54.581937mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 194, in scrape_ep_key_players
    raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header
2025-01-20T00:36:55.230158dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:55.230658dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)"
2025-01-20T00:36:55.463031dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:36:55.779424dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en
2025-01-20T00:36:56.910765dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:56.911356dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)"
2025-01-20T00:36:57.062276dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:36:57.063463dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)"
2025-01-20T00:36:57.067508dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:57.617273dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:58.025456dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:58.260551dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:36:59.379181dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:36:59.548477dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:00.230216dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:00.418866dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:00.420892dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:00.511906dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/2047(INI)&l=en
2025-01-20T00:37:00.516587dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:00.714475dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:02.599932dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:02.601275dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:02.654882dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:02.999219dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:04.615991dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:37:04.845067dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:04.846390dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)"
2025-01-20T00:37:04.850924dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:04.852349dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:37:04.993692dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:05.892033dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:07.021673dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:37:07.103121dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:07.225841dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:07.226537dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:37:07.302705dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:07.654878dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:37:08.207314mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2012/0164(APP)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1256257'))
2025-01-20T00:37:08.209302mgrerrorTraceback (most recent call last):
File "scrapers/dossier.py", line 740, in fetchSummary
    tmp=fetch(url)
        ^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 264, in fetch
    xml = fetch_raw(url, retries, ignore, params)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error:  for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1256257

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 84, in scrape
    docs = scrape_docs(root, edocs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 614, in scrape_docs
    doc['summary']=fetchSummary(url)
                   ^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 742, in fetchSummary
    tmp=fetch_raw(url)
        ^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error:  for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1256257
2025-01-20T00:37:09.229316dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:37:09.340942dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:09.342377dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)"
2025-01-20T00:37:09.599085dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:09.600134dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:10.306023dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:10.575704dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:10.576465dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)"
2025-01-20T00:37:11.151134dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:11.307265dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:37:11.307864dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:37:11.542686dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:37:11.543590dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:37:11.676425dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:37:12.371026dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:12.805431dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:13.153391dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:13.738994dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:37:13.832232dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:13.833059dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)"
2025-01-20T00:37:14.393603dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:14.395250dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:37:14.396666dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:14.403057dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:37:14.789979dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:15.383658dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:15.705998dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:16.111716dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:16.360613dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:17.081296dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:17.088283dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:17.499163dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:17.677943dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:18.222033dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:18.629960dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:18.960139dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:18.960791dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:37:19.120546dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:37:19.121320dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:19.527747dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:37:19.649384dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:20.243028dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:37:20.963594dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:21.399782dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:21.566394dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:37:21.717848dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:21.729781dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:21.882890dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:37:22.253331dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:37:22.861234dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:37:23.598054dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:24.274040dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:24.347970dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:24.518386dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:37:25.117485dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:25.224427dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:25.727496dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:26.329973dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:26.804211dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:37:26.805066dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 3.0 month(s)"
2025-01-20T00:37:26.926121dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:27.184618dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:27.757928dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:27.892560dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:37:27.893138dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:37:28.153158dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:37:28.153746dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:37:28.713845dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:28.814685dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:29.010407dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:37:29.282136dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:29.612122dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:37:29.612650dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:37:29.843156dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:37:30.419578dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:30.546007dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:30.773896dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:31.265164dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:31.833604dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:31.834646dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:37:32.670362dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:37:32.936392dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:33.631035dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:33.633736dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:33.635506dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:34.506778dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:34.895668dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:35.044377dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:35.600378dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:36.975560dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:36.983126dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:36.990890dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:37:36.994818dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:37.199191dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:37.561282dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:38.099242dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:37:38.099812dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:37:38.777383dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:37:38.778011dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:37:40.014149dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:37:40.015358dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:37:40.016259dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:37:40.017537dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:37:40.124127dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:37:40.125241dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:37:40.126064dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:37:40.127401dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:37:40.185260dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:40.600300dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:37:40.601034dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:37:41.003141dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:41.372536dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:42.373065dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:42.456349dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:42.615565dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:42.884104dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:37:43.012286dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:43.108089dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:43.926582dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:44.222936dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:37:44.223524dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:37:44.565541dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:37:45.097670dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:37:45.098339dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:37:45.590990dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:45.658575dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:45.748159dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:45.852396dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:46.886114dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:46.892406dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:47.433441dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:47.437028dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:47.809019dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:48.189954dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:48.453773dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:48.507402dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:49.257517dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:49.372104dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:37:50.155706dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:50.156332dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)"
2025-01-20T00:37:50.697104dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:50.699104dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:50.912005dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:37:50.912637dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:37:50.983397dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:51.314686dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:52.434437dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:52.493145dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:53.554619dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:37:53.765032dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:37:53.820470dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:37:53.916696dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:53.918365dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:37:54.993101dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:37:55.186640dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:37:55.187231dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:37:55.865211dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:37:56.350968dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:56.577343dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:56.577966dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:37:56.734704dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:56.736804dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:56.738846dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:37:56.942514dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:57.657130dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:37:57.657907dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:37:57.837531dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:59.020908dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:59.099230dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:59.737921dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:59.739858dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:37:59.743032dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:37:59.744303dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:38:00.897081dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:00.899494dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:01.719221dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:38:01.721136dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:38:02.072628dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:02.160409dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:02.324256dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:38:02.496786dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:03.274548dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:03.276053dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:38:03.419023dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:03.902741dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:04.057646dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:04.058395dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:38:04.243572dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:38:04.655856dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:38:05.007149dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:05.007888dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:05.009308dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)"
2025-01-20T00:38:05.493442dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:05.932911dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:05.998198dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:06.888057dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:07.063359dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)"
2025-01-20T00:38:07.106930dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:07.115107dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:07.116024dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:38:07.614390dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:38:07.958017dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:08.355001dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:09.784376dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:09.920882dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:10.042539dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:10.223604dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:11.125461dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:11.126214dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:12.472886dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:12.523228dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:12.605345dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:12.842926dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:12.843615dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:13.354601dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:14.192346dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:14.193065dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:38:14.671179dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:14.835516dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:14.907816dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:14.908510dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:38:15.010002dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:15.217424dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:15.749649dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:15.753286dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:38:17.347656dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:17.592206dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:17.671276dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:17.936980dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:18.067923dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:18.069432dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:38:23.766059dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:23.769176dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:23.771651dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:23.773545dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:23.779956dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:23.782967dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:24.638327mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2015/0012(NLE)&l=en'} (ValueError())
2025-01-20T00:38:24.639335mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:38:26.114225dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:26.117892dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:26.193309dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:26.531295dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:26.729368dossiererrorunknown committee header in EP key players ['Former committee for opinion on the legal basis', 'Former rapporteur for opinion', 'Appointed']
2025-01-20T00:38:26.729707mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2004/0148(COD)&l=en'} (ValueError('bad html in EP key players, committee header'))
2025-01-20T00:38:26.730409mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 194, in scrape_ep_key_players
    raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header
2025-01-20T00:38:27.179745dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:27.377815dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2148(INI)&l=en
2025-01-20T00:38:27.638520dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:28.954730dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:29.113462dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:29.114176dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 3.0 month(s)"
2025-01-20T00:38:29.224210dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:29.305028dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:29.791280dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:30.381638dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:30.484320dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:30.824296dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0057(COD)&l=en
2025-01-20T00:38:31.253925dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:32.023662dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:32.246279dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:32.427768dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:32.588918dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:33.084129dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:33.346409dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:38:33.347161dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)"
2025-01-20T00:38:33.428924dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:34.313368dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:38:34.629064dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:34.937399dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:35.562580dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:35.883231dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:36.646418dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:37.214868dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:38.159200dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:38.160715dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:38.438077dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:38.654100dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:38.655257dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:38:38.656017dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:40.261356dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:40.950515dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:41.050214dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:38:42.480849dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:43.562978dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:43.657746dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:43.659156dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:43.990365dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:44.397762dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:44.467006dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:45.617732dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:46.078243dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:46.466860dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:38:46.467899dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:46.468946dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:38:46.750323dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:46.862829dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:47.067623dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:48.067680dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:49.020607dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:49.380160dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:49.561065dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:49.713845dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:50.001994dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:50.551609dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:50.552589dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:38:50.553254dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)"
2025-01-20T00:38:50.624185dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:51.318362dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:51.802147dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:52.429452dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:52.430818dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:38:52.433058dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:52.637861dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:53.241300dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:38:53.243168dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:54.247948dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:38:55.126866mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2011/0815(NLE)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1173982'))
2025-01-20T00:38:55.128461mgrerrorTraceback (most recent call last):
File "scrapers/dossier.py", line 740, in fetchSummary
    tmp=fetch(url)
        ^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 264, in fetch
    xml = fetch_raw(url, retries, ignore, params)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error:  for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1173982

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 82, in scrape
    events, edocs = scrape_events(root)
                    ^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 491, in scrape_events
    event['summary']=fetchSummary(url)
                     ^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 742, in fetchSummary
    tmp=fetch_raw(url)
        ^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error:  for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1173982
2025-01-20T00:38:58.392842mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2009/0814(NLE)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1097092'))
2025-01-20T00:38:58.426945mgrerrorTraceback (most recent call last):
File "scrapers/dossier.py", line 740, in fetchSummary
    tmp=fetch(url)
        ^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 264, in fetch
    xml = fetch_raw(url, retries, ignore, params)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error:  for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1097092

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 82, in scrape
    events, edocs = scrape_events(root)
                    ^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 491, in scrape_events
    event['summary']=fetchSummary(url)
                     ^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 742, in fetchSummary
    tmp=fetch_raw(url)
        ^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error:  for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1097092
2025-01-20T00:38:59.443373dossiererrorunknown committee header in EP key players ['Former committee for opinion on the legal basis', 'Former rapporteur for opinion', 'Appointed']
2025-01-20T00:38:59.443708mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2008/0090(COD)&l=en'} (ValueError('bad html in EP key players, committee header'))
2025-01-20T00:38:59.444472mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 194, in scrape_ep_key_players
    raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header
2025-01-20T00:39:01.899785mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2008/0171(NLE)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1046121'))
2025-01-20T00:39:01.901144mgrerrorTraceback (most recent call last):
File "scrapers/dossier.py", line 740, in fetchSummary
    tmp=fetch(url)
        ^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 264, in fetch
    xml = fetch_raw(url, retries, ignore, params)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error:  for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1046121

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 82, in scrape
    events, edocs = scrape_events(root)
                    ^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 491, in scrape_events
    event['summary']=fetchSummary(url)
                     ^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 742, in fetchSummary
    tmp=fetch_raw(url)
        ^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error:  for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1046121
2025-01-20T00:39:03.848407dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:04.150526dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:04.648446dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:05.558701dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:05.864766dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:06.394364dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:06.964808dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:06.966111dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:07.197455dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:07.938595dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:08.024700dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:08.768568dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:09.036192dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:09.821210dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:09.824722dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:10.249205dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:10.879200dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:12.501315dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:12.708255dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:12.709174dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:13.023554dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:14.555199dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:15.007833dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:15.142557dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:15.196286dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:15.591200dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:16.217681dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:16.996247dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:17.095456dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:17.635712dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:17.636478dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)"
2025-01-20T00:39:18.079322dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:18.151711dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:18.153222dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:39:18.484339dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:18.485369dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)"
2025-01-20T00:39:19.108344dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:19.512417dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:19.651031dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:20.521333dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:20.574507dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:20.892766dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:20.894343dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:20.910054dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:21.217812dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:22.101867dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:22.635868dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:22.636695dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)"
2025-01-20T00:39:23.252601dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:23.383335dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:23.384899dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:23.687415dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:23.849454dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:24.177538dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:24.647575dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:24.648237dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)"
2025-01-20T00:39:24.932670dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:25.784280dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:25.995195dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:26.001406dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:26.168444dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:26.524611dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:39:26.525379dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)"
2025-01-20T00:39:26.525947dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:39:26.669417dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:27.485599dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:28.007909dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:28.600015dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:28.928107dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:29.360645dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:29.512053dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:29.606079dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:30.349736dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:30.671256dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:31.055937dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:31.840369dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:32.037159dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:32.040028dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:32.042931dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:39:32.412762dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2848(RSP)&l=en
2025-01-20T00:39:33.451570dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:33.567438dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:34.514164dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:35.030417mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2017/0035(COD)&l=en'} (ValueError())
2025-01-20T00:39:35.031350mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:39:35.283186dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:36.820356dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:37.372687dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:37.544135dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:37.771787dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:37.899808dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:37.930242dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:37.960087dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:37.972807dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:39.724564dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:40.089127dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:40.424309dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:40.426321dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:40.483204dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:40.601421dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:40.603383dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:41.122427dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:41.369966dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2669(RSP)&l=en
2025-01-20T00:39:42.552809dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:42.714777dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:42.973979dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:42.976427dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:43.424288dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:43.515139dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:43.740673dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:44.393191dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:45.487562dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:45.723501dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:45.898086dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:46.250508dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:46.544400dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:47.429531dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:48.787957dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:49.365690dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:49.440953dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:49.738730dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:49.744643dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2014/2230(INI)&l=en
2025-01-20T00:39:50.274431mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=1995/0057(NLE)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=60823'))
2025-01-20T00:39:50.275864mgrerrorTraceback (most recent call last):
File "scrapers/dossier.py", line 740, in fetchSummary
    tmp=fetch(url)
        ^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 264, in fetch
    xml = fetch_raw(url, retries, ignore, params)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error:  for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=60823

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 82, in scrape
    events, edocs = scrape_events(root)
                    ^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 491, in scrape_events
    event['summary']=fetchSummary(url)
                     ^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 742, in fetchSummary
    tmp=fetch_raw(url)
        ^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error:  for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=60823
2025-01-20T00:39:50.634668dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:51.658023dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:52.003804dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:52.004533dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:39:52.124317dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:52.309793dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:52.435362dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:52.555591dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:53.321280dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:53.385422dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:54.207517dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:54.470085dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:55.092598dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:55.216742dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:55.699846dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:56.101027dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:56.628931dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:39:57.226070dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:58.115516dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:58.361164dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:58.802156dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:58.802898dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:39:59.706792dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:39:59.713468dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:00.153429dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:00.154304dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:40:00.924873dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:01.026654mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2015/0188(NLE)&l=en'} (ValueError())
2025-01-20T00:40:01.028510mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:40:01.137902dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:01.210393mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0072(COD)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1331574'))
2025-01-20T00:40:01.211801mgrerrorTraceback (most recent call last):
File "scrapers/dossier.py", line 740, in fetchSummary
    tmp=fetch(url)
        ^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 264, in fetch
    xml = fetch_raw(url, retries, ignore, params)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error:  for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1331574

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 82, in scrape
    events, edocs = scrape_events(root)
                    ^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 491, in scrape_events
    event['summary']=fetchSummary(url)
                     ^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 742, in fetchSummary
    tmp=fetch_raw(url)
        ^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error:  for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1331574
2025-01-20T00:40:02.216251dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:02.218392dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:02.874492dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:03.465988dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:03.472981dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:03.578440dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:03.799456dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:03.801941dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:04.272808dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:04.656737dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:04.909080dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:05.548485dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:12.142149dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:12.144212dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:12.147143dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:12.152015dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:12.154204dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:12.156155dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:40:12.162082dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:12.166567dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)"
2025-01-20T00:40:14.268236dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:14.630944dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:14.631852dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:14.941270dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:15.270061dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:15.539885dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:15.540873dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:40:15.549320dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:15.550267dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:40:17.223619dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:17.232398dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:17.556716dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:17.750101dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:18.202862dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:19.206531dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:19.915111dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:20.026071dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:20.521737dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:20.528254dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:20.981453dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:21.480528dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:22.104053dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:22.321623dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:22.786039dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:23.114187dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:23.289586dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:23.515646dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:24.167521dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:24.682187dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:25.890987dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:26.084613dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:26.093249dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:26.286675dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:28.825035dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:28.826622dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:28.838332dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:29.656609dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:30.980109dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:31.333287dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:31.334306dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:31.337231dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:32.022110dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:32.784582dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:33.643739dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:33.844004dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:33.844836dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:40:33.915540dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:34.034346dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:34.433563dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:35.908346dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:36.868112dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:36.946290mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2016/0811(CNS)&l=en'} (ValueError())
2025-01-20T00:40:36.947683mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:40:37.980006mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2016/0810(CNS)&l=en'} (ValueError())
2025-01-20T00:40:37.981887mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:40:38.597143dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:38.598069dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)"
2025-01-20T00:40:38.957342mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2016/0205(NLE)&l=en'} (ValueError())
2025-01-20T00:40:38.958202mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:40:39.361134dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:39.362026dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:41.025701dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:41.317113dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:41.708131dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:42.300556dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:42.823829dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:43.054819dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:43.786637dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:43.915819dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:44.370922dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:44.371838dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:44.733263dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:40:44.747988dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2222(INI)&l=en
2025-01-20T00:40:45.012382dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2024(INL)&l=en
2025-01-20T00:40:45.395266dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0282(COD)&l=en
2025-01-20T00:40:45.819149dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:45.820038dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:40:46.369186dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:46.457131dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:47.104095dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:47.104833dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:40:47.416993dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:48.167532dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:48.373295dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:48.382650dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:48.383811dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:40:48.839847dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:48.924220dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:49.739539dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:50.016311dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2016/0062(NLE)&l=en
2025-01-20T00:40:50.570621dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:50.748540dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:50.762251dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:51.110027dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:51.225774dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:51.312061dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:52.665011dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:52.665730dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:40:52.783341dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:53.371196dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:55.380085dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:56.051614dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:57.283567dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:57.453416dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:57.717330dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:58.378902dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:58.558236dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:40:59.394889dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:59.463511dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:59.464295dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:40:59.567363dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:59.877741dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:59.976007dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:40:59.979189dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:01.280131dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:41:01.280977dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:41:01.711688dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:01.717858dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:41:01.940125dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:01.993592dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:02.136876dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:41:02.535263dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:02.537173dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:03.777204dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:03.977058dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:04.113877dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:04.418285dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:41:04.819031dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:41:04.819750dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:05.001574dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:05.002501dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:41:06.098587dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:06.374833dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:06.968550dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:41:07.018582dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:08.355311dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:08.826872dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:08.827588dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)"
2025-01-20T00:41:09.310402dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:41:09.430362dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:10.506189dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:11.814689dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:13.574005dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:41:13.574575dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)"
2025-01-20T00:41:13.576158dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:41:13.588264dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:13.590579dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:41:13.832053dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0152(COD)&l=en
2025-01-20T00:41:14.549340dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2016/0224(COD)&l=en
2025-01-20T00:41:14.800893dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0400(COD)&l=en
2025-01-20T00:41:17.765905dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:41:18.081966dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0225(COD)&l=en
2025-01-20T00:41:19.594027dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:19.594870dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:41:21.371109dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:41:21.558550dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:41:21.851334dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:41:22.102679dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:41:22.497574dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:41:23.424338dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:23.710426dossiererrorunknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed']
2025-01-20T00:41:23.710760mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0329(COD)&l=en'} (ValueError('bad html in EP key players, committee header'))
2025-01-20T00:41:23.711474mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 194, in scrape_ep_key_players
    raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header
2025-01-20T00:41:29.389150dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:29.529398dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:29.977885dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:30.950705dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:31.186201dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:31.562363dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:31.942341dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:32.391382dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:32.398523dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:32.610673dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:32.715974dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/2688(RSO)&l=en
2025-01-20T00:41:33.273877dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:33.443277dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:33.655860dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:34.553577dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:35.241176dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:41:35.936987dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:35.938276dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:41:37.337535dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:41:37.487026dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:41:38.536357dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:41:38.539887dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:41:38.971043dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:39.908592dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:41:39.909413dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)"
2025-01-20T00:41:40.139478dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:41:40.242042dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:40.597598dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:41.231354dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:41.433692dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:41.609169dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:41.809961dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:42.526790dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:41:42.807134dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:41:43.211014dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:43.215841dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:44.478840dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:44.780487dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:45.083019dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:45.142595dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:45.144017dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)"
2025-01-20T00:41:45.369201dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:45.897284dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:45.899595dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:46.209211dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:47.031570dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:47.513714dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:47.592412dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:47.766026dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:47.877603dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:48.297959dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:48.820242dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:48.927468dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:55.217872dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:55.221066dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:55.223383dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:55.225852dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:55.227956dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:55.230241dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:41:55.231389dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:55.233659dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:55.237856dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)"
2025-01-20T00:41:57.305188dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:41:57.613107dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:41:57.614000dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:57.867596dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:41:57.972064dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:41:59.678247dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:00.598953dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:00.600434dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:00.601628dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:00.618285dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:00.891507dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/0001(COD)&l=en
2025-01-20T00:42:01.894056dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:01.894938dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:02.052618dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:02.380426dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:02.975476dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:03.289086dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:04.276306dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:04.451933dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:42:04.778884mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/0005(NLE)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1581015'))
2025-01-20T00:42:04.781219mgrerrorTraceback (most recent call last):
File "scrapers/dossier.py", line 740, in fetchSummary
    tmp=fetch(url)
        ^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 264, in fetch
    xml = fetch_raw(url, retries, ignore, params)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error:  for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1581015

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 82, in scrape
    events, edocs = scrape_events(root)
                    ^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 491, in scrape_events
    event['summary']=fetchSummary(url)
                     ^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 742, in fetchSummary
    tmp=fetch_raw(url)
        ^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error:  for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1581015
2025-01-20T00:42:04.785013dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:05.033352dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:05.446771dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:05.910484dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:06.397235dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:06.831612dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:06.940506dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:07.109692dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:07.110394dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)"
2025-01-20T00:42:07.459355dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:07.460505dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)"
2025-01-20T00:42:07.796738dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:07.797351dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:42:08.373433dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:08.553180dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:08.928524dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:08.929192dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:42:09.156138dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:09.765109dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:42:09.765709dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)"
2025-01-20T00:42:09.766404dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:42:09.817492dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:09.892698dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:09.909537dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:09.910656dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:42:11.042354dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:11.487619dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:11.818350dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:11.822197dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:12.128177dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:12.129940dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:12.225247dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:12.516128dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:13.345174dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:14.285624dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:14.286214dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)"
2025-01-20T00:42:14.487193dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:14.611114dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:14.612967dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:14.688871dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:14.869472dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:15.099156dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:16.030022dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:16.634012dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:16.790936dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:16.848397dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:17.113212dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:17.175395dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:17.481808dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:17.482378dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:42:18.903851dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:19.376510dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:19.459263dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:20.416900dossiererrorunknown committee header in EP key players ['Former committee for opinion on the legal basis', 'Former rapporteur for opinion', 'Appointed']
2025-01-20T00:42:20.417276mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2016/0400B(COD)&l=en'} (ValueError('bad html in EP key players, committee header'))
2025-01-20T00:42:20.418078mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 194, in scrape_ep_key_players
    raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header
2025-01-20T00:42:21.456807dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:21.655924dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:42:21.656899dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:21.882092dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:21.883242dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:42:22.811034dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:23.663105dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:23.799708dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:23.994891dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:24.085166dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:24.433618dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:24.921424dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:25.170908dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:25.171861dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:42:26.094489dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:26.178016dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:26.376299dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:26.379822dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:26.389313dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:26.790885dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:27.811258dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:27.812529dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)"
2025-01-20T00:42:28.187512dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:28.479922dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:28.481942dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:28.494708dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:28.600007dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:28.650401dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:29.061583dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:30.434867dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:30.627340dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:30.823640dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:42:30.831422dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:30.832696dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:30.906570dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:31.058682dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:31.059408dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:42:31.514872dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:32.746180dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:32.900662dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:33.061508dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:33.062682dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:42:33.143218dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:33.362573dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:33.518042dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:33.577530dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:33.700828dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2110(INI)&l=en
2025-01-20T00:42:34.118398dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:42:34.552745dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:34.990945dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:35.138838dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:35.480856dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:35.868284dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:35.970736dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:36.150555dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:42:36.323542dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/2852(RSP)&l=en
2025-01-20T00:42:36.573841dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:36.839591dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:37.314802dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:37.406276dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:37.760132dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2133(INI)&l=en
2025-01-20T00:42:38.568425dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:38.620715dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:38.926554dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2858(RSP)&l=en
2025-01-20T00:42:38.931507dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:39.014397dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:39.111912dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:39.112997dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:42:39.855926dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:39.856722dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:42:40.838485dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:41.174490dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:41.301265dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:42:41.439470dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:42.159449dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:42.161007dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:42:42.163110dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:42.292480dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:42.590648dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:43.272839dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:43.573245dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2203(INI)&l=en
2025-01-20T00:42:43.771186dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:43.905071dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:43.973078dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2212(INI)&l=en
2025-01-20T00:42:44.067343dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2211(INI)&l=en
2025-01-20T00:42:44.073148dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:44.737360dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:44.907132dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:44.994964dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:44.995597dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:42:44.996221dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)"
2025-01-20T00:42:45.275356dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:46.214816dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:46.293544dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:46.355916dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:46.592883dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:46.865789dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:47.306854dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:47.815183dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:47.815877dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:42:47.935242dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:47.936123dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:42:48.324907dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:48.574125dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:48.576417dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:49.743078dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:49.747548dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:50.054495dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:50.065364dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2185(INI)&l=en
2025-01-20T00:42:50.163677dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:50.295473dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2165(INI)&l=en
2025-01-20T00:42:50.430327dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:50.490370dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2163(INI)&l=en
2025-01-20T00:42:51.189073dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:51.420349dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:51.511407dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:52.682665dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:52.986220dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:52.987312dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:52.995186dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:42:53.539390dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:53.789764dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2519(RSP)&l=en
2025-01-20T00:42:53.972171dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:55.176399dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:56.091704dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:56.274017dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2522(RSP)&l=en
2025-01-20T00:42:56.368729dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:56.746974dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:57.093091dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2501(RSP)&l=en
2025-01-20T00:42:57.216996dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:57.358006dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2570(RSP)&l=en
2025-01-20T00:42:58.173667dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:58.474279dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2568(RSP)&l=en
2025-01-20T00:42:58.527553dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:58.610300dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:58.726520dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2573(RSP)&l=en
2025-01-20T00:42:58.786700dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2572(RSP)&l=en
2025-01-20T00:42:58.938180dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2569(RSP)&l=en
2025-01-20T00:42:59.037393dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2540(RSP)&l=en
2025-01-20T00:42:59.049709dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2556(RSP)&l=en
2025-01-20T00:42:59.120146dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:59.201477dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:59.294432dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2574(RSP)&l=en
2025-01-20T00:42:59.347811dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:42:59.432009dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2571(RSP)&l=en
2025-01-20T00:42:59.711807dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2598(RSP)&l=en
2025-01-20T00:42:59.986908dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:00.006481dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2587(RSP)&l=en
2025-01-20T00:43:00.223816dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2592(RSP)&l=en
2025-01-20T00:43:00.227693dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2595(RSP)&l=en
2025-01-20T00:43:00.492998dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2601(RSP)&l=en
2025-01-20T00:43:00.521033dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2593(RSP)&l=en
2025-01-20T00:43:00.846979dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2600(RSP)&l=en
2025-01-20T00:43:00.884139dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2599(RSP)&l=en
2025-01-20T00:43:01.117861dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2602(RSP)&l=en
2025-01-20T00:43:01.379082dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:01.613520dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2597(RSP)&l=en
2025-01-20T00:43:01.683607dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:01.732434dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2591(RSP)&l=en
2025-01-20T00:43:01.842161dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:03.494491dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:04.478760dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:04.481322dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:43:04.482848dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:04.486337dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:05.658918dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:05.753097dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:06.891240dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:07.068157dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:07.070205dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:07.071493dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:07.146564dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:07.432491dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:08.044939dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:08.045691dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:43:08.166569dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:43:09.234603dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:09.235785dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:09.237335dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:43:09.397408dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:09.404231dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:11.153874dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:11.311026dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:11.485278dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:11.486132dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:11.493573dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:13.255173dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:43:13.353393dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:13.496616dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2072(INL)&l=en
2025-01-20T00:43:13.696954dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:43:13.795728dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:43:14.804576dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:15.080080dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2710(RSP)&l=en
2025-01-20T00:43:15.240320dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2703(RSP)&l=en
2025-01-20T00:43:15.276678dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:15.604304dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:16.075225dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:16.075924dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:43:16.239653dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:16.936384dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:17.403112dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:17.544989dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:17.631487dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:17.933322dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:18.055263dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:43:18.772395dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:19.947043dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:19.948298dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:19.950283dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:43:20.219706dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:43:20.393619dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:43:21.552853dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:22.417182dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:43:22.419995dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:22.860590dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:22.862922dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:43:22.874707dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:43:23.665893dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:24.581137dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:24.697973dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:24.698609dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:43:24.835290dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:25.309357dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:25.439229dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:25.441408dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:25.499399dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:26.820189dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:27.634486dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:27.744765dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:28.001954dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:28.020730dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2200(IMM)&l=en
2025-01-20T00:43:28.249132dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2799(RSP)&l=en
2025-01-20T00:43:28.482803dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2798(RSP)&l=en
2025-01-20T00:43:29.107462dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:29.108914dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:43:29.972377dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:30.535266dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:30.810835dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:31.524134dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:32.307931dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:32.308632dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:43:33.000654dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:33.001543dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:33.392168dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:33.502168dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:34.130530dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:34.784621dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:34.786712dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:35.030312dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:35.240337dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:35.604686dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:35.605654dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:35.748108dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:43:36.705134dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:43:36.943280dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:37.206877dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:37.347961dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:37.447709dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:37.767959dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2897(RSP)&l=en
2025-01-20T00:43:37.937526dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:38.105314dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:38.544159dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:38.544817dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:43:39.040636dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:43:39.460485dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:39.461695dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:39.548197dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:43:40.421455dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:40.486469dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:40.579912dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:40.834895dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:40.835490dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:43:41.325328dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:41.838678dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:41.979449dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:43:41.981087dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:42.642140dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:42.799480dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:43.062907dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:43.424247dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:43.907118dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:44.142391dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:43:44.499476dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:44.607079dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:44.919564dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:43:45.451294dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:45.880029dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:46.014147dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:46.163501dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:43:46.341535dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:46.609343dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:47.246964dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:47.252383dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:47.910278dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:54.228173dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:54.231248dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:54.235339dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:43:54.239231dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:43:54.242883dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:43:54.245877dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:56.556733dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:56.566148dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:56.568846dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:43:56.572392dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:56.680453dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:56.681393dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:43:57.844544dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:58.808852dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:58.989947dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:59.074818dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:59.131869dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:59.319346dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:43:59.322047dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:00.685635dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:00.924448dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:01.191337dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:01.605694dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:01.838974dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:02.528976dossiererrorunknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed']
2025-01-20T00:44:02.529375mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/0060(COD)&l=en'} (ValueError('bad html in EP key players, committee header'))
2025-01-20T00:44:02.530181mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 194, in scrape_ep_key_players
    raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header
2025-01-20T00:44:02.615452dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:02.982829dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:03.841006dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:03.842685dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:44:04.717507dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:04.931897dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:05.268515dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:05.331420dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:06.131516dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:06.420807dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:06.969303dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:07.080689dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:07.236263dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:07.477620dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:07.479394dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:07.729175dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:08.398549dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:08.470706dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:09.150226dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:09.453576dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:09.646107dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:09.648132dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:10.047247dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:10.397848dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:10.775087dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:10.843143dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:11.450989dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:11.730198dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:11.783449dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:11.969943dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:12.581847dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:12.770151dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:13.074619dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:13.140503dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:13.335114dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2061(INI)&l=en
2025-01-20T00:44:13.463152dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2047(INI)&l=en
2025-01-20T00:44:13.866129dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:13.969381dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:14.260708dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:14.799564dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:15.511221dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:15.592443dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:15.594229dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:44:15.915921dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:15.923980dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:16.324859dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:16.325765dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:16.916867dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:17.258178dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2730(RSP)&l=en
2025-01-20T00:44:17.422251dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:17.714281dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:18.144572dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:18.325017dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:19.445937dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:19.502122dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:19.595983dossierwarningno body mapping found for "Initial period for examining delegated act 4.0 month(s)"
2025-01-20T00:44:19.596758dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)"
2025-01-20T00:44:19.727868dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:19.787715dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:20.443722dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:20.740085dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:20.740829dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:44:21.346045dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:21.669597dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:21.957344dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:21.965231dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:22.383040dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:22.618009dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:23.112882dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:23.504796dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:23.767103dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:24.220150dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:24.336597dossierwarningno body mapping found for "Initial period for examining delegated act 4.0 month(s)"
2025-01-20T00:44:24.799206dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:24.805949dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:25.554931dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:26.883940dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:27.619748mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2157(DEC)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1668966'))
2025-01-20T00:44:27.622442mgrerrorTraceback (most recent call last):
File "scrapers/dossier.py", line 740, in fetchSummary
    tmp=fetch(url)
        ^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 264, in fetch
    xml = fetch_raw(url, retries, ignore, params)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error:  for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1668966

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 82, in scrape
    events, edocs = scrape_events(root)
                    ^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 491, in scrape_events
    event['summary']=fetchSummary(url)
                     ^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 742, in fetchSummary
    tmp=fetch_raw(url)
        ^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error:  for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1668966
2025-01-20T00:44:27.979790dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:28.964151dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:29.271904dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:29.278406dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:30.045994dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:30.386692dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/0211(COD)&l=en
2025-01-20T00:44:30.482215dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:30.554553dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:30.753213dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:31.247326dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:31.407674dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:31.415421dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:32.089580dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:32.874447dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:33.386649dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:33.490951dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:33.814785dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:34.124003dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:34.668866dossiererrorunknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed']
2025-01-20T00:44:34.669270mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/0213(CNS)&l=en'} (ValueError('bad html in EP key players, committee header'))
2025-01-20T00:44:34.670026mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 194, in scrape_ep_key_players
    raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header
2025-01-20T00:44:34.908708dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:35.012966dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:35.561957dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:35.626976dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:36.004977dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:36.162880dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:37.028821dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:37.233142dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:37.342993dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:37.497527dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:37.833226dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:38.131853dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:38.132596dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:44:38.369645dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:38.711225dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:39.456872dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:39.672532dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:39.675905dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:39.755883dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:40.022696dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:40.291296dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:40.292132dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)"
2025-01-20T00:44:41.691878dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:41.848406dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:42.033602dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:42.222428dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2175(IMM)&l=en
2025-01-20T00:44:42.423242dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:42.651642dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:42.654985dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:44.005988dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:44.441897dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:44.759215dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:44.815713dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:45.418545dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:46.408136dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:44:46.409182dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:44:46.917777dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:44:46.918720dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:44:46.978131dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:47.249859dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:47.664164dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:47.666258dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:44:48.407359dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:48.408122dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:44:48.652356dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:48.748264dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:49.393198dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:49.483955dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:50.359570dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:50.628972dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:50.697014dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:50.796049dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:51.279801dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:52.163846dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:52.390695dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:52.849711dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:53.385726dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:53.451463dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:53.876766dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:53.877424dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:44:54.004138dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:55.290555dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:55.716314dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:44:56.035131dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:56.038088dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:56.677119dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:56.863120dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:57.449216dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:57.450036dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:44:57.704824dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:58.438961dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:58.483128dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2939(RSP)&l=en
2025-01-20T00:44:58.807674dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:58.842545dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2998(RSP)&l=en
2025-01-20T00:44:59.047315dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:44:59.865264dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:00.126870dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:00.127584dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:45:00.177803dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2198(INI)&l=en
2025-01-20T00:45:00.231635dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:00.521072dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2213(INI)&l=en
2025-01-20T00:45:00.527727dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:01.268101dossiererrorunknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed']
2025-01-20T00:45:01.268489mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/0387(COD)&l=en'} (ValueError('bad html in EP key players, committee header'))
2025-01-20T00:45:01.269306mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 194, in scrape_ep_key_players
    raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header
2025-01-20T00:45:02.682749dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:02.813117dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:03.351471dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:03.620461dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/3011(RSP)&l=en
2025-01-20T00:45:03.636331dossiererrorunknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed']
2025-01-20T00:45:03.636662mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/0375(COD)&l=en'} (ValueError('bad html in EP key players, committee header'))
2025-01-20T00:45:03.637443mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 194, in scrape_ep_key_players
    raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header
2025-01-20T00:45:03.754919dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:05.682158dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:05.753844dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:05.838089dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:06.165779dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:06.349093dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:06.587049dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:07.994959dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:08.040327dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:08.050750dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:08.185974dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:08.186870dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:08.379613dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:09.096231dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:09.228593dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:10.076421dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:10.422347dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:10.510928dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:10.672067dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:10.837584dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2020/2259(INI)&l=en
2025-01-20T00:45:10.959690dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:11.409248dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:11.413618dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:12.120689dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:12.906260dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:13.295323dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:13.496537dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:13.729947dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:13.865553dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:14.425438dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:14.987234dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:15.161370dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:15.540402dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:16.123543dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:16.236904dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:16.237807dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:45:16.291778dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:16.393197dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:17.438120dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:17.852615dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2238(INI)&l=en
2025-01-20T00:45:17.858318dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:18.158423dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:18.301614dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:18.377072dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:18.519782dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:45:18.748206dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:19.336544dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:19.819958dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:20.483317dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:20.681798dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:21.274369dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2506(RSP)&l=en
2025-01-20T00:45:22.553873dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:45:22.868911dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:23.292923dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:24.170562dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:24.172347dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:24.353632dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:24.932269dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:25.517766dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:25.730638dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:26.414720dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:26.874297dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:27.201175dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2554(RSP)&l=en
2025-01-20T00:45:27.251940dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:27.604837dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:27.697277dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:27.698129dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:45:27.770404dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:28.638192dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:28.861559dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:29.374381dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:29.732034dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:29.808695dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:30.088897dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:30.192428dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:31.300706dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:31.497097dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:32.095935dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:32.326869dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:32.394071dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:32.644277dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:32.645625dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:32.996592dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:33.815414dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:34.504302dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:34.724696dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:34.846364dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:34.943341dossierwarningno body mapping found for "Initial period for examining delegated act 4.0 month(s)"
2025-01-20T00:45:35.023989dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:36.565422dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:44.622818dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:44.628713dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:44.630120dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:44.631120dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:44.632807dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:44.636265dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:44.639052dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:44.641969dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:45:44.872802dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:46.785470dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:47.140020dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:47.142305dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:47.145958dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:47.149468dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:47.225490dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:48.948304dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:48.953920dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:49.191272dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:49.498804dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:49.504481dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:49.511164dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:49.513827dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:51.200257dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:51.825820dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:51.826708dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:51.902707dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:51.903480dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:45:51.974985dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:52.136991dossiererrorunknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed']
2025-01-20T00:45:52.137466mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/0125(COD)&l=en'} (ValueError('bad html in EP key players, committee header'))
2025-01-20T00:45:52.138527mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 194, in scrape_ep_key_players
    raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header
2025-01-20T00:45:52.143071dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:53.276516dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:54.017960dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:54.144973dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:54.424941dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:54.427005dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:54.519383dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:55.465006dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:56.307737dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:56.315937dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:56.465971dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:56.538602dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:45:57.666749dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:58.771980dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:58.774310dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:45:58.777151dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:58.780861dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:58.842391dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:59.111014dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:45:59.111686dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:45:59.755152dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:00.057095dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:00.837683dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:01.227034dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:01.405572dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:01.408826dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:01.415673dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:01.761911dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:02.490559dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:02.705874dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:02.970286dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:03.553573dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:03.658343dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:03.767510dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:04.027456dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:04.118798dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:04.816171dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:05.323514dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:05.705545dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:06.106393dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:06.218813dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:06.273182dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:06.338684dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:06.339509dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:46:07.527141dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:07.599544dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:08.228695dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:08.229998dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:08.518320dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:08.732988dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:09.433693dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:10.603808dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:10.606923dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:10.608213dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:10.616561dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:10.716346dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:11.302728dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:11.430961dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:13.046202dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:13.047017dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:13.166217dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:13.346355dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:13.658331dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:13.820802dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:13.892133dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:15.659895dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:15.661946dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:15.865718dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:15.866586dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:46:16.020461dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:16.080097dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:16.192074dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:16.472269dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2863(RSP)&l=en
2025-01-20T00:46:18.454798dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:18.457204dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:18.458412dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:18.464938dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:18.570958dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:18.823613dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:20.500563dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:20.626659dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:20.628212dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:21.232679dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:21.454884dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:21.455592dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)"
2025-01-20T00:46:21.503443dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:22.607811dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:22.804533dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:22.805240dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:46:23.374671dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:23.924042dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:23.924886dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:25.394979dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:25.505883dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:25.622262dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:25.629329dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:26.001973dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:26.116929dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:27.757949dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:27.905152dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:28.221209dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:28.223073dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:28.826626dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:29.597566dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:30.129128dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:30.452134dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:30.766600dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:30.912623dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:31.733274dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:32.366101dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:32.569215dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:33.625747dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:33.629511dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:33.635371dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:33.865550dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:34.597876dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:34.681470dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:34.930110dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:35.283347dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:36.714361dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:36.947449dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:37.014564dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:37.072005dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:37.120103dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:37.853844dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:46:38.165608dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:46:38.630988dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/3010(RSP)&l=en
2025-01-20T00:46:38.862581dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2209(IMM)&l=en
2025-01-20T00:46:39.000437dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:41.146219dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:41.148221dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:41.194475mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/0391(COD)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764360'))
2025-01-20T00:46:41.196192mgrerrorTraceback (most recent call last):
File "scrapers/dossier.py", line 740, in fetchSummary
    tmp=fetch(url)
        ^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 264, in fetch
    xml = fetch_raw(url, retries, ignore, params)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error:  for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764360

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 82, in scrape
    events, edocs = scrape_events(root)
                    ^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 491, in scrape_events
    event['summary']=fetchSummary(url)
                     ^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 742, in fetchSummary
    tmp=fetch_raw(url)
        ^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error:  for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764360
2025-01-20T00:46:43.452546dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:43.762227dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:46:43.764997dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)"
2025-01-20T00:46:43.774690dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:44.044421dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:44.067732dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2203(INI)&l=en
2025-01-20T00:46:44.242956mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/0394(COD)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764287'))
2025-01-20T00:46:44.265114mgrerrorTraceback (most recent call last):
File "scrapers/dossier.py", line 740, in fetchSummary
    tmp=fetch(url)
        ^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 264, in fetch
    xml = fetch_raw(url, retries, ignore, params)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error:  for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764287

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 82, in scrape
    events, edocs = scrape_events(root)
                    ^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 491, in scrape_events
    event['summary']=fetchSummary(url)
                     ^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 742, in fetchSummary
    tmp=fetch_raw(url)
        ^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error:  for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764287
2025-01-20T00:46:44.290039dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2008(IMM)&l=en
2025-01-20T00:46:44.664869dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:45.625210mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/0396(COD)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764419'))
2025-01-20T00:46:45.626836dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:45.627492mgrerrorTraceback (most recent call last):
File "scrapers/dossier.py", line 740, in fetchSummary
    tmp=fetch(url)
        ^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 264, in fetch
    xml = fetch_raw(url, retries, ignore, params)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error:  for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764419

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 82, in scrape
    events, edocs = scrape_events(root)
                    ^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 491, in scrape_events
    event['summary']=fetchSummary(url)
                     ^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 742, in fetchSummary
    tmp=fetch_raw(url)
        ^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error:  for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764419
2025-01-20T00:46:46.387264dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:46.457543dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:46.512446dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:46.643341dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:47.200276dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:47.807721dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:48.158859dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:48.450022dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:48.598343dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:48.599031dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:46:48.859656dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:49.546231dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:49.858671dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:49.865019dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:50.208942dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2567(RSP)&l=en
2025-01-20T00:46:50.565181dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:50.684272dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:51.240210dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:52.688575dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:52.689301dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:46:53.004181dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:53.008184dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:53.011542dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:53.339918dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:53.341449dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:46:53.549289dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:53.714982dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:53.777984dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2597(RSP)&l=en
2025-01-20T00:46:54.057253dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2592(RSP)&l=en
2025-01-20T00:46:54.516057dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2614(RSP)&l=en
2025-01-20T00:46:54.853060dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0077(COD)&l=en
2025-01-20T00:46:55.168997dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:56.164691dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:56.275235dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:56.506232dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:46:57.364906dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:57.677473dossiererrorunknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed']
2025-01-20T00:46:57.677834mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0059(NLE)&l=en'} (ValueError('bad html in EP key players, committee header'))
2025-01-20T00:46:57.678599mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 194, in scrape_ep_key_players
    raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header
2025-01-20T00:46:58.675520dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:58.957634dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2039(IMM)&l=en
2025-01-20T00:46:59.156336mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0053(COD)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1771293'))
2025-01-20T00:46:59.157574mgrerrorTraceback (most recent call last):
File "scrapers/dossier.py", line 740, in fetchSummary
    tmp=fetch(url)
        ^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 264, in fetch
    xml = fetch_raw(url, retries, ignore, params)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error:  for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1771293

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 82, in scrape
    events, edocs = scrape_events(root)
                    ^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 491, in scrape_events
    event['summary']=fetchSummary(url)
                     ^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 742, in fetchSummary
    tmp=fetch_raw(url)
        ^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
    r.raise_for_status()
  File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error:  for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1771293
2025-01-20T00:46:59.246782dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:59.262980dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2649(RSP)&l=en
2025-01-20T00:46:59.632616dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:46:59.978807dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:00.235547dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:01.191459dossiererrorunknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed']
2025-01-20T00:47:01.191856mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0085(COD)&l=en'} (ValueError('bad html in EP key players, committee header'))
2025-01-20T00:47:01.192659mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 194, in scrape_ep_key_players
    raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header
2025-01-20T00:47:01.298994dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:47:01.548373dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:47:02.476797dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:47:03.092358dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:04.023632dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:05.791242dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:06.791387dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:06.792176dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:47:07.237192dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:47:09.182399dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:47:12.201348dossiererrorunknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed']
2025-01-20T00:47:12.201667mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0130(COD)&l=en'} (ValueError('bad html in EP key players, committee header'))
2025-01-20T00:47:12.202491mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 194, in scrape_ep_key_players
    raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header
2025-01-20T00:47:12.372323dossiererrorunknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed']
2025-01-20T00:47:12.372673mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0128(COD)&l=en'} (ValueError('bad html in EP key players, committee header'))
2025-01-20T00:47:12.373408mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 194, in scrape_ep_key_players
    raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header
2025-01-20T00:47:13.224890dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:14.391622dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:15.280822dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:15.522870dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:22.496843dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:22.499769dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:47:22.502351dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:47:22.506853dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:22.784401dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:47:24.389123dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:47:24.526412dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:25.152433dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:25.778626dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:26.283638dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:26.977773dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:27.543901dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:28.242205dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:29.241389dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:29.249302dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:30.181266dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:31.275987dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:31.544146dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:31.650455dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:32.312353dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:32.376569dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:34.129928dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:35.398162dossierwarningno body mapping found for "Initial period for examining delegated act 4.0 month(s)"
2025-01-20T00:47:36.254078dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:36.490884dossierwarningno body mapping found for "Initial period for examining delegated act 4.0 month(s)"
2025-01-20T00:47:37.243320dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:37.673458dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:42.662955mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0259(NLE)&l=en'} (ValueError())
2025-01-20T00:47:42.664136mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:47:42.770329dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:42.980237dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:47:43.310702dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2104(INL)&l=en
2025-01-20T00:47:43.587070dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2125(INI)&l=en
2025-01-20T00:47:43.592068dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:47:44.400815dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:45.185781dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:45.186629dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:47:45.481945dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:45.738439dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:46.849229dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:46.859421dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:47:48.652220dossierwarningno body mapping found for "Matter referred back to the committee responsible for reconsideration"
2025-01-20T00:47:48.821541dossiererrorunknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed']
2025-01-20T00:47:48.821938mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/0134(COD)&l=en'} (ValueError('bad html in EP key players, committee header'))
2025-01-20T00:47:48.822843mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 194, in scrape_ep_key_players
    raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header
2025-01-20T00:47:49.271707dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2710(RSP)&l=en
2025-01-20T00:47:51.299222dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:47:52.304848dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:52.449213dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:52.552723dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:47:54.447692dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:56.424797dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:58.000560dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:58.486508dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:47:58.746729dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:59.462443dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:59.463727dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:47:59.698597dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:00.008977dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:00.282445dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:00.736526dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:01.079218dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:01.349247dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:48:01.544165dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:01.708500dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:02.268914dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:02.704232dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:02.982141dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:03.558676dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:03.944737dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:03.947923dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:04.141275dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:04.643541dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:04.736096dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:05.044293dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2191(IMM)&l=en
2025-01-20T00:48:05.161928dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:06.330637dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:06.400708dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:07.087441dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:07.338227dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:08.505592dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:08.615579dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:10.343845dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:10.883535dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:10.886710dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:11.151884dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:11.218925dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:11.448956dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2200(IMM)&l=en
2025-01-20T00:48:11.484931dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2199(IMM)&l=en
2025-01-20T00:48:12.581689dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:13.118402dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:13.468178dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:13.687712dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:13.789579dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:14.818902dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:15.005399dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2927(RSP)&l=en
2025-01-20T00:48:15.147162dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:15.930006dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:15.988126dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:16.148177dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:16.244959dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:16.339677dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:17.397642dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:17.630884dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:18.566527dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:18.567315dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:18.669875dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:18.793530dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:18.931545dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:19.786432dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:20.141252dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:21.071375dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:21.075927dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:21.079590dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:21.081354dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:22.039243dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:22.306516dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:22.593233dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2989(RSP)&l=en
2025-01-20T00:48:22.855126mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0288(COD)&l=en'} (ValueError())
2025-01-20T00:48:22.856183mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:48:23.275609dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:23.919701dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:23.985209dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:24.200100dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:24.919418dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:24.976934dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:25.324268dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:27.211209dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:27.297531dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:28.044711dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:28.541275mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0375(COD)&l=en'} (ValueError())
2025-01-20T00:48:28.542233mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:48:28.970229dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:29.168663dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:29.522388dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:29.677610dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:30.297909dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:30.932671dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:48:32.137527mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0456(NLE)&l=en'} (ValueError())
2025-01-20T00:48:32.139707mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:48:35.115562dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:35.983618dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:36.155632dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:36.503018dossiererrorunknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed']
2025-01-20T00:48:36.503391mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0448(COD)&l=en'} (ValueError('bad html in EP key players, committee header'))
2025-01-20T00:48:36.504334mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 194, in scrape_ep_key_players
    raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header
2025-01-20T00:48:37.650527dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:37.916400dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:38.604204dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:38.604983dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:38.899025dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:39.824484dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:40.697102dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:40.697741dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:48:41.108135dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:41.227041dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:41.230223dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:41.371322dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:42.552780dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:43.116874dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:43.264687dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:43.469108dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:44.065154dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:44.486612dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:45.516899mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0010(NLE)&l=en'} (ValueError())
2025-01-20T00:48:45.517924mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:48:45.927758dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:52.351245dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:52.353459dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:52.354445dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:52.356694dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:52.390025dossiererrorunknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed']
2025-01-20T00:48:52.390388mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0035(COD)&l=en'} (ValueError('bad html in EP key players, committee header'))
2025-01-20T00:48:52.391324mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 194, in scrape_ep_key_players
    raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header
2025-01-20T00:48:53.637560mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0006(COD)&l=en'} (ValueError())
2025-01-20T00:48:53.638534mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:48:54.654794dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:54.771838dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:55.069360dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:55.448262dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:55.683059dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:55.684108dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:55.792366dossiererrorunknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed']
2025-01-20T00:48:55.792719mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0038(NLE)&l=en'} (ValueError('bad html in EP key players, committee header'))
2025-01-20T00:48:55.793460mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 194, in scrape_ep_key_players
    raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header
2025-01-20T00:48:56.096552dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:56.968046dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:57.154498dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:57.281702dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:58.076371dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:58.473339dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:58.478154dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:58.593760dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:58.597620dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:59.534478dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:48:59.955098dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:48:59.956129dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:00.437164dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:00.923468dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:00.976876dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:01.164266dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:01.775359dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:02.040601dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2593(RSP)&l=en
2025-01-20T00:49:02.542984dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:02.820439dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2622(RSP)&l=en
2025-01-20T00:49:03.393955dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:03.516617dossiererrorunknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending"
2025-01-20T00:49:03.517008mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0059(COD)&l=en'} (ValueError('bad html in key players EP section, linkless committee name'))
2025-01-20T00:49:03.519314mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 230, in scrape_ep_key_players
    raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name
2025-01-20T00:49:03.888208dossiererrorunknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending"
2025-01-20T00:49:03.888711mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0060(COD)&l=en'} (ValueError('bad html in key players EP section, linkless committee name'))
2025-01-20T00:49:03.889718mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 230, in scrape_ep_key_players
    raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name
2025-01-20T00:49:04.658051mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0048(NLE)&l=en'} (ValueError())
2025-01-20T00:49:04.659005mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:49:05.233965dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:05.561698dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:05.660717dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:05.894959dossiererrorunknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed']
2025-01-20T00:49:05.895334mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0061(COD)&l=en'} (ValueError('bad html in EP key players, committee header'))
2025-01-20T00:49:05.896117mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 194, in scrape_ep_key_players
    raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header
2025-01-20T00:49:06.203089dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:06.744687dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:07.151624dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:07.154502dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:07.829337dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:07.990237dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:08.217197dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:08.418439dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:08.504806dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:09.315338dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:09.534998dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:09.752223dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:10.670421dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:11.069323dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:11.071013dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:11.306028dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:11.313542dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:12.093118dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:12.373237dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:12.639271dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:12.941618dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:13.441393dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:13.682533dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:13.685577dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:14.470586dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:14.775532dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:15.137585dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:15.294026dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:15.295219dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:15.764790dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:16.101314dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:16.255728dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2010(IMM)&l=en
2025-01-20T00:49:16.462545dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:17.561366dossierwarningno body mapping found for "Initial period for examining delegated act 1.0 month(s)"
2025-01-20T00:49:17.563637dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)"
2025-01-20T00:49:17.566778dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:17.570412dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:17.725401dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:20.181844dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:20.534981dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2711(DEA)&l=en
2025-01-20T00:49:20.537912dossiererrorunknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending"
2025-01-20T00:49:20.538721mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0101(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name'))
2025-01-20T00:49:20.539666mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 230, in scrape_ep_key_players
    raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name
2025-01-20T00:49:21.615967mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0074(NLE)&l=en'} (ValueError())
2025-01-20T00:49:21.616916mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:49:22.811172dossiererrorunknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending"
2025-01-20T00:49:22.811496mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0155(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name'))
2025-01-20T00:49:22.812316mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 230, in scrape_ep_key_players
    raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name
2025-01-20T00:49:26.487157dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:27.560275dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:27.704573dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:27.809164dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:27.809834dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:49:28.175530dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:29.039582dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:29.321528dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:30.049525dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:30.338046dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:30.338566dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:49:30.387229dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:30.851287dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:31.574280dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:32.083615dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:32.084903dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:32.308782dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:32.878393dossierwarningno body mapping found for "Initial period for examining delegated act 4.0 month(s)"
2025-01-20T00:49:33.134189dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:33.292222dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:33.851183dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:33.852033dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:33.853249dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:49:35.968153mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2021(DEC)&l=en'} (ValueError())
2025-01-20T00:49:35.969229mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 271, in patch
    raise ValueError()
ValueError
2025-01-20T00:49:37.693935mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2026(DEC)&l=en'} (ValueError())
2025-01-20T00:49:37.695018mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 271, in patch
    raise ValueError()
ValueError
2025-01-20T00:49:37.876165mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2022(DEC)&l=en'} (ValueError())
2025-01-20T00:49:37.877250mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 271, in patch
    raise ValueError()
ValueError
2025-01-20T00:49:38.377992dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:38.503232mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2025(DEC)&l=en'} (ValueError())
2025-01-20T00:49:38.504333mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 271, in patch
    raise ValueError()
ValueError
2025-01-20T00:49:38.890264dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:39.046689dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:39.047279dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:49:39.352331dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:40.036785dossiererrorunknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending"
2025-01-20T00:49:40.037167mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0178(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name'))
2025-01-20T00:49:40.037942mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 230, in scrape_ep_key_players
    raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name
2025-01-20T00:49:40.229313dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:40.344251dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:40.572027dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:40.755042dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:41.726397dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:41.999046dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:42.432938dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:42.681829dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:42.991362dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:42.991980dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:49:43.234007dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:43.234762dossierwarningno body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)"
2025-01-20T00:49:43.314281dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:44.306946dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:44.307764dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)"
2025-01-20T00:49:44.544572dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:45.155124dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:45.220730dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:45.372626dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:45.476104dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:45.778634dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:46.222799dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:46.223500dossierwarningno body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)"
2025-01-20T00:49:46.724879dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:47.744486dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:47.748520dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:47.886321dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:47.888003dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:48.939111dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:48.942657dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:49.312239dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:50.221302dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:50.775113dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:51.653833dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:51.659933dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:52.568850dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:52.791379dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:52.906492dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:54.285188dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:55.231060dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:55.384290dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:55.841194dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:55.952287dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:56.692632dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2783(RSP)&l=en
2025-01-20T00:49:57.823576dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:58.072933dossiererrorunknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending"
2025-01-20T00:49:58.073415mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0245(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name'))
2025-01-20T00:49:58.074512mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 230, in scrape_ep_key_players
    raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name
2025-01-20T00:49:58.078673dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:58.531677dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:49:59.331113dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:49:59.911257dossierwarningno body mapping found for "Urgent procedure requested by a committee"
2025-01-20T00:49:59.952636mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0804(NLE)&l=en'} (ValueError())
2025-01-20T00:49:59.953631mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:50:00.561132dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:50:00.971403mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2054(INI)&l=en'} (ValueError())
2025-01-20T00:50:00.973577mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:50:00.974103mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2053(INI)&l=en'} (ValueError())
2025-01-20T00:50:00.977200mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:50:01.422878mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0249(COD)&l=en'} (ValueError())
2025-01-20T00:50:01.423936mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:50:03.276472mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2057(INI)&l=en'} (ValueError())
2025-01-20T00:50:03.277468mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:50:04.471823dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:50:04.475322dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:50:05.016775mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2056(INI)&l=en'} (ValueError())
2025-01-20T00:50:05.017899mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:50:05.344393dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:50:05.901529dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:50:06.661537dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:50:07.899304dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:50:08.054141dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:50:08.597504dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:50:08.734218mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0267(NLE)&l=en'} (IndexError('list index out of range'))
2025-01-20T00:50:08.735337mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 265, in scrape_ep_key_players
    tmp = junws(cells[2])
                ~~~~~^^^
IndexError: list index out of range
2025-01-20T00:50:08.823750dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:50:10.770424dossiererrorunknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending"
2025-01-20T00:50:10.771035mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0263(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name'))
2025-01-20T00:50:10.771936dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:50:10.772599mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 230, in scrape_ep_key_players
    raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name
2025-01-20T00:50:10.887447dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:50:11.271816dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:50:11.430341dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:50:11.752734dossierwarningno body mapping found for "Urgent procedure requested by a committee"
2025-01-20T00:50:11.859572dossierwarningno body mapping found for "Urgent procedure requested by a committee"
2025-01-20T00:50:11.905850dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:50:12.636008mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0274(COD)&l=en'} (ValueError())
2025-01-20T00:50:12.637194mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:50:12.643668mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0275(COD)&l=en'} (ValueError())
2025-01-20T00:50:12.644533mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:50:12.644825mgrerrorexception threshold exeeded for dossier queue, aborting
2025-01-20T00:50:12.645101mgrerrorexceptions:
2025-01-20T00:50:12.645378mgrerrorValueError('bad html in key players EP section, linkless committee name')
2025-01-20T00:50:12.645684mgrerrorValueError()
2025-01-20T00:50:12.645971mgrerrorValueError()
2025-01-20T00:50:12.646236mgrerrorValueError()
2025-01-20T00:50:12.646518mgrerrorValueError()
2025-01-20T00:50:12.646781mgrerrorValueError()
2025-01-20T00:50:12.647039mgrerrorValueError()
2025-01-20T00:50:12.647335mgrerrorIndexError('list index out of range')
2025-01-20T00:50:12.647591mgrerrorValueError('bad html in key players EP section, linkless committee name')
2025-01-20T00:50:12.647865mgrerrorValueError()
2025-01-20T00:50:12.648151mgrerrorValueError()
2025-01-20T00:50:12.648533mgrerror---------------END OF EXCEPTIONS---------------
2025-01-20T00:50:13.264341dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:50:13.265461dossierwarningno body mapping found for "Initial period for examining delegated act 2.0 month(s)"
2025-01-20T00:50:13.266310dossierwarningno body mapping found for "Initial period for examining delegated act 3.0 month(s)"
2025-01-20T00:50:13.540587dossiererrorunknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending"
2025-01-20T00:50:13.540961mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0260(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name'))
2025-01-20T00:50:13.541911mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 230, in scrape_ep_key_players
    raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name
2025-01-20T00:50:14.526461dossiererrorunknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending"
2025-01-20T00:50:14.533367mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0159M(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name'))
2025-01-20T00:50:14.535195mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 73, in scrape
    'committees': scrape_ep_key_players(root),
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 230, in scrape_ep_key_players
    raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name
2025-01-20T00:50:15.783699mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0214(COD)&l=en'} (ValueError())
2025-01-20T00:50:15.785018mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:50:16.506663mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0286(BUD)&l=en'} (ValueError())
2025-01-20T00:50:16.507659mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 101, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2025-01-20T00:52:03.515900mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T00:52:29.876655mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T00:52:58.895350mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T00:56:09.848817mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T00:56:14.049818mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T00:57:10.606873mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:03:43.030451mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:04:54.219946mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:04:56.507483mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:07:00.643187mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:08:34.604489mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:09:43.489495mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:11:54.536639mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:12:01.572264mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:12:06.050573mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:14:29.281388mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:16:34.700328mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:16:42.710483mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:17:24.882285mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:18:39.581043mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:19:06.425118mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:19:39.114948mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:21:23.494837mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:21:40.253382mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:23:11.233719mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:23:36.543597mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:24:12.466492mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:24:12.976100mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:24:32.000484mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:24:47.110801mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:25:19.960898mep_activitywarningpe, has not expected format: 'Commission'
2025-01-20T01:25:50.028221mep_activitywarningpe, has not expected format: 'Commission'