BETA

Summary for scraper logs from the 2024-11-10

Summary of log messages

LevelCount
Exceptions29
error171
warning50
info16495
debug0

Summary of changes

TypeAddedUpdated
mep 0 26
dossier 0 168
amendment 1856 0
mep_activity 709 0

Dossier events without known bodies

EventCount
"Initial period for examining delegated act 4 month(s)"6
"Urgent procedure requested by a committee"1
TimeModuleLevelMessage
2024-11-10T00:23:23.798455mepwarningunknown title for assistants "Assistants to the Quaestorate" http://www.europarl.europa.eu/meps/en/202073/name/assistants
2024-11-10T00:23:23.798890mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 202073} (ValueError())
2024-11-10T00:23:23.821016mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/mep.py", line 123, in scrape
    raise ValueError
ValueError
2024-11-10T00:26:56.544517mepwarningunknown title for assistants "Assistants to the Vice-Presidency" http://www.europarl.europa.eu/meps/en/125027/name/assistants
2024-11-10T00:26:56.545222mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 125027} (ValueError())
2024-11-10T00:26:56.552460mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/mep.py", line 123, in scrape
    raise ValueError
ValueError
2024-11-10T00:28:13.062996mepwarningunknown title for assistants "Assistants to the Quaestorate" http://www.europarl.europa.eu/meps/en/22858/name/assistants
2024-11-10T00:28:13.064034mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 22858} (ValueError())
2024-11-10T00:28:13.064992mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/mep.py", line 123, in scrape
    raise ValueError
ValueError
2024-11-10T00:29:06.193483mepwarningunknown title for assistants "Assistants to the Vice-Presidency" http://www.europarl.europa.eu/meps/en/125042/name/assistants
2024-11-10T00:29:06.194108mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 125042} (ValueError())
2024-11-10T00:29:06.200357mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/mep.py", line 123, in scrape
    raise ValueError
ValueError
2024-11-10T00:30:40.366555mepwarningunknown title for assistants "Assistants to the Vice-Presidency" http://www.europarl.europa.eu/meps/en/30482/name/assistants
2024-11-10T00:30:40.366949mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 30482} (ValueError())
2024-11-10T00:30:40.368181mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/mep.py", line 123, in scrape
    raise ValueError
ValueError
2024-11-10T00:30:59.853087mepwarningunknown title for assistants "Assistants to the Vice-Presidency" http://www.europarl.europa.eu/meps/en/124846/name/assistants
2024-11-10T00:30:59.853490mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 124846} (ValueError())
2024-11-10T00:30:59.854390mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/mep.py", line 123, in scrape
    raise ValueError
ValueError
2024-11-10T00:31:47.560385mepwarningunknown title for assistants "Assistants to the Vice-Presidency" http://www.europarl.europa.eu/meps/en/257113/name/assistants
2024-11-10T00:31:47.573517mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 257113} (ValueError())
2024-11-10T00:31:47.615478mepwarningunknown title for assistants "Assistants to the Vice-Presidency" http://www.europarl.europa.eu/meps/en/37312/name/assistants
2024-11-10T00:31:47.616113mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/mep.py", line 123, in scrape
    raise ValueError
ValueError
2024-11-10T00:31:47.618438mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 37312} (ValueError())
2024-11-10T00:31:47.621499mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/mep.py", line 123, in scrape
    raise ValueError
ValueError
2024-11-10T00:33:26.481110mepwarningunknown title for assistants "Assistants to the Vice-Presidency" http://www.europarl.europa.eu/meps/en/96756/name/assistants
2024-11-10T00:33:26.482128mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 96756} (ValueError())
2024-11-10T00:33:26.483592mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/mep.py", line 123, in scrape
    raise ValueError
ValueError
2024-11-10T00:33:59.415814mepwarningunknown title for assistants "Assistants to the Vice-Presidency" http://www.europarl.europa.eu/meps/en/220801/name/assistants
2024-11-10T00:33:59.416226mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 220801} (ValueError())
2024-11-10T00:33:59.417135mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/mep.py", line 123, in scrape
    raise ValueError
ValueError
2024-11-10T00:34:18.586978mepwarningunknown title for assistants "Assistants to the Vice-Presidency" http://www.europarl.europa.eu/meps/en/28615/name/assistants
2024-11-10T00:34:18.587369mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 28615} (ValueError())
2024-11-10T00:34:18.588320mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/mep.py", line 123, in scrape
    raise ValueError
ValueError
2024-11-10T00:34:20.800909mepwarningunknown title for assistants "Assistants to the Quaestorate" http://www.europarl.europa.eu/meps/en/124884/name/assistants
2024-11-10T00:34:20.802047mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 124884} (ValueError())
2024-11-10T00:34:20.813984mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/mep.py", line 123, in scrape
    raise ValueError
ValueError
2024-11-10T00:34:48.960160dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0059(COD)&l=en
2024-11-10T00:34:54.773020dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en
2024-11-10T00:35:07.358206dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0063(COD)&l=en
2024-11-10T00:35:10.442323dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0060(COD)&l=en
2024-11-10T00:35:17.266562dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en
2024-11-10T00:35:17.635896mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2013/0186(COD)&l=en'} (ValueError())
2024-11-10T00:35:17.653912mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 98, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2024-11-10T00:35:19.457263dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/2047(INI)&l=en
2024-11-10T00:36:06.783972mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2011/0391(COD)&l=en'} (ValueError())
2024-11-10T00:36:06.785098mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 98, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2024-11-10T00:36:13.055917mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2011/0441(NLE)&l=en'} (ValueError())
2024-11-10T00:36:13.058528mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 98, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2024-11-10T00:36:13.059161dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2148(INI)&l=en
2024-11-10T00:36:16.351262dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0057(COD)&l=en
2024-11-10T00:36:22.079967mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=1998/0031(NLE)&l=en'} (ValueError())
2024-11-10T00:36:22.082361mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 98, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2024-11-10T00:37:01.609088dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2848(RSP)&l=en
2024-11-10T00:37:08.476597dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2669(RSP)&l=en
2024-11-10T00:37:13.992342dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2014/2230(INI)&l=en
2024-11-10T00:37:14.001273dossiererrorno content found for section "Attention!" of 2015/2542(DEA)
2024-11-10T00:37:14.005893dossiererrorno content found for section "Delegated act was actually rejected!" of 2015/2542(DEA)
2024-11-10T00:37:46.042194dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2222(INI)&l=en
2024-11-10T00:37:46.179264dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0282(COD)&l=en
2024-11-10T00:37:47.603889dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2024(INL)&l=en
2024-11-10T00:37:49.677970dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2016/0062(NLE)&l=en
2024-11-10T00:38:09.900595dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0152(COD)&l=en
2024-11-10T00:38:12.460194dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2016/0224(COD)&l=en
2024-11-10T00:38:12.667224dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0400(COD)&l=en
2024-11-10T00:38:23.609696dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/2688(RSO)&l=en
2024-11-10T00:38:38.901762dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/0001(COD)&l=en
2024-11-10T00:39:02.991359dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2110(INI)&l=en
2024-11-10T00:39:05.102923dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/2852(RSP)&l=en
2024-11-10T00:39:06.198912dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2133(INI)&l=en
2024-11-10T00:39:06.532704dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2858(RSP)&l=en
2024-11-10T00:39:10.841480dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2203(INI)&l=en
2024-11-10T00:39:11.401351dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2211(INI)&l=en
2024-11-10T00:39:11.519805dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2212(INI)&l=en
2024-11-10T00:39:13.438811dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2185(INI)&l=en
2024-11-10T00:39:13.904816dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2165(INI)&l=en
2024-11-10T00:39:14.052279dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2163(INI)&l=en
2024-11-10T00:39:16.778701dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2519(RSP)&l=en
2024-11-10T00:39:16.901645dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2522(RSP)&l=en
2024-11-10T00:39:17.511327dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2501(RSP)&l=en
2024-11-10T00:39:17.628634dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2570(RSP)&l=en
2024-11-10T00:39:18.046154dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2568(RSP)&l=en
2024-11-10T00:39:18.281029dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2573(RSP)&l=en
2024-11-10T00:39:18.329046dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2572(RSP)&l=en
2024-11-10T00:39:18.480373dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2569(RSP)&l=en
2024-11-10T00:39:18.500962dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2556(RSP)&l=en
2024-11-10T00:39:18.503148dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2540(RSP)&l=en
2024-11-10T00:39:18.660175dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2574(RSP)&l=en
2024-11-10T00:39:18.775165dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2571(RSP)&l=en
2024-11-10T00:39:18.933588dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2598(RSP)&l=en
2024-11-10T00:39:19.195780dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2592(RSP)&l=en
2024-11-10T00:39:19.243850dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2587(RSP)&l=en
2024-11-10T00:39:19.449910dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2595(RSP)&l=en
2024-11-10T00:39:19.596247dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2593(RSP)&l=en
2024-11-10T00:39:19.721345dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2601(RSP)&l=en
2024-11-10T00:39:19.942125dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2600(RSP)&l=en
2024-11-10T00:39:20.028419dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2602(RSP)&l=en
2024-11-10T00:39:20.113583dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2599(RSP)&l=en
2024-11-10T00:39:20.189604dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2591(RSP)&l=en
2024-11-10T00:39:20.201266dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2597(RSP)&l=en
2024-11-10T00:39:29.392626dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2710(RSP)&l=en
2024-11-10T00:39:29.661822dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2703(RSP)&l=en
2024-11-10T00:39:36.787219dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2200(IMM)&l=en
2024-11-10T00:39:37.240151dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2799(RSP)&l=en
2024-11-10T00:39:37.724293dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2798(RSP)&l=en
2024-11-10T00:39:44.656418dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2897(RSP)&l=en
2024-11-10T00:40:07.697379dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2047(INI)&l=en
2024-11-10T00:40:07.747094dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2061(INI)&l=en
2024-11-10T00:40:10.052977dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2730(RSP)&l=en
2024-11-10T00:40:11.545081dossierwarningno body mapping found for "Initial period for examining delegated act 4 month(s)"
2024-11-10T00:40:16.884829dossierwarningno body mapping found for "Initial period for examining delegated act 4 month(s)"
2024-11-10T00:40:19.458854dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/0211(COD)&l=en
2024-11-10T00:40:26.770781dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2175(IMM)&l=en
2024-11-10T00:40:37.956137dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2939(RSP)&l=en
2024-11-10T00:40:38.308306dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2998(RSP)&l=en
2024-11-10T00:40:39.240076dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2198(INI)&l=en
2024-11-10T00:40:40.035842dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2213(INI)&l=en
2024-11-10T00:40:42.140317dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/3011(RSP)&l=en
2024-11-10T00:40:47.960525dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2020/2259(INI)&l=en
2024-11-10T00:40:52.681478dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2238(INI)&l=en
2024-11-10T00:40:54.696974dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2506(RSP)&l=en
2024-11-10T00:40:58.903252dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2554(RSP)&l=en
2024-11-10T00:41:07.311004dossierwarningno body mapping found for "Initial period for examining delegated act 4 month(s)"
2024-11-10T00:41:34.330957dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2863(RSP)&l=en
2024-11-10T00:41:35.166890mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/0221(NLE)&l=en'} (ValueError())
2024-11-10T00:41:35.168074mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 98, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2024-11-10T00:41:55.643100dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/3010(RSP)&l=en
2024-11-10T00:41:55.873357dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2209(IMM)&l=en
2024-11-10T00:42:03.808830dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2203(INI)&l=en
2024-11-10T00:42:04.237441dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2008(IMM)&l=en
2024-11-10T00:42:08.774375dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2567(RSP)&l=en
2024-11-10T00:42:10.823515dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2592(RSP)&l=en
2024-11-10T00:42:11.720251dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2597(RSP)&l=en
2024-11-10T00:42:11.818599dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2614(RSP)&l=en
2024-11-10T00:42:11.905864dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0077(COD)&l=en
2024-11-10T00:42:17.256216dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2039(IMM)&l=en
2024-11-10T00:42:17.559502dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2649(RSP)&l=en
2024-11-10T00:42:51.773402dossierwarningno body mapping found for "Initial period for examining delegated act 4 month(s)"
2024-11-10T00:42:53.132138dossierwarningno body mapping found for "Initial period for examining delegated act 4 month(s)"
2024-11-10T00:43:01.374549dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2104(INL)&l=en
2024-11-10T00:43:02.627166dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2125(INI)&l=en
2024-11-10T00:43:08.449375dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2710(RSP)&l=en
2024-11-10T00:43:17.957449dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2191(IMM)&l=en
2024-11-10T00:43:23.763143dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2200(IMM)&l=en
2024-11-10T00:43:23.924790dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2199(IMM)&l=en
2024-11-10T00:43:25.618685dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2927(RSP)&l=en
2024-11-10T00:43:31.275402dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2989(RSP)&l=en
2024-11-10T00:43:54.316330dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2593(RSP)&l=en
2024-11-10T00:43:54.983410dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2622(RSP)&l=en
2024-11-10T00:44:06.765211dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2010(IMM)&l=en
2024-11-10T00:44:11.256282dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2711(DEA)&l=en
2024-11-10T00:44:19.906350dossierwarningno body mapping found for "Initial period for examining delegated act 4 month(s)"
2024-11-10T00:44:39.432758dossierwarningno body mapping found for "Urgent procedure requested by a committee"
2024-11-10T00:49:12.337634mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2714(RSP)&l=en'} (ValueError('dossier proc header has not two components'))
2024-11-10T00:49:12.338860mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 60, in scrape
    if len(tmp)!=2: raise ValueError("dossier proc header has not two components")
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ValueError: dossier proc header has not two components
2024-11-10T00:49:42.702634mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2841(RSP)&l=en'} (ValueError('dossier proc header has not two components'))
2024-11-10T00:49:42.703381mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 60, in scrape
    if len(tmp)!=2: raise ValueError("dossier proc header has not two components")
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ValueError: dossier proc header has not two components
2024-11-10T00:49:42.851942mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2834(RSP)&l=en'} (ValueError('dossier proc header has not two components'))
2024-11-10T00:49:42.852747mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 60, in scrape
    if len(tmp)!=2: raise ValueError("dossier proc header has not two components")
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ValueError: dossier proc header has not two components
2024-11-10T00:49:43.973569mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2836(RSP)&l=en'} (ValueError('dossier proc header has not two components'))
2024-11-10T00:49:43.974842mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 60, in scrape
    if len(tmp)!=2: raise ValueError("dossier proc header has not two components")
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ValueError: dossier proc header has not two components
2024-11-10T00:49:43.983425mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2837(RSP)&l=en'} (ValueError('dossier proc header has not two components'))
2024-11-10T00:49:43.997005mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 60, in scrape
    if len(tmp)!=2: raise ValueError("dossier proc header has not two components")
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ValueError: dossier proc header has not two components
2024-11-10T00:49:43.997823mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2840(RSP)&l=en'} (ValueError('dossier proc header has not two components'))
2024-11-10T00:49:44.005935mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2839(RSP)&l=en'} (ValueError('dossier proc header has not two components'))
2024-11-10T00:49:44.006871mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 60, in scrape
    if len(tmp)!=2: raise ValueError("dossier proc header has not two components")
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ValueError: dossier proc header has not two components
2024-11-10T00:49:44.007356mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2835(RSP)&l=en'} (ValueError('dossier proc header has not two components'))
2024-11-10T00:49:44.008233mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 60, in scrape
    if len(tmp)!=2: raise ValueError("dossier proc header has not two components")
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ValueError: dossier proc header has not two components
2024-11-10T00:49:44.009934mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 60, in scrape
    if len(tmp)!=2: raise ValueError("dossier proc header has not two components")
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ValueError: dossier proc header has not two components
2024-11-10T00:49:45.587175mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0284(BUD)&l=en'} (ValueError())
2024-11-10T00:49:45.624912mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 98, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2024-11-10T00:49:48.901116mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0286(BUD)&l=en'} (ValueError())
2024-11-10T00:49:48.902173mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 98, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 271, in patch
    raise ValueError()
ValueError
2024-11-10T00:54:12.370883mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2838(RSP)&l=en'} (ValueError('dossier proc header has not two components'))
2024-11-10T00:54:12.371576mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 60, in scrape
    if len(tmp)!=2: raise ValueError("dossier proc header has not two components")
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ValueError: dossier proc header has not two components
2024-11-10T00:54:12.371879mgrerrorexception threshold exeeded for dossier queue, aborting
2024-11-10T00:54:12.372171mgrerrorexceptions:
2024-11-10T00:54:12.372434mgrerrorValueError('dossier proc header has not two components')
2024-11-10T00:54:12.372783mgrerrorValueError('dossier proc header has not two components')
2024-11-10T00:54:12.373060mgrerrorValueError('dossier proc header has not two components')
2024-11-10T00:54:12.373316mgrerrorValueError('dossier proc header has not two components')
2024-11-10T00:54:12.373555mgrerrorValueError('dossier proc header has not two components')
2024-11-10T00:54:12.373823mgrerrorValueError('dossier proc header has not two components')
2024-11-10T00:54:12.374101mgrerrorValueError('dossier proc header has not two components')
2024-11-10T00:54:12.374361mgrerrorValueError('dossier proc header has not two components')
2024-11-10T00:54:12.374618mgrerrorValueError()
2024-11-10T00:54:12.374887mgrerrorValueError()
2024-11-10T00:54:12.375142mgrerrorValueError('dossier proc header has not two components')
2024-11-10T00:54:12.375469mgrerror---------------END OF EXCEPTIONS---------------
2024-11-10T00:54:56.205002mgrerrorfailed to execute plenaries job {'onfinished': {'daisy': True}} (AttributeError("type object 'datetime.datetime' has no attribute 'datetime'"))
2024-11-10T00:54:56.207547mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/plenaries.py", line 59, in scrape
    elif isinstance(date,datetime.datetime):
                         ^^^^^^^^^^^^^^^^^
AttributeError: type object 'datetime.datetime' has no attribute 'datetime'
2024-11-10T00:55:27.955219mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T00:55:46.682867mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T00:55:53.793455mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T00:58:25.211993mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T00:58:35.334253mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T00:58:57.787873mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:00:40.854286mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:00:53.387017mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:01:35.673117mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:02:34.777251mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:03:07.473910mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:04:17.291122mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:04:26.956026mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:04:34.333798mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:05:56.281395mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:07:03.299462mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:07:07.398848mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:07:35.650387mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:08:18.817155mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:08:36.137906mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:08:58.968613mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:09:54.968122mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:10:10.509301mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:11:08.914612mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:11:21.258449mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:11:38.786826mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:11:39.420667mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:11:51.845593mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:12:01.902348mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:12:14.590238mep_activitywarningpe, has not expected format: 'Commission'
2024-11-10T01:12:18.705119mep_activitywarningpe, has not expected format: 'Commission'