BETA

Summary for scraper logs from the 2024-11-11

Summary of log messages

LevelCount
Exceptions29
error171
warning50
info16456
debug0

Summary of changes

TypeAddedUpdated
mep 0 3
dossier 0 172
amendment 1856 0
mep_activity 709 0

Dossier events without known bodies

EventCount
"Initial period for examining delegated act 4 month(s)"6
"Urgent procedure requested by a committee"1
TimeModuleLevelMessage
2024-11-11T00:23:23.575312mepwarningunknown title for assistants "Assistants to the Quaestorate" http://www.europarl.europa.eu/meps/en/202073/name/assistants
2024-11-11T00:23:23.587402mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 202073} (ValueError())
2024-11-11T00:23:23.593601mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/mep.py", line 123, in scrape
    raise ValueError
ValueError
2024-11-11T00:26:56.158358mepwarningunknown title for assistants "Assistants to the Vice-Presidency" http://www.europarl.europa.eu/meps/en/125027/name/assistants
2024-11-11T00:26:56.162429mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 125027} (ValueError())
2024-11-11T00:26:56.168942mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/mep.py", line 123, in scrape
    raise ValueError
ValueError
2024-11-11T00:28:08.957549mepwarningunknown title for assistants "Assistants to the Quaestorate" http://www.europarl.europa.eu/meps/en/22858/name/assistants
2024-11-11T00:28:08.957956mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 22858} (ValueError())
2024-11-11T00:28:08.958829mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/mep.py", line 123, in scrape
    raise ValueError
ValueError
2024-11-11T00:29:03.775175mepwarningunknown title for assistants "Assistants to the Vice-Presidency" http://www.europarl.europa.eu/meps/en/125042/name/assistants
2024-11-11T00:29:03.775745mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 125042} (ValueError())
2024-11-11T00:29:03.776800mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/mep.py", line 123, in scrape
    raise ValueError
ValueError
2024-11-11T00:30:36.537291mepwarningunknown title for assistants "Assistants to the Vice-Presidency" http://www.europarl.europa.eu/meps/en/30482/name/assistants
2024-11-11T00:30:36.537620mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 30482} (ValueError())
2024-11-11T00:30:36.538566mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/mep.py", line 123, in scrape
    raise ValueError
ValueError
2024-11-11T00:30:57.740217mepwarningunknown title for assistants "Assistants to the Vice-Presidency" http://www.europarl.europa.eu/meps/en/124846/name/assistants
2024-11-11T00:30:57.786746mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 124846} (ValueError())
2024-11-11T00:30:57.828625mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/mep.py", line 123, in scrape
    raise ValueError
ValueError
2024-11-11T00:31:44.276276mepwarningunknown title for assistants "Assistants to the Vice-Presidency" http://www.europarl.europa.eu/meps/en/257113/name/assistants
2024-11-11T00:31:44.277088mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 257113} (ValueError())
2024-11-11T00:31:44.278774mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/mep.py", line 123, in scrape
    raise ValueError
ValueError
2024-11-11T00:31:45.927690mepwarningunknown title for assistants "Assistants to the Vice-Presidency" http://www.europarl.europa.eu/meps/en/37312/name/assistants
2024-11-11T00:31:45.928107mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 37312} (ValueError())
2024-11-11T00:31:45.928868mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/mep.py", line 123, in scrape
    raise ValueError
ValueError
2024-11-11T00:33:23.006253mepwarningunknown title for assistants "Assistants to the Vice-Presidency" http://www.europarl.europa.eu/meps/en/96756/name/assistants
2024-11-11T00:33:23.006599mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 96756} (ValueError())
2024-11-11T00:33:23.007465mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/mep.py", line 123, in scrape
    raise ValueError
ValueError
2024-11-11T00:33:56.748964mepwarningunknown title for assistants "Assistants to the Vice-Presidency" http://www.europarl.europa.eu/meps/en/220801/name/assistants
2024-11-11T00:33:56.785952mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 220801} (ValueError())
2024-11-11T00:33:56.797342mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/mep.py", line 123, in scrape
    raise ValueError
ValueError
2024-11-11T00:34:14.589300mepwarningunknown title for assistants "Assistants to the Vice-Presidency" http://www.europarl.europa.eu/meps/en/28615/name/assistants
2024-11-11T00:34:14.589632mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 28615} (ValueError())
2024-11-11T00:34:14.590447mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/mep.py", line 123, in scrape
    raise ValueError
ValueError
2024-11-11T00:34:15.784904mepwarningunknown title for assistants "Assistants to the Quaestorate" http://www.europarl.europa.eu/meps/en/124884/name/assistants
2024-11-11T00:34:15.805933mgrerrorfailed to execute mep job {'onfinished': {'daisy': True}, 'id': 124884} (ValueError())
2024-11-11T00:34:15.810129mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/mep.py", line 123, in scrape
    raise ValueError
ValueError
2024-11-11T00:34:44.253193dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0059(COD)&l=en
2024-11-11T00:34:49.056485dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en
2024-11-11T00:34:56.197080dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0063(COD)&l=en
2024-11-11T00:35:02.128792dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0060(COD)&l=en
2024-11-11T00:35:08.239777dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en
2024-11-11T00:35:08.514261mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2013/0186(COD)&l=en'} (ValueError())
2024-11-11T00:35:08.515417mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 98, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2024-11-11T00:35:10.106741dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/2047(INI)&l=en
2024-11-11T00:35:21.761426mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2012/0164(APP)&l=en'} (ValueError())
2024-11-11T00:35:21.763278mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 98, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2024-11-11T00:35:54.115980mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2011/0391(COD)&l=en'} (ValueError())
2024-11-11T00:35:54.117462mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 98, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2024-11-11T00:36:00.086287dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2148(INI)&l=en
2024-11-11T00:36:03.147968dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0057(COD)&l=en
2024-11-11T00:36:06.673924mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=1998/0031(NLE)&l=en'} (ValueError())
2024-11-11T00:36:06.697407mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 98, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2024-11-11T00:36:22.271554mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2009/0814(NLE)&l=en'} (ValueError())
2024-11-11T00:36:22.273692mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 98, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2024-11-11T00:36:43.550658dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2848(RSP)&l=en
2024-11-11T00:36:49.771641dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2669(RSP)&l=en
2024-11-11T00:36:51.607980dossiererrorno content found for section "Attention!" of 2015/2542(DEA)
2024-11-11T00:36:51.612151dossiererrorno content found for section "Delegated act was actually rejected!" of 2015/2542(DEA)
2024-11-11T00:36:51.959121dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2014/2230(INI)&l=en
2024-11-11T00:37:24.057381dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2222(INI)&l=en
2024-11-11T00:37:24.681576dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0282(COD)&l=en
2024-11-11T00:37:25.273253dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2024(INL)&l=en
2024-11-11T00:37:26.855540dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2016/0062(NLE)&l=en
2024-11-11T00:37:46.824530dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0152(COD)&l=en
2024-11-11T00:37:49.477029dossiererrorthis url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0400(COD)&l=en
2024-11-11T00:37:52.554494dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2016/0224(COD)&l=en
2024-11-11T00:38:00.288086dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/2688(RSO)&l=en
2024-11-11T00:38:18.704115dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/0001(COD)&l=en
2024-11-11T00:38:38.996220dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2110(INI)&l=en
2024-11-11T00:38:41.758970dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/2852(RSP)&l=en
2024-11-11T00:38:42.871032dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2858(RSP)&l=en
2024-11-11T00:38:42.904160dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2133(INI)&l=en
2024-11-11T00:38:45.936641dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2203(INI)&l=en
2024-11-11T00:38:46.224544dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2212(INI)&l=en
2024-11-11T00:38:47.758787dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2211(INI)&l=en
2024-11-11T00:38:49.876386dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2185(INI)&l=en
2024-11-11T00:38:49.913730dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2165(INI)&l=en
2024-11-11T00:38:50.488903dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2163(INI)&l=en
2024-11-11T00:38:53.307098dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2519(RSP)&l=en
2024-11-11T00:38:53.868395dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2522(RSP)&l=en
2024-11-11T00:38:54.284227dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2501(RSP)&l=en
2024-11-11T00:38:54.318688dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2570(RSP)&l=en
2024-11-11T00:38:55.009839dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2568(RSP)&l=en
2024-11-11T00:38:55.276306dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2573(RSP)&l=en
2024-11-11T00:38:55.408190dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2572(RSP)&l=en
2024-11-11T00:38:55.612849dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2569(RSP)&l=en
2024-11-11T00:38:55.617709dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2540(RSP)&l=en
2024-11-11T00:38:55.653580dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2556(RSP)&l=en
2024-11-11T00:38:55.715913dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2574(RSP)&l=en
2024-11-11T00:38:55.887592dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2571(RSP)&l=en
2024-11-11T00:38:56.351735dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2587(RSP)&l=en
2024-11-11T00:38:56.355384dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2592(RSP)&l=en
2024-11-11T00:38:56.446372dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2598(RSP)&l=en
2024-11-11T00:38:56.892743dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2595(RSP)&l=en
2024-11-11T00:38:56.894081dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2593(RSP)&l=en
2024-11-11T00:38:56.895677dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2601(RSP)&l=en
2024-11-11T00:38:57.683155dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2602(RSP)&l=en
2024-11-11T00:38:57.688670dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2600(RSP)&l=en
2024-11-11T00:38:57.748552dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2599(RSP)&l=en
2024-11-11T00:38:58.216635dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2597(RSP)&l=en
2024-11-11T00:38:58.406432dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2591(RSP)&l=en
2024-11-11T00:39:04.578199dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2710(RSP)&l=en
2024-11-11T00:39:04.943990dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2703(RSP)&l=en
2024-11-11T00:39:11.313331dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2200(IMM)&l=en
2024-11-11T00:39:11.547666dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2798(RSP)&l=en
2024-11-11T00:39:11.550556dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2799(RSP)&l=en
2024-11-11T00:39:17.486883dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2897(RSP)&l=en
2024-11-11T00:39:35.823013dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2047(INI)&l=en
2024-11-11T00:39:35.827423dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2061(INI)&l=en
2024-11-11T00:39:39.169035dossierwarningno body mapping found for "Initial period for examining delegated act 4 month(s)"
2024-11-11T00:39:39.356432dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2730(RSP)&l=en
2024-11-11T00:39:43.876820dossierwarningno body mapping found for "Initial period for examining delegated act 4 month(s)"
2024-11-11T00:39:46.277678dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/0211(COD)&l=en
2024-11-11T00:39:54.023315dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2175(IMM)&l=en
2024-11-11T00:40:04.058270dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2939(RSP)&l=en
2024-11-11T00:40:04.275404dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2998(RSP)&l=en
2024-11-11T00:40:05.185946dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2198(INI)&l=en
2024-11-11T00:40:05.293385dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2213(INI)&l=en
2024-11-11T00:40:07.237709dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/3011(RSP)&l=en
2024-11-11T00:40:14.012253dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2020/2259(INI)&l=en
2024-11-11T00:40:18.393744dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2238(INI)&l=en
2024-11-11T00:40:20.050459dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2506(RSP)&l=en
2024-11-11T00:40:23.831975dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2554(RSP)&l=en
2024-11-11T00:40:30.078682dossierwarningno body mapping found for "Initial period for examining delegated act 4 month(s)"
2024-11-11T00:40:54.033337dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2863(RSP)&l=en
2024-11-11T00:41:14.061292dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/3010(RSP)&l=en
2024-11-11T00:41:16.348551dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2209(IMM)&l=en
2024-11-11T00:41:19.038978dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2203(INI)&l=en
2024-11-11T00:41:19.475744dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2008(IMM)&l=en
2024-11-11T00:41:25.426982dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2567(RSP)&l=en
2024-11-11T00:41:51.734914dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2597(RSP)&l=en
2024-11-11T00:41:52.003984dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2592(RSP)&l=en
2024-11-11T00:41:53.765213dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2614(RSP)&l=en
2024-11-11T00:41:53.781569dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0077(COD)&l=en
2024-11-11T00:41:56.108073dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2039(IMM)&l=en
2024-11-11T00:41:57.281243dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2649(RSP)&l=en
2024-11-11T00:42:34.636279dossierwarningno body mapping found for "Initial period for examining delegated act 4 month(s)"
2024-11-11T00:42:35.025792dossierwarningno body mapping found for "Initial period for examining delegated act 4 month(s)"
2024-11-11T00:42:42.540539dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2104(INL)&l=en
2024-11-11T00:42:43.343736dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2125(INI)&l=en
2024-11-11T00:42:48.520927dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2710(RSP)&l=en
2024-11-11T00:42:57.083728dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2191(IMM)&l=en
2024-11-11T00:43:00.509694dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2200(IMM)&l=en
2024-11-11T00:43:00.697344dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2199(IMM)&l=en
2024-11-11T00:43:02.230160dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2927(RSP)&l=en
2024-11-11T00:43:07.257014dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2989(RSP)&l=en
2024-11-11T00:43:33.242982dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2593(RSP)&l=en
2024-11-11T00:43:33.855783dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2622(RSP)&l=en
2024-11-11T00:43:41.575367dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2010(IMM)&l=en
2024-11-11T00:43:43.818323dossiererrorthis url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2711(DEA)&l=en
2024-11-11T00:43:51.817549dossierwarningno body mapping found for "Initial period for examining delegated act 4 month(s)"
2024-11-11T00:44:05.863173dossierwarningno body mapping found for "Urgent procedure requested by a committee"
2024-11-11T00:48:41.838852mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0089(BUD)&l=en'} (ValueError('dossier proc header has not two components'))
2024-11-11T00:48:41.839885mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 60, in scrape
    if len(tmp)!=2: raise ValueError("dossier proc header has not two components")
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ValueError: dossier proc header has not two components
2024-11-11T00:49:08.532978mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2841(RSP)&l=en'} (ValueError('dossier proc header has not two components'))
2024-11-11T00:49:08.533601mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 60, in scrape
    if len(tmp)!=2: raise ValueError("dossier proc header has not two components")
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ValueError: dossier proc header has not two components
2024-11-11T00:49:08.547720mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2834(RSP)&l=en'} (ValueError('dossier proc header has not two components'))
2024-11-11T00:49:08.549007mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 60, in scrape
    if len(tmp)!=2: raise ValueError("dossier proc header has not two components")
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ValueError: dossier proc header has not two components
2024-11-11T00:49:08.555821mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2836(RSP)&l=en'} (ValueError('dossier proc header has not two components'))
2024-11-11T00:49:08.556497mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 60, in scrape
    if len(tmp)!=2: raise ValueError("dossier proc header has not two components")
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ValueError: dossier proc header has not two components
2024-11-11T00:49:08.563893mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2840(RSP)&l=en'} (ValueError('dossier proc header has not two components'))
2024-11-11T00:49:08.564636mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 60, in scrape
    if len(tmp)!=2: raise ValueError("dossier proc header has not two components")
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ValueError: dossier proc header has not two components
2024-11-11T00:49:08.644681mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2837(RSP)&l=en'} (ValueError('dossier proc header has not two components'))
2024-11-11T00:49:08.645320mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 60, in scrape
    if len(tmp)!=2: raise ValueError("dossier proc header has not two components")
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ValueError: dossier proc header has not two components
2024-11-11T00:49:08.774590mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2839(RSP)&l=en'} (ValueError('dossier proc header has not two components'))
2024-11-11T00:49:08.775213mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 60, in scrape
    if len(tmp)!=2: raise ValueError("dossier proc header has not two components")
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ValueError: dossier proc header has not two components
2024-11-11T00:49:09.667200mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2835(RSP)&l=en'} (ValueError('dossier proc header has not two components'))
2024-11-11T00:49:09.668230mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 60, in scrape
    if len(tmp)!=2: raise ValueError("dossier proc header has not two components")
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ValueError: dossier proc header has not two components
2024-11-11T00:49:11.506300mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0284(BUD)&l=en'} (ValueError())
2024-11-11T00:49:11.507222mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 98, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
    raise ValueError()
ValueError
2024-11-11T00:49:14.126720mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0286(BUD)&l=en'} (ValueError())
2024-11-11T00:49:14.127644mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 98, in scrape
    return process(
           ^^^^^^^^
  File "/home/pt/pt2/utils/process.py", line 51, in process
    o2 = patch(prev or {}, json.loads(jdump(d)))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pt/pt2/utils/objchanges.py", line 271, in patch
    raise ValueError()
ValueError
2024-11-11T00:53:41.870859mgrerrorfailed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2838(RSP)&l=en'} (ValueError('dossier proc header has not two components'))
2024-11-11T00:53:41.871505mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/dossier.py", line 60, in scrape
    if len(tmp)!=2: raise ValueError("dossier proc header has not two components")
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ValueError: dossier proc header has not two components
2024-11-11T00:53:41.871814mgrerrorexception threshold exeeded for dossier queue, aborting
2024-11-11T00:53:41.872118mgrerrorexceptions:
2024-11-11T00:53:41.872368mgrerrorValueError('dossier proc header has not two components')
2024-11-11T00:53:41.872622mgrerrorValueError('dossier proc header has not two components')
2024-11-11T00:53:41.872958mgrerrorValueError('dossier proc header has not two components')
2024-11-11T00:53:41.873239mgrerrorValueError('dossier proc header has not two components')
2024-11-11T00:53:41.873462mgrerrorValueError('dossier proc header has not two components')
2024-11-11T00:53:41.873683mgrerrorValueError('dossier proc header has not two components')
2024-11-11T00:53:41.873961mgrerrorValueError('dossier proc header has not two components')
2024-11-11T00:53:41.874246mgrerrorValueError('dossier proc header has not two components')
2024-11-11T00:53:41.874467mgrerrorValueError()
2024-11-11T00:53:41.874711mgrerrorValueError()
2024-11-11T00:53:41.874999mgrerrorValueError('dossier proc header has not two components')
2024-11-11T00:53:41.875299mgrerror---------------END OF EXCEPTIONS---------------
2024-11-11T00:54:22.713272mgrerrorfailed to execute plenaries job {'onfinished': {'daisy': True}} (AttributeError("type object 'datetime.datetime' has no attribute 'datetime'"))
2024-11-11T00:54:22.715672mgrerrorTraceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
    ret = scraper.scrape(**job)
          ^^^^^^^^^^^^^^^^^^^^^
  File "scrapers/plenaries.py", line 59, in scrape
    elif isinstance(date,datetime.datetime):
                         ^^^^^^^^^^^^^^^^^
AttributeError: type object 'datetime.datetime' has no attribute 'datetime'
2024-11-11T00:54:49.350732mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T00:55:05.701510mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T00:55:16.339176mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T00:57:31.270990mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T00:57:43.372814mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T00:57:59.204417mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T00:59:36.761488mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T00:59:47.356829mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T01:00:31.416202mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T01:01:29.260862mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T01:02:03.638561mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T01:03:07.787083mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T01:03:15.126116mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T01:03:22.154636mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T01:04:43.372605mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T01:05:49.069407mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T01:05:52.830721mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T01:06:20.231807mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T01:07:01.171877mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T01:07:15.166636mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T01:07:38.183160mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T01:08:35.400377mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T01:08:47.307681mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T01:09:45.553045mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T01:09:57.641092mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T01:10:14.109352mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T01:10:17.348848mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T01:10:25.076090mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T01:10:34.016115mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T01:10:48.382882mep_activitywarningpe, has not expected format: 'Commission'
2024-11-11T01:10:51.999335mep_activitywarningpe, has not expected format: 'Commission'