2025-01-22T00:36:07.244639 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:07.245610 | dossier | error | unknown linkless committee in EP key players: "ENVI Environment, Climate and Food Safety" -> u"Environment, Climate and Food Safety": u"ENVI" |
2025-01-22T00:36:07.246294 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2017/2549(DEA)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2025-01-22T00:36:07.247933 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2025-01-22T00:36:07.522582 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:08.013719 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:08.015098 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2025-01-22T00:36:08.085214 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2025-01-22T00:36:08.086133 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
2025-01-22T00:36:08.379750 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:10.270161 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:10.377696 | dossier | error | unknown linkless committee in EP key players: "ENVI Environment, Climate and Food Safety" -> u"Environment, Climate and Food Safety": u"ENVI" |
2025-01-22T00:36:10.378841 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2017/2661(DEA)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2025-01-22T00:36:10.379642 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2025-01-22T00:36:11.252827 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:12.104232 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:12.248502 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:12.660083 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0059(COD)&l=en |
2025-01-22T00:36:13.880136 | dossier | error | unknown linkless committee in EP key players: "ENVI Environment, Climate and Food Safety" -> u"Environment, Climate and Food Safety": u"ENVI" |
2025-01-22T00:36:13.880711 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2017/2994(DEA)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2025-01-22T00:36:13.881898 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2025-01-22T00:36:13.886537 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:14.454110 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:14.454876 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 3.0 month(s)" |
2025-01-22T00:36:14.753555 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:15.936498 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:16.041286 | dossier | error | unknown linkless committee in EP key players: "ENVI Environment, Climate and Food Safety" -> u"Environment, Climate and Food Safety": u"ENVI" |
2025-01-22T00:36:16.041675 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/2918(DEA)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2025-01-22T00:36:16.042520 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2025-01-22T00:36:16.339359 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:17.629471 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:18.793700 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:18.794642 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 3.0 month(s)" |
2025-01-22T00:36:19.823487 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:20.775346 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:20.946678 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:21.239697 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:22.308824 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2025-01-22T00:36:22.513945 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2016/0195(NLE)&l=en'} (ValueError()) |
2025-01-22T00:36:22.515180 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
2025-01-22T00:36:22.520089 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:23.788887 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:23.941653 | dossier | error | unknown linkless committee in EP key players: "ENVI Environment, Climate and Food Safety" -> u"Environment, Climate and Food Safety": u"ENVI" |
2025-01-22T00:36:23.942040 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2017/2822(DEA)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2025-01-22T00:36:23.942908 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2025-01-22T00:36:24.177345 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:24.268262 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en |
2025-01-22T00:36:24.995115 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:25.465569 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:25.803698 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:26.539502 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:26.638941 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:27.015884 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:27.507392 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:27.852962 | dossier | error | unknown linkless committee in EP key players: "ENVI Environment, Climate and Food Safety" -> u"Environment, Climate and Food Safety": u"ENVI" |
2025-01-22T00:36:27.853445 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/2914(DEA)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2025-01-22T00:36:27.854323 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2025-01-22T00:36:28.226840 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:29.177612 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:29.845901 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:29.954616 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:30.209349 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:30.477089 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:30.774682 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2016/0038(NLE)&l=en'} (ValueError()) |
2025-01-22T00:36:30.775690 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
2025-01-22T00:36:31.274556 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:32.716511 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:32.718123 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:32.719911 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2025-01-22T00:36:33.048299 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:33.501523 | dossier | error | unknown linkless committee in EP key players: "ENVI Environment, Climate and Food Safety" -> u"Environment, Climate and Food Safety": u"ENVI" |
2025-01-22T00:36:33.502241 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/2961(DEA)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2025-01-22T00:36:33.503510 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2025-01-22T00:36:33.510793 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2025-01-22T00:36:34.270224 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:34.271980 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 3.0 month(s)" |
2025-01-22T00:36:34.272715 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2025-01-22T00:36:35.508885 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:35.695925 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:36.168234 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:36.172135 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:36.814235 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:36.818481 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:36.821041 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:37.301504 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:38.507771 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:38.567138 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:38.567851 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2025-01-22T00:36:39.545919 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:39.931501 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:40.153912 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:40.154946 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 4.0 month(s)" |
2025-01-22T00:36:40.250710 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:40.870013 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2025-01-22T00:36:40.871018 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
2025-01-22T00:36:41.811221 | dossier | error | unknown linkless committee in EP key players: "ENVI Environment, Climate and Food Safety" -> u"Environment, Climate and Food Safety": u"ENVI" |
2025-01-22T00:36:41.811827 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2017/2555(DEA)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2025-01-22T00:36:41.813048 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2025-01-22T00:36:41.817275 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:42.163762 | dossier | error | unknown linkless committee in EP key players: "ENVI Environment, Climate and Food Safety" -> u"Environment, Climate and Food Safety": u"ENVI" |
2025-01-22T00:36:42.164173 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2017/2750(DEA)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2025-01-22T00:36:42.165049 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2025-01-22T00:36:42.760930 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0063(COD)&l=en |
2025-01-22T00:36:43.332276 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:43.333063 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:43.649272 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:43.973793 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:45.058545 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:46.348828 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:47.150883 | dossier | error | unknown linkless committee in EP key players: "ENVI Environment, Climate and Food Safety" -> u"Environment, Climate and Food Safety": u"ENVI" |
2025-01-22T00:36:47.151243 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/2648(DEA)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2025-01-22T00:36:47.152075 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2025-01-22T00:36:47.456380 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:48.158199 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:48.470374 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
2025-01-22T00:36:48.470723 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0212(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
2025-01-22T00:36:48.471529 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
2025-01-22T00:36:49.407556 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:50.239543 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0060(COD)&l=en |
2025-01-22T00:36:50.441206 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:50.706016 | dossier | error | unknown linkless committee in EP key players: "ENVI Environment, Climate and Food Safety" -> u"Environment, Climate and Food Safety": u"ENVI" |
2025-01-22T00:36:50.706404 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/2916(DEA)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2025-01-22T00:36:50.707186 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2025-01-22T00:36:51.265813 | dossier | error | unknown linkless committee in EP key players: "ENVI Environment, Climate and Food Safety" -> u"Environment, Climate and Food Safety": u"ENVI" |
2025-01-22T00:36:51.266198 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0332(COD)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2025-01-22T00:36:51.267039 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2025-01-22T00:36:52.171372 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:52.953905 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:53.737317 | dossier | error | unknown linkless committee in EP key players: "ENVI Environment, Climate and Food Safety" -> u"Environment, Climate and Food Safety": u"ENVI" |
2025-01-22T00:36:53.737665 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2014/2894(DEA)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2025-01-22T00:36:53.738497 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2025-01-22T00:36:55.037672 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:55.447496 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the legal basis', 'Former rapporteur for opinion', 'Appointed'] |
2025-01-22T00:36:55.447967 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0273(NLE)&l=en'} (ValueError('bad html in EP key players, committee header')) |
2025-01-22T00:36:55.448855 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
2025-01-22T00:36:55.960617 | dossier | error | unknown linkless committee in EP key players: "ENVI Environment, Climate and Food Safety" -> u"Environment, Climate and Food Safety": u"ENVI" |
2025-01-22T00:36:55.960960 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/2912(DEA)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2025-01-22T00:36:55.961685 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2025-01-22T00:36:56.293867 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:56.542979 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:56.543619 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
2025-01-22T00:36:57.036423 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:57.542942 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
2025-01-22T00:36:57.543390 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2013/0186(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
2025-01-22T00:36:57.544198 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
2025-01-22T00:36:57.834656 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:36:57.835251 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
2025-01-22T00:36:58.588414 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en |
2025-01-22T00:36:58.722178 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2025-01-22T00:36:59.440968 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:36:59.441592 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
2025-01-22T00:36:59.975518 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:37:00.334659 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
2025-01-22T00:37:00.335292 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)" |
2025-01-22T00:37:00.557609 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:37:01.221250 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:37:01.444104 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
2025-01-22T00:37:02.348608 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:37:02.887443 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:37:03.124302 | dossier | error | unknown linkless committee in EP key players: "ENVI Environment, Climate and Food Safety" -> u"Environment, Climate and Food Safety": u"ENVI" |
2025-01-22T00:37:03.124645 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2017/3033(DEA)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2025-01-22T00:37:03.125485 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2025-01-22T00:37:03.125837 | mgr | error | exception threshold exeeded for dossier queue, aborting |
2025-01-22T00:37:03.126168 | mgr | error | exceptions: |
2025-01-22T00:37:03.126455 | mgr | error | ValueError('bad html in key players EP section, linkless committee name') |
2025-01-22T00:37:03.126694 | mgr | error | ValueError('bad html in key players EP section, linkless committee name') |
2025-01-22T00:37:03.127007 | mgr | error | ValueError('bad html in key players EP section, linkless committee name') |
2025-01-22T00:37:03.127302 | mgr | error | ValueError('bad html in EP key players, committee header') |
2025-01-22T00:37:03.127536 | mgr | error | ValueError('bad html in key players EP section, linkless committee name') |
2025-01-22T00:37:03.127800 | mgr | error | ValueError('bad html in key players EP section, linkless committee name') |
2025-01-22T00:37:03.128082 | mgr | error | ValueError('bad html in key players EP section, linkless committee name') |
2025-01-22T00:37:03.128316 | mgr | error | ValueError('bad html in EP key players, committee header') |
2025-01-22T00:37:03.128575 | mgr | error | ValueError('bad html in key players EP section, linkless committee name') |
2025-01-22T00:37:03.128925 | mgr | error | ValueError('bad html in EP key players, committee header') |
2025-01-22T00:37:03.129253 | mgr | error | ValueError('bad html in key players EP section, linkless committee name') |
2025-01-22T00:37:03.134711 | mgr | error | ---------------END OF EXCEPTIONS--------------- |
2025-01-22T00:37:03.498491 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:37:03.902457 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:37:03.972047 | dossier | error | unknown linkless committee in EP key players: "ENVI Environment, Climate and Food Safety" -> u"Environment, Climate and Food Safety": u"ENVI" |
2025-01-22T00:37:03.972437 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/2577(DEA)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
2025-01-22T00:37:03.973316 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
2025-01-22T00:37:04.336687 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:37:05.472799 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
2025-01-22T00:37:05.473536 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
2025-01-22T00:37:58.932760 | pvote | error | Failed to process split vote VOT xml: 404 Client Error: Not Found for url: https://www.europarl.europa.eu/doceo/document/PV-9-2025-01-20-VOT_EN.xml |
2025-01-22T00:37:59.169406 plenary warning no url in 1981/1104(COD) {'date': '1982-01-26T00:00:00', 'type': 'Committee report tabled for plenary, 1st reading', 'body': 'EP', 'docs': [{'title': 'A1-0977/1981'}]} |
2025-01-22T00:39:09.891258 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T00:39:34.364718 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T00:40:10.131466 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T00:43:19.807535 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T00:43:24.360551 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T00:44:24.480483 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T00:51:28.444954 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T00:52:10.517580 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T00:52:10.632203 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T00:54:21.665961 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T00:55:51.616105 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T00:56:55.577968 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T00:59:05.581475 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T00:59:25.111678 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T00:59:26.089515 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T01:01:36.079510 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T01:03:44.031429 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T01:03:49.907479 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T01:04:33.597820 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T01:05:57.477231 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T01:06:26.232149 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T01:07:02.371914 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T01:08:37.793876 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T01:09:01.266600 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T01:10:54.083569 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T01:11:17.023447 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T01:11:56.312531 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T01:11:58.949450 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T01:12:23.279031 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T01:12:34.153818 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T01:13:11.785030 | mep_activity | warning | pe, has not expected format: 'Commission' |
2025-01-22T01:13:45.242728 | mep_activity | warning | pe, has not expected format: 'Commission' |