| 2024-12-24T00:36:14.544337 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:14.961504 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:15.422816 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:15.429076 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:36:15.434650 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
| 2024-12-24T00:36:15.700971 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:15.701682 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:36:16.099954 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:16.821558 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:17.740691 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:17.744223 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:18.116414 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:18.193527 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:18.442861 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0059(COD)&l=en |
| 2024-12-24T00:36:18.806318 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:19.104558 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:19.105369 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:19.106680 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 3.0 month(s)" |
| 2024-12-24T00:36:19.910490 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:20.349146 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:20.626582 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:20.948174 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:21.129258 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:21.584340 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:21.586733 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 3.0 month(s)" |
| 2024-12-24T00:36:23.206848 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:23.305839 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:23.393272 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:23.869921 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:24.963280 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:25.727123 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:25.728837 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:36:26.077559 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2633(RSP)&l=en |
| 2024-12-24T00:36:26.178863 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:26.391728 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:26.393630 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:27.207384 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:27.811287 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:28.441307 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:28.442918 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:28.447645 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:28.741911 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:29.738900 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:29.862806 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:30.153636 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:30.621994 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:30.872176 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:31.236107 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:32.078733 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:32.199433 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:33.208170 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:33.209173 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:33.401992 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:33.402739 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:36:33.935590 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:34.258907 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:36:34.726692 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:36:35.388673 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:35.389619 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 3.0 month(s)" |
| 2024-12-24T00:36:35.849238 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:36.082478 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:36.269821 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:36.603878 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:36.607094 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:36.782151 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:37.487189 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:37.488815 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:38.305138 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:38.305903 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:36:38.512869 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:38.725410 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:39.216347 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:39.217356 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 4.0 month(s)" |
| 2024-12-24T00:36:39.218204 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:39.726582 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:40.215736 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:36:40.216695 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:36:40.537819 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:40.872234 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:40.872981 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:41.271905 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0063(COD)&l=en |
| 2024-12-24T00:36:41.395102 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:41.925972 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:41.931381 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:42.222039 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:42.676507 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:43.342120 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:43.990557 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:44.130878 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:44.353785 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
| 2024-12-24T00:36:44.354311 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0212(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-24T00:36:44.355825 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-24T00:36:44.599552 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:44.959739 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:46.132536 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:46.391675 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0060(COD)&l=en |
| 2024-12-24T00:36:46.396963 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:46.838239 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:48.145355 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:48.149086 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:49.160590 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:49.857587 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the legal basis', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-24T00:36:49.858084 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0273(NLE)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-24T00:36:49.858887 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-24T00:36:50.087655 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:50.481602 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:50.482528 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:50.712423 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:50.713517 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:36:50.718727 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-24T00:36:50.719115 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2013/0186(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-24T00:36:50.720099 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-24T00:36:51.485228 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:51.486978 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-24T00:36:51.964725 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2840(RSP)&l=en |
| 2024-12-24T00:36:52.231859 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:36:52.776469 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:36:52.777134 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)" |
| 2024-12-24T00:36:53.209552 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:53.210219 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
| 2024-12-24T00:36:53.514078 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:54.237632 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:54.422052 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:36:54.424239 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:55.203483 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:55.511213 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:56.395710 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:56.722720 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/2047(INI)&l=en |
| 2024-12-24T00:36:56.834555 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:56.838305 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:56.840165 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:57.225613 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:58.808568 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:58.920961 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:59.078139 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:36:59.083444 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:00.450339 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:37:00.956978 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:01.174474 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:01.175121 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-24T00:37:01.312351 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:01.437809 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:37:02.284715 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:02.456062 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:02.456831 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:37:02.597537 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:02.771081 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:37:03.516837 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:03.877744 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:37:04.100544 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2012/0164(APP)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1256257')) |
| 2024-12-24T00:37:04.103745 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1256257
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 84, in scrape
docs = scrape_docs(root, edocs)
^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 614, in scrape_docs
doc['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1256257 |
| 2024-12-24T00:37:04.946821 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:05.095846 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:05.337061 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:37:05.851364 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:05.852175 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-24T00:37:06.971521 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:06.973299 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:06.975320 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:06.977120 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:06.977877 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-24T00:37:06.979598 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:37:07.083019 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:07.649428 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:07.654141 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:37:08.104160 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:37:09.207494 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:37:09.326029 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:37:09.329389 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:09.443704 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:09.446075 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:09.451033 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-24T00:37:09.783609 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:10.493838 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:10.495188 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:10.497708 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:37:11.667274 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:11.669033 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:11.670208 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:11.852709 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:11.856432 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:11.865864 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:20.559255 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:20.561474 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:20.563186 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:20.564837 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:37:20.567530 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:20.569246 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:20.571259 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:20.573227 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:20.575515 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:37:20.580382 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:22.807406 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:22.973187 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:37:22.974726 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:22.976685 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:23.198044 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:23.202838 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:37:23.203874 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:37:23.209385 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:25.422852 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:25.424532 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:25.534179 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:37:25.753596 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:25.988080 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:26.350348 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:37:26.430110 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:27.677700 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:27.792474 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:27.964544 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:37:27.966344 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 3.0 month(s)" |
| 2024-12-24T00:37:27.967297 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:28.398265 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:28.778820 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:29.211532 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:29.212230 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:37:29.428182 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:29.694547 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:37:29.931718 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:30.092324 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:30.092958 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:37:30.234543 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:30.480960 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:30.481574 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:37:30.732945 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:37:30.822950 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:32.081198 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:32.115425 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:32.498064 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:32.718198 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:32.934776 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:32.935532 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:37:33.290882 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:33.293036 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:34.239786 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:34.416337 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:35.260400 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:35.380384 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:35.625086 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:35.627386 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:35.685330 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:35.932532 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:36.356055 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:37.309810 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:37.359369 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:37.918454 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:37.919328 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:37:37.923500 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:37.925388 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:37:38.024877 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:38.025745 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:37:38.085104 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:38.347971 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:38.348949 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:37:38.867008 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:38.867703 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:37:39.444677 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:39.892270 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:39.893107 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:37:40.376110 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:40.377510 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:40.378644 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:37:40.488117 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:40.489148 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:40.752840 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:41.465729 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:41.947746 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:37:42.018430 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:42.653149 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:42.756437 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:37:42.922964 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:42.923543 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:37:43.087634 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:43.088278 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:37:43.132355 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:43.897510 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:44.254898 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:44.527931 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:45.005737 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:45.143693 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:45.361231 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:45.366363 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:45.990672 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:46.628440 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:46.996510 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:47.161715 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:47.551714 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:47.754500 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:48.112532 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:48.113736 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-24T00:37:48.116511 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:37:48.331861 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:49.482001 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:49.839552 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:50.119380 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:50.121637 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:50.123859 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:37:50.431690 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:50.740251 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:37:50.854587 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:52.002423 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:52.065689 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:52.540667 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:52.767608 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:53.054984 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:53.055596 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:37:53.168836 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:37:53.347972 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:37:54.126255 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:54.126998 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:37:54.768738 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:54.769354 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:37:54.856336 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:55.124982 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:55.218132 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:55.537327 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:55.538054 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:37:56.104917 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:56.108538 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:57.362445 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:57.363600 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:37:57.867381 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:57.870250 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:37:57.871794 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:57.872707 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:37:58.105704 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:37:59.009283 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:37:59.009890 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:37:59.815957 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:00.042946 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:00.049459 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:38:00.594658 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:00.596947 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:01.122665 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:01.123601 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:38:01.193053 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:01.193908 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:38:01.341175 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:02.254481 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:38:02.545132 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:38:02.714206 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:02.715074 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-24T00:38:02.817699 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:03.370769 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:03.478419 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:03.804999 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:04.104706 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:05.300934 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:05.466378 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)" |
| 2024-12-24T00:38:05.478933 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:05.479905 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:38:05.685041 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:38:05.823846 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:06.021686 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:06.927401 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:08.170495 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:08.171678 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:08.308925 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:08.856875 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:08.969221 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:09.221403 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:10.192985 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:10.382778 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:10.594835 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:10.691929 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:10.797668 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:11.998133 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:11.998939 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:38:12.027980 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:12.074483 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:12.075297 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:38:12.361831 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:12.799652 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:12.806465 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:13.113618 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:13.278546 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:38:14.457349 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:14.458137 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:38:14.870864 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:14.944596 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:15.045147 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:15.154187 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:15.557237 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:15.599185 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:16.597318 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2015/0012(NLE)&l=en'} (ValueError()) |
| 2024-12-24T00:38:16.598520 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
| 2024-12-24T00:38:16.992478 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:17.330850 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:17.607252 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:17.697889 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:17.870902 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:19.043193 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:19.753788 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the legal basis', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-24T00:38:19.754178 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2004/0148(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-24T00:38:19.770422 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-24T00:38:19.797560 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:20.005026 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:20.005794 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:20.013818 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:20.344356 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2148(INI)&l=en |
| 2024-12-24T00:38:21.541642 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:21.981125 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:22.331380 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:22.432037 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:22.432820 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 3.0 month(s)" |
| 2024-12-24T00:38:22.596556 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:22.781889 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:22.788883 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:23.004044 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0057(COD)&l=en |
| 2024-12-24T00:38:24.103563 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:24.332644 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:24.528829 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:25.046834 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:25.213715 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:25.497579 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:25.784450 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:38:25.785202 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
| 2024-12-24T00:38:26.585403 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:26.792586 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:38:26.801124 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:28.036915 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:28.038501 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:28.617371 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:29.443321 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:29.728718 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:30.581808 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:30.688760 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:30.689576 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:30.996304 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:30.997075 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:38:31.761972 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:32.903354 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:32.981409 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:33.260060 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:38:35.113006 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:36.046366 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:37.111452 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:37.115518 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:37.117478 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:37.313460 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:38.433291 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:40.334472 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:40.335559 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:40.393084 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:40.618784 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:40.790707 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:40.878997 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:38:40.879847 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:38:41.318392 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:43.229978 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:43.514063 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:43.530588 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:43.794452 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:44.269459 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:44.616791 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:46.201504 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:46.202412 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:38:46.202994 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-24T00:38:46.625050 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:46.628277 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:46.840743 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:46.968797 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:47.232309 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:47.301067 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:47.301901 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:38:48.255812 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:49.301257 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:38:50.313331 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:38:51.088247 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2011/0815(NLE)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1173982')) |
| 2024-12-24T00:38:51.099824 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1173982
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1173982 |
| 2024-12-24T00:38:54.765845 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2009/0814(NLE)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1097092')) |
| 2024-12-24T00:38:54.767374 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1097092
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1097092 |
| 2024-12-24T00:38:56.297617 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the legal basis', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-24T00:38:56.297987 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2008/0090(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-24T00:38:56.298796 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-24T00:38:57.673837 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2008/0171(NLE)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1046121')) |
| 2024-12-24T00:38:57.675239 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1046121
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1046121 |
| 2024-12-24T00:39:00.090839 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:00.937561 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:01.474047 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:09.032118 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:09.033303 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:11.949273 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:12.223283 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:12.224703 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:12.227294 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:12.527601 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:13.579661 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:14.139332 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:15.540089 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:16.704577 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:16.864371 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:17.086280 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:17.304812 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:17.306695 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:18.285639 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:19.208060 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:19.331566 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2015/0270(COD)&l=en'} (ValueError()) |
| 2024-12-24T00:39:19.332677 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
| 2024-12-24T00:39:19.682701 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:20.126409 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:20.309979 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:20.446680 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:20.541399 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:21.168949 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:22.044641 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:22.659668 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:23.093229 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:23.093953 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)" |
| 2024-12-24T00:39:23.312045 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:23.372122 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:23.372737 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:39:23.535533 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:23.942372 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:23.943514 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
| 2024-12-24T00:39:24.945330 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:25.525563 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:26.160137 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:26.675958 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:27.032662 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:27.033283 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:27.491585 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:27.500079 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:28.163616 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:29.508444 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:29.828077 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:29.834477 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:29.903447 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:29.904311 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-24T00:39:30.553148 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:30.869344 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:31.525658 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:31.653460 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:32.708930 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:33.230902 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:33.338039 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:33.338589 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
| 2024-12-24T00:39:33.941226 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:34.367033 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:34.780713 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:39:34.781560 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
| 2024-12-24T00:39:34.782162 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:39:35.112799 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:35.115640 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:36.385815 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:37.059386 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:37.692284 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:37.998696 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:38.575530 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:38.579661 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:38.864721 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:39.344168 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:39.770747 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:39.849476 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:41.609694 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:41.613962 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:41.616639 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:39:42.020530 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2848(RSP)&l=en |
| 2024-12-24T00:39:42.247142 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:42.569294 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:43.320644 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:44.166981 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:45.538730 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:45.757895 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:45.920274 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2017/0035(COD)&l=en'} (ValueError()) |
| 2024-12-24T00:39:45.921463 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
| 2024-12-24T00:39:47.069347 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:47.209972 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:47.385655 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:47.787383 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:47.914238 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:48.574059 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:48.799714 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:49.027313 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:49.845694 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:50.162078 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:50.671057 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:50.911160 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:51.136816 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:51.317959 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:51.822505 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:51.823307 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:52.060639 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2018/2669(RSP)&l=en |
| 2024-12-24T00:39:52.577368 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:52.749038 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:52.952904 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:53.619905 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:53.769845 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:53.774597 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:54.143034 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:54.544555 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:54.940025 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:55.034952 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:55.715839 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:55.921338 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:39:57.148730 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:57.153051 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:58.083062 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:58.086819 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:58.312601 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:58.356899 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2014/2230(INI)&l=en |
| 2024-12-24T00:39:58.427550 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=1995/0057(NLE)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=60823')) |
| 2024-12-24T00:39:58.429165 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=60823
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=60823 |
| 2024-12-24T00:39:59.415601 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:39:59.893406 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:00.397001 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:00.604097 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:00.605035 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:40:00.700139 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:00.787805 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:01.263102 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:01.267070 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:02.317888 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:02.540977 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:02.548401 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:03.332923 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:03.724141 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:03.835061 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:04.734989 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:04.947922 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:05.013843 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:05.961888 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:06.088967 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:07.271525 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:07.272304 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:40:07.355614 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:07.527889 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:08.340189 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:08.442771 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:08.448887 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:40:09.560877 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:09.567536 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:09.633316 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2013/0072(COD)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1331574')) |
| 2024-12-24T00:40:09.634816 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1331574
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1331574 |
| 2024-12-24T00:40:09.820428 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:10.909468 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:11.047864 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:11.053914 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:11.378337 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:11.974435 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:12.136236 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:12.137321 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:12.670214 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:13.387263 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:13.535501 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:13.661253 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:13.944158 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:14.556413 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:14.558716 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:14.927289 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:15.313969 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:40:15.314708 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
| 2024-12-24T00:40:15.575806 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:16.229455 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:16.918989 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:17.058378 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:17.060618 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:17.902115 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:18.744317 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:18.745294 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:40:19.011784 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:19.013453 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:40:19.383860 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:19.654938 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:20.050456 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:20.705290 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:21.635960 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:22.025233 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:22.088518 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:22.281835 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:22.601853 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:23.117817 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:23.273398 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:24.200350 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:24.643152 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:24.644622 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:24.798895 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:24.978808 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:25.608122 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:25.891904 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:26.928555 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:27.155885 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:27.901502 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:27.904301 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:28.260020 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:28.497119 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:30.061346 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:30.348019 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:30.661046 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:31.154014 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:32.293805 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:32.583390 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:32.968570 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:33.048311 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:33.325952 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:34.347460 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:34.657680 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:35.275151 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:35.275931 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:40:35.468940 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:35.628569 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:36.119860 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:37.680119 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:38.597882 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:39.973041 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:39.973931 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-24T00:40:40.418334 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:40.592954 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:42.071594 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:42.296327 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:42.351726 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:44.060550 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:44.237675 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:44.607704 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:46.357267 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:46.964005 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:47.044362 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:47.201261 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:47.373371 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2015/2222(INI)&l=en |
| 2024-12-24T00:40:47.490596 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:40:47.791138 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2017/2024(INL)&l=en |
| 2024-12-24T00:40:48.036052 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0282(COD)&l=en |
| 2024-12-24T00:40:48.041059 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:48.042023 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:40:48.266488 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:48.560424 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:49.740876 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:49.843710 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:49.844422 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:40:50.582335 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:50.623480 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:50.624958 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:40:50.739255 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:50.740458 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:50.880052 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:52.201483 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:52.566780 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2016/0062(NLE)&l=en |
| 2024-12-24T00:40:52.772999 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:52.932850 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:53.187388 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:53.400507 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:40:53.403665 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:53.406194 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:54.727478 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:54.728205 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:40:55.354457 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:55.624909 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:57.962143 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:57.964725 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:40:59.028683 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:00.125606 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:00.479059 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:00.622784 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:00.736317 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:00.903780 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:00.904584 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:41:01.193341 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:01.391795 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:01.617521 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:02.446216 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:09.120803 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:09.122557 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:09.124719 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:09.126762 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:09.130725 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:09.134154 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:09.147637 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:41:09.154973 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:41:11.090848 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:11.384241 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:11.538294 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:11.634428 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:11.697088 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:11.810939 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:11.811803 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:13.068528 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:13.627402 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:13.628367 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:41:13.722113 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:14.029514 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:15.279192 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:15.591571 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:16.002867 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:16.250424 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:16.251311 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-24T00:41:17.552652 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:18.033107 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:18.284607 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:19.329787 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:20.950957 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:20.953100 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:41:20.954183 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:41:20.957906 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
| 2024-12-24T00:41:20.964734 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:41:21.403975 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0152(COD)&l=en |
| 2024-12-24T00:41:21.736102 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2016/0224(COD)&l=en |
| 2024-12-24T00:41:22.064211 | dossier | error | this url returns a hard 404: http://www.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2016/0400(COD)&l=en |
| 2024-12-24T00:41:24.506381 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0225(COD)&l=en |
| 2024-12-24T00:41:24.601205 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:25.840735 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:25.841482 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:41:26.733631 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:27.801553 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:28.023975 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:28.638242 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:28.828088 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:29.688818 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:30.040010 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-24T00:41:30.040386 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2018/0329(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-24T00:41:30.041441 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-24T00:41:34.999133 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:35.863492 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:36.341677 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:37.338602 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:37.579944 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:37.581050 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:37.738868 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:38.042321 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:38.330112 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/2688(RSO)&l=en |
| 2024-12-24T00:41:38.800020 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:38.983715 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:39.807496 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:39.808549 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:39.811105 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:41.104114 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:41.879473 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:41:42.777559 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:42.778311 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:41:43.834726 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:44.072405 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:45.067607 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:45.219884 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:45.813247 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:45.814364 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:46.355070 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:46.355859 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)" |
| 2024-12-24T00:41:46.417844 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:46.853999 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:47.306980 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:47.373191 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:47.603022 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:48.342651 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:48.458017 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:48.708703 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:49.199431 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:49.309005 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:49.985117 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:49.986254 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-24T00:41:50.240295 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:50.305316 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:51.048892 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:51.235978 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:51.374576 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:51.834487 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:52.264957 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:52.267963 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:52.944859 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:53.248715 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:53.394188 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:53.694873 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:53.696089 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:54.604678 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:54.898704 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:54.979064 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:55.078217 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:55.822581 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:55.824532 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:56.302424 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:56.412532 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:57.139707 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:57.140715 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
| 2024-12-24T00:41:57.196155 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:57.342247 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:58.012188 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:58.635590 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:58.643671 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:41:59.571379 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:41:59.652652 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:00.421634 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:01.552400 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:01.553395 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:02.183865 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:02.369848 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:02.648135 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:02.724769 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/0001(COD)&l=en |
| 2024-12-24T00:42:02.966629 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:03.164709 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:03.847947 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:04.919553 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:05.184112 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:05.336307 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:42:05.337185 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:05.658868 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/0005(NLE)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1581015')) |
| 2024-12-24T00:42:05.661208 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1581015
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1581015 |
| 2024-12-24T00:42:05.756158 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:06.443274 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:07.347324 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:07.565149 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:07.741337 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:07.749781 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:07.750565 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:07.751500 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)" |
| 2024-12-24T00:42:08.281472 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:08.282271 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:08.283103 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:42:08.284689 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-24T00:42:09.233141 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:09.605656 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:10.034823 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:10.035431 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:42:10.289600 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:10.743742 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:10.747994 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:10.749331 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:42:10.809742 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:42:10.810313 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
| 2024-12-24T00:42:10.810924 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:42:10.984515 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:11.929796 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:12.807607 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:13.179222 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:13.551054 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:13.556150 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:13.557154 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:13.559488 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:13.772703 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:14.857028 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:15.869107 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:15.984168 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:16.046881 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:16.225711 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:16.371338 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:16.374265 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:16.376654 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-24T00:42:16.547039 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:17.762480 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:18.287807 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:18.344402 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:18.475660 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:18.781999 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:19.077803 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:19.081967 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:19.085616 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:42:20.417057 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:20.560220 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:20.920395 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:21.533050 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the legal basis', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-24T00:42:21.533402 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2016/0400B(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-24T00:42:21.534202 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-24T00:42:22.705260 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:22.849249 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:42:22.849864 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:23.279830 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:23.280413 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:42:23.609373 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:24.592852 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:24.841921 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:25.270053 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:25.545066 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:25.626602 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:25.767881 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:26.659987 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:26.660606 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:42:26.775224 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:26.899825 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:27.272661 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:27.619560 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:27.620583 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:27.725086 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:28.619480 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:28.620337 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-24T00:42:29.080178 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:29.297202 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:29.443377 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:29.921096 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:29.983602 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:30.135364 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:30.205311 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:30.958606 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:31.550103 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:31.552793 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:31.959567 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:32.304376 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:42:32.596951 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:32.599653 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:33.101293 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:33.102008 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:42:33.401992 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:33.897502 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:33.899188 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:33.900148 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:42:34.547189 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:34.640629 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:34.992114 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:35.003322 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2110(INI)&l=en |
| 2024-12-24T00:42:35.281606 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:35.579783 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:42:35.739622 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:36.453369 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:36.521730 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:37.262134 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:37.264071 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:37.740671 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:42:37.742392 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:37.901893 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:38.001140 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:38.151566 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2019/2852(RSP)&l=en |
| 2024-12-24T00:42:38.856966 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:38.931619 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:39.279523 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2133(INI)&l=en |
| 2024-12-24T00:42:40.169531 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:40.271680 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:40.569815 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2858(RSP)&l=en |
| 2024-12-24T00:42:40.683910 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:40.687049 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:40.693858 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:42:41.100465 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:41.429951 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:41.430681 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:42:42.714378 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:43.125642 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:42:43.280381 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:43.288544 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:43.640564 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:43.641581 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:42:43.735781 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:44.343831 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:44.349997 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:45.300096 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:45.378771 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:45.500159 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:45.620827 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2203(INI)&l=en |
| 2024-12-24T00:42:45.732570 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2212(INI)&l=en |
| 2024-12-24T00:42:45.738326 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:45.808141 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:45.844078 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2211(INI)&l=en |
| 2024-12-24T00:42:46.654023 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:46.779703 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:46.780599 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:46.781533 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:42:46.782665 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-24T00:42:47.974134 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:48.137781 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:48.400515 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:48.498990 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:48.882592 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:49.160833 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:49.467434 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:49.468154 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:42:50.054169 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:50.055062 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:42:50.350636 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:50.358204 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:50.942654 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:51.545530 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:59.021391 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:59.023581 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:59.025583 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:59.027192 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:59.029277 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:59.031765 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:42:59.038780 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:42:59.315467 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2185(INI)&l=en |
| 2024-12-24T00:42:59.418220 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2165(INI)&l=en |
| 2024-12-24T00:42:59.486287 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2019/2163(INI)&l=en |
| 2024-12-24T00:43:01.246606 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:01.434834 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:01.711573 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:01.714369 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:01.716444 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:02.044604 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2519(RSP)&l=en |
| 2024-12-24T00:43:02.121404 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:03.916959 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:03.927354 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:04.269872 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2522(RSP)&l=en |
| 2024-12-24T00:43:04.418677 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:04.538089 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:04.821317 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:05.099690 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2501(RSP)&l=en |
| 2024-12-24T00:43:05.163367 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2570(RSP)&l=en |
| 2024-12-24T00:43:06.273028 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:06.607654 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2568(RSP)&l=en |
| 2024-12-24T00:43:06.971299 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:06.972588 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:06.991099 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2573(RSP)&l=en |
| 2024-12-24T00:43:07.097879 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:07.330271 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2572(RSP)&l=en |
| 2024-12-24T00:43:07.334745 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:07.426742 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:07.498556 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2540(RSP)&l=en |
| 2024-12-24T00:43:07.548508 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2569(RSP)&l=en |
| 2024-12-24T00:43:07.584585 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2574(RSP)&l=en |
| 2024-12-24T00:43:07.693519 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:07.715468 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2556(RSP)&l=en |
| 2024-12-24T00:43:07.769229 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2571(RSP)&l=en |
| 2024-12-24T00:43:07.933902 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2598(RSP)&l=en |
| 2024-12-24T00:43:08.060517 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2587(RSP)&l=en |
| 2024-12-24T00:43:08.273484 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2592(RSP)&l=en |
| 2024-12-24T00:43:08.389224 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2595(RSP)&l=en |
| 2024-12-24T00:43:08.580399 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2593(RSP)&l=en |
| 2024-12-24T00:43:08.721272 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2601(RSP)&l=en |
| 2024-12-24T00:43:08.920048 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2600(RSP)&l=en |
| 2024-12-24T00:43:09.089949 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2599(RSP)&l=en |
| 2024-12-24T00:43:09.268082 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2602(RSP)&l=en |
| 2024-12-24T00:43:09.666968 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2591(RSP)&l=en |
| 2024-12-24T00:43:09.992415 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2597(RSP)&l=en |
| 2024-12-24T00:43:10.069075 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:10.256090 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:10.330415 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:12.203010 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:12.413586 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:12.682524 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:12.904852 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:12.998206 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:14.278831 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:14.282576 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:14.687389 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:14.868282 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:15.149683 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:15.242220 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:15.415780 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:15.899268 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:16.551447 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:16.662594 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:16.663318 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:43:16.946139 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2072(INL)&l=en |
| 2024-12-24T00:43:17.252492 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:43:17.495169 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:17.587148 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:17.889621 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:18.068677 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:18.741049 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:19.122081 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:19.259115 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:19.376133 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:20.103692 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:20.208343 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:20.209522 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:21.205388 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:21.603665 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:21.922329 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:22.185527 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2710(RSP)&l=en |
| 2024-12-24T00:43:22.346383 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:22.469012 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2703(RSP)&l=en |
| 2024-12-24T00:43:23.014435 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:23.015272 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:43:23.405101 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:23.696058 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:24.242304 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:24.306637 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:24.813591 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:25.068614 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:25.255307 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:25.257734 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:25.881336 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:27.002893 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:27.081560 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:27.184565 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:27.185521 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:43:27.834564 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:28.514445 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:29.579220 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:29.926674 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:30.041783 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:30.044683 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:30.159587 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:31.071413 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:31.671222 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:32.018961 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:32.019778 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:43:32.794535 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:32.797436 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:32.805395 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:32.808611 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:32.811132 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:34.883924 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:35.119393 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:35.120582 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:35.203200 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:35.503052 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2200(IMM)&l=en |
| 2024-12-24T00:43:35.722854 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2799(RSP)&l=en |
| 2024-12-24T00:43:35.727785 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:35.932697 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2798(RSP)&l=en |
| 2024-12-24T00:43:36.507854 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:37.293642 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:37.424411 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:38.323542 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:38.782036 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:39.591296 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:39.592111 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:43:39.782130 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:39.934122 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:40.297377 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:40.563568 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:40.848501 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:41.036338 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:41.165666 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:42.066233 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:42.286639 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:42.444030 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:42.651984 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:42.657055 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:43.492406 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:43.639932 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:44.010937 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:44.287692 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:44.799044 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:44.896567 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:45.054723 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2020/2897(RSP)&l=en |
| 2024-12-24T00:43:45.059569 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:45.569787 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:45.570467 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:43:46.045660 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:43:46.509611 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:46.752323 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:47.044157 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:47.433289 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:47.826648 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:47.828902 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:48.348305 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:48.348934 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:43:48.523638 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:49.267028 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:49.414322 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:49.625511 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:49.987365 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:49.993790 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:50.286714 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:50.751087 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:51.089493 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:51.598727 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:51.756066 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:51.816787 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:52.164874 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:52.501549 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:53.124375 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:53.336491 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:53.540817 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:53.863078 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:53.864342 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:54.409831 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:54.416206 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:54.584321 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:55.756643 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:55.938109 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:56.220976 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:56.634787 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:56.888589 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:56.971349 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:57.981826 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:58.056700 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:43:58.784068 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:58.786912 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:59.063565 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:43:59.167327 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:00.009347 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:00.390955 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:00.919301 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:01.100577 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:01.287490 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:01.382178 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:01.837568 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:03.142852 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:03.273907 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:03.618266 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:03.724081 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:03.753424 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-24T00:44:03.754569 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/0060(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-24T00:44:03.757230 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-24T00:44:04.073565 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:05.274303 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:05.500686 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:06.227140 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:06.482659 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:06.889181 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:06.889968 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:44:07.482296 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:07.584951 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:08.414879 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:08.498174 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:09.251039 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:09.252259 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:09.253960 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:09.255595 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:09.719207 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:09.925670 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:10.618057 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:11.169918 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:11.816575 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:11.977412 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:11.980971 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:11.984025 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:12.086554 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:12.792458 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:13.027169 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:13.511627 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:14.313514 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:14.317005 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:14.409069 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:14.495188 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:14.719807 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:15.282997 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:15.590147 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:15.888889 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:15.950897 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2061(INI)&l=en |
| 2024-12-24T00:44:16.256510 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2047(INI)&l=en |
| 2024-12-24T00:44:16.404166 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:16.697626 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:16.698381 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:17.238626 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:17.809998 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:17.810728 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:44:18.623045 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:18.630473 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:18.831519 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:19.191108 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:19.192102 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:19.442671 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:19.636080 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2730(RSP)&l=en |
| 2024-12-24T00:44:20.338868 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:20.934654 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:21.019570 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:21.406622 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:21.798425 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:21.972233 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:22.873781 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:22.918611 | dossier | warning | no body mapping found for "Initial period for examining delegated act 4.0 month(s)" |
| 2024-12-24T00:44:22.919686 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-24T00:44:23.418633 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:23.532744 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:23.802731 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:23.803541 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:44:24.116634 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:24.122834 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:24.998444 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:25.171145 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:25.337811 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:26.280787 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:26.432459 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:26.509465 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:26.525566 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:27.404175 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:27.837905 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:27.891962 | dossier | warning | no body mapping found for "Initial period for examining delegated act 4.0 month(s)" |
| 2024-12-24T00:44:28.583504 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:28.742577 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:30.841781 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:31.208406 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2157(DEC)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1668966')) |
| 2024-12-24T00:44:31.210003 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1668966
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1668966 |
| 2024-12-24T00:44:31.625059 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:32.431903 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:32.671514 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:32.959686 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:33.601799 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:33.708899 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:33.933718 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/0211(COD)&l=en |
| 2024-12-24T00:44:34.035851 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:34.154941 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:34.155744 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:34.724186 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:35.056236 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:35.243330 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:36.385406 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:36.592930 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:37.092672 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:37.094602 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:37.276965 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:38.240907 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-24T00:44:38.241262 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/0213(CNS)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-24T00:44:38.242040 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-24T00:44:38.442702 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:38.531290 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:38.678591 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:39.309322 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:39.465232 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:39.914259 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:40.530879 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:40.728634 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:40.730242 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:41.078200 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:41.158726 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:41.570553 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:41.738871 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:41.739609 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:44:42.279359 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:42.752087 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:43.039686 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:43.241356 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:43.244175 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:43.311725 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:43.845061 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:43.845906 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-24T00:44:45.276386 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:45.278225 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:45.483483 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:45.693357 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2175(IMM)&l=en |
| 2024-12-24T00:44:45.805153 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:45.884380 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:46.515944 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:47.611202 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:47.800139 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:47.949864 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:48.456957 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:56.095893 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:44:56.105632 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:56.113472 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:44:56.120687 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:44:56.125597 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:44:56.135080 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:44:58.322977 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:58.465545 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:58.823274 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:58.824037 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:44:59.028512 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:59.334594 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:59.335395 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:44:59.644677 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:44:59.753223 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:00.795967 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:00.940712 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:00.991185 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:01.289922 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:01.906486 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:02.492342 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:02.623185 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:02.704550 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:03.831569 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:03.833748 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:45:03.838822 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:04.003136 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:04.594956 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:05.334334 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:05.340876 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:05.484547 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:06.379592 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:06.581051 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:07.032486 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:07.823154 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:07.951371 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:07.952891 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:45:07.955348 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:08.217922 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:08.221993 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:08.455721 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2939(RSP)&l=en |
| 2024-12-24T00:45:08.583050 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2998(RSP)&l=en |
| 2024-12-24T00:45:09.579731 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:09.581876 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:45:09.586362 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:09.845342 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:09.883480 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2198(INI)&l=en |
| 2024-12-24T00:45:10.143346 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2213(INI)&l=en |
| 2024-12-24T00:45:10.407033 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:10.813914 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
| 2024-12-24T00:45:10.814279 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/0387(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-24T00:45:10.815083 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-24T00:45:12.473516 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:12.475452 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:12.780738 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-24T00:45:12.781218 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/0375(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-24T00:45:12.782057 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-24T00:45:13.093847 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/3011(RSP)&l=en |
| 2024-12-24T00:45:13.149067 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:13.851203 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:15.431231 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:15.594096 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:15.855883 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:15.934391 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:16.376625 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:16.377434 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:17.287312 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:17.740366 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:17.868947 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:18.309694 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:18.373931 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:18.751022 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:18.856682 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:19.132467 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:19.377694 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:19.936925 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:20.228295 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil//popups/ficheprocedure.do?reference=2020/2259(INI)&l=en |
| 2024-12-24T00:45:20.233004 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:20.676909 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:21.007804 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:21.256362 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:21.436156 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:21.851437 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:23.116061 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:23.280740 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:23.934820 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:23.936146 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:24.166129 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:24.515178 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:25.068254 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:25.547393 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:25.722633 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:26.238841 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:26.512925 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:26.855675 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:26.856549 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:45:26.927740 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:27.764849 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:27.869818 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:28.066320 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2021/2238(INI)&l=en |
| 2024-12-24T00:45:28.259261 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:28.391032 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:28.856320 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:45:29.198547 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:29.294227 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:29.584959 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:30.374546 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:30.715160 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:30.914407 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:31.510829 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2506(RSP)&l=en |
| 2024-12-24T00:45:33.089087 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:45:33.274951 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:34.111410 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:35.292890 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:35.295474 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:35.296382 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:35.995844 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:36.146868 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:36.212206 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:37.810006 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:37.987669 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:37.990145 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:37.993925 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:38.225411 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2554(RSP)&l=en |
| 2024-12-24T00:45:38.590302 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:38.591710 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:45:38.593476 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:39.293898 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:39.920366 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:40.543394 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:40.550960 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:40.648493 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:40.833254 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:40.834078 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:41.909256 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:42.637164 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:43.247568 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:43.253849 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:43.314673 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:43.315899 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:43.322406 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:43.900132 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:45.284508 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:45.593610 | dossier | warning | no body mapping found for "Initial period for examining delegated act 4.0 month(s)" |
| 2024-12-24T00:45:45.867962 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:46.144374 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:46.146019 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:46.147244 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:47.945344 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:48.668250 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:48.669459 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:48.671973 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:48.679935 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:48.694998 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:48.695986 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:45:48.944498 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:49.573876 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:50.673327 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:51.295320 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:51.301211 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:51.303776 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:51.306294 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:51.962325 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:52.180145 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:53.551650 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:53.555651 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:53.733667 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:53.918578 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:53.921134 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:54.468861 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:54.647581 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:55.540859 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:55.780290 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:56.649290 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
| 2024-12-24T00:45:56.650407 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/0125(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-24T00:45:56.652620 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-24T00:45:56.654379 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:56.657536 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:56.660101 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:57.128421 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:57.129217 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:45:57.751789 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:45:58.859106 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:58.957522 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:59.219194 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:59.221789 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:45:59.852849 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:00.023931 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:01.236853 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:01.350595 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:01.573494 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:02.009760 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:02.203100 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:02.315248 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:02.316088 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:46:03.820027 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:03.821055 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:04.012145 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:04.337946 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:04.338972 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:04.340278 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:46:04.579211 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:04.895571 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:06.026159 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:06.339453 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:06.419242 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:06.488880 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:06.743639 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:06.990320 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:07.074964 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:07.155071 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:08.214498 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:08.349728 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:08.696933 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:09.046358 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:09.246453 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:09.249976 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:09.308708 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:09.668253 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:10.672379 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:11.156966 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:11.157677 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:46:11.389895 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:11.465401 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:11.545397 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:11.979688 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:12.041324 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:13.493734 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:13.955820 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:14.076681 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:14.346304 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:14.667294 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:14.791530 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:14.796359 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:15.784651 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:16.448541 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:16.449371 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:16.993207 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:16.994294 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:17.473836 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:18.022418 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:18.778206 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:18.847105 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:18.919988 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:19.138919 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:19.747506 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:20.276961 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:21.075159 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:21.238461 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:21.239311 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:46:21.423090 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:21.559576 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:21.948362 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2863(RSP)&l=en |
| 2024-12-24T00:46:22.419973 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:22.819599 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:23.693866 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:23.697034 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:24.156317 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:24.402186 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:24.813037 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:24.943905 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:25.896160 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:26.156679 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:26.681139 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:26.681869 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)" |
| 2024-12-24T00:46:27.039683 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:27.094297 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:27.907926 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:27.908630 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:46:28.402352 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:28.693742 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:29.157420 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:29.399565 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:29.839933 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:30.184539 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:30.362283 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:30.512662 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:30.904280 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:32.660455 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:32.662352 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:33.006858 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:33.160686 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:33.168154 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:34.728263 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:34.862650 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:35.481427 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:35.492582 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:35.676856 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:36.496898 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:37.127790 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:37.230563 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:37.650609 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:44.582971 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:44.586167 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:44.588530 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:44.590810 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:44.593461 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:44.595471 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:44.598271 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:44.604744 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:47.014259 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:47.016808 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:47.421508 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:46:47.424561 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:47.429913 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:47.714588 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:46:48.291204 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/3010(RSP)&l=en |
| 2024-12-24T00:46:48.573890 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2209(IMM)&l=en |
| 2024-12-24T00:46:49.254495 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:49.938340 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/0391(COD)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764360')) |
| 2024-12-24T00:46:49.940211 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764360
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764360 |
| 2024-12-24T00:46:50.680592 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:51.444038 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/0394(COD)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764287')) |
| 2024-12-24T00:46:51.449937 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764287
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764287 |
| 2024-12-24T00:46:51.455192 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:53.039115 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:54.263408 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:54.264297 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:54.541890 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:46:54.542537 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 1.0 month(s)" |
| 2024-12-24T00:46:54.607383 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2203(INI)&l=en |
| 2024-12-24T00:46:54.727566 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/0396(COD)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764419')) |
| 2024-12-24T00:46:54.729623 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764419
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1764419 |
| 2024-12-24T00:46:54.844091 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2008(IMM)&l=en |
| 2024-12-24T00:46:56.061164 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:56.442517 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:57.000460 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:57.172571 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:57.278218 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:58.349707 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:58.677589 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:46:58.826139 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:59.420098 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:59.421714 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:59.810227 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:46:59.811009 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:47:00.605537 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:47:00.610644 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:00.948811 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:01.405389 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:47:01.702834 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:01.734511 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2567(RSP)&l=en |
| 2024-12-24T00:47:01.965652 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:02.290877 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:04.015623 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:04.016463 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:47:04.272177 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:04.283343 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:47:04.287344 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:04.314363 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:04.504295 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:04.743132 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:04.748936 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:05.006783 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2592(RSP)&l=en |
| 2024-12-24T00:47:05.081604 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2597(RSP)&l=en |
| 2024-12-24T00:47:06.765891 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:06.840360 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:47:07.062345 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2614(RSP)&l=en |
| 2024-12-24T00:47:07.150544 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0077(COD)&l=en |
| 2024-12-24T00:47:07.155460 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:47:07.468538 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:47:09.172801 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:10.185511 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
| 2024-12-24T00:47:10.186379 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0059(NLE)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-24T00:47:10.188242 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-24T00:47:10.190610 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:10.506634 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:10.928011 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0053(COD)&l=en'} (HTTPError('404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1771293')) |
| 2024-12-24T00:47:10.929413 | mgr | error | Traceback (most recent call last): |
File "scrapers/dossier.py", line 740, in fetchSummary
tmp=fetch(url)
^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 264, in fetch
xml = fetch_raw(url, retries, ignore, params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1771293
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 82, in scrape
events, edocs = scrape_events(root)
^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 491, in scrape_events
event['summary']=fetchSummary(url)
^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 742, in fetchSummary
tmp=fetch_raw(url)
^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/utils.py", line 258, in fetch_raw
r.raise_for_status()
File "/home/pt/pt2/env3/lib/python3.12/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: for url: https://oeil.secure.europarl.europa.eu/oeil/en/document-summary?id=1771293 |
| 2024-12-24T00:47:11.278663 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2039(IMM)&l=en |
| 2024-12-24T00:47:11.308078 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2649(RSP)&l=en |
| 2024-12-24T00:47:11.783174 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
| 2024-12-24T00:47:11.783549 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0085(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-24T00:47:11.784399 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-24T00:47:12.357990 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:12.842113 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:13.366004 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:13.837806 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:47:15.094442 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:47:15.437253 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:47:17.551279 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:18.156050 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:19.121551 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:20.371405 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:47:20.610016 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:20.610852 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:47:23.141834 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:47:25.610617 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-24T00:47:25.611099 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0130(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-24T00:47:25.612282 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-24T00:47:26.087021 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-24T00:47:26.087421 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0128(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-24T00:47:26.088282 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-24T00:47:26.214816 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:27.971538 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:28.389737 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:28.861834 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:47:28.863943 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:28.865091 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:47:29.720508 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:47:30.284813 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:31.866216 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:32.266314 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:33.289453 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:34.015210 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:35.539888 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:36.263643 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:47:36.451276 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:36.747501 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:38.250749 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:38.886341 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:39.184421 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:39.757738 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:39.760259 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:40.338466 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:40.511844 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:41.333216 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:41.444082 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:43.502240 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:46.043864 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:46.225130 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:46.372711 | dossier | warning | no body mapping found for "Initial period for examining delegated act 4.0 month(s)" |
| 2024-12-24T00:47:46.926171 | dossier | warning | no body mapping found for "Initial period for examining delegated act 4.0 month(s)" |
| 2024-12-24T00:47:47.779057 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:52.667224 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:53.756987 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0259(NLE)&l=en'} (ValueError()) |
| 2024-12-24T00:47:53.758202 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
| 2024-12-24T00:47:53.994211 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2104(INL)&l=en |
| 2024-12-24T00:47:54.048335 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:47:54.338683 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2125(INI)&l=en |
| 2024-12-24T00:47:54.789126 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:55.165701 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:47:56.144517 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:56.297862 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:56.298684 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:47:56.647694 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:57.460341 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:47:57.698526 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:48:06.319686 | dossier | warning | no body mapping found for "Matter referred back to the committee responsible for reconsideration" |
| 2024-12-24T00:48:06.355184 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-24T00:48:06.355827 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/0134(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-24T00:48:06.357625 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-24T00:48:06.820464 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2022/2710(RSP)&l=en |
| 2024-12-24T00:48:09.388741 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:48:10.015045 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:10.158934 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:10.161148 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:48:10.787215 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:11.479103 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:48:11.925043 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:11.934163 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:12.505728 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:12.660519 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:12.751568 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:12.984254 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:13.739841 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:14.071450 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:14.334030 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:14.809530 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:14.813453 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:48:15.018372 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:16.030369 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:16.212143 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:16.364139 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:16.591667 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:17.294316 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:17.395815 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:48:17.493862 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:18.801428 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:18.811966 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:18.813367 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:18.814503 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:19.228435 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2191(IMM)&l=en |
| 2024-12-24T00:48:20.207212 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:20.921283 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:21.372795 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:21.723698 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:22.271839 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:23.208723 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:24.381220 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:24.768027 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:25.564632 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:25.887086 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:48:25.984998 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2200(IMM)&l=en |
| 2024-12-24T00:48:26.198838 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2199(IMM)&l=en |
| 2024-12-24T00:48:26.271066 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:48:27.028516 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:27.611960 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:28.408349 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:28.815446 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:29.522546 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:48:29.896691 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2927(RSP)&l=en |
| 2024-12-24T00:48:29.902271 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:30.053518 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:30.061541 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:31.059775 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:31.344125 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:32.328076 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:48:32.781021 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:33.760079 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:33.839499 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:48:33.961939 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:48:34.244627 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:34.641355 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:35.717786 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:36.124171 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:36.944378 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:48:37.087343 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:37.262543 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:38.260005 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:39.029937 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:39.651913 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:48:40.513877 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:48:41.100382 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/2989(RSP)&l=en |
| 2024-12-24T00:48:41.348447 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:41.475351 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:41.840982 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:48:42.547933 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:43.073671 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:48:43.406615 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:44.303421 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:44.397295 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:47.560018 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:48:47.561235 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:48:47.946792 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:48:48.458037 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:48:50.590559 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:51.157473 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:51.211541 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:51.530042 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:48:52.187924 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:49:00.200076 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:00.201539 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:00.476626 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:00.551365 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
| 2024-12-24T00:49:00.551713 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2023/0448(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-24T00:49:00.552716 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-24T00:49:01.791088 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:03.733975 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:04.080906 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:04.903400 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:06.222945 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:06.445504 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:07.408252 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:07.409016 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:49:08.231023 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:08.232123 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:08.506557 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:09.843347 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:10.300087 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:11.698949 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:12.064250 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:12.363640 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:12.754223 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:13.765235 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:16.023582 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:16.467105 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:20.296166 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:20.569701 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:20.844200 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:21.233963 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:21.504265 | dossier | error | unknown committee header in EP key players ['Former committee for opinion on the recast technique', 'Former rapporteur for opinion', 'Appointed'] |
| 2024-12-24T00:49:21.504585 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0035(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-24T00:49:21.505443 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-24T00:49:21.691589 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:22.233633 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
| 2024-12-24T00:49:22.234030 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0038(NLE)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-24T00:49:22.234725 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-24T00:49:22.435776 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:25.199099 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:25.200082 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:25.209989 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:25.653390 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:26.108278 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:26.387553 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:27.103687 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:27.370088 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:29.608327 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:29.765383 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:30.160614 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:30.214438 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:30.378797 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:31.379049 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:31.379878 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:31.486786 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:32.939807 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:32.940887 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:33.256063 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:33.535998 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:33.915085 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2593(RSP)&l=en |
| 2024-12-24T00:49:34.914899 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:35.437474 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2622(RSP)&l=en |
| 2024-12-24T00:49:36.251040 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
| 2024-12-24T00:49:36.251492 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0060(COD)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
| 2024-12-24T00:49:36.252425 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
| 2024-12-24T00:49:36.558573 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:37.006737 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
| 2024-12-24T00:49:37.007210 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0059(COD)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
| 2024-12-24T00:49:37.008166 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
| 2024-12-24T00:49:38.268062 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:38.419920 | dossier | error | unknown committee header in EP key players ['Former joint committee responsible', 'Former rapporteur', 'Appointed'] |
| 2024-12-24T00:49:38.420347 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0061(COD)&l=en'} (ValueError('bad html in EP key players, committee header')) |
| 2024-12-24T00:49:38.421155 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 194, in scrape_ep_key_players
raise ValueError("bad html in EP key players, committee header")
ValueError: bad html in EP key players, committee header |
| 2024-12-24T00:49:38.710339 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:39.961690 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:39.963534 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:39.965541 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:39.967433 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:39.970174 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:41.419896 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:41.502424 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:41.992954 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:42.901393 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:43.070094 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:43.174469 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:43.177870 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:43.335880 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:44.760960 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:45.097990 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:45.381585 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:46.200541 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:46.402141 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:46.505340 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:46.507389 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:47.028671 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:48.402924 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:49.184100 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:49.189960 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:49.580277 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:49.847632 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:50.255561 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:50.926347 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:51.286840 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:52.002734 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:49:52.232430 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:52.666412 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2010(IMM)&l=en |
| 2024-12-24T00:49:52.673154 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:53.486736 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:53.557471 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:53.809567 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:54.260171 | dossier | warning | no body mapping found for "Initial period for examining delegated act 1.0 month(s)" |
| 2024-12-24T00:49:54.261125 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 1.0 month(s)" |
| 2024-12-24T00:49:55.207480 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:49:58.098375 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2711(DEA)&l=en |
| 2024-12-24T00:49:58.346908 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
| 2024-12-24T00:49:58.347475 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0101(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
| 2024-12-24T00:49:58.348829 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
| 2024-12-24T00:49:59.309500 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:01.434259 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
| 2024-12-24T00:50:01.435170 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0155(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
| 2024-12-24T00:50:01.436730 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
| 2024-12-24T00:50:04.832879 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:06.767631 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:06.768682 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:50:06.769578 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:07.151763 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:07.788437 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:13.740493 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:13.754010 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:13.759024 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:13.761890 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:13.763369 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:13.764707 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:13.769156 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:50:16.290230 | dossier | warning | no body mapping found for "Initial period for examining delegated act 4.0 month(s)" |
| 2024-12-24T00:50:16.360814 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:16.553539 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:16.554583 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:50:16.735290 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:50:16.801256 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:17.421863 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:18.620802 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:18.621411 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:50:19.494326 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:50:23.967833 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:24.683438 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:26.140124 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:26.140859 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:50:26.480604 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:50:26.486309 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:26.970627 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
| 2024-12-24T00:50:26.971381 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0178(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
| 2024-12-24T00:50:26.973104 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
| 2024-12-24T00:50:27.102116 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:50:27.102827 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:50:27.998415 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:50:29.557959 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:29.717694 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:50:30.118508 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:30.120459 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:30.122761 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:50:30.466786 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:30.467545 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Parliament's request by 2.0 month(s)" |
| 2024-12-24T00:50:31.040216 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:50:31.043355 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:32.563969 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:32.983005 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:33.063014 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:33.204159 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:33.204960 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 2.0 month(s)" |
| 2024-12-24T00:50:33.262001 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:33.340538 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:34.115713 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:50:34.400907 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:50:34.401697 | dossier | warning | no body mapping found for "Initial period for examining delegated act extended at Council's request by 3.0 month(s)" |
| 2024-12-24T00:50:35.747239 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:50:35.749570 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:35.873926 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:50:36.208239 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:36.301411 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:37.839274 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:50:39.216336 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:39.638628 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:39.640993 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:50:39.658109 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:41.005157 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:41.903432 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:42.778268 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:42.780807 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:50:42.950312 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:44.399008 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:44.515858 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:50:45.470912 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:50:46.349528 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:46.455433 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:50:47.712285 | dossier | error | this url returns a hard 404: https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2783(RSP)&l=en |
| 2024-12-24T00:50:48.799103 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:50:49.506188 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:49.953253 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:50.012357 | dossier | warning | no body mapping found for "Urgent procedure requested by a committee" |
| 2024-12-24T00:50:50.302466 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
| 2024-12-24T00:50:50.302902 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0245(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
| 2024-12-24T00:50:50.303673 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
| 2024-12-24T00:50:52.154935 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:50:53.120428 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:54.463284 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2053(INI)&l=en'} (ValueError()) |
| 2024-12-24T00:50:54.464225 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
| 2024-12-24T00:50:56.475759 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2057(INI)&l=en'} (ValueError()) |
| 2024-12-24T00:50:56.476729 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
| 2024-12-24T00:50:58.363569 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/2056(INI)&l=en'} (ValueError()) |
| 2024-12-24T00:50:58.364572 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
| 2024-12-24T00:50:59.172583 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:50:59.986802 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:51:00.381099 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:51:01.184741 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:51:01.581137 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:51:04.060893 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:51:04.264413 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:51:04.664195 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:51:04.727074 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:51:05.171967 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0267(NLE)&l=en'} (IndexError('list index out of range')) |
| 2024-12-24T00:51:05.173144 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 265, in scrape_ep_key_players
tmp = junws(cells[2])
~~~~~^^^
IndexError: list index out of range |
| 2024-12-24T00:51:08.190500 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
| 2024-12-24T00:51:08.190930 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0263(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
| 2024-12-24T00:51:08.191743 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
| 2024-12-24T00:51:08.307444 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:51:08.654225 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:51:08.882686 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:51:08.987416 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:51:08.988881 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:51:09.423817 | dossier | warning | no body mapping found for "Urgent procedure requested by a committee" |
| 2024-12-24T00:51:09.791279 | dossier | warning | no body mapping found for "Urgent procedure requested by a committee" |
| 2024-12-24T00:51:10.022829 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0275(COD)&l=en'} (ValueError()) |
| 2024-12-24T00:51:10.023929 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 101, in scrape
return process(
^^^^^^^^
File "/home/pt/pt2/utils/process.py", line 51, in process
o2 = patch(prev or {}, json.loads(jdump(d)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/pt/pt2/utils/objchanges.py", line 230, in patch
raise ValueError()
ValueError |
| 2024-12-24T00:51:12.069184 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:51:12.073564 | dossier | warning | no body mapping found for "Initial period for examining delegated act 2.0 month(s)" |
| 2024-12-24T00:51:12.314314 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
| 2024-12-24T00:51:12.315045 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0260(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
| 2024-12-24T00:51:12.316461 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
| 2024-12-24T00:51:12.318592 | dossier | warning | no body mapping found for "Initial period for examining delegated act 3.0 month(s)" |
| 2024-12-24T00:51:12.994390 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
| 2024-12-24T00:51:12.994766 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0159M(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
| 2024-12-24T00:51:12.995578 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
| 2024-12-24T00:51:13.274043 | dossier | error | unknown linkless committee in EP key players: "Pending final decision on the referral" -> u"final decision on the referral": u"Pending" |
| 2024-12-24T00:51:13.274726 | mgr | error | failed to execute dossier job {'onfinished': {'daisy': True}, 'url': 'https://oeil.secure.europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2024/0253(NLE)&l=en'} (ValueError('bad html in key players EP section, linkless committee name')) |
| 2024-12-24T00:51:13.275918 | mgr | error | Traceback (most recent call last): |
File "/home/pt/pt2/scraper_service.py", line 69, in consume
ret = scraper.scrape(**job)
^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 73, in scrape
'committees': scrape_ep_key_players(root),
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "scrapers/dossier.py", line 230, in scrape_ep_key_players
raise ValueError("bad html in key players EP section, linkless committee name")
ValueError: bad html in key players EP section, linkless committee name |
| 2024-12-24T00:52:58.100868 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T00:53:26.338534 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T00:54:08.135585 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T00:56:59.683585 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-24T00:56:59.685275 plenary info adding A9-0056/2024-134 (A9-0056/2024-134) |
| 2024-12-24T00:57:14.710499 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-24T00:57:14.767376 plenary info adding A9-0445/2023-151 (A9-0445/2023-151) |
| 2024-12-24T00:58:27.915518 | mep_activity | warning | pe, has not expected format: 'Commission' |
2024-12-24T00:58:28.003970 plenary info adding A9-0158/2024-115 (A9-0158/2024-115) |
| 2024-12-24T01:05:40.997007 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:06:34.695037 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:06:35.331194 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:07:54.144356 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:09:32.043134 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:10:37.582848 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:12:39.826017 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:12:51.395806 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:12:58.280744 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:15:16.206669 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:17:11.948802 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:17:19.255361 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:18:05.193001 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:19:18.050152 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:19:47.281570 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:20:22.083204 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:21:56.361981 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:22:23.184040 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:23:53.811476 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:24:25.047980 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:25:02.731738 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:25:02.770592 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:25:16.506918 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:25:32.999345 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:26:07.577999 | mep_activity | warning | pe, has not expected format: 'Commission' |
| 2024-12-24T01:26:35.852491 | mep_activity | warning | pe, has not expected format: 'Commission' |