Fabio Manganiello
8440320031
Don't swallow the stack trace in backend.http.request if a request fails
2020-04-22 23:46:05 +00:00
Fabio Manganiello
4ece49bfe7
Added missing string format parameter
2020-03-24 09:11:07 +01:00
Fabio Manganiello
d38746d278
Moved imports for extra dependencies inside the methods where they are actually used
2019-12-01 23:35:05 +01:00
Fabio Manganiello
9914d4ef0b
Handling CSS and fonts properly in RSSUpdates digests
2019-10-13 12:43:18 +02:00
Fabio Manganiello
1f2f293778
Redirect mercury-parser.js stderr to stdout. Moreover, if an error occurs while parsing a link from an RSS feed we should report the link that raised the error, not the URL of the parent feed
2019-07-25 16:34:00 +00:00
Fabio Manganiello
44e27e6c62
Log the link we are trying to parse (useful for debugging parsing issues)
2019-07-25 18:23:28 +02:00
Fabio Manganiello
6aaa2fa1ea
extract_content is supposed to be a boolean
2019-07-25 01:09:16 +02:00
Fabio Manganiello
5293f5b203
#73 : Implemented wrapper plugin for the new Node.js mercury-parser.
...
As the Mercury reader web API is deprecated, and the only available
implementation is the open source mercury-parser, node, npm and
@postlight/mercury-parser have to be added as dependencies for the
http.webpage plugin (or at least for the `simplify` action).
2019-07-24 19:02:53 +02:00
Fabio Manganiello
57712b3693
Be more robust in case of Mercury API failures while parsing RSS feeds. TODO: the Mercury API has now been retired and replaced by a library, that however is only available for Node.js. Figure out how to wrap the new library in Python 3
2019-07-19 15:00:06 +00:00
Fabio Manganiello
cd9bdbb1c8
Fixed undefined reference
2019-07-17 14:57:50 +02:00
Fabio Manganiello
a60e89806f
Fixed undefined reference
2019-07-16 22:43:27 +02:00
Fabio Manganiello
cc61032bec
Fixes for readthedocs build
2019-07-16 22:38:42 +02:00
Fabio Manganiello
2d8b2ba55a
Removed pp- prefix from the name of the spawned processes and threads
2019-01-13 20:41:15 +01:00
Fabio Manganiello
fbf3600e91
Setting thread and process names properly through prctl
2019-01-10 23:45:13 +01:00
Fabio Manganiello
56c7258c74
Setting names for threads
2019-01-10 23:08:29 +01:00
Fabio Manganiello
eb439d227a
Wrapped HTTP requests loop in a try-except block to prevent it from breaking in case of temporary failures
2018-12-05 15:55:19 +00:00
Fabio Manganiello
4c2302a534
Removed title from logging trace in RSS backend
2018-10-23 00:23:47 +02:00
Fabio Manganiello
ae7cd120d2
Wrapped the RSS parsing loop in a try-except block to prevent the backend from continuously crashing if there are encoding issues on the RSS titles
2018-10-21 14:47:52 +02:00
Fabio Manganiello
7490529ca2
Reverted bugged title decode
2018-10-20 14:49:21 +02:00
Fabio Manganiello
2fd7ba003b
Decoding title from RSS feeds
2018-10-19 23:48:04 +02:00
Fabio Manganiello
09d7d98ae3
Retry logic for Mercury API
2018-08-19 21:52:01 +00:00
Fabio Manganiello
d7bc17778e
Forgot import logging
2018-06-08 16:55:06 +02:00
Fabio Manganiello
2bb6ed6867
Declared logger attribute in HttpRequest as it won't be available to the subclasses otherwise
2018-06-08 16:54:15 +02:00
Fabio Manganiello
f0bb2a20b0
Typo
2018-06-08 16:41:31 +02:00
Fabio Manganiello
0756da3861
Fixed logger references
2018-06-08 16:37:59 +02:00
Fabio Manganiello
4da74b1096
Refactored logging submodule
2018-06-06 20:09:23 +02:00
Fabio Manganiello
18efdb1c70
Make sure the summary is always there
2018-05-21 09:47:50 +02:00
Fabio Manganiello
0accbfa66e
Logging traces on RSS parse
2018-05-21 09:27:13 +02:00
Fabio Manganiello
bd761d420e
RSS digests are now optional
2018-05-07 19:44:34 +02:00
Fabio Manganiello
e4269a8d5d
Skip RSS items if published_parsed is not defined
2018-05-07 18:33:44 +02:00
Fabio Manganiello
88c5bc16f5
- Added rss-news dashboard widget
...
- Added summary field to the RSS entry
- Added support for custom dashboard backgrounds
- UX fixes + font change
2018-05-05 23:59:43 +02:00
Fabio Manganiello
dca41ea86e
A more robust logic for spotting new RSS items
2018-05-01 10:13:41 +02:00
Fabio Manganiello
68c52fe102
- Importing Flask.request as http_request to prevent name clashes with
...
SQLAlchemy's request module
- All SQLAlchemy engine and connection setup done within get_new_items
to prevent different threads from creating and using the db instance
- Added check_same_thread to sqlite connection line to prevent
different-thread exceptions when the Flask main thread does some cleanup
2018-04-28 19:11:14 +02:00
Fabio Manganiello
55eb689121
Support for RSS digest generation either in HTML or PDF format
2018-01-28 02:01:54 +01:00
Fabio Manganiello
91dd975413
mkdir_p replaced with os.makedirs
2018-01-27 13:54:15 +01:00
Fabio Manganiello
22b3f8e9b9
Removed redundant variable
2018-01-27 04:46:28 +01:00
Fabio Manganiello
14afbcad3a
Support for RSS feeds update events, solves #48
2018-01-27 04:32:44 +01:00
Fabio Manganiello
76f7bbc529
Refactored HTTP request plugin and fixed bug on the plugin name
2018-01-12 15:18:06 +01:00
Fabio Manganiello
b1f42c22ae
Added Booking.com endpoints automation
2018-01-11 19:31:44 +01:00
Fabio Manganiello
19cfafb2c7
Making the HTTP poll events work
2018-01-10 03:14:27 +01:00
Fabio Manganiello
d0759765b2
Removed booking module
2018-01-10 00:20:48 +01:00
Fabio Manganiello
2ea06f7708
Making JSON HTTP poll requests work
2018-01-09 18:44:45 +01:00
