revil-O/platypush
1
0
Fork 0
forked from platypush/platypush
Code Pull requests Activity
3341 commits 7 branches 83 tags 136 MiB
Commit graph

2849 commits

Author SHA1 Message Date
Fabio Manganiello
08c3a1e11a
Bump version: 0.24.5 → 0.50.0 2023-06-28 02:23:09 +02:00
Fabio Manganiello
5e5403287e
The inspect plugin should not fail hard if the cache couldn't be loaded. 
This can happen for many reasons - not only if the cache file is not
accessible, but also if the structure/signature of some pickled objects
has changed. In that case, we should invalidate the current cache and
re-initialize it instead of failing.
 2023-06-28 01:33:12 +02:00
Fabio Manganiello
ba827b0248
Added sound plugin documentation. 
- Added example of how to stream audio over HTTP.

- Added Portaudio to the apt/pacman dependencies.
 2023-06-28 00:10:36 +02:00
Fabio Manganiello
a103ea49f1
Fixed ffmpeg/audio consumer synchronization upon timeout. 2023-06-27 15:12:15 +02:00
Fabio Manganiello
77f7cd8b90
Don't use typing.Self (yet). 
typing.Self has only been introduced in Python 3.10.
 2023-06-27 14:17:04 +02:00
Fabio Manganiello
f2540437b7
Sound plugin rewritten almost from scratch. 2023-06-27 13:31:38 +02:00
Fabio Manganiello
2fb6e4d7d0
Updated webapp dist files 2023-06-16 15:48:23 +02:00
Fabio Manganiello
2f4229d7b1
pylint fixes for the camera plugin. 2023-06-16 15:40:05 +02:00
Fabio Manganiello
9aa8e4538a
Better termination logic for the ffmpeg audio converter. 2023-06-16 11:47:37 +02:00
Fabio Manganiello
a6351dddd4
Extracted AudioRecorder out of SoundPlugin. 2023-06-16 03:12:55 +02:00
Fabio Manganiello
da93f1b3b0
[Chore] pylint 2023-06-14 01:44:36 +02:00
Fabio Manganiello
c8786b75de
sound.recordplay merged into sound.record. 2023-06-12 22:15:02 +02:00
Fabio Manganiello
be794316a8
Merged sound.stream_recording and sound.record. 2023-06-12 13:06:02 +02:00
Fabio Manganiello
a415c5b231
Merged outfile/fifo logic in sound.stream_recording. 2023-06-12 12:33:14 +02:00
Fabio Manganiello
e238fcb6e4
Refactoring the sound plugin to use ffmpeg as a stream converter. 2023-06-11 12:48:49 +02:00
Fabio Manganiello
4587b262b0
Stream camera frames over HTTP using a Redis pub/sub mechanism. 2023-06-05 20:40:12 +02:00
Fabio Manganiello
d7208c6bbc
Refactored Tornado routes for native pub/sub support. 
The Redis pub/sub mechanism is now a native feature for Tornado routes
through the `PubSubMixin`.

(Plus, lint/black chore for the sound plugin)
 2023-05-30 21:58:27 +02:00
Fabio Manganiello
8b5eb82497
Camera stream writer fixes. 
- The readiness condition should be `multiprocessing.Condition`, not
  `threading.Condition` - in most of the cases it will be checked in a
  multiprocess environment.

- Fixed parameter name for `write`.
 2023-05-30 11:06:48 +02:00
Fabio Manganiello
4fffabd82a
Revert "Removed camera.gstreamer." 
This reverts commit b4d714df8a.
 2023-05-29 22:13:24 +02:00
Fabio Manganiello
4bf9c01ac9
Moved camera routes. 
Camera routes migrated from Flask blueprints to Tornado handlers.
 2023-05-27 22:24:45 +02:00
Fabio Manganiello
b4d714df8a
Removed camera.gstreamer. 
Too much of a pain in the ass to handle, too many format options to
think of, too many combinations of pipelines to support, and if I don't
think of those beforehand then I'll have to offload all of that
complexity on the user.
 2023-05-27 22:19:50 +02:00
Fabio Manganiello
1c40e5e843
Black'd the camera plugin and writer. 
Also, proper fix for the multi-inheritance problem of
the ffmpeg writers.
 2023-05-23 20:42:59 +02:00
Fabio Manganiello
a2f8e2f0d2
Fixed bottom margin for ConfirmDialog buttons 2023-05-22 16:44:53 +02:00
Fabio Manganiello
a7aabd7c52
Fixed handling of :meth: docstring annotations with relative paths. 2023-05-22 16:32:30 +02:00
Fabio Manganiello
7eca1c27c9
Blackened the qrcode and pushbullet plugins 2023-05-22 02:33:54 +02:00
Fabio Manganiello
aaac6488d6
Updated webapp dist files 2023-05-22 02:24:24 +02:00
Fabio Manganiello
d7405ad05d
Added multiple parsers for the entities referenced in docstrings. 
The `inspect` plugin can now detect references to plugins, backends,
events, responses and schemas in docstrings and replace them either with
links to the documentation or auto-generated examples.
 2023-05-22 02:20:58 +02:00
Fabio Manganiello
4f11d7cf74
Updated webapp dist files 2023-05-21 03:15:16 +02:00
Fabio Manganiello
b91c1eba6d
Parse :return: definitions from action docstrings too. 2023-05-21 03:05:19 +02:00
Fabio Manganiello
229b8f2985
Many improvements for the execute panel. 2023-05-21 03:04:52 +02:00
Fabio Manganiello
edf1dbee1d
Updated webapp dist files 2023-05-20 15:54:18 +02:00
Fabio Manganiello
5efc90ca17
Better PWA installation prompt. 
Display a popup modal instead of a confirm box to prompt the user to
install the PWA app.

`confirm` blocks the JavaScript engine when run in `beforeMount` and
therefore the browser won't be able to proceed with `event.prompt()`.
 2023-05-20 15:52:37 +02:00
Fabio Manganiello
666ea9ea6b
Added use_werkzeug_server option to backend.http. 
There are situations where you may not want to run the HTTP server in a
full blown WSGI-over-Tornado container - unit/integration tests and
embedded single-core devices are among those cases.

In those scenarios, we should allow the user to be able to run the
backend using the built-in Werkzeug server provided by Flask.
 2023-05-20 15:26:58 +02:00
Fabio Manganiello
013274bcbc [#259] Proper support for the progressive webapp (#262) 
Closes: 259
Reviewed-on: platypush/platypush#262
 2023-05-20 02:42:33 +02:00
Fabio Manganiello
27d4a20418
Use reflection to infer the arguments of a Python user procedure 2023-05-17 17:17:59 +02:00
Fabio Manganiello
0a1209fe6e
Updated webapp dist files 2023-05-17 10:56:37 +02:00
Fabio Manganiello
33e2879413
Various UI improvements for the execute tab. 2023-05-17 10:41:02 +02:00
Fabio Manganiello
91daec579d
Reverted to the previous style for entities on mobile. 
Better to use screen width wisely and avoid unnecessary padding.
 2023-05-17 01:13:09 +02:00
Fabio Manganiello
61ea3d79e4
Large refactor for the inspect plugin. 
More common logic has been extracted and all the methods and classes
have been documented and black'd.
 2023-05-17 00:05:22 +02:00
Fabio Manganiello
2cba504e3b
Improvements for the autocomplete component. 2023-05-14 15:07:54 +02:00
Fabio Manganiello
8447f9a854
Improved rendering of actions/arguments documentation. 
The frontend now calls `utils.rst_to_html` to render the docstrings as
HTML instead of dumping them as raw text.

Also, actions and arguments are now cached to improve performance.
 2023-05-14 15:06:34 +02:00
Fabio Manganiello
5f2d6dfeb5
Added utils.rst_to_html action. 2023-05-14 15:05:24 +02:00
Fabio Manganiello
3c83e7f412
A faster implementation for the inspect.get_* methods. 
Plugin/backend lookup is now done by inspecting the manifest files
instead of searching all the subpackages.
 2023-05-13 13:44:46 +02:00
Fabio Manganiello
72797e73ff
Changed the Tornado paradigm to start the WSGI workers. 
Use `bind_sockets`/`fork_processes` instead of reinventing the wheel
with our own multiprocessing handling.
 2023-05-13 12:35:20 +02:00
Fabio Manganiello
ac4fe4447e
Revert "Added a multi-worker approach to the Tornado WSGI container." 
This reverts commit 71401a4936.

Temporarily reverted this commit because the `reuse_address` on the
application's `listen` method has only been implemented in Tornado 6.2 -
and Debian stable still shipts Tornado 6.1.
 2023-05-13 02:36:20 +02:00
Fabio Manganiello
71401a4936
Added a multi-worker approach to the Tornado WSGI container. 
The WSGI container is a good option to wrap a multi-modal webapp
(Flask + websocket routes), but it's constrained to a single-process
approach and queued/pre-buffered requests. That makes performance poor
when handling requests that may take a few seconds to complete.
 2023-05-13 01:26:18 +02:00
Fabio Manganiello
b7b93edbae
Updated dist files 2023-05-12 03:52:33 +02:00
Fabio Manganiello
a15191d4ca
Updated dist files 2023-05-12 03:51:59 +02:00
Fabio Manganiello
d4f8e51caf
A less blocking implementation of the entities loading UI logic. 2023-05-12 03:49:20 +02:00
Fabio Manganiello
62d846ddda
Updated dist files 2023-05-12 03:42:17 +02:00
Fabio Manganiello
23a5e90e2e
Updated dist files 2023-05-12 03:26:55 +02:00
Fabio Manganiello
6cd9cb6e76
Better entities caching on the frontend. 2023-05-12 03:18:22 +02:00
Fabio Manganiello
79871e0fa1
Fixed devServer routes in vue.config.js. 
Use `127.0.0.1` instead of `localhost` for the Vue proxy.
 2023-05-12 02:57:14 +02:00
Fabio Manganiello
cfedcd701e
Performance improvements when loading the Tensorflow plugin. 
The Tensorflow module may take a few seconds to load the first time and
slow down the first scan of the plugins.

All the Tensorflow imports should therefore be placed close to where
they are used instead of being defined at the top of the module.
 2023-05-11 19:48:22 +02:00
Fabio Manganiello
f49ad4c349
Updated dist files 2023-05-10 02:52:24 +02:00
Fabio Manganiello
6b0f0883ee
A proper way to proxy websocket calls using the Vue devServer. 2023-05-10 02:27:01 +02:00
Fabio Manganiello
78c12212c6
[#260] A simple entities caching mechanism using the browser storage. 2023-05-10 02:26:06 +02:00
Fabio Manganiello
74ab884b7a
Proper redirects upon /execute failure. 
If a call to `/execute` fails with a 401 or 412 status, then redirect
the user to `/register` or `/login`.
 2023-05-10 02:24:50 +02:00
Fabio Manganiello
41233138ff
Blackened inspect module and extracted model defs to adjacent module. 2023-05-09 21:58:02 +02:00
Fabio Manganiello
ab2425ebd0
[#260] Removed legacy backend.websocket. 
It has now been replaced by the `/ws/events` and `/ws/requests`
websocket routes under `backend.http`.
 2023-05-09 02:46:43 +02:00
Fabio Manganiello
a069d23bb7
[#260] Added `/ws/requests` websocket route. 2023-05-09 02:40:32 +02:00
Fabio Manganiello
7716a416e9
[#260] Support for sending events via websocket over /ws/events. 2023-05-09 02:18:58 +02:00
Fabio Manganiello
edb7197f71
[#260] Implemented authentication for websocket routes. 
Plus, refactored the `backend.http.app.utils` module by breaking it down
into multiple components, as the module was starting to get too large.
 2023-05-09 00:03:11 +02:00
Fabio Manganiello
2d4b179879
Include the path info in the logging messages in WSRoute. 2023-05-08 12:35:54 +02:00
Fabio Manganiello
3fc622e296
Remove legacy references to the websocket HTTP port and backend in platydock. 2023-05-08 12:25:09 +02:00
Fabio Manganiello
f5fcccb0bd
Refactored the new websocket routes. 
Defined a `platypush.backend.http.ws` package with all the routes, a
base `WSRoute` class that all the websocket routes can extend, and a
logic in the HTTP backend to automatically scan the package to register
exposed websocket routes.
 2023-05-08 11:45:14 +02:00
Fabio Manganiello
56dc8d0972
Migrated the webapp to Tornado. 
It was just too painful to find a combination of versions of  gunicorn,
gevent, eventlet, pyuwsgi etc. that could work on all of my systems.

On the other hand, Tornado works out of the box with no headaches.

Also in this commit:

- Updated a bunch of outdated/required integration dependencies.
- Black'd and LINTed a couple of old plugins.
 2023-05-08 02:06:45 +02:00
Fabio Manganiello
f81e9061a3
lifespan=on is actually not required on Flask config level. 2023-05-07 16:30:41 +02:00
Fabio Manganiello
692180c653
Back to uvicorn workers from eventlet. 
The eventlet API has way too many dependency issues with gunicorn.

Still TODO: Fix or at least mitigate the WSGI workers timeout issue when
they handle websocket connections.
 2023-05-07 15:37:58 +02:00
Fabio Manganiello
8102178ba4
Updated dist files 2023-05-07 13:00:48 +02:00
Fabio Manganiello
c0a948f8ce
Removed remaining references to websocket port. 2023-05-07 12:54:13 +02:00
Fabio Manganiello
bdbbd24e6f
Only include /ws/events as a proxied websocket, without messing with the /ws route exposed by the Vue debugger 2023-05-07 12:22:51 +02:00
Fabio Manganiello
059fff8558
Updated dist files 2023-05-07 12:19:13 +02:00
Fabio Manganiello
f9b0bc905e
Migrated websocket service. 
The websocket service is no longer provided by a different service,
controlled by a different thread running on another port.

Instead, it's now exposed directly over Flask routes, using
WSGI+eventlet+simple_websocket.

Also, the SSL context options have been removed from `backend.http`, for
sake of simplicity. If you want to enable SSL, you can serve Platypush
through a reverse proxy like nginx.
 2023-05-07 12:08:28 +02:00
Fabio Manganiello
3aefc9607d
Migrated from waitress to gunicorn. 
`waitress`, unlike `gunicorn`, doesn't provide an easy way to plug into
a WSGI socket that can be used for the websocket interface.
 2023-05-07 00:42:57 +02:00
Fabio Manganiello
9951d62511
Added logic to automatically generate the secret key for Flask. 2023-05-06 22:04:48 +02:00
Fabio Manganiello
d1f0e1976c
Exclude squashfs/loopback mounts from system.disk_info. 2023-05-06 18:53:16 +02:00
Fabio Manganiello
e33a391d25
Updated dist files 2023-05-06 12:37:00 +02:00
Fabio Manganiello
4f78d61223
Improved UI on mobile. 2023-05-06 12:34:27 +02:00
Fabio Manganiello
6e939bbe62
Close modals and dropdown when ESC is pressed. 2023-05-05 20:46:42 +02:00
Fabio Manganiello
e9e59c857a
Updated dist files 2023-05-05 02:51:33 +02:00
Fabio Manganiello
59bf1c2aa0
Added close button to the modal's header. 2023-05-05 02:48:41 +02:00
Fabio Manganiello
8af3ae17b8
A more efficient way of detecting the entity groups to display. 
Instead of iterating over each of the entities in a grouping to find out
which groups should be displayed based on the selector's policy, the
selector can directly keep its `selectedGroups` attribute in sync with
the index.
 2023-05-05 02:33:34 +02:00
Fabio Manganiello
373788377b
Created two separate actions under variable to delete/unset. 
`delete` will actually remove the record from the database (same as
`unset`'s new behaviour), while `unset` will set it to null without
deleting it (same as the `unset`'s previous behaviour).
 2023-05-05 02:21:18 +02:00
Fabio Manganiello
98b9d31dd4
Updated dist files 2023-05-05 01:10:24 +02:00
Fabio Manganiello
4383dbb2b4
Bluetooth UI toggle aligned to the right - like all other toggles. 2023-05-05 01:04:39 +02:00
Fabio Manganiello
285f3941d9
Always use an external uWSGI server to run the web service. 
Added `waitress` dependency. For performance and security reasons, it's
better to always run the Flask application inside of a uWSGI server.

`waitress` also makes things easier by avoiding to ask the user to
manually provide the external executable arguments, as it was the case
with `uwsgi` and `gunicorn`.
 2023-05-05 00:07:13 +02:00
Fabio Manganiello
2c254e8eb9
numpy and PIL should be required dependencies for all camera plugins. 2023-05-04 23:44:42 +02:00
Fabio Manganiello
99311a6e71
Updated dist files 2023-05-04 02:23:24 +02:00
Fabio Manganiello
7db09276ca
Some small style improvements. 2023-05-04 02:20:40 +02:00
Fabio Manganiello
2398cac572
A more efficient and clean logic for selectedEntities calculation. 2023-05-04 02:19:55 +02:00
Fabio Manganiello
394e27eaf2
Refactored style for UI dropdowns. 2023-05-04 02:19:09 +02:00
Fabio Manganiello
c690230930
An AssistantEvent should not fail initialization if the assistant integration isn't found. 2023-05-04 00:28:50 +02:00
Fabio Manganiello
5d1c8cf8e9
Additional null check on this.searchTerm 2023-05-03 03:33:34 +02:00
Fabio Manganiello
3482c29679
Updated dist files 2023-05-03 03:18:44 +02:00
Fabio Manganiello
a06d0ef6a1
Merged all the items in the entities panel's header in the Selector component. 2023-05-03 03:14:46 +02:00
Fabio Manganiello
7c7818dd76
Fixed entity search. 
It was broken by the previous refactor of the entities panel, which no
longer triggers the `watch` callback on the upstream `entityGroups`.

The new approach listens for entity updates on the frontend bus and
dynamically creates the entity groupings in `selectedGroups` if they are
missing.
 2023-05-03 02:12:14 +02:00
Fabio Manganiello
9922305ac5
Fixed grouping for entityGroups.id. 
Unlike the other entity groupings, which are 4-layered (`grouping ->
group -> entity_id -> entity`), the grouping by ID only needs 3 layers
(`grouping -> entity_id -> entity`).
 2023-05-03 02:09:51 +02:00
Fabio Manganiello
cc2ec1db7f
The HTTP Zeroconf service should be registered before the server starts. 2023-05-02 21:24:50 +02:00
Fabio Manganiello
55cb87d14f
Updated dist files 2023-05-02 10:24:11 +02:00