3353 commits

Author	SHA1	Message	Date
Fabio Manganiello	a6752ed034	Fixed wrong event path in a manifest file.	2023-08-20 14:08:22 +02:00
Fabio Manganiello	700b8e1d16	Added header and footer to generated Dockerfile.	2023-08-20 14:05:22 +02:00
Fabio Manganiello	a6f8021150	PackageManager has both install and uninstall.	2023-08-20 13:33:49 +02:00
Fabio Manganiello	5efcae64c1	Better Dockerfile logic to retrieve sources. ... If the /install folder on the container doesn't contain a copy of the source files, then the git repository will be cloned under that folder. The user can specify via `-r/--ref` option which tag/branch/commit they want to install.	2023-08-20 13:31:13 +02:00
Fabio Manganiello	28ba042810	If no configuration file is passed to platydock generate a minimal Dockerfile.	2023-08-20 03:36:34 +02:00
Fabio Manganiello	199ac5f0f7	New way of managing installation scripts and dependencies. ... Created `platypush/install` folder that contains: - Dockerfiles for the supported distros - Lists of required base dependencies for the supported distros - Install and run scripts - Added Debian to supported base images	2023-08-20 02:28:10 +02:00
Fabio Manganiello	71c5291190	Refactored the interface of Platydock and manifest utils.	2023-08-19 22:46:37 +02:00
Fabio Manganiello	a99ffea37c	Fixed apt dependencies for mpd plugin.	2023-08-19 21:46:08 +02:00
Fabio Manganiello	980af16984	Rewritten platydock utility. ... Platydock now will only print out a Dockerfile given a configuration file. No more maintaining the state of containers, storing separate workdirs and configuration directories etc. - that introduced way too much overhead over Docker.	2023-08-19 13:47:43 +02:00
Fabio Manganiello	9002f3034a	Tweaked package managers install command arguments.	2023-08-19 13:46:08 +02:00
Fabio Manganiello	69706eaabe	s/logger/_logger/ in the plugins module. ... The `logger` name may clash with the context of an action, where `logger` may have been set to something else.	2023-08-19 13:32:19 +02:00
Fabio Manganiello	1cb686bdab	Updated the inspect plugin to the new manifest utils interface.	2023-08-19 13:31:48 +02:00
Fabio Manganiello	043f303761	s/HttpBackend._DEFAULT_HTTP_PORT/HttpBackend.DEFAULT_HTTP_PORT/g	2023-08-19 13:30:51 +02:00
Fabio Manganiello	dd3a701a2e	Full rewrite of platypush.utils.manifest. ... The new version encapsulates all the utility functions into three classes - `Manifest`, `Manifests` and `Dependencies`.	2023-08-19 13:28:40 +02:00
Fabio Manganiello	a8255f3621	Pass the configuration file used by the application to the Alembic process. ... The database settings could also be overridden in the configuration file besides the command line. We should therefore pass the path to the runtime configuration file, so the Alembic process can initialize its configuration from the same file and use the same settings.	2023-08-19 13:23:20 +02:00
Fabio Manganiello	1825b492b3	Replaced Config.workdir with Config.get_workdir(). ... Again, Python < 3.9 doesn't like class properties.	2023-08-19 13:21:24 +02:00
Fabio Manganiello	a8836f95f5	Support explicit workdir parameter override in Config constructor.	2023-08-19 13:15:29 +02:00
Fabio Manganiello	5bc82dfe64	s/Config._cfgfile/Config.config_file/g	2023-08-19 13:13:36 +02:00
Fabio Manganiello	181da63c89	Pass the database engine to the Alembic process as an extra argument. ... If the path of the default database engine is overridden via `--workdir` option then it won't be visible to the new `python` subprocess spawned for Alembic.	2023-08-19 13:02:05 +02:00
Fabio Manganiello	c2b3ec8ce3	Fixed manifest files with outdated formats.	2023-08-19 12:54:33 +02:00
Fabio Manganiello	e463a52435	Use sys.executable rather than 'python' to launch the application.	2023-08-19 12:40:57 +02:00
Fabio Manganiello	0a5fc40dc5	Merge branch 'master' into 276/better-docker	2023-08-18 17:34:56 +02:00
Fabio Manganiello	2cab836bdf	Entity.columns class property replaced by Entity.get_columns method. ... Again, Python < 3.9 doesn't like the combination of `@property` + `@classmethod`.	2023-08-18 17:20:53 +02:00
Fabio Manganiello	a9cdff900e	_variable should be an external global function rather than a class property. ... The combination of `@property` + `@classmethod` isn't supported on Python < 3.9.	2023-08-18 16:16:47 +02:00
Fabio Manganiello	d0c89f88a8	Fixed parenthesised multi-with statement. ... This syntax is not supported on Python < 3.9, and therefore it should be broken down as a multi-line statement.	2023-08-18 16:10:31 +02:00
Fabio Manganiello	ca95490412	Added timeout parameter to requests.get in the rss plugin.	2023-08-18 15:53:30 +02:00
Fabio Manganiello	5dd7345c0b	Sync the latest parse timestamps in main instead of __init__ in rss. ... We should load the latest timestamps from the db when the thread starts instead of doing it in the constructor. The constructor may be invoked when the entities engine hasn't been initialized yet, and result in deadlocks.	2023-08-18 15:51:11 +02:00
Fabio Manganiello	ec64b0ef8b	Added --device_id command line option.	2023-08-17 23:16:24 +02:00
Fabio Manganiello	ac83b43f98	Support for custom key-value overrides on Config.init.	2023-08-17 22:03:39 +02:00
Fabio Manganiello	657b2cc87d	Create the default configuration file even if --config is supplied but the file doesn't exist.	2023-08-17 11:25:49 +02:00
Fabio Manganiello	24b04d9103	s/--config-file/--config/ option in Dockerfile.	2023-08-17 10:35:40 +02:00
Fabio Manganiello	bf7d060b81	Added @ensure_initialized decorator to actions in variable. ... The `variable` plugin may break in the constructor the first time the application is started. That's because it tries to initialize the cache of stored variables, but the local database hasn't yet been initialized. That's because plugins are registered _before_ the entities engine is initialized, as the entities engine assumes that it already has plugins to scan for entities. Therefore, the initialization of the `variable` plugin's cache should be lazy (only done upon the first call to `get`/`set` etc.), in order to prevent deadlock situations where the plugin waits for the engine to start, but the engine will be initialized only after the plugin is ready. And the lazy initialization logic should also ensure that the entities engine has been properly started (and emit a `TimeoutError` if that's not the case), in order to prevent race conditions.	2023-08-17 02:47:30 +02:00
Fabio Manganiello	adfedfa2dd	s/TimeoutError/AssertionError/ if get_entities_engine times out.	2023-08-17 02:36:40 +02:00
Fabio Manganiello	ec2b8da983	Ignore Redis errors when a backend sends an unregister notify event. ... When that happens, it's most likely that the application is already stopping and the Redis service has already been terminated.	2023-08-17 01:49:41 +02:00
Fabio Manganiello	3bf068e0b2	The __main__ function should take no arguments. ... setup.py won't pass any arguments to `main()`, so the default entry point should get them itself from `sys.argv`.	2023-08-17 01:35:39 +02:00
Fabio Manganiello	98e9abde18	Extended manifest files with Python system packages (if available). ... - If a Python optional dependency is available as a system package on the target system, try and install it that route rather than pip. It's usually faster and it decreases the risk of breaking system packages. - Added support for apk dependencies in manifest files. This brings the number of distros officially supported by all the extensions to four: - Alpine - Arch - Debian - Ubuntu	2023-08-16 22:43:51 +02:00
Fabio Manganiello	00863a176e	Added application plugin.	2023-08-15 11:20:24 +02:00
Fabio Manganiello	f51beb271e	Large refactor + stability fixes for the external process control logic.	2023-08-15 11:12:21 +02:00
Fabio Manganiello	46245e851f	Synchronize with the currently running stop thread (if any) in Backend.wait_stop.	2023-08-15 02:08:47 +02:00
Fabio Manganiello	a8a7ceb2ac	Implemented HttpBackend._stop_workers. ... The Tornado WSGI container won't guarantee the termination of the spawned workers upon termination, so the code of the backend has to take care of it and terminate all the children processes of the server process when it terminates. This also means that `psutil` is now a required base dependency, as we need to expand the process subtree under the webserver launcher.	2023-08-15 00:13:34 +02:00
Fabio Manganiello	04921c759f	Added wait_stop method to the entities engine and cron scheduler.	2023-08-14 23:49:47 +02:00
Fabio Manganiello	ceb9d6d1ba	Removed redundant Backend._get_redis() method. ... It was used only once, and it could easily be replaced by `platypush.utils.get_redis()`.	2023-08-14 23:37:38 +02:00
Fabio Manganiello	7157936b87	Added get_remaining_timeout utility function.	2023-08-14 23:17:50 +02:00
Fabio Manganiello	dc1a152433	Added get_default_pid_file utility method.	2023-08-14 10:47:25 +02:00
Fabio Manganiello	c11bc69a66	Handle KeyboardInterrupt and process return code in the main.	2023-08-13 23:55:40 +02:00
Fabio Manganiello	8819a0ed4c	Added CommandStream to the main Application. ... The stream will be used to communicate command messages from the application to its runner.	2023-08-13 23:51:21 +02:00
Fabio Manganiello	06111587f7	Added CommandStream class. ... This abstraction is used to write and read commands over a UNIX socket.	2023-08-13 23:37:51 +02:00
Fabio Manganiello	c89f992867	Added StopCommand and RestartCommand.	2023-08-13 23:36:36 +02:00
Fabio Manganiello	b1f244a812	Added ControllableProcess class. ... This class can be used to easily control the execution of underlying processes.	2023-08-13 23:33:08 +02:00
Fabio Manganiello	efef9d7bc0	Added commands module.	2023-08-13 23:21:36 +02:00
Fabio Manganiello	97adc3f775	Moved application argument parser to an external platypush.cli module.	2023-08-13 22:27:16 +02:00
Fabio Manganiello	1819ee75ef	s/Application.stop_app/Application.stop/g	2023-08-13 22:23:15 +02:00
Fabio Manganiello	827b564006	Using a single constant for DEFAULT_REDIS_QUEUE. ... Also, catch `AttributeError` on `self._proc.terminate` in the `HttpBackend`, since the process may already have been terminated and set to null by another worker process.	2023-08-13 22:20:16 +02:00
Fabio Manganiello	4062ddbcf0	More improvements to the inspect plugin. ... - Support for distinct `type` field on constructor and method arguments. - Added `has_varargs` field. - Added `required` field. - Better logic for parsing arguments `default` values.	2023-08-08 20:47:27 +02:00
Fabio Manganiello	9beb0a7af3	Skip :type: annotations from docstring args documentation.	2023-08-08 20:47:27 +02:00
Fabio Manganiello	2a30f060b4	Parse the arguments list from obj_type.__init__.__doc__ too.	2023-08-08 20:47:27 +02:00
Fabio Manganiello	1474685cc0	[Automatic] Updated UI files	2023-08-06 22:51:57 +00:00
Fabio Manganiello	26b4dcba46	Reduced padding of ConfirmDialog body element.	2023-08-07 00:50:10 +02:00
Fabio Manganiello	5184543a3e	Normalize the size of the camera frame container from window size. ... If the window is smaller than the camera resolution, then we should scale down the container size accordingly.	2023-08-07 00:38:19 +02:00
Fabio Manganiello	dd313c6371	[Automatic] Updated UI files	2023-08-06 21:50:25 +00:00
Fabio Manganiello	2f007888fc	[Automatic] Updated UI files	2023-08-06 21:48:33 +00:00
Fabio Manganiello	609a8c6052	[Automatic] Updated UI files	2023-08-06 21:46:44 +00:00
Fabio Manganiello	276a9a7421	[Automatic] Updated UI files	2023-08-06 21:44:51 +00:00
Fabio Manganiello	715cdcfcff	More consistent style for the buttons on the tokens settings page.	2023-08-06 23:42:50 +02:00
Fabio Manganiello	bd49e460d5	More style improvements for the user settings panel.	2023-08-06 23:36:06 +02:00
Fabio Manganiello	6eed558342	More improvements on the users settings panel.	2023-08-06 23:14:54 +02:00
Fabio Manganiello	1d47b35219	Updated UI dependencies	2023-08-06 20:38:46 +02:00
Fabio Manganiello	237e0c47cb	Redesigned config panel UI.	2023-08-06 18:49:03 +02:00
Fabio Manganiello	53aeb0b3b1	Better documentation for the Redis server + LINT fixes. ... 1. Added documentation to the README on the possible options to run the Redis service. 2. Show a relevant message to the user if the application is run with `--start-redis` and Redis couldn't start. 3. Some LINT/black chores on some files that hadn't been touched in a while.	2023-08-02 22:17:11 +02:00
snyk-bot	7cda9954d4	fix: upgrade vue-router from 4.1.2 to 4.2.3 ... Snyk has created this PR to upgrade vue-router from 4.1.2 to 4.2.3. See this package in npm: https://www.npmjs.com/package/vue-router See this project in Snyk: https://app.snyk.io/org/blacklight/project/96bfd125-5816-4d9e-83c6-94d1569ab0f1?utm_source=github&utm_medium=referral&page=upgrade-pr	2023-07-27 02:01:02 +00:00
snyk-bot	26c9694664	fix: upgrade core-js from 3.23.4 to 3.31.1 ... Snyk has created this PR to upgrade core-js from 3.23.4 to 3.31.1. See this package in npm: https://www.npmjs.com/package/core-js See this project in Snyk: https://app.snyk.io/org/blacklight/project/96bfd125-5816-4d9e-83c6-94d1569ab0f1?utm_source=github&utm_medium=referral&page=upgrade-pr	2023-07-27 02:00:57 +00:00
Fabio Manganiello	e4756eb639	Replaced deprecated flask.escape with markupsafe.escape.	2023-07-25 00:26:15 +02:00
Fabio Manganiello	91cd08cdff	Adapted tests to use a locally started Redis instance.	2023-07-24 10:37:07 +02:00
Fabio Manganiello	7a20fec52f	[#60] Added --workdir and --logsdir command-line options. ... Also, the application is now using `XDG_CONFIG_HOME` and `XDG_DATA_HOME` if available to lookup the configuration file and working directory. Closes: #60	2023-07-24 03:29:08 +02:00
Fabio Manganiello	c1d66abb89	[#60] Added --workdir and --logsdir command-line options. ... Closes: #60	2023-07-24 03:20:18 +02:00
Fabio Manganiello	5fd40af285	Revert "Added explicit --help option." ... This reverts commit 1304be0718.	2023-07-24 02:38:12 +02:00
Fabio Manganiello	1304be0718	Added explicit --help option. ... argparse.ArgumentParser doesn't seem to add the option automatically anymore.	2023-07-24 02:11:42 +02:00
Fabio Manganiello	e9a568fdd2	Unified interface to retrieve the Redis bus configuration. ... A common `utils.get_redis_conf` has been created to handle the cascade fallback logic used to retrive the default Redis configuration.	2023-07-24 01:04:13 +02:00
Fabio Manganiello	77ffefdccb	Added a Config.set method. ... A useful interface to change configuration values at runtime.	2023-07-24 00:48:07 +02:00
Fabio Manganiello	dd862db29a	[chore] LINT fixes	2023-07-24 00:35:03 +02:00
Fabio Manganiello	3e3d47aa44	Check first the configuration of the Redis plugin and then that of the backend.	2023-07-24 00:26:49 +02:00
Fabio Manganiello	315a89fb65	Added a default parameter to Config.get.	2023-07-23 23:31:57 +02:00
Fabio Manganiello	37dcaba7a1	Refactored structure of main application and startup scripts. ... The main application class has been moved from __init__ to the app module. __init__ will contain instead the relevant global variables and the modules and objects exposed to external integrations - such as `get_plugin` and `get_backend`, or the `main` itself. This will make future integrations much easier - the global __init__ doesn't contain any business logic now, it can import anything without fearing circular dependencies, and it can limit its exposed objects to those that we want to expose to 3rd-party integrations and scripts. It will also make it easier to extend the main entry point with additional logic - such as a supervisor or an embedded Redis server.	2023-07-23 23:12:36 +02:00
Fabio Manganiello	0dc380fa94	Removed dependency from prctl. ... Also, black'd and LINT-fixed some files that hadn't been touched in a while.	2023-07-23 19:17:30 +02:00
Fabio Manganiello	15a34ebac9	Upgraded Docker base image. ... Debian base image bumped from Bullseye -> Bookworm.	2023-07-23 17:25:52 +02:00
Fabio Manganiello	cfdecd5703	[#267] Don't show the PWA popup again after the user dismisses it. ... Plus, upgraded a bunch of frontend libraries. Closes: #267	2023-07-23 02:44:17 +02:00
Fabio Manganiello	454228c56e	Upgraded UI dependencies	2023-07-23 02:42:14 +02:00
dependabot[bot]	33699fcac8	Bump word-wrap from 1.2.3 to 1.2.5 in /platypush/backend/http/webapp ... Bumps [word-wrap](https://github.com/jonschlinkert/word-wrap) from 1.2.3 to 1.2.5. - [Release notes](https://github.com/jonschlinkert/word-wrap/releases) - [Commits](https://github.com/jonschlinkert/word-wrap/compare/1.2.3...1.2.5) --- updated-dependencies: - dependency-name: word-wrap dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com>	2023-07-22 21:48:53 +00:00
dependabot[bot]	505cba44b8	Bump webpack from 5.70.0 to 5.88.2 in /platypush/backend/http/webapp ... Bumps [webpack](https://github.com/webpack/webpack) from 5.70.0 to 5.88.2. - [Release notes](https://github.com/webpack/webpack/releases) - [Commits](https://github.com/webpack/webpack/compare/v5.70.0...v5.88.2) --- updated-dependencies: - dependency-name: webpack dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com>	2023-07-22 21:46:59 +00:00
Fabio Manganiello	1d98f54c54	Bump version: 0.50.2 → 0.50.3	2023-07-22 23:36:04 +02:00
Fabio Manganiello	66981bd00b	Updated email addresses and black'd some old source files.	2023-07-22 23:02:44 +02:00
Fabio Manganiello	3eda0c6f17	[#268] Implemented XMPP integration.	2023-07-22 22:36:36 +02:00
Fabio Manganiello	63afd90701	Serialize exceptions in the default JSON serializers. ... This allows us to easily pass errors in internal JSON payloads, and ensure that these are serialized consistently across all the integrations.	2023-07-22 15:14:05 +02:00
Fabio Manganiello	cef9d0e007	Always serialize exception names when logging/returning request exceptions.	2023-07-22 15:13:17 +02:00
Fabio Manganiello	d49e5b1f6a	Expose Config.workdir property. ... This is a useful proxy to avoid using `Config.get('workdir')` string lookup.	2023-07-22 15:11:58 +02:00
Fabio Manganiello	c846c61493	Refactored Config.__init__. ... The constructor of the `Config` class had grown too big. It's much more manageable if split into multiple sub-constructor helpers.	2023-07-15 13:38:07 +02:00
Fabio Manganiello	0a3d6add83	Support ./config.yaml as a config file location.	2023-07-15 01:29:41 +02:00
Fabio Manganiello	fa1364d854	Improved logging for requests, responses and events. ... - The following logging namespaces are now used, to make it easier to filter only log lines related to the logged application message: - `platypush:events` - `platypush:requests` - `platypush:responses` - Those messages are always logged as JSON, with no prefixes nor suffixes. - Requests are always logged when executed - no more delegation to the upstream backend. - Responses are always logged when fully populated (including `id`, `origin`, `target` etc.), instead of being logged when still partially populated. This makes it particularly easy to link request/response IDs directly from the logs.	2023-07-15 01:11:45 +02:00
Fabio Manganiello	cb04af0bbd	Catch TypeError when execution an action. ... Most of TypeError are due to the user passing wrong data. It usually doesn't mean that we have to fail hard and reload the plugin, nor retry the call with the same parameters.	2023-07-14 22:20:27 +02:00
Fabio Manganiello	27cf1bec52	Removed some optional top-level imports. ... Optional top-level imports in Tornado route declarations will trigger `ImportError`. While this will just mean that those routes will be skipped, it will also generate a lot of noise on the logs.	2023-07-01 03:13:38 +02:00
Fabio Manganiello	e0af2daaff	Bump version: 0.50.1 → 0.50.2	2023-06-30 23:12:40 +02:00
Fabio Manganiello	42a990a132	Format string typo fix	2023-06-30 23:07:00 +02:00
Fabio Manganiello	9a7fc031d9	A more robust logic to detect plugins by class type in get_plugin.	2023-06-30 23:01:09 +02:00
Fabio Manganiello	f3b2386ed6	Bump version: 0.50.0 → 0.50.1	2023-06-28 02:44:13 +02:00
Fabio Manganiello	08c3a1e11a	Bump version: 0.24.5 → 0.50.0	2023-06-28 02:23:09 +02:00
Fabio Manganiello	5e5403287e	The inspect plugin should not fail hard if the cache couldn't be loaded. ... This can happen for many reasons - not only if the cache file is not accessible, but also if the structure/signature of some pickled objects has changed. In that case, we should invalidate the current cache and re-initialize it instead of failing.	2023-06-28 01:33:12 +02:00
Fabio Manganiello	ba827b0248	Added sound plugin documentation. ... - Added example of how to stream audio over HTTP. - Added Portaudio to the apt/pacman dependencies.	2023-06-28 00:10:36 +02:00
Fabio Manganiello	a103ea49f1	Fixed ffmpeg/audio consumer synchronization upon timeout.	2023-06-27 15:12:15 +02:00
Fabio Manganiello	77f7cd8b90	Don't use typing.Self (yet). ... typing.Self has only been introduced in Python 3.10.	2023-06-27 14:17:04 +02:00
Fabio Manganiello	f2540437b7	Sound plugin rewritten almost from scratch.	2023-06-27 13:31:38 +02:00
Fabio Manganiello	2fb6e4d7d0	Updated webapp dist files	2023-06-16 15:48:23 +02:00
Fabio Manganiello	2f4229d7b1	pylint fixes for the camera plugin.	2023-06-16 15:40:05 +02:00
Fabio Manganiello	9aa8e4538a	Better termination logic for the ffmpeg audio converter.	2023-06-16 11:47:37 +02:00
Fabio Manganiello	a6351dddd4	Extracted AudioRecorder out of SoundPlugin.	2023-06-16 03:12:55 +02:00
Fabio Manganiello	da93f1b3b0	[Chore] pylint	2023-06-14 01:44:36 +02:00
Fabio Manganiello	c8786b75de	sound.recordplay merged into sound.record.	2023-06-12 22:15:02 +02:00
Fabio Manganiello	be794316a8	Merged sound.stream_recording and sound.record.	2023-06-12 13:06:02 +02:00
Fabio Manganiello	a415c5b231	Merged outfile/fifo logic in sound.stream_recording.	2023-06-12 12:33:14 +02:00
Fabio Manganiello	e238fcb6e4	Refactoring the sound plugin to use ffmpeg as a stream converter.	2023-06-11 12:48:49 +02:00
Fabio Manganiello	4587b262b0	Stream camera frames over HTTP using a Redis pub/sub mechanism.	2023-06-05 20:40:12 +02:00
Fabio Manganiello	d7208c6bbc	Refactored Tornado routes for native pub/sub support. ... The Redis pub/sub mechanism is now a native feature for Tornado routes through the `PubSubMixin`. (Plus, lint/black chore for the sound plugin)	2023-05-30 21:58:27 +02:00
Fabio Manganiello	8b5eb82497	Camera stream writer fixes. ... - The readiness condition should be `multiprocessing.Condition`, not `threading.Condition` - in most of the cases it will be checked in a multiprocess environment. - Fixed parameter name for `write`.	2023-05-30 11:06:48 +02:00
Fabio Manganiello	4fffabd82a	Revert "Removed camera.gstreamer." ... This reverts commit b4d714df8a.	2023-05-29 22:13:24 +02:00
Fabio Manganiello	4bf9c01ac9	Moved camera routes. ... Camera routes migrated from Flask blueprints to Tornado handlers.	2023-05-27 22:24:45 +02:00
Fabio Manganiello	b4d714df8a	Removed camera.gstreamer. ... Too much of a pain in the ass to handle, too many format options to think of, too many combinations of pipelines to support, and if I don't think of those beforehand then I'll have to offload all of that complexity on the user.	2023-05-27 22:19:50 +02:00
Fabio Manganiello	1c40e5e843	Black'd the camera plugin and writer. ... Also, proper fix for the multi-inheritance problem of the ffmpeg writers.	2023-05-23 20:42:59 +02:00
Fabio Manganiello	a2f8e2f0d2	Fixed bottom margin for ConfirmDialog buttons	2023-05-22 16:44:53 +02:00
Fabio Manganiello	a7aabd7c52	Fixed handling of :meth: docstring annotations with relative paths.	2023-05-22 16:32:30 +02:00
Fabio Manganiello	7eca1c27c9	Blackened the qrcode and pushbullet plugins	2023-05-22 02:33:54 +02:00
Fabio Manganiello	aaac6488d6	Updated webapp dist files	2023-05-22 02:24:24 +02:00
Fabio Manganiello	d7405ad05d	Added multiple parsers for the entities referenced in docstrings. ... The `inspect` plugin can now detect references to plugins, backends, events, responses and schemas in docstrings and replace them either with links to the documentation or auto-generated examples.	2023-05-22 02:20:58 +02:00
Fabio Manganiello	4f11d7cf74	Updated webapp dist files	2023-05-21 03:15:16 +02:00
Fabio Manganiello	b91c1eba6d	Parse :return: definitions from action docstrings too.	2023-05-21 03:05:19 +02:00
Fabio Manganiello	229b8f2985	Many improvements for the execute panel.	2023-05-21 03:04:52 +02:00
Fabio Manganiello	edf1dbee1d	Updated webapp dist files	2023-05-20 15:54:18 +02:00
Fabio Manganiello	5efc90ca17	Better PWA installation prompt. ... Display a popup modal instead of a confirm box to prompt the user to install the PWA app. `confirm` blocks the JavaScript engine when run in `beforeMount` and therefore the browser won't be able to proceed with `event.prompt()`.	2023-05-20 15:52:37 +02:00
Fabio Manganiello	666ea9ea6b	Added use_werkzeug_server option to backend.http. ... There are situations where you may not want to run the HTTP server in a full blown WSGI-over-Tornado container - unit/integration tests and embedded single-core devices are among those cases. In those scenarios, we should allow the user to be able to run the backend using the built-in Werkzeug server provided by Flask.	2023-05-20 15:26:58 +02:00
Fabio Manganiello	013274bcbc	[#259] Proper support for the progressive webapp (#262) ... Closes: 259 Reviewed-on: platypush/platypush#262	2023-05-20 02:42:33 +02:00
Fabio Manganiello	27d4a20418	Use reflection to infer the arguments of a Python user procedure	2023-05-17 17:17:59 +02:00
Fabio Manganiello	0a1209fe6e	Updated webapp dist files	2023-05-17 10:56:37 +02:00
Fabio Manganiello	33e2879413	Various UI improvements for the execute tab.	2023-05-17 10:41:02 +02:00
Fabio Manganiello	91daec579d	Reverted to the previous style for entities on mobile. ... Better to use screen width wisely and avoid unnecessary padding.	2023-05-17 01:13:09 +02:00
Fabio Manganiello	61ea3d79e4	Large refactor for the inspect plugin. ... More common logic has been extracted and all the methods and classes have been documented and black'd.	2023-05-17 00:05:22 +02:00
Fabio Manganiello	2cba504e3b	Improvements for the autocomplete component.	2023-05-14 15:07:54 +02:00
Fabio Manganiello	8447f9a854	Improved rendering of actions/arguments documentation. ... The frontend now calls `utils.rst_to_html` to render the docstrings as HTML instead of dumping them as raw text. Also, actions and arguments are now cached to improve performance.	2023-05-14 15:06:34 +02:00
Fabio Manganiello	5f2d6dfeb5	Added utils.rst_to_html action.	2023-05-14 15:05:24 +02:00
Fabio Manganiello	3c83e7f412	A faster implementation for the inspect.get_* methods. ... Plugin/backend lookup is now done by inspecting the manifest files instead of searching all the subpackages.	2023-05-13 13:44:46 +02:00
Fabio Manganiello	72797e73ff	Changed the Tornado paradigm to start the WSGI workers. ... Use `bind_sockets`/`fork_processes` instead of reinventing the wheel with our own multiprocessing handling.	2023-05-13 12:35:20 +02:00
Fabio Manganiello	ac4fe4447e	Revert "Added a multi-worker approach to the Tornado WSGI container." ... This reverts commit 71401a4936. Temporarily reverted this commit because the `reuse_address` on the application's `listen` method has only been implemented in Tornado 6.2 - and Debian stable still shipts Tornado 6.1.	2023-05-13 02:36:20 +02:00
Fabio Manganiello	71401a4936	Added a multi-worker approach to the Tornado WSGI container. ... The WSGI container is a good option to wrap a multi-modal webapp (Flask + websocket routes), but it's constrained to a single-process approach and queued/pre-buffered requests. That makes performance poor when handling requests that may take a few seconds to complete.	2023-05-13 01:26:18 +02:00
Fabio Manganiello	b7b93edbae	Updated dist files	2023-05-12 03:52:33 +02:00
Fabio Manganiello	a15191d4ca	Updated dist files	2023-05-12 03:51:59 +02:00
Fabio Manganiello	d4f8e51caf	A less blocking implementation of the entities loading UI logic.	2023-05-12 03:49:20 +02:00
Fabio Manganiello	62d846ddda	Updated dist files	2023-05-12 03:42:17 +02:00
Fabio Manganiello	23a5e90e2e	Updated dist files	2023-05-12 03:26:55 +02:00
Fabio Manganiello	6cd9cb6e76	Better entities caching on the frontend.	2023-05-12 03:18:22 +02:00
Fabio Manganiello	79871e0fa1	Fixed devServer routes in vue.config.js. ... Use `127.0.0.1` instead of `localhost` for the Vue proxy.	2023-05-12 02:57:14 +02:00
Fabio Manganiello	cfedcd701e	Performance improvements when loading the Tensorflow plugin. ... The Tensorflow module may take a few seconds to load the first time and slow down the first scan of the plugins. All the Tensorflow imports should therefore be placed close to where they are used instead of being defined at the top of the module.	2023-05-11 19:48:22 +02:00
Fabio Manganiello	f49ad4c349	Updated dist files	2023-05-10 02:52:24 +02:00
Fabio Manganiello	6b0f0883ee	A proper way to proxy websocket calls using the Vue devServer.	2023-05-10 02:27:01 +02:00
Fabio Manganiello	78c12212c6	[#260] A simple entities caching mechanism using the browser storage.	2023-05-10 02:26:06 +02:00
Fabio Manganiello	74ab884b7a	Proper redirects upon /execute failure. ... If a call to `/execute` fails with a 401 or 412 status, then redirect the user to `/register` or `/login`.	2023-05-10 02:24:50 +02:00
Fabio Manganiello	41233138ff	Blackened inspect module and extracted model defs to adjacent module.	2023-05-09 21:58:02 +02:00
Fabio Manganiello	ab2425ebd0	[#260] Removed legacy backend.websocket. ... It has now been replaced by the `/ws/events` and `/ws/requests` websocket routes under `backend.http`.	2023-05-09 02:46:43 +02:00
Fabio Manganiello	a069d23bb7	[#260] Added `/ws/requests` websocket route.	2023-05-09 02:40:32 +02:00
Fabio Manganiello	7716a416e9	[#260] Support for sending events via websocket over /ws/events.	2023-05-09 02:18:58 +02:00
Fabio Manganiello	edb7197f71	[#260] Implemented authentication for websocket routes. ... Plus, refactored the `backend.http.app.utils` module by breaking it down into multiple components, as the module was starting to get too large.	2023-05-09 00:03:11 +02:00
Fabio Manganiello	2d4b179879	Include the path info in the logging messages in WSRoute.	2023-05-08 12:35:54 +02:00
Fabio Manganiello	3fc622e296	Remove legacy references to the websocket HTTP port and backend in platydock.	2023-05-08 12:25:09 +02:00
Fabio Manganiello	f5fcccb0bd	Refactored the new websocket routes. ... Defined a `platypush.backend.http.ws` package with all the routes, a base `WSRoute` class that all the websocket routes can extend, and a logic in the HTTP backend to automatically scan the package to register exposed websocket routes.	2023-05-08 11:45:14 +02:00
Fabio Manganiello	56dc8d0972	Migrated the webapp to Tornado. ... It was just too painful to find a combination of versions of gunicorn, gevent, eventlet, pyuwsgi etc. that could work on all of my systems. On the other hand, Tornado works out of the box with no headaches. Also in this commit: - Updated a bunch of outdated/required integration dependencies. - Black'd and LINTed a couple of old plugins.	2023-05-08 02:06:45 +02:00
Fabio Manganiello	f81e9061a3	lifespan=on is actually not required on Flask config level.	2023-05-07 16:30:41 +02:00
Fabio Manganiello	692180c653	Back to uvicorn workers from eventlet. ... The eventlet API has way too many dependency issues with gunicorn. Still TODO: Fix or at least mitigate the WSGI workers timeout issue when they handle websocket connections.	2023-05-07 15:37:58 +02:00
Fabio Manganiello	8102178ba4	Updated dist files	2023-05-07 13:00:48 +02:00
Fabio Manganiello	c0a948f8ce	Removed remaining references to websocket port.	2023-05-07 12:54:13 +02:00
Fabio Manganiello	bdbbd24e6f	Only include /ws/events as a proxied websocket, without messing with the /ws route exposed by the Vue debugger	2023-05-07 12:22:51 +02:00
Fabio Manganiello	059fff8558	Updated dist files	2023-05-07 12:19:13 +02:00
Fabio Manganiello	f9b0bc905e	Migrated websocket service. ... The websocket service is no longer provided by a different service, controlled by a different thread running on another port. Instead, it's now exposed directly over Flask routes, using WSGI+eventlet+simple_websocket. Also, the SSL context options have been removed from `backend.http`, for sake of simplicity. If you want to enable SSL, you can serve Platypush through a reverse proxy like nginx.	2023-05-07 12:08:28 +02:00
Fabio Manganiello	3aefc9607d	Migrated from waitress to gunicorn. ... `waitress`, unlike `gunicorn`, doesn't provide an easy way to plug into a WSGI socket that can be used for the websocket interface.	2023-05-07 00:42:57 +02:00
Fabio Manganiello	9951d62511	Added logic to automatically generate the secret key for Flask.	2023-05-06 22:04:48 +02:00
Fabio Manganiello	d1f0e1976c	Exclude squashfs/loopback mounts from system.disk_info.	2023-05-06 18:53:16 +02:00
Fabio Manganiello	e33a391d25	Updated dist files	2023-05-06 12:37:00 +02:00
Fabio Manganiello	4f78d61223	Improved UI on mobile.	2023-05-06 12:34:27 +02:00
Fabio Manganiello	6e939bbe62	Close modals and dropdown when ESC is pressed.	2023-05-05 20:46:42 +02:00
Fabio Manganiello	e9e59c857a	Updated dist files	2023-05-05 02:51:33 +02:00
Fabio Manganiello	59bf1c2aa0	Added close button to the modal's header.	2023-05-05 02:48:41 +02:00
Fabio Manganiello	8af3ae17b8	A more efficient way of detecting the entity groups to display. ... Instead of iterating over each of the entities in a grouping to find out which groups should be displayed based on the selector's policy, the selector can directly keep its `selectedGroups` attribute in sync with the index.	2023-05-05 02:33:34 +02:00
Fabio Manganiello	373788377b	Created two separate actions under variable to delete/unset. ... `delete` will actually remove the record from the database (same as `unset`'s new behaviour), while `unset` will set it to null without deleting it (same as the `unset`'s previous behaviour).	2023-05-05 02:21:18 +02:00
Fabio Manganiello	98b9d31dd4	Updated dist files	2023-05-05 01:10:24 +02:00
Fabio Manganiello	4383dbb2b4	Bluetooth UI toggle aligned to the right - like all other toggles.	2023-05-05 01:04:39 +02:00
Fabio Manganiello	285f3941d9	Always use an external uWSGI server to run the web service. ... Added `waitress` dependency. For performance and security reasons, it's better to always run the Flask application inside of a uWSGI server. `waitress` also makes things easier by avoiding to ask the user to manually provide the external executable arguments, as it was the case with `uwsgi` and `gunicorn`.	2023-05-05 00:07:13 +02:00
Fabio Manganiello	2c254e8eb9	numpy and PIL should be required dependencies for all camera plugins.	2023-05-04 23:44:42 +02:00
Fabio Manganiello	99311a6e71	Updated dist files	2023-05-04 02:23:24 +02:00
Fabio Manganiello	7db09276ca	Some small style improvements.	2023-05-04 02:20:40 +02:00
Fabio Manganiello	2398cac572	A more efficient and clean logic for selectedEntities calculation.	2023-05-04 02:19:55 +02:00
Fabio Manganiello	394e27eaf2	Refactored style for UI dropdowns.	2023-05-04 02:19:09 +02:00
Fabio Manganiello	c690230930	An AssistantEvent should not fail initialization if the assistant integration isn't found.	2023-05-04 00:28:50 +02:00
Fabio Manganiello	5d1c8cf8e9	Additional null check on this.searchTerm	2023-05-03 03:33:34 +02:00
Fabio Manganiello	3482c29679	Updated dist files	2023-05-03 03:18:44 +02:00
Fabio Manganiello	a06d0ef6a1	Merged all the items in the entities panel's header in the Selector component.	2023-05-03 03:14:46 +02:00
Fabio Manganiello	7c7818dd76	Fixed entity search. ... It was broken by the previous refactor of the entities panel, which no longer triggers the `watch` callback on the upstream `entityGroups`. The new approach listens for entity updates on the frontend bus and dynamically creates the entity groupings in `selectedGroups` if they are missing.	2023-05-03 02:12:14 +02:00
Fabio Manganiello	9922305ac5	Fixed grouping for entityGroups.id. ... Unlike the other entity groupings, which are 4-layered (`grouping -> group -> entity_id -> entity`), the grouping by ID only needs 3 layers (`grouping -> entity_id -> entity`).	2023-05-03 02:09:51 +02:00
Fabio Manganiello	cc2ec1db7f	The HTTP Zeroconf service should be registered before the server starts.	2023-05-02 21:24:50 +02:00
Fabio Manganiello	55cb87d14f	Updated dist files	2023-05-02 10:24:11 +02:00
Fabio Manganiello	68359b88a9	More performance improvements for the entities page. ... - Don't recalculate entity groups every time. Instead, keep them in sync every time an entity is added or removed. - Removed `computedChildren` from the entity component - no null nodes are guaranteed to be passed now, so there's no need for another iteration on the list of children. - `childrenByParentId` now only looks in the scope of the entity's children instead of searching all the entities.	2023-05-02 10:14:03 +02:00
Fabio Manganiello	0fc0a22cd7	Reintroduced loading icon spin animation.	2023-05-02 10:08:36 +02:00
Fabio Manganiello	3febfabdd7	Bluetooth LE blacklisted device notices moved info -> debug.	2023-05-01 22:10:06 +02:00
Fabio Manganiello	998990aabc	Made Entity.children_ids resilient against deleted objects.	2023-05-01 22:09:16 +02:00
Fabio Manganiello	9d82ce6ea9	Noisy beacons notice back to debug level. ... There's just too many of them and it ends up polluting the logs.	2023-05-01 21:25:42 +02:00
Fabio Manganiello	ce248ccfbb	Added children_ids to the entity attributes serialized in to_json.	2023-05-01 19:59:13 +02:00
Fabio Manganiello	de76c2b6a8	Updated dist files	2023-05-01 10:12:43 +02:00
Fabio Manganiello	835ad9f2dc	Use plugin as a default entity grouping instead of category	2023-05-01 10:06:11 +02:00
Fabio Manganiello	85ecdcb0cb	Removed entity icon loading animation. ... The animation has a big impact on page loading performance when the system includes a high number of entities that all need their loading animation to be render.	2023-05-01 09:49:34 +02:00
Fabio Manganiello	24c6b7b377	Updated dist files	2023-05-01 01:25:27 +02:00
Fabio Manganiello	b7cf1a42de	Use a proxy value in the variable component for the textbox. ... Otherwise the value may keep being overwritten while the user is typing a new one.	2023-05-01 01:22:20 +02:00
Fabio Manganiello	a3839e637d	Set a max-width: 600px for group containers.	2023-05-01 01:22:02 +02:00
Fabio Manganiello	1e43866978	Moved more entity common CSS out of the Vue component.	2023-05-01 01:21:18 +02:00
Fabio Manganiello	de84a65a22	Show prettified entity type when hover the entity icon.	2023-05-01 01:20:31 +02:00
Fabio Manganiello	7906ee2c49	Entity components style improvements. ... Multiple style improvements for the entity components. Among these: - A more consistent style for entity values and toggler buttons. - Fixed overflowing/underflowing entities on smaller/larger screen sizes. - Simplified the stylesheets for many entities as many component classes have now been moved to `common.scss`.	2023-04-30 22:32:50 +02:00
Fabio Manganiello	d1066ba624	Use Math.round instead of parseInt when parsing durations.	2023-04-30 16:22:37 +02:00
Fabio Manganiello	5d4bffa119	Fixed retrieval of entities plugin.	2023-04-30 10:42:05 +02:00
Fabio Manganiello	94a493580c	Updated dist files	2023-04-30 01:36:13 +02:00
Fabio Manganiello	0b853e0a54	Apply word-break: break-all to entities' names and values. ... The entity name and value in the component header may be arbitrarily long and rendered on small screens. We therefore need to ensure that the text won't overflow the screen width.	2023-04-30 01:17:54 +02:00
Fabio Manganiello	3d7755159f	Improved compatibility for traceback.format_exception. ... The new syntax, that only requires an `Exception` instance to be passed to the function, is only compatible with Python >= 3.10.	2023-04-30 00:38:17 +02:00
Fabio Manganiello	6b28d16ccf	Exclude more noisy Bluetooth beacons. ... Exclude any beacons from devices with no name, no children other than services, and with none of those services being public/known.	2023-04-29 23:34:24 +02:00
Fabio Manganiello	f764d1b4fb	Noisy Bluetooth beacons notices should be logged on info level.	2023-04-29 23:18:12 +02:00
Fabio Manganiello	52f036dc1d	Updated dist files	2023-04-29 22:49:35 +02:00
Fabio Manganiello	cbf0ea8a19	Style fixes for mobile screens.	2023-04-29 22:45:10 +02:00
Fabio Manganiello	e96885a805	Delete the entity on variable.unset instead of setting it to null.	2023-04-29 18:21:57 +02:00
Fabio Manganiello	b4048002b9	Updated dist files	2023-04-29 18:21:32 +02:00
Fabio Manganiello	6d9c34f06f	Added VariableModal to set variables from the dashboard.	2023-04-29 18:20:41 +02:00
Fabio Manganiello	a3888be216	The robustness check in case of missing fields should also apply to other system entities.	2023-04-29 16:08:38 +02:00
Fabio Manganiello	8c9768b05e	Robustness check for system disk entities. ... When the system information is still loading it may happen that the device associated to the disk hasn't been loaded yet.	2023-04-29 16:04:57 +02:00
Fabio Manganiello	a20065c649	Exposed _entities utility property in Plugin. ... It can be used by other plugins to easily access the `entities` plugin, along the lines of `db` and `redis`.	2023-04-29 15:50:31 +02:00
Fabio Manganiello	68d8befa34	Removed some vestigial commented code.	2023-04-29 15:28:44 +02:00
Fabio Manganiello	23b851e9d7	variable.status robustness fix. ... `entities.transform_entities` will pass back an empty list instead of an empty dict if no entities were found, and the function should be able to handle it.	2023-04-29 15:24:58 +02:00
Fabio Manganiello	e919bf95ad	Print the full stack trace if a plugin failed in entities.scan	2023-04-29 15:14:13 +02:00
Fabio Manganiello	38c87ef39f	Added frontend component for the Variable entity.	2023-04-29 11:37:21 +02:00
Fabio Manganiello	f40f956507	Migrated variable table to the new entities framework.	2023-04-29 11:36:55 +02:00
Fabio Manganiello	8fe61217ce	Added _db and _redis properties to the Plugin class. ... Plugins can now access the database and Redis APIs directly without having to run their own `get_plugin` validation logic.	2023-04-29 11:35:57 +02:00
Fabio Manganiello	a8d2261f32	Added core_plugins to the configuration. ... These plugins (only including `variable` for now) are a core part of the application and should always be explicitly enabled.	2023-04-29 11:34:34 +02:00
Fabio Manganiello	78cee5d9b0	Added support for automatic database migrations. ... Added Alembic environment and `run_db_migrations` logic to the entities engine so database schema changes can be processed as soon as the application is started.	2023-04-29 11:32:31 +02:00
Fabio Manganiello	ff9b76477d	Fixed arguments naming.	2023-04-28 11:04:33 +02:00
Fabio Manganiello	162904f281	[#253] Added support for relational filters on event hooks.	2023-04-27 22:07:02 +02:00
Fabio Manganiello	87db5ca5f3	Exclude all iBeacon devices by default (it's not only Apple, it's everyone)	2023-04-26 14:17:59 +02:00
Fabio Manganiello	7685521e2b	Always use the default configuration values for MQTT listeners if not specified	2023-04-26 03:30:05 +02:00
Fabio Manganiello	10d587efd0	FIX: Possible assert evaluation error. ... Some versions/configurations of Python may throw `Boolean value of this clause is not defined` here.	2023-04-26 02:25:28 +02:00
Fabio Manganiello	245472a4c5	Better event hooks filters. ... - Support for nested attributes on event hook conditions. Things like these are now possible: ``` from platypush.event.hook import hook from platypush.message.event.entities import EntityUpdateEvent @hook(EntityUpdateEvent, entity={"external_id": "system:cpu"}) def on_cpu_update_event(event: EntityUpdateEvent, **_): print(event.args["entity"]["percent"]) ``` - The scoring/regex extraction/partial string match logic in `_matches_argument` is actually only needed for `SpeechRecognizedEvent`. Other events don't need these features, and event hooks may be actually triggered unexpectedly in case of partial matches. Therefore, the "complex" `_matches_argument` has been moved as an override only for `SpeechRecognizedEvent`, and all the other events will perform simple key-value matching.	2023-04-26 01:45:58 +02:00
Fabio Manganiello	ee54e0edbf	Use a font-awesome spinner instead of an animated gif when loading entities	2023-04-25 16:42:01 +02:00
Fabio Manganiello	cb288deb71	Exclude more noisy BLE beacons. ... Excluding Apple iBeacons and devices with no name and no services.	2023-04-25 16:19:11 +02:00
Fabio Manganiello	dd60b8924d	Wrap the PRAGMA statement in sqlalchemy.text. ... SQLAlchemy 2 no longer supports raw strings passed to `.execute()` methods.	2023-04-25 10:41:37 +02:00
Fabio Manganiello	440d70d9cf	LINT/format fixes.	2023-04-25 10:36:27 +02:00
Fabio Manganiello	4cc88fcf5f	Rewritten the variable plugin to use SQLAlchemy's ORM. ... This removes the need for raw SQL statements and CREATE TABLE statements that may be engine-specific.	2023-04-25 10:35:12 +02:00
Fabio Manganiello	e1cd22121a	Removed connection.begin() pattern from the db plugin. ... SQLAlchemy should automatically begin a transaction on connection/session creation. Plus, `.begin()` messes up things with SQLAlchemy 2, which has `autobegin` enabled with no easy way of disabling it.	2023-04-25 10:31:49 +02:00
Fabio Manganiello	37722d12cd	No need for session.begin in db.create_all.	2023-04-24 23:55:50 +02:00
Fabio Manganiello	6fa179e769	LINT fixes	2023-04-24 23:49:31 +02:00
Fabio Manganiello	91df18f7b5	Better way to import declarative_base from SQLAlchemy. ... Import `declarative_base` in a way that is compatible with any SQLAlchemy version between 1.3 and 2.x.	2023-04-24 23:21:39 +02:00
Fabio Manganiello	87889142e0	Fixed compatibility with SQLAlchemy >= 2.0 in the db plugin.	2023-04-24 22:52:17 +02:00
Fabio Manganiello	8478245cde	Removed Mapped[Entity] type annotation. ... `Mapped` has been introduced only in SQLAlchemy 1.4, while Debian stable still ships 1.3. Removing the type annotation doesn't come with a big cost, but it keeps Platypush compatible with Debian stable.	2023-04-24 21:48:52 +02:00
Fabio Manganiello	e955ffc018	Be more resilient in DateTimeWeather widget about custom temperature/humidity names or non-numeric data	2023-04-24 12:48:51 +02:00
Fabio Manganiello	5638c567ff	Show temperature and humidity on the DateTimeWeather widget upon sensor events only if the sensor data is numeric.	2023-04-24 10:59:45 +02:00
Fabio Manganiello	bfa296e7c5	Fixed dataclass JSON serialization	2023-04-24 01:18:33 +02:00
Fabio Manganiello	9c03b028d7	Be a bit more resilient if an upstream integration sent some empty entities	2023-04-24 00:44:16 +02:00
Fabio Manganiello	6711b26137	Support dataclass serialization in the standard message serializer.	2023-04-24 00:43:06 +02:00
Fabio Manganiello	dc3392c11d	Disk I/O stats are not always available and should therefore be optional.	2023-04-23 22:25:24 +02:00
Fabio Manganiello	0cd28f1040	libbluetooth-dev is a required dependency to build pybluez on Debian-derived distros	2023-04-23 18:59:37 +02:00
Fabio Manganiello	9c1855e4c0	Fixed docstring for zigbee.mqtt plugin.	2023-04-23 13:03:10 +02:00
Fabio Manganiello	512ced3e94	Updated dist files	2023-04-23 02:13:48 +02:00
Fabio Manganiello	6439e235d2	Updated caniuse dependency	2023-04-23 02:11:21 +02:00
Fabio Manganiello	27b1048789	Converted system.processes to the new data model.	2023-04-23 02:08:43 +02:00
Fabio Manganiello	387616ea96	Convert system.connected_users to the new data model.	2023-04-23 01:12:07 +02:00
Fabio Manganiello	259b42bdd6	Removed legacy backend.sensor.battery.	2023-04-23 00:44:03 +02:00
Fabio Manganiello	763d9e06ec	Increased default poll_interval for system plugin to 60 seconds.	2023-04-23 00:42:44 +02:00
Fabio Manganiello	a72c32cb00	Added battery entity support to system plugin.	2023-04-23 00:41:21 +02:00
Fabio Manganiello	b3440ab96b	Added support for fan sensors on the system plugin.	2023-04-23 00:08:27 +02:00
Fabio Manganiello	45d5f439be	Added support for system temperature sensor entities.	2023-04-22 22:42:11 +02:00
Fabio Manganiello	1b048e1952	s/net_connections/network_connections/g	2023-04-22 17:19:24 +02:00
Fabio Manganiello	374f936c1f	Merged network_stats into NetworkInterface model.	2023-04-22 17:19:24 +02:00
Fabio Manganiello	f4036be52b	Extracted and refactored more common elements of the Entity components.	2023-04-22 17:19:23 +02:00
Fabio Manganiello	e213941791	s/net_io_counters/network_info/g	2023-04-22 17:19:23 +02:00
Fabio Manganiello	977b55dea9	Merged network addresses into NetworkInterface model.	2023-04-22 17:19:23 +02:00
Fabio Manganiello	ebe79ac29a	Refactored system schema dataclasses. ... - `percent_field` should be declared on `platypush.schemas.dataclasses` level, since it's not specific to the `system` plugin. - Added a common `SystemBaseSchema` that takes care of calling `_asdict()` if the object is passed as a `psutil` object instead of a dict.	2023-04-22 17:19:23 +02:00
Fabio Manganiello	2d618188c8	Print the full exception stack trace if .status fails.	2023-04-22 17:19:23 +02:00
Fabio Manganiello	b3a0896485	Converted NetworkConnection schema/response.	2023-04-22 17:19:22 +02:00
Fabio Manganiello	d473b5d836	Make the recursive entity merger/column set logic more resilient against ObjectDeletedError	2023-04-22 10:40:30 +02:00
Fabio Manganiello	98a300c4b1	Added NetworkInterface entities to system plugin. ... Plus, `platypush.schemas.system` has now been split into multiple submodules to avoid a single-file mega-module with all the system schemas definitions.	2023-04-21 00:45:15 +02:00
Fabio Manganiello	44b8fd4b34	Support for disk entities in the system integration.	2023-04-20 16:26:51 +02:00
Fabio Manganiello	6b03451386	Better responsive alignment for the collapse toggler.	2023-04-20 16:26:05 +02:00
Fabio Manganiello	e8c96ad35d	Added convertTime utility function	2023-04-20 02:27:58 +02:00
Fabio Manganiello	153d03d43f	Moved CPU percentage on the level of the CPU entity instead of a child entity.	2023-04-19 01:48:05 +02:00
Fabio Manganiello	4ebfbf3851	Added memory stats entities.	2023-04-19 01:31:11 +02:00
Fabio Manganiello	0073239a40	Support for CPU load_average entity.	2023-04-18 18:26:02 +02:00
Fabio Manganiello	1cee0459cf	Added CpuFrequency entity to system.	2023-04-18 01:49:36 +02:00
Fabio Manganiello	a5b0a524f6	Added CpuStats entity to system.	2023-04-18 01:19:06 +02:00
Fabio Manganiello	b4fbd3e915	Added percent entity to cpu.	2023-04-17 02:25:04 +02:00
Fabio Manganiello	711cc2b239	Removed (now unused) CpuTimesResponse.	2023-04-17 02:25:03 +02:00
Fabio Manganiello	b9286f50b0	Added support for CpuTimes as an entity of the system plugin. ... Also, there is now a single `Cpu` entity being exported, with a nested hierarchy structured like: ``` cpu -> cpu_info -> cpu_times -> idle -> user -> system -> ... -> cpu_load -> ... ```	2023-04-17 02:25:03 +02:00
Fabio Manganiello	4842c1911b	Frontend entities should have a reference to allEntities. ... There are probably more optimal ways of achieving this other than passing a reference to the full list of entities to each of the entities, such as running a BFS to recursively expand all the entities within the child hierarchy of an entity. This is needed because the entity needs to know which entities aren't direct children, but are two or more layers down in the hierarchy, so they should be passed to their own child entities.	2023-04-17 02:25:03 +02:00
Fabio Manganiello	6e65783feb	Added schemas for CpuTimes.	2023-04-17 02:25:03 +02:00
Fabio Manganiello	e810025a6d	Added Cpu and CpuTimes entities.	2023-04-17 02:25:03 +02:00
Fabio Manganiello	65481dc6b4	Added PercentSensor entity type.	2023-04-17 02:25:02 +02:00
Fabio Manganiello	e7f64843a5	Added include_children parameter to _merge_columns. ... We need to recursively merge the columns of children entities if a child entity isn't a leaf node.	2023-04-17 02:25:02 +02:00
Fabio Manganiello	b43017ef01	Refactoring the system plugin to support entities.	2023-04-17 02:25:02 +02:00
Fabio Manganiello	3e3c48d779	Defined new entity and schema for CpuInfo.	2023-04-17 02:25:02 +02:00
Fabio Manganiello	186a21f715	Added CpuInfo entity frontend components.	2023-04-17 02:25:01 +02:00
Fabio Manganiello	74aeca5c34	Trigger a sensor event only if abs(old_data - new_data) > tolerance ... Not if abs(old_data - new_data) >= tolerance, otherwise events will always be triggered when tolerance=0, even if the data hasn't changed.	2023-04-17 02:25:01 +02:00
Fabio Manganiello	4c19535612	A more resilient logic on entity copy/serialization to prevent ObjectDeletedError	2023-04-13 17:16:21 +02:00
Fabio Manganiello	a499b7bc2f	Deprecated poll_seconds in light.hue. ... For sake of naming consistency with other plugins, we should use `poll_interval` instead.	2023-04-03 01:36:12 +02:00
Fabio Manganiello	10955dad72	Fixed some documentation glitches in switchbot.	2023-04-03 01:36:12 +02:00
Fabio Manganiello	6e5f746dbe	Removed deprecated gpio.sensor base plugin. ... Now all the plugins that used to implement it have been moved to `SensorPlugin`.	2023-04-03 01:36:12 +02:00
Fabio Manganiello	8852cb8db4	Fixed new class name for sensor.mcp3008 plugin.	2023-04-03 01:36:12 +02:00
Fabio Manganiello	d5ddc0c65e	Migrated arduino integration to the new SensorPlugin API.	2023-04-03 01:36:12 +02:00
Fabio Manganiello	cf16076bce	Added icons for new entity sensor sources.	2023-04-03 01:36:11 +02:00
Fabio Manganiello	ac2ec58f89	Migrated mcp3008 integration to the new SensorPlugin API.	2023-04-03 01:36:11 +02:00
Fabio Manganiello	45e5ca47e7	Fallback for sensor._has_changes	2023-04-02 15:38:49 +02:00
Fabio Manganiello	962c55937d	Migrated sensor.distance integration. ... Remove `backend.sensor.distance` and `gpio.sensor.distance`. They are now replaced by the `sensor.hcsr04` integration, which is compatible with the new `SensorPlugin` API.	2023-04-02 14:20:12 +02:00
Fabio Manganiello	92578a17c9	Added small docstring portion	2023-04-02 13:55:00 +02:00
Fabio Manganiello	beff88986a	Migrated dht integration. ... Removed `backend.sensor.dht` and `gpio.sensor.dht`. They have been merged into the new `sensor.dht` integration, which supports the new `SensorPlugin` API.	2023-04-02 13:38:53 +02:00
Fabio Manganiello	8f604445a2	Migrated old sensor.accelerometer integration. ... Removed `backend.sensor.accelerometer` and `gpio.sensor.accelerometer`. The logic has now been merged in the new `sensor.lis3dh` integration, which is compatible with the new `SensorPlugin` API.	2023-04-02 13:22:28 +02:00
Fabio Manganiello	44cf25271c	Migrated pmw3901 integration. ... Removed legacy `backend.sensor.motion.pmw3901` and `gpio.sensor.motion.pmw3901`. They have been merged in the new `sensor.pmw3901` integration, compatible with the new `SensorPlugin` API.	2023-04-02 12:36:08 +02:00
Fabio Manganiello	fcdda40c4a	Update the _last_measurement only if some events were processed from the new data.	2023-04-02 12:09:45 +02:00
Fabio Manganiello	88784985e1	Should be abs(old_data - new_data) >= tolerance. ... Not `abs(old_data - new_data) > tolerance`.	2023-04-02 12:08:40 +02:00
Fabio Manganiello	a3f4b21478	Updated dist files	2023-04-02 03:24:11 +02:00
Fabio Manganiello	e6e5dec088	Updated dist files	2023-04-02 02:56:09 +02:00
Fabio Manganiello	7697c1c6ad	Migrated envirophat to the new SensorPlugin API. ... Removed `backend.sensor.envirophat` and `gpio.sensor.envirophat` plugin. They have now been merged into the new `sensor.envirophat` plugin.	2023-04-02 02:49:08 +02:00
Fabio Manganiello	3cd42c9e45	Entity should use Message.Encoder as a JSON serializer.	2023-04-02 02:44:19 +02:00
Fabio Manganiello	31f411868c	Message.Encoder should serialize binary data to 0x-led hex strings.	2023-04-02 02:43:06 +02:00
Fabio Manganiello	9e5ad0e0b1	Entity.to_dict now takes into account columns mapped to properties. ... No more `_value` in the JSON output instead of the `value` property. If a column is marked as private, and there's an associated property mapped to its public name, then we should use and serialize that value.	2023-04-02 02:22:40 +02:00
Fabio Manganiello	8d4aa310f4	Support for values passed in dict format to ThreeAxisSensor	2023-04-02 02:02:08 +02:00
Fabio Manganiello	5a6f4bcf57	Added 3-axis sensor, accelerometer and magnetometer entities	2023-04-02 01:13:22 +02:00
Fabio Manganiello	d964167631	s/TimeDurationSensor/TimeDuration/g	2023-04-02 00:57:48 +02:00
Fabio Manganiello	839c6108a0	Added sensor.* icon classes	2023-04-02 00:40:50 +02:00
Fabio Manganiello	429893ddbf	Updated dist files	2023-04-01 23:58:28 +02:00
Fabio Manganiello	f24d0773d1	No need for sensor.vl53l1x.transform_entities to call the parent.	2023-04-01 23:54:43 +02:00
Fabio Manganiello	99572f9731	Sanity check to prevent empty objects from being propagated to sensor.transform_entities	2023-04-01 23:41:28 +02:00
Fabio Manganiello	3f3726c50a	Fixed another occurrence of "Subscripted generics cannot be used" etc. error	2023-04-01 23:34:22 +02:00
Fabio Manganiello	e2e73d0fdb	Fix another Python < 3.10 subscripted generic issue.	2023-04-01 23:23:51 +02:00
Fabio Manganiello	c1d0f21ead	Migrated ltr559 integration to the new API. ... Merged `backend.sensor.ltr559` and `gpio.sensor.ltr559` into the new `sensor.ltr559` plugin, which extends the new `SensorPlugin` API.	2023-04-01 23:16:03 +02:00
Fabio Manganiello	8e0f88ea16	Don't swap the argument of SensorPlugin.publish_entities with a list if not required	2023-04-01 23:06:37 +02:00
Fabio Manganiello	0047d85b9d	Dirty fix for "Subscripted generics cannot be used with class and instance checks" on Python < 3.10	2023-04-01 22:52:24 +02:00
Fabio Manganiello	98ec018292	Replaced NoneType reference. ... `types.NoneType` is not always available on all Python versions, so we have to make our own type for it.	2023-04-01 22:42:13 +02:00
Fabio Manganiello	5dabfed365	Migrated sensor.bme280 to the new SensorPlugin interface. ... Removed the old `backend.sensor.bme280` and the old `gpio.sensor.bme280` plugin. They have now been merged into the new `sensor.bme280` runnable plugin, which extends the `SensorPlugin` API and supports entities.	2023-04-01 22:31:24 +02:00
Fabio Manganiello	6f237a1500	Support the deprecated poll_seconds option on RunnablePlugin	2023-04-01 22:02:59 +02:00
Fabio Manganiello	c23e8867e2	Added enabled_sensors to the sensor plugin	2023-04-01 21:56:56 +02:00
Fabio Manganiello	7912a59ff8	vl53l1x plugin migrated to the new SensorPlugin interface.	2023-04-01 19:31:13 +02:00
Fabio Manganiello	6a5a5de03e	serial plugin migrated to the new SensorPlugin interface.	2023-04-01 19:29:56 +02:00
Fabio Manganiello	bf4db76830	Legacy sensor backend replaced by an extended sensor runnable plugin.	2023-04-01 19:24:35 +02:00
Fabio Manganiello	bf75eb73ac	Added an abstract base SensorDataEvent for sensor events.	2023-03-31 22:51:35 +02:00
Fabio Manganiello	6a3ade3304	Added common.sensors package. ... The package contains the base types and constants shared across sensor-based integrations.	2023-03-31 22:50:47 +02:00
Fabio Manganiello	42d468c895	get_lock should raise a TimeoutError if lock.acquire is False	2023-03-31 22:31:32 +02:00
Fabio Manganiello	7bdd877e49	Support the binary flag both on serial.read and serial.write.	2023-03-31 14:31:45 +02:00
Fabio Manganiello	1efaff878e	Rewritten serial plugin. ... `backend.serial` has been removed and the polling logic merged into the `serial` plugin. The `serial` plugin now supports the new entity engine as well.	2023-03-31 14:31:45 +02:00
Fabio Manganiello	2a8a3f4394	Removed legacy sensor.distance.vl53l1x backend	2023-03-31 14:26:14 +02:00
Fabio Manganiello	a3e8c7c155	Rewritten vl53l1x integration as a runnable plugin with entity support	2023-03-31 14:25:05 +02:00
Fabio Manganiello	226034946f	Added distance_sensor entity	2023-03-31 14:22:28 +02:00
Fabio Manganiello	6fb362a6fb	gpio.sensor.distance.vl53l1x -> sensor.distance.vl53l1x	2023-03-31 14:21:48 +02:00
Fabio Manganiello	e198f2a175	Replaced .title in get_plugin with .upper on the first character. ... `str.title` capitalizes any alphabetic letter after any non-alphabetic letter. That's a problem for Platypush plugins' naming convention, because plugins like `sensor.distance.vl53l1x` may be broken into `sensor.distance.vl53.l1.x`.	2023-03-31 14:09:43 +02:00
Fabio Manganiello	c2f9ebf4ed	Updated dist files	2023-03-27 01:47:29 +02:00
Fabio Manganiello	2781eb1fb1	Merge branch 'master' into 29-generic-entities-support	2023-03-27 00:36:50 +02:00
Fabio Manganiello	7a368ebbb8	[#240] Migrated clipboard plugin from pyperclip to pyclip. ... Closes: #240	2023-03-26 23:52:15 +02:00
Fabio Manganiello	bce2fdee25	Replaced deprecated asyncio.wait([]) with asyncio.gather(*[]).	2023-03-26 23:15:53 +02:00
Fabio Manganiello	cf91ab90df	Increased default width of nav on desktop+	2023-03-26 23:10:46 +02:00
Fabio Manganiello	c0251ef2f7	s/instance/instance_name/g in LinodeInstanceStatusChanged. ... For sake of consistency - we also have `instance_id` and having the instance name assigned to the `instance` attribute is quite ambiguous.	2023-03-26 22:58:20 +02:00
Fabio Manganiello	6d674fef21	Fixed small JSON syntax error in the docstring of ntfy.send_message.	2023-03-26 22:53:42 +02:00
Fabio Manganiello	30124e7cef	Fixed docstring of Event.__init__.	2023-03-26 22:53:11 +02:00
Fabio Manganiello	276aff757b	Removed circular dependency. ... Workaround for the circular dependency between `platypush.entities.bluetooth` and `platypush.plugins.bluetooth.model`. Unentangling the circular dependency would require way too much work, since the entity model provides several helpers and properties that depend on the plugin's model. The workaround in this commit is to simply push those imports down in the methods that use them, so they won't be imported until those methods are called, as well as removing some type annotations that depended on those objects.	2023-03-26 15:30:57 +02:00
Fabio Manganiello	89bc54da22	Updated dist files	2023-03-26 12:30:46 +02:00
Fabio Manganiello	295758bb20	Added frontend components for cloud instances.	2023-03-26 12:27:17 +02:00
Fabio Manganiello	bc2730c841	Rewritten linode integration. ... - Support for cloud instances as native entities. - Using Marshmallow dataclasses+schemas instead of custom `Response` objects. - Merge `linode` backend into `linode` plugin.	2023-03-26 11:23:33 +02:00
Fabio Manganiello	4b9c5a0203	Support for schema EnumField.	2023-03-26 03:48:32 +02:00
Fabio Manganiello	026662f6b6	Added base schema for Marshmallow dataclasses.	2023-03-26 03:47:44 +02:00
Fabio Manganiello	7bbae55e44	platypush.entities._managers -> platypush.entities.managers. ... It's better for entity managers to be stored in their own public package, instead of cluttering too much the namespace of their parent package.	2023-03-26 03:46:06 +02:00
Fabio Manganiello	89d85baa6d	Support for implicit serialization of Enum values in JSONAble.	2023-03-26 03:43:04 +02:00
Fabio Manganiello	a71017df33	Updated web app files	2023-03-24 16:45:55 +01:00
Fabio Manganiello	567e9d4e21	Removed legacy bluetooth backends. ... No replacements have been made for the OBEX backends (push and file services). PyOBEX is too broken and unmaintained, and there are too many poorly documented steps required to get an unprivileged user to run an SDP service.	2023-03-24 16:41:30 +01:00
Fabio Manganiello	3c355352c5	Using the new StoppableThread API.	2023-03-24 16:39:30 +01:00
Fabio Manganiello	5ebf4e912e	Added wait_stop and shoud_stop methods to StoppableThread.	2023-03-24 16:05:18 +01:00
Fabio Manganiello	998793e94f	Added OBEX_FILE_TRANSFER constant to directory stub.	2023-03-24 15:41:20 +01:00
Fabio Manganiello	4b4db5b3c7	Added StoppableThread common interface.	2023-03-24 15:40:16 +01:00
Fabio Manganiello	2f49ddf33a	Fallback logic that uses DBus to disconnect from a BT device. ... This logic will be used if the connection wasn't opened by the current process and therefore a call to DBus is required to terminate it.	2023-03-24 01:57:05 +01:00
Fabio Manganiello	913ef6f8cd	Refresh BluetoothDevice.reachable when a device is found/lost.	2023-03-24 01:56:19 +01:00
Fabio Manganiello	d46d4e2300	Added support for Bluetooth devices blacklist. ... Based on device address, name or manufacturer.	2023-03-24 01:52:39 +01:00
Fabio Manganiello	0cebcf4f9b	switchbot.bluetooth integration migrated to a bluetooth plugin.	2023-03-23 17:46:54 +01:00
Fabio Manganiello	4fac110bb8	Added bluetooth.set method, whose execution is delegated to the plugins.	2023-03-23 17:45:02 +01:00
Fabio Manganiello	cd219f44c4	Pass the list of plugins when creating Bluetooth managers.	2023-03-23 17:42:16 +01:00
Fabio Manganiello	43289a3b55	Scan always at least for 10 seconds before failing on get_device.	2023-03-23 17:41:37 +01:00
Fabio Manganiello	6267943786	Wrap BleakError exceptions into AssertionError.	2023-03-23 17:40:30 +01:00
Fabio Manganiello	d6805a8b18	Added support for custom Bluetooth device plugins.	2023-03-23 17:10:37 +01:00
Fabio Manganiello	af125347d6	If no matching services are found when connecting to a device, default to BLEManager. ... GATT characteristics are not necessarily exposed as services.	2023-03-23 13:00:26 +01:00
Fabio Manganiello	d1cd6dd2af	get_plugin with reload=True should stop the existing plugin if it's running	2023-03-23 01:11:54 +01:00
Fabio Manganiello	a2a5fce6cb	Added Apple Continuity to the list of blacklisted manufacturers/models	2023-03-22 22:55:19 +01:00
Fabio Manganiello	e71c312133	Always read an entity's parent through get_parent when climbing up. ... This should avoid the risk of `DetachedInstanceError` by retrieving the object into the session if it's not available.	2023-03-22 22:41:09 +01:00
Fabio Manganiello	5c23d3aa87	metadata and rssi fields on BLEDevice have been deprecated. ... Changed the BLE beacon parsing logic to read those fields from `AdvertisementData` instead of `BLEDevice`.	2023-03-22 22:39:01 +01:00
Fabio Manganiello	65bc3ae06d	Noisy beacons device configuration should look both at manufacturer and model.	2023-03-22 22:37:46 +01:00
Fabio Manganiello	f49b866a51	Focus the <input> element when a <NameEditor> element is created.	2023-03-22 21:28:21 +01:00
Fabio Manganiello	dd80dc998c	Show entity icon and type in the list of children entities on EntityModal.	2023-03-22 21:26:59 +01:00
Fabio Manganiello	239dd17f23	Exclude from the list of display children on EntityModal those with no name or that are configuration values.	2023-03-22 16:38:38 +01:00
Fabio Manganiello	e10bec88c0	Noisy beacons logging trace moved from info to debug.	2023-03-22 16:31:57 +01:00
Fabio Manganiello	5dd95362a1	Include links both to the parent and children entities in EntityModal.	2023-03-22 16:20:29 +01:00
Fabio Manganiello	99cfd247a5	A more effective logic to exclude noisy BLE beacons. ... This includes BLE beacons sent from all Google/Apple/Microsoft/Samsung beacon networks in all of their variants.	2023-03-22 15:35:02 +01:00
Fabio Manganiello	01d323fad0	Passing a boolean exclude_known_noisy_beacons to bluetooth plugin. ... The logic to exclude BLE beacons from randomized devices needs to be a bit more granular and not limited only to the reported device manufacturer.	2023-03-22 15:29:19 +01:00
Fabio Manganiello	f6e09d34e4	A more clever logic of parsing the manufacturer for BLE devices. ... 1. Check the manufacturer parsed via Bleak/Theengs 2. Check the MAC address prefix in the oui numbers table 3. Check from the reported `manufacturer_data`	2023-03-22 14:16:00 +01:00
Fabio Manganiello	f7e8cfe5a7	Don't include unit in BLE sensors when they are matched against the native type. ... It's likely to just include the native type name anyway.	2023-03-22 14:14:59 +01:00
Fabio Manganiello	486f37a45e	Support sensor value reported both on value as well as _value fields.	2023-03-22 14:11:13 +01:00
Fabio Manganiello	bfc87e0f7b	Display arrays and objects in the entity modal as prettified JSON.	2023-03-22 13:50:35 +01:00
Fabio Manganiello	c750d83188	Prevent name collisions on bluetooth.ServiceClass.	2023-03-22 03:27:25 +01:00
Fabio Manganiello	174b1ee6a9	Use a default list of excluded Bluetooth manufacturers.	2023-03-21 16:03:01 +01:00
Fabio Manganiello	e9abb5cb9a	Implemented support for child entities in entity modals.	2023-03-21 16:02:02 +01:00
Fabio Manganiello	b1cb7ef847	Added a list of excluded_manufacturers to BluetoothPlugin.	2023-03-21 14:32:45 +01:00
Fabio Manganiello	718e0434ba	Display all available entity attributes on EntityModal.	2023-03-20 14:32:03 +01:00
Fabio Manganiello	78bbe71be1	Another .pull-right fix.	2023-03-20 02:04:32 +01:00
Fabio Manganiello	3743ee4f00	s/TheengsGateway/TheengsDecoder/g now that the pip package has been published.	2023-03-20 01:41:21 +01:00
Fabio Manganiello	431dedf3eb	BluetoothDevice moved to its own component, with device connect support.	2023-03-20 01:28:12 +01:00
Fabio Manganiello	0a4b22c12e	Implemented connect/disconnect call on BluetoothService component.	2023-03-20 01:27:47 +01:00
Fabio Manganiello	714f853751	Pass the list of children to the entity component.	2023-03-20 01:27:21 +01:00
Fabio Manganiello	a011de890b	Better .pull-right class implementation.	2023-03-20 01:26:48 +01:00
Fabio Manganiello	2b5596820b	Made Types.objectsEqual method more robust against null input	2023-03-19 22:50:23 +01:00
Fabio Manganiello	71a3481560	Better style for the sidebar/nav	2023-03-19 22:23:37 +01:00
Fabio Manganiello	12096f2dbe	Don't fail hard when device disconnection fails.	2023-03-19 12:56:53 +01:00
Fabio Manganiello	40f81b105f	Set the connected flag when connecting/disconnecting from a service.	2023-03-19 12:56:31 +01:00
Fabio Manganiello	9d66b63266	BluetoothService attributes fixes. ... BluetoothService IDs should always be in the format `address::uuid` and the name should always be in title format.	2023-03-19 12:55:14 +01:00
Fabio Manganiello	6e9263c4e4	A more elegant logic to infer the manufacturer name.	2023-03-19 12:54:52 +01:00
Fabio Manganiello	b568876474	Use a service's UUID as a name instead of Unknown if the service is unknown.	2023-03-19 12:54:09 +01:00
Fabio Manganiello	aa04741daa	Added BluetoothService UI component	2023-03-19 12:53:23 +01:00
Fabio Manganiello	f74fab795d	Added parent component value to Entity.	2023-03-19 12:50:45 +01:00
Fabio Manganiello	243de15813	Added connected flag to BluetoothService.	2023-03-19 12:49:38 +01:00
Fabio Manganiello	256d9adbf2	Removed children from BluetoothDevice.to_json - it makes events too verbose	2023-03-19 12:48:11 +01:00
Fabio Manganiello	4144e4f842	Fixed self._ip_to_dev expansion	2023-03-19 12:47:07 +01:00
Fabio Manganiello	878fe91155	Big rewrite/refactor of the entities merger	2023-03-19 12:40:48 +01:00
Fabio Manganiello	2411b961e8	[WIP] Big, big refactor of the Bluetooth integration. ... - Merged together Bluetooth legacy and BLE plugins and scanners. - Introduced Theengs as a dependency to infer BLE device types and create sub-entities appropriately. - Using `BluetoothDevice` and `BluetoothService` entities as the bread and butter for all the Bluetooth plugin's components. - Using a shared cache of devices and services between the legacy and BLE integrations, with merging/coalescing logic included. - Extended list of discoverable services to include all those officially supported by the Bluetooth specs. - Instantiate a separate pool of workers to discover services. - Refactor of the Bluetooth events - all of them are now instantiated from a single `BluetoothDevice` object.	2023-03-13 02:31:21 +01:00
Fabio Manganiello	4bc61133c5	The Entity object should also have a to_json method.	2023-03-12 23:01:51 +01:00
Fabio Manganiello	4a8da80c7c	Don't join self._thread on stop in RunnablePlugin if self._thread = current_thread	2023-03-11 23:45:46 +01:00
Fabio Manganiello	31552963c4	EntitiesDb.upsert should return a deep copy of the upserted entities. ... Not the upserted entities themselves, no matter if expunged or made transient. Reminder to my future self: returning the flushed entities and then using them outside of the session or in another thread opens a big can of worms when using SQLAlchemy.	2023-03-10 12:06:36 +01:00
Fabio Manganiello	f45e47363d	Use lazy='joined' instead of lazy='selectin' on Entity.parent. ... That's the best way to ensure that all the columns are fetched eagerly and prevent errors later when trying to access lazily loaded attributes outside of the session/thread.	2023-03-10 12:01:23 +01:00
Fabio Manganiello	8ccf3e804d	Added utility get_entities_engine() function.	2023-03-10 11:49:23 +01:00
Fabio Manganiello	60da930e4b	Added support for get_plugin(MyPlugin) besides get_plugin('my').	2023-03-10 11:47:39 +01:00
Fabio Manganiello	3fcc9957d1	A dirty fix to prevent DetachedInstanceError when accessing the parent entity.	2023-03-10 11:45:44 +01:00
Fabio Manganiello	ceb7a2f098	EntitiesEngine synchronization improvements. ... - Added `wait_start()` method that other threads can use to synchronize with the engine and wait before performing db operations. - Callback logic wrapped in a try/except block to prevent custom integrations with buggy callbacks from crashing the engine.	2023-03-10 00:57:24 +01:00
Fabio Manganiello	73dc2463f1	Added auto_commit=False to entities.save()	2023-03-10 00:40:51 +01:00
Fabio Manganiello	7e92d5f244	Added recursive .copy() method to Entity.	2023-03-09 22:35:31 +01:00
Fabio Manganiello	9f9ee575f1	Added _import_error_ignored_modules. ... ImportErrors on these entity modules will be ignored when dynamically loading them, since they have optional external dependencies and we shouldn't throw an error if we can't import them.	2023-03-09 01:40:35 +01:00
Fabio Manganiello	c4efec6832	Several fixes and improvements on the entities engine. ... - Support for an optional callback on `publish_entities` to get notified when the published object are flushed to the db. - Use `lazy='selectin'` for the entity parent -> children relationship - it is more efficient and it ensures that all the data the application needs is loaded upfront. - `Entity.entity_key` rolled back to `<external_id, plugin>`. The fallback logic on `<id, plugin>` created more problems than those it as supposed to solve. - Added `expire_on_commit=False` to the entities engine session to make sure that we don't get errors on detached/expired instances.	2023-03-09 01:16:04 +01:00
Fabio Manganiello	1781a19a79	s/Entity.to_json/Entity.to_dict/g ... stuff	2023-03-06 23:46:33 +01:00
Fabio Manganiello	b9efa9fa30	entity_key should coalesce (entity.external_id or entity.id)	2023-03-06 16:54:02 +01:00
Fabio Manganiello	72c55c03f2	[WIP] Refactoring/extending models and parsers for Bluetooth entities.	2023-03-03 02:10:11 +01:00
Fabio Manganiello	a688e7102e	Changed default poll_interval for RunnablePlugin. ... 30 -> 15 seconds.	2023-03-03 02:00:48 +01:00
Fabio Manganiello	ead4513915	Added optional unit column to RawSensor entity.	2023-03-03 01:59:27 +01:00
Fabio Manganiello	7be55e446f	Convert UUID objects to strings when serializing to JSON.	2023-03-02 21:58:26 +01:00
Fabio Manganiello	15fadb93bb	Added stand-alone connect and disconnect actions to bluetooth.	2023-02-25 01:59:35 +01:00
Fabio Manganiello	70d1bb893c	A cleaner way of calculating the success response attribute.	2023-02-25 01:58:09 +01:00
Fabio Manganiello	2dfb389630	Added remaining bluetooth entity types in _mappers.py.	2023-02-23 21:20:41 +01:00
Fabio Manganiello	a0556d3a42	Added PresenceSensor entities.	2023-02-23 01:42:26 +01:00
Fabio Manganiello	886b930e2f	Support for bluetooth devices with multiple temperature sensors.	2023-02-23 01:27:31 +01:00
Fabio Manganiello	56d693032a	Added DewPointSensor entities.	2023-02-23 01:23:04 +01:00
Fabio Manganiello	d212276247	Added PressureSensor entities.	2023-02-23 01:12:27 +01:00
Fabio Manganiello	dd3f683006	Added unit to bluetooth mappers whenever available.	2023-02-23 01:04:33 +01:00
Fabio Manganiello	d961e2a997	Added TimeDurationSensor entity.	2023-02-23 01:02:13 +01:00
Fabio Manganiello	c3e16f9f9d	Added support for heart rate sensor entities.	2023-02-23 00:55:55 +01:00
Fabio Manganiello	3dab94c346	Added StepsSensor detection to bluetooth.	2023-02-23 00:50:06 +01:00
Fabio Manganiello	e1b3d52706	Added StepsSensor entity.	2023-02-23 00:45:58 +01:00
Fabio Manganiello	dcab766cef	Only scan for the configured Bluetooth service UUIDs.	2023-02-22 03:36:16 +01:00
Fabio Manganiello	d8c429f4a8	Major improvements on the entities engine. ... - Better logic to recursively link parent/children entities, so partial updates won't get lost. - Removed `EntitiesCache` - it was too much to maintain while keeping consistent with the ORM, and it was a perennial fight against SQLAlchemy's own cache. - Removed `EntityNotifier` - with no need to merge cached entities, the `notify` method has become much simpler and it's simply been merged in the `EntitiesRepository`.	2023-02-22 02:53:45 +01:00
Fabio Manganiello	9776921836	Better way of handling with RawSensor in bluetooth integration.	2023-02-22 02:26:51 +01:00
Fabio Manganiello	a5a923a752	Added BluetoothDeviceNewDataEvent. ... These events handle the case where a Bluetooth device only publishes new service data without advertising any additional updated properties.	2023-02-22 02:23:11 +01:00
Fabio Manganiello	dc7cbe743d	Refactored/improved RawSensor entity. ... It will now automatically deal with most of the native types and convert them to strings on the db.	2023-02-22 02:19:19 +01:00
Fabio Manganiello	b2ffc08c89	s/MultiValueSensor/CompositeSensor/g on smartthings	2023-02-22 02:18:12 +01:00
Fabio Manganiello	340fd08064	Removed some old type: ignore comments.	2023-02-22 01:29:51 +01:00
Fabio Manganiello	cf219d5a48	Added some more docstrings to entities.	2023-02-22 01:02:26 +01:00
Fabio Manganiello	7fa545d7f8	Merge branch 'master' into 29-generic-entities-support	2023-02-22 00:46:33 +01:00
Fabio Manganiello	c645ce6bb8	Bump version: 0.24.4 → 0.24.5	2023-02-22 00:32:57 +01:00
Fabio Manganiello	bbc9647cb0	s/MultiValueSensor/CompositeSensor/g	2023-02-21 23:14:10 +01:00
Fabio Manganiello	2fa45fc5a3	Documentation and LINT fixes for sensor entities.	2023-02-21 23:10:05 +01:00
Fabio Manganiello	b4627ecd04	Removed deprecated use_unicode parameter from MPDClient	2023-02-20 20:35:33 +01:00
Fabio Manganiello	aa0b909fff	Use the TheengsDecoder to parse Bluetooth packets and map services to native entities.	2023-02-20 20:27:17 +01:00
Fabio Manganiello	73bf2446bd	Wrap bluetooth.connect in a per-device locked section.	2023-02-19 23:11:19 +01:00
Fabio Manganiello	9112239ac3	Better exception management in AsyncRunnablePlugin. ... Exceptions that cause the termination of the plugin's loop should always be logged as such, unless the plugin is supposed to stop and various exceptions may occur upon teardown.	2023-02-19 23:03:27 +01:00
Fabio Manganiello	a6c36fa1c1	Added brand, model and model_id columns to BluetoothDevice.	2023-02-19 23:02:04 +01:00
Fabio Manganiello	68e6b271c1	Updated dist files	2023-02-19 22:58:20 +01:00
Fabio Manganiello	cb9b01c89f	Added raw_sensor metadata	2023-02-19 22:57:50 +01:00
Fabio Manganiello	72a9a9dfcf	LINT/type fixes	2023-02-19 22:56:45 +01:00
Fabio Manganiello	8aedc3c233	Recursively normalize child entities in EntityManager._normalize_entities	2023-02-18 17:51:57 +01:00
Fabio Manganiello	613e32e7c1	Extended number of supported events and data fields in Bluetooth integration.	2023-02-18 01:15:10 +01:00
Fabio Manganiello	7adae272a4	Merge branch 'master' into 29-generic-entities-support	2023-02-15 22:24:41 +01:00
Fabio Manganiello	08553f84b9	Added timeout parameter to websocket.send.	2023-02-15 22:23:15 +01:00
Fabio Manganiello	45664be44b	Removed deprecated backend.bluetooth.scanner. ... Scan capabilities are now implemented on the `bluetooth` plugin itself.	2023-02-13 23:13:51 +01:00
Fabio Manganiello	471bc1fd3d	Updated dist files	2023-02-13 23:13:32 +01:00
Fabio Manganiello	a3aa186ddf	- Added support for scan_pause/scan_resume on bluetooth integration. ... - Added `BluetoothDevice` as its own entity type.	2023-02-13 23:12:25 +01:00
Fabio Manganiello	1d0be5c929	- Simplified prototype for EntityManager.set ... - Added small documentation/annotations notes to the `Plugin` module. - Small LINT fixes	2023-02-11 21:35:00 +01:00
Fabio Manganiello	575635fd6b	Defined set as a base method for all plugins that implement writeable entities	2023-02-11 04:04:21 +01:00
Fabio Manganiello	4365352331	[WIP] s/set_value/set/g for entities	2023-02-11 03:57:23 +01:00
Fabio Manganiello	b0cc80ceb0	Rewriting bluetooth.ble plugin to use bleak instead of gattlib.	2023-02-10 17:40:20 +01:00
Fabio Manganiello	f30e077a5a	Support for custom Bluetooth adapter on switchbot.bluetooth.	2023-02-08 23:01:05 +01:00
Fabio Manganiello	8469a1027f	Migrated/refactored switchbot.bluetooth integration. ... - Out `gattlib` + `pybluez`, in `bleak`. It's not platform-dependent, it doesn't require libboost and other heavy build dependencies, and it doesn't require the user that runs the service from having special privileges to access raw Bluetooth sockets. - Better integration with Platypush native entities. The devices are now mapped to write-only `EnumSwitch` entities, and the status returns the serialized representation of those entities instead of the previous intermediate representation.	2023-02-08 22:42:00 +01:00
Fabio Manganiello	35719b0da9	Let publish_entities return the list of transformed_entities	2023-02-08 02:09:34 +01:00
Fabio Manganiello	e04870209e	More LINT fixes	2023-02-08 01:50:54 +01:00
Fabio Manganiello	a98a5f0980	typo fix	2023-02-08 01:09:25 +01:00
Fabio Manganiello	e49a0aec4d	Various improvements. ... - Better synchronization logic on stop for `AsyncRunnablePlugin`. - Fixed several thread names by dropping `prctl.set_name` in favour of specifying the name directly on thread creation. - Several LINT fixes.	2023-02-08 00:46:50 +01:00
Fabio Manganiello	9d028af524	Removed last reference of SwitchPlugin	2023-02-05 23:10:35 +01:00
Fabio Manganiello	419a0cec61	More LINTing ... Better prototype for `MultiLevelSwitchEntityManager.set_value`	2023-02-05 23:07:43 +01:00
Fabio Manganiello	fde834c1b1	More LINT fixes + refactors	2023-02-05 22:00:50 +01:00