3217 commits

Author	SHA1	Message	Date
Fabio Manganiello	0a13b4605e	[Execute panel] Procedures merged into actions. ... Plus, a last big refactor/redesign for the panel's components.	2023-10-12 02:49:51 +02:00
Fabio Manganiello	e760f8e23a	[Execute panel] Introduced a common Response component.	2023-10-11 16:57:04 +02:00
Fabio Manganiello	b47e729012	[Execute panel] Added cURL snippet modal.	2023-10-11 16:38:38 +02:00
Fabio Manganiello	fc21e9740b	[Execute panel] Better rendering of responses and errors.	2023-10-11 15:28:49 +02:00
Fabio Manganiello	21820bb185	Big refactor of the Execute panel.	2023-10-11 14:31:46 +02:00
Fabio Manganiello	1b6e9b4df9	Fixed a broken docstring reference.	2023-10-10 22:18:36 +02:00
Fabio Manganiello	ff07623803	Auto-focus the first parameter after selecting an action.	2023-10-10 21:31:14 +02:00
Fabio Manganiello	07f0535504	Migrated Execute panel to the new Autocomplete widget.	2023-10-10 21:13:54 +02:00
Fabio Manganiello	a717235453	Added autofocus support to Autocomplete element.	2023-10-10 20:51:09 +02:00
Fabio Manganiello	923eb7cadb	Autocomplete is now its own component.	2023-10-10 18:42:41 +02:00
Fabio Manganiello	f6bf9438b9	Several improvements for the Execute panel.	2023-10-10 01:45:35 +02:00
Fabio Manganiello	434855ffdd	A better logic to process relative references in docstrings.	2023-10-10 01:35:37 +02:00
Fabio Manganiello	5726c6985f	Added utility function to get the defining class of a method.	2023-10-10 01:35:01 +02:00
Fabio Manganiello	2af304f478	Replaced radio buttons on the Execute panel with buttons.	2023-10-10 00:40:20 +02:00
Fabio Manganiello	84efef710e	Added Tabs and Tab UI elements.	2023-10-10 00:39:27 +02:00
Fabio Manganiello	0c818d3fe0	.. schema:: JSON arguments should be comma-separated.	2023-10-10 00:38:23 +02:00
Fabio Manganiello	b225b056b0	ParseContext should also process kwonlyargs.	2023-10-10 00:37:08 +02:00
Fabio Manganiello	52e353dc14	Expose the wrapped function in @action. ... Added a `wrapped` "hidden" parameter to the function returned by the `@action` decorator. We need this to access the underlying decorated function when e.g. we need to access its specs or decorators.	2023-10-09 22:35:08 +02:00
Fabio Manganiello	1e93af86f4	Fixed some broken docstring references.	2023-10-09 01:33:45 +02:00
Fabio Manganiello	53bdcb9604	A major rewrite of the inspect plugin. ... - The `inspect` plugin and the Sphinx inspection extensions now use the same underlying logic. - Moved all the common inspection logic under `platypush.common.reflection`. - Faster scanning of the available integrations and components through a pool of threads. - Added `doc_url` parameters. - Migrated events and responses metadata scanning logic. - Now expanding some custom Sphinx tag instead of returning errors when running outside of the Sphinx context - it includes `:class:`, `:meth:` and `.. schema::`.	2023-10-09 01:33:45 +02:00
Fabio Manganiello	9acd71944c	Skip numpy types serialization errors on Message.Encoder.	2023-10-09 01:33:45 +02:00
Fabio Manganiello	e5a5ac5ffb	Added doc_url parameter to integration metadata.	2023-10-09 01:33:45 +02:00
Fabio Manganiello	d872835093	New API to check if a table class exists before defining it. ... - Check if it's part of the metadata through a function call rather than checking `Base.metadata` in every single module. - Make it possible to override them (mostly for doc generation logic that needs to be able to import those classes). - Make it possible to extend them.	2023-10-09 01:33:44 +02:00
Fabio Manganiello	608844ca0c	[WIP] Large refactor of the inspection plugin and models.	2023-10-09 01:33:44 +02:00
Fabio Manganiello	841643f3ff	Added cachedir to configuration.	2023-10-09 01:33:44 +02:00
Fabio Manganiello	40557f5d5d	Replaced one more occurrence of <type> | None syntax.	2023-10-09 01:33:44 +02:00
Fabio Manganiello	4da3c13976	First WIP commit for the new Integrations panel.	2023-10-09 01:33:44 +02:00
Fabio Manganiello	4d52fd35b9	Skip None responses in the RSS plugin.	2023-10-04 22:08:11 +02:00
Fabio Manganiello	40d3ad1150	Removed <type> | None type hints. ... They break on Python < 3.10.	2023-10-03 01:15:13 +02:00
Fabio Manganiello	3086dd86fc	LINT+Black+stability fixes for some plugins that hadn't been touched in a while. ... - media.mplayer - media.omxplayer - media.vlc - music.mpd - music.snapcast	2023-10-01 22:55:06 +02:00
Fabio Manganiello	2aefc4e5c8	Several improvements for the Google integrations. ... 1. Improved documentation. Every plugin now reports the exact steps to get the integration up and running with the right API scopes. 2. All Google plugins now have a standard process to get (and reuse) the client secret. Except for PubSub, Translate and Maps (which have their own flows), all the Google plugins now read the client secrets from `<WORKDIR>/credentials/google/client_secret.json` by default. 3. Black/LINT for some of those plugins, which hadn't been touched in a while. 4. The interface to pass API scopes is now leaner. It's now possible to pass a scope directly as e.g. `calendar.readonly` rather than `https://www.googleapis.com/auth/calendar.readonly`. 5. Improved the logic to retrieve the right scope tokens file. If e.g. an integration requires the role `A`, and a credentials file exists for the roles `A` and `B`, then this file will be used rather than prompting the user to authenticate again.	2023-10-01 15:37:20 +02:00
Fabio Manganiello	5ca3757834	A more readable configuration for the calendar plugin. ... The old type configuration (`platypush.plugins.calendar.name.CalendarNamePlugin`) is a bit clunky. Instead, since the type will always be a plugin, we should encourage the use of `calendar.name` directly to identify the type.	2023-10-01 01:09:15 +02:00
Fabio Manganiello	966a6ce29e	httplib2 should be an explicit dependency for Google integrations. ... Plus, some misc LINT/Black chores.	2023-10-01 00:52:59 +02:00
Fabio Manganiello	a7bb81553c	Regex fix.	2023-09-30 15:11:09 +02:00
Fabio Manganiello	9e489bb5cf	Propagate the default/required properties of a parameter upon merge.	2023-09-30 14:57:11 +02:00
Fabio Manganiello	1732bfa82c	Fixed _default_docstring regex.	2023-09-30 14:36:08 +02:00
Fabio Manganiello	532f5479b3	Added full YAML example for chat.irc configuration.	2023-09-30 14:34:54 +02:00
Fabio Manganiello	ecffbf29bf	Skip vararg/varkw parameters from the config snippet.	2023-09-30 13:53:33 +02:00
Fabio Manganiello	4f5ccda353	Better documentation for the calendar plugin.	2023-09-30 13:31:41 +02:00
Fabio Manganiello	c82f7bbfbe	Ignore the default docstring text for __init__. ... If no docstring is specified for a constructor, Python usually pre-fills a standard text - "Initialize self. See help(type(self))". We don't need this default text in our plugins documentation.	2023-09-30 13:29:49 +02:00
Fabio Manganiello	15d06fa5c2	Improved docstring parser logic.	2023-09-30 12:35:31 +02:00
Fabio Manganiello	343972b520	New IntegrationMetadata generic util class. ... This object is in charge of parsing all the metadata of a plugin/backend.	2023-09-30 02:28:20 +02:00
Fabio Manganiello	905d6632e0	Misc documentation improvements.	2023-09-29 18:09:15 +02:00
Fabio Manganiello	0a3ec4b9f1	Merge branch 'master' into 311/auto-generate-deps-docs	2023-09-28 01:25:29 +02:00
Fabio Manganiello	b76f141b61	Catch response write errors in the MQTT callback. ... If the client that forwarded the request is no longer available (either because an exception or a timeout was raised) then its I/O buffer and event loop may be closed. In this case, the response callback should handle and report the exception, and still set the event, so that any other threads waiting for the response can move on.	2023-09-27 11:23:55 +02:00
Fabio Manganiello	ca7f042ccc	We shouldn't call dateutil.parser if t has already been deserialized to a datetime.	2023-09-27 11:20:10 +02:00
Fabio Manganiello	c311987741	Removed typing.Final from some of the most commonly used modules. ... `typing.Final` is not defined on Python < 3.8.	2023-09-26 23:50:10 +02:00
Fabio Manganiello	9298f52443	Moved BluetoothPlugin to __init__.py. ... This is for consistency with other plugins, that all have their main plugin class definition inside of `__init__.py`.	2023-09-24 19:21:53 +02:00
Fabio Manganiello	c3337ccc6c	[#311] Docs deps autogen sphinx plugin. ... Added an `add_dependencies` plugin to the Sphinx build process that parses the manifest files of the scanned backends and plugins and automatically generates the documentation for the required dependencies and triggered events. This means that those dependencies are no longer required to be listed in the docstring of the class itself. Also in this commit: - Black/LINT for some integrations that hadn't been touched in a long time. - Deleted some leftovers from previous refactors (deprecated `backend.mqtt`, `backend.zwave.mqtt`, `backend.http.request.rss`). - Deleted deprecated `inotify` backend - replaced by `file.monitor` (see #289).	2023-09-24 17:00:08 +02:00
Fabio Manganiello	059f7a4b11	Merge branch 'master' into 316/rpm-support	2023-09-23 16:21:48 +02:00
Fabio Manganiello	2b981f6b68	Added python-croniter dependency to Fedora. ... Plus, some clean up of the variables on .drone.yaml.	2023-09-23 16:20:28 +02:00
Fabio Manganiello	b797add90d	Modify shebang header for Mercury JS script. ... The RPM build process wants an absolute path.	2023-09-23 16:16:13 +02:00
Fabio Manganiello	a872d6f554	Added Fedora to the available Docker base images.	2023-09-22 19:02:13 +02:00
Fabio Manganiello	79e24461cb	Coalesce to empty list if zigbee.mqtt.devices returns null.	2023-09-22 17:00:53 +02:00
Fabio Manganiello	55965e962c	Store the Philips Hue bridge configuration under our workdir. ... By default, the `phue` library will store the file containing the token and the bridge configuration under `~/.python_hue`. That's outside of our application folder, and it can't easily be copied around or added to Docker volumes. We should instead have it under `<WORKDIR>/light.hue/config.json`, in line with what the other plugins do, and if `~/.python_hue` is available but `<WORKDIR>/light.hue/config.json` isn't then we should copy the legacy file to the new one.	2023-09-22 16:58:44 +02:00
Fabio Manganiello	761f2768cb	[#316] Added RPM dependencies.	2023-09-21 23:20:06 +02:00
Fabio Manganiello	453b6becae	FIX: We shouldn't expand cfgfile if it's empty.	2023-09-21 01:18:15 +02:00
Fabio Manganiello	bdbe263905	Added croniter to system dependencies. ... The python-croniter package has now been added both to Arch's and Debian's official repos, so we can install it via pacman or apt rather than pip.	2023-09-21 01:07:49 +02:00
Fabio Manganiello	648b4224bb	[#285] Removed old covid19 backend. ... Those endpoints aren't even working anymore. Closes: #285	2023-09-21 00:26:35 +02:00
Fabio Manganiello	5d6d37785e	[#288] Removed legacy http.poll backend. ... Closes: #288	2023-09-20 23:53:12 +02:00
Fabio Manganiello	7ba9a8930a	[#291] Removed deprecated light.hue backend. ... Closes: #291	2023-09-20 23:46:40 +02:00
Fabio Manganiello	a6efaad26d	[#306] Removed Travis CI integration. ... I've tried my best to keep it around, but the endpoints seem to be broken, they no longer have a link to their API v3 documentation, and the API Explorer that was supposed to be in the dashboard is gone.	2023-09-20 23:31:58 +02:00
Fabio Manganiello	3970470e17	Removed typing-inspect dependenccy	2023-09-18 14:25:50 +02:00
Fabio Manganiello	3e8d6bb01e	Removed typing-extensions dependency. ... The package isn't present on older versions of Debian.	2023-09-18 14:05:39 +02:00
Fabio Manganiello	07c88c9530	Added logic to prevent socket leakage from paho-mqtt upon client stop.	2023-09-17 23:43:56 +02:00
Fabio Manganiello	3f4168eb69	Support for new Quality enumeration constants on tidalapi.	2023-09-17 22:40:26 +02:00
Fabio Manganiello	c6cda86b1c	LINT/regex fix for ESP plugin.	2023-09-17 17:10:40 +02:00
Fabio Manganiello	4c4a33dc7c	Added Bluetooth example configuration to sample config.yaml.	2023-09-17 03:25:21 +02:00
Fabio Manganiello	46167a6c2a	Removed legacy zwave backend.	2023-09-17 02:46:24 +02:00
Fabio Manganiello	190cfa21b5	Fixed documentation references to some non-existing events.	2023-09-17 02:41:55 +02:00
Fabio Manganiello	0421325b26	Support to register/unregister custom handlers on the bus.	2023-09-17 02:29:11 +02:00
Fabio Manganiello	2e004c1a1e	get_all_plugins should use Message.Encoder for encoding the response. ... Some plugin information may include enums, tuples and other types that aren't serializable by the default JSON serializer.	2023-09-17 02:11:52 +02:00
Fabio Manganiello	fa2b84a269	Updated example configuration for mqtt and mqtt-based plugins.	2023-09-16 15:26:07 +02:00
Fabio Manganiello	2fcd623c51	Migrated zwave.mqtt integration. ... Merged the zwave.mqtt plugin with the listener and removed the leftovers of the legacy zwave plugin.	2023-09-16 03:58:19 +02:00
Fabio Manganiello	52cb1afb4b	Don't break words in entity value frames.	2023-09-16 02:58:17 +02:00
Fabio Manganiello	e947cb1e67	Updated web dist files	2023-09-15 16:22:40 +02:00
Fabio Manganiello	4223576016	We should always update the entities cache on addEntity. ... Updating the entity cache only when we receive an event from a root entity means that we lose events sent by individual child entities.	2023-09-15 00:45:38 +02:00
Fabio Manganiello	1020b63da7	All EntityMixin components should be allowed to emit loading events.	2023-09-15 00:34:29 +02:00
Fabio Manganiello	2c93049ee5	Catch all the exceptions in a plugin action wrapper. ... The @action decorator should capture all the exceptions, log them and return them on `Response.errors`. This ensures that uncaught exceptions from plugin actions won't unwind out of control, and also that they are logged and treated consistently across all the integrations.	2023-09-14 23:08:23 +02:00
Fabio Manganiello	ac72b2f7a8	Fixed management of state on zigbee.mqtt. ... Before the merge of the plugin and the listener those components used to have their own separate state, which led to inconsistencies.	2023-09-14 23:05:27 +02:00
Fabio Manganiello	5a514fdcce	Only support the run_topic logic on the MQTT plugin. ... Plugins that extend `MqttPlugin` shouldn't run messages as requests, even if the parent MQTT plugin is configured to do so.	2023-09-14 01:09:03 +02:00
Fabio Manganiello	4cb5aa7acb	Prepend the class name to the string used to generate the MQTT client_id hash. ... If we include the class name by default then we won't have to explicitly modify the client_id in the implementation classes in order to prevent clashes.	2023-09-14 01:06:53 +02:00
Fabio Manganiello	3104a59f44	Better processing of configuration file parameters. ... - Do `abspath`+`expanduser` on the configuration file path before checking if it exists. - If the path doesn't exist, but the user explicitly passed a configuration file, then copy/create the default configuration under the specified directory.	2023-09-14 00:24:52 +02:00
Fabio Manganiello	ddd8f1afdc	base_topic param in zigbee.mqtt renamed to topic_prefix. ... This is for sake of consistency with other integrations (like `zwave.mqtt`) that also use the same parameter name for the MQTT topic prefix.	2023-09-07 21:32:56 +02:00
Fabio Manganiello	8ab7b6bebc	Removed deprecated zigbee.mqtt backend. ... Closes: #322	2023-09-06 02:54:48 +02:00
Fabio Manganiello	3de510da68	Migrated zigbee.mqtt integration. ... The plugin has been migrated to the new `mqtt` API and the legacy listener that extended `MqttBackend` has been removed and merged into the plugin.	2023-09-06 02:44:56 +02:00
Fabio Manganiello	33a1ef39e4	Refactored and merged backend.mqtt logic into mqtt plugin.	2023-09-06 02:43:45 +02:00
Fabio Manganiello	b746d0b402	Moved get_message_response to platypush.utils. ... It is general-purpose enough to be used by all the integrations, not only by the HTTP backend.	2023-09-05 13:03:30 +02:00
Fabio Manganiello	f1acff00e9	Put the join back on CommandStream.__exit__. ... We want to give the process a bit of slack between the terminate and the close, or we'll be guaranteed to get race conditions upon close.	2023-09-04 11:01:34 +02:00
Fabio Manganiello	b3c82fe0d1	More resilient termination logic for CommandStream.	2023-09-04 02:47:18 +02:00
Fabio Manganiello	c69f97c0a5	Updated default config.yaml. ... The new configuration: - Enables `backend.http` by default - Removes the extra `config.auto.yaml` dependency - Includes many more examples, lots of updates for existing examples, and extensive comments.	2023-09-04 02:22:46 +02:00
Fabio Manganiello	07c2eee890	Changed (fixed) default location for config dir if not existing. ... Following some common UNIX conventions, if no configuration file is specified and none exists under the default locations, then a new configuration directory should be created under: ``` - if root: /etc/platypush - else: - if XDG_CONFIG_HOME: - $XDG_CONFIG_HOME/platypush - else: - ~/.config/platypush ```	2023-09-04 02:19:13 +02:00
Fabio Manganiello	b6c0ff799b	Rewritten the http.webpage plugin.	2023-09-03 17:33:25 +02:00
Fabio Manganiello	669f2eb2d2	LINT/black for tts.mimic3 plugin.	2023-09-02 12:40:34 +02:00
snyk-bot	46c40f6fa6	fix: upgrade sass from 1.64.2 to 1.65.1 ... Snyk has created this PR to upgrade sass from 1.64.2 to 1.65.1. See this package in npm: https://www.npmjs.com/package/sass See this project in Snyk: https://app.snyk.io/org/blacklight/project/96bfd125-5816-4d9e-83c6-94d1569ab0f1?utm_source=github&utm_medium=referral&page=upgrade-pr	2023-09-01 23:15:47 +00:00
Fabio Manganiello	35416f3ee3	Some LINT on the old http.request.rss plugin.	2023-09-02 01:01:16 +02:00
Fabio Manganiello	9aaf2559fa	Added utils.is_root method.	2023-08-31 23:21:32 +02:00
Fabio Manganiello	e6b5abe909	Added SIGTERM handler for clean termination in Docker contexts.	2023-08-31 02:09:23 +02:00
Fabio Manganiello	4dd713ffd2	Refactored Platydock and Platyvenv. ... The two scripts now share the same command interface, behaviour and base class. Also, Platydock now builds a Docker image instead of just printing a Dockerfile, unless the `--print` option is passed.	2023-08-31 01:16:56 +02:00
Fabio Manganiello	429658e7c8	Refactored PackageManager classes. ... Instead of having a custom `get_installed` callable field, with replicated code for each package manager, the field has now been promoted to a class method containing the common logic, and the instances now expect a `list` field (base command to list the installed packages using the specified package manager) and a `parse_list_line` callback field (to extract the base package name given a raw line from the command above). Also, we shouldn't run the list command if we're running within a Docker context - the host and container environments will be different.	2023-08-28 01:26:19 +02:00
Fabio Manganiello	86e5f74645	platyvenv should generate (and document) a run.sh helper script.	2023-08-27 23:20:03 +02:00
Fabio Manganiello	9e6430a9ac	Clone git repo if platyvenv is not running from a srcdir	2023-08-23 20:02:04 +02:00
Fabio Manganiello	dafd65dc21	Added new platyvenv Python script.	2023-08-23 11:55:25 +02:00
Fabio Manganiello	f230fa79bb	to_pkg_install_commands should skip already installed sys packages.	2023-08-23 11:51:53 +02:00
Fabio Manganiello	449821673c	Added PackageManager.get_installed.	2023-08-23 10:50:29 +02:00
Fabio Manganiello	b10ccdb313	Added get_src_root utility function.	2023-08-23 02:53:31 +02:00
Fabio Manganiello	1ef0d804db	Added full_command argument to to_pip_install_commands. ... This is useful if we just want to get the list of pip dependencies and create our own pip command.	2023-08-23 02:19:54 +02:00
Fabio Manganiello	2bff4c9cf1	Exclude python-* system packages when installing in a venv.	2023-08-23 02:17:19 +02:00
Fabio Manganiello	cddf318fa7	Dependencies.from_config should include the base system deps.	2023-08-23 02:16:33 +02:00
Fabio Manganiello	8f39231d31	Added new utility methods to the Dependencies class.	2023-08-23 02:15:50 +02:00
Fabio Manganiello	ce68250b4d	Refactor/documentation round for platydock.	2023-08-22 02:49:05 +02:00
Fabio Manganiello	10c0e5fcad	Added default_os field to PackageManagers enum elements. ... This is useful to determine which is the default set of scripts that should be used by the installer depending on the detected installed package manager.	2023-08-20 21:21:37 +02:00
Fabio Manganiello	2c46b6fe14	Added git a required manifest dependency when needed. ... It is needed for packages that install pip packages via git.	2023-08-20 21:19:15 +02:00
Fabio Manganiello	a28dcb7a8d	Remove /var/cache/apk from container image after installation.	2023-08-20 14:19:04 +02:00
Fabio Manganiello	a6752ed034	Fixed wrong event path in a manifest file.	2023-08-20 14:08:22 +02:00
Fabio Manganiello	700b8e1d16	Added header and footer to generated Dockerfile.	2023-08-20 14:05:22 +02:00
Fabio Manganiello	a6f8021150	PackageManager has both install and uninstall.	2023-08-20 13:33:49 +02:00
Fabio Manganiello	5efcae64c1	Better Dockerfile logic to retrieve sources. ... If the /install folder on the container doesn't contain a copy of the source files, then the git repository will be cloned under that folder. The user can specify via `-r/--ref` option which tag/branch/commit they want to install.	2023-08-20 13:31:13 +02:00
Fabio Manganiello	28ba042810	If no configuration file is passed to platydock generate a minimal Dockerfile.	2023-08-20 03:36:34 +02:00
Fabio Manganiello	199ac5f0f7	New way of managing installation scripts and dependencies. ... Created `platypush/install` folder that contains: - Dockerfiles for the supported distros - Lists of required base dependencies for the supported distros - Install and run scripts - Added Debian to supported base images	2023-08-20 02:28:10 +02:00
Fabio Manganiello	71c5291190	Refactored the interface of Platydock and manifest utils.	2023-08-19 22:46:37 +02:00
Fabio Manganiello	a99ffea37c	Fixed apt dependencies for mpd plugin.	2023-08-19 21:46:08 +02:00
Fabio Manganiello	980af16984	Rewritten platydock utility. ... Platydock now will only print out a Dockerfile given a configuration file. No more maintaining the state of containers, storing separate workdirs and configuration directories etc. - that introduced way too much overhead over Docker.	2023-08-19 13:47:43 +02:00
Fabio Manganiello	9002f3034a	Tweaked package managers install command arguments.	2023-08-19 13:46:08 +02:00
Fabio Manganiello	69706eaabe	s/logger/_logger/ in the plugins module. ... The `logger` name may clash with the context of an action, where `logger` may have been set to something else.	2023-08-19 13:32:19 +02:00
Fabio Manganiello	1cb686bdab	Updated the inspect plugin to the new manifest utils interface.	2023-08-19 13:31:48 +02:00
Fabio Manganiello	043f303761	s/HttpBackend._DEFAULT_HTTP_PORT/HttpBackend.DEFAULT_HTTP_PORT/g	2023-08-19 13:30:51 +02:00
Fabio Manganiello	dd3a701a2e	Full rewrite of platypush.utils.manifest. ... The new version encapsulates all the utility functions into three classes - `Manifest`, `Manifests` and `Dependencies`.	2023-08-19 13:28:40 +02:00
Fabio Manganiello	a8255f3621	Pass the configuration file used by the application to the Alembic process. ... The database settings could also be overridden in the configuration file besides the command line. We should therefore pass the path to the runtime configuration file, so the Alembic process can initialize its configuration from the same file and use the same settings.	2023-08-19 13:23:20 +02:00
Fabio Manganiello	1825b492b3	Replaced Config.workdir with Config.get_workdir(). ... Again, Python < 3.9 doesn't like class properties.	2023-08-19 13:21:24 +02:00
Fabio Manganiello	a8836f95f5	Support explicit workdir parameter override in Config constructor.	2023-08-19 13:15:29 +02:00
Fabio Manganiello	5bc82dfe64	s/Config._cfgfile/Config.config_file/g	2023-08-19 13:13:36 +02:00
Fabio Manganiello	181da63c89	Pass the database engine to the Alembic process as an extra argument. ... If the path of the default database engine is overridden via `--workdir` option then it won't be visible to the new `python` subprocess spawned for Alembic.	2023-08-19 13:02:05 +02:00
Fabio Manganiello	c2b3ec8ce3	Fixed manifest files with outdated formats.	2023-08-19 12:54:33 +02:00
Fabio Manganiello	e463a52435	Use sys.executable rather than 'python' to launch the application.	2023-08-19 12:40:57 +02:00
Fabio Manganiello	0a5fc40dc5	Merge branch 'master' into 276/better-docker	2023-08-18 17:34:56 +02:00
Fabio Manganiello	2cab836bdf	Entity.columns class property replaced by Entity.get_columns method. ... Again, Python < 3.9 doesn't like the combination of `@property` + `@classmethod`.	2023-08-18 17:20:53 +02:00
Fabio Manganiello	a9cdff900e	_variable should be an external global function rather than a class property. ... The combination of `@property` + `@classmethod` isn't supported on Python < 3.9.	2023-08-18 16:16:47 +02:00
Fabio Manganiello	d0c89f88a8	Fixed parenthesised multi-with statement. ... This syntax is not supported on Python < 3.9, and therefore it should be broken down as a multi-line statement.	2023-08-18 16:10:31 +02:00
Fabio Manganiello	ca95490412	Added timeout parameter to requests.get in the rss plugin.	2023-08-18 15:53:30 +02:00
Fabio Manganiello	5dd7345c0b	Sync the latest parse timestamps in main instead of __init__ in rss. ... We should load the latest timestamps from the db when the thread starts instead of doing it in the constructor. The constructor may be invoked when the entities engine hasn't been initialized yet, and result in deadlocks.	2023-08-18 15:51:11 +02:00
Fabio Manganiello	ec64b0ef8b	Added --device_id command line option.	2023-08-17 23:16:24 +02:00
Fabio Manganiello	ac83b43f98	Support for custom key-value overrides on Config.init.	2023-08-17 22:03:39 +02:00
Fabio Manganiello	657b2cc87d	Create the default configuration file even if --config is supplied but the file doesn't exist.	2023-08-17 11:25:49 +02:00
Fabio Manganiello	24b04d9103	s/--config-file/--config/ option in Dockerfile.	2023-08-17 10:35:40 +02:00
Fabio Manganiello	bf7d060b81	Added @ensure_initialized decorator to actions in variable. ... The `variable` plugin may break in the constructor the first time the application is started. That's because it tries to initialize the cache of stored variables, but the local database hasn't yet been initialized. That's because plugins are registered _before_ the entities engine is initialized, as the entities engine assumes that it already has plugins to scan for entities. Therefore, the initialization of the `variable` plugin's cache should be lazy (only done upon the first call to `get`/`set` etc.), in order to prevent deadlock situations where the plugin waits for the engine to start, but the engine will be initialized only after the plugin is ready. And the lazy initialization logic should also ensure that the entities engine has been properly started (and emit a `TimeoutError` if that's not the case), in order to prevent race conditions.	2023-08-17 02:47:30 +02:00
Fabio Manganiello	adfedfa2dd	s/TimeoutError/AssertionError/ if get_entities_engine times out.	2023-08-17 02:36:40 +02:00
Fabio Manganiello	ec2b8da983	Ignore Redis errors when a backend sends an unregister notify event. ... When that happens, it's most likely that the application is already stopping and the Redis service has already been terminated.	2023-08-17 01:49:41 +02:00
Fabio Manganiello	3bf068e0b2	The __main__ function should take no arguments. ... setup.py won't pass any arguments to `main()`, so the default entry point should get them itself from `sys.argv`.	2023-08-17 01:35:39 +02:00
Fabio Manganiello	98e9abde18	Extended manifest files with Python system packages (if available). ... - If a Python optional dependency is available as a system package on the target system, try and install it that route rather than pip. It's usually faster and it decreases the risk of breaking system packages. - Added support for apk dependencies in manifest files. This brings the number of distros officially supported by all the extensions to four: - Alpine - Arch - Debian - Ubuntu	2023-08-16 22:43:51 +02:00
Fabio Manganiello	00863a176e	Added application plugin.	2023-08-15 11:20:24 +02:00
Fabio Manganiello	f51beb271e	Large refactor + stability fixes for the external process control logic.	2023-08-15 11:12:21 +02:00
Fabio Manganiello	46245e851f	Synchronize with the currently running stop thread (if any) in Backend.wait_stop.	2023-08-15 02:08:47 +02:00
Fabio Manganiello	a8a7ceb2ac	Implemented HttpBackend._stop_workers. ... The Tornado WSGI container won't guarantee the termination of the spawned workers upon termination, so the code of the backend has to take care of it and terminate all the children processes of the server process when it terminates. This also means that `psutil` is now a required base dependency, as we need to expand the process subtree under the webserver launcher.	2023-08-15 00:13:34 +02:00
Fabio Manganiello	04921c759f	Added wait_stop method to the entities engine and cron scheduler.	2023-08-14 23:49:47 +02:00
Fabio Manganiello	ceb9d6d1ba	Removed redundant Backend._get_redis() method. ... It was used only once, and it could easily be replaced by `platypush.utils.get_redis()`.	2023-08-14 23:37:38 +02:00
Fabio Manganiello	7157936b87	Added get_remaining_timeout utility function.	2023-08-14 23:17:50 +02:00
Fabio Manganiello	dc1a152433	Added get_default_pid_file utility method.	2023-08-14 10:47:25 +02:00
Fabio Manganiello	c11bc69a66	Handle KeyboardInterrupt and process return code in the main.	2023-08-13 23:55:40 +02:00
Fabio Manganiello	8819a0ed4c	Added CommandStream to the main Application. ... The stream will be used to communicate command messages from the application to its runner.	2023-08-13 23:51:21 +02:00
Fabio Manganiello	06111587f7	Added CommandStream class. ... This abstraction is used to write and read commands over a UNIX socket.	2023-08-13 23:37:51 +02:00
Fabio Manganiello	c89f992867	Added StopCommand and RestartCommand.	2023-08-13 23:36:36 +02:00
Fabio Manganiello	b1f244a812	Added ControllableProcess class. ... This class can be used to easily control the execution of underlying processes.	2023-08-13 23:33:08 +02:00
Fabio Manganiello	efef9d7bc0	Added commands module.	2023-08-13 23:21:36 +02:00
Fabio Manganiello	97adc3f775	Moved application argument parser to an external platypush.cli module.	2023-08-13 22:27:16 +02:00
Fabio Manganiello	1819ee75ef	s/Application.stop_app/Application.stop/g	2023-08-13 22:23:15 +02:00
Fabio Manganiello	827b564006	Using a single constant for DEFAULT_REDIS_QUEUE. ... Also, catch `AttributeError` on `self._proc.terminate` in the `HttpBackend`, since the process may already have been terminated and set to null by another worker process.	2023-08-13 22:20:16 +02:00
Fabio Manganiello	4062ddbcf0	More improvements to the inspect plugin. ... - Support for distinct `type` field on constructor and method arguments. - Added `has_varargs` field. - Added `required` field. - Better logic for parsing arguments `default` values.	2023-08-08 20:47:27 +02:00
Fabio Manganiello	9beb0a7af3	Skip :type: annotations from docstring args documentation.	2023-08-08 20:47:27 +02:00
Fabio Manganiello	2a30f060b4	Parse the arguments list from obj_type.__init__.__doc__ too.	2023-08-08 20:47:27 +02:00
Fabio Manganiello	1474685cc0	[Automatic] Updated UI files	2023-08-06 22:51:57 +00:00
Fabio Manganiello	26b4dcba46	Reduced padding of ConfirmDialog body element.	2023-08-07 00:50:10 +02:00
Fabio Manganiello	5184543a3e	Normalize the size of the camera frame container from window size. ... If the window is smaller than the camera resolution, then we should scale down the container size accordingly.	2023-08-07 00:38:19 +02:00
Fabio Manganiello	dd313c6371	[Automatic] Updated UI files	2023-08-06 21:50:25 +00:00
Fabio Manganiello	2f007888fc	[Automatic] Updated UI files	2023-08-06 21:48:33 +00:00
Fabio Manganiello	609a8c6052	[Automatic] Updated UI files	2023-08-06 21:46:44 +00:00
Fabio Manganiello	276a9a7421	[Automatic] Updated UI files	2023-08-06 21:44:51 +00:00
Fabio Manganiello	715cdcfcff	More consistent style for the buttons on the tokens settings page.	2023-08-06 23:42:50 +02:00
Fabio Manganiello	bd49e460d5	More style improvements for the user settings panel.	2023-08-06 23:36:06 +02:00
Fabio Manganiello	6eed558342	More improvements on the users settings panel.	2023-08-06 23:14:54 +02:00
Fabio Manganiello	1d47b35219	Updated UI dependencies	2023-08-06 20:38:46 +02:00
Fabio Manganiello	237e0c47cb	Redesigned config panel UI.	2023-08-06 18:49:03 +02:00
Fabio Manganiello	53aeb0b3b1	Better documentation for the Redis server + LINT fixes. ... 1. Added documentation to the README on the possible options to run the Redis service. 2. Show a relevant message to the user if the application is run with `--start-redis` and Redis couldn't start. 3. Some LINT/black chores on some files that hadn't been touched in a while.	2023-08-02 22:17:11 +02:00
snyk-bot	7cda9954d4	fix: upgrade vue-router from 4.1.2 to 4.2.3 ... Snyk has created this PR to upgrade vue-router from 4.1.2 to 4.2.3. See this package in npm: https://www.npmjs.com/package/vue-router See this project in Snyk: https://app.snyk.io/org/blacklight/project/96bfd125-5816-4d9e-83c6-94d1569ab0f1?utm_source=github&utm_medium=referral&page=upgrade-pr	2023-07-27 02:01:02 +00:00
snyk-bot	26c9694664	fix: upgrade core-js from 3.23.4 to 3.31.1 ... Snyk has created this PR to upgrade core-js from 3.23.4 to 3.31.1. See this package in npm: https://www.npmjs.com/package/core-js See this project in Snyk: https://app.snyk.io/org/blacklight/project/96bfd125-5816-4d9e-83c6-94d1569ab0f1?utm_source=github&utm_medium=referral&page=upgrade-pr	2023-07-27 02:00:57 +00:00
Fabio Manganiello	e4756eb639	Replaced deprecated flask.escape with markupsafe.escape.	2023-07-25 00:26:15 +02:00
Fabio Manganiello	91cd08cdff	Adapted tests to use a locally started Redis instance.	2023-07-24 10:37:07 +02:00
Fabio Manganiello	7a20fec52f	[#60] Added --workdir and --logsdir command-line options. ... Also, the application is now using `XDG_CONFIG_HOME` and `XDG_DATA_HOME` if available to lookup the configuration file and working directory. Closes: #60	2023-07-24 03:29:08 +02:00
Fabio Manganiello	c1d66abb89	[#60] Added --workdir and --logsdir command-line options. ... Closes: #60	2023-07-24 03:20:18 +02:00
Fabio Manganiello	5fd40af285	Revert "Added explicit --help option." ... This reverts commit 1304be0718.	2023-07-24 02:38:12 +02:00
Fabio Manganiello	1304be0718	Added explicit --help option. ... argparse.ArgumentParser doesn't seem to add the option automatically anymore.	2023-07-24 02:11:42 +02:00
Fabio Manganiello	e9a568fdd2	Unified interface to retrieve the Redis bus configuration. ... A common `utils.get_redis_conf` has been created to handle the cascade fallback logic used to retrive the default Redis configuration.	2023-07-24 01:04:13 +02:00
Fabio Manganiello	77ffefdccb	Added a Config.set method. ... A useful interface to change configuration values at runtime.	2023-07-24 00:48:07 +02:00
Fabio Manganiello	dd862db29a	[chore] LINT fixes	2023-07-24 00:35:03 +02:00
Fabio Manganiello	3e3d47aa44	Check first the configuration of the Redis plugin and then that of the backend.	2023-07-24 00:26:49 +02:00
Fabio Manganiello	315a89fb65	Added a default parameter to Config.get.	2023-07-23 23:31:57 +02:00
Fabio Manganiello	37dcaba7a1	Refactored structure of main application and startup scripts. ... The main application class has been moved from __init__ to the app module. __init__ will contain instead the relevant global variables and the modules and objects exposed to external integrations - such as `get_plugin` and `get_backend`, or the `main` itself. This will make future integrations much easier - the global __init__ doesn't contain any business logic now, it can import anything without fearing circular dependencies, and it can limit its exposed objects to those that we want to expose to 3rd-party integrations and scripts. It will also make it easier to extend the main entry point with additional logic - such as a supervisor or an embedded Redis server.	2023-07-23 23:12:36 +02:00
Fabio Manganiello	0dc380fa94	Removed dependency from prctl. ... Also, black'd and LINT-fixed some files that hadn't been touched in a while.	2023-07-23 19:17:30 +02:00
Fabio Manganiello	15a34ebac9	Upgraded Docker base image. ... Debian base image bumped from Bullseye -> Bookworm.	2023-07-23 17:25:52 +02:00
Fabio Manganiello	cfdecd5703	[#267] Don't show the PWA popup again after the user dismisses it. ... Plus, upgraded a bunch of frontend libraries. Closes: #267	2023-07-23 02:44:17 +02:00
Fabio Manganiello	454228c56e	Upgraded UI dependencies	2023-07-23 02:42:14 +02:00
dependabot[bot]	33699fcac8	Bump word-wrap from 1.2.3 to 1.2.5 in /platypush/backend/http/webapp ... Bumps [word-wrap](https://github.com/jonschlinkert/word-wrap) from 1.2.3 to 1.2.5. - [Release notes](https://github.com/jonschlinkert/word-wrap/releases) - [Commits](https://github.com/jonschlinkert/word-wrap/compare/1.2.3...1.2.5) --- updated-dependencies: - dependency-name: word-wrap dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com>	2023-07-22 21:48:53 +00:00
dependabot[bot]	505cba44b8	Bump webpack from 5.70.0 to 5.88.2 in /platypush/backend/http/webapp ... Bumps [webpack](https://github.com/webpack/webpack) from 5.70.0 to 5.88.2. - [Release notes](https://github.com/webpack/webpack/releases) - [Commits](https://github.com/webpack/webpack/compare/v5.70.0...v5.88.2) --- updated-dependencies: - dependency-name: webpack dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com>	2023-07-22 21:46:59 +00:00
Fabio Manganiello	1d98f54c54	Bump version: 0.50.2 → 0.50.3	2023-07-22 23:36:04 +02:00
Fabio Manganiello	66981bd00b	Updated email addresses and black'd some old source files.	2023-07-22 23:02:44 +02:00
Fabio Manganiello	3eda0c6f17	[#268] Implemented XMPP integration.	2023-07-22 22:36:36 +02:00
Fabio Manganiello	63afd90701	Serialize exceptions in the default JSON serializers. ... This allows us to easily pass errors in internal JSON payloads, and ensure that these are serialized consistently across all the integrations.	2023-07-22 15:14:05 +02:00
Fabio Manganiello	cef9d0e007	Always serialize exception names when logging/returning request exceptions.	2023-07-22 15:13:17 +02:00
Fabio Manganiello	d49e5b1f6a	Expose Config.workdir property. ... This is a useful proxy to avoid using `Config.get('workdir')` string lookup.	2023-07-22 15:11:58 +02:00
Fabio Manganiello	c846c61493	Refactored Config.__init__. ... The constructor of the `Config` class had grown too big. It's much more manageable if split into multiple sub-constructor helpers.	2023-07-15 13:38:07 +02:00
Fabio Manganiello	0a3d6add83	Support ./config.yaml as a config file location.	2023-07-15 01:29:41 +02:00
Fabio Manganiello	fa1364d854	Improved logging for requests, responses and events. ... - The following logging namespaces are now used, to make it easier to filter only log lines related to the logged application message: - `platypush:events` - `platypush:requests` - `platypush:responses` - Those messages are always logged as JSON, with no prefixes nor suffixes. - Requests are always logged when executed - no more delegation to the upstream backend. - Responses are always logged when fully populated (including `id`, `origin`, `target` etc.), instead of being logged when still partially populated. This makes it particularly easy to link request/response IDs directly from the logs.	2023-07-15 01:11:45 +02:00
Fabio Manganiello	cb04af0bbd	Catch TypeError when execution an action. ... Most of TypeError are due to the user passing wrong data. It usually doesn't mean that we have to fail hard and reload the plugin, nor retry the call with the same parameters.	2023-07-14 22:20:27 +02:00
Fabio Manganiello	27cf1bec52	Removed some optional top-level imports. ... Optional top-level imports in Tornado route declarations will trigger `ImportError`. While this will just mean that those routes will be skipped, it will also generate a lot of noise on the logs.	2023-07-01 03:13:38 +02:00
Fabio Manganiello	e0af2daaff	Bump version: 0.50.1 → 0.50.2	2023-06-30 23:12:40 +02:00
Fabio Manganiello	42a990a132	Format string typo fix	2023-06-30 23:07:00 +02:00
Fabio Manganiello	9a7fc031d9	A more robust logic to detect plugins by class type in get_plugin.	2023-06-30 23:01:09 +02:00
Fabio Manganiello	f3b2386ed6	Bump version: 0.50.0 → 0.50.1	2023-06-28 02:44:13 +02:00
Fabio Manganiello	08c3a1e11a	Bump version: 0.24.5 → 0.50.0	2023-06-28 02:23:09 +02:00
Fabio Manganiello	5e5403287e	The inspect plugin should not fail hard if the cache couldn't be loaded. ... This can happen for many reasons - not only if the cache file is not accessible, but also if the structure/signature of some pickled objects has changed. In that case, we should invalidate the current cache and re-initialize it instead of failing.	2023-06-28 01:33:12 +02:00
Fabio Manganiello	ba827b0248	Added sound plugin documentation. ... - Added example of how to stream audio over HTTP. - Added Portaudio to the apt/pacman dependencies.	2023-06-28 00:10:36 +02:00
Fabio Manganiello	a103ea49f1	Fixed ffmpeg/audio consumer synchronization upon timeout.	2023-06-27 15:12:15 +02:00
Fabio Manganiello	77f7cd8b90	Don't use typing.Self (yet). ... typing.Self has only been introduced in Python 3.10.	2023-06-27 14:17:04 +02:00
Fabio Manganiello	f2540437b7	Sound plugin rewritten almost from scratch.	2023-06-27 13:31:38 +02:00
Fabio Manganiello	2fb6e4d7d0	Updated webapp dist files	2023-06-16 15:48:23 +02:00
Fabio Manganiello	2f4229d7b1	pylint fixes for the camera plugin.	2023-06-16 15:40:05 +02:00
Fabio Manganiello	9aa8e4538a	Better termination logic for the ffmpeg audio converter.	2023-06-16 11:47:37 +02:00
Fabio Manganiello	a6351dddd4	Extracted AudioRecorder out of SoundPlugin.	2023-06-16 03:12:55 +02:00
Fabio Manganiello	da93f1b3b0	[Chore] pylint	2023-06-14 01:44:36 +02:00
Fabio Manganiello	c8786b75de	sound.recordplay merged into sound.record.	2023-06-12 22:15:02 +02:00
Fabio Manganiello	be794316a8	Merged sound.stream_recording and sound.record.	2023-06-12 13:06:02 +02:00
Fabio Manganiello	a415c5b231	Merged outfile/fifo logic in sound.stream_recording.	2023-06-12 12:33:14 +02:00
Fabio Manganiello	e238fcb6e4	Refactoring the sound plugin to use ffmpeg as a stream converter.	2023-06-11 12:48:49 +02:00
Fabio Manganiello	4587b262b0	Stream camera frames over HTTP using a Redis pub/sub mechanism.	2023-06-05 20:40:12 +02:00
Fabio Manganiello	d7208c6bbc	Refactored Tornado routes for native pub/sub support. ... The Redis pub/sub mechanism is now a native feature for Tornado routes through the `PubSubMixin`. (Plus, lint/black chore for the sound plugin)	2023-05-30 21:58:27 +02:00
Fabio Manganiello	8b5eb82497	Camera stream writer fixes. ... - The readiness condition should be `multiprocessing.Condition`, not `threading.Condition` - in most of the cases it will be checked in a multiprocess environment. - Fixed parameter name for `write`.	2023-05-30 11:06:48 +02:00
Fabio Manganiello	4fffabd82a	Revert "Removed camera.gstreamer." ... This reverts commit b4d714df8a.	2023-05-29 22:13:24 +02:00
Fabio Manganiello	4bf9c01ac9	Moved camera routes. ... Camera routes migrated from Flask blueprints to Tornado handlers.	2023-05-27 22:24:45 +02:00
Fabio Manganiello	b4d714df8a	Removed camera.gstreamer. ... Too much of a pain in the ass to handle, too many format options to think of, too many combinations of pipelines to support, and if I don't think of those beforehand then I'll have to offload all of that complexity on the user.	2023-05-27 22:19:50 +02:00
Fabio Manganiello	1c40e5e843	Black'd the camera plugin and writer. ... Also, proper fix for the multi-inheritance problem of the ffmpeg writers.	2023-05-23 20:42:59 +02:00
Fabio Manganiello	a2f8e2f0d2	Fixed bottom margin for ConfirmDialog buttons	2023-05-22 16:44:53 +02:00
Fabio Manganiello	a7aabd7c52	Fixed handling of :meth: docstring annotations with relative paths.	2023-05-22 16:32:30 +02:00
Fabio Manganiello	7eca1c27c9	Blackened the qrcode and pushbullet plugins	2023-05-22 02:33:54 +02:00
Fabio Manganiello	aaac6488d6	Updated webapp dist files	2023-05-22 02:24:24 +02:00
Fabio Manganiello	d7405ad05d	Added multiple parsers for the entities referenced in docstrings. ... The `inspect` plugin can now detect references to plugins, backends, events, responses and schemas in docstrings and replace them either with links to the documentation or auto-generated examples.	2023-05-22 02:20:58 +02:00
Fabio Manganiello	4f11d7cf74	Updated webapp dist files	2023-05-21 03:15:16 +02:00
Fabio Manganiello	b91c1eba6d	Parse :return: definitions from action docstrings too.	2023-05-21 03:05:19 +02:00
Fabio Manganiello	229b8f2985	Many improvements for the execute panel.	2023-05-21 03:04:52 +02:00
Fabio Manganiello	edf1dbee1d	Updated webapp dist files	2023-05-20 15:54:18 +02:00
Fabio Manganiello	5efc90ca17	Better PWA installation prompt. ... Display a popup modal instead of a confirm box to prompt the user to install the PWA app. `confirm` blocks the JavaScript engine when run in `beforeMount` and therefore the browser won't be able to proceed with `event.prompt()`.	2023-05-20 15:52:37 +02:00