No OneTemporary
Actions

Authored By

Unknown

Size

267 KB

Referenced Files

None

Subscribers

None

View Options

This file is larger than 256 KB, so syntax highlighting was skipped.

	diff --git a/CHANGELOG.md b/CHANGELOG.md
	index 4e3e40864..5f26d48ff 100644
	--- a/CHANGELOG.md
	+++ b/CHANGELOG.md
	@@ -1,1165 +1,1185 @@
	# Changelog

	All notable changes to this project will be documented in this file.

	The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/).

	## Unreleased

	### Changed

	### Added

	### Fixed

	### Removed

	-## 2.4.0 - 2021-08-xx
	+## 2.4.1 - 2021-08-29
	+
	+### Changed
	+- Make `mix pleroma.database set_text_search_config` run concurrently and indefinitely
	+
	+### Added
	+- AdminAPI: Missing configuration description for StealEmojiPolicy
	+
	+### Fixed
	+- MastodonAPI: Stream out Create activities
	+- MRF ObjectAgePolicy: Fix pattern matching on "published"
	+- TwitterAPI: Make `change_password` and `change_email` require params on body instead of query
	+- Subscription(Bell) Notifications: Don't create from Pipeline Ingested replies
	+- AdminAPI: Fix rendering reports containing a `nil` object
	+- Mastodon API: Activity Search fallbacks on status fetching after a DB Timeout/Error
	+- Mastodon API: Fix crash in Streamer related to reblogging
	+- AdminAPI: List available frontends when `static/frontends` folder is missing
	+- Make activity search properly use language-aware GIN indexes
	+- AdminAPI: Fix suggestions for MRF Policies
	+
	+## 2.4.0 - 2021-08-08

	### Changed

	- Breaking: Configuration: `:chat, enabled` moved to `:shout, enabled` and `:instance, chat_limit` moved to `:shout, limit`
	- Support for Erlang/OTP 24
	- The `application` metadata returned with statuses is no longer hardcoded. Apps that want to display these details will now have valid data for new posts after this change.
	- HTTPSecurityPlug now sends a response header to opt out of Google's FLoC (Federated Learning of Cohorts) targeted advertising.
	- Email address is now returned if requesting user is the owner of the user account so it can be exposed in client and FE user settings UIs.
	- Improved Twittercard and OpenGraph meta tag generation including thumbnails and image dimension metadata when available.
	- AdminAPI: sort users so the newest are at the top.
	- ActivityPub Client-to-Server(C2S): Limitation on the type of Activity/Object are lifted as they are now passed through ObjectValidators

	### Added

	- MRF (`FollowBotPolicy`): New MRF Policy which makes a designated local Bot account attempt to follow all users in public Notes received by your instance. Users who require approving follower requests or have #nobot in their profile are excluded.
	- Return OAuth token `id` (primary key) in POST `/oauth/token`.
	- AdminAPI: return `created_at` date with users.
	- `AnalyzeMetadata` upload filter for extracting image/video attachment dimensions and generating blurhashes for images. Blurhashes for videos are not generated at this time.
	- Attachment dimensions and blurhashes are federated when available.
	- Pinned posts federation

	### Fixed
	- Don't crash so hard when email settings are invalid.
	- Checking activated Upload Filters for required commands.
	- Remote users can no longer reappear after being deleted.
	- Deactivated users may now be deleted.
	- Mix task `pleroma.database prune_objects`
	- Fixed rendering of JSON errors on ActivityPub endpoints.
	- Linkify: Parsing crash with URLs ending in unbalanced closed paren, no path separator, and no query parameters
	- Try to save exported ConfigDB settings (migrate_from_db) in the system temp directory if default location is not writable.
	- Uploading custom instance thumbnail via AdminAPI/AdminFE generated invalid URL to the image
	- Applying ConcurrentLimiter settings via AdminAPI
	- User login failures if their `notification_settings` were in a NULL state.
	- Mix task `pleroma.user delete_activities` query transaction timeout is now :infinity
	- MRF (`SimplePolicy`): Embedded objects are now checked. If any embedded object would be rejected, its parent is rejected. This fixes Announces leaking posts from blocked domains.
	- Fixed some Markdown issues, including trailing slash in links.

	### Removed
	- Breaking: Remove deprecated `/api/qvitter/statuses/notifications/read` (replaced by `/api/v1/pleroma/notifications/read`)

	## [2.3.0] - 2021-03-01

	### Security

	- Fixed client user agent leaking through MediaProxy

	### Removed

	- `:auth, :enforce_oauth_admin_scope_usage` configuration option.

	### Changed

	- Breaking: Changed `mix pleroma.user toggle_confirmed` to `mix pleroma.user confirm`
	- Breaking: Changed `mix pleroma.user toggle_activated` to `mix pleroma.user activate/deactivate`
	- Breaking: NSFW hashtag is no longer added on sensitive posts
	- Polls now always return a `voters_count`, even if they are single-choice.
	- Admin Emails: The ap id is used as the user link in emails now.
	- Improved registration workflow for email confirmation and account approval modes.
	- Search: When using Postgres 11+, Pleroma will use the `websearch_to_tsvector` function to parse search queries.
	- Emoji: Support the full Unicode 13.1 set of Emoji for reactions, plus regional indicators.
	- Deprecated `Pleroma.Uploaders.S3, :public_endpoint`. Now `Pleroma.Upload, :base_url` is the standard configuration key for all uploaders.
	- Improved Apache webserver support: updated sample configuration, MediaProxy cache invalidation verified with the included sample script
	- Improve OAuth 2.0 provider support. A missing `fqn` field was added to the response, but does not expose the user's email address.
	- Provide redirect of external posts from `/notice/:id` to their original URL
	- Admins no longer receive notifications for reports if they are the actor making the report.
	- Improved Mailer configuration setting descriptions for AdminFE.
	- Updated default avatar to look nicer.

	<details>
	<summary>API Changes</summary>

	- Breaking: AdminAPI changed User field `confirmation_pending` to `is_confirmed`
	- Breaking: AdminAPI changed User field `approval_pending` to `is_approved`
	- Breaking: AdminAPI changed User field `deactivated` to `is_active`
	- Breaking: AdminAPI `GET /api/pleroma/admin/users/:nickname_or_id/statuses` changed response format and added the number of total users posts.
	- Breaking: AdminAPI `GET /api/pleroma/admin/instances/:instance/statuses` changed response format and added the number of total users posts.
	- Admin API: Reports now ordered by newest
	- Pleroma API: `GET /api/v1/pleroma/chats` is deprecated in favor of `GET /api/v2/pleroma/chats`.
	- Pleroma API: Reroute `/api/pleroma/` to `/api/v1/pleroma/`

	</details>
	- Improved hashtag timeline performance (requires a background migration).

	### Added

	- Reports now generate notifications for admins and mods.
	- Support for local-only statuses.
	- Support pagination of blocks and mutes.
	- Account backup.
	- Configuration: Add `:instance, autofollowing_nicknames` setting to provide a way to make accounts automatically follow new users that register on the local Pleroma instance.
	- Ability to view remote timelines, with ex. `/api/v1/timelines/public?instance=lain.com` and streams `public:remote` and `public:remote:media`.
	- The site title is now injected as a `title` tag like preloads or metadata.
	- Password reset tokens now are not accepted after a certain age.
	- Mix tasks to help with displaying and removing ConfigDB entries. See `mix pleroma.config`.
	- OAuth form improvements: users are remembered by their cookie, the CSS is overridable by the admin, and the style has been improved.
	- OAuth improvements and fixes: more secure session-based authentication (by token that could be revoked anytime), ability to revoke belonging OAuth token from any client etc.
	- Ability to set ActivityPub aliases for follower migration.
	- Configurable background job limits for RichMedia (link previews) and MediaProxyWarmingPolicy
	- Ability to define custom HTTP headers per each frontend
	- MRF (`NoEmptyPolicy`): New MRF Policy which will deny empty statuses or statuses of only mentions from being created by local users
	- New users will receive a simple email confirming their registration if no other emails will be dispatched. (e.g., Welcome, Confirmation, or Approval Required)

	<details>
	<summary>API Changes</summary>
	- Admin API: (`GET /api/pleroma/admin/users`) filter users by `unconfirmed` status and `actor_type`.
	- Admin API: OpenAPI spec for the user-related operations
	- Pleroma API: `GET /api/v2/pleroma/chats` added. It is exactly like `GET /api/v1/pleroma/chats` except supports pagination.
	- Pleroma API: Add `idempotency_key` to the chat message entity that can be used for optimistic message sending.
	- Pleroma API: (`GET /api/v1/pleroma/federation_status`) Add a way to get a list of unreachable instances.
	- Mastodon API: User and conversation mutes can now auto-expire if `expires_in` parameter was given while adding the mute.
	- Admin API: An endpoint to manage frontends.
	- Streaming API: Add follow relationships updates.
	- WebPush: Introduce `pleroma:chat_mention` and `pleroma:emoji_reaction` notification types.
	- Mastodon API: Add monthly active users to `/api/v1/instance` (`pleroma.stats.mau`).
	- Mastodon API: Home, public, hashtag & list timelines accept `only_media`, `remote` & `local` parameters for filtration.
	- Mastodon API: `/api/v1/accounts/:id` & `/api/v1/mutes` endpoints accept `with_relationships` parameter and return filled `pleroma.relationship` field.
	- Mastodon API: Endpoint to remove a conversation (`DELETE /api/v1/conversations/:id`).
	- Mastodon API: `expires_in` in the scheduled post `params` field on `/api/v1/statuses` and `/api/v1/scheduled_statuses/:id` endpoints.
	</details>

	### Fixed

	- Users with `is_discoverable` field set to false (default value) will appear in in-service search results but be hidden from external services (search bots etc.).
	- Streaming API: Posts and notifications are not dropped, when CLI task is executing.
	- Creating incorrect IPv4 address-style HTTP links when encountering certain numbers.
	- Reblog API Endpoint: Do not set visibility parameter to public by default and let CommonAPI to infer it from status, so a user can reblog their private status without explicitly setting reblog visibility to private.
	- Tag URLs in statuses are now absolute
	- Removed duplicate jobs to purge expired activities
	- File extensions of some attachments were incorrectly changed. This feature has been disabled for now.
	- Mix task pleroma.instance creates missing parent directories if the configuration or SQL output paths are changed.

	<details>
	<summary>API Changes</summary>
	- Mastodon API: Current user is now included in conversation if it's the only participant.
	- Mastodon API: Fixed last_status.account being not filled with account data.
	- Mastodon API: Fix not being able to add or remove multiple users at once in lists.
	- Mastodon API: Fixed own_votes being not returned with poll data.
	- Mastodon API: Fixed creation of scheduled posts with polls.
	- Mastodon API: Support for expires_in/expires_at in the Filters.
	</details>

	## [2.2.2] - 2021-01-18

	### Fixed

	- StealEmojiPolicy creates dir for emojis, if it doesn't exist.
	- Updated `elixir_make` to a non-retired version

	### Upgrade notes

	1. Restart Pleroma

	## [2.2.1] - 2020-12-22

	### Changed
	- Updated Pleroma FE

	### Fixed

	- Config generation: rename `Pleroma.Upload.Filter.ExifTool` to `Pleroma.Upload.Filter.Exiftool`.
	- S3 Uploads with Elixir 1.11.
	- Mix task pleroma.user delete_activities for source installations.
	- Search: RUM index search speed has been fixed.
	- Rich Media Previews sometimes showed the wrong preview due to a bug following redirects.
	- Fixes for the autolinker.
	- Forwarded reports duplication from Pleroma instances.
	- Emoji Reaction activity filtering from blocked and muted accounts.

	- <details>
	<summary>API</summary>
	- Statuses were not displayed for Mastodon forwarded reports.
	</details>

	### Upgrade notes

	1. Restart Pleroma

	## [2.2.0] - 2020-11-12

	### Security

	- Fixed the possibility of using file uploads to spoof posts.

	### Changed

	- Breaking Requires `libmagic` (or `file`) to guess file types.
	- Breaking: App metrics endpoint (`/api/pleroma/app_metrics`) is disabled by default, check `docs/API/prometheus.md` on enabling and configuring.
	- Breaking: Pleroma Admin API: emoji packs and files routes changed.
	- Breaking: Sensitive/NSFW statuses no longer disable link previews.
	- Search: Users are now findable by their urls.
	- Renamed `:await_up_timeout` in `:connections_pool` namespace to `:connect_timeout`, old name is deprecated.
	- Renamed `:timeout` in `pools` namespace to `:recv_timeout`, old name is deprecated.
	- The `discoverable` field in the `User` struct will now add a NOINDEX metatag to profile pages when false.
	- Users with the `is_discoverable` field set to false will not show up in searches ([bug](https://git.pleroma.social/pleroma/pleroma/-/issues/2301)).
	- Minimum lifetime for ephmeral activities changed to 10 minutes and made configurable (`:min_lifetime` option).
	- Introduced optional dependencies on `ffmpeg`, `ImageMagick`, `exiftool` software packages. Please refer to `docs/installation/optional/media_graphics_packages.md`.
	- <details>
	<summary>API Changes</summary>
	- API: Empty parameter values for integer parameters are now ignored in non-strict validaton mode.
	</details>

	### Removed

	- Breaking: `Pleroma.Workers.Cron.StatsWorker` setting from Oban `:crontab` (moved to a simpler implementation).
	- Breaking: `Pleroma.Workers.Cron.ClearOauthTokenWorker` setting from Oban `:crontab` (moved to scheduled jobs).
	- Breaking: `Pleroma.Workers.Cron.PurgeExpiredActivitiesWorker` setting from Oban `:crontab` (moved to scheduled jobs).
	- Removed `:managed_config` option. In practice, it was accidentally removed with 2.0.0 release when frontends were
	switched to a new configuration mechanism, however it was not officially removed until now.

	### Added

	- Media preview proxy (requires `ffmpeg` and `ImageMagick` to be installed and media proxy to be enabled; see `:media_preview_proxy` config for more details).
	- Mix tasks for controlling user account confirmation status in bulk (`mix pleroma.user confirm_all` and `mix pleroma.user unconfirm_all`)
	- Mix task for sending confirmation emails to all unconfirmed users (`mix pleroma.email resend_confirmation_emails`)
	- Mix task option for force-unfollowing relays
	- App metrics: ability to restrict access to specified IP whitelist.

	<details>
	<summary>API Changes</summary>

	- Admin API: Importing emoji from a zip file
	- Pleroma API: Importing the mutes users from CSV files.
	- Pleroma API: Pagination for remote/local packs and emoji.

	</details>

	### Fixed

	- Add documented-but-missing chat pagination.
	- Allow sending out emails again.
	- Allow sending chat messages to yourself
	- OStatus / static FE endpoints: fixed inaccessibility for anonymous users on non-federating instances, switched to handling per `:restrict_unauthenticated` setting.
	- Fix remote users with a whitespace name.

	### Upgrade notes

	1. Install libmagic and development headers (`libmagic-dev` on Ubuntu/Debian, `file-dev` on Alpine Linux)
	2. Run database migrations (inside Pleroma directory):
	- OTP: `./bin/pleroma_ctl migrate`
	- From Source: `mix ecto.migrate`
	3. Restart Pleroma

	## [2.1.2] - 2020-09-17

	### Security

	- Fix most MRF rules either crashing or not being applied to objects passed into the Common Pipeline (ChatMessage, Question, Answer, Audio, Event).

	### Fixed

	- Welcome Chat messages preventing user registration with MRF Simple Policy applied to the local instance.
	- Mastodon API: the public timeline returning an error when the `reply_visibility` parameter is set to `self` for an unauthenticated user.
	- Mastodon Streaming API: Handler crashes on authentication failures, resulting in error logs.
	- Mastodon Streaming API: Error logs on client pings.
	- Rich media: Log spam on failures. Now the error is only logged once per attempt.

	### Changed

	- Rich Media: A HEAD request is now done to the url, to ensure it has the appropriate content type and size before proceeding with a GET.

	### Upgrade notes

	1. Restart Pleroma

	## [2.1.1] - 2020-09-08

	### Security
	- Fix possible DoS in Mastodon API user search due to an error in match clauses, leading to an infinite recursion and subsequent OOM with certain inputs.
	- Fix metadata leak for accounts and statuses on private instances.
	- Fix possible DoS in Admin API search using an atom leak vulnerability. Authentication with admin rights was required to exploit.

	### Changed

	- Breaking: The metadata providers RelMe and Feed are no longer configurable. RelMe should always be activated and Feed only provides a <link> header tag for the actual RSS/Atom feed when the instance is public.
	- Improved error message when cmake is not available at build stage.

	### Added
	- Rich media failure tracking (along with `:failure_backoff` option).

	<details>
	<summary>Admin API Changes</summary>

	- Add `PATCH /api/pleroma/admin/instance_document/:document_name` to modify the Terms of Service and Instance Panel HTML pages via Admin API
	</details>

	### Fixed
	- Default HTTP adapter not respecting pool setting, leading to possible OOM.
	- Fixed uploading webp images when the Exiftool Upload Filter is enabled by skipping them
	- Mastodon API: Search parameter `following` now correctly returns the followings rather than the followers
	- Mastodon API: Timelines hanging for (`number of posts with links * rich media timeout`) in the worst case.
	Reduced to just rich media timeout.
	- Mastodon API: Cards being wrong for preview statuses due to cache key collision.
	- Password resets no longer processed for deactivated accounts.
	- Favicon scraper raising exceptions on URLs longer than 255 characters.

	## [2.1.0] - 2020-08-28

	### Changed

	- Breaking: The default descriptions on uploads are now empty. The old behavior (filename as default) can be configured, see the cheat sheet.
	- Breaking: Added the ObjectAgePolicy to the default set of MRFs. This will delist and strip the follower collection of any message received that is older than 7 days. This will stop users from seeing very old messages in the timelines. The messages can still be viewed on the user's page and in conversations. They also still trigger notifications.
	- Breaking: Elixir >=1.9 is now required (was >= 1.8)
	- Breaking: Configuration: `:auto_linker, :opts` moved to `:pleroma, Pleroma.Formatter`. Old config namespace is deprecated.
	- Breaking: Configuration: `:instance, welcome_user_nickname` moved to `:welcome, :direct_message, :sender_nickname`, `:instance, :welcome_message` moved to `:welcome, :direct_message, :message`. Old config namespace is deprecated.
	- Breaking: LDAP: Fallback to local database authentication has been removed for security reasons and lack of a mechanism to ensure the passwords are synchronized when LDAP passwords are updated.
	- Breaking Changed defaults for `:restrict_unauthenticated` so that when `:instance, :public` is set to `false` then all `:restrict_unauthenticated` items be effectively set to `true`. If you'd like to allow unauthenticated access to specific API endpoints on a private instance, please explicitly set `:restrict_unauthenticated` to non-default value in `config/prod.secret.exs`.
	- In Conversations, return only direct messages as `last_status`
	- Using the `only_media` filter on timelines will now exclude reblog media
	- MFR policy to set global expiration for all local Create activities
	- OGP rich media parser merged with TwitterCard
	- Configuration: `:instance, rewrite_policy` moved to `:mrf, policies`, `:instance, :mrf_transparency` moved to `:mrf, :transparency`, `:instance, :mrf_transparency_exclusions` moved to `:mrf, :transparency_exclusions`. Old config namespace is deprecated.
	- Configuration: `:media_proxy, whitelist` format changed to host with scheme (e.g. `http://example.com` instead of `example.com`). Domain format is deprecated.

	<details>
	<summary>API Changes</summary>

	- Breaking: Pleroma API: The routes to update avatar, banner and background have been removed.
	- Breaking: Image description length is limited now.
	- Breaking: Emoji API: changed methods and renamed routes.
	- Breaking: Notification Settings API for suppressing notifications has been simplified down to `block_from_strangers`.
	- Breaking: Notification Settings API option for hiding push notification contents has been renamed to `hide_notification_contents`.
	- MastodonAPI: Allow removal of avatar, banner and background.
	- Streaming: Repeats of a user's posts will no longer be pushed to the user's stream.
	- Mastodon API: Added `pleroma.metadata.fields_limits` to /api/v1/instance
	- Mastodon API: On deletion, returns the original post text.
	- Mastodon API: Add `pleroma.unread_count` to the Marker entity.
	- Mastodon API: Added `pleroma.metadata.post_formats` to /api/v1/instance
	- Mastodon API (legacy): Allow query parameters for `/api/v1/domain_blocks`, e.g. `/api/v1/domain_blocks?domain=badposters.zone`
	- Mastodon API: Make notifications about statuses from muted users and threads read automatically
	- Pleroma API: `/api/pleroma/captcha` responses now include `seconds_valid` with an integer value.

	</details>

	<details>
	<summary>Admin API Changes</summary>

	- Breaking Changed relay `/api/pleroma/admin/relay` endpoints response format.
	- Status visibility stats: now can return stats per instance.
	- Mix task to refresh counter cache (`mix pleroma.refresh_counter_cache`)

	</details>

	### Removed

	- Breaking: removed `with_move` parameter from notifications timeline.

	### Added

	- Frontends: Add mix task to install frontends.
	- Frontends: Add configurable frontends for primary and admin fe.
	- Configuration: Added a blacklist for email servers.
	- Chats: Added `accepts_chat_messages` field to user, exposed in APIs and federation.
	- Chats: Added support for federated chats. For details, see the docs.
	- ActivityPub: Added support for existing AP ids for instances migrated from Mastodon.
	- Instance: Add `background_image` to configuration and `/api/v1/instance`
	- Instance: Extend `/api/v1/instance` with Pleroma-specific information.
	- NodeInfo: `pleroma:api/v1/notifications:include_types_filter` to the `features` list.
	- NodeInfo: `pleroma_emoji_reactions` to the `features` list.
	- Configuration: `:restrict_unauthenticated` setting, restrict access for unauthenticated users to timelines (public and federate), user profiles and statuses.
	- Configuration: Add `:database_config_whitelist` setting to whitelist settings which can be configured from AdminFE.
	- Configuration: `filename_display_max_length` option to set filename truncate limit, if filename display enabled (0 = no limit).
	- New HTTP adapter [gun](https://github.com/ninenines/gun). Gun adapter requires minimum OTP version of 22.2 otherwise Pleroma won’t start. For hackney OTP update is not required.
	- Mix task to create trusted OAuth App.
	- Mix task to reset MFA for user accounts
	- Notifications: Added `follow_request` notification type.
	- Added `:reject_deletes` group to SimplePolicy
	- MRF (`EmojiStealPolicy`): New MRF Policy which allows to automatically download emojis from remote instances
	- Support pagination in emoji packs API (for packs and for files in pack)
	- Support for viewing instances favicons next to posts and accounts
	- Added Pleroma.Upload.Filter.Exiftool as an alternate EXIF stripping mechanism targeting GPS/location metadata.
	- "By approval" registrations mode.
	- Configuration: Added `:welcome` settings for the welcome message to newly registered users. You can send a welcome message as a direct message, chat or email.
	- Ability to hide favourites and emoji reactions in the API with `[:instance, :show_reactions]` config.

	<details>
	<summary>API Changes</summary>

	- Mastodon API: Add pleroma.parent_visible field to statuses.
	- Mastodon API: Extended `/api/v1/instance`.
	- Mastodon API: Support for `include_types` in `/api/v1/notifications`.
	- Mastodon API: Added `/api/v1/notifications/:id/dismiss` endpoint.
	- Mastodon API: Add support for filtering replies in public and home timelines.
	- Mastodon API: Support for `bot` field in `/api/v1/accounts/update_credentials`.
	- Mastodon API: Support irreversible property for filters.
	- Mastodon API: Add pleroma.favicon field to accounts.
	- Admin API: endpoints for create/update/delete OAuth Apps.
	- Admin API: endpoint for status view.
	- OTP: Add command to reload emoji packs
	</details>

	### Fixed
	- Fix list pagination and other list issues.
	- Support pagination in conversations API
	- Breaking: SimplePolicy `:reject` and `:accept` allow deletions again
	- Fix follower/blocks import when nicknames starts with @
	- Filtering of push notifications on activities from blocked domains
	- Resolving Peertube accounts with Webfinger
	- `blob:` urls not being allowed by connect-src CSP
	- Mastodon API: fix `GET /api/v1/notifications` not returning the full result set
	- Rich Media Previews for Twitter links
	- Admin API: fix `GET /api/pleroma/admin/users/:nickname/credentials` returning 404 when getting the credentials of a remote user while `:instance, :limit_to_local_content` is set to `:unauthenticated`
	- Fix CSP policy generation to include remote Captcha services
	- Fix edge case where MediaProxy truncates media, usually caused when Caddy is serving content for the other Federated instance.
	- Emoji Packs could not be listed when instance was set to `public: false`
	- Fix whole_word always returning false on filter get requests
	- Migrations not working on OTP releases if the database was connected over ssl
	- Fix relay following

	## [2.0.7] - 2020-06-13

	### Security
	- Fix potential DoSes exploiting atom leaks in rich media parser and the `UserAllowListPolicy` MRF policy

	### Fixed
	- CSP: not allowing images/media from every host when mediaproxy is disabled
	- CSP: not adding mediaproxy base url to image/media hosts
	- StaticFE missing the CSS file

	### Upgrade notes

	1. Restart Pleroma

	## [2.0.6] - 2020-06-09

	### Security
	- CSP: harden `image-src` and `media-src` when MediaProxy is used

	### Fixed
	- AP C2S: Fix pagination in inbox/outbox
	- Various compilation errors on OTP 23
	- Mastodon API streaming: Repeats from muted threads not being filtered

	### Changed
	- Various database performance improvements

	### Upgrade notes
	1. Run database migrations (inside Pleroma directory):
	- OTP: `./bin/pleroma_ctl migrate`
	- From Source: `mix ecto.migrate`
	2. Restart Pleroma

	## [2.0.5] - 2020-05-13

	### Security
	- Fix possible private status leaks in Mastodon Streaming API

	### Fixed
	- Crashes when trying to block a user if block federation is disabled
	- Not being able to start the instance without `erlang-eldap` installed
	- Users with bios over the limit getting rejected
	- Follower counters not being updated on incoming follow accepts

	### Upgrade notes

	1. Restart Pleroma

	## [2.0.4] - 2020-05-10

	### Security
	- AP C2S: Fix a potential DoS by creating nonsensical objects that break timelines

	### Fixed
	- Peertube user lookups not working
	- `InsertSkeletonsForDeletedUsers` migration failing on some instances
	- Healthcheck reporting the number of memory currently used, rather than allocated in total
	- LDAP not being usable in OTP releases
	- Default apache configuration having tls chain issues

	### Upgrade notes

	#### Apache only

	1. Remove the following line from your config:
	```
	SSLCertificateFile /etc/letsencrypt/live/${servername}/cert.pem
	```

	#### Everyone

	1. Restart Pleroma

	## [2.0.3] - 2020-05-02

	### Security
	- Disallow re-registration of previously deleted users, which allowed viewing direct messages addressed to them
	- Mastodon API: Fix `POST /api/v1/follow_requests/:id/authorize` allowing to force a follow from a local user even if they didn't request to follow
	- CSP: Sandbox uploads

	### Fixed
	- Notifications from blocked domains
	- Potential federation issues with Mastodon versions before 3.0.0
	- HTTP Basic Authentication permissions issue
	- Follow/Block imports not being able to find the user if the nickname started with an `@`
	- Instance stats counting internal users
	- Inability to run a From Source release without git
	- ObjectAgePolicy didn't filter out old messages
	- `blob:` urls not being allowed by CSP

	### Added
	- NodeInfo: ObjectAgePolicy settings to the `federation` list.
	- Follow request notifications
	<details>
	<summary>API Changes</summary>
	- Admin API: `GET /api/pleroma/admin/need_reboot`.
	</details>

	### Upgrade notes

	1. Restart Pleroma
	2. Run database migrations (inside Pleroma directory):
	- OTP: `./bin/pleroma_ctl migrate`
	- From Source: `mix ecto.migrate`
	3. Reset status visibility counters (inside Pleroma directory):
	- OTP: `./bin/pleroma_ctl refresh_counter_cache`
	- From Source: `mix pleroma.refresh_counter_cache`


	## [2.0.2] - 2020-04-08
	### Added
	- Support for Funkwhale's `Audio` activity
	- Admin API: `PATCH /api/pleroma/admin/users/:nickname/update_credentials`

	### Fixed
	- Blocked/muted users still generating push notifications
	- Input textbox for bio ignoring newlines
	- OTP: Inability to use PostgreSQL databases with SSL
	- `user delete_activities` breaking when trying to delete already deleted posts
	- Incorrect URL for Funkwhale channels

	### Upgrade notes
	1. Restart Pleroma

	## [2.0.1] - 2020-03-15
	### Security
	- Static-FE: Fix remote posts not being sanitized

	### Fixed
	- Rate limiter crashes when there is no explicitly specified ip in the config
	- 500 errors when no `Accept` header is present if Static-FE is enabled
	- Instance panel not being updated immediately due to wrong `Cache-Control` headers
	- Statuses posted with BBCode/Markdown having unncessary newlines in Pleroma-FE
	- OTP: Fix some settings not being migrated to in-database config properly
	- No `Cache-Control` headers on attachment/media proxy requests
	- Character limit enforcement being off by 1
	- Mastodon Streaming API: hashtag timelines not working

	### Changed
	- BBCode and Markdown formatters will no longer return any `\n` and only use `<br/>` for newlines
	- Mastodon API: Allow registration without email if email verification is not enabled

	### Upgrade notes
	#### Nginx only
	1. Remove `proxy_ignore_headers Cache-Control;` and `proxy_hide_header Cache-Control;` from your config.

	#### Everyone
	1. Run database migrations (inside Pleroma directory):
	- OTP: `./bin/pleroma_ctl migrate`
	- From Source: `mix ecto.migrate`
	2. Restart Pleroma

	## [2.0.0] - 2019-03-08
	### Security
	- Mastodon API: Fix being able to request enormous amount of statuses in timelines leading to DoS. Now limited to 40 per request.

	### Removed
	- Breaking: Removed 1.0+ deprecated configurations `Pleroma.Upload, :strip_exif` and `:instance, :dedupe_media`
	- Breaking: OStatus protocol support
	- Breaking: MDII uploader
	- Breaking: Using third party engines for user recommendation
	<details>
	<summary>API Changes</summary>

	- Breaking: AdminAPI: migrate_from_db endpoint
	</details>

	### Changed
	- Breaking: Pleroma won't start if it detects unapplied migrations
	- Breaking: Elixir >=1.8 is now required (was >= 1.7)
	- Breaking: `Pleroma.Plugs.RemoteIp` and `:rate_limiter` enabled by default. Please ensure your reverse proxy forwards the real IP!
	- Breaking: attachment links (`config :pleroma, :instance, no_attachment_links` and `config :pleroma, Pleroma.Upload, link_name`) disabled by default
	- Breaking: OAuth: defaulted `[:auth, :enforce_oauth_admin_scope_usage]` setting to `true` which demands `admin` OAuth scope to perform admin actions (in addition to `is_admin` flag on User); make sure to use bundled or newer versions of AdminFE & PleromaFE to access admin / moderator features.
	- Breaking: Dynamic configuration has been rearchitected. The `:pleroma, :instance, dynamic_configuration` setting has been replaced with `config :pleroma, configurable_from_database`. Please backup your configuration to a file and run the migration task to ensure consistency with the new schema.
	- Breaking: `:instance, no_attachment_links` has been replaced with `:instance, attachment_links` which still takes a boolean value but doesn't use double negative language.
	- Replaced [pleroma_job_queue](https://git.pleroma.social/pleroma/pleroma_job_queue) and `Pleroma.Web.Federator.RetryQueue` with [Oban](https://github.com/sorentwo/oban) (see [`docs/config.md`](docs/config.md) on migrating customized worker / retry settings)
	- Introduced [quantum](https://github.com/quantum-elixir/quantum-core) job scheduler
	- Enabled `:instance, extended_nickname_format` in the default config
	- Add `rel="ugc"` to all links in statuses, to prevent SEO spam
	- Extract RSS functionality from OStatus
	- MRF (Simple Policy): Also use `:accept`/`:reject` on the actors rather than only their activities
	- OStatus: Extract RSS functionality
	- Deprecated `User.Info` embedded schema (fields moved to `User`)
	- Store status data inside Flag activity
	- Deprecated (reorganized as `UserRelationship` entity) User fields with user AP IDs (`blocks`, `mutes`, `muted_reblogs`, `muted_notifications`, `subscribers`).
	- Rate limiter is now disabled for localhost/socket (unless remoteip plug is enabled)
	- Logger: default log level changed from `warn` to `info`.
	- Config mix task `migrate_to_db` truncates `config` table before migrating the config file.
	- Allow account registration without an email
	- Default to `prepare: :unnamed` in the database configuration.
	- Instance stats are now loaded on startup instead of being empty until next hourly job.
	<details>
	<summary>API Changes</summary>

	- Breaking EmojiReactions: Change endpoints and responses to align with Mastodon
	- Breaking Admin API: `PATCH /api/pleroma/admin/users/:nickname/force_password_reset` is now `PATCH /api/pleroma/admin/users/force_password_reset` (accepts `nicknames` array in the request body)
	- Breaking: Admin API: Return link alongside with token on password reset
	- Breaking: Admin API: `PUT /api/pleroma/admin/reports/:id` is now `PATCH /api/pleroma/admin/reports`, see admin_api.md for details
	- Breaking: `/api/pleroma/admin/users/invite_token` now uses `POST`, changed accepted params and returns full invite in json instead of only token string.
	- Breaking replying to reports is now "report notes", endpoint changed from `POST /api/pleroma/admin/reports/:id/respond` to `POST /api/pleroma/admin/reports/:id/notes`
	- Mastodon API: stopped sanitizing display names, field names and subject fields since they are supposed to be treated as plaintext
	- Admin API: Return `total` when querying for reports
	- Mastodon API: Return `pleroma.direct_conversation_id` when creating a direct message (`POST /api/v1/statuses`)
	- Admin API: Return link alongside with token on password reset
	- Admin API: Support authentication via `x-admin-token` HTTP header
	- Mastodon API: Add `pleroma.direct_conversation_id` to the status endpoint (`GET /api/v1/statuses/:id`)
	- Mastodon API: `pleroma.thread_muted` to the Status entity
	- Mastodon API: Mark the direct conversation as read for the author when they send a new direct message
	- Mastodon API, streaming: Add `pleroma.direct_conversation_id` to the `conversation` stream event payload.
	- Admin API: Render whole status in grouped reports
	- Mastodon API: User timelines will now respect blocks, unless you are getting the user timeline of somebody you blocked (which would be empty otherwise).
	- Mastodon API: Favoriting / Repeating a post multiple times will now return the identical response every time. Before, executing that action twice would return an error ("already favorited") on the second try.
	- Mastodon API: Limit timeline requests to 3 per timeline per 500ms per user/ip by default.
	- Admin API: `PATCH /api/pleroma/admin/users/:nickname/credentials` and `GET /api/pleroma/admin/users/:nickname/credentials`
	</details>

	### Added
	- `:chat_limit` option to limit chat characters.
	- `cleanup_attachments` option to remove attachments along with statuses. Does not affect duplicate files and attachments without status. Enabling this will increase load to database when deleting statuses on larger instances.
	- Refreshing poll results for remote polls
	- Authentication: Added rate limit for password-authorized actions / login existence checks
	- Static Frontend: Add the ability to render user profiles and notices server-side without requiring JS app.
	- Mix task to re-count statuses for all users (`mix pleroma.count_statuses`)
	- Mix task to list all users (`mix pleroma.user list`)
	- Mix task to send a test email (`mix pleroma.email test`)
	- Support for `X-Forwarded-For` and similar HTTP headers which used by reverse proxies to pass a real user IP address to the backend. Must not be enabled unless your instance is behind at least one reverse proxy (such as Nginx, Apache HTTPD or Varnish Cache).
	- MRF: New module which handles incoming posts based on their age. By default, all incoming posts that are older than 2 days will be unlisted and not shown to their followers.
	- User notification settings: Add `privacy_option` option.
	- Support for custom Elixir modules (such as MRF policies)
	- User settings: Add _This account is a_ option.
	- A new users admin digest email
	- OAuth: admin scopes support (relevant setting: `[:auth, :enforce_oauth_admin_scope_usage]`).
	- Add an option `authorized_fetch_mode` to require HTTP signatures for AP fetches.
	- ActivityPub: support for `replies` collection (output for outgoing federation & fetching on incoming federation).
	- Mix task to refresh counter cache (`mix pleroma.refresh_counter_cache`)
	<details>
	<summary>API Changes</summary>

	- Job queue stats to the healthcheck page
	- Admin API: Add ability to fetch reports, grouped by status `GET /api/pleroma/admin/grouped_reports`
	- Admin API: Add ability to require password reset
	- Mastodon API: Account entities now include `follow_requests_count` (planned Mastodon 3.x addition)
	- Pleroma API: `GET /api/v1/pleroma/accounts/:id/scrobbles` to get a list of recently scrobbled items
	- Pleroma API: `POST /api/v1/pleroma/scrobble` to scrobble a media item
	- Mastodon API: Add `upload_limit`, `avatar_upload_limit`, `background_upload_limit`, and `banner_upload_limit` to `/api/v1/instance`
	- Mastodon API: Add `pleroma.unread_conversation_count` to the Account entity
	- OAuth: support for hierarchical permissions / [Mastodon 2.4.3 OAuth permissions](https://docs.joinmastodon.org/api/permissions/)
	- Metadata Link: Atom syndication Feed
	- Mix task to re-count statuses for all users (`mix pleroma.count_statuses`)
	- Mastodon API: Add `exclude_visibilities` parameter to the timeline and notification endpoints
	- Admin API: `/users/:nickname/toggle_activation` endpoint is now deprecated in favor of: `/users/activate`, `/users/deactivate`, both accept `nicknames` array
	- Admin API: Multiple endpoints now require `nicknames` array, instead of singe `nickname`:
	- `POST/DELETE /api/pleroma/admin/users/:nickname/permission_group/:permission_group` are deprecated in favor of: `POST/DELETE /api/pleroma/admin/users/permission_group/:permission_group`
	- `DELETE /api/pleroma/admin/users` (`nickname` query param or `nickname` sent in JSON body) is deprecated in favor of: `DELETE /api/pleroma/admin/users` (`nicknames` query array param or `nicknames` sent in JSON body)
	- Admin API: Add `GET /api/pleroma/admin/relay` endpoint - lists all followed relays
	- Pleroma API: `POST /api/v1/pleroma/conversations/read` to mark all conversations as read
	- ActivityPub: Support `Move` activities
	- Mastodon API: Add `/api/v1/markers` for managing timeline read markers
	- Mastodon API: Add the `recipients` parameter to `GET /api/v1/conversations`
	- Configuration: `feed` option for user atom feed.
	- Pleroma API: Add Emoji reactions
	- Admin API: Add `/api/pleroma/admin/instances/:instance/statuses` - lists all statuses from a given instance
	- Admin API: Add `/api/pleroma/admin/users/:nickname/statuses` - lists all statuses from a given user
	- Admin API: `PATCH /api/pleroma/users/confirm_email` to confirm email for multiple users, `PATCH /api/pleroma/users/resend_confirmation_email` to resend confirmation email for multiple users
	- ActivityPub: Configurable `type` field of the actors.
	- Mastodon API: `/api/v1/accounts/:id` has `source/pleroma/actor_type` field.
	- Mastodon API: `/api/v1/update_credentials` accepts `actor_type` field.
	- Captcha: Support native provider
	- Captcha: Enable by default
	- Mastodon API: Add support for `account_id` param to filter notifications by the account
	- Mastodon API: Add `emoji_reactions` property to Statuses
	- Mastodon API: Change emoji reaction reply format
	- Notifications: Added `pleroma:emoji_reaction` notification type
	- Mastodon API: Change emoji reaction reply format once more
	- Configuration: `feed.logo` option for tag feed.
	- Tag feed: `/tags/:tag.rss` - list public statuses by hashtag.
	- Mastodon API: Add `reacted` property to `emoji_reactions`
	- Pleroma API: Add reactions for a single emoji.
	- ActivityPub: `[:activitypub, :note_replies_output_limit]` setting sets the number of note self-replies to output on outgoing federation.
	- Admin API: `GET /api/pleroma/admin/stats` to get status count by visibility scope
	- Admin API: `GET /api/pleroma/admin/statuses` - list all statuses (accepts `godmode` and `local_only`)
	</details>

	### Fixed
	- Report emails now include functional links to profiles of remote user accounts
	- Not being able to log in to some third-party apps when logged in to MastoFE
	- MRF: `Delete` activities being exempt from MRF policies
	- OTP releases: Not being able to configure OAuth expired token cleanup interval
	- OTP releases: Not being able to configure HTML sanitization policy
	- OTP releases: Not being able to change upload limit (again)
	- Favorites timeline now ordered by favorite date instead of post date
	- Support for cancellation of a follow request
	<details>
	<summary>API Changes</summary>

	- Mastodon API: Fix private and direct statuses not being filtered out from the public timeline for an authenticated user (`GET /api/v1/timelines/public`)
	- Mastodon API: Inability to get some local users by nickname in `/api/v1/accounts/:id_or_nickname`
	- AdminAPI: If some status received reports both in the "new" format and "old" format it was considered reports on two different statuses (in the context of grouped reports)
	- Admin API: Error when trying to update reports in the "old" format
	- Mastodon API: Marking a conversation as read (`POST /api/v1/conversations/:id/read`) now no longer brings it to the top in the user's direct conversation list
	</details>

	## [1.1.9] - 2020-02-10
	### Fixed
	- OTP: Inability to set the upload limit (again)
	- Not being able to pin polls
	- Streaming API: incorrect handling of reblog mutes
	- Rejecting the user when field length limit is exceeded
	- OpenGraph provider: html entities in descriptions

	## [1.1.8] - 2020-01-10
	### Fixed
	- Captcha generation issues
	- Returned Kocaptcha endpoint to configuration
	- Captcha validity is now 5 minutes

	## [1.1.7] - 2019-12-13
	### Fixed
	- OTP: Inability to set the upload limit
	- OTP: Inability to override node name/distribution type to run 2 Pleroma instances on the same machine

	### Added
	- Integrated captcha provider

	### Changed
	- Captcha enabled by default
	- Default Captcha provider changed from `Pleroma.Captcha.Kocaptcha` to `Pleroma.Captcha.Native`
	- Better `Cache-Control` header for static content

	### Bundled Pleroma-FE Changes
	#### Added
	- Icons in the navigation panel

	#### Fixed
	- Improved support unauthenticated view of private instances

	#### Removed
	- Whitespace hack on empty post content

	## [1.1.6] - 2019-11-19
	### Fixed
	- Not being able to log into to third party apps when the browser is logged into mastofe
	- Email confirmation not being required even when enabled
	- Mastodon API: conversations API crashing when one status is malformed

	### Bundled Pleroma-FE Changes
	#### Added
	- About page
	- Meme arrows

	#### Fixed
	- Image modal not closing unless clicked outside of image
	- Attachment upload spinner not being centered
	- Showing follow counters being 0 when they are actually hidden

	## [1.1.5] - 2019-11-09
	### Fixed
	- Polls having different numbers in timelines/notifications/poll api endpoints due to cache desyncronization
	- Pleroma API: OAuth token endpoint not being found when ".json" suffix is appended

	### Changed
	- Frontend bundle updated to [044c9ad0](https://git.pleroma.social/pleroma/pleroma-fe/commit/044c9ad0562af059dd961d50961a3880fca9c642)

	## [1.1.4] - 2019-11-01
	### Fixed
	- Added a migration that fills up empty user.info fields to prevent breakage after previous unsafe migrations.
	- Failure to migrate from pre-1.0.0 versions
	- Mastodon API: Notification stream not including follow notifications

	## [1.1.3] - 2019-10-25
	### Fixed
	- Blocked users showing up in notifications collapsed as if they were muted
	- `pleroma_ctl` not working on Debian's default shell

	## [1.1.2] - 2019-10-18
	### Fixed
	- `pleroma_ctl` trying to connect to a running instance when generating the config, which of course doesn't exist.

	## [1.1.1] - 2019-10-18
	### Fixed
	- One of the migrations between 1.0.0 and 1.1.0 wiping user info of the relay user because of unexpected behavior of postgresql's `jsonb_set`, resulting in inability to post in the default configuration. If you were affected, please run the following query in postgres console, the relay user will be recreated automatically:
	```
	delete from users where ap_id = 'https://your.instance.hostname/relay';
	```
	- Bad user search matches

	## [1.1.0] - 2019-10-14
	Breaking: The stable branch has been changed from `master` to `stable`. If you want to keep using 1.0, the `release/1.0` branch will receive security updates for 6 months after 1.1 release.

	OTP Note: `pleroma_ctl` in 1.0 defaults to `master` and doesn't support specifying arbitrary branches, making `./pleroma_ctl update` fail. To fix this, fetch a version of `pleroma_ctl` from 1.1 using the command below and proceed with the update normally:
	```
	curl -Lo ./bin/pleroma_ctl 'https://git.pleroma.social/pleroma/pleroma/raw/develop/rel/files/bin/pleroma_ctl'
	```
	### Security
	- Mastodon API: respect post privacy in `/api/v1/statuses/:id/{favourited,reblogged}_by`

	### Removed
	- Breaking: GNU Social API with Qvitter extensions support
	- Emoji: Remove longfox emojis.
	- Remove `Reply-To` header from report emails for admins.
	- ActivityPub: The `/objects/:uuid/likes` endpoint.

	### Changed
	- Breaking: Configuration: A setting to explicitly disable the mailer was added, defaulting to true, if you are using a mailer add `config :pleroma, Pleroma.Emails.Mailer, enabled: true` to your config
	- Breaking: Configuration: `/media/` is now removed when `base_url` is configured, append `/media/` to your `base_url` config to keep the old behaviour if desired
	- Breaking: `/api/pleroma/notifications/read` is moved to `/api/v1/pleroma/notifications/read` and now supports `max_id` and responds with Mastodon API entities.
	- Configuration: added `config/description.exs`, from which `docs/config.md` is generated
	- Configuration: OpenGraph and TwitterCard providers enabled by default
	- Configuration: Filter.AnonymizeFilename added ability to retain file extension with custom text
	- Federation: Return 403 errors when trying to request pages from a user's follower/following collections if they have `hide_followers`/`hide_follows` set
	- NodeInfo: Return `skipThreadContainment` in `metadata` for the `skip_thread_containment` option
	- NodeInfo: Return `mailerEnabled` in `metadata`
	- Mastodon API: Unsubscribe followers when they unfollow a user
	- Mastodon API: `pleroma.thread_muted` key in the Status entity
	- AdminAPI: Add "godmode" while fetching user statuses (i.e. admin can see private statuses)
	- Improve digest email template
	– Pagination: (optional) return `total` alongside with `items` when paginating
	- The `Pleroma.FlakeId` module has been replaced with the `flake_id` library.

	### Fixed
	- Following from Osada
	- Favorites timeline doing database-intensive queries
	- Metadata rendering errors resulting in the entire page being inaccessible
	- `federation_incoming_replies_max_depth` option being ignored in certain cases
	- Mastodon API: Handling of search timeouts (`/api/v1/search` and `/api/v2/search`)
	- Mastodon API: Misskey's endless polls being unable to render
	- Mastodon API: Embedded relationships not being properly rendered in the Account entity of Status entity
	- Mastodon API: Notifications endpoint crashing if one notification failed to render
	- Mastodon API: `exclude_replies` is correctly handled again.
	- Mastodon API: Add `account_id`, `type`, `offset`, and `limit` to search API (`/api/v1/search` and `/api/v2/search`)
	- Mastodon API, streaming: Fix filtering of notifications based on blocks/mutes/thread mutes
	- Mastodon API: Fix private and direct statuses not being filtered out from the public timeline for an authenticated user (`GET /api/v1/timelines/public`)
	- Mastodon API: Ensure the `account` field is not empty when rendering Notification entities.
	- Mastodon API: Inability to get some local users by nickname in `/api/v1/accounts/:id_or_nickname`
	- Mastodon API: Blocks are now treated consistently between the Streaming API and the Timeline APIs
	- Rich Media: Parser failing when no TTL can be found by image TTL setters
	- Rich Media: The crawled URL is now spliced into the rich media data.
	- ActivityPub S2S: sharedInbox usage has been mostly aligned with the rules in the AP specification.
	- ActivityPub C2S: follower/following collection pages being inaccessible even when authentifucated if `hide_followers`/ `hide_follows` was set
	- ActivityPub: Deactivated user deletion
	- ActivityPub: Fix `/users/:nickname/inbox` crashing without an authenticated user
	- MRF: fix ability to follow a relay when AntiFollowbotPolicy was enabled
	- ActivityPub: Correct addressing of Undo.
	- ActivityPub: Correct addressing of profile update activities.
	- ActivityPub: Polls are now refreshed when necessary.
	- Report emails now include functional links to profiles of remote user accounts
	- Existing user id not being preserved on insert conflict
	- Pleroma.Upload base_url was not automatically whitelisted by MediaProxy. Now your custom CDN or file hosting will be accessed directly as expected.
	- Report email not being sent to admins when the reporter is a remote user
	- Reverse Proxy limiting `max_body_length` was incorrectly defined and only checked `Content-Length` headers which may not be sufficient in some circumstances

	### Added
	- Expiring/ephemeral activites. All activities can have expires_at value set, which controls when they should be deleted automatically.
	- Mastodon API: in post_status, the expires_in parameter lets you set the number of seconds until an activity expires. It must be at least one hour.
	- Mastodon API: all status JSON responses contain a `pleroma.expires_at` item which states when an activity will expire. The value is only shown to the user who created the activity. To everyone else it's empty.
	- Configuration: `ActivityExpiration.enabled` controls whether expired activites will get deleted at the appropriate time. Enabled by default.
	- Conversations: Add Pleroma-specific conversation endpoints and status posting extensions. Run the `bump_all_conversations` task again to create the necessary data.
	- MRF: Support for priming the mediaproxy cache (`Pleroma.Web.ActivityPub.MRF.MediaProxyWarmingPolicy`)
	- MRF: Support for excluding specific domains from Transparency.
	- MRF: Support for filtering posts based on who they mention (`Pleroma.Web.ActivityPub.MRF.MentionPolicy`)
	- Mastodon API: Support for the [`tagged` filter](https://github.com/tootsuite/mastodon/pull/9755) in [`GET /api/v1/accounts/:id/statuses`](https://docs.joinmastodon.org/api/rest/accounts/#get-api-v1-accounts-id-statuses)
	- Mastodon API, streaming: Add support for passing the token in the `Sec-WebSocket-Protocol` header
	- Mastodon API, extension: Ability to reset avatar, profile banner, and background
	- Mastodon API: Add support for `fields_attributes` API parameter (setting custom fields)
	- Mastodon API: Add support for categories for custom emojis by reusing the group feature. <https://github.com/tootsuite/mastodon/pull/11196>
	- Mastodon API: Add support for muting/unmuting notifications
	- Mastodon API: Add support for the `blocked_by` attribute in the relationship API (`GET /api/v1/accounts/relationships`). <https://github.com/tootsuite/mastodon/pull/10373>
	- Mastodon API: Add support for the `domain_blocking` attribute in the relationship API (`GET /api/v1/accounts/relationships`).
	- Mastodon API: Add `pleroma.deactivated` to the Account entity
	- Mastodon API: added `/auth/password` endpoint for password reset with rate limit.
	- Mastodon API: /api/v1/accounts/:id/statuses now supports nicknames or user id
	- Mastodon API: Improve support for the user profile custom fields
	- Mastodon API: Add support for `fields_attributes` API parameter (setting custom fields)
	- Mastodon API: Added an endpoint to get multiple statuses by IDs (`GET /api/v1/statuses/?ids[]=1&ids[]=2`)
	- Admin API: Return users' tags when querying reports
	- Admin API: Return avatar and display name when querying users
	- Admin API: Allow querying user by ID
	- Admin API: Added support for `tuples`.
	- Admin API: Added endpoints to run mix tasks pleroma.config migrate_to_db & pleroma.config migrate_from_db
	- Added synchronization of following/followers counters for external users
	- Configuration: `enabled` option for `Pleroma.Emails.Mailer`, defaulting to `false`.
	- Configuration: Pleroma.Plugs.RateLimiter `bucket_name`, `params` options.
	- Configuration: `user_bio_length` and `user_name_length` options.
	- Addressable lists
	- Twitter API: added rate limit for `/api/account/password_reset` endpoint.
	- ActivityPub: Add an internal service actor for fetching ActivityPub objects.
	- ActivityPub: Optional signing of ActivityPub object fetches.
	- Admin API: Endpoint for fetching latest user's statuses
	- Pleroma API: Add `/api/v1/pleroma/accounts/confirmation_resend?email=<email>` for resending account confirmation.
	- Pleroma API: Email change endpoint.
	- Admin API: Added moderation log
	- Web response cache (currently, enabled for ActivityPub)
	- Reverse Proxy: Do not retry failed requests to limit pressure on the peer

	### Changed
	- Configuration: Filter.AnonymizeFilename added ability to retain file extension with custom text
	- Admin API: changed json structure for saving config settings.
	- RichMedia: parsers and their order are configured in `rich_media` config.
	- RichMedia: add the rich media ttl based on image expiration time.

	## [1.0.7] - 2019-09-26
	### Fixed
	- Broken federation on Erlang 22 (previous versions of hackney http client were using an option that got deprecated)
	### Changed
	- ActivityPub: The first page in inboxes/outboxes is no longer embedded.

	## [1.0.6] - 2019-08-14
	### Fixed
	- MRF: fix use of unserializable keyword lists in describe() implementations
	- ActivityPub S2S: POST requests are now signed with `(request-target)` pseudo-header.

	## [1.0.5] - 2019-08-13
	### Fixed
	- Mastodon API: follower/following counters not being nullified, when `hide_follows`/`hide_followers` is set
	- Mastodon API: `muted` in the Status entity, using author's account to determine if the thread was muted
	- Mastodon API: return the actual profile URL in the Account entity's `url` property when appropriate
	- Templates: properly style anchor tags
	- Objects being re-embedded to activities after being updated (e.g faved/reposted). Running 'mix pleroma.database prune_objects' again is advised.
	- Not being able to access the Mastodon FE login page on private instances
	- MRF: ensure that subdomain_match calls are case-insensitive
	- Fix internal server error when using the healthcheck API.

	### Added
	- Breaking: MRF describe API, which adds support for exposing configuration information about MRF policies to NodeInfo.
	Custom modules will need to be updated by adding, at the very least, `def describe, do: {:ok, %{}}` to the MRF policy modules.
	- Relays: Added a task to list relay subscriptions.
	- MRF: Support for filtering posts based on ActivityStreams vocabulary (`Pleroma.Web.ActivityPub.MRF.VocabularyPolicy`)
	- MRF (Simple Policy): Support for wildcard domains.
	- Support for wildcard domains in user domain blocks setting.
	- Configuration: `quarantined_instances` support wildcard domains.
	- Mix Tasks: `mix pleroma.database fix_likes_collections`
	- Configuration: `federation_incoming_replies_max_depth` option

	### Removed
	- Federation: Remove `likes` from objects.
	- Breaking: ActivityPub: The `accept_blocks` configuration setting.

	## [1.0.4] - 2019-08-01
	### Fixed
	- Invalid SemVer version generation, when the current branch does not have commits ahead of tag/checked out on a tag

	## [1.0.3] - 2019-07-31
	### Security
	- OStatus: eliminate the possibility of a protocol downgrade attack.
	- OStatus: prevent following locked accounts, bypassing the approval process.
	- TwitterAPI: use CommonAPI to handle remote follows instead of OStatus.

	## [1.0.2] - 2019-07-28
	### Fixed
	- Not being able to pin unlisted posts
	- Mastodon API: represent poll IDs as strings
	- MediaProxy: fix matching filenames
	- MediaProxy: fix filename encoding
	- Migrations: fix a sporadic migration failure
	- Metadata rendering errors resulting in the entire page being inaccessible
	- Federation/MediaProxy not working with instances that have wrong certificate order
	- ActivityPub S2S: remote user deletions now work the same as local user deletions.

	### Changed
	- Configuration: OpenGraph and TwitterCard providers enabled by default
	- Configuration: Filter.AnonymizeFilename added ability to retain file extension with custom text

	## [1.0.1] - 2019-07-14
	### Security
	- OStatus: fix an object spoofing vulnerability.

	## [1.0.0] - 2019-06-29
	### Security
	- Mastodon API: Fix display names not being sanitized
	- Rich media: Do not crawl private IP ranges

	### Added
	- Digest email for inactive users
	- Add a generic settings store for frontends / clients to use.
	- Explicit addressing option for posting.
	- Optional SSH access mode. (Needs `erlang-ssh` package on some distributions).
	- [MongooseIM](https://github.com/esl/MongooseIM) http authentication support.
	- LDAP authentication
	- External OAuth provider authentication
	- Support for building a release using [`mix release`](https://hexdocs.pm/mix/master/Mix.Tasks.Release.html)
	- A [job queue](https://git.pleroma.social/pleroma/pleroma_job_queue) for federation, emails, web push, etc.
	- [Prometheus](https://prometheus.io/) metrics
	- Support for Mastodon's remote interaction
	- Mix Tasks: `mix pleroma.database bump_all_conversations`
	- Mix Tasks: `mix pleroma.database remove_embedded_objects`
	- Mix Tasks: `mix pleroma.database update_users_following_followers_counts`
	- Mix Tasks: `mix pleroma.user toggle_confirmed`
	- Mix Tasks: `mix pleroma.config migrate_to_db`
	- Mix Tasks: `mix pleroma.config migrate_from_db`
	- Federation: Support for `Question` and `Answer` objects
	- Federation: Support for reports
	- Configuration: `poll_limits` option
	- Configuration: `pack_extensions` option
	- Configuration: `safe_dm_mentions` option
	- Configuration: `link_name` option
	- Configuration: `fetch_initial_posts` option
	- Configuration: `notify_email` option
	- Configuration: Media proxy `whitelist` option
	- Configuration: `report_uri` option
	- Configuration: `email_notifications` option
	- Configuration: `limit_to_local_content` option
	- Pleroma API: User subscriptions
	- Pleroma API: Healthcheck endpoint
	- Pleroma API: `/api/v1/pleroma/mascot` per-user frontend mascot configuration endpoints
	- Admin API: Endpoints for listing/revoking invite tokens
	- Admin API: Endpoints for making users follow/unfollow each other
	- Admin API: added filters (role, tags, email, name) for users endpoint
	- Admin API: Endpoints for managing reports
	- Admin API: Endpoints for deleting and changing the scope of individual reported statuses
	- Admin API: Endpoints to view and change config settings.
	- AdminFE: initial release with basic user management accessible at /pleroma/admin/
	- Mastodon API: Add chat token to `verify_credentials` response
	- Mastodon API: Add background image setting to `update_credentials`
	- Mastodon API: [Scheduled statuses](https://docs.joinmastodon.org/api/rest/scheduled-statuses/)
	- Mastodon API: `/api/v1/notifications/destroy_multiple` (glitch-soc extension)
	- Mastodon API: `/api/v1/pleroma/accounts/:id/favourites` (API extension)
	- Mastodon API: [Reports](https://docs.joinmastodon.org/api/rest/reports/)
	- Mastodon API: `POST /api/v1/accounts` (account creation API)
	- Mastodon API: [Polls](https://docs.joinmastodon.org/api/rest/polls/)
	- ActivityPub C2S: OAuth endpoints
	- Metadata: RelMe provider
	- OAuth: added support for refresh tokens
	- Emoji packs and emoji pack manager
	- Object pruning (`mix pleroma.database prune_objects`)
	- OAuth: added job to clean expired access tokens
	- MRF: Support for rejecting reports from specific instances (`mrf_simple`)
	- MRF: Support for stripping avatars and banner images from specific instances (`mrf_simple`)
	- MRF: Support for running subchains.
	- Configuration: `skip_thread_containment` option
	- Configuration: `rate_limit` option. See `Pleroma.Plugs.RateLimiter` documentation for details.
	- MRF: Support for filtering out likely spam messages by rejecting posts from new users that contain links.
	- Configuration: `ignore_hosts` option
	- Configuration: `ignore_tld` option
	- Configuration: default syslog tag "Pleroma" is now lowercased to "pleroma"

	### Changed
	- Breaking: bind to 127.0.0.1 instead of 0.0.0.0 by default
	- Breaking: Configuration: move from Pleroma.Mailer to Pleroma.Emails.Mailer
	- Thread containment / test for complete visibility will be skipped by default.
	- Enforcement of OAuth scopes
	- Add multiple use/time expiring invite token
	- Restyled OAuth pages to fit with Pleroma's default theme
	- Link/mention/hashtag detection is now handled by [auto_linker](https://git.pleroma.social/pleroma/auto_linker)
	- NodeInfo: Return `safe_dm_mentions` feature flag
	- Federation: Expand the audience of delete activities to all recipients of the deleted object
	- Federation: Removed `inReplyToStatusId` from objects
	- Configuration: Dedupe enabled by default
	- Configuration: Default log level in `prod` environment is now set to `warn`
	- Configuration: Added `extra_cookie_attrs` for setting non-standard cookie attributes. Defaults to ["SameSite=Lax"] so that remote follows work.
	- Timelines: Messages involving people you have blocked will be excluded from the timeline in all cases instead of just repeats.
	- Admin API: Move the user related API to `api/pleroma/admin/users`
	- Admin API: `POST /api/pleroma/admin/users` will take list of users
	- Pleroma API: Support for emoji tags in `/api/pleroma/emoji` resulting in a breaking API change
	- Mastodon API: Support for `exclude_types`, `limit` and `min_id` in `/api/v1/notifications`
	- Mastodon API: Add `languages` and `registrations` to `/api/v1/instance`
	- Mastodon API: Provide plaintext versions of cw/content in the Status entity
	- Mastodon API: Add `pleroma.conversation_id`, `pleroma.in_reply_to_account_acct` fields to the Status entity
	- Mastodon API: Add `pleroma.tags`, `pleroma.relationship{}`, `pleroma.is_moderator`, `pleroma.is_admin`, `pleroma.confirmation_pending`, `pleroma.hide_followers`, `pleroma.hide_follows`, `pleroma.hide_favorites` fields to the User entity
	- Mastodon API: Add `pleroma.show_role`, `pleroma.no_rich_text` fields to the Source subentity
	- Mastodon API: Add support for updating `no_rich_text`, `hide_followers`, `hide_follows`, `hide_favorites`, `show_role` in `PATCH /api/v1/update_credentials`
	- Mastodon API: Add `pleroma.is_seen` to the Notification entity
	- Mastodon API: Add `pleroma.local` to the Status entity
	- Mastodon API: Add `preview` parameter to `POST /api/v1/statuses`
	- Mastodon API: Add `with_muted` parameter to timeline endpoints
	- Mastodon API: Actual reblog hiding instead of a dummy
	- Mastodon API: Remove attachment limit in the Status entity
	- Mastodon API: Added support max_id & since_id for bookmark timeline endpoints.
	- Deps: Updated Cowboy to 2.6
	- Deps: Updated Ecto to 3.0.7
	- Don't ship finmoji by default, they can be installed as an emoji pack
	- Hide deactivated users and their statuses
	- Posts which are marked sensitive or tagged nsfw no longer have link previews.
	- HTTP connection timeout is now set to 10 seconds.
	- Respond with a 404 Not implemented JSON error message when requested API is not implemented
	- Rich Media: crawl only https URLs.

	### Fixed
	- Follow requests don't get 'stuck' anymore.
	- Added an FTS index on objects. Running `vacuum analyze` and setting a larger `work_mem` is recommended.
	- Followers counter not being updated when a follower is blocked
	- Deactivated users being able to request an access token
	- Limit on request body in rich media/relme parsers being ignored resulting in a possible memory leak
	- Proper Twitter Card generation instead of a dummy
	- Deletions failing for users with a large number of posts
	- NodeInfo: Include admins in `staffAccounts`
	- ActivityPub: Crashing when requesting empty local user's outbox
	- Federation: Handling of objects without `summary` property
	- Federation: Add a language tag to activities as required by ActivityStreams 2.0
	- Federation: Do not federate avatar/banner if set to default allowing other servers/clients to use their defaults
	- Federation: Cope with missing or explicitly nulled address lists
	- Federation: Explicitly ensure activities addressed to `as:Public` become addressed to the followers collection
	- Federation: Better cope with actors which do not declare a followers collection and use `as:Public` with these semantics
	- Federation: Follow requests from remote users who have been blocked will be automatically rejected if appropriate
	- MediaProxy: Parse name from content disposition headers even for non-whitelisted types
	- MediaProxy: S3 link encoding
	- Rich Media: Reject any data which cannot be explicitly encoded into JSON
	- Pleroma API: Importing follows from Mastodon 2.8+
	- Twitter API: Exposing default scope, `no_rich_text` of the user to anyone
	- Twitter API: Returning the `role` object in user entity despite `show_role = false`
	- Mastodon API: `/api/v1/favourites` serving only public activities
	- Mastodon API: Reblogs having `in_reply_to_id` - `null` even when they are replies
	- Mastodon API: Streaming API broadcasting wrong activity id
	- Mastodon API: 500 errors when requesting a card for a private conversation
	- Mastodon API: Handling of `reblogs` in `/api/v1/accounts/:id/follow`
	- Mastodon API: Correct `reblogged`, `favourited`, and `bookmarked` values in the reblog status JSON
	- Mastodon API: Exposing default scope of the user to anyone
	- Mastodon API: Make `irreversible` field default to `false` [`POST /api/v1/filters`]
	- Mastodon API: Replace missing non-nullable Card attributes with empty strings
	- User-Agent is now sent correctly for all HTTP requests.
	- MRF: Simple policy now properly delists imported or relayed statuses

	## Removed
	- Configuration: `config :pleroma, :fe` in favor of the more flexible `config :pleroma, :frontend_configurations`

	## [0.9.99999] - 2019-05-31
	### Security
	- Mastodon API: Fix lists leaking private posts

	## [0.9.9999] - 2019-04-05
	### Security
	- Mastodon API: Fix content warnings skipping HTML sanitization

	## [0.9.999] - 2019-03-13
	Frontend changes only.
	### Added
	- Added floating action button for posting status on mobile
	### Changed
	- Changed user-settings icon to a pencil
	### Fixed
	- Keyboard shortcuts activating when typing a message
	- Gaps when scrolling down on a timeline after showing new

	## [0.9.99] - 2019-03-08
	### Changed
	- Update the frontend to the 0.9.99 tag
	### Fixed
	- Sign the date header in federation to fix Mastodon federation.

	## [0.9.9] - 2019-02-22
	This is our first stable release.
	diff --git a/docs/configuration/howto_search_cjk.md b/docs/configuration/howto_search_cjk.md
	index d3ce28077..a73b10db3 100644
	--- a/docs/configuration/howto_search_cjk.md
	+++ b/docs/configuration/howto_search_cjk.md
	@@ -1,42 +1,42 @@
	# How to enable text search for Chinese, Japanese and Korean

	Pleroma's full text search feature is powered by PostgreSQL's native [text search](https://www.postgresql.org/docs/current/textsearch.html), it works well out of box for most of languages, but needs extra configurations for some asian languages like Chinese, Japanese and Korean (CJK).


	## Setup and test the new search config

	-In most cases, you would need an extension installed to support parsing CJK text. Here are a few extension you may choose from, or you are more than welcome to share additional ones you found working for you with the rest of Pleroma community.
	+In most cases, you would need an extension installed to support parsing CJK text. Here are a few extensions you may choose from, or you are more than welcome to share additional ones you found working for you with the rest of Pleroma community.

	* [a generic n-gram parser](https://github.com/huangjimmy/pg_cjk_parser) supports Simplifed/Traditional Chinese, Japanese, and Korean
	* [a Korean parser](https://github.com/i0seph/textsearch_ko) based on mecab
	* [a Japanese parser](https://www.amris.co.jp/tsja/index.html) based on mecab
	* [zhparser](https://github.com/amutu/zhparser/) is a PostgreSQL extension base on the Simple Chinese Word Segmentation(SCWS)
	* [another Chinese parser](https://github.com/jaiminpan/pg_jieba) based on Jieba Chinese Word Segmentation

	Once you have the new search config , make sure you test it with the `pleroma` user in PostgreSQL (change `YOUR.CONFIG` to your real configuration name)
	```
	SELECT ts_debug('YOUR.CONFIG', '安装和配置Nginx, ElixirとErlangをインストールします');
	```
	Check output of the query, and see if it matches your expectation.


	## Update text search config and index in database

	=== "OTP"

	```sh
	./bin/pleroma_ctl database set_text_search_config YOUR.CONFIG
	```

	=== "From Source"

	```sh
	mix pleroma.database set_text_search_config YOUR.CONFIG
	```

	-Note: index update may take a while.
	+Note: index update may take a while, and it can be done while the instance is up and running, so you may restart db connection as soon as you see `Recreate index` in task output.

	## Restart database connection
	Since some changes above will only apply with a new database connection, you will have to restart either Pleroma or PostgreSQL process, or use `pg_terminate_backend` SQL command without restarting either.

	Now the search results of statuses should be much more friendly for your language of choice, the results for searching users and tags were not changed, as the default parsing/matching should work for most cases.
	diff --git a/docs/installation/alpine_linux_en.md b/docs/installation/alpine_linux_en.md
	index 13395ff25..c37ff0c63 100644
	--- a/docs/installation/alpine_linux_en.md
	+++ b/docs/installation/alpine_linux_en.md
	@@ -1,225 +1,228 @@
	# Installing on Alpine Linux
	+
	+{! backend/installation/otp_vs_from_source_source.include !}
	+
	## Installation

	This guide is a step-by-step installation guide for Alpine Linux. The instructions were verified against Alpine v3.10 standard image. You might miss additional dependencies if you use `netboot` instead.

	It assumes that you have administrative rights, either as root or a user with [sudo permissions](https://www.linode.com/docs/tools-reference/custom-kernels-distros/install-alpine-linux-on-your-linode/#configuration). If you want to run this guide with root, ignore the `sudo` at the beginning of the lines, unless it calls a user like `sudo -Hu pleroma`; in this case, use `su -l <username> -s $SHELL -c 'command'` instead.

	{! backend/installation/generic_dependencies.include !}

	### Prepare the system

	* The community repository must be enabled in `/etc/apk/repositories`. Depending on which version and mirror you use this looks like `http://alpine.42.fr/v3.10/community`. If you autogenerated the mirror during installation:

	```shell
	awk 'NR==2' /etc/apk/repositories \| sed 's/main/community/' \| tee -a /etc/apk/repositories
	```

	* Then update the system, if not already done:

	```shell
	sudo apk update
	sudo apk upgrade
	```

	* Install some tools, which are needed later:

	```shell
	sudo apk add git build-base cmake file-dev
	```

	### Install Elixir and Erlang

	* Install Erlang and Elixir:

	```shell
	sudo apk add erlang erlang-runtime-tools erlang-xmerl elixir
	```

	* Install `erlang-eldap` if you want to enable ldap authenticator

	```shell
	sudo apk add erlang-eldap
	```

	### Install PostgreSQL

	* Install Postgresql server:

	```shell
	sudo apk add postgresql postgresql-contrib
	```

	* Initialize database:

	```shell
	sudo /etc/init.d/postgresql start
	```

	* Enable and start postgresql server:

	```shell
	sudo rc-update add postgresql
	```

	### Install media / graphics packages (optional, see [`docs/installation/optional/media_graphics_packages.md`](../installation/optional/media_graphics_packages.md))

	```shell
	sudo apk add ffmpeg imagemagick exiftool
	```

	### Install PleromaBE

	* Add a new system user for the Pleroma service:

	```shell
	sudo addgroup pleroma
	sudo adduser -S -s /bin/false -h /opt/pleroma -H -G pleroma pleroma
	```

	Note: To execute a single command as the Pleroma system user, use `sudo -Hu pleroma command`. You can also switch to a shell by using `sudo -Hu pleroma $SHELL`. If you don’t have and want `sudo` on your system, you can use `su` as root user (UID 0) for a single command by using `su -l pleroma -s $SHELL -c 'command'` and `su -l pleroma -s $SHELL` for starting a shell.

	* Git clone the PleromaBE repository and make the Pleroma user the owner of the directory:

	```shell
	sudo mkdir -p /opt/pleroma
	sudo chown -R pleroma:pleroma /opt/pleroma
	sudo -Hu pleroma git clone -b stable https://git.pleroma.social/pleroma/pleroma /opt/pleroma
	```

	* Change to the new directory:

	```shell
	cd /opt/pleroma
	```

	* Install the dependencies for Pleroma and answer with `yes` if it asks you to install `Hex`:

	```shell
	sudo -Hu pleroma mix deps.get
	```

	* Generate the configuration: `sudo -Hu pleroma MIX_ENV=prod mix pleroma.instance gen`
	* Answer with `yes` if it asks you to install `rebar3`.
	* This may take some time, because parts of pleroma get compiled first.
	* After that it will ask you a few questions about your instance and generates a configuration file in `config/generated_config.exs`.

	* Check the configuration and if all looks right, rename it, so Pleroma will load it (`prod.secret.exs` for productive instance, `dev.secret.exs` for development instances):

	```shell
	sudo -Hu pleroma mv config/{generated_config.exs,prod.secret.exs}
	```

	* The previous command creates also the file `config/setup_db.psql`, with which you can create the database:

	```shell
	sudo -Hu postgres psql -f config/setup_db.psql
	```

	* Now run the database migration:

	```shell
	sudo -Hu pleroma MIX_ENV=prod mix ecto.migrate
	```

	* Now you can start Pleroma already

	```shell
	sudo -Hu pleroma MIX_ENV=prod mix phx.server
	```

	### Finalize installation

	If you want to open your newly installed instance to the world, you should run nginx or some other webserver/proxy in front of Pleroma and you should consider to create an OpenRC service file for Pleroma.

	#### Nginx

	* Install nginx, if not already done:

	```shell
	sudo apk add nginx
	```

	* Setup your SSL cert, using your method of choice or certbot. If using certbot, first install it:

	```shell
	sudo apk add certbot
	```

	and then set it up:

	```shell
	sudo mkdir -p /var/lib/letsencrypt/
	sudo certbot certonly --email <your@emailaddress> -d <yourdomain> --standalone
	```

	If that doesn’t work, make sure, that nginx is not already running. If it still doesn’t work, try setting up nginx first (change ssl “on” to “off” and try again).

	* Copy the example nginx configuration to the nginx folder

	```shell
	sudo cp /opt/pleroma/installation/pleroma.nginx /etc/nginx/conf.d/pleroma.conf
	```

	* Before starting nginx edit the configuration and change it to your needs. You must change change `server_name` and the paths to the certificates. You can use `nano` (install with `apk add nano` if missing).

	```
	server {
	server_name your.domain;
	listen 80;
	...
	}

	server {
	server_name your.domain;
	listen 443 ssl http2;
	...
	ssl_trusted_certificate /etc/letsencrypt/live/your.domain/chain.pem;
	ssl_certificate /etc/letsencrypt/live/your.domain/fullchain.pem;
	ssl_certificate_key /etc/letsencrypt/live/your.domain/privkey.pem;
	...
	}
	```

	* Enable and start nginx:

	```shell
	sudo rc-update add nginx
	sudo service nginx start
	```

	If you need to renew the certificate in the future, uncomment the relevant location block in the nginx config and run:

	```shell
	sudo certbot certonly --email <your@emailaddress> -d <yourdomain> --webroot -w /var/lib/letsencrypt/
	```

	#### OpenRC service

	* Copy example service file:

	```shell
	sudo cp /opt/pleroma/installation/init.d/pleroma /etc/init.d/pleroma
	```

	* Make sure to start it during the boot

	```shell
	sudo rc-update add pleroma
	```

	#### Create your first user

	If your instance is up and running, you can create your first user with administrative rights with the following task:

	```shell
	sudo -Hu pleroma MIX_ENV=prod mix pleroma.user new <username> <your@emailaddress> --admin
	```

	#### Further reading

	{! backend/installation/further_reading.include !}

	## Questions

	Questions about the installation or didn’t it work as it should be, ask in [#pleroma:libera.chat](https://matrix.to/#/#pleroma:libera.chat) via Matrix or #pleroma on libera.chat via IRC.
	diff --git a/docs/installation/arch_linux_en.md b/docs/installation/arch_linux_en.md
	index d11deb621..285743d56 100644
	--- a/docs/installation/arch_linux_en.md
	+++ b/docs/installation/arch_linux_en.md
	@@ -1,218 +1,221 @@
	# Installing on Arch Linux
	+
	+{! backend/installation/otp_vs_from_source_source.include !}
	+
	## Installation

	This guide will assume that you have administrative rights, either as root or a user with [sudo permissions](https://wiki.archlinux.org/index.php/Sudo). If you want to run this guide with root, ignore the `sudo` at the beginning of the lines, unless it calls a user like `sudo -Hu pleroma`; in this case, use `su <username> -s $SHELL -c 'command'` instead.

	### Required packages

	* `postgresql`
	* `elixir`
	* `git`
	* `base-devel`
	* `cmake`
	* `file`

	#### Optional packages used in this guide

	* `nginx` (preferred, example configs for other reverse proxies can be found in the repo)
	* `certbot` (or any other ACME client for Let’s Encrypt certificates)
	* `ImageMagick`
	* `ffmpeg`
	* `exiftool`

	### Prepare the system

	* First update the system, if not already done:

	```shell
	sudo pacman -Syu
	```

	* Install some of the above mentioned programs:

	```shell
	sudo pacman -S git base-devel elixir cmake file
	```

	### Install PostgreSQL

	[Arch Wiki article](https://wiki.archlinux.org/index.php/PostgreSQL)

	* Install the `postgresql` package:

	```shell
	sudo pacman -S postgresql
	```

	* Initialize the database cluster:

	```shell
	sudo -iu postgres initdb -D /var/lib/postgres/data
	```

	* Start and enable the `postgresql.service`

	```shell
	sudo systemctl enable --now postgresql.service
	```

	### Install media / graphics packages (optional, see [`docs/installation/optional/media_graphics_packages.md`](../installation/optional/media_graphics_packages.md))

	```shell
	sudo pacman -S ffmpeg imagemagick perl-image-exiftool
	```

	### Install PleromaBE

	* Add a new system user for the Pleroma service:

	```shell
	sudo useradd -r -s /bin/false -m -d /var/lib/pleroma -U pleroma
	```

	Note: To execute a single command as the Pleroma system user, use `sudo -Hu pleroma command`. You can also switch to a shell by using `sudo -Hu pleroma $SHELL`. If you don’t have and want `sudo` on your system, you can use `su` as root user (UID 0) for a single command by using `su -l pleroma -s $SHELL -c 'command'` and `su -l pleroma -s $SHELL` for starting a shell.

	* Git clone the PleromaBE repository and make the Pleroma user the owner of the directory:

	```shell
	sudo mkdir -p /opt/pleroma
	sudo chown -R pleroma:pleroma /opt/pleroma
	sudo -Hu pleroma git clone -b stable https://git.pleroma.social/pleroma/pleroma /opt/pleroma
	```

	* Change to the new directory:

	```shell
	cd /opt/pleroma
	```

	* Install the dependencies for Pleroma and answer with `yes` if it asks you to install `Hex`:

	```shell
	sudo -Hu pleroma mix deps.get
	```

	* Generate the configuration: `sudo -Hu pleroma MIX_ENV=prod mix pleroma.instance gen`
	* Answer with `yes` if it asks you to install `rebar3`.
	* This may take some time, because parts of pleroma get compiled first.
	* After that it will ask you a few questions about your instance and generates a configuration file in `config/generated_config.exs`.

	* Check the configuration and if all looks right, rename it, so Pleroma will load it (`prod.secret.exs` for productive instance, `dev.secret.exs` for development instances):

	```shell
	sudo -Hu pleroma mv config/{generated_config.exs,prod.secret.exs}
	```

	* The previous command creates also the file `config/setup_db.psql`, with which you can create the database:

	```shell
	sudo -Hu postgres psql -f config/setup_db.psql
	```

	* Now run the database migration:

	```shell
	sudo -Hu pleroma MIX_ENV=prod mix ecto.migrate
	```

	* Now you can start Pleroma already

	```shell
	sudo -Hu pleroma MIX_ENV=prod mix phx.server
	```

	### Finalize installation

	If you want to open your newly installed instance to the world, you should run nginx or some other webserver/proxy in front of Pleroma and you should consider to create a systemd service file for Pleroma.

	#### Nginx

	* Install nginx, if not already done:

	```shell
	sudo pacman -S nginx
	```

	* Create directories for available and enabled sites:

	```shell
	sudo mkdir -p /etc/nginx/sites-{available,enabled}
	```

	* Append the following line at the end of the `http` block in `/etc/nginx/nginx.conf`:

	```Nginx
	include sites-enabled/*;
	```

	* Setup your SSL cert, using your method of choice or certbot. If using certbot, first install it:

	```shell
	sudo pacman -S certbot certbot-nginx
	```

	and then set it up:

	```shell
	sudo mkdir -p /var/lib/letsencrypt/
	sudo certbot certonly --email <your@emailaddress> -d <yourdomain> --standalone
	```

	If that doesn’t work, make sure, that nginx is not already running. If it still doesn’t work, try setting up nginx first (change ssl “on” to “off” and try again).

	---

	* Copy the example nginx configuration and activate it:

	```shell
	sudo cp /opt/pleroma/installation/pleroma.nginx /etc/nginx/sites-available/pleroma.nginx
	sudo ln -s /etc/nginx/sites-available/pleroma.nginx /etc/nginx/sites-enabled/pleroma.nginx
	```

	* Before starting nginx edit the configuration and change it to your needs (e.g. change servername, change cert paths)
	* Enable and start nginx:

	```shell
	sudo systemctl enable --now nginx.service
	```

	If you need to renew the certificate in the future, uncomment the relevant location block in the nginx config and run:

	```shell
	sudo certbot certonly --email <your@emailaddress> -d <yourdomain> --webroot -w /var/lib/letsencrypt/
	```

	#### Other webserver/proxies

	You can find example configurations for them in `/opt/pleroma/installation/`.

	#### Systemd service

	* Copy example service file

	```shell
	sudo cp /opt/pleroma/installation/pleroma.service /etc/systemd/system/pleroma.service
	```

	* Edit the service file and make sure that all paths fit your installation
	* Enable and start `pleroma.service`:

	```shell
	sudo systemctl enable --now pleroma.service
	```

	#### Create your first user

	If your instance is up and running, you can create your first user with administrative rights with the following task:

	```shell
	sudo -Hu pleroma MIX_ENV=prod mix pleroma.user new <username> <your@emailaddress> --admin
	```

	#### Further reading

	{! backend/installation/further_reading.include !}

	## Questions

	Questions about the installation or didn’t it work as it should be, ask in [#pleroma:libera.chat](https://matrix.to/#/#pleroma:libera.chat) via Matrix or #pleroma on libera.chat via IRC.
	diff --git a/docs/installation/debian_based_en.md b/docs/installation/debian_based_en.md
	index 02682e5b0..4e52b2155 100644
	--- a/docs/installation/debian_based_en.md
	+++ b/docs/installation/debian_based_en.md
	@@ -1,181 +1,184 @@
	# Installing on Debian Based Distributions
	+
	+{! backend/installation/otp_vs_from_source_source.include !}
	+
	## Installation

	This guide will assume you are on Debian 11 (“bullseye”) or later. This guide should also work with Ubuntu 18.04 (“Bionic Beaver”) and later. It also assumes that you have administrative rights, either as root or a user with [sudo permissions](https://www.digitalocean.com/community/tutorials/how-to-add-delete-and-grant-sudo-privileges-to-users-on-a-debian-vps). If you want to run this guide with root, ignore the `sudo` at the beginning of the lines, unless it calls a user like `sudo -Hu pleroma`; in this case, use `su <username> -s $SHELL -c 'command'` instead.

	{! backend/installation/generic_dependencies.include !}

	### Prepare the system

	* First update the system, if not already done:

	```shell
	sudo apt update
	sudo apt full-upgrade
	```

	* Install some of the above mentioned programs:

	```shell
	sudo apt install git build-essential postgresql postgresql-contrib cmake libmagic-dev
	```

	### Install Elixir and Erlang

	* Install Elixir and Erlang (you might need to use backports or [asdf](https://github.com/asdf-vm/asdf) on old systems):

	```shell
	sudo apt update
	sudo apt install elixir erlang-dev erlang-nox
	```


	### Optional packages: [`docs/installation/optional/media_graphics_packages.md`](../installation/optional/media_graphics_packages.md)

	```shell
	sudo apt install imagemagick ffmpeg libimage-exiftool-perl
	```

	### Install PleromaBE

	* Add a new system user for the Pleroma service:

	```shell
	sudo useradd -r -s /bin/false -m -d /var/lib/pleroma -U pleroma
	```

	Note: To execute a single command as the Pleroma system user, use `sudo -Hu pleroma command`. You can also switch to a shell by using `sudo -Hu pleroma $SHELL`. If you don’t have and want `sudo` on your system, you can use `su` as root user (UID 0) for a single command by using `su -l pleroma -s $SHELL -c 'command'` and `su -l pleroma -s $SHELL` for starting a shell.

	* Git clone the PleromaBE repository and make the Pleroma user the owner of the directory:

	```shell
	sudo mkdir -p /opt/pleroma
	sudo chown -R pleroma:pleroma /opt/pleroma
	sudo -Hu pleroma git clone -b stable https://git.pleroma.social/pleroma/pleroma /opt/pleroma
	```

	* Change to the new directory:

	```shell
	cd /opt/pleroma
	```

	* Install the dependencies for Pleroma and answer with `yes` if it asks you to install `Hex`:

	```shell
	sudo -Hu pleroma mix deps.get
	```

	* Generate the configuration: `sudo -Hu pleroma MIX_ENV=prod mix pleroma.instance gen`
	* Answer with `yes` if it asks you to install `rebar3`.
	* This may take some time, because parts of pleroma get compiled first.
	* After that it will ask you a few questions about your instance and generates a configuration file in `config/generated_config.exs`.

	* Check the configuration and if all looks right, rename it, so Pleroma will load it (`prod.secret.exs` for productive instance, `dev.secret.exs` for development instances):

	```shell
	sudo -Hu pleroma mv config/{generated_config.exs,prod.secret.exs}
	```


	* The previous command creates also the file `config/setup_db.psql`, with which you can create the database:

	```shell
	sudo -Hu postgres psql -f config/setup_db.psql
	```

	* Now run the database migration:

	```shell
	sudo -Hu pleroma MIX_ENV=prod mix ecto.migrate
	```

	* Now you can start Pleroma already

	```shell
	sudo -Hu pleroma MIX_ENV=prod mix phx.server
	```

	### Finalize installation

	If you want to open your newly installed instance to the world, you should run nginx or some other webserver/proxy in front of Pleroma and you should consider to create a systemd service file for Pleroma.

	#### Nginx

	* Install nginx, if not already done:

	```shell
	sudo apt install nginx
	```

	* Setup your SSL cert, using your method of choice or certbot. If using certbot, first install it:

	```shell
	sudo apt install certbot
	```

	and then set it up:

	```shell
	sudo mkdir -p /var/lib/letsencrypt/
	sudo certbot certonly --email <your@emailaddress> -d <yourdomain> --standalone
	```

	If that doesn’t work, make sure, that nginx is not already running. If it still doesn’t work, try setting up nginx first (change ssl “on” to “off” and try again).

	---

	* Copy the example nginx configuration and activate it:

	```shell
	sudo cp /opt/pleroma/installation/pleroma.nginx /etc/nginx/sites-available/pleroma.nginx
	sudo ln -s /etc/nginx/sites-available/pleroma.nginx /etc/nginx/sites-enabled/pleroma.nginx
	```

	* Before starting nginx edit the configuration and change it to your needs (e.g. change servername, change cert paths)
	* Enable and start nginx:

	```shell
	sudo systemctl enable --now nginx.service
	```

	If you need to renew the certificate in the future, uncomment the relevant location block in the nginx config and run:

	```shell
	sudo certbot certonly --email <your@emailaddress> -d <yourdomain> --webroot -w /var/lib/letsencrypt/
	```

	#### Other webserver/proxies

	You can find example configurations for them in `/opt/pleroma/installation/`.

	#### Systemd service

	* Copy example service file

	```shell
	sudo cp /opt/pleroma/installation/pleroma.service /etc/systemd/system/pleroma.service
	```

	* Edit the service file and make sure that all paths fit your installation
	* Enable and start `pleroma.service`:

	```shell
	sudo systemctl enable --now pleroma.service
	```

	#### Create your first user

	If your instance is up and running, you can create your first user with administrative rights with the following task:

	```shell
	sudo -Hu pleroma MIX_ENV=prod mix pleroma.user new <username> <your@emailaddress> --admin
	```

	#### Further reading

	{! backend/installation/further_reading.include !}

	## Questions

	Questions about the installation or didn’t it work as it should be, ask in [#pleroma:libera.chat](https://matrix.to/#/#pleroma:libera.chat) via Matrix or #pleroma on libera.chat via IRC.
	diff --git a/docs/installation/gentoo_en.md b/docs/installation/gentoo_en.md
	index 982ab52d2..36882c8c8 100644
	--- a/docs/installation/gentoo_en.md
	+++ b/docs/installation/gentoo_en.md
	@@ -1,299 +1,302 @@
	# Installing on Gentoo GNU/Linux
	+
	+{! backend/installation/otp_vs_from_source_source.include !}
	+
	## Installation

	This guide will assume that you have administrative rights, either as root or a user with [sudo permissions](https://wiki.gentoo.org/wiki/Sudo). Lines that begin with `#` indicate that they should be run as the superuser. Lines using `$` should be run as the indicated user, e.g. `pleroma$` should be run as the `pleroma` user.

	{! backend/installation/generic_dependencies.include !}

	### Your make.conf, package.use, and USE flags

	The only specific USE flag you should need is the `uuid` flag for `dev-db/postgresql`. Add the following line to any new file in `/etc/portage/package.use`. If you would like a suggested name for the file, either `postgresql` or `pleroma` would do fine, depending on how you like to arrange your package.use flags.

	```text
	dev-db/postgresql uuid
	```

	You could opt to add `USE="uuid"` to `/etc/portage/make.conf` if you'd rather set this as a global USE flags, but this flags does unrelated things in other packages, so keep that in mind if you elect to do so.

	Double check your compiler flags in `/etc/portage/make.conf`. If you require any special compilation flags or would like to set up remote builds, now is the time to do so. Be sure that your CFLAGS and MAKEOPTS make sense for the platform you are using. It is not recommended to use above `-O2` or risky optimization flags for a production server.

	### Installing a cron daemon

	Gentoo quite pointedly does not come with a cron daemon installed, and as such it is recommended you install one to automate certbot renewals and to allow other system administration tasks to be run automatically. Gentoo has [a whole wide world of cron options](https://wiki.gentoo.org/wiki/Cron) but if you just want A Cron That Works, `emerge --ask virtual/cron` will install the default cron implementation (probably cronie) which will work just fine. For the purpouses of this guide, we will be doing just that.

	### Required ebuilds

	* `dev-db/postgresql`
	* `dev-lang/elixir`
	* `dev-vcs/git`
	* `dev-util/cmake`
	* `sys-apps/file`

	#### Optional ebuilds used in this guide

	* `www-servers/nginx` (preferred, example configs for other reverse proxies can be found in the repo)
	* `app-crypt/certbot` (or any other ACME client for Let’s Encrypt certificates)
	* `app-crypt/certbot-nginx` (nginx certbot plugin that allows use of the all-powerful `--nginx` flag on certbot)
	* `media-gfx/imagemagick`
	* `media-video/ffmpeg`
	* `media-libs/exiftool`

	### Prepare the system

	* First ensure that you have the latest copy of the portage ebuilds if you have not synced them yet:

	```shell
	# emaint sync -a
	```

	* Emerge all required the required and suggested software in one go:

	```shell
	# emerge --ask dev-db/postgresql dev-lang/elixir dev-vcs/git www-servers/nginx app-crypt/certbot app-crypt/certbot-nginx dev-util/cmake sys-apps/file
	```

	If you would not like to install the optional packages, remove them from this line.

	If you're running this from a low-powered virtual machine, it should work though it will take some time. There were no issues on a VPS with a single core and 1GB of RAM; if you are using an even more limited device and run into issues, you can try creating a swapfile or use a more powerful machine running Gentoo to [cross build](https://wiki.gentoo.org/wiki/Cross_build_environment). If you have a wait ahead of you, now would be a good time to take a break, strech a bit, refresh your beverage of choice and/or get a snack, and reply to Arch users' posts with "I use Gentoo btw" as we do.

	### Install PostgreSQL

	[Gentoo Wiki article](https://wiki.gentoo.org/wiki/PostgreSQL) as well as [PostgreSQL QuickStart](https://wiki.gentoo.org/wiki/PostgreSQL/QuickStart) might be worth a quick glance, as the way Gentoo handles postgres is slightly unusual, with built in capability to have two different databases running for testing and live or whatever other purpouse. While it is still straightforward to install, it does mean that the version numbers used in this guide might change for future updates, so keep an eye out for the output you get from `emerge` to ensure you are using the correct ones.

	* Install postgresql if you have not done so already:

	```shell
	# emerge --ask dev-db/postgresql
	```

	Ensure that `/etc/conf.d/postgresql-11` has the encoding you want (it defaults to UTF8 which is probably what you want) and make any adjustments to the data directory if you find it necessary. Be sure to adjust the number at the end depending on what version of postgres you actually installed.

	* Initialize the database cluster

	The output from emerging postgresql should give you a command for initializing the postgres database. The default slot should be indicated in this command, ensure that it matches the command below.

	```shell
	# emerge --config dev-db/postgresql:11
	```

	* Start postgres and enable the system service

	```shell
	# /etc/init.d/postgresql-11 start
	# rc-update add postgresql-11 default
	```

	### A note on licenses, the AGPL, and deployment procedures

	If you do not plan to make any modifications to your Pleroma instance, cloning directly from the main repo will get you what you need. However, if you plan on doing any contributions to upstream development, making changes or modifications to your instance, making custom themes, or want to play around--and let's be honest here, if you're using Gentoo that is most likely you--you will save yourself a lot of headache later if you take the time right now to fork the Pleroma repo and use that in the following section.

	Not only does this make it much easier to deploy changes you make, as you can commit and pull from upstream and all that good stuff from the comfort of your local machine then simply `git pull` on your instance server when you're ready to deploy, it also ensures you are compliant with the Affero General Public Licence that Pleroma is licenced under, which stipulates that all network services provided with modified AGPL code must publish their changes on a publicly available internet service and for free. It also makes it much easier to ask for help from and provide help to your fellow Pleroma admins if your public repo always reflects what you are running because it is part of your deployment procedure.

	### Install media / graphics packages (optional, see [`docs/installation/optional/media_graphics_packages.md`](docs/installation/optional/media_graphics_packages.md))

	```shell
	# emerge --ask media-video/ffmpeg media-gfx/imagemagick media-libs/exiftool
	```

	### Install PleromaBE

	* Add a new system user for the Pleroma service and set up default directories:

	Remove `,wheel` if you do not want this user to be able to use `sudo`, however note that being able to `sudo` as the `pleroma` user will make finishing the insallation and common maintenence tasks somewhat easier:

	```shell
	# useradd -m -G users,wheel -s /bin/bash pleroma
	```

	Optional: If you are using sudo, review your sudo setup to ensure it works for you. The `/etc/sudoers` file has a lot of options and examples to help you, and [the Gentoo sudo guide](https://wiki.gentoo.org/wiki/Sudo) has more information. Finishing this installation will be somewhat easier if you have a way to sudo from the `pleroma` user, but it might be best to not allow that user to sudo during normal operation, and as such there will be a reminder at the end of this guide to double check if you would like to lock down the `pleroma` user after initial setup.

	Note: To execute a single command as the Pleroma system user, use `sudo -Hu pleroma command`. You can also switch to a shell by using `sudo -Hu pleroma $SHELL`. If you don't have or want `sudo` or would like to use the system as the `pleroma` user for instance maintenance tasks, you can simply use `su - pleroma` to switch to the `pleroma` user.

	* Git clone the PleromaBE repository and make the Pleroma user the owner of the directory:

	It is highly recommended you use your own fork for the `https://path/to/repo` part below, however if you foolishly decide to forego using your own fork, the primary repo `https://git.pleroma.social/pleroma/pleroma` will work here.

	```shell
	pleroma$ cd ~
	pleroma$ git clone -b stable https://path/to/repo
	```

	* Change to the new directory:

	```shell
	pleroma$ cd ~/pleroma
	```

	* Install the dependencies for Pleroma and answer with `yes` if it asks you to install `Hex`:

	```shell
	pleroma$ mix deps.get
	```

	* Generate the configuration:

	```shell
	pleroma$ MIX_ENV=prod mix pleroma.instance gen
	```

	* Answer with `yes` if it asks you to install `rebar3`.

	* This part precompiles some parts of Pleroma, so it might take a few moments

	* After that it will ask you a few questions about your instance and generates a configuration file in `config/generated_config.exs`.

	* Spend some time with `generated_config.exs` to ensure that everything is in order. If you plan on using an S3-compatible service to store your local media, that can be done here. You will likely mostly be using `prod.secret.exs` for a production instance, however if you would like to set up a development environment, make a copy to `dev.secret.exs` and adjust settings as needed as well.

	```shell
	pleroma$ mv config/generated_config.exs config/prod.secret.exs
	```

	* The previous command creates also the file `config/setup_db.psql`, with which you can create the database. Ensure that it is using the correct database name on the `CREATE DATABASE` and the `\c` lines, then run the postgres script:

	```shell
	pleroma$ sudo -Hu postgres psql -f config/setup_db.psql
	```

	* Now run the database migration:

	```shell
	pleroma$ MIX_ENV=prod mix ecto.migrate
	```

	* Now you can start Pleroma already

	```shell
	pleroma$ MIX_ENV=prod mix phx.server
	```

	It probably won't work over the public internet quite yet, however, as we still need to set up a web servere to proxy to the pleroma application, as well as configure SSL.

	### Finalize installation

	Assuming you want to open your newly installed federated social network to, well, the federation, you should run nginx or some other webserver/proxy in front of Pleroma. It is also a good idea to set up Pleroma to run as a system service.

	#### Nginx

	* Install nginx, if not already done:

	```shell
	# emerge --ask www-servers/nginx
	```

	* Create directories for available and enabled sites:

	```shell
	# mkdir -p /etc/nginx/sites-{available,enabled}
	```

	* Append the following line at the end of the `http` block in `/etc/nginx/nginx.conf`:

	```Nginx
	include sites-enabled/*;
	```

	* Setup your SSL cert, using your method of choice or certbot. If using certbot, install it if you haven't already:

	```shell
	# emerge --ask app-crypt/certbot app-crypt/certbot-nginx
	```

	and then set it up:

	```shell
	# mkdir -p /var/lib/letsencrypt/
	# certbot certonly --email <your@emailaddress> -d <yourdomain> --standalone
	```

	If that doesn't work the first time, add `--dry-run` to further attempts to avoid being ratelimited as you identify the issue, and do not remove it until the dry run succeeds. If that doesn’t work, make sure, that nginx is not already running. If it still doesn’t work, try setting up nginx first (change ssl “on” to “off” and try again). Often the answer to issues with certbot is to use the `--nginx` flag once you have nginx up and running.

	If you are using any additional subdomains, such as for a media proxy, you can re-run the same command with the subdomain in question. When it comes time to renew later, you will not need to run multiple times for each domain, one renew will handle it.

	---

	* Copy the example nginx configuration and activate it:

	```shell
	# cp /home/pleroma/pleroma/installation/pleroma.nginx /etc/nginx/sites-available/
	# ln -s /etc/nginx/sites-available/pleroma.nginx /etc/nginx/sites-enabled/pleroma.nginx
	```

	* Take some time to ensure that your nginx config is correct

	Replace all instances of `example.tld` with your instance's public URL. If for whatever reason you made changes to the port that your pleroma app runs on, be sure that is reflected in your configuration.

	Pay special attention to the line that begins with `ssl_ecdh_curve`. It is stongly advised to comment that line out so that OpenSSL will use its full capabilities, and it is also possible you are running OpenSSL 1.0.2 necessitating that you do this.

	* Enable and start nginx:

	```shell
	# rc-update add nginx default
	# /etc/init.d/nginx start
	```

	If you are using certbot, it is HIGHLY recommend you set up a cron job that renews your certificate, and that you install the suggested `certbot-nginx` plugin. If you don't do these things, you only have yourself to blame when your instance breaks suddenly because you forgot about it.

	First, ensure that the command you will be installing into your crontab works.

	```shell
	# /usr/bin/certbot renew --nginx
	```

	Assuming not much time has passed since you got certbot working a few steps ago, you should get a message for all domains you installed certificates for saying `Cert not yet due for renewal`.

	Now, run crontab as a superuser with `crontab -e` or `sudo crontab -e` as appropriate, and add the following line to your cron:

	```cron
	0 0 1 * * /usr/bin/certbot renew --nginx
	```

	This will run certbot on the first of the month at midnight. If you'd rather run more frequently, it's not a bad idea, feel free to go for it.

	#### Other webserver/proxies

	If you would like to use other webservers or proxies, there are example configurations for some popular alternatives in `/home/pleroma/pleroma/installation/`. You can, of course, check out [the Gentoo wiki](https://wiki.gentoo.org) for more information on installing and configuring said alternatives.

	#### Create the uploads folder

	Even if you are using S3, Pleroma needs someplace to store media posted on your instance. If you are using the `/home/pleroma/pleroma` root folder suggested by this guide, simply:

	```shell
	pleroma$ mkdir -p ~/pleroma/uploads
	```

	#### init.d service

	* Copy example service file

	```shell
	# cp /home/pleroma/pleroma/installation/init.d/pleroma /etc/init.d/
	```

	* Be sure to take a look at this service file and make sure that all paths fit your installation

	* Enable and start `pleroma`:

	```shell
	# rc-update add pleroma default
	# /etc/init.d/pleroma start
	```

	#### Create your first user

	If your instance is up and running, you can create your first user with administrative rights with the following task:

	```shell
	pleroma$ MIX_ENV=prod mix pleroma.user new <username> <your@emailaddress> --admin
	```

	#### Privilege cleanup

	If you opted to allow sudo for the `pleroma` user but would like to remove the ability for greater security, now might be a good time to edit `/etc/sudoers` and/or change the groups the `pleroma` user belongs to. Be sure to restart the pleroma service afterwards to ensure it picks up on the changes.

	#### Further reading

	{! backend/installation/further_reading.include !}

	## Questions

	Questions about the installation or didn’t it work as it should be, ask in [#pleroma:libera.chat](https://matrix.to/#/#pleroma:libera.chat) via Matrix or #pleroma on libera.chat via IRC.
	diff --git a/docs/installation/migrating_from_source_otp_en.md b/docs/installation/migrating_from_source_otp_en.md
	index d303a6daf..e4a01d8db 100644
	--- a/docs/installation/migrating_from_source_otp_en.md
	+++ b/docs/installation/migrating_from_source_otp_en.md
	@@ -1,142 +1,143 @@
	# Switching a from-source install to OTP releases

	-## What are OTP releases?
	-OTP releases are as close as you can get to binary releases with Erlang/Elixir. The release is self-contained, and provides everything needed to boot it, it is easily administered via the provided shell script to open up a remote console, start/stop/restart the release, start in the background, send remote commands, and more.
	+{! backend/installation/otp_vs_from_source.include !}
	+
	+In this guide we cover how you can migrate from a from source installation to one using OTP releases.

	## Pre-requisites
	You will be running commands as root. If you aren't root already, please elevate your priviledges by executing `sudo su`/`su`.

	The system needs to have `curl` and `unzip` installed for downloading and unpacking release builds.

	=== "Alpine"
	```sh
	apk add curl unzip
	```

	=== "Debian/Ubuntu"
	```sh
	apt install curl unzip
	```

	## Moving content out of the application directory
	When using OTP releases the application directory changes with every version so it would be a bother to keep content there (and also dangerous unless `--no-rm` option is used when updating). Fortunately almost all paths in Pleroma are configurable, so it is possible to move them out of there.

	Pleroma should be stopped before proceeding.

	### Moving uploads/custom public files directory

	```sh
	# Create uploads directory and set proper permissions (skip if using a remote uploader)
	# Note: It does not have to be `/var/lib/pleroma/uploads`, you can configure it to be something else later
	mkdir -p /var/lib/pleroma/uploads
	chown -R pleroma /var/lib/pleroma

	# Create custom public files directory
	# Note: It does not have to be `/var/lib/pleroma/static`, you can configure it to be something else later
	mkdir -p /var/lib/pleroma/static
	chown -R pleroma /var/lib/pleroma

	# If you use the local uploader with default settings your uploads should be located in `~pleroma/uploads`
	mv ~pleroma/uploads/* /var/lib/pleroma/uploads

	# If you have created the custom public files directory with default settings it should be located in `~pleroma/instance/static`
	mv ~pleroma/instance/static /var/lib/pleroma/static
	```

	### Moving emoji
	Assuming you have all emojis in subdirectories of `priv/static/emoji` moving them can be done with
	```sh
	mkdir /var/lib/pleroma/static/emoji
	ls -d ~pleroma/priv/static/emoji/*/ \| xargs -i sh -c 'mv "{}" "/var/lib/pleroma/static/emoji/$(basename {})"'
	```

	But, if for some reason you have custom emojis in the root directory you should copy the whole directory instead.
	```sh
	mv ~pleroma/priv/static/emoji /var/lib/pleroma/static/emoji
	```
	and then copy custom emojis to `/var/lib/pleroma/static/emoji/custom`.

	This is needed because storing custom emojis in the root directory is deprecated, but if you just move them to `/var/lib/pleroma/static/emoji/custom` it will break emoji urls on old posts.

	Note that globs have been replaced with `pack_extensions`, so if your emojis are not in png/gif you should [modify the default value](../configuration/cheatsheet.md#emoji).

	### Moving the config
	```sh
	# Create the config directory
	# The default path for Pleroma config is /etc/pleroma/config.exs
	# but it can be set via PLEROMA_CONFIG_PATH environment variable
	mkdir -p /etc/pleroma

	# Move the config file
	mv ~pleroma/config/prod.secret.exs /etc/pleroma/config.exs

	# Change `use Mix.Config` at the top to `import Config`
	$EDITOR /etc/pleroma/config.exs
	```
	## Installing the release
	Before proceeding, get the flavour from [Detecting flavour](otp_en.md#detecting-flavour) section in OTP installation guide.
	```sh
	# Delete all files in pleroma user's directory
	rm -r ~pleroma/*

	# Set the flavour environment variable to the string you got in Detecting flavour section.
	# For example if the flavour is `amd64-musl` the command will be
	export FLAVOUR="amd64-musl"

	# Clone the release build into a temporary directory and unpack it
	# Replace `stable` with `unstable` if you want to run the unstable branch
	su pleroma -s $SHELL -lc "
	curl 'https://git.pleroma.social/api/v4/projects/2/jobs/artifacts/stable/download?job=$FLAVOUR' -o /tmp/pleroma.zip
	unzip /tmp/pleroma.zip -d /tmp/
	"

	# Move the release to the home directory and delete temporary files
	su pleroma -s $SHELL -lc "
	mv /tmp/release/* ~pleroma/
	rmdir /tmp/release
	rm /tmp/pleroma.zip
	"

	# Start the instance to verify that everything is working as expected
	su pleroma -s $SHELL -lc "./bin/pleroma daemon"

	# Wait for about 20 seconds and query the instance endpoint, if it shows your uri, name and email correctly, you are configured correctly
	sleep 20 && curl http://localhost:4000/api/v1/instance

	# Stop the instance
	su pleroma -s $SHELL -lc "./bin/pleroma stop"
	```

	## Setting up a system service
	OTP releases have different service files than from-source installs so they need to be copied over again.

	Warning: The service files assume pleroma user's home directory is `/opt/pleroma`, please make sure all paths fit your installation.

	=== "Alpine"
	```sh
	# Copy the service into a proper directory
	cp -f ~pleroma/installation/init.d/pleroma /etc/init.d/pleroma

	# Start pleroma
	rc-service pleroma start
	```

	=== "Debian/Ubuntu"
	```sh
	# Copy the service into a proper directory
	cp ~pleroma/installation/pleroma.service /etc/systemd/system/pleroma.service

	# Reload service files
	systemctl daemon-reload

	# Reenable pleroma to start on boot
	systemctl reenable pleroma

	# Start pleroma
	systemctl start pleroma
	```

	## Running mix tasks
	Refer to [Running mix tasks](otp_en.md#running-mix-tasks) section from OTP release installation guide.
	## Updating
	Refer to [Updating](otp_en.md#updating) section from OTP release installation guide.
	diff --git a/docs/installation/otp_en.md b/docs/installation/otp_en.md
	index 3f67534ac..0861a8157 100644
	--- a/docs/installation/otp_en.md
	+++ b/docs/installation/otp_en.md
	@@ -1,303 +1,307 @@
	# Installing on Linux using OTP releases

	+{! backend/installation/otp_vs_from_source.include !}
	+
	+This guide covers a installation using an OTP release. To install Pleroma from source, please check out the corresponding guide for your distro.
	+
	## Pre-requisites
	* A machine running Linux with GNU (e.g. Debian, Ubuntu) or musl (e.g. Alpine) libc and `x86_64`, `aarch64` or `armv7l` CPU, you have root access to. If you are not sure if it's compatible see [Detecting flavour section](#detecting-flavour) below
	* A (sub)domain pointed to the machine

	You will be running commands as root. If you aren't root already, please elevate your priviledges by executing `sudo su`/`su`.

	While in theory OTP releases are possbile to install on any compatible machine, for the sake of simplicity this guide focuses only on Debian/Ubuntu and Alpine.

	### Detecting flavour

	Paste the following into the shell:
	```sh
	arch="$(uname -m)";if [ "$arch" = "x86_64" ];then arch="amd64";elif [ "$arch" = "armv7l" ];then arch="arm";elif [ "$arch" = "aarch64" ];then arch="arm64";else echo "Unsupported arch: $arch">&2;fi;if getconf GNU_LIBC_VERSION>/dev/null;then libc_postfix="";elif [ "$(ldd 2>&1\|head -c 9)" = "musl libc" ];then libc_postfix="-musl";elif [ "$(find /lib/libc.musl*\|wc -l)" ];then libc_postfix="-musl";else echo "Unsupported libc">&2;fi;echo "$arch$libc_postfix"
	```

	If your platform is supported the output will contain the flavour string, you will need it later. If not, this just means that we don't build releases for your platform, you can still try installing from source.

	### Installing the required packages

	Other than things bundled in the OTP release Pleroma depends on:

	* curl (to download the release build)
	* unzip (needed to unpack release builds)
	* ncurses (ERTS won't run without it)
	* PostgreSQL (also utilizes extensions in postgresql-contrib)
	* nginx (could be swapped with another reverse proxy but this guide covers only it)
	* certbot (for Let's Encrypt certificates, could be swapped with another ACME client, but this guide covers only it)
	* libmagic/file

	=== "Alpine"
	```
	awk 'NR==2' /etc/apk/repositories \| sed 's/main/community/' \| tee -a /etc/apk/repositories
	apk update
	apk add curl unzip ncurses postgresql postgresql-contrib nginx certbot file-dev
	```

	=== "Debian/Ubuntu"
	```
	apt install curl unzip libncurses5 postgresql postgresql-contrib nginx certbot libmagic-dev
	```

	### Installing optional packages

	Per [`docs/installation/optional/media_graphics_packages.md`](optional/media_graphics_packages.md):
	* ImageMagick
	* ffmpeg
	* exiftool

	=== "Alpine"
	```
	apk update
	apk add imagemagick ffmpeg exiftool
	```

	=== "Debian/Ubuntu"
	```
	apt install imagemagick ffmpeg libimage-exiftool-perl
	```

	## Setup
	### Configuring PostgreSQL
	#### (Optional) Installing RUM indexes

	!!! warning
	It is recommended to use PostgreSQL v11 or newer. We have seen some minor issues with lower PostgreSQL versions.

	RUM indexes are an alternative indexing scheme that is not included in PostgreSQL by default. You can read more about them on the [Configuration page](../configuration/cheatsheet.md#rum-indexing-for-full-text-search). They are completely optional and most of the time are not worth it, especially if you are running a single user instance (unless you absolutely need ordered search results).

	=== "Alpine"
	```
	apk add git build-base postgresql-dev
	git clone https://github.com/postgrespro/rum /tmp/rum
	cd /tmp/rum
	make USE_PGXS=1
	make USE_PGXS=1 install
	cd
	rm -r /tmp/rum
	```

	=== "Debian/Ubuntu"
	```
	# Available only on Buster/19.04
	apt install postgresql-11-rum
	```

	#### (Optional) Performance configuration
	It is encouraged to check [Optimizing your PostgreSQL performance](../configuration/postgresql.md) document, for tips on PostgreSQL tuning.

	Restart PostgreSQL to apply configuration changes:

	=== "Alpine"
	```
	rc-service postgresql restart
	```

	=== "Debian/Ubuntu"
	```
	systemctl restart postgresql
	```

	### Installing Pleroma
	```sh
	# Create a Pleroma user
	adduser --system --shell /bin/false --home /opt/pleroma pleroma

	# Set the flavour environment variable to the string you got in Detecting flavour section.
	# For example if the flavour is `amd64-musl` the command will be
	export FLAVOUR="amd64-musl"

	# Clone the release build into a temporary directory and unpack it
	su pleroma -s $SHELL -lc "
	curl 'https://git.pleroma.social/api/v4/projects/2/jobs/artifacts/stable/download?job=$FLAVOUR' -o /tmp/pleroma.zip
	unzip /tmp/pleroma.zip -d /tmp/
	"

	# Move the release to the home directory and delete temporary files
	su pleroma -s $SHELL -lc "
	mv /tmp/release/* /opt/pleroma
	rmdir /tmp/release
	rm /tmp/pleroma.zip
	"
	# Create uploads directory and set proper permissions (skip if planning to use a remote uploader)
	# Note: It does not have to be `/var/lib/pleroma/uploads`, the config generator will ask about the upload directory later

	mkdir -p /var/lib/pleroma/uploads
	chown -R pleroma /var/lib/pleroma

	# Create custom public files directory (custom emojis, frontend bundle overrides, robots.txt, etc.)
	# Note: It does not have to be `/var/lib/pleroma/static`, the config generator will ask about the custom public files directory later
	mkdir -p /var/lib/pleroma/static
	chown -R pleroma /var/lib/pleroma

	# Create a config directory
	mkdir -p /etc/pleroma
	chown -R pleroma /etc/pleroma

	# Run the config generator
	su pleroma -s $SHELL -lc "./bin/pleroma_ctl instance gen --output /etc/pleroma/config.exs --output-psql /tmp/setup_db.psql"

	# Create the postgres database
	su postgres -s $SHELL -lc "psql -f /tmp/setup_db.psql"

	# Create the database schema
	su pleroma -s $SHELL -lc "./bin/pleroma_ctl migrate"

	# If you have installed RUM indexes uncommend and run
	# su pleroma -s $SHELL -lc "./bin/pleroma_ctl migrate --migrations-path priv/repo/optional_migrations/rum_indexing/"

	# Start the instance to verify that everything is working as expected
	su pleroma -s $SHELL -lc "./bin/pleroma daemon"

	# Wait for about 20 seconds and query the instance endpoint, if it shows your uri, name and email correctly, you are configured correctly
	sleep 20 && curl http://localhost:4000/api/v1/instance

	# Stop the instance
	su pleroma -s $SHELL -lc "./bin/pleroma stop"
	```

	### Setting up nginx and getting Let's Encrypt SSL certificaties

	#### Get a Let's Encrypt certificate
	```sh
	certbot certonly --standalone --preferred-challenges http -d yourinstance.tld
	```

	#### Copy Pleroma nginx configuration to the nginx folder

	The location of nginx configs is dependent on the distro

	=== "Alpine"
	```
	cp /opt/pleroma/installation/pleroma.nginx /etc/nginx/conf.d/pleroma.conf
	```

	=== "Debian/Ubuntu"
	```
	cp /opt/pleroma/installation/pleroma.nginx /etc/nginx/sites-available/pleroma.conf
	ln -s /etc/nginx/sites-available/pleroma.conf /etc/nginx/sites-enabled/pleroma.conf
	```

	If your distro does not have either of those you can append `include /etc/nginx/pleroma.conf` to the end of the http section in /etc/nginx/nginx.conf and
	```sh
	cp /opt/pleroma/installation/pleroma.nginx /etc/nginx/pleroma.conf
	```

	#### Edit the nginx config
	```sh
	# Replace example.tld with your (sub)domain
	$EDITOR path-to-nginx-config

	# Verify that the config is valid
	nginx -t
	```
	#### Start nginx

	=== "Alpine"
	```
	rc-service nginx start
	```

	=== "Debian/Ubuntu"
	```
	systemctl start nginx
	```

	At this point if you open your (sub)domain in a browser you should see a 502 error, that's because Pleroma is not started yet.

	### Setting up a system service

	=== "Alpine"
	```
	# Copy the service into a proper directory
	cp /opt/pleroma/installation/init.d/pleroma /etc/init.d/pleroma

	# Start pleroma and enable it on boot
	rc-service pleroma start
	rc-update add pleroma
	```

	=== "Debian/Ubuntu"
	```
	# Copy the service into a proper directory
	cp /opt/pleroma/installation/pleroma.service /etc/systemd/system/pleroma.service

	# Start pleroma and enable it on boot
	systemctl start pleroma
	systemctl enable pleroma
	```

	If everything worked, you should see Pleroma-FE when visiting your domain. If that didn't happen, try reviewing the installation steps, starting Pleroma in the foreground and seeing if there are any errrors.

	Questions about the installation or didn’t it work as it should be, ask in [#pleroma:libera.chat](https://matrix.to/#/#pleroma:libera.chat) via Matrix or #pleroma on libera.chat via IRC, you can also [file an issue on our Gitlab](https://git.pleroma.social/pleroma/pleroma-support/issues/new).

	## Post installation

	### Setting up auto-renew of the Let's Encrypt certificate
	```sh
	# Create the directory for webroot challenges
	mkdir -p /var/lib/letsencrypt

	# Uncomment the webroot method
	$EDITOR path-to-nginx-config

	# Verify that the config is valid
	nginx -t
	```

	=== "Alpine"
	```
	# Restart nginx
	rc-service nginx restart

	# Start the cron daemon and make it start on boot
	rc-service crond start
	rc-update add crond

	# Ensure the webroot menthod and post hook is working
	certbot renew --cert-name yourinstance.tld --webroot -w /var/lib/letsencrypt/ --dry-run --post-hook 'rc-service nginx reload'

	# Add it to the daily cron
	echo '#!/bin/sh
	certbot renew --cert-name yourinstance.tld --webroot -w /var/lib/letsencrypt/ --post-hook "rc-service nginx reload"
	' > /etc/periodic/daily/renew-pleroma-cert
	chmod +x /etc/periodic/daily/renew-pleroma-cert

	# If everything worked the output should contain /etc/cron.daily/renew-pleroma-cert
	run-parts --test /etc/periodic/daily
	```

	=== "Debian/Ubuntu"
	```
	# Restart nginx
	systemctl restart nginx

	# Ensure the webroot menthod and post hook is working
	certbot renew --cert-name yourinstance.tld --webroot -w /var/lib/letsencrypt/ --dry-run --post-hook 'systemctl reload nginx'

	# Add it to the daily cron
	echo '#!/bin/sh
	certbot renew --cert-name yourinstance.tld --webroot -w /var/lib/letsencrypt/ --post-hook "systemctl reload nginx"
	' > /etc/cron.daily/renew-pleroma-cert
	chmod +x /etc/cron.daily/renew-pleroma-cert

	# If everything worked the output should contain /etc/cron.daily/renew-pleroma-cert
	run-parts --test /etc/cron.daily
	```

	## Create your first user and set as admin
	```sh
	cd /opt/pleroma
	su pleroma -s $SHELL -lc "./bin/pleroma_ctl user new joeuser joeuser@sld.tld --admin"
	```
	This will create an account withe the username of 'joeuser' with the email address of joeuser@sld.tld, and set that user's account as an admin. This will result in a link that you can paste into the browser, which logs you in and enables you to set the password.

	## Further reading

	{! backend/installation/further_reading.include !}

	## Questions

	Questions about the installation or didn’t it work as it should be, ask in [#pleroma:libera.chat](https://matrix.to/#/#pleroma:libera.chat) via Matrix or #pleroma on libera.chat via IRC, you can also [file an issue on our Gitlab](https://git.pleroma.social/pleroma/pleroma-support/issues/new).
	diff --git a/docs/installation/otp_vs_from_source.include b/docs/installation/otp_vs_from_source.include
	new file mode 100644
	index 000000000..63e837a53
	--- /dev/null
	+++ b/docs/installation/otp_vs_from_source.include
	@@ -0,0 +1,3 @@
	+## OTP releases vs from-source installations
	+
	+There are two ways to install Pleroma. You can use OTP releases or do a from-source installation. OTP releases are as close as you can get to binary releases with Erlang/Elixir. The release is self-contained, and provides everything needed to boot it, it is easily administered via the provided shell script to open up a remote console, start/stop/restart the release, start in the background, send remote commands, and more. With from source installations you install Pleroma from source, meaning you have to install certain dependencies like Erlang+Elixir and compile Pleroma yourself.
	diff --git a/docs/installation/otp_vs_from_source_source.include b/docs/installation/otp_vs_from_source_source.include
	new file mode 100644
	index 000000000..63482b69d
	--- /dev/null
	+++ b/docs/installation/otp_vs_from_source_source.include
	@@ -0,0 +1,3 @@
	+{! backend/installation/otp_vs_from_source.include !}
	+
	+This guide covers a from-source installation. To install using OTP releases, please check out [the OTP guide](./otp_en.md).
	diff --git a/lib/mix/tasks/pleroma/database.ex b/lib/mix/tasks/pleroma/database.ex
	index 57f73d12b..a973beaa9 100644
	--- a/lib/mix/tasks/pleroma/database.ex
	+++ b/lib/mix/tasks/pleroma/database.ex
	@@ -1,257 +1,261 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2021 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Mix.Tasks.Pleroma.Database do
	alias Pleroma.Conversation
	alias Pleroma.Maintenance
	alias Pleroma.Object
	alias Pleroma.Repo
	alias Pleroma.User

	require Logger
	require Pleroma.Constants

	import Ecto.Query
	import Mix.Pleroma

	use Mix.Task

	@shortdoc "A collection of database related tasks"
	@moduledoc File.read!("docs/administration/CLI_tasks/database.md")

	def run(["remove_embedded_objects" \| args]) do
	{options, [], []} =
	OptionParser.parse(
	args,
	strict: [
	vacuum: :boolean
	]
	)

	start_pleroma()
	Logger.info("Removing embedded objects")

	Repo.query!(
	"update activities set data = safe_jsonb_set(data, '{object}'::text[], data->'object'->'id') where data->'object'->>'id' is not null;",
	[],
	timeout: :infinity
	)

	if Keyword.get(options, :vacuum) do
	Maintenance.vacuum("full")
	end
	end

	def run(["bump_all_conversations"]) do
	start_pleroma()
	Conversation.bump_for_all_activities()
	end

	def run(["update_users_following_followers_counts"]) do
	start_pleroma()

	Repo.transaction(
	fn ->
	from(u in User, select: u)
	\|> Repo.stream()
	\|> Stream.each(&User.update_follower_count/1)
	\|> Stream.run()
	end,
	timeout: :infinity
	)
	end

	def run(["prune_objects" \| args]) do
	{options, [], []} =
	OptionParser.parse(
	args,
	strict: [
	vacuum: :boolean
	]
	)

	start_pleroma()

	deadline = Pleroma.Config.get([:instance, :remote_post_retention_days])

	Logger.info("Pruning objects older than #{deadline} days")

	time_deadline =
	NaiveDateTime.utc_now()
	\|> NaiveDateTime.add(-(deadline * 86_400))

	from(o in Object,
	where:
	fragment(
	"?->'to' \\? ? OR ?->'cc' \\? ?",
	o.data,
	^Pleroma.Constants.as_public(),
	o.data,
	^Pleroma.Constants.as_public()
	),
	where: o.inserted_at < ^time_deadline,
	where:
	fragment("split_part(?->>'actor', '/', 3) != ?", o.data, ^Pleroma.Web.Endpoint.host())
	)
	\|> Repo.delete_all(timeout: :infinity)

	prune_hashtags_query = """
	DELETE FROM hashtags AS ht
	WHERE NOT EXISTS (
	SELECT 1 FROM hashtags_objects hto
	WHERE ht.id = hto.hashtag_id)
	"""

	Repo.query(prune_hashtags_query)

	if Keyword.get(options, :vacuum) do
	Maintenance.vacuum("full")
	end
	end

	def run(["fix_likes_collections"]) do
	start_pleroma()

	from(object in Object,
	where: fragment("(?)->>'likes' is not null", object.data),
	select: %{id: object.id, likes: fragment("(?)->>'likes'", object.data)}
	)
	\|> Pleroma.Repo.chunk_stream(100, :batches)
	\|> Stream.each(fn objects ->
	ids =
	objects
	\|> Enum.filter(fn object -> object.likes \|> Jason.decode!() \|> is_map() end)
	\|> Enum.map(& &1.id)

	Object
	\|> where([object], object.id in ^ids)
	\|> update([object],
	set: [
	data:
	fragment(
	"safe_jsonb_set(?, '{likes}', '[]'::jsonb, true)",
	object.data
	)
	]
	)
	\|> Repo.update_all([], timeout: :infinity)
	end)
	\|> Stream.run()
	end

	def run(["vacuum", args]) do
	start_pleroma()

	Maintenance.vacuum(args)
	end

	def run(["ensure_expiration"]) do
	start_pleroma()
	days = Pleroma.Config.get([:mrf_activity_expiration, :days], 365)

	Pleroma.Activity
	\|> join(:inner, [a], o in Object,
	on:
	fragment(
	"(?->>'id') = COALESCE((?)->'object'->> 'id', (?)->>'object')",
	o.data,
	a.data,
	a.data
	)
	)
	\|> where(local: true)
	\|> where([a], fragment("(? ->> 'type'::text) = 'Create'", a.data))
	\|> where([_a, o], fragment("?->>'type' = 'Note'", o.data))
	\|> Pleroma.Repo.chunk_stream(100, :batches)
	\|> Stream.each(fn activities ->
	Enum.each(activities, fn activity ->
	expires_at =
	activity.inserted_at
	\|> DateTime.from_naive!("Etc/UTC")
	\|> Timex.shift(days: days)

	Pleroma.Workers.PurgeExpiredActivity.enqueue(%{
	activity_id: activity.id,
	expires_at: expires_at
	})
	end)
	end)
	\|> Stream.run()
	end

	def run(["set_text_search_config", tsconfig]) do
	start_pleroma()
	%{rows: [[tsc]]} = Ecto.Adapters.SQL.query!(Pleroma.Repo, "SHOW default_text_search_config;")
	shell_info("Current default_text_search_config: #{tsc}")

	%{rows: [[db]]} = Ecto.Adapters.SQL.query!(Pleroma.Repo, "SELECT current_database();")
	shell_info("Update default_text_search_config: #{tsconfig}")

	%{messages: msg} =
	Ecto.Adapters.SQL.query!(
	Pleroma.Repo,
	"ALTER DATABASE #{db} SET default_text_search_config = '#{tsconfig}';"
	)

	# non-exist config will not raise excpetion but only give >0 messages
	if length(msg) > 0 do
	shell_info("Error: #{inspect(msg, pretty: true)}")
	else
	rum_enabled = Pleroma.Config.get([:database, :rum_enabled])
	shell_info("Recreate index, RUM: #{rum_enabled}")

	# Note SQL below needs to be kept up-to-date with latest GIN or RUM index definition in future
	if rum_enabled do
	Ecto.Adapters.SQL.query!(
	Pleroma.Repo,
	"CREATE OR REPLACE FUNCTION objects_fts_update() RETURNS trigger AS $$ BEGIN
	new.fts_content := to_tsvector(new.data->>'content');
	RETURN new;
	END
	- $$ LANGUAGE plpgsql"
	+ $$ LANGUAGE plpgsql",
	+ [],
	+ timeout: :infinity
	)

	shell_info("Refresh RUM index")
	Ecto.Adapters.SQL.query!(Pleroma.Repo, "UPDATE objects SET updated_at = NOW();")
	else
	Ecto.Adapters.SQL.query!(Pleroma.Repo, "DROP INDEX IF EXISTS objects_fts;")

	Ecto.Adapters.SQL.query!(
	Pleroma.Repo,
	- "CREATE INDEX objects_fts ON objects USING gin(to_tsvector('#{tsconfig}', data->>'content')); "
	+ "CREATE INDEX CONCURRENTLY objects_fts ON objects USING gin(to_tsvector('#{tsconfig}', data->>'content')); ",
	+ [],
	+ timeout: :infinity
	)
	end

	shell_info('Done.')
	end
	end

	# Rolls back a specific migration (leaving subsequent migrations applied).
	# WARNING: imposes a risk of unrecoverable data loss — proceed at your own responsibility.
	# Based on https://stackoverflow.com/a/53825840
	def run(["rollback", version]) do
	prompt = "SEVERE WARNING: this operation may result in unrecoverable data loss. Continue?"

	if shell_prompt(prompt, "n") in ~w(Yn Y y) do
	{_, result, _} =
	Ecto.Migrator.with_repo(Pleroma.Repo, fn repo ->
	version = String.to_integer(version)
	re = ~r/^#{version}_.*\.exs/
	path = Ecto.Migrator.migrations_path(repo)

	with {_, "" <> file} <- {:find, Enum.find(File.ls!(path), &String.match?(&1, re))},
	{_, [{mod, _} \| _]} <- {:compile, Code.compile_file(Path.join(path, file))},
	{_, :ok} <- {:rollback, Ecto.Migrator.down(repo, version, mod)} do
	{:ok, "Reversed migration: #{file}"}
	else
	{:find, _} -> {:error, "No migration found with version prefix: #{version}"}
	{:compile, e} -> {:error, "Problem compiling migration module: #{inspect(e)}"}
	{:rollback, e} -> {:error, "Problem reversing migration: #{inspect(e)}"}
	end
	end)

	shell_info(inspect(result))
	end
	end
	end
	diff --git a/lib/pleroma/activity/search.ex b/lib/pleroma/activity/search.ex
	index ed898ba4f..09671f621 100644
	--- a/lib/pleroma/activity/search.ex
	+++ b/lib/pleroma/activity/search.ex
	@@ -1,132 +1,150 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2021 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Activity.Search do
	alias Pleroma.Activity
	alias Pleroma.Object.Fetcher
	alias Pleroma.Pagination
	alias Pleroma.User
	alias Pleroma.Web.ActivityPub.Visibility

	require Pleroma.Constants

	import Ecto.Query

	def search(user, search_query, options \\ []) do
	index_type = if Pleroma.Config.get([:database, :rum_enabled]), do: :rum, else: :gin
	limit = Enum.min([Keyword.get(options, :limit), 40])
	offset = Keyword.get(options, :offset, 0)
	author = Keyword.get(options, :author)

	search_function =
	if :persistent_term.get({Pleroma.Repo, :postgres_version}) >= 11 do
	:websearch
	else
	:plain
	end

	- Activity
	- \|> Activity.with_preloaded_object()
	- \|> Activity.restrict_deactivated_users()
	- \|> restrict_public()
	- \|> query_with(index_type, search_query, search_function)
	- \|> maybe_restrict_local(user)
	- \|> maybe_restrict_author(author)
	- \|> maybe_restrict_blocked(user)
	- \|> Pagination.fetch_paginated(
	- %{"offset" => offset, "limit" => limit, "skip_order" => index_type == :rum},
	- :offset
	- )
	- \|> maybe_fetch(user, search_query)
	+ try do
	+ Activity
	+ \|> Activity.with_preloaded_object()
	+ \|> Activity.restrict_deactivated_users()
	+ \|> restrict_public()
	+ \|> query_with(index_type, search_query, search_function)
	+ \|> maybe_restrict_local(user)
	+ \|> maybe_restrict_author(author)
	+ \|> maybe_restrict_blocked(user)
	+ \|> Pagination.fetch_paginated(
	+ %{"offset" => offset, "limit" => limit, "skip_order" => index_type == :rum},
	+ :offset
	+ )
	+ \|> maybe_fetch(user, search_query)
	+ rescue
	+ _ -> maybe_fetch([], user, search_query)
	+ end
	end

	def maybe_restrict_author(query, %User{} = author) do
	Activity.Queries.by_author(query, author)
	end

	def maybe_restrict_author(query, _), do: query

	def maybe_restrict_blocked(query, %User{} = user) do
	Activity.Queries.exclude_authors(query, User.blocked_users_ap_ids(user))
	end

	def maybe_restrict_blocked(query, _), do: query

	defp restrict_public(q) do
	from([a, o] in q,
	where: fragment("?->>'type' = 'Create'", a.data),
	where: ^Pleroma.Constants.as_public() in a.recipients
	)
	end

	defp query_with(q, :gin, search_query, :plain) do
	+ %{rows: [[tsc]]} =
	+ Ecto.Adapters.SQL.query!(
	+ Pleroma.Repo,
	+ "select current_setting('default_text_search_config')::regconfig::oid;"
	+ )
	+
	from([a, o] in q,
	where:
	fragment(
	- "to_tsvector(?->>'content') @@ plainto_tsquery(?)",
	+ "to_tsvector(?::oid::regconfig, ?->>'content') @@ plainto_tsquery(?)",
	+ ^tsc,
	o.data,
	^search_query
	)
	)
	end

	defp query_with(q, :gin, search_query, :websearch) do
	+ %{rows: [[tsc]]} =
	+ Ecto.Adapters.SQL.query!(
	+ Pleroma.Repo,
	+ "select current_setting('default_text_search_config')::regconfig::oid;"
	+ )
	+
	from([a, o] in q,
	where:
	fragment(
	- "to_tsvector(?->>'content') @@ websearch_to_tsquery(?)",
	+ "to_tsvector(?::oid::regconfig, ?->>'content') @@ websearch_to_tsquery(?)",
	+ ^tsc,
	o.data,
	^search_query
	)
	)
	end

	defp query_with(q, :rum, search_query, :plain) do
	from([a, o] in q,
	where:
	fragment(
	"? @@ plainto_tsquery(?)",
	o.fts_content,
	^search_query
	),
	order_by: [fragment("? <=> now()::date", o.inserted_at)]
	)
	end

	defp query_with(q, :rum, search_query, :websearch) do
	from([a, o] in q,
	where:
	fragment(
	"? @@ websearch_to_tsquery(?)",
	o.fts_content,
	^search_query
	),
	order_by: [fragment("? <=> now()::date", o.inserted_at)]
	)
	end

	defp maybe_restrict_local(q, user) do
	limit = Pleroma.Config.get([:instance, :limit_to_local_content], :unauthenticated)

	case {limit, user} do
	{:all, _} -> restrict_local(q)
	{:unauthenticated, %User{}} -> q
	{:unauthenticated, _} -> restrict_local(q)
	{false, _} -> q
	end
	end

	defp restrict_local(q), do: where(q, local: true)

	defp maybe_fetch(activities, user, search_query) do
	with true <- Regex.match?(~r/https?:/, search_query),
	{:ok, object} <- Fetcher.fetch_object_from_id(search_query),
	%Activity{} = activity <- Activity.get_create_by_object_ap_id(object.data["id"]),
	true <- Visibility.visible_for_user?(activity, user) do
	[activity \| activities]
	else
	_ -> activities
	end
	end
	end
	diff --git a/lib/pleroma/web/activity_pub/mrf.ex b/lib/pleroma/web/activity_pub/mrf.ex
	index ac00fa54b..41592e71e 100644
	--- a/lib/pleroma/web/activity_pub/mrf.ex
	+++ b/lib/pleroma/web/activity_pub/mrf.ex
	@@ -1,169 +1,169 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2021 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Web.ActivityPub.MRF do
	require Logger

	@behaviour Pleroma.Web.ActivityPub.MRF.PipelineFiltering

	@mrf_config_descriptions [
	%{
	group: :pleroma,
	key: :mrf,
	tab: :mrf,
	label: "MRF",
	type: :group,
	description: "General MRF settings",
	children: [
	%{
	key: :policies,
	type: [:module, {:list, :module}],
	description:
	"A list of MRF policies enabled. Module names are shortened (removed leading `Pleroma.Web.ActivityPub.MRF.` part), but on adding custom module you need to use full name.",
	- suggestions: {:list_behaviour_implementations, Pleroma.Web.ActivityPub.MRF}
	+ suggestions: {:list_behaviour_implementations, Pleroma.Web.ActivityPub.MRF.Policy}
	},
	%{
	key: :transparency,
	label: "MRF transparency",
	type: :boolean,
	description:
	"Make the content of your Message Rewrite Facility settings public (via nodeinfo)"
	},
	%{
	key: :transparency_exclusions,
	label: "MRF transparency exclusions",
	type: {:list, :string},
	description:
	"Exclude specific instance names from MRF transparency. The use of the exclusions feature will be disclosed in nodeinfo as a boolean value.",
	suggestions: [
	"exclusion.com"
	]
	}
	]
	}
	]

	@default_description %{
	label: "",
	description: ""
	}

	@required_description_keys [:key, :related_policy]

	def filter(policies, %{} = message) do
	policies
	\|> Enum.reduce({:ok, message}, fn
	policy, {:ok, message} -> policy.filter(message)
	_, error -> error
	end)
	end

	def filter(%{} = object), do: get_policies() \|> filter(object)

	@impl true
	def pipeline_filter(%{} = message, meta) do
	object = meta[:object_data]
	ap_id = message["object"]

	if object && ap_id do
	with {:ok, message} <- filter(Map.put(message, "object", object)) do
	meta = Keyword.put(meta, :object_data, message["object"])
	{:ok, Map.put(message, "object", ap_id), meta}
	else
	{err, message} -> {err, message, meta}
	end
	else
	{err, message} = filter(message)

	{err, message, meta}
	end
	end

	def get_policies do
	Pleroma.Config.get([:mrf, :policies], [])
	\|> get_policies()
	\|> Enum.concat([Pleroma.Web.ActivityPub.MRF.HashtagPolicy])
	end

	defp get_policies(policy) when is_atom(policy), do: [policy]
	defp get_policies(policies) when is_list(policies), do: policies
	defp get_policies(_), do: []

	@spec subdomains_regex([String.t()]) :: [Regex.t()]
	def subdomains_regex(domains) when is_list(domains) do
	for domain <- domains, do: ~r(^#{String.replace(domain, ".", "(.\\.)*")}$)i
	end

	@spec subdomain_match?([Regex.t()], String.t()) :: boolean()
	def subdomain_match?(domains, host) do
	Enum.any?(domains, fn domain -> Regex.match?(domain, host) end)
	end

	def describe(policies) do
	{:ok, policy_configs} =
	policies
	\|> Enum.reduce({:ok, %{}}, fn
	policy, {:ok, data} ->
	{:ok, policy_data} = policy.describe()
	{:ok, Map.merge(data, policy_data)}

	_, error ->
	error
	end)

	mrf_policies =
	get_policies()
	\|> Enum.map(fn policy -> to_string(policy) \|> String.split(".") \|> List.last() end)

	exclusions = Pleroma.Config.get([:mrf, :transparency_exclusions])

	base =
	%{
	mrf_policies: mrf_policies,
	exclusions: length(exclusions) > 0
	}
	\|> Map.merge(policy_configs)

	{:ok, base}
	end

	def describe, do: get_policies() \|> describe()

	def config_descriptions do
	Pleroma.Web.ActivityPub.MRF.Policy
	\|> Pleroma.Docs.Generator.list_behaviour_implementations()
	\|> config_descriptions()
	end

	def config_descriptions(policies) do
	Enum.reduce(policies, @mrf_config_descriptions, fn policy, acc ->
	if function_exported?(policy, :config_description, 0) do
	description =
	@default_description
	\|> Map.merge(policy.config_description)
	\|> Map.put(:group, :pleroma)
	\|> Map.put(:tab, :mrf)
	\|> Map.put(:type, :group)

	if Enum.all?(@required_description_keys, &Map.has_key?(description, &1)) do
	[description \| acc]
	else
	Logger.warn(
	"#{policy} config description doesn't have one or all required keys #{
	inspect(@required_description_keys)
	}"
	)

	acc
	end
	else
	Logger.debug(
	"#{policy} is excluded from config descriptions, because does not implement `config_description/0` method."
	)

	acc
	end
	end)
	end
	end
	diff --git a/lib/pleroma/web/activity_pub/mrf/object_age_policy.ex b/lib/pleroma/web/activity_pub/mrf/object_age_policy.ex
	index 9a211fd44..02c9b18ed 100644
	--- a/lib/pleroma/web/activity_pub/mrf/object_age_policy.ex
	+++ b/lib/pleroma/web/activity_pub/mrf/object_age_policy.ex
	@@ -1,137 +1,141 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2021 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Web.ActivityPub.MRF.ObjectAgePolicy do
	alias Pleroma.Config
	alias Pleroma.User

	require Pleroma.Constants

	@moduledoc "Filter activities depending on their age"
	@behaviour Pleroma.Web.ActivityPub.MRF.Policy

	defp check_date(%{"object" => %{"published" => published}} = message) do
	with %DateTime{} = now <- DateTime.utc_now(),
	{:ok, %DateTime{} = then, _} <- DateTime.from_iso8601(published),
	max_ttl <- Config.get([:mrf_object_age, :threshold]),
	{:ttl, false} <- {:ttl, DateTime.diff(now, then) > max_ttl} do
	{:ok, message}
	else
	{:ttl, true} ->
	{:reject, nil}

	e ->
	{:error, e}
	end
	end

	defp check_reject(message, actions) do
	if :reject in actions do
	{:reject, "[ObjectAgePolicy]"}
	else
	{:ok, message}
	end
	end

	defp check_delist(message, actions) do
	if :delist in actions do
	with %User{} = user <- User.get_cached_by_ap_id(message["actor"]) do
	to =
	List.delete(message["to"] \|\| [], Pleroma.Constants.as_public()) ++
	[user.follower_address]

	cc =
	List.delete(message["cc"] \|\| [], user.follower_address) ++
	[Pleroma.Constants.as_public()]

	message =
	message
	\|> Map.put("to", to)
	\|> Map.put("cc", cc)
	+ \|> Kernel.put_in(["object", "to"], to)
	+ \|> Kernel.put_in(["object", "cc"], cc)

	{:ok, message}
	else
	_e ->
	{:reject, "[ObjectAgePolicy] Unhandled error"}
	end
	else
	{:ok, message}
	end
	end

	defp check_strip_followers(message, actions) do
	if :strip_followers in actions do
	with %User{} = user <- User.get_cached_by_ap_id(message["actor"]) do
	to = List.delete(message["to"] \|\| [], user.follower_address)
	cc = List.delete(message["cc"] \|\| [], user.follower_address)

	message =
	message
	\|> Map.put("to", to)
	\|> Map.put("cc", cc)
	+ \|> Kernel.put_in(["object", "to"], to)
	+ \|> Kernel.put_in(["object", "cc"], cc)

	{:ok, message}
	else
	_e ->
	{:reject, "[ObjectAgePolicy] Unhandled error"}
	end
	else
	{:ok, message}
	end
	end

	@impl true
	- def filter(%{"type" => "Create", "published" => _} = message) do
	+ def filter(%{"type" => "Create", "object" => %{"published" => _}} = message) do
	with actions <- Config.get([:mrf_object_age, :actions]),
	{:reject, _} <- check_date(message),
	{:ok, message} <- check_reject(message, actions),
	{:ok, message} <- check_delist(message, actions),
	{:ok, message} <- check_strip_followers(message, actions) do
	{:ok, message}
	else
	# check_date() is allowed to short-circuit the pipeline
	e -> e
	end
	end

	@impl true
	def filter(message), do: {:ok, message}

	@impl true
	def describe do
	mrf_object_age =
	Config.get(:mrf_object_age)
	\|> Enum.into(%{})

	{:ok, %{mrf_object_age: mrf_object_age}}
	end

	@impl true
	def config_description do
	%{
	key: :mrf_object_age,
	related_policy: "Pleroma.Web.ActivityPub.MRF.ObjectAgePolicy",
	label: "MRF Object Age",
	description:
	"Rejects or delists posts based on their timestamp deviance from your server's clock.",
	children: [
	%{
	key: :threshold,
	type: :integer,
	description: "Required age (in seconds) of a post before actions are taken.",
	suggestions: [172_800]
	},
	%{
	key: :actions,
	type: {:list, :atom},
	description:
	"A list of actions to apply to the post. `:delist` removes the post from public timelines; " <>
	"`:strip_followers` removes followers from the ActivityPub recipient list ensuring they won't be delivered to home timelines; " <>
	"`:reject` rejects the message entirely",
	suggestions: [:delist, :strip_followers, :reject]
	}
	]
	}
	end
	end
	diff --git a/lib/pleroma/web/activity_pub/mrf/steal_emoji_policy.ex b/lib/pleroma/web/activity_pub/mrf/steal_emoji_policy.ex
	index c28f14a41..fbe9795ac 100644
	--- a/lib/pleroma/web/activity_pub/mrf/steal_emoji_policy.ex
	+++ b/lib/pleroma/web/activity_pub/mrf/steal_emoji_policy.ex
	@@ -1,99 +1,144 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2021 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Web.ActivityPub.MRF.StealEmojiPolicy do
	require Logger

	alias Pleroma.Config

	@moduledoc "Detect new emojis by their shortcode and steals them"
	@behaviour Pleroma.Web.ActivityPub.MRF.Policy

	defp accept_host?(host), do: host in Config.get([:mrf_steal_emoji, :hosts], [])

	defp steal_emoji({shortcode, url}, emoji_dir_path) do
	url = Pleroma.Web.MediaProxy.url(url)

	with {:ok, %{status: status} = response} when status in 200..299 <- Pleroma.HTTP.get(url) do
	size_limit = Config.get([:mrf_steal_emoji, :size_limit], 50_000)

	if byte_size(response.body) <= size_limit do
	extension =
	url
	\|> URI.parse()
	\|> Map.get(:path)
	\|> Path.basename()
	\|> Path.extname()

	file_path = Path.join(emoji_dir_path, shortcode <> (extension \|\| ".png"))

	case File.write(file_path, response.body) do
	:ok ->
	shortcode

	e ->
	Logger.warn("MRF.StealEmojiPolicy: Failed to write to #{file_path}: #{inspect(e)}")
	nil
	end
	else
	Logger.debug(
	"MRF.StealEmojiPolicy: :#{shortcode}: at #{url} (#{byte_size(response.body)} B) over size limit (#{
	size_limit
	} B)"
	)

	nil
	end
	else
	e ->
	Logger.warn("MRF.StealEmojiPolicy: Failed to fetch #{url}: #{inspect(e)}")
	nil
	end
	end

	@impl true
	def filter(%{"object" => %{"emoji" => foreign_emojis, "actor" => actor}} = message) do
	host = URI.parse(actor).host

	if host != Pleroma.Web.Endpoint.host() and accept_host?(host) do
	installed_emoji = Pleroma.Emoji.get_all() \|> Enum.map(fn {k, _} -> k end)

	emoji_dir_path =
	Config.get(
	[:mrf_steal_emoji, :path],
	Path.join(Config.get([:instance, :static_dir]), "emoji/stolen")
	)

	File.mkdir_p(emoji_dir_path)

	new_emojis =
	foreign_emojis
	\|> Enum.reject(fn {shortcode, _url} -> shortcode in installed_emoji end)
	\|> Enum.filter(fn {shortcode, _url} ->
	reject_emoji? =
	[:mrf_steal_emoji, :rejected_shortcodes]
	\|> Config.get([])
	\|> Enum.find(false, fn regex -> String.match?(shortcode, regex) end)

	!reject_emoji?
	end)
	\|> Enum.map(&steal_emoji(&1, emoji_dir_path))
	\|> Enum.filter(& &1)

	if !Enum.empty?(new_emojis) do
	Logger.info("Stole new emojis: #{inspect(new_emojis)}")
	Pleroma.Emoji.reload()
	end
	end

	{:ok, message}
	end

	def filter(message), do: {:ok, message}

	+ @impl true
	+ @spec config_description :: %{
	+ children: [
	+ %{
	+ description: <<_::272, _::_*256>>,
	+ key: :hosts \| :rejected_shortcodes \| :size_limit,
	+ suggestions: [any(), ...],
	+ type: {:list, :string} \| {:list, :string} \| :integer
	+ },
	+ ...
	+ ],
	+ description: <<_::448>>,
	+ key: :mrf_steal_emoji,
	+ label: <<_::80>>,
	+ related_policy: <<_::352>>
	+ }
	+ def config_description do
	+ %{
	+ key: :mrf_steal_emoji,
	+ related_policy: "Pleroma.Web.ActivityPub.MRF.StealEmojiPolicy",
	+ label: "MRF Emojis",
	+ description: "Steals emojis from selected instances when it sees them.",
	+ children: [
	+ %{
	+ key: :hosts,
	+ type: {:list, :string},
	+ description: "List of hosts to steal emojis from",
	+ suggestions: [""]
	+ },
	+ %{
	+ key: :rejected_shortcodes,
	+ type: {:list, :string},
	+ description: "Regex-list of shortcodes to reject",
	+ suggestions: [""]
	+ },
	+ %{
	+ key: :size_limit,
	+ type: :integer,
	+ description: "File size limit (in bytes), checked before an emoji is saved to the disk",
	+ suggestions: ["100000"]
	+ }
	+ ]
	+ }
	+ end
	+
	@impl true
	def describe do
	{:ok, %{}}
	end
	end
	diff --git a/lib/pleroma/web/activity_pub/side_effects.ex b/lib/pleroma/web/activity_pub/side_effects.ex
	index b0ec84ade..b82a89896 100644
	--- a/lib/pleroma/web/activity_pub/side_effects.ex
	+++ b/lib/pleroma/web/activity_pub/side_effects.ex
	@@ -1,538 +1,537 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2021 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Web.ActivityPub.SideEffects do
	@moduledoc """
	This module looks at an inserted object and executes the side effects that it
	implies. For example, a `Like` activity will increase the like count on the
	liked object, a `Follow` activity will add the user to the follower
	collection, and so on.
	"""
	alias Pleroma.Activity
	- alias Pleroma.Activity.Ir.Topics
	alias Pleroma.Chat
	alias Pleroma.Chat.MessageReference
	alias Pleroma.FollowingRelationship
	alias Pleroma.Notification
	alias Pleroma.Object
	alias Pleroma.Repo
	alias Pleroma.User
	alias Pleroma.Web.ActivityPub.ActivityPub
	alias Pleroma.Web.ActivityPub.Builder
	alias Pleroma.Web.ActivityPub.Pipeline
	alias Pleroma.Web.ActivityPub.Utils
	alias Pleroma.Web.Push
	alias Pleroma.Web.Streamer

	require Logger

	@cachex Pleroma.Config.get([:cachex, :provider], Cachex)
	@logger Pleroma.Config.get([:side_effects, :logger], Logger)

	@behaviour Pleroma.Web.ActivityPub.SideEffects.Handling

	defp ap_streamer, do: Pleroma.Config.get([:side_effects, :ap_streamer], ActivityPub)

	@impl true
	def handle(object, meta \\ [])

	# Task this handles
	# - Follows
	# - Sends a notification
	@impl true
	def handle(
	%{
	data: %{
	"actor" => actor,
	"type" => "Accept",
	"object" => follow_activity_id
	}
	} = object,
	meta
	) do
	with %Activity{actor: follower_id} = follow_activity <-
	Activity.get_by_ap_id(follow_activity_id),
	%User{} = followed <- User.get_cached_by_ap_id(actor),
	%User{} = follower <- User.get_cached_by_ap_id(follower_id),
	{:ok, follow_activity} <- Utils.update_follow_state_for_all(follow_activity, "accept"),
	{:ok, _follower, followed} <-
	FollowingRelationship.update(follower, followed, :follow_accept) do
	Notification.update_notification_type(followed, follow_activity)
	end

	{:ok, object, meta}
	end

	# Task this handles
	# - Rejects all existing follow activities for this person
	# - Updates the follow state
	# - Dismisses notification
	@impl true
	def handle(
	%{
	data: %{
	"actor" => actor,
	"type" => "Reject",
	"object" => follow_activity_id
	}
	} = object,
	meta
	) do
	with %Activity{actor: follower_id} = follow_activity <-
	Activity.get_by_ap_id(follow_activity_id),
	%User{} = followed <- User.get_cached_by_ap_id(actor),
	%User{} = follower <- User.get_cached_by_ap_id(follower_id),
	{:ok, _follow_activity} <- Utils.update_follow_state_for_all(follow_activity, "reject") do
	FollowingRelationship.update(follower, followed, :follow_reject)
	Notification.dismiss(follow_activity)
	end

	{:ok, object, meta}
	end

	# Tasks this handle
	# - Follows if possible
	# - Sends a notification
	# - Generates accept or reject if appropriate
	@impl true
	def handle(
	%{
	data: %{
	"id" => follow_id,
	"type" => "Follow",
	"object" => followed_user,
	"actor" => following_user
	}
	} = object,
	meta
	) do
	with %User{} = follower <- User.get_cached_by_ap_id(following_user),
	%User{} = followed <- User.get_cached_by_ap_id(followed_user),
	{_, {:ok, _, _}, _, _} <-
	{:following, User.follow(follower, followed, :follow_pending), follower, followed} do
	if followed.local && !followed.is_locked do
	{:ok, accept_data, _} = Builder.accept(followed, object)
	{:ok, _activity, _} = Pipeline.common_pipeline(accept_data, local: true)
	end
	else
	{:following, {:error, _}, _follower, followed} ->
	{:ok, reject_data, _} = Builder.reject(followed, object)
	{:ok, _activity, _} = Pipeline.common_pipeline(reject_data, local: true)

	_ ->
	nil
	end

	{:ok, notifications} = Notification.create_notifications(object, do_send: false)

	meta =
	meta
	\|> add_notifications(notifications)

	updated_object = Activity.get_by_ap_id(follow_id)

	{:ok, updated_object, meta}
	end

	# Tasks this handles:
	# - Unfollow and block
	@impl true
	def handle(
	%{data: %{"type" => "Block", "object" => blocked_user, "actor" => blocking_user}} =
	object,
	meta
	) do
	with %User{} = blocker <- User.get_cached_by_ap_id(blocking_user),
	%User{} = blocked <- User.get_cached_by_ap_id(blocked_user) do
	User.block(blocker, blocked)
	end

	{:ok, object, meta}
	end

	# Tasks this handles:
	# - Update the user
	#
	# For a local user, we also get a changeset with the full information, so we
	# can update non-federating, non-activitypub settings as well.
	@impl true
	def handle(%{data: %{"type" => "Update", "object" => updated_object}} = object, meta) do
	if changeset = Keyword.get(meta, :user_update_changeset) do
	changeset
	\|> User.update_and_set_cache()
	else
	{:ok, new_user_data} = ActivityPub.user_data_from_user_object(updated_object)

	User.get_by_ap_id(updated_object["id"])
	\|> User.remote_user_changeset(new_user_data)
	\|> User.update_and_set_cache()
	end

	{:ok, object, meta}
	end

	# Tasks this handles:
	# - Add like to object
	# - Set up notification
	@impl true
	def handle(%{data: %{"type" => "Like"}} = object, meta) do
	liked_object = Object.get_by_ap_id(object.data["object"])
	Utils.add_like_to_object(object, liked_object)

	Notification.create_notifications(object)

	{:ok, object, meta}
	end

	# Tasks this handles
	# - Actually create object
	# - Rollback if we couldn't create it
	# - Increase the user note count
	# - Increase the reply count
	# - Increase replies count
	# - Set up ActivityExpiration
	# - Set up notifications
	@impl true
	def handle(%{data: %{"type" => "Create"}} = activity, meta) do
	with {:ok, object, meta} <- handle_object_creation(meta[:object_data], meta),
	%User{} = user <- User.get_cached_by_ap_id(activity.data["actor"]) do
	{:ok, notifications} = Notification.create_notifications(activity, do_send: false)
	{:ok, _user} = ActivityPub.increase_note_count_if_public(user, object)

	if in_reply_to = object.data["inReplyTo"] && object.data["type"] != "Answer" do
	Object.increase_replies_count(in_reply_to)
	end

	reply_depth = (meta[:depth] \|\| 0) + 1

	# FIXME: Force inReplyTo to replies
	if Pleroma.Web.Federator.allowed_thread_distance?(reply_depth) and
	object.data["replies"] != nil do
	for reply_id <- object.data["replies"] do
	Pleroma.Workers.RemoteFetcherWorker.enqueue("fetch_remote", %{
	"id" => reply_id,
	"depth" => reply_depth
	})
	end
	end

	ConcurrentLimiter.limit(Pleroma.Web.RichMedia.Helpers, fn ->
	Task.start(fn -> Pleroma.Web.RichMedia.Helpers.fetch_data_for_activity(activity) end)
	end)

	meta =
	meta
	\|> add_notifications(notifications)

	+ ap_streamer().stream_out(activity)
	+
	{:ok, activity, meta}
	else
	e -> Repo.rollback(e)
	end
	end

	# Tasks this handles:
	# - Add announce to object
	# - Set up notification
	# - Stream out the announce
	@impl true
	def handle(%{data: %{"type" => "Announce"}} = object, meta) do
	announced_object = Object.get_by_ap_id(object.data["object"])
	user = User.get_cached_by_ap_id(object.data["actor"])

	Utils.add_announce_to_object(object, announced_object)

	if !User.is_internal_user?(user) do
	Notification.create_notifications(object)

	- object
	- \|> Topics.get_activity_topics()
	- \|> Streamer.stream(object)
	+ ap_streamer().stream_out(object)
	end

	{:ok, object, meta}
	end

	@impl true
	def handle(%{data: %{"type" => "Undo", "object" => undone_object}} = object, meta) do
	with undone_object <- Activity.get_by_ap_id(undone_object),
	:ok <- handle_undoing(undone_object) do
	{:ok, object, meta}
	end
	end

	# Tasks this handles:
	# - Add reaction to object
	# - Set up notification
	@impl true
	def handle(%{data: %{"type" => "EmojiReact"}} = object, meta) do
	reacted_object = Object.get_by_ap_id(object.data["object"])
	Utils.add_emoji_reaction_to_object(object, reacted_object)

	Notification.create_notifications(object)

	{:ok, object, meta}
	end

	# Tasks this handles:
	# - Delete and unpins the create activity
	# - Replace object with Tombstone
	# - Set up notification
	# - Reduce the user note count
	# - Reduce the reply count
	# - Stream out the activity
	@impl true
	def handle(%{data: %{"type" => "Delete", "object" => deleted_object}} = object, meta) do
	deleted_object =
	Object.normalize(deleted_object, fetch: false) \|\|
	User.get_cached_by_ap_id(deleted_object)

	result =
	case deleted_object do
	%Object{} ->
	with {:ok, deleted_object, _activity} <- Object.delete(deleted_object),
	{_, actor} when is_binary(actor) <- {:actor, deleted_object.data["actor"]},
	%User{} = user <- User.get_cached_by_ap_id(actor) do
	User.remove_pinned_object_id(user, deleted_object.data["id"])

	{:ok, user} = ActivityPub.decrease_note_count_if_public(user, deleted_object)

	if in_reply_to = deleted_object.data["inReplyTo"] do
	Object.decrease_replies_count(in_reply_to)
	end

	MessageReference.delete_for_object(deleted_object)

	ap_streamer().stream_out(object)
	ap_streamer().stream_out_participations(deleted_object, user)
	:ok
	else
	{:actor, _} ->
	@logger.error("The object doesn't have an actor: #{inspect(deleted_object)}")
	:no_object_actor
	end

	%User{} ->
	with {:ok, _} <- User.delete(deleted_object) do
	:ok
	end
	end

	if result == :ok do
	Notification.create_notifications(object)
	{:ok, object, meta}
	else
	{:error, result}
	end
	end

	# Tasks this handles:
	# - adds pin to user
	# - removes expiration job for pinned activity, if was set for expiration
	@impl true
	def handle(%{data: %{"type" => "Add"} = data} = object, meta) do
	with %User{} = user <- User.get_cached_by_ap_id(data["actor"]),
	{:ok, _user} <- User.add_pinned_object_id(user, data["object"]) do
	# if pinned activity was scheduled for deletion, we remove job
	if expiration = Pleroma.Workers.PurgeExpiredActivity.get_expiration(meta[:activity_id]) do
	Oban.cancel_job(expiration.id)
	end

	{:ok, object, meta}
	else
	nil ->
	{:error, :user_not_found}

	{:error, changeset} ->
	if changeset.errors[:pinned_objects] do
	{:error, :pinned_statuses_limit_reached}
	else
	changeset.errors
	end
	end
	end

	# Tasks this handles:
	# - removes pin from user
	# - removes corresponding Add activity
	# - if activity had expiration, recreates activity expiration job
	@impl true
	def handle(%{data: %{"type" => "Remove"} = data} = object, meta) do
	with %User{} = user <- User.get_cached_by_ap_id(data["actor"]),
	{:ok, _user} <- User.remove_pinned_object_id(user, data["object"]) do
	data["object"]
	\|> Activity.add_by_params_query(user.ap_id, user.featured_address)
	\|> Repo.delete_all()

	# if pinned activity was scheduled for deletion, we reschedule it for deletion
	if meta[:expires_at] do
	# MRF.ActivityExpirationPolicy used UTC timestamps for expires_at in original implementation
	{:ok, expires_at} =
	Pleroma.EctoType.ActivityPub.ObjectValidators.DateTime.cast(meta[:expires_at])

	Pleroma.Workers.PurgeExpiredActivity.enqueue(%{
	activity_id: meta[:activity_id],
	expires_at: expires_at
	})
	end

	{:ok, object, meta}
	else
	nil -> {:error, :user_not_found}
	error -> error
	end
	end

	# Nothing to do
	@impl true
	def handle(object, meta) do
	{:ok, object, meta}
	end

	def handle_object_creation(%{"type" => "ChatMessage"} = object, meta) do
	with {:ok, object, meta} <- Pipeline.common_pipeline(object, meta) do
	actor = User.get_cached_by_ap_id(object.data["actor"])
	recipient = User.get_cached_by_ap_id(hd(object.data["to"]))

	streamables =
	[[actor, recipient], [recipient, actor]]
	\|> Enum.uniq()
	\|> Enum.map(fn [user, other_user] ->
	if user.local do
	{:ok, chat} = Chat.bump_or_create(user.id, other_user.ap_id)
	{:ok, cm_ref} = MessageReference.create(chat, object, user.ap_id != actor.ap_id)

	@cachex.put(
	:chat_message_id_idempotency_key_cache,
	cm_ref.id,
	meta[:idempotency_key]
	)

	{
	["user", "user:pleroma_chat"],
	{user, %{cm_ref \| chat: chat, object: object}}
	}
	end
	end)
	\|> Enum.filter(& &1)

	meta =
	meta
	\|> add_streamables(streamables)

	{:ok, object, meta}
	end
	end

	def handle_object_creation(%{"type" => "Answer"} = object_map, meta) do
	with {:ok, object, meta} <- Pipeline.common_pipeline(object_map, meta) do
	Object.increase_vote_count(
	object.data["inReplyTo"],
	object.data["name"],
	object.data["actor"]
	)

	{:ok, object, meta}
	end
	end

	def handle_object_creation(%{"type" => objtype} = object, meta)
	when objtype in ~w[Audio Video Question Event Article Note Page] do
	with {:ok, object, meta} <- Pipeline.common_pipeline(object, meta) do
	{:ok, object, meta}
	end
	end

	# Nothing to do
	def handle_object_creation(object, meta) do
	{:ok, object, meta}
	end

	defp undo_like(nil, object), do: delete_object(object)

	defp undo_like(%Object{} = liked_object, object) do
	with {:ok, _} <- Utils.remove_like_from_object(object, liked_object) do
	delete_object(object)
	end
	end

	def handle_undoing(%{data: %{"type" => "Like"}} = object) do
	object.data["object"]
	\|> Object.get_by_ap_id()
	\|> undo_like(object)
	end

	def handle_undoing(%{data: %{"type" => "EmojiReact"}} = object) do
	with %Object{} = reacted_object <- Object.get_by_ap_id(object.data["object"]),
	{:ok, _} <- Utils.remove_emoji_reaction_from_object(object, reacted_object),
	{:ok, _} <- Repo.delete(object) do
	:ok
	end
	end

	def handle_undoing(%{data: %{"type" => "Announce"}} = object) do
	with %Object{} = liked_object <- Object.get_by_ap_id(object.data["object"]),
	{:ok, _} <- Utils.remove_announce_from_object(object, liked_object),
	{:ok, _} <- Repo.delete(object) do
	:ok
	end
	end

	def handle_undoing(
	%{data: %{"type" => "Block", "actor" => blocker, "object" => blocked}} = object
	) do
	with %User{} = blocker <- User.get_cached_by_ap_id(blocker),
	%User{} = blocked <- User.get_cached_by_ap_id(blocked),
	{:ok, _} <- User.unblock(blocker, blocked),
	{:ok, _} <- Repo.delete(object) do
	:ok
	end
	end

	def handle_undoing(object), do: {:error, ["don't know how to handle", object]}

	@spec delete_object(Object.t()) :: :ok \| {:error, Ecto.Changeset.t()}
	defp delete_object(object) do
	with {:ok, _} <- Repo.delete(object), do: :ok
	end

	defp send_notifications(meta) do
	Keyword.get(meta, :notifications, [])
	\|> Enum.each(fn notification ->
	Streamer.stream(["user", "user:notification"], notification)
	Push.send(notification)
	end)

	meta
	end

	defp send_streamables(meta) do
	Keyword.get(meta, :streamables, [])
	\|> Enum.each(fn {topics, items} ->
	Streamer.stream(topics, items)
	end)

	meta
	end

	defp add_streamables(meta, streamables) do
	existing = Keyword.get(meta, :streamables, [])

	meta
	\|> Keyword.put(:streamables, streamables ++ existing)
	end

	defp add_notifications(meta, notifications) do
	existing = Keyword.get(meta, :notifications, [])

	meta
	\|> Keyword.put(:notifications, notifications ++ existing)
	end

	@impl true
	def handle_after_transaction(meta) do
	meta
	\|> send_notifications()
	\|> send_streamables()
	end
	end
	diff --git a/lib/pleroma/web/admin_api/controllers/frontend_controller.ex b/lib/pleroma/web/admin_api/controllers/frontend_controller.ex
	index 722f51bd2..442e6a5a0 100644
	--- a/lib/pleroma/web/admin_api/controllers/frontend_controller.ex
	+++ b/lib/pleroma/web/admin_api/controllers/frontend_controller.ex
	@@ -1,40 +1,46 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2021 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Web.AdminAPI.FrontendController do
	use Pleroma.Web, :controller

	alias Pleroma.Config
	alias Pleroma.Web.Plugs.OAuthScopesPlug

	plug(Pleroma.Web.ApiSpec.CastAndValidate)
	plug(OAuthScopesPlug, %{scopes: ["admin:write"]} when action == :install)
	plug(OAuthScopesPlug, %{scopes: ["admin:read"]} when action == :index)
	action_fallback(Pleroma.Web.AdminAPI.FallbackController)

	defdelegate open_api_operation(action), to: Pleroma.Web.ApiSpec.Admin.FrontendOperation

	def index(conn, _params) do
	installed = installed()

	frontends =
	[:frontends, :available]
	\|> Config.get([])
	\|> Enum.map(fn {name, desc} ->
	Map.put(desc, "installed", name in installed)
	end)

	render(conn, "index.json", frontends: frontends)
	end

	def install(%{body_params: params} = conn, _params) do
	with :ok <- Pleroma.Frontend.install(params.name, Map.delete(params, :name)) do
	index(conn, %{})
	end
	end

	defp installed do
	- File.ls!(Pleroma.Frontend.dir())
	+ frontend_directory = Pleroma.Frontend.dir()
	+
	+ if File.exists?(frontend_directory) do
	+ File.ls!(frontend_directory)
	+ else
	+ []
	+ end
	end
	end
	diff --git a/lib/pleroma/web/admin_api/report.ex b/lib/pleroma/web/admin_api/report.ex
	index 259068f04..345bc1e87 100644
	--- a/lib/pleroma/web/admin_api/report.ex
	+++ b/lib/pleroma/web/admin_api/report.ex
	@@ -1,23 +1,25 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2021 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Web.AdminAPI.Report do
	alias Pleroma.Activity
	alias Pleroma.User

	def extract_report_info(
	%{data: %{"actor" => actor, "object" => [account_ap_id \| status_ap_ids]}} = report
	) do
	user = User.get_cached_by_ap_id(actor)
	account = User.get_cached_by_ap_id(account_ap_id)

	statuses =
	- Enum.map(status_ap_ids, fn
	+ status_ap_ids
	+ \|> Enum.reject(&is_nil(&1))
	+ \|> Enum.map(fn
	act when is_map(act) -> Activity.get_by_ap_id_with_object(act["id"])
	act when is_binary(act) -> Activity.get_by_ap_id_with_object(act)
	end)

	%{report: report, user: user, account: account, statuses: statuses}
	end
	end
	diff --git a/lib/pleroma/web/api_spec/operations/twitter_util_operation.ex b/lib/pleroma/web/api_spec/operations/twitter_util_operation.ex
	index 0cafbc719..879b2227e 100644
	--- a/lib/pleroma/web/api_spec/operations/twitter_util_operation.ex
	+++ b/lib/pleroma/web/api_spec/operations/twitter_util_operation.ex
	@@ -1,219 +1,237 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2021 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Web.ApiSpec.TwitterUtilOperation do
	alias OpenApiSpex.Operation
	alias OpenApiSpex.Schema
	alias Pleroma.Web.ApiSpec.Schemas.ApiError
	alias Pleroma.Web.ApiSpec.Schemas.BooleanLike

	+ import Pleroma.Web.ApiSpec.Helpers
	+
	def open_api_operation(action) do
	operation = String.to_existing_atom("#{action}_operation")
	apply(__MODULE__, operation, [])
	end

	def emoji_operation do
	%Operation{
	tags: ["Emojis"],
	summary: "List all custom emojis",
	operationId: "UtilController.emoji",
	parameters: [],
	responses: %{
	200 =>
	Operation.response("List", "application/json", %Schema{
	type: :object,
	additionalProperties: %Schema{
	type: :object,
	properties: %{
	image_url: %Schema{type: :string},
	tags: %Schema{type: :array, items: %Schema{type: :string}}
	}
	},
	example: %{
	"firefox" => %{
	"image_url" => "/emoji/firefox.png",
	"tag" => ["Fun"]
	}
	}
	})
	}
	}
	end

	def frontend_configurations_operation do
	%Operation{
	tags: ["Configuration"],
	summary: "Dump frontend configurations",
	operationId: "UtilController.frontend_configurations",
	parameters: [],
	responses: %{
	200 =>
	Operation.response("List", "application/json", %Schema{
	type: :object,
	additionalProperties: %Schema{type: :object}
	})
	}
	}
	end

	def change_password_operation do
	%Operation{
	tags: ["Account credentials"],
	summary: "Change account password",
	security: [%{"oAuth" => ["write:accounts"]}],
	operationId: "UtilController.change_password",
	- parameters: [
	- Operation.parameter(:password, :query, :string, "Current password", required: true),
	- Operation.parameter(:new_password, :query, :string, "New password", required: true),
	- Operation.parameter(
	- :new_password_confirmation,
	- :query,
	- :string,
	- "New password, confirmation",
	- required: true
	- )
	- ],
	+ requestBody: request_body("Parameters", change_password_request(), required: true),
	responses: %{
	200 =>
	Operation.response("Success", "application/json", %Schema{
	type: :object,
	properties: %{status: %Schema{type: :string, example: "success"}}
	}),
	400 => Operation.response("Error", "application/json", ApiError),
	403 => Operation.response("Error", "application/json", ApiError)
	}
	}
	end

	+ defp change_password_request do
	+ %Schema{
	+ title: "ChangePasswordRequest",
	+ description: "POST body for changing the account's passowrd",
	+ type: :object,
	+ required: [:password, :new_password, :new_password_confirmation],
	+ properties: %{
	+ password: %Schema{type: :string, description: "Current password"},
	+ new_password: %Schema{type: :string, description: "New password"},
	+ new_password_confirmation: %Schema{
	+ type: :string,
	+ description: "New password, confirmation"
	+ }
	+ }
	+ }
	+ end
	+
	def change_email_operation do
	%Operation{
	tags: ["Account credentials"],
	summary: "Change account email",
	security: [%{"oAuth" => ["write:accounts"]}],
	operationId: "UtilController.change_email",
	- parameters: [
	- Operation.parameter(:password, :query, :string, "Current password", required: true),
	- Operation.parameter(:email, :query, :string, "New email", required: true)
	- ],
	- requestBody: nil,
	+ requestBody: request_body("Parameters", change_email_request(), required: true),
	responses: %{
	200 =>
	Operation.response("Success", "application/json", %Schema{
	type: :object,
	properties: %{status: %Schema{type: :string, example: "success"}}
	}),
	400 => Operation.response("Error", "application/json", ApiError),
	403 => Operation.response("Error", "application/json", ApiError)
	}
	}
	end

	+ defp change_email_request do
	+ %Schema{
	+ title: "ChangeEmailRequest",
	+ description: "POST body for changing the account's email",
	+ type: :object,
	+ required: [:email, :password],
	+ properties: %{
	+ email: %Schema{type: :string, description: "New email"},
	+ password: %Schema{type: :string, description: "Current password"}
	+ }
	+ }
	+ end
	+
	def update_notificaton_settings_operation do
	%Operation{
	tags: ["Accounts"],
	summary: "Update Notification Settings",
	security: [%{"oAuth" => ["write:accounts"]}],
	operationId: "UtilController.update_notificaton_settings",
	parameters: [
	Operation.parameter(
	:block_from_strangers,
	:query,
	BooleanLike,
	"blocks notifications from accounts you do not follow"
	),
	Operation.parameter(
	:hide_notification_contents,
	:query,
	BooleanLike,
	"removes the contents of a message from the push notification"
	)
	],
	requestBody: nil,
	responses: %{
	200 =>
	Operation.response("Success", "application/json", %Schema{
	type: :object,
	properties: %{status: %Schema{type: :string, example: "success"}}
	}),
	400 => Operation.response("Error", "application/json", ApiError)
	}
	}
	end

	def disable_account_operation do
	%Operation{
	tags: ["Account credentials"],
	summary: "Disable Account",
	security: [%{"oAuth" => ["write:accounts"]}],
	operationId: "UtilController.disable_account",
	parameters: [
	Operation.parameter(:password, :query, :string, "Password")
	],
	responses: %{
	200 =>
	Operation.response("Success", "application/json", %Schema{
	type: :object,
	properties: %{status: %Schema{type: :string, example: "success"}}
	}),
	403 => Operation.response("Error", "application/json", ApiError)
	}
	}
	end

	def delete_account_operation do
	%Operation{
	tags: ["Account credentials"],
	summary: "Delete Account",
	security: [%{"oAuth" => ["write:accounts"]}],
	operationId: "UtilController.delete_account",
	parameters: [
	Operation.parameter(:password, :query, :string, "Password")
	],
	responses: %{
	200 =>
	Operation.response("Success", "application/json", %Schema{
	type: :object,
	properties: %{status: %Schema{type: :string, example: "success"}}
	}),
	403 => Operation.response("Error", "application/json", ApiError)
	}
	}
	end

	def captcha_operation do
	%Operation{
	summary: "Get a captcha",
	operationId: "UtilController.captcha",
	parameters: [],
	responses: %{
	200 => Operation.response("Success", "application/json", %Schema{type: :object})
	}
	}
	end

	def healthcheck_operation do
	%Operation{
	tags: ["Accounts"],
	summary: "Quick status check on the instance",
	security: [%{"oAuth" => ["write:accounts"]}],
	operationId: "UtilController.healthcheck",
	parameters: [],
	responses: %{
	200 => Operation.response("Healthy", "application/json", %Schema{type: :object}),
	503 =>
	Operation.response("Disabled or Unhealthy", "application/json", %Schema{type: :object})
	}
	}
	end

	def remote_subscribe_operation do
	%Operation{
	tags: ["Accounts"],
	summary: "Remote Subscribe",
	operationId: "UtilController.remote_subscribe",
	parameters: [],
	responses: %{200 => Operation.response("Web Page", "test/html", %Schema{type: :string})}
	}
	end
	end
	diff --git a/lib/pleroma/web/common_api/utils.ex b/lib/pleroma/web/common_api/utils.ex
	index 33639e695..10eb48250 100644
	--- a/lib/pleroma/web/common_api/utils.ex
	+++ b/lib/pleroma/web/common_api/utils.ex
	@@ -1,527 +1,522 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2021 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Web.CommonAPI.Utils do
	import Pleroma.Web.Gettext

	alias Calendar.Strftime
	alias Pleroma.Activity
	alias Pleroma.Config
	alias Pleroma.Conversation.Participation
	alias Pleroma.Formatter
	alias Pleroma.Object
	alias Pleroma.Repo
	alias Pleroma.User
	alias Pleroma.Web.ActivityPub.Utils
	alias Pleroma.Web.ActivityPub.Visibility
	alias Pleroma.Web.CommonAPI.ActivityDraft
	alias Pleroma.Web.MediaProxy
	alias Pleroma.Web.Plugs.AuthenticationPlug
	alias Pleroma.Web.Utils.Params

	require Logger
	require Pleroma.Constants

	def attachments_from_ids(%{media_ids: ids, descriptions: desc}) do
	attachments_from_ids_descs(ids, desc)
	end

	def attachments_from_ids(%{media_ids: ids}) do
	attachments_from_ids_no_descs(ids)
	end

	def attachments_from_ids(_), do: []

	def attachments_from_ids_no_descs([]), do: []

	def attachments_from_ids_no_descs(ids) do
	Enum.map(ids, fn media_id ->
	case Repo.get(Object, media_id) do
	%Object{data: data} -> data
	_ -> nil
	end
	end)
	\|> Enum.reject(&is_nil/1)
	end

	def attachments_from_ids_descs([], _), do: []

	def attachments_from_ids_descs(ids, descs_str) do
	{_, descs} = Jason.decode(descs_str)

	Enum.map(ids, fn media_id ->
	with %Object{data: data} <- Repo.get(Object, media_id) do
	Map.put(data, "name", descs[media_id])
	end
	end)
	\|> Enum.reject(&is_nil/1)
	end

	@spec get_to_and_cc(ActivityDraft.t()) :: {list(String.t()), list(String.t())}

	def get_to_and_cc(%{in_reply_to_conversation: %Participation{} = participation}) do
	participation = Repo.preload(participation, :recipients)
	{Enum.map(participation.recipients, & &1.ap_id), []}
	end

	def get_to_and_cc(%{visibility: visibility} = draft) when visibility in ["public", "local"] do
	to =
	case visibility do
	"public" -> [Pleroma.Constants.as_public() \| draft.mentions]
	"local" -> [Utils.as_local_public() \| draft.mentions]
	end

	cc = [draft.user.follower_address]

	if draft.in_reply_to do
	{Enum.uniq([draft.in_reply_to.data["actor"] \| to]), cc}
	else
	{to, cc}
	end
	end

	def get_to_and_cc(%{visibility: "unlisted"} = draft) do
	to = [draft.user.follower_address \| draft.mentions]
	cc = [Pleroma.Constants.as_public()]

	if draft.in_reply_to do
	{Enum.uniq([draft.in_reply_to.data["actor"] \| to]), cc}
	else
	{to, cc}
	end
	end

	def get_to_and_cc(%{visibility: "private"} = draft) do
	{to, cc} = get_to_and_cc(struct(draft, visibility: "direct"))
	{[draft.user.follower_address \| to], cc}
	end

	def get_to_and_cc(%{visibility: "direct"} = draft) do
	# If the OP is a DM already, add the implicit actor.
	if draft.in_reply_to && Visibility.is_direct?(draft.in_reply_to) do
	{Enum.uniq([draft.in_reply_to.data["actor"] \| draft.mentions]), []}
	else
	{draft.mentions, []}
	end
	end

	def get_to_and_cc(%{visibility: {:list, _}, mentions: mentions}), do: {mentions, []}

	def get_addressed_users(_, to) when is_list(to) do
	User.get_ap_ids_by_nicknames(to)
	end

	def get_addressed_users(mentioned_users, _), do: mentioned_users

	def maybe_add_list_data(activity_params, user, {:list, list_id}) do
	case Pleroma.List.get(list_id, user) do
	%Pleroma.List{} = list ->
	activity_params
	\|> put_in([:additional, "bcc"], [list.ap_id])
	\|> put_in([:additional, "listMessage"], list.ap_id)
	\|> put_in([:object, "listMessage"], list.ap_id)

	_ ->
	activity_params
	end
	end

	def maybe_add_list_data(activity_params, _, _), do: activity_params

	def make_poll_data(%{"poll" => %{"expires_in" => expires_in}} = data)
	when is_binary(expires_in) do
	# In some cases mastofe sends out strings instead of integers
	data
	\|> put_in(["poll", "expires_in"], String.to_integer(expires_in))
	\|> make_poll_data()
	end

	def make_poll_data(%{poll: %{options: options, expires_in: expires_in}} = data)
	when is_list(options) do
	limits = Config.get([:instance, :poll_limits])

	with :ok <- validate_poll_expiration(expires_in, limits),
	:ok <- validate_poll_options_amount(options, limits),
	:ok <- validate_poll_options_length(options, limits) do
	{option_notes, emoji} =
	Enum.map_reduce(options, %{}, fn option, emoji ->
	note = %{
	"name" => option,
	"type" => "Note",
	"replies" => %{"type" => "Collection", "totalItems" => 0}
	}

	{note, Map.merge(emoji, Pleroma.Emoji.Formatter.get_emoji_map(option))}
	end)

	end_time =
	DateTime.utc_now()
	\|> DateTime.add(expires_in)
	\|> DateTime.to_iso8601()

	key = if Params.truthy_param?(data.poll[:multiple]), do: "anyOf", else: "oneOf"
	poll = %{"type" => "Question", key => option_notes, "closed" => end_time}

	{:ok, {poll, emoji}}
	end
	end

	def make_poll_data(%{"poll" => poll}) when is_map(poll) do
	{:error, "Invalid poll"}
	end

	def make_poll_data(_data) do
	{:ok, {%{}, %{}}}
	end

	defp validate_poll_options_amount(options, %{max_options: max_options}) do
	if Enum.count(options) > max_options do
	{:error, "Poll can't contain more than #{max_options} options"}
	else
	:ok
	end
	end

	defp validate_poll_options_length(options, %{max_option_chars: max_option_chars}) do
	if Enum.any?(options, &(String.length(&1) > max_option_chars)) do
	{:error, "Poll options cannot be longer than #{max_option_chars} characters each"}
	else
	:ok
	end
	end

	defp validate_poll_expiration(expires_in, %{min_expiration: min, max_expiration: max}) do
	cond do
	expires_in > max -> {:error, "Expiration date is too far in the future"}
	expires_in < min -> {:error, "Expiration date is too soon"}
	true -> :ok
	end
	end

	def make_content_html(%ActivityDraft{} = draft) do
	attachment_links =
	draft.params
	\|> Map.get("attachment_links", Config.get([:instance, :attachment_links]))
	\|> Params.truthy_param?()

	content_type = get_content_type(draft.params[:content_type])

	options =
	if draft.visibility == "direct" && Config.get([:instance, :safe_dm_mentions]) do
	[safe_mention: true]
	else
	[]
	end

	draft.status
	\|> format_input(content_type, options)
	\|> maybe_add_attachments(draft.attachments, attachment_links)
	end

	defp get_content_type(content_type) do
	if Enum.member?(Config.get([:instance, :allowed_post_formats]), content_type) do
	content_type
	else
	"text/plain"
	end
	end

	def make_context(_, %Participation{} = participation) do
	Repo.preload(participation, :conversation).conversation.ap_id
	end

	def make_context(%Activity{data: %{"context" => context}}, _), do: context
	def make_context(_, _), do: Utils.generate_context_id()

	def maybe_add_attachments(parsed, _attachments, false = _no_links), do: parsed

	def maybe_add_attachments({text, mentions, tags}, attachments, _no_links) do
	text = add_attachments(text, attachments)
	{text, mentions, tags}
	end

	def add_attachments(text, attachments) do
	attachment_text = Enum.map(attachments, &build_attachment_link/1)
	Enum.join([text \| attachment_text], "<br>")
	end

	defp build_attachment_link(%{"url" => [%{"href" => href} \| _]} = attachment) do
	name = attachment["name"] \|\| URI.decode(Path.basename(href))
	href = MediaProxy.url(href)
	"<a href=\"#{href}\" class='attachment'>#{shortname(name)}</a>"
	end

	defp build_attachment_link(_), do: ""

	def format_input(text, format, options \\ [])

	@doc """
	Formatting text to plain text, BBCode, HTML, or Markdown
	"""
	def format_input(text, "text/plain", options) do
	text
	\|> Formatter.html_escape("text/plain")
	\|> Formatter.linkify(options)
	\|> (fn {text, mentions, tags} ->
	{String.replace(text, ~r/\r?\n/, "<br>"), mentions, tags}
	end).()
	end

	def format_input(text, "text/bbcode", options) do
	text
	\|> String.replace(~r/\r/, "")
	\|> Formatter.html_escape("text/plain")
	\|> BBCode.to_html()
	\|> (fn {:ok, html} -> html end).()
	\|> Formatter.linkify(options)
	end

	def format_input(text, "text/html", options) do
	text
	\|> Formatter.html_escape("text/html")
	\|> Formatter.linkify(options)
	end

	def format_input(text, "text/markdown", options) do
	text
	\|> Formatter.mentions_escape(options)
	\|> Formatter.markdown_to_html()
	\|> Formatter.linkify(options)
	\|> Formatter.html_escape("text/html")
	end

	def make_note_data(%ActivityDraft{} = draft) do
	%{
	"type" => "Note",
	"to" => draft.to,
	"cc" => draft.cc,
	"content" => draft.content_html,
	"summary" => draft.summary,
	"sensitive" => draft.sensitive,
	"context" => draft.context,
	"attachment" => draft.attachments,
	"actor" => draft.user.ap_id,
	"tag" => Keyword.values(draft.tags) \|> Enum.uniq()
	}
	\|> add_in_reply_to(draft.in_reply_to)
	\|> Map.merge(draft.extra)
	end

	defp add_in_reply_to(object, nil), do: object

	defp add_in_reply_to(object, in_reply_to) do
	with %Object{} = in_reply_to_object <- Object.normalize(in_reply_to, fetch: false) do
	Map.put(object, "inReplyTo", in_reply_to_object.data["id"])
	else
	_ -> object
	end
	end

	def format_naive_asctime(date) do
	date \|> DateTime.from_naive!("Etc/UTC") \|> format_asctime
	end

	def format_asctime(date) do
	Strftime.strftime!(date, "%a %b %d %H:%M:%S %z %Y")
	end

	def date_to_asctime(date) when is_binary(date) do
	with {:ok, date, _offset} <- DateTime.from_iso8601(date) do
	format_asctime(date)
	else
	_e ->
	Logger.warn("Date #{date} in wrong format, must be ISO 8601")
	""
	end
	end

	def date_to_asctime(date) do
	Logger.warn("Date #{date} in wrong format, must be ISO 8601")
	""
	end

	def to_masto_date(%NaiveDateTime{} = date) do
	date
	\|> NaiveDateTime.to_iso8601()
	\|> String.replace(~r/(\.\d+)?$/, ".000Z", global: false)
	end

	def to_masto_date(date) when is_binary(date) do
	with {:ok, date} <- NaiveDateTime.from_iso8601(date) do
	to_masto_date(date)
	else
	_ -> ""
	end
	end

	def to_masto_date(_), do: ""

	defp shortname(name) do
	with max_length when max_length > 0 <-
	Config.get([Pleroma.Upload, :filename_display_max_length], 30),
	true <- String.length(name) > max_length do
	String.slice(name, 0..max_length) <> "…"
	else
	_ -> name
	end
	end

	@spec confirm_current_password(User.t(), String.t()) :: {:ok, User.t()} \| {:error, String.t()}
	def confirm_current_password(user, password) do
	with %User{local: true} = db_user <- User.get_cached_by_id(user.id),
	true <- AuthenticationPlug.checkpw(password, db_user.password_hash) do
	{:ok, db_user}
	else
	_ -> {:error, dgettext("errors", "Invalid password.")}
	end
	end

	def maybe_notify_to_recipients(
	recipients,
	%Activity{data: %{"to" => to, "type" => _type}} = _activity
	) do
	recipients ++ to
	end

	def maybe_notify_to_recipients(recipients, _), do: recipients

	def maybe_notify_mentioned_recipients(
	recipients,
	%Activity{data: %{"to" => _to, "type" => type} = data} = activity
	)
	when type == "Create" do
	object = Object.normalize(activity, fetch: false)

	object_data =
	cond do
	not is_nil(object) ->
	object.data

	is_map(data["object"]) ->
	data["object"]

	true ->
	%{}
	end

	tagged_mentions = maybe_extract_mentions(object_data)

	recipients ++ tagged_mentions
	end

	def maybe_notify_mentioned_recipients(recipients, _), do: recipients

	- # Do not notify subscribers if author is making a reply
	- def maybe_notify_subscribers(recipients, %Activity{
	- object: %Object{data: %{"inReplyTo" => _ap_id}}
	- }) do
	- recipients
	- end
	-
	def maybe_notify_subscribers(
	recipients,
	- %Activity{data: %{"actor" => actor, "type" => type}} = activity
	- )
	- when type == "Create" do
	- with %User{} = user <- User.get_cached_by_ap_id(actor) do
	+ %Activity{data: %{"actor" => actor, "type" => "Create"}} = activity
	+ ) do
	+ # Do not notify subscribers if author is making a reply
	+ with %Object{data: object} <- Object.normalize(activity, fetch: false),
	+ nil <- object["inReplyTo"],
	+ %User{} = user <- User.get_cached_by_ap_id(actor) do
	subscriber_ids =
	user
	\|> User.subscriber_users()
	\|> Enum.filter(&Visibility.visible_for_user?(activity, &1))
	\|> Enum.map(& &1.ap_id)

	recipients ++ subscriber_ids
	else
	_e -> recipients
	end
	end

	def maybe_notify_subscribers(recipients, _), do: recipients

	def maybe_notify_followers(recipients, %Activity{data: %{"type" => "Move"}} = activity) do
	with %User{} = user <- User.get_cached_by_ap_id(activity.actor) do
	user
	\|> User.get_followers()
	\|> Enum.map(& &1.ap_id)
	\|> Enum.concat(recipients)
	else
	_e -> recipients
	end
	end

	def maybe_notify_followers(recipients, _), do: recipients

	def maybe_extract_mentions(%{"tag" => tag}) do
	tag
	\|> Enum.filter(fn x -> is_map(x) && x["type"] == "Mention" end)
	\|> Enum.map(fn x -> x["href"] end)
	\|> Enum.uniq()
	end

	def maybe_extract_mentions(_), do: []

	def make_report_content_html(nil), do: {:ok, {nil, [], []}}

	def make_report_content_html(comment) do
	max_size = Config.get([:instance, :max_report_comment_size], 1000)

	if String.length(comment) <= max_size do
	{:ok, format_input(comment, "text/plain")}
	else
	{:error,
	dgettext("errors", "Comment must be up to %{max_size} characters", max_size: max_size)}
	end
	end

	def get_report_statuses(%User{ap_id: actor}, %{status_ids: status_ids})
	when is_list(status_ids) do
	{:ok, Activity.all_by_actor_and_id(actor, status_ids)}
	end

	def get_report_statuses(_, _), do: {:ok, nil}

	# DEPRECATED mostly, context objects are now created at insertion time.
	def context_to_conversation_id(context) do
	with %Object{id: id} <- Object.get_cached_by_ap_id(context) do
	id
	else
	_e ->
	changeset = Object.context_mapping(context)

	case Repo.insert(changeset) do
	{:ok, %{id: id}} ->
	id

	# This should be solved by an upsert, but it seems ecto
	# has problems accessing the constraint inside the jsonb.
	{:error, _} ->
	Object.get_cached_by_ap_id(context).id
	end
	end
	end

	def conversation_id_to_context(id) do
	with %Object{data: %{"id" => context}} <- Repo.get(Object, id) do
	context
	else
	_e ->
	{:error, dgettext("errors", "No such conversation")}
	end
	end

	def validate_character_limit("" = _full_payload, [] = _attachments) do
	{:error, dgettext("errors", "Cannot post an empty status without attachments")}
	end

	def validate_character_limit(full_payload, _attachments) do
	limit = Config.get([:instance, :limit])
	length = String.length(full_payload)

	if length <= limit do
	:ok
	else
	{:error, dgettext("errors", "The status is over the character limit")}
	end
	end
	end
	diff --git a/lib/pleroma/web/mastodon_api/views/status_view.ex b/lib/pleroma/web/mastodon_api/views/status_view.ex
	index da44e0a74..463f34198 100644
	--- a/lib/pleroma/web/mastodon_api/views/status_view.ex
	+++ b/lib/pleroma/web/mastodon_api/views/status_view.ex
	@@ -1,596 +1,604 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2021 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Web.MastodonAPI.StatusView do
	use Pleroma.Web, :view

	require Pleroma.Constants

	alias Pleroma.Activity
	alias Pleroma.HTML
	alias Pleroma.Maps
	alias Pleroma.Object
	alias Pleroma.Repo
	alias Pleroma.User
	alias Pleroma.UserRelationship
	alias Pleroma.Web.CommonAPI
	alias Pleroma.Web.CommonAPI.Utils
	alias Pleroma.Web.MastodonAPI.AccountView
	alias Pleroma.Web.MastodonAPI.PollView
	alias Pleroma.Web.MastodonAPI.StatusView
	alias Pleroma.Web.MediaProxy
	alias Pleroma.Web.PleromaAPI.EmojiReactionController

	import Pleroma.Web.ActivityPub.Visibility, only: [get_visibility: 1, visible_for_user?: 2]

	# This is a naive way to do this, just spawning a process per activity
	# to fetch the preview. However it should be fine considering
	# pagination is restricted to 40 activities at a time
	defp fetch_rich_media_for_activities(activities) do
	Enum.each(activities, fn activity ->
	spawn(fn ->
	Pleroma.Web.RichMedia.Helpers.fetch_data_for_activity(activity)
	end)
	end)
	end

	# TODO: Add cached version.
	defp get_replied_to_activities([]), do: %{}

	defp get_replied_to_activities(activities) do
	activities
	\|> Enum.map(fn
	%{data: %{"type" => "Create"}} = activity ->
	object = Object.normalize(activity, fetch: false)
	object && object.data["inReplyTo"] != "" && object.data["inReplyTo"]

	_ ->
	nil
	end)
	\|> Enum.filter(& &1)
	\|> Activity.create_by_object_ap_id_with_object()
	\|> Repo.all()
	\|> Enum.reduce(%{}, fn activity, acc ->
	object = Object.normalize(activity, fetch: false)
	if object, do: Map.put(acc, object.data["id"], activity), else: acc
	end)
	end

	defp get_context_id(%{data: %{"context_id" => context_id}}) when not is_nil(context_id),
	do: context_id

	defp get_context_id(%{data: %{"context" => context}}) when is_binary(context),
	do: Utils.context_to_conversation_id(context)

	defp get_context_id(_), do: nil

	- defp reblogged?(activity, user) do
	- object = Object.normalize(activity, fetch: false) \|\| %{}
	- present?(user && user.ap_id in (object.data["announcements"] \|\| []))
	+ # Check if the user reblogged this status
	+ defp reblogged?(activity, %User{ap_id: ap_id}) do
	+ with %Object{data: %{"announcements" => announcements}} when is_list(announcements) <-
	+ Object.normalize(activity, fetch: false) do
	+ ap_id in announcements
	+ else
	+ _ -> false
	+ end
	end

	+ # False if the user is logged out
	+ defp reblogged?(_activity, _user), do: false
	+
	def render("index.json", opts) do
	reading_user = opts[:for]

	# To do: check AdminAPIControllerTest on the reasons behind nil activities in the list
	activities = Enum.filter(opts.activities, & &1)

	# Start fetching rich media before doing anything else, so that later calls to get the cards
	# only block for timeout in the worst case, as opposed to
	# length(activities_with_links) * timeout
	fetch_rich_media_for_activities(activities)
	replied_to_activities = get_replied_to_activities(activities)

	parent_activities =
	activities
	\|> Enum.filter(&(&1.data["type"] == "Announce" && &1.data["object"]))
	\|> Enum.map(&Object.normalize(&1, fetch: false).data["id"])
	\|> Activity.create_by_object_ap_id()
	\|> Activity.with_preloaded_object(:left)
	\|> Activity.with_preloaded_bookmark(reading_user)
	\|> Activity.with_set_thread_muted_field(reading_user)
	\|> Repo.all()

	relationships_opt =
	cond do
	Map.has_key?(opts, :relationships) ->
	opts[:relationships]

	is_nil(reading_user) ->
	UserRelationship.view_relationships_option(nil, [])

	true ->
	# Note: unresolved users are filtered out
	actors =
	(activities ++ parent_activities)
	\|> Enum.map(&CommonAPI.get_user(&1.data["actor"], false))
	\|> Enum.filter(& &1)

	UserRelationship.view_relationships_option(reading_user, actors, subset: :source_mutes)
	end

	opts =
	opts
	\|> Map.put(:replied_to_activities, replied_to_activities)
	\|> Map.put(:parent_activities, parent_activities)
	\|> Map.put(:relationships, relationships_opt)

	safe_render_many(activities, StatusView, "show.json", opts)
	end

	def render(
	"show.json",
	%{activity: %{data: %{"type" => "Announce", "object" => _object}} = activity} = opts
	) do
	user = CommonAPI.get_user(activity.data["actor"])
	created_at = Utils.to_masto_date(activity.data["published"])
	object = Object.normalize(activity, fetch: false)

	reblogged_parent_activity =
	if opts[:parent_activities] do
	Activity.Queries.find_by_object_ap_id(
	opts[:parent_activities],
	object.data["id"]
	)
	else
	Activity.create_by_object_ap_id(object.data["id"])
	\|> Activity.with_preloaded_bookmark(opts[:for])
	\|> Activity.with_set_thread_muted_field(opts[:for])
	\|> Repo.one()
	end

	reblog_rendering_opts = Map.put(opts, :activity, reblogged_parent_activity)
	reblogged = render("show.json", reblog_rendering_opts)

	favorited = opts[:for] && opts[:for].ap_id in (object.data["likes"] \|\| [])

	bookmarked = Activity.get_bookmark(reblogged_parent_activity, opts[:for]) != nil

	mentions =
	activity.recipients
	\|> Enum.map(fn ap_id -> User.get_cached_by_ap_id(ap_id) end)
	\|> Enum.filter(& &1)
	\|> Enum.map(fn user -> AccountView.render("mention.json", %{user: user}) end)

	{pinned?, pinned_at} = pin_data(object, user)

	%{
	id: to_string(activity.id),
	uri: object.data["id"],
	url: object.data["id"],
	account:
	AccountView.render("show.json", %{
	user: user,
	for: opts[:for]
	}),
	in_reply_to_id: nil,
	in_reply_to_account_id: nil,
	reblog: reblogged,
	content: reblogged[:content] \|\| "",
	created_at: created_at,
	reblogs_count: 0,
	replies_count: 0,
	favourites_count: 0,
	reblogged: reblogged?(reblogged_parent_activity, opts[:for]),
	favourited: present?(favorited),
	bookmarked: present?(bookmarked),
	muted: false,
	pinned: pinned?,
	sensitive: false,
	spoiler_text: "",
	visibility: get_visibility(activity),
	media_attachments: reblogged[:media_attachments] \|\| [],
	mentions: mentions,
	tags: reblogged[:tags] \|\| [],
	application: build_application(object.data["generator"]),
	language: nil,
	emojis: [],
	pleroma: %{
	local: activity.local,
	pinned_at: pinned_at
	}
	}
	end

	def render("show.json", %{activity: %{data: %{"object" => _object}} = activity} = opts) do
	object = Object.normalize(activity, fetch: false)

	user = CommonAPI.get_user(activity.data["actor"])
	user_follower_address = user.follower_address

	like_count = object.data["like_count"] \|\| 0
	announcement_count = object.data["announcement_count"] \|\| 0

	hashtags = Object.hashtags(object)
	sensitive = object.data["sensitive"] \|\| Enum.member?(hashtags, "nsfw")

	tags = Object.tags(object)

	tag_mentions =
	tags
	\|> Enum.filter(fn tag -> is_map(tag) and tag["type"] == "Mention" end)
	\|> Enum.map(fn tag -> tag["href"] end)

	mentions =
	(object.data["to"] ++ tag_mentions)
	\|> Enum.uniq()
	\|> Enum.map(fn
	Pleroma.Constants.as_public() -> nil
	^user_follower_address -> nil
	ap_id -> User.get_cached_by_ap_id(ap_id)
	end)
	\|> Enum.filter(& &1)
	\|> Enum.map(fn user -> AccountView.render("mention.json", %{user: user}) end)

	favorited = opts[:for] && opts[:for].ap_id in (object.data["likes"] \|\| [])

	bookmarked = Activity.get_bookmark(activity, opts[:for]) != nil

	client_posted_this_activity = opts[:for] && user.id == opts[:for].id

	expires_at =
	with true <- client_posted_this_activity,
	%Oban.Job{scheduled_at: scheduled_at} <-
	Pleroma.Workers.PurgeExpiredActivity.get_expiration(activity.id) do
	scheduled_at
	else
	_ -> nil
	end

	thread_muted? =
	cond do
	is_nil(opts[:for]) -> false
	is_boolean(activity.thread_muted?) -> activity.thread_muted?
	true -> CommonAPI.thread_muted?(opts[:for], activity)
	end

	attachment_data = object.data["attachment"] \|\| []
	attachments = render_many(attachment_data, StatusView, "attachment.json", as: :attachment)

	created_at = Utils.to_masto_date(object.data["published"])

	reply_to = get_reply_to(activity, opts)

	reply_to_user = reply_to && CommonAPI.get_user(reply_to.data["actor"])

	content =
	object
	\|> render_content()

	content_html =
	content
	\|> Activity.HTML.get_cached_scrubbed_html_for_activity(
	User.html_filter_policy(opts[:for]),
	activity,
	"mastoapi:content"
	)

	content_plaintext =
	content
	\|> Activity.HTML.get_cached_stripped_html_for_activity(
	activity,
	"mastoapi:content"
	)

	summary = object.data["summary"] \|\| ""

	card = render("card.json", Pleroma.Web.RichMedia.Helpers.fetch_data_for_activity(activity))

	url =
	if user.local do
	Pleroma.Web.Router.Helpers.o_status_url(Pleroma.Web.Endpoint, :notice, activity)
	else
	object.data["url"] \|\| object.data["external_url"] \|\| object.data["id"]
	end

	direct_conversation_id =
	with {_, nil} <- {:direct_conversation_id, opts[:direct_conversation_id]},
	{_, true} <- {:include_id, opts[:with_direct_conversation_id]},
	{_, %User{} = for_user} <- {:for_user, opts[:for]} do
	Activity.direct_conversation_id(activity, for_user)
	else
	{:direct_conversation_id, participation_id} when is_integer(participation_id) ->
	participation_id

	_e ->
	nil
	end

	emoji_reactions =
	object.data
	\|> Map.get("reactions", [])
	\|> EmojiReactionController.filter_allowed_users(
	opts[:for],
	Map.get(opts, :with_muted, false)
	)
	\|> Stream.map(fn {emoji, users} ->
	build_emoji_map(emoji, users, opts[:for])
	end)
	\|> Enum.to_list()

	# Status muted state (would do 1 request per status unless user mutes are preloaded)
	muted =
	thread_muted? \|\|
	UserRelationship.exists?(
	get_in(opts, [:relationships, :user_relationships]),
	:mute,
	opts[:for],
	user,
	fn for_user, user -> User.mutes?(for_user, user) end
	)

	{pinned?, pinned_at} = pin_data(object, user)

	%{
	id: to_string(activity.id),
	uri: object.data["id"],
	url: url,
	account:
	AccountView.render("show.json", %{
	user: user,
	for: opts[:for]
	}),
	in_reply_to_id: reply_to && to_string(reply_to.id),
	in_reply_to_account_id: reply_to_user && to_string(reply_to_user.id),
	reblog: nil,
	card: card,
	content: content_html,
	text: opts[:with_source] && object.data["source"],
	created_at: created_at,
	reblogs_count: announcement_count,
	replies_count: object.data["repliesCount"] \|\| 0,
	favourites_count: like_count,
	reblogged: reblogged?(activity, opts[:for]),
	favourited: present?(favorited),
	bookmarked: present?(bookmarked),
	muted: muted,
	pinned: pinned?,
	sensitive: sensitive,
	spoiler_text: summary,
	visibility: get_visibility(object),
	media_attachments: attachments,
	poll: render(PollView, "show.json", object: object, for: opts[:for]),
	mentions: mentions,
	tags: build_tags(tags),
	application: build_application(object.data["generator"]),
	language: nil,
	emojis: build_emojis(object.data["emoji"]),
	pleroma: %{
	local: activity.local,
	conversation_id: get_context_id(activity),
	in_reply_to_account_acct: reply_to_user && reply_to_user.nickname,
	content: %{"text/plain" => content_plaintext},
	spoiler_text: %{"text/plain" => summary},
	expires_at: expires_at,
	direct_conversation_id: direct_conversation_id,
	thread_muted: thread_muted?,
	emoji_reactions: emoji_reactions,
	parent_visible: visible_for_user?(reply_to, opts[:for]),
	pinned_at: pinned_at
	}
	}
	end

	def render("show.json", _) do
	nil
	end

	def render("card.json", %{rich_media: rich_media, page_url: page_url}) do
	page_url_data = URI.parse(page_url)

	page_url_data =
	if is_binary(rich_media["url"]) do
	URI.merge(page_url_data, URI.parse(rich_media["url"]))
	else
	page_url_data
	end

	page_url = page_url_data \|> to_string

	image_url_data =
	if is_binary(rich_media["image"]) do
	URI.parse(rich_media["image"])
	else
	nil
	end

	image_url = build_image_url(image_url_data, page_url_data)

	%{
	type: "link",
	provider_name: page_url_data.host,
	provider_url: page_url_data.scheme <> "://" <> page_url_data.host,
	url: page_url,
	image: image_url \|> MediaProxy.url(),
	title: rich_media["title"] \|\| "",
	description: rich_media["description"] \|\| "",
	pleroma: %{
	opengraph: rich_media
	}
	}
	end

	def render("card.json", _), do: nil

	def render("attachment.json", %{attachment: attachment}) do
	[attachment_url \| _] = attachment["url"]
	media_type = attachment_url["mediaType"] \|\| attachment_url["mimeType"] \|\| "image"
	href = attachment_url["href"] \|> MediaProxy.url()
	href_preview = attachment_url["href"] \|> MediaProxy.preview_url()
	meta = render("attachment_meta.json", %{attachment: attachment})

	type =
	cond do
	String.contains?(media_type, "image") -> "image"
	String.contains?(media_type, "video") -> "video"
	String.contains?(media_type, "audio") -> "audio"
	true -> "unknown"
	end

	<<hash_id::signed-32, _rest::binary>> = :crypto.hash(:md5, href)

	%{
	id: to_string(attachment["id"] \|\| hash_id),
	url: href,
	remote_url: href,
	preview_url: href_preview,
	text_url: href,
	type: type,
	description: attachment["name"],
	pleroma: %{mime_type: media_type},
	blurhash: attachment["blurhash"]
	}
	\|> Maps.put_if_present(:meta, meta)
	end

	def render("attachment_meta.json", %{
	attachment: %{"url" => [%{"width" => width, "height" => height} \| _]}
	})
	when is_integer(width) and is_integer(height) do
	%{
	original: %{
	width: width,
	height: height,
	aspect: width / height
	}
	}
	end

	def render("attachment_meta.json", _), do: nil

	def render("context.json", %{activity: activity, activities: activities, user: user}) do
	%{ancestors: ancestors, descendants: descendants} =
	activities
	\|> Enum.reverse()
	\|> Enum.group_by(fn %{id: id} -> if id < activity.id, do: :ancestors, else: :descendants end)
	\|> Map.put_new(:ancestors, [])
	\|> Map.put_new(:descendants, [])

	%{
	ancestors: render("index.json", for: user, activities: ancestors, as: :activity),
	descendants: render("index.json", for: user, activities: descendants, as: :activity)
	}
	end

	def get_reply_to(activity, %{replied_to_activities: replied_to_activities}) do
	object = Object.normalize(activity, fetch: false)

	with nil <- replied_to_activities[object.data["inReplyTo"]] do
	# If user didn't participate in the thread
	Activity.get_in_reply_to_activity(activity)
	end
	end

	def get_reply_to(%{data: %{"object" => _object}} = activity, _) do
	object = Object.normalize(activity, fetch: false)

	if object.data["inReplyTo"] && object.data["inReplyTo"] != "" do
	Activity.get_create_by_object_ap_id(object.data["inReplyTo"])
	else
	nil
	end
	end

	def render_content(%{data: %{"name" => name}} = object) when not is_nil(name) and name != "" do
	url = object.data["url"] \|\| object.data["id"]

	"<p><a href=\"#{url}\">#{name}</a></p>#{object.data["content"]}"
	end

	def render_content(object), do: object.data["content"] \|\| ""

	@doc """
	Builds a dictionary tags.

	## Examples

	iex> Pleroma.Web.MastodonAPI.StatusView.build_tags(["fediverse", "nextcloud"])
	[{"name": "fediverse", "url": "/tag/fediverse"},
	{"name": "nextcloud", "url": "/tag/nextcloud"}]

	"""
	@spec build_tags(list(any())) :: list(map())
	def build_tags(object_tags) when is_list(object_tags) do
	object_tags
	\|> Enum.filter(&is_binary/1)
	\|> Enum.map(&%{name: &1, url: "#{Pleroma.Web.Endpoint.url()}/tag/#{URI.encode(&1)}"})
	end

	def build_tags(_), do: []

	@doc """
	Builds list emojis.

	Arguments: `nil` or list tuple of name and url.

	Returns list emojis.

	## Examples

	iex> Pleroma.Web.MastodonAPI.StatusView.build_emojis([{"2hu", "corndog.png"}])
	[%{shortcode: "2hu", static_url: "corndog.png", url: "corndog.png", visible_in_picker: false}]

	"""
	@spec build_emojis(nil \| list(tuple())) :: list(map())
	def build_emojis(nil), do: []

	def build_emojis(emojis) do
	emojis
	\|> Enum.map(fn {name, url} ->
	name = HTML.strip_tags(name)

	url =
	url
	\|> HTML.strip_tags()
	\|> MediaProxy.url()

	%{shortcode: name, url: url, static_url: url, visible_in_picker: false}
	end)
	end

	defp present?(nil), do: false
	defp present?(false), do: false
	defp present?(_), do: true

	defp pin_data(%Object{data: %{"id" => object_id}}, %User{pinned_objects: pinned_objects}) do
	if pinned_at = pinned_objects[object_id] do
	{true, Utils.to_masto_date(pinned_at)}
	else
	{false, nil}
	end
	end

	defp build_emoji_map(emoji, users, current_user) do
	%{
	name: emoji,
	count: length(users),
	me: !!(current_user && current_user.ap_id in users)
	}
	end

	@spec build_application(map() \| nil) :: map() \| nil
	defp build_application(%{"type" => _type, "name" => name, "url" => url}),
	do: %{name: name, website: url}

	defp build_application(_), do: nil

	# Workaround for Elixir issue #10771
	# Avoid applying URI.merge unless necessary
	# TODO: revert to always attempting URI.merge(image_url_data, page_url_data)
	# when Elixir 1.12 is the minimum supported version
	@spec build_image_url(struct() \| nil, struct()) :: String.t() \| nil
	defp build_image_url(
	%URI{scheme: image_scheme, host: image_host} = image_url_data,
	%URI{} = _page_url_data
	)
	when not is_nil(image_scheme) and not is_nil(image_host) do
	image_url_data \|> to_string
	end

	defp build_image_url(%URI{} = image_url_data, %URI{} = page_url_data) do
	URI.merge(page_url_data, image_url_data) \|> to_string
	end

	defp build_image_url(_, _), do: nil
	end
	diff --git a/lib/pleroma/web/twitter_api/controllers/util_controller.ex b/lib/pleroma/web/twitter_api/controllers/util_controller.ex
	index a2e69666e..ef43f7682 100644
	--- a/lib/pleroma/web/twitter_api/controllers/util_controller.ex
	+++ b/lib/pleroma/web/twitter_api/controllers/util_controller.ex
	@@ -1,176 +1,172 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2021 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Web.TwitterAPI.UtilController do
	use Pleroma.Web, :controller

	require Logger

	alias Pleroma.Config
	alias Pleroma.Emoji
	alias Pleroma.Healthcheck
	alias Pleroma.User
	alias Pleroma.Web.CommonAPI
	alias Pleroma.Web.Plugs.OAuthScopesPlug
	alias Pleroma.Web.WebFinger

	plug(Pleroma.Web.ApiSpec.CastAndValidate when action != :remote_subscribe)
	plug(Pleroma.Web.Plugs.FederatingPlug when action == :remote_subscribe)

	plug(
	OAuthScopesPlug,
	%{scopes: ["write:accounts"]}
	when action in [
	:change_email,
	:change_password,
	:delete_account,
	:update_notificaton_settings,
	:disable_account
	]
	)

	defdelegate open_api_operation(action), to: Pleroma.Web.ApiSpec.TwitterUtilOperation

	def remote_subscribe(conn, %{"nickname" => nick, "profile" => _}) do
	with %User{} = user <- User.get_cached_by_nickname(nick),
	avatar = User.avatar_url(user) do
	conn
	\|> render("subscribe.html", %{nickname: nick, avatar: avatar, error: false})
	else
	_e ->
	render(conn, "subscribe.html", %{
	nickname: nick,
	avatar: nil,
	error: "Could not find user"
	})
	end
	end

	def remote_subscribe(conn, %{"user" => %{"nickname" => nick, "profile" => profile}}) do
	with {:ok, %{"subscribe_address" => template}} <- WebFinger.finger(profile),
	%User{ap_id: ap_id} <- User.get_cached_by_nickname(nick) do
	conn
	\|> Phoenix.Controller.redirect(external: String.replace(template, "{uri}", ap_id))
	else
	_e ->
	render(conn, "subscribe.html", %{
	nickname: nick,
	avatar: nil,
	error: "Something went wrong."
	})
	end
	end

	def frontend_configurations(conn, _params) do
	render(conn, "frontend_configurations.json")
	end

	def emoji(conn, _params) do
	emoji =
	Enum.reduce(Emoji.get_all(), %{}, fn {code, %Emoji{file: file, tags: tags}}, acc ->
	Map.put(acc, code, %{image_url: file, tags: tags})
	end)

	json(conn, emoji)
	end

	def update_notificaton_settings(%{assigns: %{user: user}} = conn, params) do
	with {:ok, _} <- User.update_notification_settings(user, params) do
	json(conn, %{status: "success"})
	end
	end

	- def change_password(%{assigns: %{user: user}} = conn, %{
	- password: password,
	- new_password: new_password,
	- new_password_confirmation: new_password_confirmation
	- }) do
	- case CommonAPI.Utils.confirm_current_password(user, password) do
	+ def change_password(%{assigns: %{user: user}, body_params: body_params} = conn, %{}) do
	+ case CommonAPI.Utils.confirm_current_password(user, body_params.password) do
	{:ok, user} ->
	with {:ok, _user} <-
	User.reset_password(user, %{
	- password: new_password,
	- password_confirmation: new_password_confirmation
	+ password: body_params.new_password,
	+ password_confirmation: body_params.new_password_confirmation
	}) do
	json(conn, %{status: "success"})
	else
	{:error, changeset} ->
	{_, {error, _}} = Enum.at(changeset.errors, 0)
	json(conn, %{error: "New password #{error}."})

	_ ->
	json(conn, %{error: "Unable to change password."})
	end

	{:error, msg} ->
	json(conn, %{error: msg})
	end
	end

	- def change_email(%{assigns: %{user: user}} = conn, %{password: password, email: email}) do
	- case CommonAPI.Utils.confirm_current_password(user, password) do
	+ def change_email(%{assigns: %{user: user}, body_params: body_params} = conn, %{}) do
	+ case CommonAPI.Utils.confirm_current_password(user, body_params.password) do
	{:ok, user} ->
	- with {:ok, _user} <- User.change_email(user, email) do
	+ with {:ok, _user} <- User.change_email(user, body_params.email) do
	json(conn, %{status: "success"})
	else
	{:error, changeset} ->
	{_, {error, _}} = Enum.at(changeset.errors, 0)
	json(conn, %{error: "Email #{error}."})

	_ ->
	json(conn, %{error: "Unable to change email."})
	end

	{:error, msg} ->
	json(conn, %{error: msg})
	end
	end

	def delete_account(%{assigns: %{user: user}} = conn, params) do
	password = params[:password] \|\| ""

	case CommonAPI.Utils.confirm_current_password(user, password) do
	{:ok, user} ->
	User.delete(user)
	json(conn, %{status: "success"})

	{:error, msg} ->
	json(conn, %{error: msg})
	end
	end

	def disable_account(%{assigns: %{user: user}} = conn, params) do
	case CommonAPI.Utils.confirm_current_password(user, params[:password]) do
	{:ok, user} ->
	User.set_activation_async(user, false)
	json(conn, %{status: "success"})

	{:error, msg} ->
	json(conn, %{error: msg})
	end
	end

	def captcha(conn, _params) do
	json(conn, Pleroma.Captcha.new())
	end

	def healthcheck(conn, _params) do
	with true <- Config.get([:instance, :healthcheck]),
	%{healthy: true} = info <- Healthcheck.system_info() do
	json(conn, info)
	else
	%{healthy: false} = info ->
	service_unavailable(conn, info)

	_ ->
	service_unavailable(conn, %{})
	end
	end

	defp service_unavailable(conn, info) do
	conn
	\|> put_status(:service_unavailable)
	\|> json(info)
	end
	end
	diff --git a/mix.exs b/mix.exs
	index 763c58089..39c79c83b 100644
	--- a/mix.exs
	+++ b/mix.exs
	@@ -1,362 +1,362 @@
	defmodule Pleroma.Mixfile do
	use Mix.Project

	def project do
	[
	app: :pleroma,
	- version: version("2.4.0"),
	+ version: version("2.4.1"),
	elixir: "~> 1.9",
	elixirc_paths: elixirc_paths(Mix.env()),
	compilers: [:phoenix, :gettext] ++ Mix.compilers(),
	elixirc_options: [warnings_as_errors: warnings_as_errors(Mix.env())],
	xref: [exclude: [:eldap]],
	start_permanent: Mix.env() == :prod,
	aliases: aliases(),
	deps: deps(),
	test_coverage: [tool: ExCoveralls],
	preferred_cli_env: ["coveralls.html": :test],
	# Docs
	name: "Pleroma",
	homepage_url: "https://pleroma.social/",
	source_url: "https://git.pleroma.social/pleroma/pleroma",
	docs: [
	source_url_pattern:
	"https://git.pleroma.social/pleroma/pleroma/blob/develop/%{path}#L%{line}",
	logo: "priv/static/images/logo.png",
	extras: ["README.md", "CHANGELOG.md"] ++ Path.wildcard("docs/*/.md"),
	groups_for_extras: [
	"Installation manuals": Path.wildcard("docs/installation/*.md"),
	Configuration: Path.wildcard("docs/config/*.md"),
	Administration: Path.wildcard("docs/admin/*.md"),
	"Pleroma's APIs and Mastodon API extensions": Path.wildcard("docs/api/*.md")
	],
	main: "readme",
	output: "priv/static/doc"
	],
	releases: [
	pleroma: [
	include_executables_for: [:unix],
	applications: [ex_syslogger: :load, syslog: :load, eldap: :transient],
	steps: [:assemble, &put_otp_version/1, &copy_files/1, &copy_nginx_config/1],
	config_providers: [{Pleroma.Config.ReleaseRuntimeProvider, []}]
	]
	]
	]
	end

	def put_otp_version(%{path: target_path} = release) do
	File.write!(
	Path.join([target_path, "OTP_VERSION"]),
	Pleroma.OTPVersion.version()
	)

	release
	end

	def copy_files(%{path: target_path} = release) do
	File.cp_r!("./rel/files", target_path)
	release
	end

	def copy_nginx_config(%{path: target_path} = release) do
	File.cp!(
	"./installation/pleroma.nginx",
	Path.join([target_path, "installation", "pleroma.nginx"])
	)

	release
	end

	# Configuration for the OTP application.
	#
	# Type `mix help compile.app` for more information.
	def application do
	[
	mod: {Pleroma.Application, []},
	extra_applications: [
	:logger,
	:runtime_tools,
	:comeonin,
	:quack,
	:fast_sanitize,
	:ssl
	],
	included_applications: [:ex_syslogger]
	]
	end

	# Specifies which paths to compile per environment.
	defp elixirc_paths(:benchmark), do: ["lib", "benchmarks"]
	defp elixirc_paths(:test), do: ["lib", "test/support"]
	defp elixirc_paths(_), do: ["lib"]

	defp warnings_as_errors(:prod), do: false
	defp warnings_as_errors(_), do: true

	# Specifies OAuth dependencies.
	defp oauth_deps do
	oauth_strategy_packages =
	System.get_env("OAUTH_CONSUMER_STRATEGIES")
	\|> to_string()
	\|> String.split()
	\|> Enum.map(fn strategy_entry ->
	with [_strategy, dependency] <- String.split(strategy_entry, ":") do
	dependency
	else
	[strategy] -> "ueberauth_#{strategy}"
	end
	end)

	for s <- oauth_strategy_packages, do: {String.to_atom(s), ">= 0.0.0"}
	end

	# Specifies your project dependencies.
	#
	# Type `mix help deps` for examples and options.
	defp deps do
	[
	{:phoenix, "~> 1.5.5"},
	{:tzdata, "~> 1.0.3"},
	{:plug_cowboy, "~> 2.3"},
	{:phoenix_pubsub, "~> 2.0"},
	{:phoenix_ecto, "~> 4.0"},
	{:ecto_enum, "~> 1.4"},
	{:ecto_sql, "~> 3.6.2"},
	{:postgrex, ">= 0.15.5"},
	{:oban, "~> 2.3.4"},
	{:gettext, "~> 0.18"},
	{:bcrypt_elixir, "~> 2.2"},
	{:trailing_format_plug, "~> 0.0.7"},
	{:fast_sanitize, "~> 0.2.0"},
	{:html_entities, "~> 0.5", override: true},
	{:phoenix_html, "~> 2.14"},
	{:calendar, "~> 1.0"},
	{:cachex, "~> 3.2"},
	{:poison, "~> 3.0", override: true},
	{:tesla, "~> 1.4.0", override: true},
	{:castore, "~> 0.1"},
	{:cowlib, "~> 2.9", override: true},
	{:gun, "~> 2.0.0-rc.1", override: true},
	{:jason, "~> 1.2"},
	{:mogrify, "~> 0.7.4"},
	{:ex_aws, "~> 2.1.6"},
	{:ex_aws_s3, "~> 2.0"},
	{:sweet_xml, "~> 0.6.6"},
	{:earmark, "1.4.15"},
	{:bbcode_pleroma, "~> 0.2.0"},
	{:crypt,
	git: "https://git.pleroma.social/pleroma/elixir-libraries/crypt.git",
	ref: "cf2aa3f11632e8b0634810a15b3e612c7526f6a3"},
	{:cors_plug, "~> 2.0"},
	{:web_push_encryption,
	git: "https://github.com/lanodan/elixir-web-push-encryption.git", branch: "bugfix/otp-24"},
	{:swoosh, "~> 1.0"},
	{:phoenix_swoosh, "~> 0.3"},
	{:gen_smtp, "~> 0.13"},
	{:ex_syslogger, "~> 1.4"},
	{:floki, "~> 0.27"},
	{:timex, "~> 3.6"},
	{:ueberauth, "~> 0.4"},
	{:linkify, "~> 0.5.1"},
	{:http_signatures, "~> 0.1.0"},
	{:telemetry, "~> 0.3"},
	{:poolboy, "~> 1.5"},
	{:prometheus, "~> 4.6"},
	{:prometheus_ex,
	git: "https://git.pleroma.social/pleroma/elixir-libraries/prometheus.ex.git",
	ref: "a4e9beb3c1c479d14b352fd9d6dd7b1f6d7deee5",
	override: true},
	{:prometheus_plugs, "~> 1.1"},
	{:prometheus_phoenix, "~> 1.3"},
	# Note: once `prometheus_phx` is integrated into `prometheus_phoenix`, remove the former:
	{:prometheus_phx,
	git: "https://git.pleroma.social/pleroma/elixir-libraries/prometheus-phx.git",
	branch: "no-logging"},
	{:prometheus_ecto, "~> 1.4"},
	{:recon, "~> 2.5"},
	{:quack, "~> 0.1.1"},
	{:joken, "~> 2.0"},
	{:benchee, "~> 1.0"},
	{:pot, "~> 1.0"},
	{:esshd, "~> 0.1.0", runtime: Application.get_env(:esshd, :enabled, false)},
	{:ex_const, "~> 0.2"},
	{:plug_static_index_html, "~> 1.0.0"},
	{:flake_id, "~> 0.1.0"},
	{:concurrent_limiter,
	git: "https://git.pleroma.social/pleroma/elixir-libraries/concurrent_limiter.git",
	ref: "d81be41024569330f296fc472e24198d7499ba78"},
	{:remote_ip,
	git: "https://git.pleroma.social/pleroma/remote_ip.git",
	ref: "b647d0deecaa3acb140854fe4bda5b7e1dc6d1c8"},
	{:captcha,
	git: "https://git.pleroma.social/pleroma/elixir-libraries/elixir-captcha.git",
	ref: "e0f16822d578866e186a0974d65ad58cddc1e2ab"},
	{:restarter, path: "./restarter"},
	{:majic,
	git: "https://git.pleroma.social/pleroma/elixir-libraries/majic.git",
	ref: "289cda1b6d0d70ccb2ba508a2b0bd24638db2880"},
	{:eblurhash, "~> 1.1.0"},
	{:open_api_spex, "~> 3.10"},

	# indirect dependency version override
	{:plug, "~> 1.10.4", override: true},

	## dev & test
	{:ex_doc, "~> 0.22", only: :dev, runtime: false},
	{:ex_machina, "~> 2.4", only: :test},
	{:credo, "~> 1.4", only: [:dev, :test], runtime: false},
	{:mock, "~> 0.3.5", only: :test},
	# temporary downgrade for excoveralls, hackney until hackney max_connections bug will be fixed
	{:excoveralls, "0.12.3", only: :test},
	{:hackney, "~> 1.17.0", override: true},
	{:mox, "~> 1.0", only: :test},
	{:websocket_client, git: "https://github.com/jeremyong/websocket_client.git", only: :test}
	] ++ oauth_deps()
	end

	# Aliases are shortcuts or tasks specific to the current project.
	# For example, to create, migrate and run the seeds file at once:
	#
	# $ mix ecto.setup
	#
	# See the documentation for `Mix` for more info on aliases.
	defp aliases do
	[
	"ecto.migrate": ["pleroma.ecto.migrate"],
	"ecto.rollback": ["pleroma.ecto.rollback"],
	"ecto.setup": ["ecto.create", "ecto.migrate", "run priv/repo/seeds.exs"],
	"ecto.reset": ["ecto.drop", "ecto.setup"],
	test: ["ecto.create --quiet", "ecto.migrate", "test"],
	docs: ["pleroma.docs", "docs"],
	analyze: ["credo --strict --only=warnings,todo,fixme,consistency,readability"],
	copyright: &add_copyright/1,
	"copyright.bump": &bump_copyright/1
	]
	end

	# Builds a version string made of:
	# * the application version
	# * a pre-release if ahead of the tag: the describe string (-count-commithash)
	# * branch name
	# * build metadata:
	# * a build name if `PLEROMA_BUILD_NAME` or `:pleroma, :build_name` is defined
	# * the mix environment if different than prod
	defp version(version) do
	identifier_filter = ~r/[^0-9a-z\-]+/i

	git_available? = match?({_output, 0}, System.cmd("sh", ["-c", "command -v git"]))

	git_pre_release =
	if git_available? do
	{tag, tag_err} =
	System.cmd("git", ["describe", "--tags", "--abbrev=0"], stderr_to_stdout: true)

	{describe, describe_err} = System.cmd("git", ["describe", "--tags", "--abbrev=8"])
	{commit_hash, commit_hash_err} = System.cmd("git", ["rev-parse", "--short", "HEAD"])

	# Pre-release version, denoted from patch version with a hyphen
	cond do
	tag_err == 0 and describe_err == 0 ->
	describe
	\|> String.trim()
	\|> String.replace(String.trim(tag), "")
	\|> String.trim_leading("-")
	\|> String.trim()

	commit_hash_err == 0 ->
	"0-g" <> String.trim(commit_hash)

	true ->
	nil
	end
	end

	# Branch name as pre-release version component, denoted with a dot
	branch_name =
	with true <- git_available?,
	{branch_name, 0} <- System.cmd("git", ["rev-parse", "--abbrev-ref", "HEAD"]),
	branch_name <- String.trim(branch_name),
	branch_name <- System.get_env("PLEROMA_BUILD_BRANCH") \|\| branch_name,
	true <-
	!Enum.any?(["master", "HEAD", "release/", "stable"], fn name ->
	String.starts_with?(name, branch_name)
	end) do
	branch_name =
	branch_name
	\|> String.trim()
	\|> String.replace(identifier_filter, "-")

	branch_name
	else
	_ -> ""
	end

	build_name =
	cond do
	name = Application.get_env(:pleroma, :build_name) -> name
	name = System.get_env("PLEROMA_BUILD_NAME") -> name
	true -> nil
	end

	env_name = if Mix.env() != :prod, do: to_string(Mix.env())
	env_override = System.get_env("PLEROMA_BUILD_ENV")

	env_name =
	case env_override do
	nil -> env_name
	env_override when env_override in ["", "prod"] -> nil
	env_override -> env_override
	end

	# Pre-release version, denoted by appending a hyphen
	# and a series of dot separated identifiers
	pre_release =
	[git_pre_release, branch_name]
	\|> Enum.filter(fn string -> string && string != "" end)
	\|> Enum.join(".")
	\|> (fn
	"" -> nil
	string -> "-" <> String.replace(string, identifier_filter, "-")
	end).()

	# Build metadata, denoted with a plus sign
	build_metadata =
	[build_name, env_name]
	\|> Enum.filter(fn string -> string && string != "" end)
	\|> Enum.join(".")
	\|> (fn
	"" -> nil
	string -> "+" <> String.replace(string, identifier_filter, "-")
	end).()

	[version, pre_release, build_metadata]
	\|> Enum.filter(fn string -> string && string != "" end)
	\|> Enum.join()
	end

	defp add_copyright(_) do
	year = NaiveDateTime.utc_now().year
	template = ~s[\
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-#{year} Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	] \|> String.replace("\n", "\\n")

	find = "find lib test priv -type f \$ -name '.ex' -or -name '.exs' \$ -exec "
	grep = "grep -L '# Copyright © [0-9\-]* Pleroma' {} \\;"
	xargs = "xargs -n1 sed -i'' '1s;^;#{template};'"

	:os.cmd(String.to_charlist("#{find}#{grep} \| #{xargs}"))
	end

	defp bump_copyright(_) do
	year = NaiveDateTime.utc_now().year
	find = "find lib test priv -type f \$ -name '.ex' -or -name '.exs' \$"

	xargs =
	"xargs sed -i'' 's;# Copyright © [0-9\-]* Pleroma.*$;# Copyright © 2017-#{year} Pleroma Authors <https://pleroma.social/>;'"

	:os.cmd(String.to_charlist("#{find} \| #{xargs}"))
	end
	end
	diff --git a/test/pleroma/docs/generator_test.exs b/test/pleroma/docs/generator_test.exs
	index a9b09e577..8574c1d5e 100644
	--- a/test/pleroma/docs/generator_test.exs
	+++ b/test/pleroma/docs/generator_test.exs
	@@ -1,226 +1,226 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2021 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Docs.GeneratorTest do
	use ExUnit.Case, async: true
	alias Pleroma.Docs.Generator

	@descriptions [
	%{
	group: :pleroma,
	key: Pleroma.Upload,
	type: :group,
	description: "",
	children: [
	%{
	key: :uploader,
	type: :module,
	description: "",
	suggestions: {:list_behaviour_implementations, Pleroma.Upload.Filter}
	},
	%{
	key: :filters,
	type: {:list, :module},
	description: "",
	- suggestions: {:list_behaviour_implementations, Pleroma.Web.ActivityPub.MRF}
	+ suggestions: {:list_behaviour_implementations, Pleroma.Web.ActivityPub.MRF.Policy}
	},
	%{
	key: Pleroma.Upload,
	type: :string,
	description: "",
	suggestions: [""]
	},
	%{
	key: :some_key,
	type: :keyword,
	description: "",
	suggestions: [],
	children: [
	%{
	key: :another_key,
	type: :integer,
	description: "",
	suggestions: [5]
	},
	%{
	key: :another_key_with_label,
	label: "Another label",
	type: :integer,
	description: "",
	suggestions: [7]
	}
	]
	},
	%{
	key: :key1,
	type: :atom,
	description: "",
	suggestions: [
	:atom,
	Pleroma.Upload,
	{:tuple, "string", 8080},
	[:atom, Pleroma.Upload, {:atom, Pleroma.Upload}]
	]
	},
	%{
	key: Pleroma.Upload,
	label: "Special Label",
	type: :string,
	description: "",
	suggestions: [""]
	},
	%{
	group: {:subgroup, Swoosh.Adapters.SMTP},
	key: :auth,
	type: :atom,
	description: "`Swoosh.Adapters.SMTP` adapter specific setting",
	suggestions: [:always, :never, :if_available]
	},
	%{
	key: "application/xml",
	type: {:list, :string},
	suggestions: ["xml"]
	},
	%{
	key: :versions,
	type: {:list, :atom},
	description: "List of TLS version to use",
	suggestions: [:tlsv1, ":tlsv1.1", ":tlsv1.2"]
	}
	]
	},
	%{
	group: :tesla,
	key: :adapter,
	type: :group,
	description: ""
	},
	%{
	group: :cors_plug,
	type: :group,
	children: [%{key: :key1, type: :string, suggestions: [""]}]
	},
	%{group: "Some string group", key: "Some string key", type: :group}
	]

	describe "convert_to_strings/1" do
	test "group, key, label" do
	[desc1, desc2 \| _] = Generator.convert_to_strings(@descriptions)

	assert desc1[:group] == ":pleroma"
	assert desc1[:key] == "Pleroma.Upload"
	assert desc1[:label] == "Pleroma.Upload"

	assert desc2[:group] == ":tesla"
	assert desc2[:key] == ":adapter"
	assert desc2[:label] == "Adapter"
	end

	test "group without key" do
	descriptions = Generator.convert_to_strings(@descriptions)
	desc = Enum.at(descriptions, 2)

	assert desc[:group] == ":cors_plug"
	refute desc[:key]
	assert desc[:label] == "Cors plug"
	end

	test "children key, label, type" do
	[%{children: [child1, child2, child3, child4 \| _]} \| _] =
	Generator.convert_to_strings(@descriptions)

	assert child1[:key] == ":uploader"
	assert child1[:label] == "Uploader"
	assert child1[:type] == :module

	assert child2[:key] == ":filters"
	assert child2[:label] == "Filters"
	assert child2[:type] == {:list, :module}

	assert child3[:key] == "Pleroma.Upload"
	assert child3[:label] == "Pleroma.Upload"
	assert child3[:type] == :string

	assert child4[:key] == ":some_key"
	assert child4[:label] == "Some key"
	assert child4[:type] == :keyword
	end

	test "child with predefined label" do
	[%{children: children} \| _] = Generator.convert_to_strings(@descriptions)
	child = Enum.at(children, 5)
	assert child[:key] == "Pleroma.Upload"
	assert child[:label] == "Special Label"
	end

	test "subchild" do
	[%{children: children} \| _] = Generator.convert_to_strings(@descriptions)
	child = Enum.at(children, 3)
	%{children: [subchild \| _]} = child

	assert subchild[:key] == ":another_key"
	assert subchild[:label] == "Another key"
	assert subchild[:type] == :integer
	end

	test "subchild with predefined label" do
	[%{children: children} \| _] = Generator.convert_to_strings(@descriptions)
	child = Enum.at(children, 3)
	%{children: subchildren} = child
	subchild = Enum.at(subchildren, 1)

	assert subchild[:key] == ":another_key_with_label"
	assert subchild[:label] == "Another label"
	end

	test "module suggestions" do
	[%{children: [%{suggestions: suggestions} \| _]} \| _] =
	Generator.convert_to_strings(@descriptions)

	Enum.each(suggestions, fn suggestion ->
	assert String.starts_with?(suggestion, "Pleroma.")
	end)
	end

	test "atoms in suggestions with leading `:`" do
	[%{children: children} \| _] = Generator.convert_to_strings(@descriptions)
	%{suggestions: suggestions} = Enum.at(children, 4)
	assert Enum.at(suggestions, 0) == ":atom"
	assert Enum.at(suggestions, 1) == "Pleroma.Upload"
	assert Enum.at(suggestions, 2) == {":tuple", "string", 8080}
	assert Enum.at(suggestions, 3) == [":atom", "Pleroma.Upload", {":atom", "Pleroma.Upload"}]

	%{suggestions: suggestions} = Enum.at(children, 6)
	assert Enum.at(suggestions, 0) == ":always"
	assert Enum.at(suggestions, 1) == ":never"
	assert Enum.at(suggestions, 2) == ":if_available"
	end

	test "group, key as string in main desc" do
	descriptions = Generator.convert_to_strings(@descriptions)
	desc = Enum.at(descriptions, 3)
	assert desc[:group] == "Some string group"
	assert desc[:key] == "Some string key"
	end

	test "key as string subchild" do
	[%{children: children} \| _] = Generator.convert_to_strings(@descriptions)
	child = Enum.at(children, 7)
	assert child[:key] == "application/xml"
	end

	test "suggestion for tls versions" do
	[%{children: children} \| _] = Generator.convert_to_strings(@descriptions)
	child = Enum.at(children, 8)
	assert child[:suggestions] == [":tlsv1", ":tlsv1.1", ":tlsv1.2"]
	end

	test "subgroup with module name" do
	[%{children: children} \| _] = Generator.convert_to_strings(@descriptions)

	%{group: subgroup} = Enum.at(children, 6)
	assert subgroup == {":subgroup", "Swoosh.Adapters.SMTP"}
	end
	end
	end
	diff --git a/test/pleroma/web/activity_pub/mrf/object_age_policy_test.exs b/test/pleroma/web/activity_pub/mrf/object_age_policy_test.exs
	index 137aafd39..2f649a0a4 100644
	--- a/test/pleroma/web/activity_pub/mrf/object_age_policy_test.exs
	+++ b/test/pleroma/web/activity_pub/mrf/object_age_policy_test.exs
	@@ -1,147 +1,148 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2021 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Web.ActivityPub.MRF.ObjectAgePolicyTest do
	use Pleroma.DataCase
	alias Pleroma.User
	alias Pleroma.Web.ActivityPub.MRF.ObjectAgePolicy
	alias Pleroma.Web.ActivityPub.Visibility

	setup do:
	clear_config(:mrf_object_age,
	threshold: 172_800,
	actions: [:delist, :strip_followers]
	)

	setup_all do
	Tesla.Mock.mock_global(fn env -> apply(HttpRequestMock, :request, [env]) end)
	:ok
	end

	defp get_old_message do
	File.read!("test/fixtures/mastodon-post-activity.json")
	\|> Jason.decode!()
	+ \|> Map.drop(["published"])
	end

	defp get_new_message do
	old_message = get_old_message()

	new_object =
	old_message
	\|> Map.get("object")
	\|> Map.put("published", DateTime.utc_now() \|> DateTime.to_iso8601())

	old_message
	\|> Map.put("object", new_object)
	end

	describe "with reject action" do
	test "works with objects with empty to or cc fields" do
	clear_config([:mrf_object_age, :actions], [:reject])

	data =
	get_old_message()
	\|> Map.put("cc", nil)
	\|> Map.put("to", nil)

	assert match?({:reject, _}, ObjectAgePolicy.filter(data))
	end

	test "it rejects an old post" do
	clear_config([:mrf_object_age, :actions], [:reject])

	data = get_old_message()

	assert match?({:reject, _}, ObjectAgePolicy.filter(data))
	end

	test "it allows a new post" do
	clear_config([:mrf_object_age, :actions], [:reject])

	data = get_new_message()

	assert match?({:ok, _}, ObjectAgePolicy.filter(data))
	end
	end

	describe "with delist action" do
	test "works with objects with empty to or cc fields" do
	clear_config([:mrf_object_age, :actions], [:delist])

	data =
	get_old_message()
	\|> Map.put("cc", nil)
	\|> Map.put("to", nil)

	{:ok, _u} = User.get_or_fetch_by_ap_id(data["actor"])

	{:ok, data} = ObjectAgePolicy.filter(data)

	assert Visibility.get_visibility(%{data: data}) == "unlisted"
	end

	test "it delists an old post" do
	clear_config([:mrf_object_age, :actions], [:delist])

	data = get_old_message()

	{:ok, _u} = User.get_or_fetch_by_ap_id(data["actor"])

	{:ok, data} = ObjectAgePolicy.filter(data)

	assert Visibility.get_visibility(%{data: data}) == "unlisted"
	end

	test "it allows a new post" do
	clear_config([:mrf_object_age, :actions], [:delist])

	data = get_new_message()

	{:ok, _user} = User.get_or_fetch_by_ap_id(data["actor"])

	assert match?({:ok, ^data}, ObjectAgePolicy.filter(data))
	end
	end

	describe "with strip_followers action" do
	test "works with objects with empty to or cc fields" do
	clear_config([:mrf_object_age, :actions], [:strip_followers])

	data =
	get_old_message()
	\|> Map.put("cc", nil)
	\|> Map.put("to", nil)

	{:ok, user} = User.get_or_fetch_by_ap_id(data["actor"])

	{:ok, data} = ObjectAgePolicy.filter(data)

	refute user.follower_address in data["to"]
	refute user.follower_address in data["cc"]
	end

	test "it strips followers collections from an old post" do
	clear_config([:mrf_object_age, :actions], [:strip_followers])

	data = get_old_message()

	{:ok, user} = User.get_or_fetch_by_ap_id(data["actor"])

	{:ok, data} = ObjectAgePolicy.filter(data)

	refute user.follower_address in data["to"]
	refute user.follower_address in data["cc"]
	end

	test "it allows a new post" do
	clear_config([:mrf_object_age, :actions], [:strip_followers])

	data = get_new_message()

	{:ok, _u} = User.get_or_fetch_by_ap_id(data["actor"])

	assert match?({:ok, ^data}, ObjectAgePolicy.filter(data))
	end
	end
	end
	diff --git a/test/pleroma/web/admin_api/controllers/frontend_controller_test.exs b/test/pleroma/web/admin_api/controllers/frontend_controller_test.exs
	index bc827cc12..200682ba9 100644
	--- a/test/pleroma/web/admin_api/controllers/frontend_controller_test.exs
	+++ b/test/pleroma/web/admin_api/controllers/frontend_controller_test.exs
	@@ -1,141 +1,155 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2021 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Web.AdminAPI.FrontendControllerTest do
	use Pleroma.Web.ConnCase

	import Pleroma.Factory

	alias Pleroma.Config

	@dir "test/frontend_static_test"

	setup do
	clear_config([:instance, :static_dir], @dir)
	File.mkdir_p!(Pleroma.Frontend.dir())

	on_exit(fn ->
	File.rm_rf(@dir)
	end)

	admin = insert(:user, is_admin: true)
	token = insert(:oauth_admin_token, user: admin)

	conn =
	build_conn()
	\|> assign(:user, admin)
	\|> assign(:token, token)

	{:ok, %{admin: admin, token: token, conn: conn}}
	end

	describe "GET /api/pleroma/admin/frontends" do
	test "it lists available frontends", %{conn: conn} do
	response =
	conn
	\|> get("/api/pleroma/admin/frontends")
	\|> json_response_and_validate_schema(:ok)

	assert Enum.map(response, & &1["name"]) ==
	Enum.map(Config.get([:frontends, :available]), fn {_, map} -> map["name"] end)

	refute Enum.any?(response, fn frontend -> frontend["installed"] == true end)
	end
	+
	+ test "it lists available frontends when no frontend folder was created yet", %{conn: conn} do
	+ File.rm_rf(@dir)
	+
	+ response =
	+ conn
	+ \|> get("/api/pleroma/admin/frontends")
	+ \|> json_response_and_validate_schema(:ok)
	+
	+ assert Enum.map(response, & &1["name"]) ==
	+ Enum.map(Config.get([:frontends, :available]), fn {_, map} -> map["name"] end)
	+
	+ refute Enum.any?(response, fn frontend -> frontend["installed"] == true end)
	+ end
	end

	describe "POST /api/pleroma/admin/frontends/install" do
	test "from available frontends", %{conn: conn} do
	clear_config([:frontends, :available], %{
	"pleroma" => %{
	"ref" => "fantasy",
	"name" => "pleroma",
	"build_url" => "http://gensokyo.2hu/builds/${ref}"
	}
	})

	Tesla.Mock.mock(fn %{url: "http://gensokyo.2hu/builds/fantasy"} ->
	%Tesla.Env{status: 200, body: File.read!("test/fixtures/tesla_mock/frontend_dist.zip")}
	end)

	conn
	\|> put_req_header("content-type", "application/json")
	\|> post("/api/pleroma/admin/frontends/install", %{name: "pleroma"})
	\|> json_response_and_validate_schema(:ok)

	assert File.exists?(Path.join([@dir, "frontends", "pleroma", "fantasy", "test.txt"]))

	response =
	conn
	\|> get("/api/pleroma/admin/frontends")
	\|> json_response_and_validate_schema(:ok)

	assert response == [
	%{
	"build_url" => "http://gensokyo.2hu/builds/${ref}",
	"git" => nil,
	"installed" => true,
	"name" => "pleroma",
	"ref" => "fantasy"
	}
	]
	end

	test "from a file", %{conn: conn} do
	clear_config([:frontends, :available], %{
	"pleroma" => %{
	"ref" => "fantasy",
	"name" => "pleroma",
	"build_dir" => ""
	}
	})

	conn
	\|> put_req_header("content-type", "application/json")
	\|> post("/api/pleroma/admin/frontends/install", %{
	name: "pleroma",
	file: "test/fixtures/tesla_mock/frontend.zip"
	})
	\|> json_response_and_validate_schema(:ok)

	assert File.exists?(Path.join([@dir, "frontends", "pleroma", "fantasy", "test.txt"]))
	end

	test "from an URL", %{conn: conn} do
	Tesla.Mock.mock(fn %{url: "http://gensokyo.2hu/madeup.zip"} ->
	%Tesla.Env{status: 200, body: File.read!("test/fixtures/tesla_mock/frontend.zip")}
	end)

	conn
	\|> put_req_header("content-type", "application/json")
	\|> post("/api/pleroma/admin/frontends/install", %{
	name: "unknown",
	ref: "baka",
	build_url: "http://gensokyo.2hu/madeup.zip",
	build_dir: ""
	})
	\|> json_response_and_validate_schema(:ok)

	assert File.exists?(Path.join([@dir, "frontends", "unknown", "baka", "test.txt"]))
	end

	test "failing returns an error", %{conn: conn} do
	Tesla.Mock.mock(fn %{url: "http://gensokyo.2hu/madeup.zip"} ->
	%Tesla.Env{status: 404, body: ""}
	end)

	result =
	conn
	\|> put_req_header("content-type", "application/json")
	\|> post("/api/pleroma/admin/frontends/install", %{
	name: "unknown",
	ref: "baka",
	build_url: "http://gensokyo.2hu/madeup.zip",
	build_dir: ""
	})
	\|> json_response_and_validate_schema(400)

	assert result == %{"error" => "Could not download or unzip the frontend"}
	end
	end
	end
	diff --git a/test/pleroma/web/twitter_api/util_controller_test.exs b/test/pleroma/web/twitter_api/util_controller_test.exs
	index cc17940b5..f030483d8 100644
	--- a/test/pleroma/web/twitter_api/util_controller_test.exs
	+++ b/test/pleroma/web/twitter_api/util_controller_test.exs
	@@ -1,484 +1,467 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2021 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Web.TwitterAPI.UtilControllerTest do
	use Pleroma.Web.ConnCase
	use Oban.Testing, repo: Pleroma.Repo

	alias Pleroma.Tests.ObanHelpers
	alias Pleroma.User

	import Pleroma.Factory
	import Mock

	setup do
	Tesla.Mock.mock(fn env -> apply(HttpRequestMock, :request, [env]) end)
	:ok
	end

	setup do: clear_config([:instance])
	setup do: clear_config([:frontend_configurations, :pleroma_fe])

	describe "PUT /api/pleroma/notification_settings" do
	setup do: oauth_access(["write:accounts"])

	test "it updates notification settings", %{user: user, conn: conn} do
	conn
	\|> put(
	"/api/pleroma/notification_settings?#{
	URI.encode_query(%{
	block_from_strangers: true
	})
	}"
	)
	\|> json_response_and_validate_schema(:ok)

	user = refresh_record(user)

	assert %Pleroma.User.NotificationSetting{
	block_from_strangers: true,
	hide_notification_contents: false
	} == user.notification_settings
	end

	test "it updates notification settings to enable hiding contents", %{user: user, conn: conn} do
	conn
	\|> put(
	"/api/pleroma/notification_settings?#{
	URI.encode_query(%{
	hide_notification_contents: 1
	})
	}"
	)
	\|> json_response_and_validate_schema(:ok)

	user = refresh_record(user)

	assert %Pleroma.User.NotificationSetting{
	block_from_strangers: false,
	hide_notification_contents: true
	} == user.notification_settings
	end
	end

	describe "GET /api/pleroma/frontend_configurations" do
	test "returns everything in :pleroma, :frontend_configurations", %{conn: conn} do
	config = [
	frontend_a: %{
	x: 1,
	y: 2
	},
	frontend_b: %{
	z: 3
	}
	]

	clear_config(:frontend_configurations, config)

	response =
	conn
	\|> get("/api/pleroma/frontend_configurations")
	\|> json_response_and_validate_schema(:ok)

	assert response == Jason.encode!(config \|> Enum.into(%{})) \|> Jason.decode!()
	end
	end

	describe "/api/pleroma/emoji" do
	test "returns json with custom emoji with tags", %{conn: conn} do
	emoji =
	conn
	\|> get("/api/pleroma/emoji")
	\|> json_response_and_validate_schema(200)

	assert Enum.all?(emoji, fn
	{_key,
	%{
	"image_url" => url,
	"tags" => tags
	}} ->
	is_binary(url) and is_list(tags)
	end)
	end
	end

	describe "GET /api/pleroma/healthcheck" do
	setup do: clear_config([:instance, :healthcheck])

	test "returns 503 when healthcheck disabled", %{conn: conn} do
	clear_config([:instance, :healthcheck], false)

	response =
	conn
	\|> get("/api/pleroma/healthcheck")
	\|> json_response_and_validate_schema(503)

	assert response == %{}
	end

	test "returns 200 when healthcheck enabled and all ok", %{conn: conn} do
	clear_config([:instance, :healthcheck], true)

	with_mock Pleroma.Healthcheck,
	system_info: fn -> %Pleroma.Healthcheck{healthy: true} end do
	response =
	conn
	\|> get("/api/pleroma/healthcheck")
	\|> json_response_and_validate_schema(200)

	assert %{
	"active" => _,
	"healthy" => true,
	"idle" => _,
	"memory_used" => _,
	"pool_size" => _
	} = response
	end
	end

	test "returns 503 when healthcheck enabled and health is false", %{conn: conn} do
	clear_config([:instance, :healthcheck], true)

	with_mock Pleroma.Healthcheck,
	system_info: fn -> %Pleroma.Healthcheck{healthy: false} end do
	response =
	conn
	\|> get("/api/pleroma/healthcheck")
	\|> json_response_and_validate_schema(503)

	assert %{
	"active" => _,
	"healthy" => false,
	"idle" => _,
	"memory_used" => _,
	"pool_size" => _
	} = response
	end
	end
	end

	describe "POST /api/pleroma/disable_account" do
	setup do: oauth_access(["write:accounts"])

	test "with valid permissions and password, it disables the account", %{conn: conn, user: user} do
	response =
	conn
	\|> post("/api/pleroma/disable_account?password=test")
	\|> json_response_and_validate_schema(:ok)

	assert response == %{"status" => "success"}
	ObanHelpers.perform_all()

	user = User.get_cached_by_id(user.id)

	refute user.is_active
	end

	test "with valid permissions and invalid password, it returns an error", %{conn: conn} do
	user = insert(:user)

	response =
	conn
	\|> post("/api/pleroma/disable_account?password=test1")
	\|> json_response_and_validate_schema(:ok)

	assert response == %{"error" => "Invalid password."}
	user = User.get_cached_by_id(user.id)

	assert user.is_active
	end
	end

	describe "POST /main/ostatus - remote_subscribe/2" do
	setup do: clear_config([:instance, :federating], true)

	test "renders subscribe form", %{conn: conn} do
	user = insert(:user)

	response =
	conn
	\|> post("/main/ostatus", %{"nickname" => user.nickname, "profile" => ""})
	\|> response(:ok)

	refute response =~ "Could not find user"
	assert response =~ "Remotely follow #{user.nickname}"
	end

	test "renders subscribe form with error when user not found", %{conn: conn} do
	response =
	conn
	\|> post("/main/ostatus", %{"nickname" => "nickname", "profile" => ""})
	\|> response(:ok)

	assert response =~ "Could not find user"
	refute response =~ "Remotely follow"
	end

	test "it redirect to webfinger url", %{conn: conn} do
	user = insert(:user)
	user2 = insert(:user, ap_id: "shp@social.heldscal.la")

	conn =
	conn
	\|> post("/main/ostatus", %{
	"user" => %{"nickname" => user.nickname, "profile" => user2.ap_id}
	})

	assert redirected_to(conn) ==
	"https://social.heldscal.la/main/ostatussub?profile=#{user.ap_id}"
	end

	test "it renders form with error when user not found", %{conn: conn} do
	user2 = insert(:user, ap_id: "shp@social.heldscal.la")

	response =
	conn
	\|> post("/main/ostatus", %{"user" => %{"nickname" => "jimm", "profile" => user2.ap_id}})
	\|> response(:ok)

	assert response =~ "Something went wrong."
	end
	end

	test "it returns new captcha", %{conn: conn} do
	with_mock Pleroma.Captcha,
	new: fn -> "test_captcha" end do
	resp =
	conn
	\|> get("/api/pleroma/captcha")
	\|> response(200)

	assert resp == "\"test_captcha\""
	assert called(Pleroma.Captcha.new())
	end
	end

	describe "POST /api/pleroma/change_email" do
	setup do: oauth_access(["write:accounts"])

	test "without permissions", %{conn: conn} do
	conn =
	conn
	\|> assign(:token, nil)
	- \|> post(
	- "/api/pleroma/change_email?#{
	- URI.encode_query(%{password: "hi", email: "test@test.com"})
	- }"
	- )
	+ \|> put_req_header("content-type", "multipart/form-data")
	+ \|> post("/api/pleroma/change_email", %{password: "hi", email: "test@test.com"})

	assert json_response_and_validate_schema(conn, 403) == %{
	"error" => "Insufficient permissions: write:accounts."
	}
	end

	test "with proper permissions and invalid password", %{conn: conn} do
	conn =
	- post(
	- conn,
	- "/api/pleroma/change_email?#{
	- URI.encode_query(%{password: "hi", email: "test@test.com"})
	- }"
	- )
	+ conn
	+ \|> put_req_header("content-type", "multipart/form-data")
	+ \|> post("/api/pleroma/change_email", %{password: "hi", email: "test@test.com"})

	assert json_response_and_validate_schema(conn, 200) == %{"error" => "Invalid password."}
	end

	test "with proper permissions, valid password and invalid email", %{
	conn: conn
	} do
	conn =
	- post(
	- conn,
	- "/api/pleroma/change_email?#{URI.encode_query(%{password: "test", email: "foobar"})}"
	- )
	+ conn
	+ \|> put_req_header("content-type", "multipart/form-data")
	+ \|> post("/api/pleroma/change_email", %{password: "test", email: "foobar"})

	assert json_response_and_validate_schema(conn, 200) == %{
	"error" => "Email has invalid format."
	}
	end

	test "with proper permissions, valid password and no email", %{
	conn: conn
	} do
	- conn = post(conn, "/api/pleroma/change_email?#{URI.encode_query(%{password: "test"})}")
	+ conn =
	+ conn
	+ \|> put_req_header("content-type", "multipart/form-data")
	+ \|> post("/api/pleroma/change_email", %{password: "test"})

	assert %{"error" => "Missing field: email."} = json_response_and_validate_schema(conn, 400)
	end

	test "with proper permissions, valid password and blank email", %{
	conn: conn
	} do
	conn =
	- post(
	- conn,
	- "/api/pleroma/change_email?#{URI.encode_query(%{password: "test", email: ""})}"
	- )
	+ conn
	+ \|> put_req_header("content-type", "multipart/form-data")
	+ \|> post("/api/pleroma/change_email", %{password: "test", email: ""})

	assert json_response_and_validate_schema(conn, 200) == %{"error" => "Email can't be blank."}
	end

	test "with proper permissions, valid password and non unique email", %{
	conn: conn
	} do
	user = insert(:user)

	conn =
	- post(
	- conn,
	- "/api/pleroma/change_email?#{URI.encode_query(%{password: "test", email: user.email})}"
	- )
	+ conn
	+ \|> put_req_header("content-type", "multipart/form-data")
	+ \|> post("/api/pleroma/change_email", %{password: "test", email: user.email})

	assert json_response_and_validate_schema(conn, 200) == %{
	"error" => "Email has already been taken."
	}
	end

	test "with proper permissions, valid password and valid email", %{
	conn: conn
	} do
	conn =
	- post(
	- conn,
	- "/api/pleroma/change_email?#{
	- URI.encode_query(%{password: "test", email: "cofe@foobar.com"})
	- }"
	- )
	+ conn
	+ \|> put_req_header("content-type", "multipart/form-data")
	+ \|> post("/api/pleroma/change_email", %{password: "test", email: "cofe@foobar.com"})

	assert json_response_and_validate_schema(conn, 200) == %{"status" => "success"}
	end
	end

	describe "POST /api/pleroma/change_password" do
	setup do: oauth_access(["write:accounts"])

	test "without permissions", %{conn: conn} do
	conn =
	conn
	\|> assign(:token, nil)
	- \|> post(
	- "/api/pleroma/change_password?#{
	- URI.encode_query(%{
	- password: "hi",
	- new_password: "newpass",
	- new_password_confirmation: "newpass"
	- })
	- }"
	- )
	+ \|> put_req_header("content-type", "multipart/form-data")
	+ \|> post("/api/pleroma/change_password", %{
	+ "password" => "hi",
	+ "new_password" => "newpass",
	+ "new_password_confirmation" => "newpass"
	+ })

	assert json_response_and_validate_schema(conn, 403) == %{
	"error" => "Insufficient permissions: write:accounts."
	}
	end

	test "with proper permissions and invalid password", %{conn: conn} do
	conn =
	- post(
	- conn,
	- "/api/pleroma/change_password?#{
	- URI.encode_query(%{
	- password: "hi",
	- new_password: "newpass",
	- new_password_confirmation: "newpass"
	- })
	- }"
	- )
	+ conn
	+ \|> put_req_header("content-type", "multipart/form-data")
	+ \|> post("/api/pleroma/change_password", %{
	+ "password" => "hi",
	+ "new_password" => "newpass",
	+ "new_password_confirmation" => "newpass"
	+ })

	assert json_response_and_validate_schema(conn, 200) == %{"error" => "Invalid password."}
	end

	test "with proper permissions, valid password and new password and confirmation not matching",
	%{
	conn: conn
	} do
	conn =
	- post(
	- conn,
	- "/api/pleroma/change_password?#{
	- URI.encode_query(%{
	- password: "test",
	- new_password: "newpass",
	- new_password_confirmation: "notnewpass"
	- })
	- }"
	- )
	+ conn
	+ \|> put_req_header("content-type", "multipart/form-data")
	+ \|> post("/api/pleroma/change_password", %{
	+ "password" => "test",
	+ "new_password" => "newpass",
	+ "new_password_confirmation" => "notnewpass"
	+ })

	assert json_response_and_validate_schema(conn, 200) == %{
	"error" => "New password does not match confirmation."
	}
	end

	test "with proper permissions, valid password and invalid new password", %{
	conn: conn
	} do
	conn =
	- post(
	- conn,
	- "/api/pleroma/change_password?#{
	- URI.encode_query(%{password: "test", new_password: "", new_password_confirmation: ""})
	- }"
	- )
	+ conn
	+ \|> put_req_header("content-type", "multipart/form-data")
	+ \|> post("/api/pleroma/change_password", %{
	+ password: "test",
	+ new_password: "",
	+ new_password_confirmation: ""
	+ })

	assert json_response_and_validate_schema(conn, 200) == %{
	"error" => "New password can't be blank."
	}
	end

	test "with proper permissions, valid password and matching new password and confirmation", %{
	conn: conn,
	user: user
	} do
	conn =
	- post(
	- conn,
	- "/api/pleroma/change_password?#{
	- URI.encode_query(%{
	- password: "test",
	- new_password: "newpass",
	- new_password_confirmation: "newpass"
	- })
	- }"
	+ conn
	+ \|> put_req_header("content-type", "multipart/form-data")
	+ \|> post(
	+ "/api/pleroma/change_password",
	+ %{
	+ password: "test",
	+ new_password: "newpass",
	+ new_password_confirmation: "newpass"
	+ }
	)

	assert json_response_and_validate_schema(conn, 200) == %{"status" => "success"}
	fetched_user = User.get_cached_by_id(user.id)
	assert Pleroma.Password.Pbkdf2.verify_pass("newpass", fetched_user.password_hash) == true
	end
	end

	describe "POST /api/pleroma/delete_account" do
	setup do: oauth_access(["write:accounts"])

	test "without permissions", %{conn: conn} do
	conn =
	conn
	\|> assign(:token, nil)
	\|> post("/api/pleroma/delete_account")

	assert json_response_and_validate_schema(conn, 403) ==
	%{"error" => "Insufficient permissions: write:accounts."}
	end

	test "with proper permissions and wrong or missing password", %{conn: conn} do
	for params <- [%{"password" => "hi"}, %{}] do
	ret_conn = post(conn, "/api/pleroma/delete_account", params)

	assert json_response_and_validate_schema(ret_conn, 200) == %{
	"error" => "Invalid password."
	}
	end
	end

	test "with proper permissions and valid password", %{conn: conn, user: user} do
	conn = post(conn, "/api/pleroma/delete_account?password=test")
	ObanHelpers.perform_all()
	assert json_response_and_validate_schema(conn, 200) == %{"status" => "success"}

	user = User.get_by_id(user.id)
	refute user.is_active
	assert user.name == nil
	assert user.bio == ""
	assert user.password_hash == nil
	end
	end
	end

File Metadata

Mime Type: text/x-diff
Expires: Sat, Oct 31, 2:34 PM (13 h, 42 m)
Storage Engine: blob
Storage Format: Raw Data
Storage Handle: 1801513
Default Alt Text: (267 KB)

No OneTemporaryActions

View Options

File Metadata

Event Timeline

No OneTemporary
Actions