No OneTemporary
Actions

Size

565 KB

Referenced Files

None

Subscribers

None

View Options

This file is larger than 256 KB, so syntax highlighting was skipped.

	diff --git a/CHANGELOG.md b/CHANGELOG.md
	index 7a6931914..03d9b0a84 100644
	--- a/CHANGELOG.md
	+++ b/CHANGELOG.md
	@@ -1,543 +1,547 @@
	# Changelog
	All notable changes to this project will be documented in this file.

	The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/).

	## [Unreleased]
	### Removed
	- Breaking: Removed 1.0+ deprecated configurations `Pleroma.Upload, :strip_exif` and `:instance, :dedupe_media`
	- Breaking: OStatus protocol support
	- Breaking: MDII uploader
	- Breaking: Using third party engines for user recommendation
	<details>
	<summary>API Changes</summary>
	- Breaking: AdminAPI: migrate_from_db endpoint
	</details>

	### Changed
	- Breaking: Pleroma won't start if it detects unapplied migrations
	- Breaking: Elixir >=1.8 is now required (was >= 1.7)
	- Breaking: `Pleroma.Plugs.RemoteIp` and `:rate_limiter` enabled by default. Please ensure your reverse proxy forwards the real IP!
	- Breaking: attachment links (`config :pleroma, :instance, no_attachment_links` and `config :pleroma, Pleroma.Upload, link_name`) disabled by default
	- Breaking: OAuth: defaulted `[:auth, :enforce_oauth_admin_scope_usage]` setting to `true` which demands `admin` OAuth scope to perform admin actions (in addition to `is_admin` flag on User); make sure to use bundled or newer versions of AdminFE & PleromaFE to access admin / moderator features.
	- Breaking: Dynamic configuration has been rearchitected. The `:pleroma, :instance, dynamic_configuration` setting has been replaced with `config :pleroma, configurable_from_database`. Please backup your configuration to a file and run the migration task to ensure consistency with the new schema.
	- Breaking: `:instance, no_attachment_links` has been replaced with `:instance, attachment_links` which still takes a boolean value but doesn't use double negative language.
	- Refactoring: Introduced `Pleroma.Federation` context for federation related modules: `OStatus`, `ActivityPub`, `HTTPSignatures`, `WebFinger` and `NodeInfo`.
	- Refactoring: Clarified boundaries between `Pleroma` and `Pleroma.Web` contexts.
	- Replaced [pleroma_job_queue](https://git.pleroma.social/pleroma/pleroma_job_queue) and `Pleroma.Web.Federator.RetryQueue` with [Oban](https://github.com/sorentwo/oban) (see [`docs/config.md`](docs/config.md) on migrating customized worker / retry settings)
	- Introduced [quantum](https://github.com/quantum-elixir/quantum-core) job scheduler
	- Enabled `:instance, extended_nickname_format` in the default config
	- Add `rel="ugc"` to all links in statuses, to prevent SEO spam
	- Extract RSS functionality from OStatus
	- MRF (Simple Policy): Also use `:accept`/`:reject` on the actors rather than only their activities
	- OStatus: Extract RSS functionality
	- Deprecated `User.Info` embedded schema (fields moved to `User`)
	- Store status data inside Flag activity
	- Deprecated (reorganized as `UserRelationship` entity) User fields with user AP IDs (`blocks`, `mutes`, `muted_reblogs`, `muted_notifications`, `subscribers`).
	- Rate limiter is now disabled for localhost/socket (unless remoteip plug is enabled)
	- Logger: default log level changed from `warn` to `info`.
	- Config mix task `migrate_to_db` truncates `config` table before migrating the config file.
	<details>
	<summary>API Changes</summary>

	- Breaking EmojiReactions: Change endpoints and responses to align with Mastodon
	- Breaking Admin API: `PATCH /api/pleroma/admin/users/:nickname/force_password_reset` is now `PATCH /api/pleroma/admin/users/force_password_reset` (accepts `nicknames` array in the request body)
	- Breaking: Admin API: Return link alongside with token on password reset
	- Breaking: Admin API: `PUT /api/pleroma/admin/reports/:id` is now `PATCH /api/pleroma/admin/reports`, see admin_api.md for details
	- Breaking: `/api/pleroma/admin/users/invite_token` now uses `POST`, changed accepted params and returns full invite in json instead of only token string.
	- Breaking replying to reports is now "report notes", enpoint changed from `POST /api/pleroma/admin/reports/:id/respond` to `POST /api/pleroma/admin/reports/:id/notes`
	- Mastodon API: stopped sanitizing display names, field names and subject fields since they are supposed to be treated as plaintext
	- Admin API: Return `total` when querying for reports
	- Mastodon API: Return `pleroma.direct_conversation_id` when creating a direct message (`POST /api/v1/statuses`)
	- Admin API: Return link alongside with token on password reset
	- Admin API: Support authentication via `x-admin-token` HTTP header
	- Mastodon API: Add `pleroma.direct_conversation_id` to the status endpoint (`GET /api/v1/statuses/:id`)
	- Mastodon API: `pleroma.thread_muted` to the Status entity
	- Mastodon API: Mark the direct conversation as read for the author when they send a new direct message
	- Mastodon API, streaming: Add `pleroma.direct_conversation_id` to the `conversation` stream event payload.
	- Admin API: Render whole status in grouped reports
	- Mastodon API: User timelines will now respect blocks, unless you are getting the user timeline of somebody you blocked (which would be empty otherwise).
	- Mastodon API: Favoriting / Repeating a post multiple times will now return the identical response every time. Before, executing that action twice would return an error ("already favorited") on the second try.
	</details>

	### Added
	- `:chat_limit` option to limit chat characters.
	- `cleanup_attachments` option to remove attachments along with statuses. Does not affect duplicate files and attachments without status. Enabling this will increase load to database when deleting statuses on larger instances.
	- Refreshing poll results for remote polls
	- Authentication: Added rate limit for password-authorized actions / login existence checks
	- Static Frontend: Add the ability to render user profiles and notices server-side without requiring JS app.
	- Mix task to re-count statuses for all users (`mix pleroma.count_statuses`)
	- Mix task to list all users (`mix pleroma.user list`)
	- Mix task to send a test email (`mix pleroma.email test`)
	- Support for `X-Forwarded-For` and similar HTTP headers which used by reverse proxies to pass a real user IP address to the backend. Must not be enabled unless your instance is behind at least one reverse proxy (such as Nginx, Apache HTTPD or Varnish Cache).
	- MRF: New module which handles incoming posts based on their age. By default, all incoming posts that are older than 2 days will be unlisted and not shown to their followers.
	- User notification settings: Add `privacy_option` option.
	- Support for custom Elixir modules (such as MRF policies)
	- User settings: Add _This account is a_ option.
	- A new users admin digest email
	- OAuth: admin scopes support (relevant setting: `[:auth, :enforce_oauth_admin_scope_usage]`).
	- Add an option `authorized_fetch_mode` to require HTTP signatures for AP fetches.
	+- ActivityPub: support for `replies` collection (output for outgoing federation & fetching on incoming federation).
	+- Mix task to refresh counter cache (`mix pleroma.refresh_counter_cache`)
	<details>
	<summary>API Changes</summary>

	- Job queue stats to the healthcheck page
	- Admin API: Add ability to fetch reports, grouped by status `GET /api/pleroma/admin/grouped_reports`
	- Admin API: Add ability to require password reset
	- Mastodon API: Account entities now include `follow_requests_count` (planned Mastodon 3.x addition)
	- Pleroma API: `GET /api/v1/pleroma/accounts/:id/scrobbles` to get a list of recently scrobbled items
	- Pleroma API: `POST /api/v1/pleroma/scrobble` to scrobble a media item
	- Mastodon API: Add `upload_limit`, `avatar_upload_limit`, `background_upload_limit`, and `banner_upload_limit` to `/api/v1/instance`
	- Mastodon API: Add `pleroma.unread_conversation_count` to the Account entity
	- OAuth: support for hierarchical permissions / [Mastodon 2.4.3 OAuth permissions](https://docs.joinmastodon.org/api/permissions/)
	- Metadata Link: Atom syndication Feed
	- Mix task to re-count statuses for all users (`mix pleroma.count_statuses`)
	- Mastodon API: Add `exclude_visibilities` parameter to the timeline and notification endpoints
	- Admin API: `/users/:nickname/toggle_activation` endpoint is now deprecated in favor of: `/users/activate`, `/users/deactivate`, both accept `nicknames` array
	- Admin API: Multiple endpoints now require `nicknames` array, instead of singe `nickname`:
	- `POST/DELETE /api/pleroma/admin/users/:nickname/permission_group/:permission_group` are deprecated in favor of: `POST/DELETE /api/pleroma/admin/users/permission_group/:permission_group`
	- `DELETE /api/pleroma/admin/users` (`nickname` query param or `nickname` sent in JSON body) is deprecated in favor of: `DELETE /api/pleroma/admin/users` (`nicknames` query array param or `nicknames` sent in JSON body)
	- Admin API: Add `GET /api/pleroma/admin/relay` endpoint - lists all followed relays
	- Pleroma API: `POST /api/v1/pleroma/conversations/read` to mark all conversations as read
	- ActivityPub: Support `Move` activities
	- Mastodon API: Add `/api/v1/markers` for managing timeline read markers
	- Mastodon API: Add the `recipients` parameter to `GET /api/v1/conversations`
	- Configuration: `feed` option for user atom feed.
	- Pleroma API: Add Emoji reactions
	- Admin API: Add `/api/pleroma/admin/instances/:instance/statuses` - lists all statuses from a given instance
	- Admin API: `PATCH /api/pleroma/users/confirm_email` to confirm email for multiple users, `PATCH /api/pleroma/users/resend_confirmation_email` to resend confirmation email for multiple users
	- ActivityPub: Configurable `type` field of the actors.
	- Mastodon API: `/api/v1/accounts/:id` has `source/pleroma/actor_type` field.
	- Mastodon API: `/api/v1/update_credentials` accepts `actor_type` field.
	- Captcha: Support native provider
	- Captcha: Enable by default
	- Mastodon API: Add support for `account_id` param to filter notifications by the account
	- Mastodon API: Add `emoji_reactions` property to Statuses
	- Mastodon API: Change emoji reaction reply format
	- Notifications: Added `pleroma:emoji_reaction` notification type
	- Mastodon API: Change emoji reaction reply format once more
	- Configuration: `feed.logo` option for tag feed.
	- Tag feed: `/tags/:tag.rss` - list public statuses by hashtag.
	- Mastodon API: Add `reacted` property to `emoji_reactions`
	- Pleroma API: Add reactions for a single emoji.
	+- ActivityPub: `[:activitypub, :note_replies_output_limit]` setting sets the number of note self-replies to output on outgoing federation.
	+- Admin API: `GET /api/pleroma/admin/stats` to get status count by visibility scope
	</details>

	### Fixed
	- Report emails now include functional links to profiles of remote user accounts
	- Not being able to log in to some third-party apps when logged in to MastoFE
	- MRF: `Delete` activities being exempt from MRF policies
	- OTP releases: Not being able to configure OAuth expired token cleanup interval
	- OTP releases: Not being able to configure HTML sanitization policy
	- OTP releases: Not being able to change upload limit (again)
	- Favorites timeline now ordered by favorite date instead of post date
	- Support for cancellation of a follow request
	<details>
	<summary>API Changes</summary>

	- Mastodon API: Fix private and direct statuses not being filtered out from the public timeline for an authenticated user (`GET /api/v1/timelines/public`)
	- Mastodon API: Inability to get some local users by nickname in `/api/v1/accounts/:id_or_nickname`
	- AdminAPI: If some status received reports both in the "new" format and "old" format it was considered reports on two different statuses (in the context of grouped reports)
	- Admin API: Error when trying to update reports in the "old" format
	- Mastodon API: Marking a conversation as read (`POST /api/v1/conversations/:id/read`) now no longer brings it to the top in the user's direct conversation list
	</details>

	## [1.1.6] - 2019-11-19
	### Fixed
	- Not being able to log into to third party apps when the browser is logged into mastofe
	- Email confirmation not being required even when enabled
	- Mastodon API: conversations API crashing when one status is malformed

	### Bundled Pleroma-FE Changes
	#### Added
	- About page
	- Meme arrows

	#### Fixed
	- Image modal not closing unless clicked outside of image
	- Attachment upload spinner not being centered
	- Showing follow counters being 0 when they are actually hidden

	## [1.1.5] - 2019-11-09
	### Fixed
	- Polls having different numbers in timelines/notifications/poll api endpoints due to cache desyncronization
	- Pleroma API: OAuth token endpoint not being found when ".json" suffix is appended

	### Changed
	- Frontend bundle updated to [044c9ad0](https://git.pleroma.social/pleroma/pleroma-fe/commit/044c9ad0562af059dd961d50961a3880fca9c642)

	## [1.1.4] - 2019-11-01
	### Fixed
	- Added a migration that fills up empty user.info fields to prevent breakage after previous unsafe migrations.
	- Failure to migrate from pre-1.0.0 versions
	- Mastodon API: Notification stream not including follow notifications

	## [1.1.3] - 2019-10-25
	### Fixed
	- Blocked users showing up in notifications collapsed as if they were muted
	- `pleroma_ctl` not working on Debian's default shell

	## [1.1.2] - 2019-10-18
	### Fixed
	- `pleroma_ctl` trying to connect to a running instance when generating the config, which of course doesn't exist.

	## [1.1.1] - 2019-10-18
	### Fixed
	- One of the migrations between 1.0.0 and 1.1.0 wiping user info of the relay user because of unexpected behavior of postgresql's `jsonb_set`, resulting in inability to post in the default configuration. If you were affected, please run the following query in postgres console, the relay user will be recreated automatically:
	```
	delete from users where ap_id = 'https://your.instance.hostname/relay';
	```
	- Bad user search matches

	## [1.1.0] - 2019-10-14
	Breaking: The stable branch has been changed from `master` to `stable`. If you want to keep using 1.0, the `release/1.0` branch will receive security updates for 6 months after 1.1 release.

	OTP Note: `pleroma_ctl` in 1.0 defaults to `master` and doesn't support specifying arbitrary branches, making `./pleroma_ctl update` fail. To fix this, fetch a version of `pleroma_ctl` from 1.1 using the command below and proceed with the update normally:
	```
	curl -Lo ./bin/pleroma_ctl 'https://git.pleroma.social/pleroma/pleroma/raw/develop/rel/files/bin/pleroma_ctl'
	```
	### Security
	- Mastodon API: respect post privacy in `/api/v1/statuses/:id/{favourited,reblogged}_by`

	### Removed
	- Breaking: GNU Social API with Qvitter extensions support
	- Emoji: Remove longfox emojis.
	- Remove `Reply-To` header from report emails for admins.
	- ActivityPub: The `/objects/:uuid/likes` endpoint.

	### Changed
	- Breaking: Configuration: A setting to explicitly disable the mailer was added, defaulting to true, if you are using a mailer add `config :pleroma, Pleroma.Emails.Mailer, enabled: true` to your config
	- Breaking: Configuration: `/media/` is now removed when `base_url` is configured, append `/media/` to your `base_url` config to keep the old behaviour if desired
	- Breaking: `/api/pleroma/notifications/read` is moved to `/api/v1/pleroma/notifications/read` and now supports `max_id` and responds with Mastodon API entities.
	- Configuration: added `config/description.exs`, from which `docs/config.md` is generated
	- Configuration: OpenGraph and TwitterCard providers enabled by default
	- Configuration: Filter.AnonymizeFilename added ability to retain file extension with custom text
	- Federation: Return 403 errors when trying to request pages from a user's follower/following collections if they have `hide_followers`/`hide_follows` set
	- NodeInfo: Return `skipThreadContainment` in `metadata` for the `skip_thread_containment` option
	- NodeInfo: Return `mailerEnabled` in `metadata`
	- Mastodon API: Unsubscribe followers when they unfollow a user
	- Mastodon API: `pleroma.thread_muted` key in the Status entity
	- AdminAPI: Add "godmode" while fetching user statuses (i.e. admin can see private statuses)
	- Improve digest email template
	– Pagination: (optional) return `total` alongside with `items` when paginating
	- The `Pleroma.FlakeId` module has been replaced with the `flake_id` library.

	### Fixed
	- Following from Osada
	- Favorites timeline doing database-intensive queries
	- Metadata rendering errors resulting in the entire page being inaccessible
	- `federation_incoming_replies_max_depth` option being ignored in certain cases
	- Mastodon API: Handling of search timeouts (`/api/v1/search` and `/api/v2/search`)
	- Mastodon API: Misskey's endless polls being unable to render
	- Mastodon API: Embedded relationships not being properly rendered in the Account entity of Status entity
	- Mastodon API: Notifications endpoint crashing if one notification failed to render
	- Mastodon API: `exclude_replies` is correctly handled again.
	- Mastodon API: Add `account_id`, `type`, `offset`, and `limit` to search API (`/api/v1/search` and `/api/v2/search`)
	- Mastodon API, streaming: Fix filtering of notifications based on blocks/mutes/thread mutes
	- Mastodon API: Fix private and direct statuses not being filtered out from the public timeline for an authenticated user (`GET /api/v1/timelines/public`)
	- Mastodon API: Ensure the `account` field is not empty when rendering Notification entities.
	- Mastodon API: Inability to get some local users by nickname in `/api/v1/accounts/:id_or_nickname`
	- Mastodon API: Blocks are now treated consistently between the Streaming API and the Timeline APIs
	- Rich Media: Parser failing when no TTL can be found by image TTL setters
	- Rich Media: The crawled URL is now spliced into the rich media data.
	- ActivityPub S2S: sharedInbox usage has been mostly aligned with the rules in the AP specification.
	- ActivityPub C2S: follower/following collection pages being inaccessible even when authentifucated if `hide_followers`/ `hide_follows` was set
	- ActivityPub: Deactivated user deletion
	- ActivityPub: Fix `/users/:nickname/inbox` crashing without an authenticated user
	- MRF: fix ability to follow a relay when AntiFollowbotPolicy was enabled
	- ActivityPub: Correct addressing of Undo.
	- ActivityPub: Correct addressing of profile update activities.
	- ActivityPub: Polls are now refreshed when necessary.
	- Report emails now include functional links to profiles of remote user accounts
	- Existing user id not being preserved on insert conflict
	- Pleroma.Upload base_url was not automatically whitelisted by MediaProxy. Now your custom CDN or file hosting will be accessed directly as expected.
	- Report email not being sent to admins when the reporter is a remote user
	- Reverse Proxy limiting `max_body_length` was incorrectly defined and only checked `Content-Length` headers which may not be sufficient in some circumstances

	### Added
	- Expiring/ephemeral activites. All activities can have expires_at value set, which controls when they should be deleted automatically.
	- Mastodon API: in post_status, the expires_in parameter lets you set the number of seconds until an activity expires. It must be at least one hour.
	- Mastodon API: all status JSON responses contain a `pleroma.expires_at` item which states when an activity will expire. The value is only shown to the user who created the activity. To everyone else it's empty.
	- Configuration: `ActivityExpiration.enabled` controls whether expired activites will get deleted at the appropriate time. Enabled by default.
	- Conversations: Add Pleroma-specific conversation endpoints and status posting extensions. Run the `bump_all_conversations` task again to create the necessary data.
	- MRF: Support for priming the mediaproxy cache (`Pleroma.Web.ActivityPub.MRF.MediaProxyWarmingPolicy`)
	- MRF: Support for excluding specific domains from Transparency.
	- MRF: Support for filtering posts based on who they mention (`Pleroma.Web.ActivityPub.MRF.MentionPolicy`)
	- Mastodon API: Support for the [`tagged` filter](https://github.com/tootsuite/mastodon/pull/9755) in [`GET /api/v1/accounts/:id/statuses`](https://docs.joinmastodon.org/api/rest/accounts/#get-api-v1-accounts-id-statuses)
	- Mastodon API, streaming: Add support for passing the token in the `Sec-WebSocket-Protocol` header
	- Mastodon API, extension: Ability to reset avatar, profile banner, and background
	- Mastodon API: Add support for `fields_attributes` API parameter (setting custom fields)
	- Mastodon API: Add support for categories for custom emojis by reusing the group feature. <https://github.com/tootsuite/mastodon/pull/11196>
	- Mastodon API: Add support for muting/unmuting notifications
	- Mastodon API: Add support for the `blocked_by` attribute in the relationship API (`GET /api/v1/accounts/relationships`). <https://github.com/tootsuite/mastodon/pull/10373>
	- Mastodon API: Add support for the `domain_blocking` attribute in the relationship API (`GET /api/v1/accounts/relationships`).
	- Mastodon API: Add `pleroma.deactivated` to the Account entity
	- Mastodon API: added `/auth/password` endpoint for password reset with rate limit.
	- Mastodon API: /api/v1/accounts/:id/statuses now supports nicknames or user id
	- Mastodon API: Improve support for the user profile custom fields
	- Mastodon API: Add support for `fields_attributes` API parameter (setting custom fields)
	- Mastodon API: Added an endpoint to get multiple statuses by IDs (`GET /api/v1/statuses/?ids[]=1&ids[]=2`)
	- Admin API: Return users' tags when querying reports
	- Admin API: Return avatar and display name when querying users
	- Admin API: Allow querying user by ID
	- Admin API: Added support for `tuples`.
	- Admin API: Added endpoints to run mix tasks pleroma.config migrate_to_db & pleroma.config migrate_from_db
	- Added synchronization of following/followers counters for external users
	- Configuration: `enabled` option for `Pleroma.Emails.Mailer`, defaulting to `false`.
	- Configuration: Pleroma.Plugs.RateLimiter `bucket_name`, `params` options.
	- Configuration: `user_bio_length` and `user_name_length` options.
	- Addressable lists
	- Twitter API: added rate limit for `/api/account/password_reset` endpoint.
	- ActivityPub: Add an internal service actor for fetching ActivityPub objects.
	- ActivityPub: Optional signing of ActivityPub object fetches.
	- Admin API: Endpoint for fetching latest user's statuses
	- Pleroma API: Add `/api/v1/pleroma/accounts/confirmation_resend?email=<email>` for resending account confirmation.
	- Pleroma API: Email change endpoint.
	- Admin API: Added moderation log
	- Web response cache (currently, enabled for ActivityPub)
	- Reverse Proxy: Do not retry failed requests to limit pressure on the peer

	### Changed
	- Configuration: Filter.AnonymizeFilename added ability to retain file extension with custom text
	- Admin API: changed json structure for saving config settings.
	- RichMedia: parsers and their order are configured in `rich_media` config.
	- RichMedia: add the rich media ttl based on image expiration time.

	## [1.0.7] - 2019-09-26
	### Fixed
	- Broken federation on Erlang 22 (previous versions of hackney http client were using an option that got deprecated)
	### Changed
	- ActivityPub: The first page in inboxes/outboxes is no longer embedded.

	## [1.0.6] - 2019-08-14
	### Fixed
	- MRF: fix use of unserializable keyword lists in describe() implementations
	- ActivityPub S2S: POST requests are now signed with `(request-target)` pseudo-header.

	## [1.0.5] - 2019-08-13
	### Fixed
	- Mastodon API: follower/following counters not being nullified, when `hide_follows`/`hide_followers` is set
	- Mastodon API: `muted` in the Status entity, using author's account to determine if the thread was muted
	- Mastodon API: return the actual profile URL in the Account entity's `url` property when appropriate
	- Templates: properly style anchor tags
	- Objects being re-embedded to activities after being updated (e.g faved/reposted). Running 'mix pleroma.database prune_objects' again is advised.
	- Not being able to access the Mastodon FE login page on private instances
	- MRF: ensure that subdomain_match calls are case-insensitive
	- Fix internal server error when using the healthcheck API.

	### Added
	- Breaking: MRF describe API, which adds support for exposing configuration information about MRF policies to NodeInfo.
	Custom modules will need to be updated by adding, at the very least, `def describe, do: {:ok, %{}}` to the MRF policy modules.
	- Relays: Added a task to list relay subscriptions.
	- MRF: Support for filtering posts based on ActivityStreams vocabulary (`Pleroma.Web.ActivityPub.MRF.VocabularyPolicy`)
	- MRF (Simple Policy): Support for wildcard domains.
	- Support for wildcard domains in user domain blocks setting.
	- Configuration: `quarantined_instances` support wildcard domains.
	- Mix Tasks: `mix pleroma.database fix_likes_collections`
	- Configuration: `federation_incoming_replies_max_depth` option

	### Removed
	- Federation: Remove `likes` from objects.
	- Breaking: ActivityPub: The `accept_blocks` configuration setting.

	## [1.0.4] - 2019-08-01
	### Fixed
	- Invalid SemVer version generation, when the current branch does not have commits ahead of tag/checked out on a tag

	## [1.0.3] - 2019-07-31
	### Security
	- OStatus: eliminate the possibility of a protocol downgrade attack.
	- OStatus: prevent following locked accounts, bypassing the approval process.
	- TwitterAPI: use CommonAPI to handle remote follows instead of OStatus.

	## [1.0.2] - 2019-07-28
	### Fixed
	- Not being able to pin unlisted posts
	- Mastodon API: represent poll IDs as strings
	- MediaProxy: fix matching filenames
	- MediaProxy: fix filename encoding
	- Migrations: fix a sporadic migration failure
	- Metadata rendering errors resulting in the entire page being inaccessible
	- Federation/MediaProxy not working with instances that have wrong certificate order
	- ActivityPub S2S: remote user deletions now work the same as local user deletions.

	### Changed
	- Configuration: OpenGraph and TwitterCard providers enabled by default
	- Configuration: Filter.AnonymizeFilename added ability to retain file extension with custom text

	## [1.0.1] - 2019-07-14
	### Security
	- OStatus: fix an object spoofing vulnerability.

	## [1.0.0] - 2019-06-29
	### Security
	- Mastodon API: Fix display names not being sanitized
	- Rich media: Do not crawl private IP ranges

	### Added
	- Digest email for inactive users
	- Add a generic settings store for frontends / clients to use.
	- Explicit addressing option for posting.
	- Optional SSH access mode. (Needs `erlang-ssh` package on some distributions).
	- [MongooseIM](https://github.com/esl/MongooseIM) http authentication support.
	- LDAP authentication
	- External OAuth provider authentication
	- Support for building a release using [`mix release`](https://hexdocs.pm/mix/master/Mix.Tasks.Release.html)
	- A [job queue](https://git.pleroma.social/pleroma/pleroma_job_queue) for federation, emails, web push, etc.
	- [Prometheus](https://prometheus.io/) metrics
	- Support for Mastodon's remote interaction
	- Mix Tasks: `mix pleroma.database bump_all_conversations`
	- Mix Tasks: `mix pleroma.database remove_embedded_objects`
	- Mix Tasks: `mix pleroma.database update_users_following_followers_counts`
	- Mix Tasks: `mix pleroma.user toggle_confirmed`
	- Mix Tasks: `mix pleroma.config migrate_to_db`
	- Mix Tasks: `mix pleroma.config migrate_from_db`
	- Federation: Support for `Question` and `Answer` objects
	- Federation: Support for reports
	- Configuration: `poll_limits` option
	- Configuration: `pack_extensions` option
	- Configuration: `safe_dm_mentions` option
	- Configuration: `link_name` option
	- Configuration: `fetch_initial_posts` option
	- Configuration: `notify_email` option
	- Configuration: Media proxy `whitelist` option
	- Configuration: `report_uri` option
	- Configuration: `email_notifications` option
	- Configuration: `limit_to_local_content` option
	- Pleroma API: User subscriptions
	- Pleroma API: Healthcheck endpoint
	- Pleroma API: `/api/v1/pleroma/mascot` per-user frontend mascot configuration endpoints
	- Admin API: Endpoints for listing/revoking invite tokens
	- Admin API: Endpoints for making users follow/unfollow each other
	- Admin API: added filters (role, tags, email, name) for users endpoint
	- Admin API: Endpoints for managing reports
	- Admin API: Endpoints for deleting and changing the scope of individual reported statuses
	- Admin API: Endpoints to view and change config settings.
	- AdminFE: initial release with basic user management accessible at /pleroma/admin/
	- Mastodon API: Add chat token to `verify_credentials` response
	- Mastodon API: Add background image setting to `update_credentials`
	- Mastodon API: [Scheduled statuses](https://docs.joinmastodon.org/api/rest/scheduled-statuses/)
	- Mastodon API: `/api/v1/notifications/destroy_multiple` (glitch-soc extension)
	- Mastodon API: `/api/v1/pleroma/accounts/:id/favourites` (API extension)
	- Mastodon API: [Reports](https://docs.joinmastodon.org/api/rest/reports/)
	- Mastodon API: `POST /api/v1/accounts` (account creation API)
	- Mastodon API: [Polls](https://docs.joinmastodon.org/api/rest/polls/)
	- ActivityPub C2S: OAuth endpoints
	- Metadata: RelMe provider
	- OAuth: added support for refresh tokens
	- Emoji packs and emoji pack manager
	- Object pruning (`mix pleroma.database prune_objects`)
	- OAuth: added job to clean expired access tokens
	- MRF: Support for rejecting reports from specific instances (`mrf_simple`)
	- MRF: Support for stripping avatars and banner images from specific instances (`mrf_simple`)
	- MRF: Support for running subchains.
	- Configuration: `skip_thread_containment` option
	- Configuration: `rate_limit` option. See `Pleroma.Plugs.RateLimiter` documentation for details.
	- MRF: Support for filtering out likely spam messages by rejecting posts from new users that contain links.
	- Configuration: `ignore_hosts` option
	- Configuration: `ignore_tld` option
	- Configuration: default syslog tag "Pleroma" is now lowercased to "pleroma"

	### Changed
	- Breaking: bind to 127.0.0.1 instead of 0.0.0.0 by default
	- Breaking: Configuration: move from Pleroma.Mailer to Pleroma.Emails.Mailer
	- Thread containment / test for complete visibility will be skipped by default.
	- Enforcement of OAuth scopes
	- Add multiple use/time expiring invite token
	- Restyled OAuth pages to fit with Pleroma's default theme
	- Link/mention/hashtag detection is now handled by [auto_linker](https://git.pleroma.social/pleroma/auto_linker)
	- NodeInfo: Return `safe_dm_mentions` feature flag
	- Federation: Expand the audience of delete activities to all recipients of the deleted object
	- Federation: Removed `inReplyToStatusId` from objects
	- Configuration: Dedupe enabled by default
	- Configuration: Default log level in `prod` environment is now set to `warn`
	- Configuration: Added `extra_cookie_attrs` for setting non-standard cookie attributes. Defaults to ["SameSite=Lax"] so that remote follows work.
	- Timelines: Messages involving people you have blocked will be excluded from the timeline in all cases instead of just repeats.
	- Admin API: Move the user related API to `api/pleroma/admin/users`
	- Admin API: `POST /api/pleroma/admin/users` will take list of users
	- Pleroma API: Support for emoji tags in `/api/pleroma/emoji` resulting in a breaking API change
	- Mastodon API: Support for `exclude_types`, `limit` and `min_id` in `/api/v1/notifications`
	- Mastodon API: Add `languages` and `registrations` to `/api/v1/instance`
	- Mastodon API: Provide plaintext versions of cw/content in the Status entity
	- Mastodon API: Add `pleroma.conversation_id`, `pleroma.in_reply_to_account_acct` fields to the Status entity
	- Mastodon API: Add `pleroma.tags`, `pleroma.relationship{}`, `pleroma.is_moderator`, `pleroma.is_admin`, `pleroma.confirmation_pending`, `pleroma.hide_followers`, `pleroma.hide_follows`, `pleroma.hide_favorites` fields to the User entity
	- Mastodon API: Add `pleroma.show_role`, `pleroma.no_rich_text` fields to the Source subentity
	- Mastodon API: Add support for updating `no_rich_text`, `hide_followers`, `hide_follows`, `hide_favorites`, `show_role` in `PATCH /api/v1/update_credentials`
	- Mastodon API: Add `pleroma.is_seen` to the Notification entity
	- Mastodon API: Add `pleroma.local` to the Status entity
	- Mastodon API: Add `preview` parameter to `POST /api/v1/statuses`
	- Mastodon API: Add `with_muted` parameter to timeline endpoints
	- Mastodon API: Actual reblog hiding instead of a dummy
	- Mastodon API: Remove attachment limit in the Status entity
	- Mastodon API: Added support max_id & since_id for bookmark timeline endpoints.
	- Deps: Updated Cowboy to 2.6
	- Deps: Updated Ecto to 3.0.7
	- Don't ship finmoji by default, they can be installed as an emoji pack
	- Hide deactivated users and their statuses
	- Posts which are marked sensitive or tagged nsfw no longer have link previews.
	- HTTP connection timeout is now set to 10 seconds.
	- Respond with a 404 Not implemented JSON error message when requested API is not implemented
	- Rich Media: crawl only https URLs.

	### Fixed
	- Follow requests don't get 'stuck' anymore.
	- Added an FTS index on objects. Running `vacuum analyze` and setting a larger `work_mem` is recommended.
	- Followers counter not being updated when a follower is blocked
	- Deactivated users being able to request an access token
	- Limit on request body in rich media/relme parsers being ignored resulting in a possible memory leak
	- Proper Twitter Card generation instead of a dummy
	- Deletions failing for users with a large number of posts
	- NodeInfo: Include admins in `staffAccounts`
	- ActivityPub: Crashing when requesting empty local user's outbox
	- Federation: Handling of objects without `summary` property
	- Federation: Add a language tag to activities as required by ActivityStreams 2.0
	- Federation: Do not federate avatar/banner if set to default allowing other servers/clients to use their defaults
	- Federation: Cope with missing or explicitly nulled address lists
	- Federation: Explicitly ensure activities addressed to `as:Public` become addressed to the followers collection
	- Federation: Better cope with actors which do not declare a followers collection and use `as:Public` with these semantics
	- Federation: Follow requests from remote users who have been blocked will be automatically rejected if appropriate
	- MediaProxy: Parse name from content disposition headers even for non-whitelisted types
	- MediaProxy: S3 link encoding
	- Rich Media: Reject any data which cannot be explicitly encoded into JSON
	- Pleroma API: Importing follows from Mastodon 2.8+
	- Twitter API: Exposing default scope, `no_rich_text` of the user to anyone
	- Twitter API: Returning the `role` object in user entity despite `show_role = false`
	- Mastodon API: `/api/v1/favourites` serving only public activities
	- Mastodon API: Reblogs having `in_reply_to_id` - `null` even when they are replies
	- Mastodon API: Streaming API broadcasting wrong activity id
	- Mastodon API: 500 errors when requesting a card for a private conversation
	- Mastodon API: Handling of `reblogs` in `/api/v1/accounts/:id/follow`
	- Mastodon API: Correct `reblogged`, `favourited`, and `bookmarked` values in the reblog status JSON
	- Mastodon API: Exposing default scope of the user to anyone
	- Mastodon API: Make `irreversible` field default to `false` [`POST /api/v1/filters`]
	- Mastodon API: Replace missing non-nullable Card attributes with empty strings
	- User-Agent is now sent correctly for all HTTP requests.
	- MRF: Simple policy now properly delists imported or relayed statuses

	## Removed
	- Configuration: `config :pleroma, :fe` in favor of the more flexible `config :pleroma, :frontend_configurations`

	## [0.9.99999] - 2019-05-31
	### Security
	- Mastodon API: Fix lists leaking private posts

	## [0.9.9999] - 2019-04-05
	### Security
	- Mastodon API: Fix content warnings skipping HTML sanitization

	## [0.9.999] - 2019-03-13
	Frontend changes only.
	### Added
	- Added floating action button for posting status on mobile
	### Changed
	- Changed user-settings icon to a pencil
	### Fixed
	- Keyboard shortcuts activating when typing a message
	- Gaps when scrolling down on a timeline after showing new

	## [0.9.99] - 2019-03-08
	### Changed
	- Update the frontend to the 0.9.99 tag
	### Fixed
	- Sign the date header in federation to fix Mastodon federation.

	## [0.9.9] - 2019-02-22
	This is our first stable release.
	diff --git a/config/config.exs b/config/config.exs
	index 9b8b81ce5..fd57b6b99 100644
	--- a/config/config.exs
	+++ b/config/config.exs
	@@ -1,624 +1,628 @@
	# .i;;;;i.
	# iYcviii;vXY:
	# .YXi .i1c.
	# .YC. . in7.
	# .vc. ...... ;1c.
	# i7, .. .;1;
	# i7, .. ... .Y1i
	# ,7v .6MMM@; .YX,
	# .7;. ..IMMMMMM1 :t7.
	# .;Y. ;$MMMMMM9. :tc.
	# vY. .. .nMMM@MMU. ;1v.
	# i7i ... .#MM@M@C. .....:71i
	# it: .... $MMM@9;.,i;;;i,;tti
	# :t7. ..... 0MMMWv.,iii:::,,;St.
	# .nC. ..... IMMMQ..,::::::,.,czX.
	# .ct: ....... .ZMMMI..,:::::::,,:76Y.
	# c2: ......,i..Y$M@t..:::::::,,..inZY
	# vov ......:ii..c$MBc..,,,,,,,,,,..iI9i
	# i9Y ......iii:..7@MA,..,,,,,,,,,....;AA:
	# iIS. ......:ii::..;@MI....,............;Ez.
	# .I9. ......:i::::...8M1..................C0z.
	# .z9; ......:i::::,.. .i:...................zWX.
	# vbv ......,i::::,,. ................. :AQY
	# c6Y. .,...,::::,,..:t0@@QY. ................ :8bi
	# :6S. ..,,...,:::,,,..EMMMMMMI. ............... .;bZ,
	# :6o, .,,,,..:::,,,..i#MMMMMM#v................. YW2.
	# .n8i ..,,,,,,,::,,,,.. tMMMMM@C:.................. .1Wn
	# 7Uc. .:::,,,,,::,,,,.. i1t;,..................... .UEi
	# 7C...::::::::::::,,,,.. .................... vSi.
	# ;1;...,,::::::,......... .................. Yz:
	# v97,......... .voC.
	# izAotX7777777777777777777777777777777777777777Y7n92:
	# .;CoIIIIIUAA666666699999ZZZZZZZZZZZZZZZZZZZZ6ov.
	#
	# !!! ATTENTION !!!
	# DO NOT EDIT THIS FILE! THIS FILE CONTAINS THE DEFAULT VALUES FOR THE CON-
	# FIGURATION! EDIT YOUR SECRET FILE (either prod.secret.exs, dev.secret.exs).
	#
	# This file is responsible for configuring your application
	# and its dependencies with the aid of the Mix.Config module.
	#
	# This configuration file is loaded before any dependency and
	# is restricted to this project.
	use Mix.Config

	# General application configuration
	config :pleroma, ecto_repos: [Pleroma.Storage.Repo]

	config :pleroma, Pleroma.Storage.Repo,
	types: Pleroma.Storage.PostgresTypes,
	telemetry_event: [Pleroma.Storage.Repo.Instrumenter],
	migration_lock: nil

	config :pleroma, Pleroma.Captcha,
	enabled: true,
	seconds_valid: 300,
	method: Pleroma.Captcha.Native

	config :pleroma, Pleroma.Captcha.Kocaptcha, endpoint: "https://captcha.kotobank.ch"

	config :pleroma, :hackney_pools,
	federation: [
	max_connections: 50,
	timeout: 150_000
	],
	media: [
	max_connections: 50,
	timeout: 150_000
	],
	upload: [
	max_connections: 25,
	timeout: 300_000
	]

	# Upload configuration
	config :pleroma, Pleroma.Upload,
	uploader: Pleroma.Upload.Uploader.Local,
	filters: [Pleroma.Upload.Filter.Dedupe],
	link_name: false,
	proxy_remote: false,
	proxy_opts: [
	redirect_on_failure: false,
	max_body_length: 25 * 1_048_576,
	http: [
	follow_redirect: true,
	pool: :upload
	]
	]

	config :pleroma, Pleroma.Upload.Uploader.Local, uploads: "uploads"

	config :pleroma, Pleroma.Upload.Uploader.S3,
	bucket: nil,
	streaming_enabled: true,
	public_endpoint: "https://s3.amazonaws.com"

	config :pleroma, :emoji,
	shortcode_globs: ["/emoji/custom/*/.png"],
	pack_extensions: [".png", ".gif"],
	groups: [
	Custom: ["/emoji/.png", "/emoji//.png"]
	],
	default_manifest: "https://git.pleroma.social/pleroma/emoji-index/raw/master/index.json",
	shared_pack_cache_seconds_per_file: 60

	config :pleroma, :uri_schemes,
	valid_schemes: [
	"https",
	"http",
	"dat",
	"dweb",
	"gopher",
	"ipfs",
	"ipns",
	"irc",
	"ircs",
	"magnet",
	"mailto",
	"mumble",
	"ssb",
	"xmpp"
	]

	websocket_config = [
	path: "/websocket",
	serializer: [
	{Phoenix.Socket.V1.JSONSerializer, "~> 1.0.0"},
	{Phoenix.Socket.V2.JSONSerializer, "~> 2.0.0"}
	],
	timeout: 60_000,
	transport_log: false,
	compress: false
	]

	# Configures the endpoint
	config :pleroma, Pleroma.Web.Endpoint,
	instrumenters: [Pleroma.Web.Endpoint.Instrumenter],
	url: [host: "localhost"],
	http: [
	ip: {127, 0, 0, 1},
	dispatch: [
	{:_,
	[
	{"/api/v1/streaming", Pleroma.Web.MastodonAPI.WebsocketHandler, []},
	{"/websocket", Phoenix.Endpoint.CowboyWebSocket,
	{Phoenix.Transports.WebSocket,
	{Pleroma.Web.Endpoint, Pleroma.Web.UserSocket, websocket_config}}},
	{:_, Phoenix.Endpoint.Cowboy2Handler, {Pleroma.Web.Endpoint, []}}
	]}
	]
	],
	protocol: "https",
	secret_key_base: "aK4Abxf29xU9TTDKre9coZPUgevcVCFQJe/5xP/7Lt4BEif6idBIbjupVbOrbKxl",
	signing_salt: "CqaoopA2",
	render_errors: [view: Pleroma.Web.ErrorView, accepts: ~w(json)],
	pubsub: [name: Pleroma.PubSub, adapter: Phoenix.PubSub.PG2],
	secure_cookie_flag: true,
	extra_cookie_attrs: [
	"SameSite=Lax"
	]

	# Configures Elixir's Logger
	config :logger, :console,
	level: :debug,
	format: "\n$time $metadata[$level] $message\n",
	metadata: [:request_id]

	config :logger, :ex_syslogger,
	level: :debug,
	ident: "pleroma",
	format: "$metadata[$level] $message",
	metadata: [:request_id]

	config :quack,
	level: :warn,
	meta: [:all],
	webhook_url: "https://hooks.slack.com/services/YOUR-KEY-HERE"

	config :mime, :types, %{
	"application/xml" => ["xml"],
	"application/xrd+xml" => ["xrd+xml"],
	"application/jrd+json" => ["jrd+json"],
	"application/activity+json" => ["activity+json"],
	"application/ld+json" => ["activity+json"]
	}

	config :tesla, adapter: Tesla.Adapter.Hackney

	# Configures http settings, upstream proxy etc.
	config :pleroma, :http,
	proxy_url: nil,
	send_user_agent: true,
	user_agent: :default,
	adapter: [
	ssl_options: [
	# Workaround for remote server certificate chain issues
	partial_chain: &:hackney_connect.partial_chain/1,
	# We don't support TLS v1.3 yet
	versions: [:tlsv1, :"tlsv1.1", :"tlsv1.2"]
	]
	]

	config :pleroma, :instance,
	name: "Pleroma",
	email: "example@example.com",
	notify_email: "noreply@example.com",
	description: "A Pleroma instance, an alternative fediverse server",
	limit: 5_000,
	chat_limit: 5_000,
	remote_limit: 100_000,
	upload_limit: 16_000_000,
	avatar_upload_limit: 2_000_000,
	background_upload_limit: 4_000_000,
	banner_upload_limit: 4_000_000,
	poll_limits: %{
	max_options: 20,
	max_option_chars: 200,
	min_expiration: 0,
	max_expiration: 365 * 24 * 60 * 60
	},
	registrations_open: true,
	+ invites_enabled: false,
	+ account_activation_required: false,
	federating: true,
	federation_incoming_replies_max_depth: 100,
	federation_reachability_timeout_days: 7,
	federation_publisher_modules: [
	Pleroma.Web.ActivityPub.Publisher
	],
	allow_relay: true,
	rewrite_policy: Pleroma.Federation.ActivityPub.MRF.NoOpPolicy,
	public: true,
	quarantined_instances: [],
	managed_config: true,
	static_dir: "instance/static/",
	allowed_post_formats: [
	"text/plain",
	"text/html",
	"text/markdown",
	"text/bbcode"
	],
	mrf_transparency: true,
	mrf_transparency_exclusions: [],
	autofollowed_nicknames: [],
	max_pinned_statuses: 1,
	attachment_links: false,
	welcome_user_nickname: nil,
	welcome_message: nil,
	max_report_comment_size: 1000,
	safe_dm_mentions: false,
	healthcheck: false,
	remote_post_retention_days: 90,
	skip_thread_containment: true,
	limit_to_local_content: :unauthenticated,
	user_bio_length: 5000,
	user_name_length: 100,
	max_account_fields: 10,
	max_remote_account_fields: 20,
	account_field_name_length: 512,
	account_field_value_length: 2048,
	external_user_synchronization: true,
	extended_nickname_format: true,
	cleanup_attachments: false

	config :pleroma, :feed,
	post_title: %{
	max_length: 100,
	omission: "..."
	}

	config :pleroma, :markup,
	# XXX - unfortunately, inline images must be enabled by default right now, because
	# of custom emoji. Issue #275 discusses defanging that somehow.
	allow_inline_images: true,
	allow_headings: false,
	allow_tables: false,
	allow_fonts: false,
	scrub_policy: [
	Pleroma.HTML.Scrubber.Default,
	Pleroma.HTML.Transform.MediaProxy
	]

	config :pleroma, :frontend_configurations,
	pleroma_fe: %{
	theme: "pleroma-dark",
	logo: "/static/logo.png",
	background: "/images/city.jpg",
	redirectRootNoLogin: "/main/all",
	redirectRootLogin: "/main/friends",
	showInstanceSpecificPanel: true,
	scopeOptionsEnabled: false,
	formattingOptionsEnabled: false,
	collapseMessageWithSubject: false,
	hidePostStats: false,
	hideUserStats: false,
	scopeCopy: true,
	subjectLineBehavior: "email",
	alwaysShowSubjectInput: true
	},
	masto_fe: %{
	showInstanceSpecificPanel: true
	}

	config :pleroma, :assets,
	mascots: [
	pleroma_fox_tan: %{
	url: "/images/pleroma-fox-tan-smol.png",
	mime_type: "image/png"
	},
	pleroma_fox_tan_shy: %{
	url: "/images/pleroma-fox-tan-shy.png",
	mime_type: "image/png"
	}
	],
	default_mascot: :pleroma_fox_tan

	config :pleroma, :manifest,
	icons: [
	%{
	src: "/static/logo.png",
	type: "image/png"
	}
	],
	theme_color: "#282c37",
	background_color: "#191b22"

	config :pleroma, :activitypub,
	unfollow_blocked: true,
	outgoing_blocks: true,
	follow_handshake_timeout: 500,
	+ note_replies_output_limit: 5,
	sign_object_fetches: true,
	authorized_fetch_mode: false

	config :pleroma, :streamer,
	workers: 3,
	overflow_workers: 2

	config :pleroma, :user, deny_follow_blocked: true

	config :pleroma, :mrf_normalize_markup, scrub_policy: Pleroma.HTML.Scrubber.Default

	config :pleroma, :mrf_rejectnonpublic,
	allow_followersonly: false,
	allow_direct: false

	config :pleroma, :mrf_hellthread,
	delist_threshold: 10,
	reject_threshold: 20

	config :pleroma, :mrf_simple,
	media_removal: [],
	media_nsfw: [],
	federated_timeline_removal: [],
	report_removal: [],
	reject: [],
	accept: [],
	avatar_removal: [],
	banner_removal: []

	config :pleroma, :mrf_keyword,
	reject: [],
	federated_timeline_removal: [],
	replace: []

	config :pleroma, :mrf_subchain, match_actor: %{}

	config :pleroma, :mrf_vocabulary,
	accept: [],
	reject: []

	config :pleroma, :mrf_object_age,
	threshold: 172_800,
	actions: [:delist, :strip_followers]

	config :pleroma, :rich_media,
	enabled: true,
	ignore_hosts: [],
	ignore_tld: ["local", "localdomain", "lan"],
	parsers: [
	Pleroma.Web.RichMedia.Parsers.TwitterCard,
	Pleroma.Web.RichMedia.Parsers.OGP,
	Pleroma.Web.RichMedia.Parsers.OEmbed
	],
	ttl_setters: [Pleroma.Web.RichMedia.Parser.TTL.AwsSignedUrl]

	config :pleroma, :media_proxy,
	enabled: false,
	proxy_opts: [
	redirect_on_failure: false,
	max_body_length: 25 * 1_048_576,
	http: [
	follow_redirect: true,
	pool: :media
	]
	],
	whitelist: []

	config :pleroma, :chat, enabled: true

	config :phoenix, :format_encoders, json: Jason

	config :phoenix, :json_library, Jason

	config :pleroma, :gopher,
	enabled: false,
	ip: {0, 0, 0, 0},
	port: 9999

	config :pleroma, Pleroma.Web.Metadata,
	providers: [
	Pleroma.Web.Metadata.Providers.OpenGraph,
	Pleroma.Web.Metadata.Providers.TwitterCard,
	Pleroma.Web.Metadata.Providers.RelMe,
	Pleroma.Web.Metadata.Providers.Feed
	],
	unfurl_nsfw: false

	config :pleroma, :http_security,
	enabled: true,
	sts: false,
	sts_max_age: 31_536_000,
	ct_max_age: 2_592_000,
	referrer_policy: "same-origin"

	config :cors_plug,
	max_age: 86_400,
	methods: ["POST", "PUT", "DELETE", "GET", "PATCH", "OPTIONS"],
	expose: [
	"Link",
	"X-RateLimit-Reset",
	"X-RateLimit-Limit",
	"X-RateLimit-Remaining",
	"X-Request-Id",
	"Idempotency-Key"
	],
	credentials: true,
	headers: ["Authorization", "Content-Type", "Idempotency-Key"]

	config :pleroma, Pleroma.User,
	restricted_nicknames: [
	".well-known",
	"~",
	"about",
	"activities",
	"api",
	"auth",
	"check_password",
	"dev",
	"friend-requests",
	"inbox",
	"internal",
	"main",
	"media",
	"nodeinfo",
	"notice",
	"oauth",
	"objects",
	"ostatus_subscribe",
	"pleroma",
	"proxy",
	"push",
	"registration",
	"relay",
	"settings",
	"status",
	"tag",
	"user-search",
	"user_exists",
	"users",
	"web"
	]

	config :pleroma, Oban,
	repo: Pleroma.Storage.Repo,
	verbose: false,
	prune: {:maxlen, 1500},
	queues: [
	activity_expiration: 10,
	federator_incoming: 50,
	federator_outgoing: 50,
	web_push: 50,
	mailer: 10,
	transmogrifier: 20,
	scheduled_activities: 10,
	background: 5,
	+ remote_fetcher: 2,
	attachments_cleanup: 5,
	new_users_digest: 1
	],
	crontab: [
	{"0 0 * * *", Pleroma.Workers.Cron.ClearOauthTokenWorker},
	{"0 * * * *", Pleroma.Workers.Cron.StatsWorker},
	{"* * * * *", Pleroma.Workers.Cron.PurgeExpiredActivitiesWorker},
	{"0 0 * * 0", Pleroma.Workers.Cron.DigestEmailsWorker},
	{"0 0 * * *", Pleroma.Workers.Cron.NewUsersDigestWorker}
	]

	config :pleroma, :workers,
	retries: [
	federator_incoming: 5,
	federator_outgoing: 5
	]

	config :pleroma, :fetch_initial_posts,
	enabled: false,
	pages: 5

	config :auto_linker,
	opts: [
	extra: true,
	# TODO: Set to :no_scheme when it works properly
	validate_tld: true,
	class: false,
	strip_prefix: false,
	new_window: false,
	rel: "ugc"
	]

	config :pleroma, :ldap,
	enabled: System.get_env("LDAP_ENABLED") == "true",
	host: System.get_env("LDAP_HOST") \|\| "localhost",
	port: String.to_integer(System.get_env("LDAP_PORT") \|\| "389"),
	ssl: System.get_env("LDAP_SSL") == "true",
	sslopts: [],
	tls: System.get_env("LDAP_TLS") == "true",
	tlsopts: [],
	base: System.get_env("LDAP_BASE") \|\| "dc=example,dc=com",
	uid: System.get_env("LDAP_UID") \|\| "cn"

	config :esshd,
	enabled: false

	oauth_consumer_strategies =
	System.get_env("OAUTH_CONSUMER_STRATEGIES")
	\|> to_string()
	\|> String.split()
	\|> Enum.map(&hd(String.split(&1, ":")))

	ueberauth_providers =
	for strategy <- oauth_consumer_strategies do
	strategy_module_name = "Elixir.Ueberauth.Strategy.#{String.capitalize(strategy)}"
	strategy_module = String.to_atom(strategy_module_name)
	{String.to_atom(strategy), {strategy_module, [callback_params: ["state"]]}}
	end

	config :ueberauth,
	Ueberauth,
	base_path: "/oauth",
	providers: ueberauth_providers

	config :pleroma,
	:auth,
	enforce_oauth_admin_scope_usage: true,
	oauth_consumer_strategies: oauth_consumer_strategies

	config :pleroma, Pleroma.Emails.Mailer, adapter: Swoosh.Adapters.Sendmail, enabled: false

	config :pleroma, Pleroma.Emails.UserEmail,
	logo: nil,
	styling: %{
	link_color: "#d8a070",
	background_color: "#2C3645",
	content_background_color: "#1B2635",
	header_color: "#d8a070",
	text_color: "#b9b9ba",
	text_muted_color: "#b9b9ba"
	}

	config :pleroma, Pleroma.Emails.NewUsersDigestEmail, enabled: false

	config :prometheus, Pleroma.Web.Endpoint.MetricsExporter, path: "/api/pleroma/app_metrics"

	config :pleroma, Pleroma.ScheduledActivity,
	daily_user_limit: 25,
	total_user_limit: 300,
	enabled: true

	config :pleroma, :email_notifications,
	digest: %{
	active: false,
	interval: 7,
	inactivity_threshold: 7
	}

	config :pleroma, :oauth2,
	token_expires_in: 600,
	issue_new_refresh_token: true,
	clean_expired_tokens: false

	config :pleroma, :database, rum_enabled: false

	config :pleroma, :env, Mix.env()

	config :http_signatures,
	adapter: Pleroma.Signature

	config :pleroma, :rate_limit,
	authentication: {60_000, 15},
	search: [{1000, 10}, {1000, 30}],
	app_account_creation: {1_800_000, 25},
	relations_actions: {10_000, 10},
	relation_id_action: {60_000, 2},
	statuses_actions: {10_000, 15},
	status_id_action: {60_000, 3},
	password_reset: {1_800_000, 5},
	account_confirmation_resend: {8_640_000, 5},
	ap_routes: {60_000, 15}

	config :pleroma, Pleroma.ActivityExpiration, enabled: true

	config :pleroma, Pleroma.Plugs.RemoteIp, enabled: true

	config :pleroma, :static_fe, enabled: false

	config :pleroma, :web_cache_ttl,
	activity_pub: nil,
	activity_pub_question: 30_000

	config :pleroma, :modules, runtime_dir: "instance/modules"

	config :pleroma, configurable_from_database: false

	config :pleroma, Pleroma.Repo, parameters: [gin_fuzzy_search_limit: "500"]

	# Import environment specific config. This must remain at the bottom
	# of this file so it overrides the configuration defined above.
	import_config "#{Mix.env()}.exs"
	diff --git a/config/description.exs b/config/description.exs
	index b07b55154..b2b535c0f 100644
	--- a/config/description.exs
	+++ b/config/description.exs
	@@ -1,3120 +1,3126 @@
	use Mix.Config
	alias Pleroma.Docs.Generator

	websocket_config = [
	path: "/websocket",
	serializer: [
	{Phoenix.Socket.V1.JSONSerializer, "~> 1.0.0"},
	{Phoenix.Socket.V2.JSONSerializer, "~> 2.0.0"}
	],
	timeout: 60_000,
	transport_log: false,
	compress: false
	]

	config :pleroma, :config_description, [
	%{
	group: :pleroma,
	key: Pleroma.Upload,
	type: :group,
	description: "Upload general settings",
	children: [
	%{
	key: :uploader,
	type: :module,
	description: "Module which will be used for uploads",
	suggestions: [Pleroma.Upload.Uploader.Local, Pleroma.Upload.Uploader.S3]
	},
	%{
	key: :filters,
	type: {:list, :module},
	description: "List of filter modules for uploads",
	suggestions:
	Generator.list_modules_in_dir(
	"lib/pleroma/upload/filter",
	"Elixir.Pleroma.Upload.Filter."
	)
	},
	%{
	key: :link_name,
	type: :boolean,
	description:
	"If enabled, a name parameter will be added to the url of the upload. For example `https://instance.tld/media/imagehash.png?name=realname.png`."
	},
	%{
	key: :base_url,
	type: :string,
	description: "Base url for the uploads, needed if you use CDN",
	suggestions: [
	"https://cdn-host.com"
	]
	},
	%{
	key: :proxy_remote,
	type: :boolean,
	description:
	"If enabled, requests to media stored using a remote uploader will be proxied instead of being redirected"
	},
	%{
	key: :proxy_opts,
	type: :keyword,
	description: "Options for Pleroma.ReverseProxy",
	suggestions: [
	redirect_on_failure: false,
	max_body_length: 25 * 1_048_576,
	http: [
	follow_redirect: true,
	pool: :media
	]
	],
	children: [
	%{
	key: :redirect_on_failure,
	type: :boolean,
	description:
	"Redirects the client to the real remote URL if there's any HTTP errors. " <>
	"Any error during body processing will not be redirected as the response is chunked."
	},
	%{
	key: :max_body_length,
	type: :integer,
	description:
	"Limits the content length to be approximately the " <>
	"specified length. It is validated with the `content-length` header and also verified when proxying."
	},
	%{
	key: :http,
	type: :keyword,
	description: "HTTP options",
	children: [
	%{
	key: :adapter,
	type: :keyword,
	description: "Adapter specific options",
	children: [
	%{
	key: :ssl_options,
	type: :keyword,
	label: "SSL Options",
	description: "SSL options for HTTP adapter",
	children: [
	%{
	key: :versions,
	type: {:list, :atom},
	description: "List of TLS versions to use",
	suggestions: [:tlsv1, ":tlsv1.1", ":tlsv1.2"]
	}
	]
	}
	]
	},
	%{
	key: :proxy_url,
	label: "Proxy URL",
	type: [:string, :tuple],
	description: "Proxy URL",
	suggestions: ["127.0.0.1:8123", {:socks5, :localhost, 9050}]
	}
	]
	}
	]
	}
	]
	},
	%{
	group: :pleroma,
	key: Pleroma.Upload.Uploader.Local,
	type: :group,
	description: "Local uploader-related settings",
	children: [
	%{
	key: :uploads,
	type: :string,
	description: "Path where user's uploads will be saved",
	suggestions: [
	"uploads"
	]
	}
	]
	},
	%{
	group: :pleroma,
	key: Pleroma.Upload.Uploader.S3,
	type: :group,
	description: "S3 uploader-related settings",
	children: [
	%{
	key: :bucket,
	type: :string,
	description: "S3 bucket",
	suggestions: [
	"bucket"
	]
	},
	%{
	key: :bucket_namespace,
	type: :string,
	description: "S3 bucket namespace",
	suggestions: ["pleroma"]
	},
	%{
	key: :public_endpoint,
	type: :string,
	description: "S3 endpoint",
	suggestions: ["https://s3.amazonaws.com"]
	},
	%{
	key: :truncated_namespace,
	type: :string,
	description:
	"If you use S3 compatible service such as Digital Ocean Spaces or CDN, set folder name or \"\" etc." <>
	" For example, when using CDN to S3 virtual host format, set \"\". At this time, write CNAME to CDN in public_endpoint."
	},
	%{
	key: :streaming_enabled,
	type: :boolean,
	description:
	"Enable streaming uploads, when enabled the file will be sent to the server in chunks as it's being read. This may be unsupported by some providers, try disabling this if you have upload problems."
	}
	]
	},
	%{
	group: :pleroma,
	key: Pleroma.Upload.Filter.Mogrify,
	type: :group,
	description: "Uploads mogrify filter settings",
	children: [
	%{
	key: :args,
	type: [:string, {:list, :string}, {:list, :tuple}],
	description: "List of actions for the mogrify command",
	suggestions: [
	"strip",
	"auto-orient",
	{"implode", "1"}
	]
	}
	]
	},
	%{
	group: :pleroma,
	key: Pleroma.Upload.Filter.AnonymizeFilename,
	type: :group,
	description: "Filter replaces the filename of the upload",
	children: [
	%{
	key: :text,
	type: :string,
	description:
	"Text to replace filenames in links. If no setting, {random}.extension will be used. You can get the original" <>
	" filename extension by using {extension}, for example custom-file-name.{extension}.",
	suggestions: [
	"custom-file-name.{extension}"
	]
	}
	]
	},
	%{
	group: :pleroma,
	key: Pleroma.Emails.Mailer,
	type: :group,
	description: "Mailer-related settings",
	children: [
	%{
	key: :adapter,
	type: :module,
	description:
	"One of the mail adapters listed in [Swoosh readme](https://github.com/swoosh/swoosh#adapters)," <>
	" or Swoosh.Adapters.Local for in-memory mailbox",
	suggestions: [
	Swoosh.Adapters.SMTP,
	Swoosh.Adapters.Sendgrid,
	Swoosh.Adapters.Sendmail,
	Swoosh.Adapters.Mandrill,
	Swoosh.Adapters.Mailgun,
	Swoosh.Adapters.Mailjet,
	Swoosh.Adapters.Postmark,
	Swoosh.Adapters.SparkPost,
	Swoosh.Adapters.AmazonSES,
	Swoosh.Adapters.Dyn,
	Swoosh.Adapters.SocketLabs,
	Swoosh.Adapters.Gmail,
	Swoosh.Adapters.Local
	]
	},
	%{
	key: :enabled,
	type: :boolean,
	description: "Allow/disallow send emails"
	},
	%{
	group: {:subgroup, Swoosh.Adapters.SMTP},
	key: :relay,
	type: :string,
	description: "`Swoosh.Adapters.SMTP` adapter specific setting",
	suggestions: ["smtp.gmail.com"]
	},
	%{
	group: {:subgroup, Swoosh.Adapters.SMTP},
	key: :username,
	type: :string,
	description: "`Swoosh.Adapters.SMTP` adapter specific setting",
	suggestions: ["pleroma"]
	},
	%{
	group: {:subgroup, Swoosh.Adapters.SMTP},
	key: :password,
	type: :string,
	description: "`Swoosh.Adapters.SMTP` adapter specific setting",
	suggestions: ["password"]
	},
	%{
	group: {:subgroup, Swoosh.Adapters.SMTP},
	key: :ssl,
	label: "SSL",
	type: :boolean,
	description: "`Swoosh.Adapters.SMTP` adapter specific setting"
	},
	%{
	group: {:subgroup, Swoosh.Adapters.SMTP},
	key: :tls,
	label: "TLS",
	type: :atom,
	description: "`Swoosh.Adapters.SMTP` adapter specific setting",
	suggestions: [:always, :never, :if_available]
	},
	%{
	group: {:subgroup, Swoosh.Adapters.SMTP},
	key: :auth,
	type: :atom,
	description: "`Swoosh.Adapters.SMTP` adapter specific setting",
	suggestions: [:always, :never, :if_available]
	},
	%{
	group: {:subgroup, Swoosh.Adapters.SMTP},
	key: :port,
	type: :integer,
	description: "`Swoosh.Adapters.SMTP` adapter specific setting",
	suggestions: [1025]
	},
	%{
	group: {:subgroup, Swoosh.Adapters.SMTP},
	key: :retries,
	type: :integer,
	description: "`Swoosh.Adapters.SMTP` adapter specific setting",
	suggestions: [5]
	},
	%{
	group: {:subgroup, Swoosh.Adapters.SMTP},
	key: :no_mx_lookups,
	label: "No MX lookups",
	type: :boolean,
	description: "`Swoosh.Adapters.SMTP` adapter specific setting"
	},
	%{
	group: {:subgroup, Swoosh.Adapters.Sendgrid},
	key: :api_key,
	label: "API key",
	type: :string,
	description: "`Swoosh.Adapters.Sendgrid` adapter specific setting",
	suggestions: ["my-api-key"]
	},
	%{
	group: {:subgroup, Swoosh.Adapters.Sendmail},
	key: :cmd_path,
	type: :string,
	description: "`Swoosh.Adapters.Sendmail` adapter specific setting",
	suggestions: ["/usr/bin/sendmail"]
	},
	%{
	group: {:subgroup, Swoosh.Adapters.Sendmail},
	key: :cmd_args,
	type: :string,
	description: "`Swoosh.Adapters.Sendmail` adapter specific setting",
	suggestions: ["-N delay,failure,success"]
	},
	%{
	group: {:subgroup, Swoosh.Adapters.Sendmail},
	key: :qmail,
	type: :boolean,
	description: "`Swoosh.Adapters.Sendmail` adapter specific setting"
	},
	%{
	group: {:subgroup, Swoosh.Adapters.Mandrill},
	key: :api_key,
	label: "API key",
	type: :string,
	description: "`Swoosh.Adapters.Mandrill` adapter specific setting",
	suggestions: ["my-api-key"]
	},
	%{
	group: {:subgroup, Swoosh.Adapters.Mailgun},
	key: :api_key,
	label: "API key",
	type: :string,
	description: "`Swoosh.Adapters.Mailgun` adapter specific setting",
	suggestions: ["my-api-key"]
	},
	%{
	group: {:subgroup, Swoosh.Adapters.Mailgun},
	key: :domain,
	type: :string,
	description: "`Swoosh.Adapters.Mailgun` adapter specific setting",
	suggestions: ["pleroma.com"]
	},
	%{
	group: {:subgroup, Swoosh.Adapters.Mailjet},
	key: :api_key,
	label: "API key",
	type: :string,
	description: "`Swoosh.Adapters.Mailjet` adapter specific setting",
	suggestions: ["my-api-key"]
	},
	%{
	group: {:subgroup, Swoosh.Adapters.Mailjet},
	key: :secret,
	type: :string,
	description: "`Swoosh.Adapters.Mailjet` adapter specific setting",
	suggestions: ["my-secret-key"]
	},
	%{
	group: {:subgroup, Swoosh.Adapters.Postmark},
	key: :api_key,
	label: "API key",
	type: :string,
	description: "`Swoosh.Adapters.Postmark` adapter specific setting",
	suggestions: ["my-api-key"]
	},
	%{
	group: {:subgroup, Swoosh.Adapters.SparkPost},
	key: :api_key,
	label: "API key",
	type: :string,
	description: "`Swoosh.Adapters.SparkPost` adapter specific setting",
	suggestions: ["my-api-key"]
	},
	%{
	group: {:subgroup, Swoosh.Adapters.SparkPost},
	key: :endpoint,
	type: :string,
	description: "`Swoosh.Adapters.SparkPost` adapter specific setting",
	suggestions: ["https://api.sparkpost.com/api/v1"]
	},
	%{
	group: {:subgroup, Swoosh.Adapters.AmazonSES},
	key: :region,
	type: :string,
	description: "`Swoosh.Adapters.AmazonSES` adapter specific setting",
	suggestions: ["us-east-1", "us-east-2"]
	},
	%{
	group: {:subgroup, Swoosh.Adapters.AmazonSES},
	key: :access_key,
	type: :string,
	description: "`Swoosh.Adapters.AmazonSES` adapter specific setting",
	suggestions: ["aws-access-key"]
	},
	%{
	group: {:subgroup, Swoosh.Adapters.AmazonSES},
	key: :secret,
	type: :string,
	description: "`Swoosh.Adapters.AmazonSES` adapter specific setting",
	suggestions: ["aws-secret-key"]
	},
	%{
	group: {:subgroup, Swoosh.Adapters.Dyn},
	key: :api_key,
	label: "API key",
	type: :string,
	description: "`Swoosh.Adapters.Dyn` adapter specific setting",
	suggestions: ["my-api-key"]
	},
	%{
	group: {:subgroup, Swoosh.Adapters.SocketLabs},
	key: :server_id,
	type: :string,
	description: "`Swoosh.Adapters.SocketLabs` adapter specific setting"
	},
	%{
	group: {:subgroup, Swoosh.Adapters.SocketLabs},
	key: :api_key,
	label: "API key",
	type: :string,
	description: "`Swoosh.Adapters.SocketLabs` adapter specific setting"
	},
	%{
	group: {:subgroup, Swoosh.Adapters.Gmail},
	key: :access_token,
	type: :string,
	description: "`Swoosh.Adapters.Gmail` adapter specific setting"
	}
	]
	},
	%{
	group: :swoosh,
	type: :group,
	description: "`Swoosh.Adapters.Local` adapter specific settings",
	children: [
	%{
	group: {:subgroup, Swoosh.Adapters.Local},
	key: :serve_mailbox,
	type: :boolean,
	description: "Run the preview server together as part of your app"
	},
	%{
	group: {:subgroup, Swoosh.Adapters.Local},
	key: :preview_port,
	type: :integer,
	description: "The preview server port",
	suggestions: [4001]
	}
	]
	},
	%{
	group: :pleroma,
	key: :uri_schemes,
	type: :group,
	description: "URI schemes related settings",
	children: [
	%{
	key: :valid_schemes,
	type: {:list, :string},
	description: "List of the scheme part that is considered valid to be an URL",
	suggestions: [
	"https",
	"http",
	"dat",
	"dweb",
	"gopher",
	"ipfs",
	"ipns",
	"irc",
	"ircs",
	"magnet",
	"mailto",
	"mumble",
	"ssb",
	"xmpp"
	]
	}
	]
	},
	%{
	group: :pleroma,
	key: :instance,
	type: :group,
	description: "Instance-related settings",
	children: [
	%{
	key: :name,
	type: :string,
	description: "Name of the instance",
	suggestions: [
	"Pleroma"
	]
	},
	%{
	key: :email,
	label: "Admin Email Address",
	type: :string,
	description: "Email used to reach an Administrator/Moderator of the instance",
	suggestions: [
	"email@example.com"
	]
	},
	%{
	key: :notify_email,
	label: "Sender Email Address",
	type: :string,
	description: "Envelope FROM address for mail sent via Pleroma",
	suggestions: [
	"notify@example.com"
	]
	},
	%{
	key: :description,
	type: :string,
	description:
	"The instance's description. It can be seen in nodeinfo and `/api/v1/instance`",
	suggestions: [
	"Very cool instance"
	]
	},
	%{
	key: :limit,
	type: :integer,
	description: "Posts character limit (CW/Subject included in the counter)",
	suggestions: [
	5_000
	]
	},
	%{
	key: :chat_limit,
	type: :integer,
	description: "Character limit of the instance chat messages",
	suggestions: [
	5_000
	]
	},
	%{
	key: :remote_limit,
	type: :integer,
	description: "Hard character limit beyond which remote posts will be dropped",
	suggestions: [
	100_000
	]
	},
	%{
	key: :upload_limit,
	type: :integer,
	description: "File size limit of uploads (except for avatar, background, banner)",
	suggestions: [
	16_000_000
	]
	},
	%{
	key: :avatar_upload_limit,
	type: :integer,
	description: "File size limit of user's profile avatars",
	suggestions: [
	2_000_000
	]
	},
	%{
	key: :background_upload_limit,
	type: :integer,
	description: "File size limit of user's profile backgrounds",
	suggestions: [
	4_000_000
	]
	},
	%{
	key: :banner_upload_limit,
	type: :integer,
	description: "File size limit of user's profile banners",
	suggestions: [
	4_000_000
	]
	},
	%{
	key: :poll_limits,
	type: :map,
	description: "A map with poll limits for local polls",
	suggestions: [
	%{
	max_options: 20,
	max_option_chars: 200,
	min_expiration: 0,
	max_expiration: 31_536_000
	}
	],
	children: [
	%{
	key: :max_options,
	type: :integer,
	description: "Maximum number of options",
	suggestions: [20]
	},
	%{
	key: :max_option_chars,
	type: :integer,
	description: "Maximum number of characters per option",
	suggestions: [200]
	},
	%{
	key: :min_expiration,
	type: :integer,
	description: "Minimum expiration time (in seconds)",
	suggestions: [0]
	},
	%{
	key: :max_expiration,
	type: :integer,
	description: "Maximum expiration time (in seconds)",
	suggestions: [3600]
	}
	]
	},
	%{
	key: :registrations_open,
	type: :boolean,
	description:
	"Enable registrations for anyone. Invitations require this setting to be disabled."
	},
	%{
	key: :invites_enabled,
	type: :boolean,
	description:
	"Enable user invitations for admins (depends on `registrations_open` being disabled)."
	},
	%{
	key: :account_activation_required,
	type: :boolean,
	description: "Require users to confirm their emails before signing in."
	},
	%{
	key: :federating,
	type: :boolean,
	description: "Enable federation with other instances."
	},
	%{
	key: :federation_incoming_replies_max_depth,
	label: "Fed. incoming replies max depth",
	type: :integer,
	description:
	- "Max. depth of reply-to activities fetching on incoming federation, to prevent out-of-memory situations while" <>
	+ "Max. depth of reply-to and reply activities fetching on incoming federation, to prevent out-of-memory situations while" <>
	" fetching very long threads. If set to `nil`, threads of any depth will be fetched. Lower this value if you experience out-of-memory crashes.",
	suggestions: [
	100
	]
	},
	%{
	key: :federation_reachability_timeout_days,
	label: "Fed. reachability timeout days",
	type: :integer,
	description:
	"Timeout (in days) of each external federation target being unreachable prior to pausing federating to it.",
	suggestions: [
	7
	]
	},
	%{
	key: :federation_publisher_modules,
	type: {:list, :module},
	description: "List of modules for federation publishing",
	suggestions: [
	Pleroma.Web.ActivityPub.Publisher
	]
	},
	%{
	key: :allow_relay,
	type: :boolean,
	description: "Enable Pleroma's Relay, which makes it possible to follow a whole instance"
	},
	%{
	key: :rewrite_policy,
	type: [:module, {:list, :module}],
	description: "A list of MRF policies enabled",
	suggestions:
	Generator.list_modules_in_dir(
	"lib/federation/activity_pub/mrf",
	"Elixir.Pleroma.Federation.ActivityPub.MRF."
	)
	},
	%{
	key: :public,
	type: :boolean,
	description:
	"Makes the client API in authentificated mode-only except for user-profiles." <>
	" Useful for disabling the Local Timeline and The Whole Known Network."
	},
	%{
	key: :quarantined_instances,
	type: {:list, :string},
	description:
	"List of ActivityPub instances where private (DMs, followers-only) activities will not be send",
	suggestions: [
	"quarantined.com",
	"*.quarantined.com"
	]
	},
	%{
	key: :managed_config,
	type: :boolean,
	description:
	"Whenether the config for pleroma-fe is configured in this config or in static/config.json"
	},
	%{
	key: :static_dir,
	type: :string,
	description: "Instance static directory",
	suggestions: [
	"instance/static/"
	]
	},
	%{
	key: :allowed_post_formats,
	type: {:list, :string},
	description: "MIME-type list of formats allowed to be posted (transformed into HTML)",
	suggestions: [
	"text/plain",
	"text/html",
	"text/markdown",
	"text/bbcode"
	]
	},
	%{
	key: :mrf_transparency,
	label: "MRF transparency",
	type: :boolean,
	description:
	"Make the content of your Message Rewrite Facility settings public (via nodeinfo)"
	},
	%{
	key: :mrf_transparency_exclusions,
	label: "MRF transparency exclusions",
	type: {:list, :string},
	description:
	"Exclude specific instance names from MRF transparency. The use of the exclusions feature will be disclosed in nodeinfo as a boolean value.",
	suggestions: [
	"exclusion.com"
	]
	},
	%{
	key: :extended_nickname_format,
	type: :boolean,
	description:
	"Enable to use extended local nicknames format (allows underscores/dashes)." <>
	" This will break federation with older software for theses nicknames."
	},
	%{
	key: :cleanup_attachments,
	type: :boolean,
	description: """
	Enable to remove associated attachments when status is removed.
	This will not affect duplicates and attachments without status.
	Enabling this will increase load to database when deleting statuses on larger instances.
	"""
	},
	%{
	key: :max_pinned_statuses,
	type: :integer,
	description: "The maximum number of pinned statuses. 0 will disable the feature.",
	suggestions: [
	0,
	1,
	3
	]
	},
	%{
	key: :autofollowed_nicknames,
	type: {:list, :string},
	description:
	"Set to nicknames of (local) users that every new user should automatically follow",
	suggestions: [
	"lain",
	"kaniini",
	"lanodan",
	"rinpatch"
	]
	},
	%{
	key: :attachment_links,
	type: :boolean,
	description: "Enable to automatically add attachment link text to statuses"
	},
	%{
	key: :welcome_message,
	type: :string,
	description:
	"A message that will be sent to a newly registered users as a direct message",
	suggestions: [
	"Hi, @username! Welcome on board!"
	]
	},
	%{
	key: :welcome_user_nickname,
	type: :string,
	description: "The nickname of the local user that sends the welcome message",
	suggestions: [
	"lain"
	]
	},
	%{
	key: :max_report_comment_size,
	type: :integer,
	description: "The maximum size of the report comment. Default: 1000.",
	suggestions: [
	1_000
	]
	},
	%{
	key: :safe_dm_mentions,
	type: :boolean,
	description:
	"If enabled, only mentions at the beginning of a post will be used to address people in direct messages." <>
	" This is to prevent accidental mentioning of people when talking about them (e.g. \"@admin please keep an eye on @bad_actor\")." <>
	" Default: disabled"
	},
	%{
	key: :healthcheck,
	type: :boolean,
	description: "If enabled, system data will be shown on `/api/pleroma/healthcheck`"
	},
	%{
	key: :remote_post_retention_days,
	type: :integer,
	description:
	"The default amount of days to retain remote posts when pruning the database",
	suggestions: [
	90
	]
	},
	%{
	key: :user_bio_length,
	type: :integer,
	description: "A user bio maximum length. Default: 5000.",
	suggestions: [
	5_000
	]
	},
	%{
	key: :user_name_length,
	type: :integer,
	description: "A user name maximum length. Default: 100.",
	suggestions: [
	100
	]
	},
	%{
	key: :skip_thread_containment,
	type: :boolean,
	description: "Skip filtering out broken threads. Default: enabled"
	},
	%{
	key: :limit_to_local_content,
	type: {:dropdown, :atom},
	description:
	"Limit unauthenticated users to search for local statutes and users only. Default: `:unauthenticated`.",
	suggestions: [
	:unauthenticated,
	:all,
	false
	]
	},
	%{
	key: :max_account_fields,
	type: :integer,
	description: "The maximum number of custom fields in the user profile. Default: 10.",
	suggestions: [
	10
	]
	},
	%{
	key: :max_remote_account_fields,
	type: :integer,
	description:
	"The maximum number of custom fields in the remote user profile. Default: 20.",
	suggestions: [
	20
	]
	},
	%{
	key: :account_field_name_length,
	type: :integer,
	description: "An account field name maximum length. Default: 512.",
	suggestions: [
	512
	]
	},
	%{
	key: :account_field_value_length,
	type: :integer,
	description: "An account field value maximum length. Default: 2048.",
	suggestions: [
	2048
	]
	},
	%{
	key: :external_user_synchronization,
	type: :boolean,
	description: "Enabling following/followers counters synchronization for external users"
	}
	]
	},
	%{
	group: :logger,
	type: :group,
	description: "Logger-related settings",
	children: [
	%{
	key: :backends,
	type: [:atom, :tuple, :module],
	description:
	"Where logs will be sent, :console - send logs to stdout, { ExSyslogger, :ex_syslogger } - to syslog, Quack.Logger - to Slack.",
	suggestions: [:console, {ExSyslogger, :ex_syslogger}, Quack.Logger]
	}
	]
	},
	%{
	group: :logger,
	type: :group,
	key: :ex_syslogger,
	description: "ExSyslogger-related settings",
	children: [
	%{
	key: :level,
	type: {:dropdown, :atom},
	description: "Log level",
	suggestions: [:debug, :info, :warn, :error]
	},
	%{
	key: :ident,
	type: :string,
	description:
	"A string that's prepended to every message, and is typically set to the app name",
	suggestions: ["pleroma"]
	},
	%{
	key: :format,
	type: :string,
	description: "Default: \"$date $time [$level] $levelpad$node $metadata $message\".",
	suggestions: ["$metadata[$level] $message"]
	},
	%{
	key: :metadata,
	type: {:list, :atom},
	suggestions: [:request_id]
	}
	]
	},
	%{
	group: :logger,
	type: :group,
	key: :console,
	description: "Console logger settings",
	children: [
	%{
	key: :level,
	type: {:dropdown, :atom},
	description: "Log level",
	suggestions: [:debug, :info, :warn, :error]
	},
	%{
	key: :format,
	type: :string,
	description: "Default: \"$date $time [$level] $levelpad$node $metadata $message\".",
	suggestions: ["$metadata[$level] $message"]
	},
	%{
	key: :metadata,
	type: {:list, :atom},
	suggestions: [:request_id]
	}
	]
	},
	%{
	group: :quack,
	type: :group,
	description: "Quack-related settings",
	children: [
	%{
	key: :level,
	type: {:dropdown, :atom},
	description: "Log level",
	suggestions: [:debug, :info, :warn, :error]
	},
	%{
	key: :meta,
	type: {:list, :atom},
	description: "Configure which metadata you want to report on",
	suggestions: [
	:application,
	:module,
	:file,
	:function,
	:line,
	:pid,
	:crash_reason,
	:initial_call,
	:registered_name,
	:all,
	:none
	]
	},
	%{
	key: :webhook_url,
	type: :string,
	description: "Configure the Slack incoming webhook",
	suggestions: ["https://hooks.slack.com/services/YOUR-KEY-HERE"]
	}
	]
	},
	%{
	group: :pleroma,
	key: :frontend_configurations,
	type: :group,
	description:
	"This form can be used to configure a keyword list that keeps the configuration data for any " <>
	"kind of frontend. By default, settings for pleroma_fe and masto_fe are configured. If you want to " <>
	"add your own configuration your settings all fields must be complete.",
	children: [
	%{
	key: :pleroma_fe,
	label: "Pleroma FE",
	type: :map,
	description: "Settings for Pleroma FE",
	suggestions: [
	%{
	theme: "pleroma-dark",
	logo: "/static/logo.png",
	background: "/images/city.jpg",
	redirectRootNoLogin: "/main/all",
	redirectRootLogin: "/main/friends",
	showInstanceSpecificPanel: true,
	scopeOptionsEnabled: false,
	formattingOptionsEnabled: false,
	collapseMessageWithSubject: false,
	hidePostStats: false,
	hideUserStats: false,
	scopeCopy: true,
	subjectLineBehavior: "email",
	alwaysShowSubjectInput: true,
	logoMask: false,
	logoMargin: ".1em",
	stickers: false,
	enableEmojiPicker: false
	}
	],
	children: [
	%{
	key: :theme,
	type: :string,
	description: "Which theme to use, they are defined in styles.json",
	suggestions: ["pleroma-dark"]
	},
	%{
	key: :logo,
	type: :string,
	description: "URL of the logo, defaults to Pleroma's logo",
	suggestions: ["/static/logo.png"]
	},
	%{
	key: :background,
	type: :string,
	description:
	"URL of the background, unless viewing a user profile with a background that is set",
	suggestions: ["/images/city.jpg"]
	},
	%{
	key: :redirectRootNoLogin,
	label: "Redirect root no login",
	type: :string,
	description:
	"Relative URL which indicates where to redirect when a user isn't logged in",
	suggestions: ["/main/all"]
	},
	%{
	key: :redirectRootLogin,
	label: "Redirect root login",
	type: :string,
	description:
	"Relative URL which indicates where to redirect when a user is logged in",
	suggestions: ["/main/friends"]
	},
	%{
	key: :showInstanceSpecificPanel,
	label: "Show instance specific panel",
	type: :boolean,
	description: "Whenether to show the instance's specific panel"
	},
	%{
	key: :scopeOptionsEnabled,
	label: "Scope options enabled",
	type: :boolean,
	description: "Enable setting a notice visibility and subject/CW when posting"
	},
	%{
	key: :formattingOptionsEnabled,
	label: "Formatting options enabled",
	type: :boolean,
	description:
	"Enable setting a formatting different than plain-text (ie. HTML, Markdown) when posting, relates to `:instance`, `allowed_post_formats`"
	},
	%{
	key: :collapseMessageWithSubject,
	label: "Collapse message with subject",
	type: :boolean,
	description:
	"When a message has a subject (aka Content Warning), collapse it by default"
	},
	%{
	key: :hidePostStats,
	label: "Hide post stats",
	type: :boolean,
	description: "Hide notices statistics (repeats, favorites, ...)"
	},
	%{
	key: :hideUserStats,
	label: "Hide user stats",
	type: :boolean,
	description:
	"Hide profile statistics (posts, posts per day, followers, followings, ...)"
	},
	%{
	key: :scopeCopy,
	label: "Scope copy",
	type: :boolean,
	description: "Copy the scope (private/unlisted/public) in replies to posts by default"
	},
	%{
	key: :subjectLineBehavior,
	label: "Subject line behavior",
	type: :string,
	description: "Allows changing the default behaviour of subject lines in replies.
	`email`: copy and preprend re:, as in email,
	`masto`: copy verbatim, as in Mastodon,
	`noop`: don't copy the subject.",
	suggestions: ["email", "masto", "noop"]
	},
	%{
	key: :alwaysShowSubjectInput,
	label: "Always show subject input",
	type: :boolean,
	description: "When disabled, auto-hide the subject field if it's empty"
	},
	%{
	key: :logoMask,
	label: "Logo mask",
	type: :boolean,
	description:
	"By default it assumes logo used will be monochrome with alpha channel to be compatible with both light and dark themes. " <>
	"If you want a colorful logo you must disable logoMask."
	},
	%{
	key: :logoMargin,
	label: "Logo margin",
	type: :string,
	description:
	"Allows you to adjust vertical margins between logo boundary and navbar borders. " <>
	"The idea is that to have logo's image without any extra margins and instead adjust them to your need in layout.",
	suggestions: [".1em"]
	},
	%{
	key: :stickers,
	type: :boolean,
	description: "Enables stickers."
	},
	%{
	key: :enableEmojiPicker,
	label: "Emoji picker",
	type: :boolean,
	description: "Enables emoji picker."
	}
	]
	},
	%{
	key: :masto_fe,
	label: "Masto FE",
	type: :map,
	description: "Settings for Masto FE",
	suggestions: [
	%{
	showInstanceSpecificPanel: true
	}
	],
	children: [
	%{
	key: :showInstanceSpecificPanel,
	label: "Show instance specific panel",
	type: :boolean,
	description: "Whenether to show the instance's specific panel"
	}
	]
	}
	]
	},
	%{
	group: :pleroma,
	key: :assets,
	type: :group,
	description:
	"This section configures assets to be used with various frontends. Currently the only option relates to mascots on the mastodon frontend",
	children: [
	%{
	key: :mascots,
	type: {:keyword, :map},
	description:
	"Keyword of mascots, each element must contain both an url and a mime_type key",
	suggestions: [
	pleroma_fox_tan: %{
	url: "/images/pleroma-fox-tan-smol.png",
	mime_type: "image/png"
	},
	pleroma_fox_tan_shy: %{
	url: "/images/pleroma-fox-tan-shy.png",
	mime_type: "image/png"
	}
	]
	},
	%{
	key: :default_mascot,
	type: :atom,
	description:
	"This will be used as the default mascot on MastoFE. Default: `:pleroma_fox_tan`",
	suggestions: [
	:pleroma_fox_tan
	]
	}
	]
	},
	%{
	group: :pleroma,
	key: :manifest,
	type: :group,
	description:
	"This section describe PWA manifest instance-specific values. Currently this option relate only for MastoFE",
	children: [
	%{
	key: :icons,
	type: {:list, :map},
	description: "Describe the icons of the app",
	suggestion: [
	%{
	src: "/static/logo.png"
	},
	%{
	src: "/static/icon.png",
	type: "image/png"
	},
	%{
	src: "/static/icon.ico",
	sizes: "72x72 96x96 128x128 256x256"
	}
	]
	},
	%{
	key: :theme_color,
	type: :string,
	description: "Describe the theme color of the app",
	suggestions: ["#282c37", "mediumpurple"]
	},
	%{
	key: :background_color,
	type: :string,
	description: "Describe the background color of the app",
	suggestions: ["#191b22", "aliceblue"]
	}
	]
	},
	%{
	group: :pleroma,
	key: :mrf_simple,
	label: "MRF simple",
	type: :group,
	description: "Message Rewrite Facility",
	children: [
	%{
	key: :media_removal,
	type: {:list, :string},
	description: "List of instances to strip media attachments from",
	suggestions: ["example.com", "*.example.com"]
	},
	%{
	key: :media_nsfw,
	label: "Media NSFW",
	type: {:list, :string},
	description: "List of instances to tag all media as NSFW (sensitive) from",
	suggestions: ["example.com", "*.example.com"]
	},
	%{
	key: :federated_timeline_removal,
	type: {:list, :string},
	description:
	"List of instances to remove from Federated (aka The Whole Known Network) Timeline",
	suggestions: ["example.com", "*.example.com"]
	},
	%{
	key: :reject,
	type: {:list, :string},
	description: "List of instances to reject any activities from",
	suggestions: ["example.com", "*.example.com"]
	},
	%{
	key: :accept,
	type: {:list, :string},
	description: "List of instances to accept any activities from",
	suggestions: ["example.com", "*.example.com"]
	},
	%{
	key: :report_removal,
	type: {:list, :string},
	description: "List of instances to reject reports from",
	suggestions: ["example.com", "*.example.com"]
	},
	%{
	key: :avatar_removal,
	type: {:list, :string},
	description: "List of instances to strip avatars from",
	suggestions: ["example.com", "*.example.com"]
	},
	%{
	key: :banner_removal,
	type: {:list, :string},
	description: "List of instances to strip banners from",
	suggestions: ["example.com", "*.example.com"]
	}
	]
	},
	%{
	group: :pleroma,
	key: :mrf_subchain,
	label: "MRF subchain",
	type: :group,
	description:
	"This policy processes messages through an alternate pipeline when a given message matches certain criteria." <>
	" All criteria are configured as a map of regular expressions to lists of policy modules.",
	children: [
	%{
	key: :match_actor,
	type: :map,
	description: "Matches a series of regular expressions against the actor field",
	suggestions: [
	%{
	~r/https:\/\/example.com/s => [Pleroma.Federation.ActivityPub.MRF.DropPolicy]
	}
	]
	}
	]
	},
	%{
	group: :pleroma,
	key: :mrf_rejectnonpublic,
	description:
	"MRF RejectNonPublic settings. RejectNonPublic drops posts with non-public visibility settings.",
	label: "MRF reject non public",
	type: :group,
	children: [
	%{
	key: :allow_followersonly,
	label: "Allow followers-only",
	type: :boolean,
	description: "Whether to allow followers-only posts"
	},
	%{
	key: :allow_direct,
	type: :boolean,
	description: "Whether to allow direct messages"
	}
	]
	},
	%{
	group: :pleroma,
	key: :mrf_hellthread,
	label: "MRF hellthread",
	type: :group,
	description: "Block messages with too much mentions",
	children: [
	%{
	key: :delist_threshold,
	type: :integer,
	description:
	"Number of mentioned users after which the message gets delisted (the message can still be seen, " <>
	" but it will not show up in public timelines and mentioned users won't get notifications about it). Set to 0 to disable.",
	suggestions: [10]
	},
	%{
	key: :reject_threshold,
	type: :integer,
	description:
	"Number of mentioned users after which the messaged gets rejected. Set to 0 to disable.",
	suggestions: [20]
	}
	]
	},
	%{
	group: :pleroma,
	key: :mrf_keyword,
	label: "MRF keyword",
	type: :group,
	description: "Reject or Word-Replace messages with a keyword or regex",
	children: [
	%{
	key: :reject,
	type: [:string, :regex],
	description:
	"A list of patterns which result in message being rejected. Each pattern can be a string or a regular expression.",
	suggestions: ["foo", ~r/foo/iu]
	},
	%{
	key: :federated_timeline_removal,
	type: [:string, :regex],
	description:
	"A list of patterns which result in message being removed from federated timelines (a.k.a unlisted). Each pattern can be a string or a regular expression.",
	suggestions: ["foo", ~r/foo/iu]
	},
	%{
	key: :replace,
	type: [{:tuple, :string, :string}, {:tuple, :regex, :string}],
	description:
	"A list of tuples containing {pattern, replacement}. Each pattern can be a string or a regular expression.",
	suggestions: [{"foo", "bar"}, {~r/foo/iu, "bar"}]
	}
	]
	},
	%{
	group: :pleroma,
	key: :mrf_mention,
	label: "MRF mention",
	type: :group,
	description: "Block messages which mention a user",
	children: [
	%{
	key: :actors,
	type: {:list, :string},
	description: "A list of actors for which any post mentioning them will be dropped.",
	suggestions: ["actor1", "actor2"]
	}
	]
	},
	%{
	group: :pleroma,
	key: :mrf_vocabulary,
	label: "MRF vocabulary",
	type: :group,
	description: "Filter messages which belong to certain activity vocabularies",
	children: [
	%{
	key: :accept,
	type: {:list, :string},
	description:
	"A list of ActivityStreams terms to accept. If empty, all supported messages are accepted",
	suggestions: ["Create", "Follow", "Mention", "Announce", "Like"]
	},
	%{
	key: :reject,
	type: {:list, :string},
	description:
	"A list of ActivityStreams terms to reject. If empty, no messages are rejected",
	suggestions: ["Create", "Follow", "Mention", "Announce", "Like"]
	}
	]
	},
	# %{
	# group: :pleroma,
	# key: :mrf_user_allowlist,
	# type: :group,
	# description:
	# "The keys in this section are the domain names that the policy should apply to." <>
	# " Each key should be assigned a list of users that should be allowed through by their ActivityPub ID",
	# children: [
	# ["example.org": ["https://example.org/users/admin"]],
	# suggestions: [
	# ["example.org": ["https://example.org/users/admin"]]
	# ]
	# ]
	# },
	%{
	group: :pleroma,
	key: :media_proxy,
	type: :group,
	description: "Media proxy",
	children: [
	%{
	key: :enabled,
	type: :boolean,
	description: "Enables proxying of remote media to the instance's proxy"
	},
	%{
	key: :base_url,
	type: :string,
	description:
	"The base URL to access a user-uploaded file. Useful when you want to proxy the media files via another host/CDN fronts.",
	suggestions: ["https://example.com"]
	},
	%{
	key: :proxy_opts,
	type: :keyword,
	description: "Options for Pleroma.ReverseProxy",
	suggestions: [
	redirect_on_failure: false,
	max_body_length: 25 * 1_048_576,
	http: [
	follow_redirect: true,
	pool: :media
	]
	],
	children: [
	%{
	key: :redirect_on_failure,
	type: :boolean,
	description:
	"Redirects the client to the real remote URL if there's any HTTP errors. " <>
	"Any error during body processing will not be redirected as the response is chunked."
	},
	%{
	key: :max_body_length,
	type: :integer,
	description:
	"Limits the content length to be approximately the " <>
	"specified length. It is validated with the `content-length` header and also verified when proxying."
	},
	%{
	key: :http,
	type: :keyword,
	description: "HTTP options",
	children: [
	%{
	key: :adapter,
	type: :keyword,
	description: "Adapter specific options",
	children: [
	%{
	key: :ssl_options,
	type: :keyword,
	label: "SSL Options",
	description: "SSL options for HTTP adapter",
	children: [
	%{
	key: :versions,
	type: {:list, :atom},
	description: "List of TLS version to use",
	suggestions: [:tlsv1, ":tlsv1.1", ":tlsv1.2"]
	}
	]
	}
	]
	},
	%{
	key: :proxy_url,
	label: "Proxy URL",
	type: [:string, :tuple],
	description: "Proxy URL",
	suggestions: ["127.0.0.1:8123", {:socks5, :localhost, 9050}]
	}
	]
	}
	]
	},
	%{
	key: :whitelist,
	type: {:list, :string},
	description: "List of domains to bypass the mediaproxy",
	suggestions: ["example.com"]
	}
	]
	},
	%{
	group: :pleroma,
	key: :gopher,
	type: :group,
	description: "Gopher settings",
	children: [
	%{
	key: :enabled,
	type: :boolean,
	description: "Enables the gopher interface"
	},
	%{
	key: :ip,
	type: :tuple,
	description: "IP address to bind to",
	suggestions: [{0, 0, 0, 0}]
	},
	%{
	key: :port,
	type: :integer,
	description: "Port to bind to",
	suggestions: [9999]
	},
	%{
	key: :dstport,
	type: :integer,
	description: "Port advertised in urls (optional, defaults to port)",
	suggestions: [9999]
	}
	]
	},
	%{
	group: :pleroma,
	key: Pleroma.Web.Endpoint,
	type: :group,
	description: "Phoenix endpoint configuration",
	children: [
	%{
	key: :http,
	label: "HTTP",
	type: {:keyword, :integer, :tuple},
	description: "http protocol configuration",
	suggestions: [
	port: 8080,
	ip: {127, 0, 0, 1}
	],
	children: [
	%{
	key: :dispatch,
	type: {:list, :tuple},
	description: "dispatch settings",
	suggestions: [
	{:_,
	[
	{"/api/v1/streaming", Pleroma.Web.MastodonAPI.WebsocketHandler, []},
	{"/websocket", Phoenix.Endpoint.CowboyWebSocket,
	{Phoenix.Transports.WebSocket,
	{Pleroma.Web.Endpoint, Pleroma.Web.UserSocket, websocket_config}}},
	{:_, Phoenix.Endpoint.Cowboy2Handler, {Pleroma.Web.Endpoint, []}}
	]}
	# end copied from config.exs
	]
	},
	%{
	key: :ip,
	label: "IP",
	type: :tuple,
	description: "ip",
	suggestions: [
	{0, 0, 0, 0}
	]
	},
	%{
	key: :port,
	type: :integer,
	description: "port",
	suggestions: [
	2020
	]
	}
	]
	},
	%{
	key: :url,
	label: "URL",
	type: {:keyword, :string, :integer},
	description: "configuration for generating urls",
	suggestions: [
	host: "example.com",
	port: 2020,
	scheme: "https"
	],
	children: [
	%{
	key: :host,
	type: :string,
	description: "Host",
	suggestions: [
	"example.com"
	]
	},
	%{
	key: :port,
	type: :integer,
	description: "port",
	suggestions: [
	2020
	]
	},
	%{
	key: :scheme,
	type: :string,
	description: "Scheme",
	suggestions: [
	"https",
	"https"
	]
	}
	]
	},
	%{
	key: :instrumenters,
	type: {:list, :module},
	suggestions: [Pleroma.Web.Endpoint.Instrumenter]
	},
	%{
	key: :protocol,
	type: :string,
	suggestions: ["https"]
	},
	%{
	key: :secret_key_base,
	type: :string,
	suggestions: ["aK4Abxf29xU9TTDKre9coZPUgevcVCFQJe/5xP/7Lt4BEif6idBIbjupVbOrbKxl"]
	},
	%{
	key: :signing_salt,
	type: :string,
	suggestions: ["CqaoopA2"]
	},
	%{
	key: :render_errors,
	type: :keyword,
	suggestions: [view: Pleroma.Web.ErrorView, accepts: ~w(json)],
	children: [
	%{
	key: :view,
	type: :module,
	suggestions: [Pleroma.Web.ErrorView]
	},
	%{
	key: :accepts,
	type: {:list, :string},
	suggestions: ["json"]
	}
	]
	},
	%{
	key: :pubsub,
	type: :keyword,
	suggestions: [name: Pleroma.PubSub, adapter: Phoenix.PubSub.PG2],
	children: [
	%{
	key: :name,
	type: :module,
	suggestions: [Pleroma.PubSub]
	},
	%{
	key: :adapter,
	type: :module,
	suggestions: [Phoenix.PubSub.PG2]
	}
	]
	},
	%{
	key: :secure_cookie_flag,
	type: :boolean
	},
	%{
	key: :extra_cookie_attrs,
	type: {:list, :string},
	suggestions: ["SameSite=Lax"]
	}
	]
	},
	%{
	group: :pleroma,
	key: :activitypub,
	type: :group,
	description: "ActivityPub-related settings",
	children: [
	%{
	key: :unfollow_blocked,
	type: :boolean,
	description: "Whether blocks result in people getting unfollowed"
	},
	%{
	key: :outgoing_blocks,
	type: :boolean,
	description: "Whether to federate blocks to other instances"
	},
	%{
	key: :sign_object_fetches,
	type: :boolean,
	description: "Sign object fetches with HTTP signatures"
	},
	+ %{
	+ key: :note_replies_output_limit,
	+ type: :integer,
	+ description:
	+ "The number of Note replies' URIs to be included with outgoing federation (`5` to match Mastodon hardcoded value, `0` to disable the output)."
	+ },
	%{
	key: :follow_handshake_timeout,
	type: :integer,
	description: "Following handshake timeout",
	suggestions: [500]
	}
	]
	},
	%{
	group: :pleroma,
	key: :http_security,
	type: :group,
	description: "HTTP security settings",
	children: [
	%{
	key: :enabled,
	type: :boolean,
	description: "Whether the managed content security policy is enabled"
	},
	%{
	key: :sts,
	label: "STS",
	type: :boolean,
	description: "Whether to additionally send a Strict-Transport-Security header"
	},
	%{
	key: :sts_max_age,
	label: "STS max age",
	type: :integer,
	description: "The maximum age for the Strict-Transport-Security header if sent",
	suggestions: [31_536_000]
	},
	%{
	key: :ct_max_age,
	label: "CT max age",
	type: :integer,
	description: "The maximum age for the Expect-CT header if sent",
	suggestions: [2_592_000]
	},
	%{
	key: :referrer_policy,
	type: :string,
	description: "The referrer policy to use, either \"same-origin\" or \"no-referrer\"",
	suggestions: ["same-origin", "no-referrer"]
	},
	%{
	key: :report_uri,
	label: "Report URI",
	type: :string,
	description: "Adds the specified url to report-uri and report-to group in CSP header",
	suggestions: ["https://example.com/report-uri"]
	}
	]
	},
	%{
	group: :web_push_encryption,
	key: :vapid_details,
	type: :group,
	description:
	"Web Push Notifications configuration. You can use the mix task mix web_push.gen.keypair to generate it",
	children: [
	%{
	key: :subject,
	type: :string,
	description:
	"A mailto link for the administrative contact." <>
	" It's best if this email is not a personal email address, but rather a group email to the instance moderation team.",
	suggestions: ["mailto:moderators@pleroma.com"]
	},
	%{
	key: :public_key,
	type: :string,
	description: "VAPID public key",
	suggestions: ["Public key"]
	},
	%{
	key: :private_key,
	type: :string,
	description: "VAPID private key",
	suggestions: ["Private key"]
	}
	]
	},
	%{
	group: :pleroma,
	key: Pleroma.Captcha,
	type: :group,
	description: "Captcha-related settings",
	children: [
	%{
	key: :enabled,
	type: :boolean,
	description: "Whether the captcha should be shown on registration"
	},
	%{
	key: :method,
	type: :module,
	description: "The method/service to use for captcha",
	suggestions: [Pleroma.Captcha.Kocaptcha, Pleroma.Captcha.Native]
	},
	%{
	key: :seconds_valid,
	type: :integer,
	description: "The time in seconds for which the captcha is valid",
	suggestions: [60]
	}
	]
	},
	%{
	group: :pleroma,
	key: Pleroma.Captcha.Kocaptcha,
	type: :group,
	description:
	"Kocaptcha is a very simple captcha service with a single API endpoint, the source code is" <>
	" here: https://github.com/koto-bank/kocaptcha. The default endpoint (https://captcha.kotobank.ch) is hosted by the developer.",
	children: [
	%{
	key: :endpoint,
	type: :string,
	description: "The kocaptcha endpoint to use",
	suggestions: ["https://captcha.kotobank.ch"]
	}
	]
	},
	%{
	group: :pleroma,
	type: :group,
	description:
	"Allows to set a token that can be used to authenticate with the admin api without using an actual user by giving it as the `admin_token` parameter",
	children: [
	%{
	key: :admin_token,
	type: :string,
	description: "Token",
	suggestions: ["We recommend a secure random string or UUID"]
	}
	]
	},
	%{
	group: :pleroma_job_queue,
	key: :queues,
	type: :group,
	description: "[Deprecated] Replaced with `Oban`/`:queues` (keeping the same format)"
	},
	%{
	group: :pleroma,
	key: Pleroma.Federation.ActivityPub.Federator.RetryQueue,
	type: :group,
	description: "[Deprecated] See `Oban` and `:workers` sections for configuration notes",
	children: [
	%{
	key: :max_retries,
	type: :integer,
	description: "[Deprecated] Replaced as `Oban`/`:queues`/`:outgoing_federation` value"
	}
	]
	},
	%{
	group: :pleroma,
	key: Oban,
	type: :group,
	description: """
	[Oban](https://github.com/sorentwo/oban) asynchronous job processor configuration.

	Note: if you are running PostgreSQL in [`silent_mode`](https://postgresqlco.nf/en/doc/param/silent_mode?version=9.1),
	it's advised to set [`log_destination`](https://postgresqlco.nf/en/doc/param/log_destination?version=9.1) to `syslog`,
	otherwise `postmaster.log` file may grow because of "you don't own a lock of type ShareLock" warnings
	(see https://github.com/sorentwo/oban/issues/52).
	""",
	children: [
	%{
	key: :repo,
	type: :module,
	description: "Application's Ecto repo",
	suggestions: [Pleroma.Storage.Repo]
	},
	%{
	key: :verbose,
	type: {:dropdown, :atom},
	description: "Logs verbose mode",
	suggestions: [false, :error, :warn, :info, :debug]
	},
	%{
	key: :prune,
	type: [:atom, :tuple],
	description:
	"Non-retryable jobs [pruning settings](https://github.com/sorentwo/oban#pruning)",
	suggestions: [:disabled, {:maxlen, 1500}, {:maxage, 60 * 60}]
	},
	%{
	key: :queues,
	type: {:keyword, :integer},
	description:
	"Background jobs queues (keys: queues, values: max numbers of concurrent jobs)",
	suggestions: [
	activity_expiration: 10,
	attachments_cleanup: 5,
	background: 5,
	federator_incoming: 50,
	federator_outgoing: 50,
	mailer: 10,
	scheduled_activities: 10,
	transmogrifier: 20,
	web_push: 50
	],
	children: [
	%{
	key: :activity_expiration,
	type: :integer,
	description: "Activity expiration queue",
	suggestions: [10]
	},
	%{
	key: :attachments_cleanup,
	type: :integer,
	description: "Attachment deletion queue",
	suggestions: [5]
	},
	%{
	key: :background,
	type: :integer,
	description: "Background queue",
	suggestions: [5]
	},
	%{
	key: :federator_incoming,
	type: :integer,
	description: "Incoming federation queue",
	suggestions: [50]
	},
	%{
	key: :federator_outgoing,
	type: :integer,
	description: "Outgoing federation queue",
	suggestions: [50]
	},
	%{
	key: :mailer,
	type: :integer,
	description: "Email sender queue, see Pleroma.Emails.Mailer",
	suggestions: [10]
	},
	%{
	key: :scheduled_activities,
	type: :integer,
	description: "Scheduled activities queue, see Pleroma.ScheduledActivities",
	suggestions: [10]
	},
	%{
	key: :transmogrifier,
	type: :integer,
	description: "Transmogrifier queue",
	suggestions: [20]
	},
	%{
	key: :web_push,
	type: :integer,
	description: "Web push notifications queue",
	suggestions: [50]
	}
	]
	}
	]
	},
	%{
	group: :pleroma,
	key: :workers,
	type: :group,
	description: "Includes custom worker options not interpretable directly by `Oban`",
	children: [
	%{
	key: :retries,
	type: {:keyword, :integer},
	description: "Max retry attempts for failed jobs, per `Oban` queue",
	suggestions: [
	federator_incoming: 5,
	federator_outgoing: 5
	]
	}
	]
	},
	%{
	group: :pleroma,
	key: Pleroma.Web.Metadata,
	type: :group,
	description: "Metadata-related settings",
	children: [
	%{
	key: :providers,
	type: {:list, :module},
	description: "List of metadata providers to enable",
	suggestions: [
	Pleroma.Web.Metadata.Providers.OpenGraph,
	Pleroma.Web.Metadata.Providers.TwitterCard,
	Pleroma.Web.Metadata.Providers.RelMe,
	Pleroma.Web.Metadata.Providers.Feed
	]
	},
	%{
	key: :unfurl_nsfw,
	label: "Unfurl NSFW",
	type: :boolean,
	description: "When enabled NSFW attachments will be shown in previews"
	}
	]
	},
	%{
	group: :pleroma,
	key: :rich_media,
	type: :group,
	description:
	"If enabled the instance will parse metadata from attached links to generate link previews.",
	children: [
	%{
	key: :enabled,
	type: :boolean,
	description: "Enables RichMedia parsing of URLs."
	},
	%{
	key: :ignore_hosts,
	type: {:list, :string},
	description: "List of hosts which will be ignored by the metadata parser.",
	suggestions: ["accounts.google.com", "xss.website"]
	},
	%{
	key: :ignore_tld,
	label: "Ignore TLD",
	type: {:list, :string},
	description: "List TLDs (top-level domains) which will ignore for parse metadata.",
	suggestions: ["local", "localdomain", "lan"]
	},
	%{
	key: :parsers,
	type: {:list, :module},
	description: "List of Rich Media parsers.",
	suggestions: [
	Pleroma.Web.RichMedia.Parsers.MetaTagsParser,
	Pleroma.Web.RichMedia.Parsers.OEmbed,
	Pleroma.Web.RichMedia.Parsers.OGP,
	Pleroma.Web.RichMedia.Parsers.TwitterCard
	]
	},
	%{
	key: :ttl_setters,
	label: "TTL setters",
	type: {:list, :module},
	description: "List of rich media TTL setters.",
	suggestions: [
	Pleroma.Web.RichMedia.Parser.TTL.AwsSignedUrl
	]
	}
	]
	},
	%{
	group: :pleroma,
	key: :fetch_initial_posts,
	type: :group,
	description: "Fetching initial posts settings",
	children: [
	%{
	key: :enabled,
	type: :boolean,
	description: "Fetch posts when a new user is federated with"
	},
	%{
	key: :pages,
	type: :integer,
	description: "The amount of pages to fetch",
	suggestions: [5]
	}
	]
	},
	%{
	group: :auto_linker,
	key: :opts,
	type: :group,
	description: "Configuration for the auto_linker library",
	children: [
	%{
	key: :class,
	type: [:string, false],
	description: "Specify the class to be added to the generated link. Disable to clear",
	suggestions: ["auto-linker", false]
	},
	%{
	key: :rel,
	type: [:string, false],
	description: "Override the rel attribute. Disable to clear",
	suggestions: ["ugc", "noopener noreferrer", false]
	},
	%{
	key: :new_window,
	type: :boolean,
	description: "Link urls will open in new window/tab"
	},
	%{
	key: :truncate,
	type: [:integer, false],
	description:
	"Set to a number to truncate urls longer then the number. Truncated urls will end in `..`",
	suggestions: [15, false]
	},
	%{
	key: :strip_prefix,
	type: :boolean,
	description: "Strip the scheme prefix"
	},
	%{
	key: :extra,
	type: :boolean,
	description: "Link urls with rarely used schemes (magnet, ipfs, irc, etc.)"
	}
	]
	},
	%{
	group: :pleroma,
	key: Pleroma.ScheduledActivity,
	type: :group,
	description: "Scheduled activities settings",
	children: [
	%{
	key: :daily_user_limit,
	type: :integer,
	description:
	"The number of scheduled activities a user is allowed to create in a single day. Default: 25.",
	suggestions: [25]
	},
	%{
	key: :total_user_limit,
	type: :integer,
	description:
	"The number of scheduled activities a user is allowed to create in total. Default: 300.",
	suggestions: [300]
	},
	%{
	key: :enabled,
	type: :boolean,
	description: "Whether scheduled activities are sent to the job queue to be executed"
	}
	]
	},
	%{
	group: :pleroma,
	key: Pleroma.ActivityExpiration,
	type: :group,
	description: "Expired activity settings",
	children: [
	%{
	key: :enabled,
	type: :boolean,
	description: "Whether expired activities will be sent to the job queue to be deleted"
	}
	]
	},
	%{
	group: :pleroma,
	type: :group,
	description: "Authenticator",
	children: [
	%{
	key: Pleroma.Web.Auth.Authenticator,
	type: :module,
	suggestions: [Pleroma.Web.Auth.PleromaAuthenticator, Pleroma.Web.Auth.LDAPAuthenticator]
	}
	]
	},
	%{
	group: :pleroma,
	key: :ldap,
	type: :group,
	description:
	"Use LDAP for user authentication. When a user logs in to the Pleroma instance, the name and password" <>
	" will be verified by trying to authenticate (bind) to a LDAP server." <>
	" If a user exists in the LDAP directory but there is no account with the same name yet on the" <>
	" Pleroma instance then a new Pleroma account will be created with the same name as the LDAP user name.",
	children: [
	%{
	key: :enabled,
	type: :boolean,
	description: "Enables LDAP authentication"
	},
	%{
	key: :host,
	type: :string,
	description: "LDAP server hostname",
	suggestions: ["localhosts"]
	},
	%{
	key: :port,
	type: :integer,
	description: "LDAP port, e.g. 389 or 636",
	suggestions: [389, 636]
	},
	%{
	key: :ssl,
	label: "SSL",
	type: :boolean,
	description: "Enable to use SSL, usually implies the port 636"
	},
	%{
	key: :sslopts,
	label: "SSL options",
	type: :keyword,
	description: "Additional SSL options",
	suggestions: [cacertfile: "path/to/file/with/PEM/cacerts", verify: :verify_peer],
	children: [
	%{
	key: :cacertfile,
	type: :string,
	description: "Path to file with PEM encoded cacerts",
	suggestions: ["path/to/file/with/PEM/cacerts"]
	},
	%{
	key: :verify,
	type: :atom,
	description: "Type of cert verification",
	suggestions: [:verify_peer]
	}
	]
	},
	%{
	key: :tls,
	label: "TLS",
	type: :boolean,
	description: "Enable to use STARTTLS, usually implies the port 389"
	},
	%{
	key: :tlsopts,
	label: "TLS options",
	type: :keyword,
	description: "Additional TLS options",
	suggestions: [cacertfile: "path/to/file/with/PEM/cacerts", verify: :verify_peer],
	children: [
	%{
	key: :cacertfile,
	type: :string,
	description: "Path to file with PEM encoded cacerts",
	suggestions: ["path/to/file/with/PEM/cacerts"]
	},
	%{
	key: :verify,
	type: :atom,
	description: "Type of cert verification",
	suggestions: [:verify_peer]
	}
	]
	},
	%{
	key: :base,
	type: :string,
	description: "LDAP base, e.g. \"dc=example,dc=com\"",
	suggestions: ["dc=example,dc=com"]
	},
	%{
	key: :uid,
	type: :string,
	description:
	"LDAP attribute name to authenticate the user, e.g. when \"cn\", the filter will be \"cn=username,base\"",
	suggestions: ["cn"]
	}
	]
	},
	%{
	group: :pleroma,
	key: :auth,
	type: :group,
	description: "Authentication / authorization settings",
	children: [
	%{
	key: :enforce_oauth_admin_scope_usage,
	type: :boolean,
	description:
	"OAuth admin scope requirement toggle. " <>
	"If enabled, admin actions explicitly demand admin OAuth scope(s) presence in OAuth token " <>
	"(client app must support admin scopes). If disabled and token doesn't have admin scope(s)," <>
	"`is_admin` user flag grants access to admin-specific actions."
	},
	%{
	key: :auth_template,
	type: :string,
	description:
	"Authentication form template. By default it's `show.html` which corresponds to `lib/web/templates/o_auth/o_auth/show.html.ee`.",
	suggestions: ["show.html"]
	},
	%{
	key: :oauth_consumer_template,
	type: :string,
	description:
	"OAuth consumer mode authentication form template. By default it's `consumer.html` which corresponds to" <>
	" `lib/web/templates/o_auth/o_auth/consumer.html.eex`.",
	suggestions: ["consumer.html"]
	},
	%{
	key: :oauth_consumer_strategies,
	type: {:list, :string},
	description:
	"The list of enabled OAuth consumer strategies. By default it's set by OAUTH_CONSUMER_STRATEGIES environment variable." <>
	" Each entry in this space-delimited string should be of format \"strategy\" or \"strategy:dependency\"" <>
	" (e.g. twitter or keycloak:ueberauth_keycloak_strategy in case dependency is named differently than ueberauth_<strategy>).",
	suggestions: ["twitter", "keycloak:ueberauth_keycloak_strategy"]
	}
	]
	},
	%{
	group: :pleroma,
	key: :email_notifications,
	type: :group,
	description: "Email notifications settings",
	children: [
	%{
	key: :digest,
	type: :map,
	description:
	"emails of \"what you've missed\" for users who have been inactive for a while",
	suggestions: [
	%{
	active: false,
	schedule: "0 0 * * 0",
	interval: 7,
	inactivity_threshold: 7
	}
	],
	children: [
	%{
	key: :active,
	type: :boolean,
	description: "Globally enable or disable digest emails"
	},
	%{
	key: :schedule,
	type: :string,
	description:
	"When to send digest email, in crontab format. \"0 0 0\" is the default, meaning \"once a week at midnight on Sunday morning\".",
	suggestions: ["0 0 * * 0"]
	},
	%{
	key: :interval,
	type: :integer,
	description: "Minimum interval between digest emails to one user",
	suggestions: [7]
	},
	%{
	key: :inactivity_threshold,
	type: :integer,
	description: "Minimum user inactivity threshold",
	suggestions: [7]
	}
	]
	}
	]
	},
	%{
	group: :pleroma,
	key: Pleroma.Emails.UserEmail,
	type: :group,
	description: "Email template settings",
	children: [
	%{
	key: :logo,
	type: :string,
	description: "A path to a custom logo. Set it to `nil` to use the default Pleroma logo.",
	suggestions: ["some/path/logo.png"]
	},
	%{
	key: :styling,
	type: :map,
	description: "a map with color settings for email templates.",
	suggestions: [
	%{
	link_color: "#d8a070",
	background_color: "#2C3645",
	content_background_color: "#1B2635",
	header_color: "#d8a070",
	text_color: "#b9b9ba",
	text_muted_color: "#b9b9ba"
	}
	],
	children: [
	%{
	key: :link_color,
	type: :string,
	suggestions: ["#d8a070"]
	},
	%{
	key: :background_color,
	type: :string,
	suggestions: ["#2C3645"]
	},
	%{
	key: :content_background_color,
	type: :string,
	suggestions: ["#1B2635"]
	},
	%{
	key: :header_color,
	type: :string,
	suggestions: ["#d8a070"]
	},
	%{
	key: :text_color,
	type: :string,
	suggestions: ["#b9b9ba"]
	},
	%{
	key: :text_muted_color,
	type: :string,
	suggestions: ["#b9b9ba"]
	}
	]
	}
	]
	},
	%{
	group: :pleroma,
	key: Pleroma.Emails.NewUsersDigestEmail,
	type: :group,
	description: "New users admin email digest",
	children: [
	%{
	key: :enabled,
	type: :boolean,
	description: "enables new users admin digest email when `true`",
	suggestions: [false]
	}
	]
	},
	%{
	group: :pleroma,
	key: :oauth2,
	type: :group,
	description: "Configure OAuth 2 provider capabilities",
	children: [
	%{
	key: :token_expires_in,
	type: :integer,
	description: "The lifetime in seconds of the access token",
	suggestions: [600]
	},
	%{
	key: :issue_new_refresh_token,
	type: :boolean,
	description:
	"Keeps old refresh token or generate new refresh token when to obtain an access token"
	},
	%{
	key: :clean_expired_tokens,
	type: :boolean,
	description: "Enable a background job to clean expired oauth tokens. Default: disabled."
	}
	]
	},
	%{
	group: :pleroma,
	key: :emoji,
	type: :group,
	children: [
	%{
	key: :shortcode_globs,
	type: {:list, :string},
	description: "Location of custom emoji files. * can be used as a wildcard.",
	suggestions: ["/emoji/custom/*/.png"]
	},
	%{
	key: :pack_extensions,
	type: {:list, :string},
	description:
	"A list of file extensions for emojis, when no emoji.txt for a pack is present",
	suggestions: [".png", ".gif"]
	},
	%{
	key: :groups,
	type: {:keyword, :string, {:list, :string}},
	description:
	"Emojis are ordered in groups (tags). This is an array of key-value pairs where the key is the group name" <>
	" and the value is the location or array of locations. * can be used as a wildcard.",
	suggestions: [
	Custom: ["/emoji/.png", "/emoji//.png"]
	]
	},
	%{
	key: :default_manifest,
	type: :string,
	description:
	"Location of the JSON-manifest. This manifest contains information about the emoji-packs you can download." <>
	" Currently only one manifest can be added (no arrays).",
	suggestions: ["https://git.pleroma.social/pleroma/emoji-index/raw/master/index.json"]
	},
	%{
	key: :shared_pack_cache_seconds_per_file,
	label: "Shared pack cache s/file",
	type: :integer,
	descpiption:
	"When an emoji pack is shared, the archive is created and cached in memory" <>
	" for this amount of seconds multiplied by the number of files.",
	suggestions: [60]
	}
	]
	},
	%{
	group: :pleroma,
	key: :database,
	type: :group,
	description: "Database related settings",
	children: [
	%{
	key: :rum_enabled,
	type: :boolean,
	description: "If RUM indexes should be used. Default: disabled"
	}
	]
	},
	%{
	group: :pleroma,
	key: :rate_limit,
	type: :group,
	description:
	"Rate limit settings. This is an advanced feature enabled only for :authentication by default.",
	children: [
	%{
	key: :search,
	type: [:tuple, {:list, :tuple}],
	description: "For the search requests (account & status search etc.)",
	suggestions: [{1000, 10}, [{10_000, 10}, {10_000, 50}]]
	},
	%{
	key: :app_account_creation,
	type: [:tuple, {:list, :tuple}],
	description: "For registering user accounts from the same IP address",
	suggestions: [{1000, 10}, [{10_000, 10}, {10_000, 50}]]
	},
	%{
	key: :relations_actions,
	type: [:tuple, {:list, :tuple}],
	description: "For actions on relations with all users (follow, unfollow)",
	suggestions: [{1000, 10}, [{10_000, 10}, {10_000, 50}]]
	},
	%{
	key: :relation_id_action,
	type: [:tuple, {:list, :tuple}],
	description: "For actions on relation with a specific user (follow, unfollow)",
	suggestions: [{1000, 10}, [{10_000, 10}, {10_000, 50}]]
	},
	%{
	key: :statuses_actions,
	type: [:tuple, {:list, :tuple}],
	description:
	"For create / delete / fav / unfav / reblog / unreblog actions on any statuses",
	suggestions: [{1000, 10}, [{10_000, 10}, {10_000, 50}]]
	},
	%{
	key: :status_id_action,
	type: [:tuple, {:list, :tuple}],
	description:
	"For fav / unfav or reblog / unreblog actions on the same status by the same user",
	suggestions: [{1000, 10}, [{10_000, 10}, {10_000, 50}]]
	},
	%{
	key: :authentication,
	type: [:tuple, {:list, :tuple}],
	description: "For authentication create / password check / user existence check requests",
	suggestions: [{60_000, 15}]
	}
	]
	},
	%{
	group: :esshd,
	type: :group,
	description:
	"Before enabling this you must add :esshd to mix.exs as one of the extra_applications " <>
	"and generate host keys in your priv dir with ssh-keygen -m PEM -N \"\" -b 2048 -t rsa -f ssh_host_rsa_key",
	children: [
	%{
	key: :enabled,
	type: :boolean,
	description: "Enables SSH"
	},
	%{
	key: :priv_dir,
	type: :string,
	description: "Dir with SSH keys",
	suggestions: ["/some/path/ssh_keys"]
	},
	%{
	key: :handler,
	type: :string,
	description: "Handler module",
	suggestions: ["Pleroma.BBS.Handler"]
	},
	%{
	key: :port,
	type: :integer,
	description: "Port to connect",
	suggestions: [10_022]
	},
	%{
	key: :password_authenticator,
	type: :string,
	description: "Authenticator module",
	suggestions: ["Pleroma.BBS.Authenticator"]
	}
	]
	},
	%{
	group: :mime,
	type: :group,
	description: "Mime types",
	children: [
	%{
	key: :types,
	type: :map,
	suggestions: [
	%{
	"application/xml" => ["xml"],
	"application/xrd+xml" => ["xrd+xml"],
	"application/jrd+json" => ["jrd+json"],
	"application/activity+json" => ["activity+json"],
	"application/ld+json" => ["activity+json"]
	}
	],
	children: [
	%{
	key: "application/xml",
	type: {:list, :string},
	suggestions: ["xml"]
	},
	%{
	key: "application/xrd+xml",
	type: {:list, :string},
	suggestions: ["xrd+xml"]
	},
	%{
	key: "application/jrd+json",
	type: {:list, :string},
	suggestions: ["jrd+json"]
	},
	%{
	key: "application/activity+json",
	type: {:list, :string},
	suggestions: ["activity+json"]
	},
	%{
	key: "application/ld+json",
	type: {:list, :string},
	suggestions: ["activity+json"]
	}
	]
	}
	]
	},
	%{
	group: :tesla,
	type: :group,
	description: "Tesla settings",
	children: [
	%{
	key: :adapter,
	type: :module,
	description: "Tesla adapter",
	suggestions: [Tesla.Adapter.Hackney]
	}
	]
	},
	%{
	group: :pleroma,
	key: :chat,
	type: :group,
	description: "Pleroma chat settings",
	children: [
	%{
	key: :enabled,
	type: :boolean
	}
	]
	},
	%{
	group: :prometheus,
	key: Pleroma.Web.Endpoint.MetricsExporter,
	type: :group,
	description: "Prometheus settings",
	children: [
	%{
	key: :path,
	type: :string,
	description: "API endpoint with metrics",
	suggestions: ["/api/pleroma/app_metrics"]
	}
	]
	},
	%{
	group: :http_signatures,
	type: :group,
	description: "HTTP Signatures settings",
	children: [
	%{
	key: :adapter,
	type: :module,
	suggestions: [Pleroma.Federation.HTTPSignatures.Signature]
	}
	]
	},
	%{
	group: :pleroma,
	key: :http,
	type: :group,
	description: "HTTP settings",
	children: [
	%{
	key: :proxy_url,
	label: "Proxy URL",
	type: [:string, :tuple],
	description: "Proxy URL",
	suggestions: ["localhost:9020", {:socks5, :localhost, 3090}]
	},
	%{
	key: :send_user_agent,
	type: :boolean
	},
	%{
	key: :user_agent,
	type: [:string, :atom],
	description:
	"What user agent to use. Must be a string or an atom `:default`. Default value is `:default`.",
	suggestions: ["Pleroma", :default]
	},
	%{
	key: :adapter,
	type: :keyword,
	description: "Adapter specific options",
	suggestions: [],
	children: [
	%{
	key: :ssl_options,
	type: :keyword,
	label: "SSL Options",
	description: "SSL options for HTTP adapter",
	children: [
	%{
	key: :versions,
	type: {:list, :atom},
	description: "List of TLS version to use",
	suggestions: [:tlsv1, ":tlsv1.1", ":tlsv1.2"]
	}
	]
	}
	]
	}
	]
	},
	%{
	group: :pleroma,
	key: :markup,
	type: :group,
	children: [
	%{
	key: :allow_inline_images,
	type: :boolean
	},
	%{
	key: :allow_headings,
	type: :boolean
	},
	%{
	key: :allow_tables,
	type: :boolean
	},
	%{
	key: :allow_fonts,
	type: :boolean
	},
	%{
	key: :scrub_policy,
	type: {:list, :module},
	suggestions: [Pleroma.HTML.Transform.MediaProxy, Pleroma.HTML.Scrubber.Default]
	}
	]
	},
	%{
	group: :pleroma,
	key: :user,
	type: :group,
	children: [
	%{
	key: :deny_follow_blocked,
	type: :boolean
	}
	]
	},
	%{
	group: :pleroma,
	key: :mrf_normalize_markup,
	label: "MRF normalize markup",
	description: "MRF NormalizeMarkup settings. Scrub configured hypertext markup.",
	type: :group,
	children: [
	%{
	key: :scrub_policy,
	type: :module,
	suggestions: [Pleroma.HTML.Scrubber.Default]
	}
	]
	},
	%{
	group: :pleroma,
	key: Pleroma.User,
	type: :group,
	children: [
	%{
	key: :restricted_nicknames,
	type: {:list, :string},
	suggestions: [
	".well-known",
	"~",
	"about",
	"activities",
	"api",
	"auth",
	"check_password",
	"dev",
	"friend-requests",
	"inbox",
	"internal",
	"main",
	"media",
	"nodeinfo",
	"notice",
	"oauth",
	"objects",
	"ostatus_subscribe",
	"pleroma",
	"proxy",
	"push",
	"registration",
	"relay",
	"settings",
	"status",
	"tag",
	"user-search",
	"user_exists",
	"users",
	"web"
	]
	}
	]
	},
	%{
	group: :cors_plug,
	type: :group,
	children: [
	%{
	key: :max_age,
	type: :integer,
	suggestions: [86_400]
	},
	%{
	key: :methods,
	type: {:list, :string},
	suggestions: ["POST", "PUT", "DELETE", "GET", "PATCH", "OPTIONS"]
	},
	%{
	key: :expose,
	type: {:list, :string},
	suggestions: [
	"Link",
	"X-RateLimit-Reset",
	"X-RateLimit-Limit",
	"X-RateLimit-Remaining",
	"X-Request-Id",
	"Idempotency-Key"
	]
	},
	%{
	key: :credentials,
	type: :boolean
	},
	%{
	key: :headers,
	type: {:list, :string},
	suggestions: ["Authorization", "Content-Type", "Idempotency-Key"]
	}
	]
	},
	%{
	group: :pleroma,
	key: Pleroma.Plugs.RemoteIp,
	type: :group,
	description: """
	`Pleroma.Plugs.RemoteIp` is a shim to call [`RemoteIp`](https://git.pleroma.social/pleroma/remote_ip) but with runtime configuration.
	If your instance is not behind at least one reverse proxy, you should not enable this plug.
	""",
	children: [
	%{
	key: :enabled,
	type: :boolean,
	description: "Enable/disable the plug. Default: disabled."
	},
	%{
	key: :headers,
	type: {:list, :string},
	description:
	"A list of strings naming the `req_headers` to use when deriving the `remote_ip`. Order does not matter. Default: `~w[forwarded x-forwarded-for x-client-ip x-real-ip]`."
	},
	%{
	key: :proxies,
	type: {:list, :string},
	description:
	"A list of strings in [CIDR](https://en.wikipedia.org/wiki/CIDR) notation specifying the IPs of known proxies. Default: `[]`."
	},
	%{
	key: :reserved,
	type: {:list, :string},
	description:
	"Defaults to [localhost](https://en.wikipedia.org/wiki/Localhost) and [private network](https://en.wikipedia.org/wiki/Private_network)."
	}
	]
	},
	%{
	group: :pleroma,
	key: :web_cache_ttl,
	type: :group,
	description:
	"The expiration time for the web responses cache. Values should be in milliseconds or `nil` to disable expiration.",
	children: [
	%{
	key: :activity_pub,
	type: :integer,
	description:
	"Activity pub routes (except question activities). Default: `nil` (no expiration).",
	suggestions: [30_000, nil]
	},
	%{
	key: :activity_pub_question,
	type: :integer,
	description: "Activity pub routes (question activities). Default: `30_000` (30 seconds).",
	suggestions: [30_000]
	}
	]
	},
	%{
	group: :pleroma,
	key: :static_fe,
	type: :group,
	description:
	"Render profiles and posts using server-generated HTML that is viewable without using JavaScript.",
	children: [
	%{
	key: :enabled,
	type: :boolean,
	description: "Enables the rendering of static HTML. Default: disabled."
	}
	]
	},
	%{
	group: :pleroma,
	key: :feed,
	type: :group,
	description: "Configure feed rendering.",
	children: [
	%{
	key: :post_title,
	type: :map,
	description: "Configure title rendering.",
	children: [
	%{
	key: :max_length,
	type: :integer,
	description: "Maximum number of characters before truncating title.",
	suggestions: [100]
	},
	%{
	key: :omission,
	type: :string,
	description: "Replacement which will be used after truncating string.",
	suggestions: ["..."]
	}
	]
	}
	]
	},
	%{
	group: :pleroma,
	key: :mrf_object_age,
	type: :group,
	description: "Rejects or delists posts based on their age when received.",
	children: [
	%{
	key: :threshold,
	type: :integer,
	description: "Required age (in seconds) of a post before actions are taken.",
	suggestions: [172_800]
	},
	%{
	key: :actions,
	type: {:list, :atom},
	description:
	"A list of actions to apply to the post. `:delist` removes the post from public timelines; " <>
	"`:strip_followers` removes followers from the ActivityPub recipient list, ensuring they won't be delivered to home timelines; " <>
	"`:reject` rejects the message entirely",
	suggestions: [:delist, :strip_followers, :reject]
	}
	]
	},
	%{
	group: :pleroma,
	key: :modules,
	type: :group,
	description: "Custom Runtime Modules.",
	children: [
	%{
	key: :runtime_dir,
	type: :string,
	description: "A path to custom Elixir modules (such as MRF policies)."
	}
	]
	},
	%{
	group: :pleroma,
	type: :group,
	description: "Allow instance configuration from database.",
	children: [
	%{
	key: :configurable_from_database,
	type: :boolean,
	description:
	"Allow transferring configuration to DB with the subsequent customization from Admin api. Default: disabled"
	}
	]
	}
	]
	diff --git a/docs/API/admin_api.md b/docs/API/admin_api.md
	index d357228f1..2f035ac27 100644
	--- a/docs/API/admin_api.md
	+++ b/docs/API/admin_api.md
	@@ -1,941 +1,958 @@
	# Admin API

	Authentication is required and the user must be an admin.

	Configuration options:

	* `[:auth, :enforce_oauth_admin_scope_usage]` — OAuth admin scope requirement toggle.
	If `true`, admin actions explicitly demand admin OAuth scope(s) presence in OAuth token (client app must support admin scopes).
	If `false` and token doesn't have admin scope(s), `is_admin` user flag grants access to admin-specific actions.
	Note that client app needs to explicitly support admin scopes and request them when obtaining auth token.

	## `GET /api/pleroma/admin/users`

	### List users

	- Query Params:
	- optional `query`: string search term (e.g. nickname, domain, nickname@domain)
	- optional `filters`: string comma-separated string of filters:
	- `local`: only local users
	- `external`: only external users
	- `active`: only active users
	- `deactivated`: only deactivated users
	- `is_admin`: users with admin role
	- `is_moderator`: users with moderator role
	- optional `page`: integer page number
	- optional `page_size`: integer number of users per page (default is `50`)
	- optional `tags`: [string] tags list
	- optional `name`: string user display name
	- optional `email`: string user email
	- Example: `https://mypleroma.org/api/pleroma/admin/users?query=john&filters=local,active&page=1&page_size=10&tags[]=some_tag&tags[]=another_tag&name=display_name&email=email@example.com`
	- Response:

	```json
	{
	"page_size": integer,
	"count": integer,
	"users": [
	{
	"deactivated": bool,
	"id": integer,
	"nickname": string,
	"roles": {
	"admin": bool,
	"moderator": bool
	},
	"local": bool,
	"tags": array,
	"avatar": string,
	"display_name": string
	},
	...
	]
	}
	```

	## DEPRECATED `DELETE /api/pleroma/admin/users`

	### Remove a user

	- Params:
	- `nickname`
	- Response: User’s nickname

	## `DELETE /api/pleroma/admin/users`

	### Remove a user

	- Params:
	- `nicknames`
	- Response: Array of user nicknames

	### Create a user

	- Method: `POST`
	- Params:
	`users`: [
	{
	`nickname`,
	`email`,
	`password`
	}
	]
	- Response: User’s nickname

	## `POST /api/pleroma/admin/users/follow`

	### Make a user follow another user

	- Params:
	- `follower`: The nickname of the follower
	- `followed`: The nickname of the followed
	- Response:
	- "ok"

	## `POST /api/pleroma/admin/users/unfollow`

	### Make a user unfollow another user

	- Params:
	- `follower`: The nickname of the follower
	- `followed`: The nickname of the followed
	- Response:
	- "ok"

	## `PATCH /api/pleroma/admin/users/:nickname/toggle_activation`

	### Toggle user activation

	- Params:
	- `nickname`
	- Response: User’s object

	```json
	{
	"deactivated": bool,
	"id": integer,
	"nickname": string
	}
	```

	## `PUT /api/pleroma/admin/users/tag`

	### Tag a list of users

	- Params:
	- `nicknames` (array)
	- `tags` (array)

	## `DELETE /api/pleroma/admin/users/tag`

	### Untag a list of users

	- Params:
	- `nicknames` (array)
	- `tags` (array)

	## `GET /api/pleroma/admin/users/:nickname/permission_group`

	### Get user user permission groups membership

	- Params: none
	- Response:

	```json
	{
	"is_moderator": bool,
	"is_admin": bool
	}
	```

	## `GET /api/pleroma/admin/users/:nickname/permission_group/:permission_group`

	Note: Available `:permission_group` is currently moderator and admin. 404 is returned when the permission group doesn’t exist.

	### Get user user permission groups membership per permission group

	- Params: none
	- Response:

	```json
	{
	"is_moderator": bool,
	"is_admin": bool
	}
	```

	## DEPRECATED `POST /api/pleroma/admin/users/:nickname/permission_group/:permission_group`

	### Add user to permission group

	- Params: none
	- Response:
	- On failure: `{"error": "…"}`
	- On success: JSON of the user

	## `POST /api/pleroma/admin/users/permission_group/:permission_group`

	### Add users to permission group

	- Params:
	- `nicknames`: nicknames array
	- Response:
	- On failure: `{"error": "…"}`
	- On success: JSON of the user

	## DEPRECATED `DELETE /api/pleroma/admin/users/:nickname/permission_group/:permission_group`

	## `DELETE /api/pleroma/admin/users/:nickname/permission_group/:permission_group`

	### Remove user from permission group

	- Params: none
	- Response:
	- On failure: `{"error": "…"}`
	- On success: JSON of the user
	- Note: An admin cannot revoke their own admin status.

	## `DELETE /api/pleroma/admin/users/permission_group/:permission_group`

	### Remove users from permission group

	- Params:
	- `nicknames`: nicknames array
	- Response:
	- On failure: `{"error": "…"}`
	- On success: JSON of the user
	- Note: An admin cannot revoke their own admin status.

	## `PATCH /api/pleroma/admin/users/activate`

	### Activate user

	- Params:
	- `nicknames`: nicknames array
	- Response:

	```json
	{
	users: [
	{
	// user object
	}
	]
	}
	```

	## `PATCH /api/pleroma/admin/users/deactivate`

	### Deactivate user

	- Params:
	- `nicknames`: nicknames array
	- Response:

	```json
	{
	users: [
	{
	// user object
	}
	]
	}
	```

	## `GET /api/pleroma/admin/users/:nickname_or_id`

	### Retrive the details of a user

	- Params:
	- `nickname` or `id`
	- Response:
	- On failure: `Not found`
	- On success: JSON of the user

	## `GET /api/pleroma/admin/users/:nickname_or_id/statuses`

	### Retrive user's latest statuses

	- Params:
	- `nickname` or `id`
	- optional `page_size`: number of statuses to return (default is `20`)
	- optional `godmode`: `true`/`false` – allows to see private statuses
	- Response:
	- On failure: `Not found`
	- On success: JSON array of user's latest statuses

	## `POST /api/pleroma/admin/relay`

	### Follow a Relay

	- Params:
	- `relay_url`
	- Response:
	- On success: URL of the followed relay

	## `DELETE /api/pleroma/admin/relay`

	### Unfollow a Relay

	- Params:
	- `relay_url`
	- Response:
	- On success: URL of the unfollowed relay

	## `GET /api/pleroma/admin/relay`

	### List Relays

	- Params: none
	- Response:
	- On success: JSON array of relays

	## `POST /api/pleroma/admin/users/invite_token`

	### Create an account registration invite token

	- Params:
	- optional `max_use` (integer)
	- optional `expires_at` (date string e.g. "2019-04-07")
	- Response:

	```json
	{
	"id": integer,
	"token": string,
	"used": boolean,
	"expires_at": date,
	"uses": integer,
	"max_use": integer,
	"invite_type": string (possible values: `one_time`, `reusable`, `date_limited`, `reusable_date_limited`)
	}
	```

	## `GET /api/pleroma/admin/users/invites`

	### Get a list of generated invites

	- Params: none
	- Response:

	```json
	{

	"invites": [
	{
	"id": integer,
	"token": string,
	"used": boolean,
	"expires_at": date,
	"uses": integer,
	"max_use": integer,
	"invite_type": string (possible values: `one_time`, `reusable`, `date_limited`, `reusable_date_limited`)
	},
	...
	]
	}
	```

	## `POST /api/pleroma/admin/users/revoke_invite`

	### Revoke invite by token

	- Params:
	- `token`
	- Response:

	```json
	{
	"id": integer,
	"token": string,
	"used": boolean,
	"expires_at": date,
	"uses": integer,
	"max_use": integer,
	"invite_type": string (possible values: `one_time`, `reusable`, `date_limited`, `reusable_date_limited`)

	}
	```

	## `POST /api/pleroma/admin/users/email_invite`

	### Sends registration invite via email

	- Params:
	- `email`
	- `name`, optional

	## `GET /api/pleroma/admin/users/:nickname/password_reset`

	### Get a password reset token for a given nickname

	- Params: none
	- Response:

	```json
	{
	"token": "base64 reset token",
	"link": "https://pleroma.social/api/pleroma/password_reset/url-encoded-base64-token"
	}
	```

	## `PATCH /api/pleroma/admin/users/force_password_reset`

	### Force passord reset for a user with a given nickname

	- Params:
	- `nicknames`
	- Response: none (code `204`)

	## `GET /api/pleroma/admin/reports`

	### Get a list of reports

	- Params:
	- optional `state`: string the state of reports. Valid values are `open`, `closed` and `resolved`
	- optional `limit`: integer the number of records to retrieve
	- optional `page`: integer page number
	- optional `page_size`: integer number of log entries per page (default is `50`)
	- Response:
	- On failure: 403 Forbidden error `{"error": "error_msg"}` when requested by anonymous or non-admin
	- On success: JSON, returns a list of reports, where:
	- `account`: the user who has been reported
	- `actor`: the user who has sent the report
	- `statuses`: list of statuses that have been included to the report

	```json
	{
	"totalReports" : 1,
	"reports": [
	{
	"account": {
	"acct": "user",
	"avatar": "https://pleroma.example.org/images/avi.png",
	"avatar_static": "https://pleroma.example.org/images/avi.png",
	"bot": false,
	"created_at": "2019-04-23T17:32:04.000Z",
	"display_name": "User",
	"emojis": [],
	"fields": [],
	"followers_count": 1,
	"following_count": 1,
	"header": "https://pleroma.example.org/images/banner.png",
	"header_static": "https://pleroma.example.org/images/banner.png",
	"id": "9i6dAJqSGSKMzLG2Lo",
	"locked": false,
	"note": "",
	"pleroma": {
	"confirmation_pending": false,
	"hide_favorites": true,
	"hide_followers": false,
	"hide_follows": false,
	"is_admin": false,
	"is_moderator": false,
	"relationship": {},
	"tags": []
	},
	"source": {
	"note": "",
	"pleroma": {},
	"sensitive": false
	},
	"tags": ["force_unlisted"],
	"statuses_count": 3,
	"url": "https://pleroma.example.org/users/user",
	"username": "user"
	},
	"actor": {
	"acct": "lain",
	"avatar": "https://pleroma.example.org/images/avi.png",
	"avatar_static": "https://pleroma.example.org/images/avi.png",
	"bot": false,
	"created_at": "2019-03-28T17:36:03.000Z",
	"display_name": "Roger Braun",
	"emojis": [],
	"fields": [],
	"followers_count": 1,
	"following_count": 1,
	"header": "https://pleroma.example.org/images/banner.png",
	"header_static": "https://pleroma.example.org/images/banner.png",
	"id": "9hEkA5JsvAdlSrocam",
	"locked": false,
	"note": "",
	"pleroma": {
	"confirmation_pending": false,
	"hide_favorites": false,
	"hide_followers": false,
	"hide_follows": false,
	"is_admin": false,
	"is_moderator": false,
	"relationship": {},
	"tags": []
	},
	"source": {
	"note": "",
	"pleroma": {},
	"sensitive": false
	},
	"tags": ["force_unlisted"],
	"statuses_count": 1,
	"url": "https://pleroma.example.org/users/lain",
	"username": "lain"
	},
	"content": "Please delete it",
	"created_at": "2019-04-29T19:48:15.000Z",
	"id": "9iJGOv1j8hxuw19bcm",
	"state": "open",
	"statuses": [
	{
	"account": { ... },
	"application": {
	"name": "Web",
	"website": null
	},
	"bookmarked": false,
	"card": null,
	"content": "<span class=\"h-card\"><a data-user=\"9hEkA5JsvAdlSrocam\" class=\"u-url mention\" href=\"https://pleroma.example.org/users/lain\">@<span>lain</span></a></span> click on my link <a href=\"https://www.google.com/\">https://www.google.com/</a>",
	"created_at": "2019-04-23T19:15:47.000Z",
	"emojis": [],
	"favourited": false,
	"favourites_count": 0,
	"id": "9i6mQ9uVrrOmOime8m",
	"in_reply_to_account_id": null,
	"in_reply_to_id": null,
	"language": null,
	"media_attachments": [],
	"mentions": [
	{
	"acct": "lain",
	"id": "9hEkA5JsvAdlSrocam",
	"url": "https://pleroma.example.org/users/lain",
	"username": "lain"
	},
	{
	"acct": "user",
	"id": "9i6dAJqSGSKMzLG2Lo",
	"url": "https://pleroma.example.org/users/user",
	"username": "user"
	}
	],
	"muted": false,
	"pinned": false,
	"pleroma": {
	"content": {
	"text/plain": "@lain click on my link https://www.google.com/"
	},
	"conversation_id": 28,
	"in_reply_to_account_acct": null,
	"local": true,
	"spoiler_text": {
	"text/plain": ""
	}
	},
	"reblog": null,
	"reblogged": false,
	"reblogs_count": 0,
	"replies_count": 0,
	"sensitive": false,
	"spoiler_text": "",
	"tags": [],
	"uri": "https://pleroma.example.org/objects/8717b90f-8e09-4b58-97b0-e3305472b396",
	"url": "https://pleroma.example.org/notice/9i6mQ9uVrrOmOime8m",
	"visibility": "direct"
	}
	]
	}
	]
	}
	```

	## `GET /api/pleroma/admin/grouped_reports`

	### Get a list of reports, grouped by status

	- Params: none
	- On success: JSON, returns a list of reports, where:
	- `date`: date of the latest report
	- `account`: the user who has been reported (see `/api/pleroma/admin/reports` for reference)
	- `status`: reported status (see `/api/pleroma/admin/reports` for reference)
	- `actors`: users who had reported this status (see `/api/pleroma/admin/reports` for reference)
	- `reports`: reports (see `/api/pleroma/admin/reports` for reference)

	```json
	"reports": [
	{
	"date": "2019-10-07T12:31:39.615149Z",
	"account": { ... },
	"status": { ... },
	"actors": [{ ... }, { ... }],
	"reports": [{ ... }]
	}
	]
	```

	## `GET /api/pleroma/admin/reports/:id`

	### Get an individual report

	- Params:
	- `id`
	- Response:
	- On failure:
	- 403 Forbidden `{"error": "error_msg"}`
	- 404 Not Found `"Not found"`
	- On success: JSON, Report object (see above)

	## `PATCH /api/pleroma/admin/reports`

	### Change the state of one or multiple reports

	- Params:

	```json
	`reports`: [
	{
	`id`, // required, report id
	`state` // required, the new state. Valid values are `open`, `closed` and `resolved`
	},
	...
	]
	```

	- Response:
	- On failure:
	- 400 Bad Request, JSON:

	```json
	[
	{
	`id`, // report id
	`error` // error message
	}
	]
	```

	- On success: `204`, empty response

	## `POST /api/pleroma/admin/reports/:id/notes`

	### Create report note

	- Params:
	- `id`: required, report id
	- `content`: required, the message
	- Response:
	- On failure:
	- 400 Bad Request `"Invalid parameters"` when `status` is missing
	- On success: `204`, empty response

	## `POST /api/pleroma/admin/reports/:report_id/notes/:id`

	### Delete report note

	- Params:
	- `report_id`: required, report id
	- `id`: required, note id
	- Response:
	- On failure:
	- 400 Bad Request `"Invalid parameters"` when `status` is missing
	- On success: `204`, empty response

	## `PUT /api/pleroma/admin/statuses/:id`

	### Change the scope of an individual reported status

	- Params:
	- `id`
	- `sensitive`: optional, valid values are `true` or `false`
	- `visibility`: optional, valid values are `public`, `private` and `unlisted`
	- Response:
	- On failure:
	- 400 Bad Request `"Unsupported visibility"`
	- 403 Forbidden `{"error": "error_msg"}`
	- 404 Not Found `"Not found"`
	- On success: JSON, Mastodon Status entity

	## `DELETE /api/pleroma/admin/statuses/:id`

	### Delete an individual reported status

	- Params:
	- `id`
	- Response:
	- On failure:
	- 403 Forbidden `{"error": "error_msg"}`
	- 404 Not Found `"Not found"`
	- On success: 200 OK `{}`

	## `GET /api/pleroma/admin/restart`

	### Restarts pleroma application

	- Params: none
	- Response:
	- On failure:
	- 400 Bad Request `"To use this endpoint you need to enable configuration from database."`

	```json
	{}
	```

	## `GET /api/pleroma/admin/config`

	### Get list of merged default settings with saved in database.

	If `need_reboot` flag exists in response, instance must be restarted, so reboot time settings can take effect.

	Only works when configuration from database is enabled.

	- Params:
	- `only_db`: true (optional, get only saved in database settings)
	- Response:
	- On failure:
	- 400 Bad Request `"To use this endpoint you need to enable configuration from database."`

	```json
	{
	"configs": [
	{
	"group": ":pleroma",
	"key": "Pleroma.Upload",
	"value": []
	}
	],
	"need_reboot": true
	}
	```
	need_reboot - optional, if were changed reboot time settings.

	## `POST /api/pleroma/admin/config`

	### Update config settings

	If `need_reboot` flag exists in response, instance must be restarted, so reboot time settings can take effect.

	Only works when configuration from database is enabled.

	Some modifications are necessary to save the config settings correctly:

	- strings which start with `Pleroma.`, `Phoenix.`, `Tesla.` or strings like `Oban`, `Ueberauth` will be converted to modules;
	```
	"Pleroma.Upload" -> Pleroma.Upload
	"Oban" -> Oban
	```
	- strings starting with `:` will be converted to atoms;
	```
	":pleroma" -> :pleroma
	```
	- objects with `tuple` key and array value will be converted to tuples;
	```
	{"tuple": ["string", "Pleroma.Upload", []]} -> {"string", Pleroma.Upload, []}
	```
	- arrays with tuple objects will be converted to keywords;
	```
	[{"tuple": [":key1", "value"]}, {"tuple": [":key2", "value"]}] -> [key1: "value", key2: "value"]
	```

	Most of the settings will be applied in `runtime`, this means that you don't need to restart the instance. But some settings are applied in `compile time` and require a reboot of the instance, such as:
	- all settings inside these keys:
	- `:hackney_pools`
	- `:chat`
	- partially settings inside these keys:
	- `:seconds_valid` in `Pleroma.Captcha`
	- `:proxy_remote` in `Pleroma.Upload`
	- `:upload_limit` in `:instance`

	- Params:
	- `configs` - array of config objects
	- config object params:
	- `group` - string (required)
	- `key` - string (required)
	- `value` - string, [], {} or {"tuple": []} (required)
	- `delete` - true (optional, if setting must be deleted)
	- `subkeys` - array of strings (optional, only works when `delete=true` parameter is passed, otherwise will be ignored)

	When a value have several nested settings, you can delete only some nested settings by passing a parameter `subkeys`, without deleting all settings by key.
	```
	[subkey: val1, subkey2: val2, subkey3: val3] \\ initial value
	{"group": ":pleroma", "key": "some_key", "delete": true, "subkeys": [":subkey", ":subkey3"]} \\ passing json for deletion
	[subkey2: val2] \\ value after deletion
	```

	Most of the settings can be partially updated through merge old values with new values, except settings value of which is list or is not keyword.

	Example of setting without keyword in value:
	```elixir
	config :tesla, :adapter, Tesla.Adapter.Hackney
	```

	List of settings which support only full update by key:
	```elixir
	@full_key_update [
	{:pleroma, :ecto_repos},
	{:quack, :meta},
	{:mime, :types},
	{:cors_plug, [:max_age, :methods, :expose, :headers]},
	{:auto_linker, :opts},
	{:swarm, :node_blacklist},
	{:logger, :backends}
	]
	```

	List of settings which support only full update by subkey:
	```elixir
	@full_subkey_update [
	{:pleroma, :assets, :mascots},
	{:pleroma, :emoji, :groups},
	{:pleroma, :workers, :retries},
	{:pleroma, :mrf_subchain, :match_actor},
	{:pleroma, :mrf_keyword, :replace}
	]
	```

	Settings without explicit key must be sended in separate config object params.
	```elixir
	config :quack,
	level: :debug,
	meta: [:all],
	...
	```
	```json
	{
	"configs": [
	{"group": ":quack", "key": ":level", "value": ":debug"},
	{"group": ":quack", "key": ":meta", "value": [":all"]},
	...
	]
	}
	```
	- Request:

	```json
	{
	"configs": [
	{
	"group": ":pleroma",
	"key": "Pleroma.Upload",
	"value": [
	{"tuple": [":uploader", "Pleroma.Upload.Uploader.Local"]},
	{"tuple": [":filters", ["Pleroma.Upload.Filter.Dedupe"]]},
	{"tuple": [":link_name", true]},
	{"tuple": [":proxy_remote", false]},
	{"tuple": [":proxy_opts", [
	{"tuple": [":redirect_on_failure", false]},
	{"tuple": [":max_body_length", 1048576]},
	{"tuple": [":http", [
	{"tuple": [":follow_redirect", true]},
	{"tuple": [":pool", ":upload"]},
	]]}
	]
	]},
	{"tuple": [":dispatch", {
	"tuple": ["/api/v1/streaming", "Pleroma.Web.MastodonAPI.WebsocketHandler", []]
	}]}
	]
	}
	]
	}
	```

	- Response:
	- On failure:
	- 400 Bad Request `"To use this endpoint you need to enable configuration from database."`
	```json
	{
	"configs": [
	{
	"group": ":pleroma",
	"key": "Pleroma.Upload",
	"value": [...]
	}
	],
	"need_reboot": true
	}
	```
	need_reboot - optional, if were changed reboot time settings.

	## ` GET /api/pleroma/admin/config/descriptions`

	### Get JSON with config descriptions.
	Loads json generated from `config/descriptions.exs`.

	- Params: none
	- Response:

	```json
	[{
	"group": ":pleroma", // string
	"key": "ModuleName", // string
	"type": "group", // string or list with possible values,
	"description": "Upload general settings", // string
	"children": [
	{
	"key": ":uploader", // string or module name `Pleroma.Upload`
	"type": "module",
	"description": "Module which will be used for uploads",
	"suggestions": ["module1", "module2"]
	},
	{
	"key": ":filters",
	"type": ["list", "module"],
	"description": "List of filter modules for uploads",
	"suggestions": [
	"module1", "module2", "module3"
	]
	}
	]
	}]
	```

	## `GET /api/pleroma/admin/moderation_log`

	### Get moderation log

	- Params:
	- optional `page`: integer page number
	- optional `page_size`: integer number of log entries per page (default is `50`)
	- optional `start_date`: datetime (ISO 8601) filter logs by creation date, start from `start_date`. Accepts datetime in ISO 8601 format (YYYY-MM-DDThh:mm:ss), e.g. `2005-08-09T18:31:42`
	- optional `end_date`: datetime (ISO 8601) filter logs by creation date, end by from `end_date`. Accepts datetime in ISO 8601 format (YYYY-MM-DDThh:mm:ss), e.g. 2005-08-09T18:31:42
	- optional `user_id`: integer filter logs by actor's id
	- optional `search`: string search logs by the log message
	- Response:

	```json
	[
	{
	"data": {
	"actor": {
	"id": 1,
	"nickname": "lain"
	},
	"action": "relay_follow"
	},
	"time": 1502812026, // timestamp
	"message": "[2017-08-15 15:47:06] @nick0 followed relay: https://example.org/relay" // log message
	}
	]
	```

	## `POST /api/pleroma/admin/reload_emoji`

	### Reload the instance's custom emoji

	- Authentication: required
	- Params: None
	- Response: JSON, "ok" and 200 status

	## `PATCH /api/pleroma/admin/users/confirm_email`

	### Confirm users' emails

	- Params:
	- `nicknames`
	- Response: Array of user nicknames

	## `PATCH /api/pleroma/admin/users/resend_confirmation_email`

	### Resend confirmation email

	- Params:
	- `nicknames`
	- Response: Array of user nicknames
	+
	+## `GET /api/pleroma/admin/stats`
	+
	+### Stats
	+
	+- Response:
	+
	+```json
	+{
	+ "status_visibility": {
	+ "direct": 739,
	+ "private": 9,
	+ "public": 17,
	+ "unlisted": 14
	+ }
	+}
	+```
	diff --git a/docs/configuration/howto_theming_your_instance.md b/docs/configuration/howto_theming_your_instance.md
	new file mode 100644
	index 000000000..d0daf5b25
	--- /dev/null
	+++ b/docs/configuration/howto_theming_your_instance.md
	@@ -0,0 +1,74 @@
	+# Theming your instance
	+
	+To add a custom theme to your instance, you'll first need to get a custom theme, upload it to the server, make it available to the instance and eventually you can set it as default.
	+
	+## Getting a custom theme
	+
	+### Create your own theme
	+
	+* You can create your own theme using the Pleroma FE by going to settings (gear on the top right) and choose the Theme tab. Here you have the options to create a personal theme.
	+* To download your theme, you can do Save preset
	+* If you want to upload a theme to customise it further, you can upload it using Load preset
	+
	+This will only save the theme for you personally. To make it available to the whole instance, you'll need to upload it to the server.
	+
	+### Get an existing theme
	+
	+* You can download a theme from another instance by going to that instance, go to settings and make sure you have the theme selected that you want. Then you can do Save preset to download it.
	+* You can also find and download custom themes at <https://plthemes.vulpes.one/>
	+
	+## Adding the custom theme to the instance
	+
	+### Upload the theme to the server
	+
	+Themes can be found in the [static directory](static_dir.md). Create `STATIC-DIR/static/themes/` if needed and copy your theme there. Next you need to add an entry for your theme to `STATIC-DIR/static/styles.json`. If you use a from source installation, you'll first need to copy the file from `priv/static/static/styles.json`.
	+
	+Example of `styles.json` where we add our own `my-awesome-theme.json`
	+```json
	+{
	+ "pleroma-dark": [ "Pleroma Dark", "#121a24", "#182230", "#b9b9ba", "#d8a070", "#d31014", "#0fa00f", "#0095ff", "#ffa500" ],
	+ "pleroma-light": [ "Pleroma Light", "#f2f4f6", "#dbe0e8", "#304055", "#f86f0f", "#d31014", "#0fa00f", "#0095ff", "#ffa500" ],
	+ "classic-dark": [ "Classic Dark", "#161c20", "#282e32", "#b9b9b9", "#baaa9c", "#d31014", "#0fa00f", "#0095ff", "#ffa500" ],
	+ "bird": [ "Bird", "#f8fafd", "#e6ecf0", "#14171a", "#0084b8", "#e0245e", "#17bf63", "#1b95e0", "#fab81e"],
	+ "ir-black": [ "Ir Black", "#000000", "#242422", "#b5b3aa", "#ff6c60", "#FF6C60", "#A8FF60", "#96CBFE", "#FFFFB6" ],
	+ "monokai": [ "Monokai", "#272822", "#383830", "#f8f8f2", "#f92672", "#F92672", "#a6e22e", "#66d9ef", "#f4bf75" ],
	+
	+ "redmond-xx": "/static/themes/redmond-xx.json",
	+ "redmond-xx-se": "/static/themes/redmond-xx-se.json",
	+ "redmond-xxi": "/static/themes/redmond-xxi.json",
	+ "breezy-dark": "/static/themes/breezy-dark.json",
	+ "breezy-light": "/static/themes/breezy-light.json",
	+ "mammal": "/static/themes/mammal.json",
	+ "my-awesome-theme": "/static/themes/my-awesome-theme.json"
	+}
	+```
	+
	+Now you'll already be able to select the theme in Pleroma FE from the drop-down. You don't need to restart Pleroma because we only changed static served files. You may need to refresh the page in your browser. You'll notice however that the theme doesn't have a name, it's just an empty entry in the drop-down.
	+
	+### Give the theme a name
	+
	+When you open one of the themes that ship with Pleroma, you'll notice that the json has a `"name"` key. Add a key-value pair to your theme where the key name is `"name"` and the value the name you want to give your theme. After this you can refresh te page in your browser and the name should be visible in the drop-down.
	+
	+Example of `my-awesome-theme.json` where we add the name "My Awesome Theme"
	+```json
	+{
	+ "_pleroma_theme_version": 2,
	+ "name": "My Awesome Theme",
	+ "theme": {}
	+}
	+```
	+
	+### Set as default theme
	+
	+Now we can set the new theme as default in the [Pleroma FE configuration](General-tips-for-customizing-Pleroma-FE.md).
	+
	+Example of adding the new theme in the back-end config files
	+```elixir
	+config :pleroma, :frontend_configurations,
	+ pleroma_fe: %{
	+ theme: "my-awesome-theme"
	+ }
	+```
	+
	+If you added it in the back-end configuration file, you'll need to restart your instance for the changes to take effect. If you don't see the changes, it's probably because the browser has cached the previous theme. In that case you'll want to clear browser caches. Alternatively you can use a private/incognito window just to see the changes.
	+
	diff --git a/docs/introduction.md b/docs/introduction.md
	index 823e14f53..a915c143c 100644
	--- a/docs/introduction.md
	+++ b/docs/introduction.md
	@@ -1,65 +1,65 @@
	# Introduction to Pleroma
	## What is Pleroma?
	Pleroma is a federated social networking platform, compatible with GNU social, Mastodon and other OStatus and ActivityPub implementations. It is free software licensed under the AGPLv3.
	It actually consists of two components: a backend, named simply Pleroma, and a user-facing frontend, named Pleroma-FE. It also includes the Mastodon frontend, if that's your thing.
	It's part of what we call the fediverse, a federated network of instances which speak common protocols and can communicate with each other.
	One account on an instance is enough to talk to the entire fediverse!

	## How can I use it?

	Pleroma instances are already widely deployed, a list can be found at <http://distsn.org/pleroma-instances.html>. Information on all existing fediverse instances can be found at <https://fediverse.network/>.

	If you don't feel like joining an existing instance, but instead prefer to deploy your own instance, that's easy too!
	Installation instructions can be found in the installation section of these docs.

	## I got an account, now what?
	Great! Now you can explore the fediverse! Open the login page for your Pleroma instance (e.g. <https://pleroma.soykaf.com>) and login with your username and password. (If you don't have an account yet, click on Register)

	At this point you will have two columns in front of you.

	### Left column

	- first block: here you can see your avatar, your nickname and statistics (Statuses, Following, Followers). Clicking your profile pic will open your profile.
	Under that you have a text form which allows you to post new statuses. The number on the bottom of the text form is a character counter, every instance can have a different character limit (the default is 5000).
	If you want to mention someone, type @ + name of the person. A drop-down menu will help you in finding the right person.
	Under the text form there are also several visibility options and there is the option to use rich text.
	Under that the icon on the left is for uploading media files and attach them to your post. There is also an emoji-picker and an option to post a poll.
	To post your status, simply press Submit.
	On the top right you will also see a wrench icon. This opens your personal settings.

	- second block: Here you can switch between the different timelines:
	- Timeline: all the people that you follow
	- Interactions: here you can switch between different timelines where there was interaction with your account. There is Mentions, Repeats and Favorites, and New follows
	- Direct Messages: these are the Direct Messages sent to you
	- Public Timeline: all the statutes from the local instance
	- The Whole Known Network: all public posts the instance knows about, both local and remote!
	- About: This isn't a Timeline but shows relevant info about the instance. You can find a list of the moderators and admins, Terms of Service, MRF policies and enabled features.
	- Optional third block: This is the Instance panel that can be activated, but is deactivated by default. It's fully customisable and by default has links to the pleroma-fe and Mastodon-fe.
	- fourth block: This is the Notifications block, here you will get notified whenever somebody mentions you, follows you, repeats or favorites one of your statuses.

	### Right column
	This is where the interesting stuff happens!
	Depending on the timeline you will see different statuses, but each status has a standard structure:

	-- Profile pic, name and link to profile. An optional left-arrow if it's a reply to another status (hovering will reveal the replied-to status). Clicking on the profile pic will uncollapse the user's profile.
	+- Profile pic, name and link to profile. An optional left-arrow if it's a reply to another status (hovering will reveal the reply-to status). Clicking on the profile pic will uncollapse the user's profile.
	- A `+` button on the right allows you to Expand/Collapse an entire discussion thread. It also updates in realtime!
	- An arrow icon allows you to open the status on the instance where it's originating from.
	- The text of the status, including mentions and attachements. If you click on a mention, it will automatically open the profile page of that person.
	- Three buttons (left to right): Reply, Repeat, Favorite. There is also a forth button, this is a dropdown menu for simple moderation like muting the conversation or, if you have moderation rights, delete the status from the server.

	### Top right

	- The magnifier icon opens the search screen where you can search for statuses, people and hashtags. It's also possible to import statusses from remote servers by pasting the url to the post in the search field.
	- The gear icon gives you general settings
	- If you have admin rights, you'll see an icon that opens the admin interface
	- The last icon is to log out

	### Bottom right
	On the bottom right you have a chatbox. Here you can communicate with people on the same instance in realtime. It is local-only, for now, but there are plans to make it extendable to the entire fediverse!

	### Mastodon interface
	If the Pleroma interface isn't your thing, or you're just trying something new but you want to keep using the familiar Mastodon interface, we got that too!
	Just add a "/web" after your instance url (e.g. <https://pleroma.soycaf.com/web>) and you'll end on the Mastodon web interface, but with a Pleroma backend! MAGIC!
	The Mastodon interface is from the Glitch-soc fork. For more information on the Mastodon interface you can check the [Mastodon](https://docs.joinmastodon.org/) and [Glitch-soc](https://glitch-soc.github.io/docs/) documentation.

	Remember, what you see is only the frontend part of Mastodon, the backend is still Pleroma.
	diff --git a/lib/federation/activity_pub/federator.ex b/lib/federation/activity_pub/federator.ex
	index b4a6a5858..149964186 100644
	--- a/lib/federation/activity_pub/federator.ex
	+++ b/lib/federation/activity_pub/federator.ex
	@@ -1,94 +1,100 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2019 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Federation.ActivityPub.Federator do
	alias Pleroma.Activity
	alias Pleroma.Federation.ActivityPub
	alias Pleroma.Federation.ActivityPub.Publisher
	alias Pleroma.Federation.ActivityPub.Transmogrifier
	alias Pleroma.Federation.ActivityPub.Utils
	alias Pleroma.Object.Containment
	alias Pleroma.User
	alias Pleroma.Workers.PublisherWorker
	alias Pleroma.Workers.ReceiverWorker

	require Logger

	- @doc "Addresses [memory leaks on recursive replies fetching](https://git.pleroma.social/pleroma/pleroma/issues/161)"
	+ @doc """
	+ Returns `true` if the distance to target object does not exceed max configured value.
	+ Serves to prevent fetching of very long threads, especially useful on smaller instances.
	+ Addresses [memory leaks on recursive replies fetching](https://git.pleroma.social/pleroma/pleroma/issues/161).
	+ Applies to fetching of both ancestor (reply-to) and child (reply) objects.
	+ """
	# credo:disable-for-previous-line Credo.Check.Readability.MaxLineLength
	- def allowed_incoming_reply_depth?(depth) do
	- max_replies_depth = Pleroma.Config.get([:instance, :federation_incoming_replies_max_depth])
	+ def allowed_thread_distance?(distance) do
	+ max_distance = Pleroma.Config.get([:instance, :federation_incoming_replies_max_depth])

	- if max_replies_depth do
	- (depth \|\| 1) <= max_replies_depth
	+ if max_distance && max_distance >= 0 do
	+ # Default depth is 0 (an object has zero distance from itself in its thread)
	+ (distance \|\| 0) <= max_distance
	else
	true
	end
	end

	# Client API

	def incoming_ap_doc(params) do
	ReceiverWorker.enqueue("incoming_ap_doc", %{"params" => params})
	end

	def publish(%{id: "pleroma:fakeid"} = activity) do
	perform(:publish, activity)
	end

	def publish(activity) do
	PublisherWorker.enqueue("publish", %{"activity_id" => activity.id})
	end

	# Job Worker Callbacks

	@spec perform(atom(), module(), any()) :: {:ok, any()} \| {:error, any()}
	def perform(:publish_one, module, params) do
	apply(module, :publish_one, [params])
	end

	def perform(:publish, activity) do
	Logger.debug(fn -> "Running publish for #{activity.data["id"]}" end)

	with %User{} = actor <- User.get_cached_by_ap_id(activity.data["actor"]),
	{:ok, actor} <- User.ensure_keys_present(actor) do
	Publisher.publish(actor, activity)
	end
	end

	def perform(:incoming_ap_doc, params) do
	Logger.debug("Handling incoming AP activity")

	params = Utils.normalize_params(params)

	# NOTE: we use the actor ID to do the containment, this is fine because an
	# actor shouldn't be acting on objects outside their own AP server.
	with {:ok, _user} <- ap_enabled_actor(params["actor"]),
	nil <- Activity.normalize(params["id"]),
	:ok <- Containment.contain_origin_from_id(params["actor"], params),
	{:ok, activity} <- Transmogrifier.handle_incoming(params) do
	{:ok, activity}
	else
	%Activity{} ->
	Logger.debug("Already had #{params["id"]}")
	:error

	_e ->
	# Just drop those for now
	Logger.debug("Unhandled activity")
	Logger.debug(Jason.encode!(params, pretty: true))
	:error
	end
	end

	def ap_enabled_actor(id) do
	user = User.get_cached_by_ap_id(id)

	if User.ap_enabled?(user) do
	{:ok, user}
	else
	ActivityPub.make_user_from_ap_id(id)
	end
	end
	end
	diff --git a/lib/federation/activity_pub/transmogrifier.ex b/lib/federation/activity_pub/transmogrifier.ex
	index 6e3bc7aac..878aec1c8 100644
	--- a/lib/federation/activity_pub/transmogrifier.ex
	+++ b/lib/federation/activity_pub/transmogrifier.ex
	@@ -1,1189 +1,1248 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2019 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Federation.ActivityPub.Transmogrifier do
	@moduledoc """
	A module to handle coding from internal to wire ActivityPub and back.
	"""
	alias Pleroma.Activity
	alias Pleroma.Federation.ActivityPub
	alias Pleroma.Federation.ActivityPub.Federator
	alias Pleroma.Federation.ActivityPub.Utils
	alias Pleroma.Federation.ActivityPub.Visibility
	alias Pleroma.FollowingRelationship
	alias Pleroma.Helpers.Constants
	alias Pleroma.Object
	alias Pleroma.Object.Containment
	alias Pleroma.Storage.Repo
	alias Pleroma.User
	alias Pleroma.Workers.TransmogrifierWorker

	import Ecto.Query

	require Logger
	require Pleroma.Helpers.Constants

	@doc """
	Modifies an incoming AP object (mastodon format) to our internal format.
	"""
	def fix_object(object, options \\ []) do
	object
	\|> strip_internal_fields
	\|> fix_actor
	\|> fix_url
	\|> fix_attachments
	\|> fix_context
	\|> fix_in_reply_to(options)
	\|> fix_emoji
	\|> fix_tag
	\|> fix_content_map
	\|> fix_addressing
	\|> fix_summary
	\|> fix_type(options)
	end

	def fix_summary(%{"summary" => nil} = object) do
	Map.put(object, "summary", "")
	end

	def fix_summary(%{"summary" => _} = object) do
	# summary is present, nothing to do
	object
	end

	def fix_summary(object), do: Map.put(object, "summary", "")

	def fix_addressing_list(map, field) do
	cond do
	is_binary(map[field]) ->
	Map.put(map, field, [map[field]])

	is_nil(map[field]) ->
	Map.put(map, field, [])

	true ->
	map
	end
	end

	def fix_explicit_addressing(
	%{"to" => to, "cc" => cc} = object,
	explicit_mentions,
	follower_collection
	) do
	explicit_to = Enum.filter(to, fn x -> x in explicit_mentions end)

	explicit_cc = Enum.filter(to, fn x -> x not in explicit_mentions end)

	final_cc =
	(cc ++ explicit_cc)
	\|> Enum.reject(fn x -> String.ends_with?(x, "/followers") and x != follower_collection end)
	\|> Enum.uniq()

	object
	\|> Map.put("to", explicit_to)
	\|> Map.put("cc", final_cc)
	end

	def fix_explicit_addressing(object, _explicit_mentions, _followers_collection), do: object

	# if directMessage flag is set to true, leave the addressing alone
	def fix_explicit_addressing(%{"directMessage" => true} = object), do: object

	def fix_explicit_addressing(object) do
	explicit_mentions = Utils.determine_explicit_mentions(object)

	%User{follower_address: follower_collection} =
	object
	\|> Containment.get_actor()
	\|> User.get_cached_by_ap_id()

	explicit_mentions =
	explicit_mentions ++
	[
	Constants.as_public(),
	follower_collection
	]

	fix_explicit_addressing(object, explicit_mentions, follower_collection)
	end

	# if as:Public is addressed, then make sure the followers collection is also addressed
	# so that the activities will be delivered to local users.
	def fix_implicit_addressing(%{"to" => to, "cc" => cc} = object, followers_collection) do
	recipients = to ++ cc

	if followers_collection not in recipients do
	cond do
	Constants.as_public() in cc ->
	to = to ++ [followers_collection]
	Map.put(object, "to", to)

	Constants.as_public() in to ->
	cc = cc ++ [followers_collection]
	Map.put(object, "cc", cc)

	true ->
	object
	end
	else
	object
	end
	end

	def fix_implicit_addressing(object, _), do: object

	def fix_addressing(object) do
	{:ok, %User{} = user} = User.get_or_fetch_by_ap_id(object["actor"])
	followers_collection = User.ap_followers(user)

	object
	\|> fix_addressing_list("to")
	\|> fix_addressing_list("cc")
	\|> fix_addressing_list("bto")
	\|> fix_addressing_list("bcc")
	\|> fix_explicit_addressing()
	\|> fix_implicit_addressing(followers_collection)
	end

	def fix_actor(%{"attributedTo" => actor} = object) do
	Map.put(object, "actor", Containment.get_actor(%{"actor" => actor}))
	end

	def fix_in_reply_to(object, options \\ [])

	def fix_in_reply_to(%{"inReplyTo" => in_reply_to} = object, options)
	when not is_nil(in_reply_to) do
	in_reply_to_id = prepare_in_reply_to(in_reply_to)
	object = Map.put(object, "inReplyToAtomUri", in_reply_to_id)
	+ depth = (options[:depth] \|\| 0) + 1

	- if Federator.allowed_incoming_reply_depth?(options[:depth]) do
	+ if Federator.allowed_thread_distance?(depth) do
	with {:ok, replied_object} <- get_obj_helper(in_reply_to_id, options),
	%Activity{} = _ <- Activity.get_create_by_object_ap_id(replied_object.data["id"]) do
	object
	\|> Map.put("inReplyTo", replied_object.data["id"])
	\|> Map.put("inReplyToAtomUri", object["inReplyToAtomUri"] \|\| in_reply_to_id)
	\|> Map.put("conversation", replied_object.data["context"] \|\| object["conversation"])
	\|> Map.put("context", replied_object.data["context"] \|\| object["conversation"])
	else
	e ->
	Logger.error("Couldn't fetch #{inspect(in_reply_to_id)}, error: #{inspect(e)}")
	object
	end
	else
	object
	end
	end

	def fix_in_reply_to(object, _options), do: object

	defp prepare_in_reply_to(in_reply_to) do
	cond do
	is_bitstring(in_reply_to) ->
	in_reply_to

	is_map(in_reply_to) && is_bitstring(in_reply_to["id"]) ->
	in_reply_to["id"]

	is_list(in_reply_to) && is_bitstring(Enum.at(in_reply_to, 0)) ->
	Enum.at(in_reply_to, 0)

	true ->
	""
	end
	end

	def fix_context(object) do
	context = object["context"] \|\| object["conversation"] \|\| Utils.generate_context_id()

	object
	\|> Map.put("context", context)
	\|> Map.put("conversation", context)
	end

	def fix_attachments(%{"attachment" => attachment} = object) when is_list(attachment) do
	attachments =
	Enum.map(attachment, fn data ->
	media_type = data["mediaType"] \|\| data["mimeType"]
	href = data["url"] \|\| data["href"]
	url = [%{"type" => "Link", "mediaType" => media_type, "href" => href}]

	data
	\|> Map.put("mediaType", media_type)
	\|> Map.put("url", url)
	end)

	Map.put(object, "attachment", attachments)
	end

	def fix_attachments(%{"attachment" => attachment} = object) when is_map(attachment) do
	object
	\|> Map.put("attachment", [attachment])
	\|> fix_attachments()
	end

	def fix_attachments(object), do: object

	def fix_url(%{"url" => url} = object) when is_map(url) do
	Map.put(object, "url", url["href"])
	end

	def fix_url(%{"type" => "Video", "url" => url} = object) when is_list(url) do
	first_element = Enum.at(url, 0)

	link_element = Enum.find(url, fn x -> is_map(x) and x["mimeType"] == "text/html" end)

	object
	\|> Map.put("attachment", [first_element])
	\|> Map.put("url", link_element["href"])
	end

	def fix_url(%{"type" => object_type, "url" => url} = object)
	when object_type != "Video" and is_list(url) do
	first_element = Enum.at(url, 0)

	url_string =
	cond do
	is_bitstring(first_element) -> first_element
	is_map(first_element) -> first_element["href"] \|\| ""
	true -> ""
	end

	Map.put(object, "url", url_string)
	end

	def fix_url(object), do: object

	def fix_emoji(%{"tag" => tags} = object) when is_list(tags) do
	emoji =
	tags
	\|> Enum.filter(fn data -> data["type"] == "Emoji" and data["icon"] end)
	\|> Enum.reduce(%{}, fn data, mapping ->
	name = String.trim(data["name"], ":")

	Map.put(mapping, name, data["icon"]["url"])
	end)

	# we merge mastodon and pleroma emoji into a single mapping, to allow for both wire formats
	emoji = Map.merge(object["emoji"] \|\| %{}, emoji)

	Map.put(object, "emoji", emoji)
	end

	def fix_emoji(%{"tag" => %{"type" => "Emoji"} = tag} = object) do
	name = String.trim(tag["name"], ":")
	emoji = %{name => tag["icon"]["url"]}

	Map.put(object, "emoji", emoji)
	end

	def fix_emoji(object), do: object

	def fix_tag(%{"tag" => tag} = object) when is_list(tag) do
	tags =
	tag
	\|> Enum.filter(fn data -> data["type"] == "Hashtag" and data["name"] end)
	\|> Enum.map(fn data -> String.slice(data["name"], 1..-1) end)

	Map.put(object, "tag", tag ++ tags)
	end

	def fix_tag(%{"tag" => %{"type" => "Hashtag", "name" => hashtag} = tag} = object) do
	combined = [tag, String.slice(hashtag, 1..-1)]

	Map.put(object, "tag", combined)
	end

	def fix_tag(%{"tag" => %{} = tag} = object), do: Map.put(object, "tag", [tag])

	def fix_tag(object), do: object

	# content map usually only has one language so this will do for now.
	def fix_content_map(%{"contentMap" => content_map} = object) do
	content_groups = Map.to_list(content_map)
	{_, content} = Enum.at(content_groups, 0)

	Map.put(object, "content", content)
	end

	def fix_content_map(object), do: object

	def fix_type(object, options \\ [])

	def fix_type(%{"inReplyTo" => reply_id, "name" => _} = object, options)
	when is_binary(reply_id) do
	- with true <- Federator.allowed_incoming_reply_depth?(options[:depth]),
	+ with true <- Federator.allowed_thread_distance?(options[:depth]),
	{:ok, %{data: %{"type" => "Question"} = _} = _} <- get_obj_helper(reply_id, options) do
	Map.put(object, "type", "Answer")
	else
	_ -> object
	end
	end

	def fix_type(object, _), do: object

	defp mastodon_follow_hack(%{"id" => id, "actor" => follower_id}, followed) do
	with true <- id =~ "follows",
	%User{local: true} = follower <- User.get_cached_by_ap_id(follower_id),
	%Activity{} = activity <- Utils.fetch_latest_follow(follower, followed) do
	{:ok, activity}
	else
	_ -> {:error, nil}
	end
	end

	defp mastodon_follow_hack(_, _), do: {:error, nil}

	defp get_follow_activity(follow_object, followed) do
	with object_id when not is_nil(object_id) <- Utils.get_ap_id(follow_object),
	{_, %Activity{} = activity} <- {:activity, Activity.get_by_ap_id(object_id)} do
	{:ok, activity}
	else
	# Can't find the activity. This might a Mastodon 2.3 "Accept"
	{:activity, nil} ->
	mastodon_follow_hack(follow_object, followed)

	_ ->
	{:error, nil}
	end
	end

	# Reduce the object list to find the reported user.
	defp get_reported(objects) do
	Enum.reduce_while(objects, nil, fn ap_id, _ ->
	with %User{} = user <- User.get_cached_by_ap_id(ap_id) do
	{:halt, user}
	else
	_ -> {:cont, nil}
	end
	end)
	end

	def handle_incoming(data, options \\ [])

	# Flag objects are placed ahead of the ID check because Mastodon 2.8 and earlier send them
	# with nil ID.
	def handle_incoming(%{"type" => "Flag", "object" => objects, "actor" => actor} = data, _options) do
	with context <- data["context"] \|\| Utils.generate_context_id(),
	content <- data["content"] \|\| "",
	%User{} = actor <- User.get_cached_by_ap_id(actor),
	# Reduce the object list to find the reported user.
	%User{} = account <- get_reported(objects),
	# Remove the reported user from the object list.
	statuses <- Enum.filter(objects, fn ap_id -> ap_id != account.ap_id end) do
	%{
	actor: actor,
	context: context,
	account: account,
	statuses: statuses,
	content: content,
	additional: %{"cc" => [account.ap_id]}
	}
	\|> ActivityPub.flag()
	end
	end

	# disallow objects with bogus IDs
	def handle_incoming(%{"id" => nil}, _options), do: :error
	def handle_incoming(%{"id" => ""}, _options), do: :error
	# length of https:// = 8, should validate better, but good enough for now.
	def handle_incoming(%{"id" => id}, _options) when is_binary(id) and byte_size(id) < 8,
	do: :error

	# TODO: validate those with a Ecto scheme
	# - tags
	# - emoji
	def handle_incoming(
	%{"type" => "Create", "object" => %{"type" => objtype} = object} = data,
	options
	)
	when objtype in ["Article", "Event", "Note", "Video", "Page", "Question", "Answer"] do
	actor = Containment.get_actor(data)

	data =
	Map.put(data, "actor", actor)
	\|> fix_addressing

	with nil <- Activity.get_create_by_object_ap_id(object["id"]),
	{:ok, %User{} = user} <- User.get_or_fetch_by_ap_id(data["actor"]) do
	- options = Keyword.put(options, :depth, (options[:depth] \|\| 0) + 1)
	- object = fix_object(data["object"], options)
	+ object = fix_object(object, options)

	params = %{
	to: data["to"],
	object: object,
	actor: user,
	context: object["conversation"],
	local: false,
	published: data["published"],
	additional:
	Map.take(data, [
	"cc",
	"directMessage",
	"id"
	])
	}

	- ActivityPub.create(params)
	+ with {:ok, created_activity} <- ActivityPub.create(params) do
	+ reply_depth = (options[:depth] \|\| 0) + 1
	+
	+ if Federator.allowed_thread_distance?(reply_depth) do
	+ for reply_id <- replies(object) do
	+ Pleroma.Workers.RemoteFetcherWorker.enqueue("fetch_remote", %{
	+ "id" => reply_id,
	+ "depth" => reply_depth
	+ })
	+ end
	+ end
	+
	+ {:ok, created_activity}
	+ end
	else
	%Activity{} = activity -> {:ok, activity}
	_e -> :error
	end
	end

	def handle_incoming(
	%{"type" => "Listen", "object" => %{"type" => "Audio"} = object} = data,
	options
	) do
	actor = Containment.get_actor(data)

	data =
	Map.put(data, "actor", actor)
	\|> fix_addressing

	with {:ok, %User{} = user} <- User.get_or_fetch_by_ap_id(data["actor"]) do
	- options = Keyword.put(options, :depth, (options[:depth] \|\| 0) + 1)
	+ reply_depth = (options[:depth] \|\| 0) + 1
	+ options = Keyword.put(options, :depth, reply_depth)
	object = fix_object(object, options)

	params = %{
	to: data["to"],
	object: object,
	actor: user,
	context: nil,
	local: false,
	published: data["published"],
	additional: Map.take(data, ["cc", "id"])
	}

	ActivityPub.listen(params)
	else
	_e -> :error
	end
	end

	def handle_incoming(
	%{"type" => "Follow", "object" => followed, "actor" => follower, "id" => id} = data,
	_options
	) do
	with %User{local: true} = followed <-
	User.get_cached_by_ap_id(Containment.get_actor(%{"actor" => followed})),
	{:ok, %User{} = follower} <-
	User.get_or_fetch_by_ap_id(Containment.get_actor(%{"actor" => follower})),
	{:ok, activity} <- ActivityPub.follow(follower, followed, id, false) do
	with deny_follow_blocked <- Pleroma.Config.get([:user, :deny_follow_blocked]),
	{_, false} <- {:user_blocked, User.blocks?(followed, follower) && deny_follow_blocked},
	{_, false} <- {:user_locked, User.locked?(followed)},
	{_, {:ok, follower}} <- {:follow, User.follow(follower, followed)},
	{_, {:ok, _}} <-
	{:follow_state_update, Utils.update_follow_state_for_all(activity, "accept")},
	{:ok, _relationship} <- FollowingRelationship.update(follower, followed, "accept") do
	ActivityPub.accept(%{
	to: [follower.ap_id],
	actor: followed,
	object: data,
	local: true
	})
	else
	{:user_blocked, true} ->
	{:ok, _} = Utils.update_follow_state_for_all(activity, "reject")
	{:ok, _relationship} = FollowingRelationship.update(follower, followed, "reject")

	ActivityPub.reject(%{
	to: [follower.ap_id],
	actor: followed,
	object: data,
	local: true
	})

	{:follow, {:error, _}} ->
	{:ok, _} = Utils.update_follow_state_for_all(activity, "reject")
	{:ok, _relationship} = FollowingRelationship.update(follower, followed, "reject")

	ActivityPub.reject(%{
	to: [follower.ap_id],
	actor: followed,
	object: data,
	local: true
	})

	{:user_locked, true} ->
	{:ok, _relationship} = FollowingRelationship.update(follower, followed, "pending")
	:noop
	end

	{:ok, activity}
	else
	_e ->
	:error
	end
	end

	def handle_incoming(
	%{"type" => "Accept", "object" => follow_object, "actor" => _actor, "id" => id} = data,
	_options
	) do
	with actor <- Containment.get_actor(data),
	{:ok, %User{} = followed} <- User.get_or_fetch_by_ap_id(actor),
	{:ok, follow_activity} <- get_follow_activity(follow_object, followed),
	{:ok, follow_activity} <- Utils.update_follow_state_for_all(follow_activity, "accept"),
	%User{local: true} = follower <- User.get_cached_by_ap_id(follow_activity.data["actor"]),
	{:ok, _relationship} <- FollowingRelationship.update(follower, followed, "accept") do
	ActivityPub.accept(%{
	to: follow_activity.data["to"],
	type: "Accept",
	actor: followed,
	object: follow_activity.data["id"],
	local: false,
	activity_id: id
	})
	else
	_e -> :error
	end
	end

	def handle_incoming(
	%{"type" => "Reject", "object" => follow_object, "actor" => _actor, "id" => id} = data,
	_options
	) do
	with actor <- Containment.get_actor(data),
	{:ok, %User{} = followed} <- User.get_or_fetch_by_ap_id(actor),
	{:ok, follow_activity} <- get_follow_activity(follow_object, followed),
	{:ok, follow_activity} <- Utils.update_follow_state_for_all(follow_activity, "reject"),
	%User{local: true} = follower <- User.get_cached_by_ap_id(follow_activity.data["actor"]),
	{:ok, _relationship} <- FollowingRelationship.update(follower, followed, "reject"),
	{:ok, activity} <-
	ActivityPub.reject(%{
	to: follow_activity.data["to"],
	type: "Reject",
	actor: followed,
	object: follow_activity.data["id"],
	local: false,
	activity_id: id
	}) do
	{:ok, activity}
	else
	_e -> :error
	end
	end

	@misskey_reactions %{
	"like" => "👍",
	"love" => "❤️",
	"laugh" => "😆",
	"hmm" => "🤔",
	"surprise" => "😮",
	"congrats" => "🎉",
	"angry" => "💢",
	"confused" => "😥",
	"rip" => "😇",
	"pudding" => "🍮",
	"star" => "⭐"
	}

	@doc "Rewrite misskey likes into EmojiReacts"
	def handle_incoming(
	%{
	"type" => "Like",
	"_misskey_reaction" => reaction
	} = data,
	options
	) do
	data
	\|> Map.put("type", "EmojiReact")
	\|> Map.put("content", @misskey_reactions[reaction] \|\| reaction)
	\|> handle_incoming(options)
	end

	def handle_incoming(
	%{"type" => "Like", "object" => object_id, "actor" => _actor, "id" => id} = data,
	_options
	) do
	with actor <- Containment.get_actor(data),
	{:ok, %User{} = actor} <- User.get_or_fetch_by_ap_id(actor),
	{:ok, object} <- get_obj_helper(object_id),
	{:ok, activity, _object} <- ActivityPub.like(actor, object, id, false) do
	{:ok, activity}
	else
	_e -> :error
	end
	end

	def handle_incoming(
	%{
	"type" => "EmojiReact",
	"object" => object_id,
	"actor" => _actor,
	"id" => id,
	"content" => emoji
	} = data,
	_options
	) do
	with actor <- Containment.get_actor(data),
	{:ok, %User{} = actor} <- User.get_or_fetch_by_ap_id(actor),
	{:ok, object} <- get_obj_helper(object_id),
	{:ok, activity, _object} <-
	ActivityPub.react_with_emoji(actor, object, emoji, activity_id: id, local: false) do
	{:ok, activity}
	else
	_e -> :error
	end
	end

	def handle_incoming(
	%{"type" => "Announce", "object" => object_id, "actor" => _actor, "id" => id} = data,
	_options
	) do
	with actor <- Containment.get_actor(data),
	{:ok, %User{} = actor} <- User.get_or_fetch_by_ap_id(actor),
	{:ok, object} <- get_embedded_obj_helper(object_id, actor),
	public <- Visibility.is_public?(data),
	{:ok, activity, _object} <- ActivityPub.announce(actor, object, id, false, public) do
	{:ok, activity}
	else
	_e -> :error
	end
	end

	def handle_incoming(
	%{"type" => "Update", "object" => %{"type" => object_type} = object, "actor" => actor_id} =
	data,
	_options
	)
	when object_type in [
	"Person",
	"Application",
	"Service",
	"Organization"
	] do
	with %User{ap_id: ^actor_id} = actor <- User.get_cached_by_ap_id(object["id"]) do
	{:ok, new_user_data} = ActivityPub.user_data_from_user_object(object)

	actor
	\|> User.upgrade_changeset(new_user_data, true)
	\|> User.update_and_set_cache()

	ActivityPub.update(%{
	local: false,
	to: data["to"] \|\| [],
	cc: data["cc"] \|\| [],
	object: object,
	actor: actor_id,
	activity_id: data["id"]
	})
	else
	e ->
	Logger.error(e)
	:error
	end
	end

	# TODO: We presently assume that any actor on the same origin domain as the object being
	# deleted has the rights to delete that object. A better way to validate whether or not
	# the object should be deleted is to refetch the object URI, which should return either
	# an error or a tombstone. This would allow us to verify that a deletion actually took
	# place.
	def handle_incoming(
	%{"type" => "Delete", "object" => object_id, "actor" => actor, "id" => id} = data,
	_options
	) do
	object_id = Utils.get_ap_id(object_id)

	with actor <- Containment.get_actor(data),
	{:ok, %User{} = actor} <- User.get_or_fetch_by_ap_id(actor),
	{:ok, object} <- get_obj_helper(object_id),
	:ok <- Containment.contain_origin(actor.ap_id, object.data),
	{:ok, activity} <-
	ActivityPub.delete(object, local: false, activity_id: id, actor: actor.ap_id) do
	{:ok, activity}
	else
	nil ->
	case User.get_cached_by_ap_id(object_id) do
	%User{ap_id: ^actor} = user ->
	User.delete(user)

	nil ->
	:error
	end

	_e ->
	:error
	end
	end

	def handle_incoming(
	%{
	"type" => "Undo",
	"object" => %{"type" => "Announce", "object" => object_id},
	"actor" => _actor,
	"id" => id
	} = data,
	_options
	) do
	with actor <- Containment.get_actor(data),
	{:ok, %User{} = actor} <- User.get_or_fetch_by_ap_id(actor),
	{:ok, object} <- get_obj_helper(object_id),
	{:ok, activity, _} <- ActivityPub.unannounce(actor, object, id, false) do
	{:ok, activity}
	else
	_e -> :error
	end
	end

	def handle_incoming(
	%{
	"type" => "Undo",
	"object" => %{"type" => "Follow", "object" => followed},
	"actor" => follower,
	"id" => id
	} = _data,
	_options
	) do
	with %User{local: true} = followed <- User.get_cached_by_ap_id(followed),
	{:ok, %User{} = follower} <- User.get_or_fetch_by_ap_id(follower),
	{:ok, activity} <- ActivityPub.unfollow(follower, followed, id, false) do
	User.unfollow(follower, followed)
	{:ok, activity}
	else
	_e -> :error
	end
	end

	def handle_incoming(
	%{
	"type" => "Undo",
	"object" => %{"type" => "EmojiReact", "id" => reaction_activity_id},
	"actor" => _actor,
	"id" => id
	} = data,
	_options
	) do
	with actor <- Containment.get_actor(data),
	{:ok, %User{} = actor} <- User.get_or_fetch_by_ap_id(actor),
	{:ok, activity, _} <-
	ActivityPub.unreact_with_emoji(actor, reaction_activity_id,
	activity_id: id,
	local: false
	) do
	{:ok, activity}
	else
	_e -> :error
	end
	end

	def handle_incoming(
	%{
	"type" => "Undo",
	"object" => %{"type" => "Block", "object" => blocked},
	"actor" => blocker,
	"id" => id
	} = _data,
	_options
	) do
	with %User{local: true} = blocked <- User.get_cached_by_ap_id(blocked),
	{:ok, %User{} = blocker} <- User.get_or_fetch_by_ap_id(blocker),
	{:ok, activity} <- ActivityPub.unblock(blocker, blocked, id, false) do
	User.unblock(blocker, blocked)
	{:ok, activity}
	else
	_e -> :error
	end
	end

	def handle_incoming(
	%{"type" => "Block", "object" => blocked, "actor" => blocker, "id" => id} = _data,
	_options
	) do
	with %User{local: true} = blocked = User.get_cached_by_ap_id(blocked),
	{:ok, %User{} = blocker} = User.get_or_fetch_by_ap_id(blocker),
	{:ok, activity} <- ActivityPub.block(blocker, blocked, id, false) do
	User.unfollow(blocker, blocked)
	User.block(blocker, blocked)
	{:ok, activity}
	else
	_e -> :error
	end
	end

	def handle_incoming(
	%{
	"type" => "Undo",
	"object" => %{"type" => "Like", "object" => object_id},
	"actor" => _actor,
	"id" => id
	} = data,
	_options
	) do
	with actor <- Containment.get_actor(data),
	{:ok, %User{} = actor} <- User.get_or_fetch_by_ap_id(actor),
	{:ok, object} <- get_obj_helper(object_id),
	{:ok, activity, _, _} <- ActivityPub.unlike(actor, object, id, false) do
	{:ok, activity}
	else
	_e -> :error
	end
	end

	# For Undos that don't have the complete object attached, try to find it in our database.
	def handle_incoming(
	%{
	"type" => "Undo",
	"object" => object
	} = activity,
	options
	)
	when is_binary(object) do
	with %Activity{data: data} <- Activity.get_by_ap_id(object) do
	activity
	\|> Map.put("object", data)
	\|> handle_incoming(options)
	else
	_e -> :error
	end
	end

	def handle_incoming(
	%{
	"type" => "Move",
	"actor" => origin_actor,
	"object" => origin_actor,
	"target" => target_actor
	},
	_options
	) do
	with %User{} = origin_user <- User.get_cached_by_ap_id(origin_actor),
	{:ok, %User{} = target_user} <- User.get_or_fetch_by_ap_id(target_actor),
	true <- origin_actor in target_user.also_known_as do
	ActivityPub.move(origin_user, target_user, false)
	else
	_e -> :error
	end
	end

	def handle_incoming(_, _), do: :error

	@spec get_obj_helper(String.t(), Keyword.t()) :: {:ok, Object.t()} \| nil
	def get_obj_helper(id, options \\ []) do
	case Object.normalize(id, true, options) do
	%Object{} = object -> {:ok, object}
	_ -> nil
	end
	end

	@spec get_embedded_obj_helper(String.t() \| Object.t(), User.t()) :: {:ok, Object.t()} \| nil
	def get_embedded_obj_helper(%{"attributedTo" => attributed_to, "id" => object_id} = data, %User{
	ap_id: ap_id
	})
	when attributed_to == ap_id do
	with {:ok, activity} <-
	handle_incoming(%{
	"type" => "Create",
	"to" => data["to"],
	"cc" => data["cc"],
	"actor" => attributed_to,
	"object" => data
	}) do
	{:ok, Object.normalize(activity)}
	else
	_ -> get_obj_helper(object_id)
	end
	end

	def get_embedded_obj_helper(object_id, _) do
	get_obj_helper(object_id)
	end

	def set_reply_to_uri(%{"inReplyTo" => in_reply_to} = object) when is_binary(in_reply_to) do
	with false <- String.starts_with?(in_reply_to, "http"),
	{:ok, %{data: replied_to_object}} <- get_obj_helper(in_reply_to) do
	Map.put(object, "inReplyTo", replied_to_object["external_url"] \|\| in_reply_to)
	else
	_e -> object
	end
	end

	def set_reply_to_uri(obj), do: obj

	+ @doc """
	+ Serialized Mastodon-compatible `replies` collection containing _self-replies_.
	+ Based on Mastodon's ActivityPub::NoteSerializer#replies.
	+ """
	+ def set_replies(obj_data) do
	+ replies_uris =
	+ with limit when limit > 0 <-
	+ Pleroma.Config.get([:activitypub, :note_replies_output_limit], 0),
	+ %Object{} = object <- Object.get_cached_by_ap_id(obj_data["id"]) do
	+ object
	+ \|> Object.self_replies()
	+ \|> select([o], fragment("?->>'id'", o.data))
	+ \|> limit(^limit)
	+ \|> Repo.all()
	+ else
	+ _ -> []
	+ end
	+
	+ set_replies(obj_data, replies_uris)
	+ end
	+
	+ defp set_replies(obj, []) do
	+ obj
	+ end
	+
	+ defp set_replies(obj, replies_uris) do
	+ replies_collection = %{
	+ "type" => "Collection",
	+ "items" => replies_uris
	+ }
	+
	+ Map.merge(obj, %{"replies" => replies_collection})
	+ end
	+
	+ def replies(%{"replies" => %{"first" => %{"items" => items}}}) when not is_nil(items) do
	+ items
	+ end
	+
	+ def replies(%{"replies" => %{"items" => items}}) when not is_nil(items) do
	+ items
	+ end
	+
	+ def replies(_), do: []
	+
	# Prepares the object of an outgoing create activity.
	def prepare_object(object) do
	object
	\|> set_sensitive
	\|> add_hashtags
	\|> add_mention_tags
	\|> add_emoji_tags
	\|> add_attributed_to
	\|> prepare_attachments
	\|> set_conversation
	\|> set_reply_to_uri
	+ \|> set_replies
	\|> strip_internal_fields
	\|> strip_internal_tags
	\|> set_type
	end

	# @doc
	# """
	# internal -> Mastodon
	# """

	def prepare_outgoing(%{"type" => activity_type, "object" => object_id} = data)
	when activity_type in ["Create", "Listen"] do
	object =
	object_id
	\|> Object.normalize()
	\|> Map.get(:data)
	\|> prepare_object

	data =
	data
	\|> Map.put("object", object)
	\|> Map.merge(Utils.make_json_ld_header())
	\|> Map.delete("bcc")

	{:ok, data}
	end

	def prepare_outgoing(%{"type" => "Announce", "actor" => ap_id, "object" => object_id} = data) do
	object =
	object_id
	\|> Object.normalize()

	data =
	if Visibility.is_private?(object) && object.data["actor"] == ap_id do
	data \|> Map.put("object", object \|> Map.get(:data) \|> prepare_object)
	else
	data \|> maybe_fix_object_url
	end

	data =
	data
	\|> strip_internal_fields
	\|> Map.merge(Utils.make_json_ld_header())
	\|> Map.delete("bcc")

	{:ok, data}
	end

	# Mastodon Accept/Reject requires a non-normalized object containing the actor URIs,
	# because of course it does.
	def prepare_outgoing(%{"type" => "Accept"} = data) do
	with follow_activity <- Activity.normalize(data["object"]) do
	object = %{
	"actor" => follow_activity.actor,
	"object" => follow_activity.data["object"],
	"id" => follow_activity.data["id"],
	"type" => "Follow"
	}

	data =
	data
	\|> Map.put("object", object)
	\|> Map.merge(Utils.make_json_ld_header())

	{:ok, data}
	end
	end

	def prepare_outgoing(%{"type" => "Reject"} = data) do
	with follow_activity <- Activity.normalize(data["object"]) do
	object = %{
	"actor" => follow_activity.actor,
	"object" => follow_activity.data["object"],
	"id" => follow_activity.data["id"],
	"type" => "Follow"
	}

	data =
	data
	\|> Map.put("object", object)
	\|> Map.merge(Utils.make_json_ld_header())

	{:ok, data}
	end
	end

	def prepare_outgoing(%{"type" => _type} = data) do
	data =
	data
	\|> strip_internal_fields
	\|> maybe_fix_object_url
	\|> Map.merge(Utils.make_json_ld_header())

	{:ok, data}
	end

	def maybe_fix_object_url(%{"object" => object} = data) when is_binary(object) do
	with false <- String.starts_with?(object, "http"),
	{:fetch, {:ok, relative_object}} <- {:fetch, get_obj_helper(object)},
	%{data: %{"external_url" => external_url}} when not is_nil(external_url) <-
	relative_object do
	Map.put(data, "object", external_url)
	else
	{:fetch, e} ->
	Logger.error("Couldn't fetch #{object} #{inspect(e)}")
	data

	_ ->
	data
	end
	end

	def maybe_fix_object_url(data), do: data

	def add_hashtags(object) do
	tags =
	(object["tag"] \|\| [])
	\|> Enum.map(fn
	# Expand internal representation tags into AS2 tags.
	tag when is_binary(tag) ->
	%{
	"href" => Pleroma.Web.Endpoint.url() <> "/tags/#{tag}",
	"name" => "##{tag}",
	"type" => "Hashtag"
	}

	# Do not process tags which are already AS2 tag objects.
	tag when is_map(tag) ->
	tag
	end)

	Map.put(object, "tag", tags)
	end

	def add_mention_tags(object) do
	mentions =
	object
	\|> Utils.get_notified_from_object()
	\|> Enum.map(&build_mention_tag/1)

	tags = object["tag"] \|\| []

	Map.put(object, "tag", tags ++ mentions)
	end

	defp build_mention_tag(%{ap_id: ap_id, nickname: nickname} = _) do
	%{"type" => "Mention", "href" => ap_id, "name" => "@#{nickname}"}
	end

	def take_emoji_tags(%User{emoji: emoji}) do
	emoji
	\|> Enum.flat_map(&Map.to_list/1)
	\|> Enum.map(&build_emoji_tag/1)
	end

	# TODO: we should probably send mtime instead of unix epoch time for updated
	def add_emoji_tags(%{"emoji" => emoji} = object) do
	tags = object["tag"] \|\| []

	out = Enum.map(emoji, &build_emoji_tag/1)

	Map.put(object, "tag", tags ++ out)
	end

	def add_emoji_tags(object), do: object

	defp build_emoji_tag({name, url}) do
	%{
	"icon" => %{"url" => url, "type" => "Image"},
	"name" => ":" <> name <> ":",
	"type" => "Emoji",
	"updated" => "1970-01-01T00:00:00Z",
	"id" => url
	}
	end

	def set_conversation(object) do
	Map.put(object, "conversation", object["context"])
	end

	def set_sensitive(object) do
	tags = object["tag"] \|\| []
	Map.put(object, "sensitive", "nsfw" in tags)
	end

	def set_type(%{"type" => "Answer"} = object) do
	Map.put(object, "type", "Note")
	end

	def set_type(object), do: object

	def add_attributed_to(object) do
	attributed_to = object["attributedTo"] \|\| object["actor"]
	Map.put(object, "attributedTo", attributed_to)
	end

	def prepare_attachments(object) do
	attachments =
	(object["attachment"] \|\| [])
	\|> Enum.map(fn data ->
	[%{"mediaType" => media_type, "href" => href} \| _] = data["url"]
	%{"url" => href, "mediaType" => media_type, "name" => data["name"], "type" => "Document"}
	end)

	Map.put(object, "attachment", attachments)
	end

	def strip_internal_fields(object) do
	object
	\|> Map.drop(Constants.object_internal_fields())
	end

	defp strip_internal_tags(%{"tag" => tags} = object) do
	tags = Enum.filter(tags, fn x -> is_map(x) end)

	Map.put(object, "tag", tags)
	end

	defp strip_internal_tags(object), do: object

	def perform(:user_upgrade, user) do
	# we pass a fake user so that the followers collection is stripped away
	old_follower_address = User.ap_followers(%User{nickname: user.nickname})

	from(
	a in Activity,
	where: ^old_follower_address in a.recipients,
	update: [
	set: [
	recipients:
	fragment(
	"array_replace(?,?,?)",
	a.recipients,
	^old_follower_address,
	^user.follower_address
	)
	]
	]
	)
	\|> Repo.update_all([])
	end

	def upgrade_user_from_ap_id(ap_id) do
	with %User{local: false} = user <- User.get_cached_by_ap_id(ap_id),
	{:ok, data} <- ActivityPub.fetch_and_prepare_user_from_ap_id(ap_id),
	already_ap <- User.ap_enabled?(user),
	{:ok, user} <- upgrade_user(user, data) do
	if not already_ap do
	TransmogrifierWorker.enqueue("user_upgrade", %{"user_id" => user.id})
	end

	{:ok, user}
	else
	%User{} = user -> {:ok, user}
	e -> e
	end
	end

	defp upgrade_user(user, data) do
	user
	\|> User.upgrade_changeset(data, true)
	\|> User.update_and_set_cache()
	end

	def maybe_fix_user_url(%{"url" => url} = data) when is_map(url) do
	Map.put(data, "url", url["href"])
	end

	def maybe_fix_user_url(data), do: data

	def maybe_fix_user_object(data), do: maybe_fix_user_url(data)
	end
	diff --git a/lib/mix/tasks/pleroma/instance.ex b/lib/mix/tasks/pleroma/instance.ex
	index 0e60f8fdc..b6f04eefe 100644
	--- a/lib/mix/tasks/pleroma/instance.ex
	+++ b/lib/mix/tasks/pleroma/instance.ex
	@@ -1,240 +1,245 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2019 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Mix.Tasks.Pleroma.Instance do
	use Mix.Task
	import Mix.Pleroma
	alias Pleroma.Crypto

	+ alias Pleroma.Config
	+
	@shortdoc "Manages Pleroma instance"
	@moduledoc File.read!("docs/administration/CLI_tasks/instance.md")

	def run(["gen" \| rest]) do
	{options, [], []} =
	OptionParser.parse(
	rest,
	strict: [
	force: :boolean,
	output: :string,
	output_psql: :string,
	domain: :string,
	instance_name: :string,
	admin_email: :string,
	notify_email: :string,
	dbhost: :string,
	dbname: :string,
	dbuser: :string,
	dbpass: :string,
	rum: :string,
	indexable: :string,
	db_configurable: :string,
	uploads_dir: :string,
	static_dir: :string,
	listen_ip: :string,
	listen_port: :string
	],
	aliases: [
	o: :output,
	f: :force
	]
	)

	paths =
	[config_path, psql_path] = [
	Keyword.get(options, :output, "config/generated_config.exs"),
	Keyword.get(options, :output_psql, "config/setup_db.psql")
	]

	will_overwrite = Enum.filter(paths, &File.exists?/1)
	proceed? = Enum.empty?(will_overwrite) or Keyword.get(options, :force, false)

	if proceed? do
	[domain, port \| _] =
	String.split(
	get_option(
	options,
	:domain,
	"What domain will your instance use? (e.g pleroma.soykaf.com)"
	),
	":"
	) ++ [443]

	name =
	get_option(
	options,
	:instance_name,
	"What is the name of your instance? (e.g. Pleroma/Soykaf)"
	)

	email = get_option(options, :admin_email, "What is your admin email address?")

	notify_email =
	get_option(
	options,
	:notify_email,
	"What email address do you want to use for sending email notifications?",
	email
	)

	indexable =
	get_option(
	options,
	:indexable,
	"Do you want search engines to index your site? (y/n)",
	"y"
	) === "y"

	db_configurable? =
	get_option(
	options,
	:db_configurable,
	"Do you want to store the configuration in the database (allows controlling it from admin-fe)? (y/n)",
	"n"
	) === "y"

	dbhost = get_option(options, :dbhost, "What is the hostname of your database?", "localhost")

	dbname = get_option(options, :dbname, "What is the name of your database?", "pleroma")

	dbuser =
	get_option(
	options,
	:dbuser,
	"What is the user used to connect to your database?",
	"pleroma"
	)

	dbpass =
	get_option(
	options,
	:dbpass,
	"What is the password used to connect to your database?",
	64 \|> Crypto.random_string() \|> binary_part(0, 64),
	"autogenerated"
	)

	rum_enabled =
	get_option(
	options,
	:rum,
	"Would you like to use RUM indices?",
	"n"
	) === "y"

	listen_port =
	get_option(
	options,
	:listen_port,
	"What port will the app listen to (leave it if you are using the default setup with nginx)?",
	4000
	)

	listen_ip =
	get_option(
	options,
	:listen_ip,
	"What ip will the app listen to (leave it if you are using the default setup with nginx)?",
	"127.0.0.1"
	)

	uploads_dir =
	get_option(
	options,
	:uploads_dir,
	"What directory should media uploads go in (when using the local uploader)?",
	Pleroma.Config.get([Pleroma.Upload.Uploader.Local, :uploads])
	)

	static_dir =
	get_option(
	options,
	:static_dir,
	"What directory should custom public files be read from (custom emojis, frontend bundle overrides, robots.txt, etc.)?",
	Pleroma.Config.get([:instance, :static_dir])
	)

	+ Config.put([:instance, :static_dir], static_dir)
	+
	secret = 64 \|> Crypto.random_string() \|> binary_part(0, 64)
	jwt_secret = 64 \|> Crypto.random_string() \|> binary_part(0, 64)
	signing_salt = 8 \|> Crypto.random_string() \|> binary_part(0, 8)
	+
	{web_push_public_key, web_push_private_key} = :crypto.generate_key(:ecdh, :prime256v1)
	template_dir = Application.app_dir(:pleroma, "priv") <> "/templates"

	result_config =
	EEx.eval_file(
	template_dir <> "/sample_config.eex",
	domain: domain,
	port: port,
	email: email,
	notify_email: notify_email,
	name: name,
	dbhost: dbhost,
	dbname: dbname,
	dbuser: dbuser,
	dbpass: dbpass,
	secret: secret,
	jwt_secret: jwt_secret,
	signing_salt: signing_salt,
	web_push_public_key: Base.url_encode64(web_push_public_key, padding: false),
	web_push_private_key: Base.url_encode64(web_push_private_key, padding: false),
	db_configurable?: db_configurable?,
	static_dir: static_dir,
	uploads_dir: uploads_dir,
	rum_enabled: rum_enabled,
	listen_ip: listen_ip,
	listen_port: listen_port
	)

	result_psql =
	EEx.eval_file(
	template_dir <> "/sample_psql.eex",
	dbname: dbname,
	dbuser: dbuser,
	dbpass: dbpass,
	rum_enabled: rum_enabled
	)

	shell_info("Writing config to #{config_path}.")

	File.write(config_path, result_config)
	shell_info("Writing the postgres script to #{psql_path}.")
	File.write(psql_path, result_psql)

	write_robots_txt(indexable, template_dir)

	shell_info(
	"\n All files successfully written! Refer to the installation instructions for your platform for next steps"
	)
	else
	shell_error(
	"The task would have overwritten the following files:\n" <>
	(Enum.map(paths, &"- #{&1}\n") \|> Enum.join("")) <>
	"Rerun with `--force` to overwrite them."
	)
	end
	end

	defp write_robots_txt(indexable, template_dir) do
	robots_txt =
	EEx.eval_file(
	template_dir <> "/robots_txt.eex",
	indexable: indexable
	)

	static_dir = Pleroma.Config.get([:instance, :static_dir], "instance/static/")

	unless File.exists?(static_dir) do
	File.mkdir_p!(static_dir)
	end

	robots_txt_path = Path.join(static_dir, "robots.txt")

	if File.exists?(robots_txt_path) do
	File.cp!(robots_txt_path, "#{robots_txt_path}.bak")
	shell_info("Backing up existing robots.txt to #{robots_txt_path}.bak")
	end

	File.write(robots_txt_path, robots_txt)
	shell_info("Writing #{robots_txt_path}.")
	end
	end
	diff --git a/lib/mix/tasks/pleroma/refresh_counter_cache.ex b/lib/mix/tasks/pleroma/refresh_counter_cache.ex
	new file mode 100644
	index 000000000..b39219aa7
	--- /dev/null
	+++ b/lib/mix/tasks/pleroma/refresh_counter_cache.ex
	@@ -0,0 +1,46 @@
	+# Pleroma: A lightweight social networking server
	+# Copyright © 2017-2019 Pleroma Authors <https://pleroma.social/>
	+# SPDX-License-Identifier: AGPL-3.0-only
	+
	+defmodule Mix.Tasks.Pleroma.RefreshCounterCache do
	+ @shortdoc "Refreshes counter cache"
	+
	+ use Mix.Task
	+
	+ alias Pleroma.Activity
	+ alias Pleroma.CounterCache
	+ alias Pleroma.Storage.Repo
	+
	+ require Logger
	+ import Ecto.Query
	+
	+ def run([]) do
	+ Mix.Pleroma.start_pleroma()
	+
	+ ["public", "unlisted", "private", "direct"]
	+ \|> Enum.each(fn visibility ->
	+ count = status_visibility_count_query(visibility)
	+ name = "status_visibility_#{visibility}"
	+ CounterCache.set(name, count)
	+ Mix.Pleroma.shell_info("Set #{name} to #{count}")
	+ end)
	+
	+ Mix.Pleroma.shell_info("Done")
	+ end
	+
	+ defp status_visibility_count_query(visibility) do
	+ Activity
	+ \|> where(
	+ [a],
	+ fragment(
	+ "activity_visibility(?, ?, ?) = ?",
	+ a.actor,
	+ a.recipients,
	+ a.data,
	+ ^visibility
	+ )
	+ )
	+ \|> where([a], fragment("(? ->> 'type'::text) = 'Create'", a.data))
	+ \|> Repo.aggregate(:count, :id, timeout: :timer.minutes(30))
	+ end
	+end
	diff --git a/lib/pleroma/captcha/captcha.ex b/lib/pleroma/captcha/captcha.ex
	index c2765a5b8..cf75c3adc 100644
	--- a/lib/pleroma/captcha/captcha.ex
	+++ b/lib/pleroma/captcha/captcha.ex
	@@ -1,114 +1,115 @@
	# Pleroma: A lightweight social networking server
	-# Copyright © 2017-2019 Pleroma Authors <https://pleroma.social/>
	+# Copyright © 2017-2020 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Captcha do
	import Pleroma.Web.Gettext

	alias Calendar.DateTime
	alias Plug.Crypto.KeyGenerator
	alias Plug.Crypto.MessageEncryptor

	use GenServer

	@doc false
	def start_link(_) do
	GenServer.start_link(__MODULE__, [], name: __MODULE__)
	end

	@doc false
	def init(_) do
	{:ok, nil}
	end

	@doc """
	Ask the configured captcha service for a new captcha
	"""
	def new do
	GenServer.call(__MODULE__, :new)
	end

	@doc """
	Ask the configured captcha service to validate the captcha
	"""
	def validate(token, captcha, answer_data) do
	GenServer.call(__MODULE__, {:validate, token, captcha, answer_data})
	end

	@doc false
	def handle_call(:new, _from, state) do
	enabled = Pleroma.Config.get([__MODULE__, :enabled])

	if !enabled do
	{:reply, %{type: :none}, state}
	else
	new_captcha = method().new()

	secret_key_base = Pleroma.Config.get!([Pleroma.Web.Endpoint, :secret_key_base])

	# This make salt a little different for two keys
	token = new_captcha[:token]
	secret = KeyGenerator.generate(secret_key_base, token <> "_encrypt")
	sign_secret = KeyGenerator.generate(secret_key_base, token <> "_sign")
	- # Basicallty copy what Phoenix.Token does here, add the time to
	+ # Basically copy what Phoenix.Token does here, add the time to
	# the actual data and make it a binary to then encrypt it
	encrypted_captcha_answer =
	%{
	at: DateTime.now_utc(),
	answer_data: new_captcha[:answer_data]
	}
	\|> :erlang.term_to_binary()
	\|> MessageEncryptor.encrypt(secret, sign_secret)

	{
	:reply,
	- # Repalce the answer with the encrypted answer
	+ # Replace the answer with the encrypted answer
	%{new_captcha \| answer_data: encrypted_captcha_answer},
	state
	}
	end
	end

	@doc false
	def handle_call({:validate, token, captcha, answer_data}, _from, state) do
	secret_key_base = Pleroma.Config.get!([Pleroma.Web.Endpoint, :secret_key_base])
	secret = KeyGenerator.generate(secret_key_base, token <> "_encrypt")
	sign_secret = KeyGenerator.generate(secret_key_base, token <> "_sign")

	# If the time found is less than (current_time-seconds_valid) then the time has already passed
	# Later we check that the time found is more than the presumed invalidatation time, that means
	# that the data is still valid and the captcha can be checked
	seconds_valid = Pleroma.Config.get!([Pleroma.Captcha, :seconds_valid])
	valid_if_after = DateTime.subtract!(DateTime.now_utc(), seconds_valid)

	result =
	- with {:ok, data} <- MessageEncryptor.decrypt(answer_data, secret, sign_secret),
	+ with false <- is_nil(answer_data),
	+ {:ok, data} <- MessageEncryptor.decrypt(answer_data, secret, sign_secret),
	%{at: at, answer_data: answer_md5} <- :erlang.binary_to_term(data) do
	try do
	if DateTime.before?(at, valid_if_after),
	do: throw({:error, dgettext("errors", "CAPTCHA expired")})

	if not is_nil(Cachex.get!(:used_captcha_cache, token)),
	do: throw({:error, dgettext("errors", "CAPTCHA already used")})

	res = method().validate(token, captcha, answer_md5)
	# Throw if an error occurs
	if res != :ok, do: throw(res)

	# Mark this captcha as used
	{:ok, _} =
	Cachex.put(:used_captcha_cache, token, true, ttl: :timer.seconds(seconds_valid))

	:ok
	catch
	:throw, e -> e
	end
	else
	_ -> {:error, dgettext("errors", "Invalid answer data")}
	end

	{:reply, result, state}
	end

	defp method, do: Pleroma.Config.get!([__MODULE__, :method])
	end
	diff --git a/lib/pleroma/healthcheck/stats.ex b/lib/pleroma/healthcheck/stats.ex
	index 28bcf0b33..ca3c71e68 100644
	--- a/lib/pleroma/healthcheck/stats.ex
	+++ b/lib/pleroma/healthcheck/stats.ex
	@@ -1,99 +1,118 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2019 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Healthcheck.Stats do
	import Ecto.Query
	+
	+ alias Pleroma.CounterCache
	alias Pleroma.Storage.Repo
	alias Pleroma.User

	use GenServer

	@init_state %{
	peers: [],
	stats: %{
	domain_count: 0,
	status_count: 0,
	user_count: 0
	}
	}

	def start_link(_) do
	GenServer.start_link(
	__MODULE__,
	@init_state,
	name: __MODULE__
	)
	end

	@doc "Performs update stats"
	def force_update do
	GenServer.call(__MODULE__, :force_update)
	end

	@doc "Performs collect stats"
	def do_collect do
	GenServer.cast(__MODULE__, :run_update)
	end

	@doc "Returns stats data"
	@spec get_stats() :: %{domain_count: integer(), status_count: integer(), user_count: integer()}
	def get_stats do
	%{stats: stats} = GenServer.call(__MODULE__, :get_state)

	stats
	end

	@doc "Returns list peers"
	@spec get_peers() :: list(String.t())
	def get_peers do
	%{peers: peers} = GenServer.call(__MODULE__, :get_state)

	peers
	end

	def init(args) do
	{:ok, args}
	end

	def handle_call(:force_update, _from, _state) do
	new_stats = get_stat_data()
	{:reply, new_stats, new_stats}
	end

	def handle_call(:get_state, _from, state) do
	{:reply, state, state}
	end

	def handle_cast(:run_update, _state) do
	new_stats = get_stat_data()

	{:noreply, new_stats}
	end

	defp get_stat_data do
	peers =
	from(
	u in User,
	select: fragment("distinct split_part(?, '@', 2)", u.nickname),
	where: u.local != ^true
	)
	\|> Repo.all()
	\|> Enum.filter(& &1)

	domain_count = Enum.count(peers)

	status_count = Repo.aggregate(User.Query.build(%{local: true}), :sum, :note_count)

	user_count = Repo.aggregate(User.Query.build(%{local: true, active: true}), :count, :id)

	%{
	peers: peers,
	stats: %{
	domain_count: domain_count,
	status_count: status_count,
	user_count: user_count
	}
	}
	end
	+
	+ def get_status_visibility_count do
	+ counter_cache =
	+ CounterCache.get_as_map([
	+ "status_visibility_public",
	+ "status_visibility_private",
	+ "status_visibility_unlisted",
	+ "status_visibility_direct"
	+ ])
	+
	+ %{
	+ public: counter_cache["status_visibility_public"] \|\| 0,
	+ unlisted: counter_cache["status_visibility_unlisted"] \|\| 0,
	+ private: counter_cache["status_visibility_private"] \|\| 0,
	+ direct: counter_cache["status_visibility_direct"] \|\| 0
	+ }
	+ end
	end
	diff --git a/lib/pleroma/schemas/activity/queries.ex b/lib/pleroma/schemas/activity/queries.ex
	index 79f305201..363727c80 100644
	--- a/lib/pleroma/schemas/activity/queries.ex
	+++ b/lib/pleroma/schemas/activity/queries.ex
	@@ -1,85 +1,101 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2019 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Activity.Queries do
	@moduledoc """
	Contains queries for Activity.
	"""

	- import Ecto.Query, only: [from: 2]
	+ import Ecto.Query, only: [from: 2, where: 3]

	@type query :: Ecto.Queryable.t() \| Activity.t()

	alias Pleroma.Activity
	alias Pleroma.User

	@spec by_ap_id(query, String.t()) :: query
	def by_ap_id(query \\ Activity, ap_id) do
	from(
	activity in query,
	where: fragment("(?)->>'id' = ?", activity.data, ^to_string(ap_id))
	)
	end

	@spec by_actor(query, String.t()) :: query
	def by_actor(query \\ Activity, actor) do
	from(
	activity in query,
	where: fragment("(?)->>'actor' = ?", activity.data, ^actor)
	)
	end

	@spec by_author(query, String.t()) :: query
	def by_author(query \\ Activity, %User{ap_id: ap_id}) do
	from(a in query, where: a.actor == ^ap_id)
	end

	@spec by_object_id(query, String.t() \| [String.t()]) :: query
	def by_object_id(query \\ Activity, object_id)

	def by_object_id(query, object_ids) when is_list(object_ids) do
	from(
	activity in query,
	where:
	fragment(
	"coalesce((?)->'object'->>'id', (?)->>'object') = ANY(?)",
	activity.data,
	activity.data,
	^object_ids
	)
	)
	end

	def by_object_id(query, object_id) when is_binary(object_id) do
	from(activity in query,
	where:
	fragment(
	"coalesce((?)->'object'->>'id', (?)->>'object') = ?",
	activity.data,
	activity.data,
	^object_id
	)
	)
	end

	+ @spec by_object_in_reply_to_id(query, String.t(), keyword()) :: query
	+ def by_object_in_reply_to_id(query, in_reply_to_id, opts \\ []) do
	+ query =
	+ if opts[:skip_preloading] do
	+ Activity.with_joined_object(query)
	+ else
	+ Activity.with_preloaded_object(query)
	+ end
	+
	+ where(
	+ query,
	+ [activity, object: o],
	+ fragment("(?)->>'inReplyTo' = ?", o.data, ^to_string(in_reply_to_id))
	+ )
	+ end
	+
	@spec by_type(query, String.t()) :: query
	def by_type(query \\ Activity, activity_type) do
	from(
	activity in query,
	where: fragment("(?)->>'type' = ?", activity.data, ^activity_type)
	)
	end

	@spec exclude_type(query, String.t()) :: query
	def exclude_type(query \\ Activity, activity_type) do
	from(
	activity in query,
	where: fragment("(?)->>'type' != ?", activity.data, ^activity_type)
	)
	end

	def exclude_authors(query \\ Activity, actors) do
	from(activity in query, where: activity.actor not in ^actors)
	end
	end
	diff --git a/lib/pleroma/schemas/counter_cache.ex b/lib/pleroma/schemas/counter_cache.ex
	new file mode 100644
	index 000000000..c1049e3c3
	--- /dev/null
	+++ b/lib/pleroma/schemas/counter_cache.ex
	@@ -0,0 +1,41 @@
	+# Pleroma: A lightweight social networking server
	+# Copyright © 2017-2019 Pleroma Authors <https://pleroma.social/>
	+# SPDX-License-Identifier: AGPL-3.0-only
	+
	+defmodule Pleroma.CounterCache do
	+ use Ecto.Schema
	+ import Ecto.Changeset
	+ import Ecto.Query
	+ alias Pleroma.CounterCache
	+ alias Pleroma.Storage.Repo
	+
	+ schema "counter_cache" do
	+ field(:name, :string)
	+ field(:count, :integer)
	+ end
	+
	+ def changeset(struct, params) do
	+ struct
	+ \|> cast(params, [:name, :count])
	+ \|> validate_required([:name])
	+ \|> unique_constraint(:name)
	+ end
	+
	+ def get_as_map(names) when is_list(names) do
	+ CounterCache
	+ \|> where([cc], cc.name in ^names)
	+ \|> Repo.all()
	+ \|> Enum.group_by(& &1.name, & &1.count)
	+ \|> Map.new(fn {k, v} -> {k, hd(v)} end)
	+ end
	+
	+ def set(name, count) do
	+ %CounterCache{}
	+ \|> changeset(%{"name" => name, "count" => count})
	+ \|> Repo.insert(
	+ on_conflict: [set: [count: count]],
	+ returning: true,
	+ conflict_target: :name
	+ )
	+ end
	+end
	diff --git a/lib/pleroma/schemas/object.ex b/lib/pleroma/schemas/object.ex
	index dc8b8c405..91a4f0696 100644
	--- a/lib/pleroma/schemas/object.ex
	+++ b/lib/pleroma/schemas/object.ex
	@@ -1,304 +1,326 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2019 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Object do
	use Ecto.Schema

	alias Pleroma.Activity
	alias Pleroma.Object
	alias Pleroma.Object.Fetcher
	alias Pleroma.ObjectTombstone
	alias Pleroma.Storage.Repo
	alias Pleroma.User

	import Ecto.Query
	import Ecto.Changeset

	require Logger

	@type t() :: %__MODULE__{}

	@derive {Jason.Encoder, only: [:data]}

	schema "objects" do
	field(:data, :map)

	timestamps()
	end

	def with_joined_activity(query, activity_type \\ "Create", join_type \\ :inner) do
	object_position = Map.get(query.aliases, :object, 0)

	join(query, join_type, [{object, object_position}], a in Activity,
	on:
	fragment(
	"COALESCE(?->'object'->>'id', ?->>'object') = (? ->> 'id') AND (?->>'type' = ?) ",
	a.data,
	a.data,
	object.data,
	a.data,
	^activity_type
	),
	as: :object_activity
	)
	end

	def create(data) do
	Object.change(%Object{}, %{data: data})
	\|> Repo.insert()
	end

	def change(struct, params \\ %{}) do
	struct
	\|> cast(params, [:data])
	\|> validate_required([:data])
	\|> unique_constraint(:ap_id, name: :objects_unique_apid_index)
	end

	def get_by_id(nil), do: nil
	def get_by_id(id), do: Repo.get(Object, id)

	def get_by_id_and_maybe_refetch(id, opts \\ []) do
	%{updated_at: updated_at} = object = get_by_id(id)

	if opts[:interval] &&
	NaiveDateTime.diff(NaiveDateTime.utc_now(), updated_at) > opts[:interval] do
	case Fetcher.refetch_object(object) do
	{:ok, %Object{} = object} ->
	object

	e ->
	Logger.error("Couldn't refresh #{object.data["id"]}:\n#{inspect(e)}")
	object
	end
	else
	object
	end
	end

	def get_by_ap_id(nil), do: nil

	def get_by_ap_id(ap_id) do
	Repo.one(from(object in Object, where: fragment("(?)->>'id' = ?", object.data, ^ap_id)))
	end

	@doc """
	Get a single attachment by it's name and href
	"""
	@spec get_attachment_by_name_and_href(String.t(), String.t()) :: Object.t() \| nil
	def get_attachment_by_name_and_href(name, href) do
	query =
	from(o in Object,
	where: fragment("(?)->>'name' = ?", o.data, ^name),
	where: fragment("(?)->>'href' = ?", o.data, ^href)
	)

	Repo.one(query)
	end

	defp warn_on_no_object_preloaded(ap_id) do
	"Object.normalize() called without preloaded object (#{inspect(ap_id)}). Consider preloading the object"
	\|> Logger.debug()

	Logger.debug("Backtrace: #{inspect(Process.info(:erlang.self(), :current_stacktrace))}")
	end

	def normalize(_, fetch_remote \\ true, options \\ [])

	# If we pass an Activity to Object.normalize(), we can try to use the preloaded object.
	# Use this whenever possible, especially when walking graphs in an O(N) loop!
	def normalize(%Object{} = object, _, _), do: object
	def normalize(%Activity{object: %Object{} = object}, _, _), do: object

	# A hack for fake activities
	def normalize(%Activity{data: %{"object" => %{"fake" => true} = data}}, _, _) do
	%Object{id: "pleroma:fake_object_id", data: data}
	end

	# No preloaded object
	def normalize(%Activity{data: %{"object" => %{"id" => ap_id}}}, fetch_remote, _) do
	warn_on_no_object_preloaded(ap_id)
	normalize(ap_id, fetch_remote)
	end

	# No preloaded object
	def normalize(%Activity{data: %{"object" => ap_id}}, fetch_remote, _) do
	warn_on_no_object_preloaded(ap_id)
	normalize(ap_id, fetch_remote)
	end

	# Old way, try fetching the object through cache.
	def normalize(%{"id" => ap_id}, fetch_remote, _), do: normalize(ap_id, fetch_remote)
	def normalize(ap_id, false, _) when is_binary(ap_id), do: get_cached_by_ap_id(ap_id)

	def normalize(ap_id, true, options) when is_binary(ap_id) do
	Fetcher.fetch_object_from_id!(ap_id, options)
	end

	def normalize(_, _, _), do: nil

	# Owned objects can only be mutated by their owner
	def authorize_mutation(%Object{data: %{"actor" => actor}}, %User{ap_id: ap_id}),
	do: actor == ap_id

	# Legacy objects can be mutated by anybody
	def authorize_mutation(%Object{}, %User{}), do: true

	def get_cached_by_ap_id(ap_id) do
	key = "object:#{ap_id}"

	Cachex.fetch!(:object_cache, key, fn _ ->
	object = get_by_ap_id(ap_id)

	if object do
	{:commit, object}
	else
	{:ignore, object}
	end
	end)
	end

	def context_mapping(context) do
	Object.change(%Object{}, %{data: %{"id" => context}})
	end

	def make_tombstone(%Object{data: %{"id" => id, "type" => type}}, deleted \\ DateTime.utc_now()) do
	%ObjectTombstone{
	id: id,
	formerType: type,
	deleted: deleted
	}
	\|> Map.from_struct()
	end

	def swap_object_with_tombstone(object) do
	tombstone = make_tombstone(object)

	object
	\|> Object.change(%{data: tombstone})
	\|> Repo.update()
	end

	def delete(%Object{data: %{"id" => id}} = object) do
	with {:ok, _obj} = swap_object_with_tombstone(object),
	deleted_activity = Activity.delete_all_by_object_ap_id(id),
	{:ok, true} <- Cachex.del(:object_cache, "object:#{id}"),
	{:ok, _} <- Cachex.del(:web_resp_cache, URI.parse(id).path) do
	with true <- Pleroma.Config.get([:instance, :cleanup_attachments]) do
	{:ok, _} =
	Pleroma.Workers.AttachmentsCleanupWorker.enqueue("cleanup_attachments", %{
	"object" => object
	})
	end

	{:ok, object, deleted_activity}
	end
	end

	def prune(%Object{data: %{"id" => id}} = object) do
	with {:ok, object} <- Repo.delete(object),
	{:ok, true} <- Cachex.del(:object_cache, "object:#{id}"),
	{:ok, _} <- Cachex.del(:web_resp_cache, URI.parse(id).path) do
	{:ok, object}
	end
	end

	def set_cache(%Object{data: %{"id" => ap_id}} = object) do
	Cachex.put(:object_cache, "object:#{ap_id}", object)
	{:ok, object}
	end

	def update_and_set_cache(changeset) do
	with {:ok, object} <- Repo.update(changeset) do
	set_cache(object)
	end
	end

	def increase_replies_count(ap_id) do
	Object
	\|> where([o], fragment("?->>'id' = ?::text", o.data, ^to_string(ap_id)))
	\|> update([o],
	set: [
	data:
	fragment(
	"""
	safe_jsonb_set(?, '{repliesCount}',
	(coalesce((?->>'repliesCount')::int, 0) + 1)::varchar::jsonb, true)
	""",
	o.data,
	o.data
	)
	]
	)
	\|> Repo.update_all([])
	\|> case do
	{1, [object]} -> set_cache(object)
	_ -> {:error, "Not found"}
	end
	end

	def decrease_replies_count(ap_id) do
	Object
	\|> where([o], fragment("?->>'id' = ?::text", o.data, ^to_string(ap_id)))
	\|> update([o],
	set: [
	data:
	fragment(
	"""
	safe_jsonb_set(?, '{repliesCount}',
	(greatest(0, (?->>'repliesCount')::int - 1))::varchar::jsonb, true)
	""",
	o.data,
	o.data
	)
	]
	)
	\|> Repo.update_all([])
	\|> case do
	{1, [object]} -> set_cache(object)
	_ -> {:error, "Not found"}
	end
	end

	def increase_vote_count(ap_id, name) do
	with %Object{} = object <- Object.normalize(ap_id),
	"Question" <- object.data["type"] do
	multiple = Map.has_key?(object.data, "anyOf")

	options =
	(object.data["anyOf"] \|\| object.data["oneOf"] \|\| [])
	\|> Enum.map(fn
	%{"name" => ^name} = option ->
	Kernel.update_in(option["replies"]["totalItems"], &(&1 + 1))

	option ->
	option
	end)

	data =
	if multiple do
	Map.put(object.data, "anyOf", options)
	else
	Map.put(object.data, "oneOf", options)
	end

	object
	\|> Object.change(%{data: data})
	\|> update_and_set_cache()
	else
	_ -> :noop
	end
	end

	@doc "Updates data field of an object"
	def update_data(%Object{data: data} = object, attrs \\ %{}) do
	object
	\|> Object.change(%{data: Map.merge(data \|\| %{}, attrs)})
	\|> Repo.update()
	end

	def local?(%Object{data: %{"id" => id}}) do
	String.starts_with?(id, Pleroma.Web.base_url() <> "/")
	end
	+
	+ def replies(object, opts \\ []) do
	+ object = Object.normalize(object)
	+
	+ query =
	+ Object
	+ \|> where(
	+ [o],
	+ fragment("(?)->>'inReplyTo' = ?", o.data, ^object.data["id"])
	+ )
	+ \|> order_by([o], asc: o.id)
	+
	+ if opts[:self_only] do
	+ actor = object.data["actor"]
	+ where(query, [o], fragment("(?)->>'actor' = ?", o.data, ^actor))
	+ else
	+ query
	+ end
	+ end
	+
	+ def self_replies(object, opts \\ []),
	+ do: replies(object, Keyword.put(opts, :self_only, true))
	end
	diff --git a/lib/pleroma/schemas/object/fetcher.ex b/lib/pleroma/schemas/object/fetcher.ex
	index 926ad45fb..49e7e94f8 100644
	--- a/lib/pleroma/schemas/object/fetcher.ex
	+++ b/lib/pleroma/schemas/object/fetcher.ex
	@@ -1,196 +1,200 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2019 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Object.Fetcher do
	+ alias Pleroma.Federation.ActivityPub.Federator
	alias Pleroma.Federation.ActivityPub.InternalFetchActor
	alias Pleroma.Federation.ActivityPub.Transmogrifier
	alias Pleroma.Federation.HTTPSignatures.Signature
	alias Pleroma.Helpers.Constants
	alias Pleroma.HTTP
	alias Pleroma.Object
	alias Pleroma.Object.Containment
	alias Pleroma.Storage.Repo

	require Logger
	require Pleroma.Helpers.Constants

	defp touch_changeset(changeset) do
	updated_at =
	NaiveDateTime.utc_now()
	\|> NaiveDateTime.truncate(:second)

	Ecto.Changeset.put_change(changeset, :updated_at, updated_at)
	end

	defp maybe_reinject_internal_fields(data, %{data: %{} = old_data}) do
	internal_fields = Map.take(old_data, Constants.object_internal_fields())

	Map.merge(data, internal_fields)
	end

	defp maybe_reinject_internal_fields(data, _), do: data

	@spec reinject_object(struct(), map()) :: {:ok, Object.t()} \| {:error, any()}
	defp reinject_object(struct, data) do
	Logger.debug("Reinjecting object #{data["id"]}")

	with data <- Transmogrifier.fix_object(data),
	data <- maybe_reinject_internal_fields(data, struct),
	changeset <- Object.change(struct, %{data: data}),
	changeset <- touch_changeset(changeset),
	{:ok, object} <- Repo.insert_or_update(changeset),
	{:ok, object} <- Object.set_cache(object) do
	{:ok, object}
	else
	e ->
	Logger.error("Error while processing object: #{inspect(e)}")
	{:error, e}
	end
	end

	def refetch_object(%Object{data: %{"id" => id}} = object) do
	with {:local, false} <- {:local, Object.local?(object)},
	{:ok, data} <- fetch_and_contain_remote_object_from_id(id),
	{:ok, object} <- reinject_object(object, data) do
	{:ok, object}
	else
	{:local, true} -> {:ok, object}
	e -> {:error, e}
	end
	end

	- # TODO:
	- # This will create a Create activity, which we need internally at the moment.
	+ # Note: will create a Create activity, which we need internally at the moment.
	def fetch_object_from_id(id, options \\ []) do
	- with {:fetch_object, nil} <- {:fetch_object, Object.get_cached_by_ap_id(id)},
	- {:fetch, {:ok, data}} <- {:fetch, fetch_and_contain_remote_object_from_id(id)},
	- {:normalize, nil} <- {:normalize, Object.normalize(data, false)},
	+ with {_, nil} <- {:fetch_object, Object.get_cached_by_ap_id(id)},
	+ {_, true} <- {:allowed_depth, Federator.allowed_thread_distance?(options[:depth])},
	+ {_, {:ok, data}} <- {:fetch, fetch_and_contain_remote_object_from_id(id)},
	+ {_, nil} <- {:normalize, Object.normalize(data, false)},
	params <- prepare_activity_params(data),
	- {:containment, :ok} <- {:containment, Containment.contain_origin(id, params)},
	- {:transmogrifier, {:ok, activity}} <-
	+ {_, :ok} <- {:containment, Containment.contain_origin(id, params)},
	+ {_, {:ok, activity}} <-
	{:transmogrifier, Transmogrifier.handle_incoming(params, options)},
	- {:object, _data, %Object{} = object} <-
	+ {_, _data, %Object{} = object} <-
	{:object, data, Object.normalize(activity, false)} do
	{:ok, object}
	else
	+ {:allowed_depth, false} ->
	+ {:error, "Max thread distance exceeded."}
	+
	{:containment, _} ->
	{:error, "Object containment failed."}

	{:transmogrifier, {:error, {:reject, nil}}} ->
	{:reject, nil}

	{:transmogrifier, _} ->
	{:error, "Transmogrifier failure."}

	{:object, data, nil} ->
	reinject_object(%Object{}, data)

	{:normalize, object = %Object{}} ->
	{:ok, object}

	{:fetch_object, %Object{} = object} ->
	{:ok, object}

	{:fetch, {:error, error}} ->
	{:error, error}

	e ->
	e
	end
	end

	defp prepare_activity_params(data) do
	%{
	"type" => "Create",
	"to" => data["to"],
	"cc" => data["cc"],
	# Should we seriously keep this attributedTo thing?
	"actor" => data["actor"] \|\| data["attributedTo"],
	"object" => data
	}
	end

	def fetch_object_from_id!(id, options \\ []) do
	with {:ok, object} <- fetch_object_from_id(id, options) do
	object
	else
	{:error, %Tesla.Mock.Error{}} ->
	nil

	{:error, "Object has been deleted"} ->
	nil

	e ->
	Logger.error("Error while fetching #{id}: #{inspect(e)}")
	nil
	end
	end

	defp make_signature(id, date) do
	uri = URI.parse(id)

	signature =
	InternalFetchActor.get_actor()
	\|> Signature.sign(%{
	"(request-target)": "get #{uri.path}",
	host: uri.host,
	date: date
	})

	[{:Signature, signature}]
	end

	defp sign_fetch(headers, id, date) do
	if Pleroma.Config.get([:activitypub, :sign_object_fetches]) do
	headers ++ make_signature(id, date)
	else
	headers
	end
	end

	defp maybe_date_fetch(headers, date) do
	if Pleroma.Config.get([:activitypub, :sign_object_fetches]) do
	headers ++ [{:Date, date}]
	else
	headers
	end
	end

	def fetch_and_contain_remote_object_from_id(id) when is_binary(id) do
	Logger.debug("Fetching object #{id} via AP")

	date = Signature.signed_date()

	headers =
	[{:Accept, "application/activity+json"}]
	\|> maybe_date_fetch(date)
	\|> sign_fetch(id, date)

	Logger.debug("Fetch headers: #{inspect(headers)}")

	with {:scheme, true} <- {:scheme, String.starts_with?(id, "http")},
	{:ok, %{body: body, status: code}} when code in 200..299 <- HTTP.get(id, headers),
	{:ok, data} <- Jason.decode(body),
	:ok <- Containment.contain_origin_from_id(id, data) do
	{:ok, data}
	else
	{:ok, %{status: code}} when code in [404, 410] ->
	{:error, "Object has been deleted"}

	{:scheme, _} ->
	{:error, "Unsupported URI scheme"}

	{:error, e} ->
	{:error, e}

	e ->
	{:error, e}
	end
	end

	def fetch_and_contain_remote_object_from_id(%{"id" => id}),
	do: fetch_and_contain_remote_object_from_id(id)

	def fetch_and_contain_remote_object_from_id(_id), do: {:error, "id must be a string"}
	end
	diff --git a/lib/pleroma/workers/remote_fetcher_worker.ex b/lib/pleroma/workers/remote_fetcher_worker.ex
	new file mode 100644
	index 000000000..e860ca869
	--- /dev/null
	+++ b/lib/pleroma/workers/remote_fetcher_worker.ex
	@@ -0,0 +1,20 @@
	+# Pleroma: A lightweight social networking server
	+# Copyright © 2017-2019 Pleroma Authors <https://pleroma.social/>
	+# SPDX-License-Identifier: AGPL-3.0-only
	+
	+defmodule Pleroma.Workers.RemoteFetcherWorker do
	+ alias Pleroma.Object.Fetcher
	+
	+ use Pleroma.Workers.WorkerHelper, queue: "remote_fetcher"
	+
	+ @impl Oban.Worker
	+ def perform(
	+ %{
	+ "op" => "fetch_remote",
	+ "id" => id
	+ } = args,
	+ _job
	+ ) do
	+ {:ok, _object} = Fetcher.fetch_object_from_id(id, depth: args["depth"])
	+ end
	+end
	diff --git a/lib/web/admin_api/admin_api_controller.ex b/lib/web/admin_api/admin_api_controller.ex
	index 3b56b6576..173a09228 100644
	--- a/lib/web/admin_api/admin_api_controller.ex
	+++ b/lib/web/admin_api/admin_api_controller.ex
	@@ -1,1001 +1,1009 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2019 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Web.AdminAPI.AdminAPIController do
	use Pleroma.Web, :controller

	import Pleroma.Web.ControllerHelper, only: [json_response: 3]

	alias Pleroma.Activity
	alias Pleroma.Config
	alias Pleroma.ConfigDB
	alias Pleroma.Federation.ActivityPub
	alias Pleroma.Federation.ActivityPub.Relay
	alias Pleroma.Federation.ActivityPub.Utils
	+ alias Pleroma.Healthcheck.Stats
	alias Pleroma.ModerationLog
	- alias Pleroma.Web.OAuthScopesPlug
	alias Pleroma.Storage.ReportNote
	alias Pleroma.User
	alias Pleroma.UserInviteToken
	alias Pleroma.Web.AdminAPI.AccountView
	alias Pleroma.Web.AdminAPI.ConfigView
	alias Pleroma.Web.AdminAPI.ModerationLogView
	alias Pleroma.Web.AdminAPI.Report
	alias Pleroma.Web.AdminAPI.ReportView
	alias Pleroma.Web.AdminAPI.Search
	alias Pleroma.Web.CommonAPI
	alias Pleroma.Web.Endpoint
	alias Pleroma.Web.MastodonAPI.StatusView
	+ alias Pleroma.Web.OAuthScopesPlug
	alias Pleroma.Web.Router

	require Logger

	@descriptions_json Pleroma.Docs.JSON.compile()
	@users_page_size 50

	plug(
	OAuthScopesPlug,
	%{scopes: ["read:accounts"], admin: true}
	when action in [:list_users, :user_show, :right_get]
	)

	plug(
	OAuthScopesPlug,
	%{scopes: ["write:accounts"], admin: true}
	when action in [
	:get_password_reset,
	:user_delete,
	:users_create,
	:user_toggle_activation,
	:user_activate,
	:user_deactivate,
	:tag_users,
	:untag_users,
	:right_add,
	:right_delete
	]
	)

	plug(OAuthScopesPlug, %{scopes: ["read:invites"], admin: true} when action == :invites)

	plug(
	OAuthScopesPlug,
	%{scopes: ["write:invites"], admin: true}
	when action in [:create_invite_token, :revoke_invite, :email_invite]
	)

	plug(
	OAuthScopesPlug,
	%{scopes: ["write:follows"], admin: true}
	when action in [:user_follow, :user_unfollow, :relay_follow, :relay_unfollow]
	)

	plug(
	OAuthScopesPlug,
	%{scopes: ["read:reports"], admin: true}
	when action in [:list_reports, :report_show]
	)

	plug(
	OAuthScopesPlug,
	%{scopes: ["write:reports"], admin: true}
	when action in [:reports_update]
	)

	plug(
	OAuthScopesPlug,
	%{scopes: ["read:statuses"], admin: true}
	when action == :list_user_statuses
	)

	plug(
	OAuthScopesPlug,
	%{scopes: ["write:statuses"], admin: true}
	when action in [:status_update, :status_delete]
	)

	plug(
	OAuthScopesPlug,
	%{scopes: ["read"], admin: true}
	- when action in [:config_show, :list_log]
	+ when action in [:config_show, :list_log, :stats]
	)

	plug(
	OAuthScopesPlug,
	%{scopes: ["write"], admin: true}
	when action == :config_update
	)

	action_fallback(:errors)

	def user_delete(%{assigns: %{user: admin}} = conn, %{"nickname" => nickname}) do
	user = User.get_cached_by_nickname(nickname)
	User.delete(user)

	ModerationLog.insert_log(%{
	actor: admin,
	subject: [user],
	action: "delete"
	})

	conn
	\|> json(nickname)
	end

	def user_delete(%{assigns: %{user: admin}} = conn, %{"nicknames" => nicknames}) do
	users = nicknames \|> Enum.map(&User.get_cached_by_nickname/1)
	User.delete(users)

	ModerationLog.insert_log(%{
	actor: admin,
	subject: users,
	action: "delete"
	})

	conn
	\|> json(nicknames)
	end

	def user_follow(%{assigns: %{user: admin}} = conn, %{
	"follower" => follower_nick,
	"followed" => followed_nick
	}) do
	with %User{} = follower <- User.get_cached_by_nickname(follower_nick),
	%User{} = followed <- User.get_cached_by_nickname(followed_nick) do
	User.follow(follower, followed)

	ModerationLog.insert_log(%{
	actor: admin,
	followed: followed,
	follower: follower,
	action: "follow"
	})
	end

	conn
	\|> json("ok")
	end

	def user_unfollow(%{assigns: %{user: admin}} = conn, %{
	"follower" => follower_nick,
	"followed" => followed_nick
	}) do
	with %User{} = follower <- User.get_cached_by_nickname(follower_nick),
	%User{} = followed <- User.get_cached_by_nickname(followed_nick) do
	User.unfollow(follower, followed)

	ModerationLog.insert_log(%{
	actor: admin,
	followed: followed,
	follower: follower,
	action: "unfollow"
	})
	end

	conn
	\|> json("ok")
	end

	def users_create(%{assigns: %{user: admin}} = conn, %{"users" => users}) do
	changesets =
	Enum.map(users, fn %{"nickname" => nickname, "email" => email, "password" => password} ->
	user_data = %{
	nickname: nickname,
	name: nickname,
	email: email,
	password: password,
	password_confirmation: password,
	bio: "."
	}

	User.register_changeset(%User{}, user_data, need_confirmation: false)
	end)
	\|> Enum.reduce(Ecto.Multi.new(), fn changeset, multi ->
	Ecto.Multi.insert(multi, Ecto.UUID.generate(), changeset)
	end)

	case Pleroma.Storage.Repo.transaction(changesets) do
	{:ok, users} ->
	res =
	users
	\|> Map.values()
	\|> Enum.map(fn user ->
	{:ok, user} = User.post_register_action(user)

	user
	end)
	\|> Enum.map(&AccountView.render("created.json", %{user: &1}))

	ModerationLog.insert_log(%{
	actor: admin,
	subjects: Map.values(users),
	action: "create"
	})

	conn
	\|> json(res)

	{:error, id, changeset, _} ->
	res =
	Enum.map(changesets.operations, fn
	{current_id, {:changeset, _current_changeset, _}} when current_id == id ->
	AccountView.render("create-error.json", %{changeset: changeset})

	{_, {:changeset, current_changeset, _}} ->
	AccountView.render("create-error.json", %{changeset: current_changeset})
	end)

	conn
	\|> put_status(:conflict)
	\|> json(res)
	end
	end

	def user_show(conn, %{"nickname" => nickname}) do
	with %User{} = user <- User.get_cached_by_nickname_or_id(nickname) do
	conn
	\|> put_view(AccountView)
	\|> render("show.json", %{user: user})
	else
	_ -> {:error, :not_found}
	end
	end

	def list_instance_statuses(conn, %{"instance" => instance} = params) do
	{page, page_size} = page_params(params)

	activities =
	ActivityPub.fetch_instance_activities(%{
	"instance" => instance,
	"limit" => page_size,
	"offset" => (page - 1) * page_size
	})

	conn
	\|> put_view(Pleroma.Web.AdminAPI.StatusView)
	\|> render("index.json", %{activities: activities, as: :activity})
	end

	def list_user_statuses(conn, %{"nickname" => nickname} = params) do
	godmode = params["godmode"] == "true" \|\| params["godmode"] == true

	with %User{} = user <- User.get_cached_by_nickname_or_id(nickname) do
	{_, page_size} = page_params(params)

	activities =
	ActivityPub.fetch_user_activities(user, nil, %{
	"limit" => page_size,
	"godmode" => godmode
	})

	conn
	\|> put_view(StatusView)
	\|> render("index.json", %{activities: activities, as: :activity})
	else
	_ -> {:error, :not_found}
	end
	end

	def user_toggle_activation(%{assigns: %{user: admin}} = conn, %{"nickname" => nickname}) do
	user = User.get_cached_by_nickname(nickname)

	{:ok, updated_user} = User.deactivate(user, !user.deactivated)

	action = if user.deactivated, do: "activate", else: "deactivate"

	ModerationLog.insert_log(%{
	actor: admin,
	subject: [user],
	action: action
	})

	conn
	\|> put_view(AccountView)
	\|> render("show.json", %{user: updated_user})
	end

	def user_activate(%{assigns: %{user: admin}} = conn, %{"nicknames" => nicknames}) do
	users = Enum.map(nicknames, &User.get_cached_by_nickname/1)
	{:ok, updated_users} = User.deactivate(users, false)

	ModerationLog.insert_log(%{
	actor: admin,
	subject: users,
	action: "activate"
	})

	conn
	\|> put_view(AccountView)
	\|> render("index.json", %{users: Keyword.values(updated_users)})
	end

	def user_deactivate(%{assigns: %{user: admin}} = conn, %{"nicknames" => nicknames}) do
	users = Enum.map(nicknames, &User.get_cached_by_nickname/1)
	{:ok, updated_users} = User.deactivate(users, true)

	ModerationLog.insert_log(%{
	actor: admin,
	subject: users,
	action: "deactivate"
	})

	conn
	\|> put_view(AccountView)
	\|> render("index.json", %{users: Keyword.values(updated_users)})
	end

	def tag_users(%{assigns: %{user: admin}} = conn, %{"nicknames" => nicknames, "tags" => tags}) do
	with {:ok, _} <- User.tag(nicknames, tags) do
	ModerationLog.insert_log(%{
	actor: admin,
	nicknames: nicknames,
	tags: tags,
	action: "tag"
	})

	json_response(conn, :no_content, "")
	end
	end

	def untag_users(%{assigns: %{user: admin}} = conn, %{"nicknames" => nicknames, "tags" => tags}) do
	with {:ok, _} <- User.untag(nicknames, tags) do
	ModerationLog.insert_log(%{
	actor: admin,
	nicknames: nicknames,
	tags: tags,
	action: "untag"
	})

	json_response(conn, :no_content, "")
	end
	end

	def list_users(conn, params) do
	{page, page_size} = page_params(params)
	filters = maybe_parse_filters(params["filters"])

	search_params = %{
	query: params["query"],
	page: page,
	page_size: page_size,
	tags: params["tags"],
	name: params["name"],
	email: params["email"]
	}

	with {:ok, users, count} <- Search.user(Map.merge(search_params, filters)),
	{:ok, users, count} <- filter_service_users(users, count),
	do:
	conn
	\|> json(
	AccountView.render("index.json",
	users: users,
	count: count,
	page_size: page_size
	)
	)
	end

	defp filter_service_users(users, count) do
	filtered_users = Enum.reject(users, &service_user?/1)
	count = if Enum.any?(users, &service_user?/1), do: length(filtered_users), else: count

	{:ok, filtered_users, count}
	end

	defp service_user?(user) do
	String.match?(user.ap_id, ~r/.*\/relay$/) or
	String.match?(user.ap_id, ~r/.*\/internal\/fetch$/)
	end

	@filters ~w(local external active deactivated is_admin is_moderator)

	@spec maybe_parse_filters(String.t()) :: %{required(String.t()) => true} \| %{}
	defp maybe_parse_filters(filters) when is_nil(filters) or filters == "", do: %{}

	defp maybe_parse_filters(filters) do
	filters
	\|> String.split(",")
	\|> Enum.filter(&Enum.member?(@filters, &1))
	\|> Enum.map(&String.to_atom(&1))
	\|> Enum.into(%{}, &{&1, true})
	end

	def right_add_multiple(%{assigns: %{user: admin}} = conn, %{
	"permission_group" => permission_group,
	"nicknames" => nicknames
	})
	when permission_group in ["moderator", "admin"] do
	update = %{:"is_#{permission_group}" => true}

	users = nicknames \|> Enum.map(&User.get_cached_by_nickname/1)

	for u <- users, do: User.admin_api_update(u, update)

	ModerationLog.insert_log(%{
	action: "grant",
	actor: admin,
	subject: users,
	permission: permission_group
	})

	json(conn, update)
	end

	def right_add_multiple(conn, _) do
	render_error(conn, :not_found, "No such permission_group")
	end

	def right_add(%{assigns: %{user: admin}} = conn, %{
	"permission_group" => permission_group,
	"nickname" => nickname
	})
	when permission_group in ["moderator", "admin"] do
	fields = %{:"is_#{permission_group}" => true}

	{:ok, user} =
	nickname
	\|> User.get_cached_by_nickname()
	\|> User.admin_api_update(fields)

	ModerationLog.insert_log(%{
	action: "grant",
	actor: admin,
	subject: [user],
	permission: permission_group
	})

	json(conn, fields)
	end

	def right_add(conn, _) do
	render_error(conn, :not_found, "No such permission_group")
	end

	def right_get(conn, %{"nickname" => nickname}) do
	user = User.get_cached_by_nickname(nickname)

	conn
	\|> json(%{
	is_moderator: user.is_moderator,
	is_admin: user.is_admin
	})
	end

	def right_delete_multiple(
	%{assigns: %{user: %{nickname: admin_nickname} = admin}} = conn,
	%{
	"permission_group" => permission_group,
	"nicknames" => nicknames
	}
	)
	when permission_group in ["moderator", "admin"] do
	with false <- Enum.member?(nicknames, admin_nickname) do
	update = %{:"is_#{permission_group}" => false}

	users = nicknames \|> Enum.map(&User.get_cached_by_nickname/1)

	for u <- users, do: User.admin_api_update(u, update)

	ModerationLog.insert_log(%{
	action: "revoke",
	actor: admin,
	subject: users,
	permission: permission_group
	})

	json(conn, update)
	else
	_ -> render_error(conn, :forbidden, "You can't revoke your own admin/moderator status.")
	end
	end

	def right_delete_multiple(conn, _) do
	render_error(conn, :not_found, "No such permission_group")
	end

	def right_delete(
	%{assigns: %{user: admin}} = conn,
	%{
	"permission_group" => permission_group,
	"nickname" => nickname
	}
	)
	when permission_group in ["moderator", "admin"] do
	fields = %{:"is_#{permission_group}" => false}

	{:ok, user} =
	nickname
	\|> User.get_cached_by_nickname()
	\|> User.admin_api_update(fields)

	ModerationLog.insert_log(%{
	action: "revoke",
	actor: admin,
	subject: [user],
	permission: permission_group
	})

	json(conn, fields)
	end

	def right_delete(%{assigns: %{user: %{nickname: nickname}}} = conn, %{"nickname" => nickname}) do
	render_error(conn, :forbidden, "You can't revoke your own admin status.")
	end

	def relay_list(conn, _params) do
	with {:ok, list} <- Relay.list() do
	json(conn, %{relays: list})
	else
	_ ->
	conn
	\|> put_status(500)
	end
	end

	def relay_follow(%{assigns: %{user: admin}} = conn, %{"relay_url" => target}) do
	with {:ok, _message} <- Relay.follow(target) do
	ModerationLog.insert_log(%{
	action: "relay_follow",
	actor: admin,
	target: target
	})

	json(conn, target)
	else
	_ ->
	conn
	\|> put_status(500)
	\|> json(target)
	end
	end

	def relay_unfollow(%{assigns: %{user: admin}} = conn, %{"relay_url" => target}) do
	with {:ok, _message} <- Relay.unfollow(target) do
	ModerationLog.insert_log(%{
	action: "relay_unfollow",
	actor: admin,
	target: target
	})

	json(conn, target)
	else
	_ ->
	conn
	\|> put_status(500)
	\|> json(target)
	end
	end

	@doc "Sends registration invite via email"
	def email_invite(%{assigns: %{user: user}} = conn, %{"email" => email} = params) do
	with true <-
	Config.get([:instance, :invites_enabled]) &&
	!Config.get([:instance, :registrations_open]),
	{:ok, invite_token} <- UserInviteToken.create_invite(),
	email <-
	Pleroma.Emails.UserEmail.user_invitation_email(
	user,
	invite_token,
	email,
	params["name"]
	),
	{:ok, _} <- Pleroma.Emails.Mailer.deliver(email) do
	json_response(conn, :no_content, "")
	end
	end

	@doc "Create an account registration invite token"
	def create_invite_token(conn, params) do
	opts = %{}

	opts =
	if params["max_use"],
	do: Map.put(opts, :max_use, params["max_use"]),
	else: opts

	opts =
	if params["expires_at"],
	do: Map.put(opts, :expires_at, params["expires_at"]),
	else: opts

	{:ok, invite} = UserInviteToken.create_invite(opts)

	json(conn, AccountView.render("invite.json", %{invite: invite}))
	end

	@doc "Get list of created invites"
	def invites(conn, _params) do
	invites = UserInviteToken.list_invites()

	conn
	\|> put_view(AccountView)
	\|> render("invites.json", %{invites: invites})
	end

	@doc "Revokes invite by token"
	def revoke_invite(conn, %{"token" => token}) do
	with {:ok, invite} <- UserInviteToken.find_by_token(token),
	{:ok, updated_invite} = UserInviteToken.update_invite(invite, %{used: true}) do
	conn
	\|> put_view(AccountView)
	\|> render("invite.json", %{invite: updated_invite})
	else
	nil -> {:error, :not_found}
	end
	end

	@doc "Get a password reset token (base64 string) for given nickname"
	def get_password_reset(conn, %{"nickname" => nickname}) do
	(%User{local: true} = user) = User.get_cached_by_nickname(nickname)
	{:ok, token} = Pleroma.PasswordResetToken.create_token(user)

	conn
	\|> json(%{
	token: token.token,
	link: Router.Helpers.reset_password_url(Endpoint, :reset, token.token)
	})
	end

	@doc "Force password reset for a given user"
	def force_password_reset(%{assigns: %{user: admin}} = conn, %{"nicknames" => nicknames}) do
	users = nicknames \|> Enum.map(&User.get_cached_by_nickname/1)

	Enum.each(users, &User.force_password_reset_async/1)

	ModerationLog.insert_log(%{
	actor: admin,
	subject: users,
	action: "force_password_reset"
	})

	json_response(conn, :no_content, "")
	end

	def list_reports(conn, params) do
	{page, page_size} = page_params(params)

	reports = Utils.get_reports(params, page, page_size)

	conn
	\|> put_view(ReportView)
	\|> render("index.json", %{reports: reports})
	end

	def list_grouped_reports(conn, _params) do
	statuses = Utils.get_reported_activities()

	conn
	\|> put_view(ReportView)
	\|> render("index_grouped.json", Utils.get_reports_grouped_by_status(statuses))
	end

	def report_show(conn, %{"id" => id}) do
	with %Activity{} = report <- Activity.get_by_id(id) do
	conn
	\|> put_view(ReportView)
	\|> render("show.json", Report.extract_report_info(report))
	else
	_ -> {:error, :not_found}
	end
	end

	def reports_update(%{assigns: %{user: admin}} = conn, %{"reports" => reports}) do
	result =
	reports
	\|> Enum.map(fn report ->
	with {:ok, activity} <- CommonAPI.update_report_state(report["id"], report["state"]) do
	ModerationLog.insert_log(%{
	action: "report_update",
	actor: admin,
	subject: activity
	})

	activity
	else
	{:error, message} -> %{id: report["id"], error: message}
	end
	end)

	case Enum.any?(result, &Map.has_key?(&1, :error)) do
	true -> json_response(conn, :bad_request, result)
	false -> json_response(conn, :no_content, "")
	end
	end

	def report_notes_create(%{assigns: %{user: user}} = conn, %{
	"id" => report_id,
	"content" => content
	}) do
	with {:ok, _} <- ReportNote.create(user.id, report_id, content) do
	ModerationLog.insert_log(%{
	action: "report_note",
	actor: user,
	subject: Activity.get_by_id(report_id),
	text: content
	})

	json_response(conn, :no_content, "")
	else
	_ -> json_response(conn, :bad_request, "")
	end
	end

	def report_notes_delete(%{assigns: %{user: user}} = conn, %{
	"id" => note_id,
	"report_id" => report_id
	}) do
	with {:ok, note} <- ReportNote.destroy(note_id) do
	ModerationLog.insert_log(%{
	action: "report_note_delete",
	actor: user,
	subject: Activity.get_by_id(report_id),
	text: note.content
	})

	json_response(conn, :no_content, "")
	else
	_ -> json_response(conn, :bad_request, "")
	end
	end

	def status_update(%{assigns: %{user: admin}} = conn, %{"id" => id} = params) do
	with {:ok, activity} <- CommonAPI.update_activity_scope(id, params) do
	{:ok, sensitive} = Ecto.Type.cast(:boolean, params["sensitive"])

	ModerationLog.insert_log(%{
	action: "status_update",
	actor: admin,
	subject: activity,
	sensitive: sensitive,
	visibility: params["visibility"]
	})

	conn
	\|> put_view(StatusView)
	\|> render("show.json", %{activity: activity})
	end
	end

	def status_delete(%{assigns: %{user: user}} = conn, %{"id" => id}) do
	with {:ok, %Activity{}} <- CommonAPI.delete(id, user) do
	ModerationLog.insert_log(%{
	action: "status_delete",
	actor: user,
	subject_id: id
	})

	json(conn, %{})
	end
	end

	def list_log(conn, params) do
	{page, page_size} = page_params(params)

	log =
	ModerationLog.get_all(%{
	page: page,
	page_size: page_size,
	start_date: params["start_date"],
	end_date: params["end_date"],
	user_id: params["user_id"],
	search: params["search"]
	})

	conn
	\|> put_view(ModerationLogView)
	\|> render("index.json", %{log: log})
	end

	def config_descriptions(conn, _params) do
	conn
	\|> Plug.Conn.put_resp_content_type("application/json")
	\|> Plug.Conn.send_resp(200, @descriptions_json)
	end

	def config_show(conn, %{"only_db" => true}) do
	with :ok <- configurable_from_database(conn) do
	configs = Pleroma.Storage.Repo.all(ConfigDB)

	conn
	\|> put_view(ConfigView)
	\|> render("index.json", %{configs: configs})
	end
	end

	def config_show(conn, _params) do
	with :ok <- configurable_from_database(conn) do
	configs = ConfigDB.get_all_as_keyword()

	merged =
	Config.Holder.config()
	\|> ConfigDB.merge(configs)
	\|> Enum.map(fn {group, values} ->
	Enum.map(values, fn {key, value} ->
	db =
	if configs[group][key] do
	ConfigDB.get_db_keys(configs[group][key], key)
	end

	db_value = configs[group][key]

	merged_value =
	if !is_nil(db_value) and Keyword.keyword?(db_value) and
	ConfigDB.sub_key_full_update?(group, key, Keyword.keys(db_value)) do
	ConfigDB.merge_group(group, key, value, db_value)
	else
	value
	end

	setting = %{
	group: ConfigDB.convert(group),
	key: ConfigDB.convert(key),
	value: ConfigDB.convert(merged_value)
	}

	if db, do: Map.put(setting, :db, db), else: setting
	end)
	end)
	\|> List.flatten()

	response = %{configs: merged}

	response =
	if Restarter.Pleroma.need_reboot?() do
	Map.put(response, :need_reboot, true)
	else
	response
	end

	json(conn, response)
	end
	end

	def config_update(conn, %{"configs" => configs}) do
	with :ok <- configurable_from_database(conn) do
	{_errors, results} =
	Enum.map(configs, fn
	%{"group" => group, "key" => key, "delete" => true} = params ->
	ConfigDB.delete(%{group: group, key: key, subkeys: params["subkeys"]})

	%{"group" => group, "key" => key, "value" => value} ->
	ConfigDB.update_or_create(%{group: group, key: key, value: value})
	end)
	\|> Enum.split_with(fn result -> elem(result, 0) == :error end)

	{deleted, updated} =
	results
	\|> Enum.map(fn {:ok, config} ->
	Map.put(config, :db, ConfigDB.get_db_keys(config))
	end)
	\|> Enum.split_with(fn config ->
	Ecto.get_meta(config, :state) == :deleted
	end)

	Config.TransferTask.load_and_update_env(deleted, false)

	need_reboot? =
	Restarter.Pleroma.need_reboot?() \|\|
	Enum.any?(updated, fn config ->
	group = ConfigDB.from_string(config.group)
	key = ConfigDB.from_string(config.key)
	value = ConfigDB.from_binary(config.value)
	Config.TransferTask.pleroma_need_restart?(group, key, value)
	end)

	response = %{configs: updated}

	response =
	if need_reboot? do
	Restarter.Pleroma.need_reboot()
	Map.put(response, :need_reboot, need_reboot?)
	else
	response
	end

	conn
	\|> put_view(ConfigView)
	\|> render("index.json", response)
	end
	end

	def restart(conn, _params) do
	with :ok <- configurable_from_database(conn) do
	Restarter.Pleroma.restart(Config.get(:env), 50)

	json(conn, %{})
	end
	end

	defp configurable_from_database(conn) do
	if Config.get(:configurable_from_database) do
	:ok
	else
	errors(
	conn,
	{:error, "To use this endpoint you need to enable configuration from database."}
	)
	end
	end

	def reload_emoji(conn, _params) do
	Pleroma.Emoji.reload()

	conn \|> json("ok")
	end

	def confirm_email(%{assigns: %{user: admin}} = conn, %{"nicknames" => nicknames}) do
	users = nicknames \|> Enum.map(&User.get_cached_by_nickname/1)

	User.toggle_confirmation(users)

	ModerationLog.insert_log(%{
	actor: admin,
	subject: users,
	action: "confirm_email"
	})

	conn \|> json("")
	end

	def resend_confirmation_email(%{assigns: %{user: admin}} = conn, %{"nicknames" => nicknames}) do
	users = nicknames \|> Enum.map(&User.get_cached_by_nickname/1)

	User.try_send_confirmation_email(users)

	ModerationLog.insert_log(%{
	actor: admin,
	subject: users,
	action: "resend_confirmation_email"
	})

	conn \|> json("")
	end

	+ def stats(conn, _) do
	+ count = Stats.get_status_visibility_count()
	+
	+ conn
	+ \|> json(%{"status_visibility" => count})
	+ end
	+
	def errors(conn, {:error, :not_found}) do
	conn
	\|> put_status(:not_found)
	\|> json(dgettext("errors", "Not found"))
	end

	def errors(conn, {:error, reason}) do
	conn
	\|> put_status(:bad_request)
	\|> json(reason)
	end

	def errors(conn, {:param_cast, _}) do
	conn
	\|> put_status(:bad_request)
	\|> json(dgettext("errors", "Invalid parameters"))
	end

	def errors(conn, _) do
	conn
	\|> put_status(:internal_server_error)
	\|> json(dgettext("errors", "Something went wrong"))
	end

	defp page_params(params) do
	{get_page(params["page"]), get_page_size(params["page_size"])}
	end

	defp get_page(page_string) when is_nil(page_string), do: 1

	defp get_page(page_string) do
	case Integer.parse(page_string) do
	{page, _} -> page
	:error -> 1
	end
	end

	defp get_page_size(page_size_string) when is_nil(page_size_string), do: @users_page_size

	defp get_page_size(page_size_string) do
	case Integer.parse(page_size_string) do
	{page_size, _} -> page_size
	:error -> @users_page_size
	end
	end
	end
	diff --git a/lib/web/router.ex b/lib/web/router.ex
	index 371369bfa..01bd7c4f5 100644
	--- a/lib/web/router.ex
	+++ b/lib/web/router.ex
	@@ -1,683 +1,684 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2019 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Web.Router do
	use Pleroma.Web, :router

	pipeline :browser do
	plug(:accepts, ["html"])
	plug(:fetch_session)
	end

	pipeline :oauth do
	plug(:fetch_session)
	plug(Pleroma.Web.OAuthPlug)
	plug(Pleroma.Web.UserEnabledPlug)
	end

	pipeline :api do
	plug(:accepts, ["json"])
	plug(:fetch_session)
	plug(Pleroma.Web.OAuthPlug)
	plug(Pleroma.Web.BasicAuthDecoderPlug)
	plug(Pleroma.Web.UserFetcherPlug)
	plug(Pleroma.Web.SessionAuthenticationPlug)
	plug(Pleroma.Web.LegacyAuthenticationPlug)
	plug(Pleroma.Web.AuthenticationPlug)
	plug(Pleroma.Web.UserEnabledPlug)
	plug(Pleroma.Web.SetUserSessionIDPlug)
	plug(Pleroma.Web.EnsureUserKeyPlug)
	plug(Pleroma.Web.IdempotencyPlug)
	end

	pipeline :authenticated_api do
	plug(:accepts, ["json"])
	plug(:fetch_session)
	plug(Pleroma.Web.OAuthPlug)
	plug(Pleroma.Web.BasicAuthDecoderPlug)
	plug(Pleroma.Web.UserFetcherPlug)
	plug(Pleroma.Web.SessionAuthenticationPlug)
	plug(Pleroma.Web.LegacyAuthenticationPlug)
	plug(Pleroma.Web.AuthenticationPlug)
	plug(Pleroma.Web.UserEnabledPlug)
	plug(Pleroma.Web.SetUserSessionIDPlug)
	plug(Pleroma.Web.EnsureAuthenticatedPlug)
	plug(Pleroma.Web.IdempotencyPlug)
	end

	pipeline :admin_api do
	plug(:accepts, ["json"])
	plug(:fetch_session)
	plug(Pleroma.Web.OAuthPlug)
	plug(Pleroma.Web.BasicAuthDecoderPlug)
	plug(Pleroma.Web.UserFetcherPlug)
	plug(Pleroma.Web.SessionAuthenticationPlug)
	plug(Pleroma.Web.LegacyAuthenticationPlug)
	plug(Pleroma.Web.AuthenticationPlug)
	plug(Pleroma.Web.AdminSecretAuthenticationPlug)
	plug(Pleroma.Web.UserEnabledPlug)
	plug(Pleroma.Web.SetUserSessionIDPlug)
	plug(Pleroma.Web.EnsureAuthenticatedPlug)
	plug(Pleroma.Web.UserIsAdminPlug)
	plug(Pleroma.Web.IdempotencyPlug)
	end

	pipeline :mastodon_html do
	plug(:accepts, ["html"])
	plug(:fetch_session)
	plug(Pleroma.Web.OAuthPlug)
	plug(Pleroma.Web.BasicAuthDecoderPlug)
	plug(Pleroma.Web.UserFetcherPlug)
	plug(Pleroma.Web.SessionAuthenticationPlug)
	plug(Pleroma.Web.LegacyAuthenticationPlug)
	plug(Pleroma.Web.AuthenticationPlug)
	plug(Pleroma.Web.UserEnabledPlug)
	plug(Pleroma.Web.SetUserSessionIDPlug)
	plug(Pleroma.Web.EnsureUserKeyPlug)
	end

	pipeline :pleroma_html do
	plug(:accepts, ["html"])
	plug(:fetch_session)
	plug(Pleroma.Web.OAuthPlug)
	plug(Pleroma.Web.BasicAuthDecoderPlug)
	plug(Pleroma.Web.UserFetcherPlug)
	plug(Pleroma.Web.SessionAuthenticationPlug)
	plug(Pleroma.Web.AuthenticationPlug)
	plug(Pleroma.Web.EnsureUserKeyPlug)
	end

	pipeline :well_known do
	plug(:accepts, ["json", "jrd+json", "xml", "xrd+xml"])
	end

	pipeline :config do
	plug(:accepts, ["json", "xml"])
	end

	pipeline :pleroma_api do
	plug(:accepts, ["html", "json"])
	end

	pipeline :mailbox_preview do
	plug(:accepts, ["html"])

	plug(:put_secure_browser_headers, %{
	"content-security-policy" =>
	"default-src 'self'; script-src 'self' 'unsafe-inline' 'unsafe-eval'; style-src 'self' 'unsafe-inline' 'unsafe-eval'"
	})
	end

	pipeline :http_signature do
	plug(Pleroma.Federation.HTTPSignatures.HTTPSignaturesPlug)
	plug(Pleroma.Federation.HTTPSignatures.MappedSignatureToIdentityPlug)
	end

	pipeline :ap_service_actor do
	plug(:accepts, ["activity+json", "json"])
	end

	pipeline :ostatus do
	plug(:accepts, ["html", "xml", "atom", "activity+json", "json"])
	plug(Pleroma.Web.StaticFEPlug)
	end

	pipeline :oembed do
	plug(:accepts, ["json", "xml"])
	end

	pipeline :activitypub do
	plug(:accepts, ["activity+json", "json"])
	plug(Pleroma.Federation.HTTPSignatures.HTTPSignaturesPlug)
	plug(Pleroma.Federation.HTTPSignatures.MappedSignatureToIdentityPlug)
	end

	pipeline :activitypub_client do
	plug(:accepts, ["activity+json", "json"])
	plug(:fetch_session)
	plug(Pleroma.Web.OAuthPlug)
	plug(Pleroma.Web.BasicAuthDecoderPlug)
	plug(Pleroma.Web.UserFetcherPlug)
	plug(Pleroma.Web.SessionAuthenticationPlug)
	plug(Pleroma.Web.LegacyAuthenticationPlug)
	plug(Pleroma.Web.AuthenticationPlug)
	plug(Pleroma.Web.UserEnabledPlug)
	plug(Pleroma.Web.SetUserSessionIDPlug)
	plug(Pleroma.Web.EnsureUserKeyPlug)
	end

	pipeline :remote_media do
	end

	## FEDERATION

	scope "/", Pleroma.Federation do
	pipe_through(:ostatus)
	pipe_through(:http_signature)

	get("/objects/:uuid", OStatus.OStatusController, :object)
	get("/activities/:uuid", OStatus.OStatusController, :activity)
	get("/notice/:id", OStatus.OStatusController, :notice)
	get("/notice/:id/embed_player", OStatus.OStatusController, :notice_player)
	end

	scope "/", Pleroma.Federation.ActivityPub do
	# XXX: not really ostatus
	pipe_through(:ostatus)

	get("/users/:nickname/outbox", ActivityPubController, :outbox)
	end

	scope "/", Pleroma.Federation.ActivityPub do
	pipe_through([:activitypub_client])

	get("/api/ap/whoami", ActivityPubController, :whoami)
	get("/users/:nickname/inbox", ActivityPubController, :read_inbox)

	post("/users/:nickname/outbox", ActivityPubController, :update_outbox)
	post("/api/ap/upload_media", ActivityPubController, :upload_media)

	get("/users/:nickname/followers", ActivityPubController, :followers)
	get("/users/:nickname/following", ActivityPubController, :following)
	end

	scope "/", Pleroma.Federation.ActivityPub do
	pipe_through(:activitypub)
	post("/inbox", ActivityPubController, :inbox)
	post("/users/:nickname/inbox", ActivityPubController, :inbox)
	end

	scope "/relay", Pleroma.Federation.ActivityPub do
	pipe_through(:ap_service_actor)

	get("/", ActivityPubController, :relay)

	scope [] do
	pipe_through(:http_signature)
	post("/inbox", ActivityPubController, :inbox)
	end

	get("/following", ActivityPubController, :following, assigns: %{relay: true})
	get("/followers", ActivityPubController, :followers, assigns: %{relay: true})
	end

	scope "/internal/fetch", Pleroma.Federation.ActivityPub do
	pipe_through(:ap_service_actor)

	get("/", ActivityPubController, :internal_fetch)
	post("/inbox", ActivityPubController, :inbox)
	end

	scope "/.well-known", Pleroma.Federation do
	pipe_through(:well_known)

	get("/host-meta", WebFinger.WebFingerController, :host_meta)
	get("/webfinger", WebFinger.WebFingerController, :webfinger)
	get("/nodeinfo", NodeInfo.NodeInfoController, :schemas)
	end

	scope "/nodeinfo", Pleroma.Federation do
	get("/:version", NodeInfo.NodeInfoController, :nodeinfo)
	end

	## TWITTER API

	scope "/api/pleroma", Pleroma.Web.TwitterAPI do
	pipe_through(:pleroma_api)

	get("/password_reset/:token", PasswordController, :reset, as: :reset_password)
	post("/password_reset", PasswordController, :do_reset, as: :reset_password)
	get("/emoji", UtilController, :emoji)
	get("/captcha", UtilController, :captcha)
	get("/healthcheck", UtilController, :healthcheck)
	end

	scope "/", Pleroma.Web.TwitterAPI do
	pipe_through(:pleroma_html)

	post("/main/ostatus", UtilController, :remote_subscribe)
	get("/ostatus_subscribe", RemoteFollowController, :follow)

	post("/ostatus_subscribe", RemoteFollowController, :do_follow)
	end

	scope "/api/pleroma", Pleroma.Web.TwitterAPI do
	pipe_through(:authenticated_api)

	post("/change_email", UtilController, :change_email)
	post("/change_password", UtilController, :change_password)
	post("/delete_account", UtilController, :delete_account)
	put("/notification_settings", UtilController, :update_notificaton_settings)
	post("/disable_account", UtilController, :disable_account)

	post("/blocks_import", UtilController, :blocks_import)
	post("/follow_import", UtilController, :follow_import)
	end

	scope "/api", Pleroma.Web.TwitterAPI do
	pipe_through(:config)

	get("/help/test", UtilController, :help_test)
	post("/help/test", UtilController, :help_test)
	get("/statusnet/config", UtilController, :config)
	get("/statusnet/version", UtilController, :version)
	get("/pleroma/frontend_configurations", UtilController, :frontend_configurations)
	end

	scope "/api", Pleroma.Web.TwitterAPI do
	pipe_through(:api)

	get("/account/confirm_email/:user_id/:token", TwitterAPIController, :confirm_email,
	as: :confirm_email
	)
	end

	scope "/api", Pleroma.Web.TwitterAPI, as: :authenticated_twitter_api do
	pipe_through(:authenticated_api)

	get("/oauth_tokens", TwitterAPIController, :oauth_tokens)
	delete("/oauth_tokens/:id", TwitterAPIController, :revoke_token)

	post("/qvitter/statuses/notifications/read", TwitterAPIController, :notifications_read)
	end

	## PLEROMA API

	scope "/api/pleroma", Pleroma.Web do
	pipe_through(:pleroma_api)
	post("/uploader_callback/:upload_path", UploaderController, :callback)
	end

	scope "/api/pleroma/emoji", Pleroma.Web.PleromaAPI do
	scope "/packs" do
	# Modifying packs
	pipe_through(:admin_api)

	post("/import_from_fs", EmojiAPIController, :import_from_fs)

	post("/:pack_name/update_file", EmojiAPIController, :update_file)
	post("/:pack_name/update_metadata", EmojiAPIController, :update_metadata)
	put("/:name", EmojiAPIController, :create)
	delete("/:name", EmojiAPIController, :delete)
	post("/download_from", EmojiAPIController, :download_from)
	post("/list_from", EmojiAPIController, :list_from)
	end

	scope "/packs" do
	# Pack info / downloading
	get("/", EmojiAPIController, :list_packs)
	get("/:name/download_shared/", EmojiAPIController, :download_shared)
	end
	end

	scope "/oauth", Pleroma.Web.OAuth do
	scope [] do
	pipe_through(:oauth)
	get("/authorize", OAuthController, :authorize)
	end

	post("/authorize", OAuthController, :create_authorization)
	post("/token", OAuthController, :token_exchange)
	post("/revoke", OAuthController, :token_revoke)
	get("/registration_details", OAuthController, :registration_details)

	scope [] do
	pipe_through(:browser)

	get("/prepare_request", OAuthController, :prepare_request)
	get("/:provider", OAuthController, :request)
	get("/:provider/callback", OAuthController, :callback)
	post("/register", OAuthController, :register)
	end
	end

	scope "/api/v1/pleroma", Pleroma.Web.PleromaAPI do
	pipe_through(:api)

	get("/statuses/:id/reactions/:emoji", PleromaAPIController, :emoji_reactions_by)
	get("/statuses/:id/reactions", PleromaAPIController, :emoji_reactions_by)
	end

	scope "/api/v1/pleroma", Pleroma.Web.PleromaAPI do
	scope [] do
	pipe_through(:authenticated_api)

	get("/conversations/:id/statuses", PleromaAPIController, :conversation_statuses)
	get("/conversations/:id", PleromaAPIController, :conversation)
	post("/conversations/read", PleromaAPIController, :read_conversations)
	end

	scope [] do
	pipe_through(:authenticated_api)

	patch("/conversations/:id", PleromaAPIController, :update_conversation)
	put("/statuses/:id/reactions/:emoji", PleromaAPIController, :react_with_emoji)
	delete("/statuses/:id/reactions/:emoji", PleromaAPIController, :unreact_with_emoji)
	post("/notifications/read", PleromaAPIController, :read_notification)

	patch("/accounts/update_avatar", AccountController, :update_avatar)
	patch("/accounts/update_banner", AccountController, :update_banner)
	patch("/accounts/update_background", AccountController, :update_background)

	get("/mascot", MascotController, :show)
	put("/mascot", MascotController, :update)

	post("/scrobble", ScrobbleController, :new_scrobble)
	end

	scope [] do
	pipe_through(:api)
	get("/accounts/:id/favourites", AccountController, :favourites)
	end

	scope [] do
	pipe_through(:authenticated_api)

	post("/accounts/:id/subscribe", AccountController, :subscribe)
	post("/accounts/:id/unsubscribe", AccountController, :unsubscribe)
	end

	post("/accounts/confirmation_resend", AccountController, :confirmation_resend)
	end

	scope "/api/v1/pleroma", Pleroma.Web.PleromaAPI do
	pipe_through(:api)
	get("/accounts/:id/scrobbles", ScrobbleController, :user_scrobbles)
	end

	scope "/api/web", Pleroma.Web do
	pipe_through(:authenticated_api)

	put("/settings", MastoFEController, :put_settings)
	end

	scope "/", Pleroma.Web do
	pipe_through(:ostatus)
	pipe_through(:http_signature)

	get("/users/:nickname/feed", Feed.UserController, :feed, as: :user_feed)
	get("/users/:nickname", Feed.UserController, :feed_redirect, as: :user_feed)

	get("/tags/:tag", Feed.TagController, :feed, as: :tag_feed)
	end

	scope "/", Pleroma.Web do
	pipe_through(:browser)
	get("/mailer/unsubscribe/:token", Mailer.SubscriptionController, :unsubscribe)
	end

	scope "/proxy/", Pleroma.Web.MediaProxy do
	pipe_through(:remote_media)

	get("/:sig/:url", MediaProxyController, :remote)
	get("/:sig/:url/:filename", MediaProxyController, :remote)
	end

	if Pleroma.Config.get(:env) == :dev do
	scope "/dev" do
	pipe_through([:mailbox_preview])

	forward("/mailbox", Plug.Swoosh.MailboxPreview, base_path: "/dev/mailbox")
	end
	end

	scope "/", Pleroma.Web.MongooseIM do
	get("/user_exists", MongooseIMController, :user_exists)
	get("/check_password", MongooseIMController, :check_password)
	end

	## PLEROMA ADMIN API

	scope "/api/pleroma/admin", Pleroma.Web.AdminAPI do
	pipe_through(:admin_api)

	post("/users/follow", AdminAPIController, :user_follow)
	post("/users/unfollow", AdminAPIController, :user_unfollow)

	delete("/users", AdminAPIController, :user_delete)
	post("/users", AdminAPIController, :users_create)
	patch("/users/:nickname/toggle_activation", AdminAPIController, :user_toggle_activation)
	patch("/users/activate", AdminAPIController, :user_activate)
	patch("/users/deactivate", AdminAPIController, :user_deactivate)
	put("/users/tag", AdminAPIController, :tag_users)
	delete("/users/tag", AdminAPIController, :untag_users)

	get("/users/:nickname/permission_group", AdminAPIController, :right_get)
	get("/users/:nickname/permission_group/:permission_group", AdminAPIController, :right_get)

	post("/users/:nickname/permission_group/:permission_group", AdminAPIController, :right_add)

	delete(
	"/users/:nickname/permission_group/:permission_group",
	AdminAPIController,
	:right_delete
	)

	post("/users/permission_group/:permission_group", AdminAPIController, :right_add_multiple)

	delete(
	"/users/permission_group/:permission_group",
	AdminAPIController,
	:right_delete_multiple
	)

	get("/relay", AdminAPIController, :relay_list)
	post("/relay", AdminAPIController, :relay_follow)
	delete("/relay", AdminAPIController, :relay_unfollow)

	post("/users/invite_token", AdminAPIController, :create_invite_token)
	get("/users/invites", AdminAPIController, :invites)
	post("/users/revoke_invite", AdminAPIController, :revoke_invite)
	post("/users/email_invite", AdminAPIController, :email_invite)

	get("/users/:nickname/password_reset", AdminAPIController, :get_password_reset)
	patch("/users/force_password_reset", AdminAPIController, :force_password_reset)

	get("/users", AdminAPIController, :list_users)
	get("/users/:nickname", AdminAPIController, :user_show)
	get("/users/:nickname/statuses", AdminAPIController, :list_user_statuses)

	get("/instances/:instance/statuses", AdminAPIController, :list_instance_statuses)

	patch("/users/confirm_email", AdminAPIController, :confirm_email)
	patch("/users/resend_confirmation_email", AdminAPIController, :resend_confirmation_email)

	get("/reports", AdminAPIController, :list_reports)
	get("/grouped_reports", AdminAPIController, :list_grouped_reports)
	get("/reports/:id", AdminAPIController, :report_show)
	patch("/reports", AdminAPIController, :reports_update)
	post("/reports/:id/notes", AdminAPIController, :report_notes_create)
	delete("/reports/:report_id/notes/:id", AdminAPIController, :report_notes_delete)

	put("/statuses/:id", AdminAPIController, :status_update)
	delete("/statuses/:id", AdminAPIController, :status_delete)

	get("/config", AdminAPIController, :config_show)
	post("/config", AdminAPIController, :config_update)
	get("/config/descriptions", AdminAPIController, :config_descriptions)
	get("/restart", AdminAPIController, :restart)

	get("/moderation_log", AdminAPIController, :list_log)

	post("/reload_emoji", AdminAPIController, :reload_emoji)
	+ get("/stats", AdminAPIController, :stats)
	end

	## MASTODON API

	scope "/api/v1", Pleroma.Web.MastodonAPI do
	pipe_through(:authenticated_api)

	get("/accounts/verify_credentials", AccountController, :verify_credentials)

	get("/accounts/relationships", AccountController, :relationships)

	get("/accounts/:id/lists", AccountController, :lists)
	get("/accounts/:id/identity_proofs", MastodonAPIController, :empty_array)

	get("/follow_requests", FollowRequestController, :index)
	get("/blocks", AccountController, :blocks)
	get("/mutes", AccountController, :mutes)

	get("/timelines/home", TimelineController, :home)
	get("/timelines/direct", TimelineController, :direct)

	get("/favourites", StatusController, :favourites)
	get("/bookmarks", StatusController, :bookmarks)

	get("/notifications", NotificationController, :index)
	get("/notifications/:id", NotificationController, :show)
	post("/notifications/clear", NotificationController, :clear)
	post("/notifications/dismiss", NotificationController, :dismiss)
	delete("/notifications/destroy_multiple", NotificationController, :destroy_multiple)

	get("/scheduled_statuses", ScheduledActivityController, :index)
	get("/scheduled_statuses/:id", ScheduledActivityController, :show)

	get("/lists", ListController, :index)
	get("/lists/:id", ListController, :show)
	get("/lists/:id/accounts", ListController, :list_accounts)

	get("/domain_blocks", DomainBlockController, :index)

	get("/filters", FilterController, :index)

	get("/suggestions", SuggestionController, :index)

	get("/conversations", ConversationController, :index)
	post("/conversations/:id/read", ConversationController, :read)

	get("/endorsements", AccountController, :endorsements)

	patch("/accounts/update_credentials", AccountController, :update_credentials)

	post("/statuses", StatusController, :create)
	delete("/statuses/:id", StatusController, :delete)

	post("/statuses/:id/reblog", StatusController, :reblog)
	post("/statuses/:id/unreblog", StatusController, :unreblog)
	post("/statuses/:id/favourite", StatusController, :favourite)
	post("/statuses/:id/unfavourite", StatusController, :unfavourite)
	post("/statuses/:id/pin", StatusController, :pin)
	post("/statuses/:id/unpin", StatusController, :unpin)
	post("/statuses/:id/bookmark", StatusController, :bookmark)
	post("/statuses/:id/unbookmark", StatusController, :unbookmark)
	post("/statuses/:id/mute", StatusController, :mute_conversation)
	post("/statuses/:id/unmute", StatusController, :unmute_conversation)

	put("/scheduled_statuses/:id", ScheduledActivityController, :update)
	delete("/scheduled_statuses/:id", ScheduledActivityController, :delete)

	post("/polls/:id/votes", PollController, :vote)

	post("/media", MediaController, :create)
	put("/media/:id", MediaController, :update)

	delete("/lists/:id", ListController, :delete)
	post("/lists", ListController, :create)
	put("/lists/:id", ListController, :update)

	post("/lists/:id/accounts", ListController, :add_to_list)
	delete("/lists/:id/accounts", ListController, :remove_from_list)

	post("/filters", FilterController, :create)
	get("/filters/:id", FilterController, :show)
	put("/filters/:id", FilterController, :update)
	delete("/filters/:id", FilterController, :delete)

	post("/reports", ReportController, :create)

	post("/follows", AccountController, :follows)
	post("/accounts/:id/follow", AccountController, :follow)
	post("/accounts/:id/unfollow", AccountController, :unfollow)
	post("/accounts/:id/block", AccountController, :block)
	post("/accounts/:id/unblock", AccountController, :unblock)
	post("/accounts/:id/mute", AccountController, :mute)
	post("/accounts/:id/unmute", AccountController, :unmute)

	post("/follow_requests/:id/authorize", FollowRequestController, :authorize)
	post("/follow_requests/:id/reject", FollowRequestController, :reject)

	post("/domain_blocks", DomainBlockController, :create)
	delete("/domain_blocks", DomainBlockController, :delete)

	post("/push/subscription", SubscriptionController, :create)
	get("/push/subscription", SubscriptionController, :get)
	put("/push/subscription", SubscriptionController, :update)
	delete("/push/subscription", SubscriptionController, :delete)

	get("/markers", MarkerController, :index)
	post("/markers", MarkerController, :upsert)
	end

	scope "/api/v1", Pleroma.Web.MastodonAPI do
	pipe_through(:api)

	post("/accounts", AccountController, :create)
	get("/accounts/search", SearchController, :account_search)

	get("/instance", InstanceController, :show)
	get("/instance/peers", InstanceController, :peers)

	post("/apps", AppController, :create)
	get("/apps/verify_credentials", AppController, :verify_credentials)

	get("/statuses/:id/card", StatusController, :card)
	get("/statuses/:id/favourited_by", StatusController, :favourited_by)
	get("/statuses/:id/reblogged_by", StatusController, :reblogged_by)

	get("/custom_emojis", CustomEmojiController, :index)

	get("/trends", MastodonAPIController, :empty_array)

	get("/timelines/public", TimelineController, :public)
	get("/timelines/tag/:tag", TimelineController, :hashtag)
	get("/timelines/list/:list_id", TimelineController, :list)

	get("/statuses", StatusController, :index)
	get("/statuses/:id", StatusController, :show)
	get("/statuses/:id/context", StatusController, :context)

	get("/polls/:id", PollController, :show)

	get("/accounts/:id/statuses", AccountController, :statuses)
	get("/accounts/:id/followers", AccountController, :followers)
	get("/accounts/:id/following", AccountController, :following)
	get("/accounts/:id", AccountController, :show)

	get("/search", SearchController, :search)
	end

	scope "/api/v2", Pleroma.Web.MastodonAPI do
	pipe_through(:api)
	get("/search", SearchController, :search2)
	end

	scope "/", Pleroma.Web do
	pipe_through(:api)

	get("/web/manifest.json", MastoFEController, :manifest)
	end

	scope "/", Pleroma.Web do
	pipe_through(:mastodon_html)

	get("/web/login", MastodonAPI.AuthController, :login)
	delete("/auth/sign_out", MastodonAPI.AuthController, :logout)

	post("/auth/password", MastodonAPI.AuthController, :password_reset)

	get("/web/*path", MastoFEController, :index)
	end

	## FALLBACK

	scope "/", Pleroma.Web do
	get("/registration/:token", FallbackRedirectController, :registration_page)
	get("/:maybe_nickname_or_id", FallbackRedirectController, :redirector_with_meta)
	get("/api*path", FallbackRedirectController, :api_not_implemented)
	get("/*path", FallbackRedirectController, :redirector)

	options("/*path", FallbackRedirectController, :empty)
	end
	end
	diff --git a/priv/repo/migrations/20200109123126_add_counter_cache_table.exs b/priv/repo/migrations/20200109123126_add_counter_cache_table.exs
	new file mode 100644
	index 000000000..df9e21193
	--- /dev/null
	+++ b/priv/repo/migrations/20200109123126_add_counter_cache_table.exs
	@@ -0,0 +1,55 @@
	+defmodule Pleroma.Repo.Migrations.AddCounterCacheTable do
	+ use Ecto.Migration
	+
	+ def up do
	+ create_if_not_exists table(:counter_cache) do
	+ add(:name, :string, null: false)
	+ add(:count, :bigint, null: false, default: 0)
	+ end
	+
	+ create_if_not_exists(unique_index(:counter_cache, [:name]))
	+
	+ """
	+ CREATE OR REPLACE FUNCTION update_status_visibility_counter_cache()
	+ RETURNS TRIGGER AS
	+ $$
	+ DECLARE
	+ BEGIN
	+ IF TG_OP = 'INSERT' THEN
	+ IF NEW.data->>'type' = 'Create' THEN
	+ EXECUTE 'INSERT INTO counter_cache (name, count) VALUES (''status_visibility_' \|\| activity_visibility(NEW.actor, NEW.recipients, NEW.data) \|\| ''', 1) ON CONFLICT (name) DO UPDATE SET count = counter_cache.count + 1';
	+ END IF;
	+ RETURN NEW;
	+ ELSIF TG_OP = 'UPDATE' THEN
	+ IF (NEW.data->>'type' = 'Create') and (OLD.data->>'type' = 'Create') and activity_visibility(NEW.actor, NEW.recipients, NEW.data) != activity_visibility(OLD.actor, OLD.recipients, OLD.data) THEN
	+ EXECUTE 'INSERT INTO counter_cache (name, count) VALUES (''status_visibility_' \|\| activity_visibility(NEW.actor, NEW.recipients, NEW.data) \|\| ''', 1) ON CONFLICT (name) DO UPDATE SET count = counter_cache.count + 1';
	+ EXECUTE 'update counter_cache SET count = counter_cache.count - 1 where count > 0 and name = ''status_visibility_' \|\| activity_visibility(OLD.actor, OLD.recipients, OLD.data) \|\| ''';';
	+ END IF;
	+ RETURN NEW;
	+ ELSIF TG_OP = 'DELETE' THEN
	+ IF OLD.data->>'type' = 'Create' THEN
	+ EXECUTE 'update counter_cache SET count = counter_cache.count - 1 where count > 0 and name = ''status_visibility_' \|\| activity_visibility(OLD.actor, OLD.recipients, OLD.data) \|\| ''';';
	+ END IF;
	+ RETURN OLD;
	+ END IF;
	+ END;
	+ $$
	+ LANGUAGE 'plpgsql';
	+ """
	+ \|> execute()
	+
	+ """
	+ CREATE TRIGGER status_visibility_counter_cache_trigger BEFORE INSERT OR UPDATE of recipients, data OR DELETE ON activities
	+ FOR EACH ROW
	+ EXECUTE PROCEDURE update_status_visibility_counter_cache();
	+ """
	+ \|> execute()
	+ end
	+
	+ def down do
	+ execute("drop trigger if exists status_visibility_counter_cache_trigger on activities")
	+ execute("drop function if exists update_status_visibility_counter_cache()")
	+ drop_if_exists(unique_index(:counter_cache, [:name]))
	+ drop_if_exists(table(:counter_cache))
	+ end
	+end
	diff --git a/test/federation/activity_pub/transmogrifier_test.exs b/test/federation/activity_pub/transmogrifier_test.exs
	index 38f83557d..90e10d987 100644
	--- a/test/federation/activity_pub/transmogrifier_test.exs
	+++ b/test/federation/activity_pub/transmogrifier_test.exs
	@@ -1,2050 +1,2192 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2019 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Federation.ActivityPub.TransmogrifierTest do
	+ use Oban.Testing, repo: Pleroma.Storage.Repo
	use Pleroma.DataCase
	+
	alias Pleroma.Activity
	alias Pleroma.Federation.ActivityPub
	alias Pleroma.Federation.ActivityPub.Federator
	alias Pleroma.Federation.ActivityPub.Transmogrifier
	alias Pleroma.Federation.ActivityPub.Utils
	alias Pleroma.Object
	alias Pleroma.Object.Fetcher
	alias Pleroma.Tests.ObanHelpers
	alias Pleroma.User
	alias Pleroma.Web.AdminAPI.AccountView
	alias Pleroma.Web.CommonAPI

	import Mock
	import Pleroma.Factory
	import ExUnit.CaptureLog

	setup_all do
	Tesla.Mock.mock_global(fn env -> apply(HttpRequestMock, :request, [env]) end)
	:ok
	end

	clear_config([:instance, :max_remote_account_fields])

	describe "handle_incoming" do
	test "it ignores an incoming notice if we already have it" do
	activity = insert(:note_activity)

	data =
	File.read!("test/fixtures/mastodon-post-activity.json")
	\|> Poison.decode!()
	\|> Map.put("object", Object.normalize(activity).data)

	{:ok, returned_activity} = Transmogrifier.handle_incoming(data)

	assert activity == returned_activity
	end

	@tag capture_log: true
	- test "it fetches replied-to activities if we don't have them" do
	+ test "it fetches reply-to activities if we don't have them" do
	data =
	File.read!("test/fixtures/mastodon-post-activity.json")
	\|> Poison.decode!()

	object =
	data["object"]
	\|> Map.put("inReplyTo", "https://shitposter.club/notice/2827873")

	data = Map.put(data, "object", object)
	{:ok, returned_activity} = Transmogrifier.handle_incoming(data)
	returned_object = Object.normalize(returned_activity, false)

	assert activity =
	Activity.get_create_by_object_ap_id(
	"tag:shitposter.club,2017-05-05:noticeId=2827873:objectType=comment"
	)

	assert returned_object.data["inReplyToAtomUri"] == "https://shitposter.club/notice/2827873"
	end

	- test "it does not fetch replied-to activities beyond max_replies_depth" do
	+ test "it does not fetch reply-to activities beyond max replies depth limit" do
	data =
	File.read!("test/fixtures/mastodon-post-activity.json")
	\|> Poison.decode!()

	object =
	data["object"]
	\|> Map.put("inReplyTo", "https://shitposter.club/notice/2827873")

	data = Map.put(data, "object", object)

	with_mock Federator,
	- allowed_incoming_reply_depth?: fn _ -> false end do
	+ allowed_thread_distance?: fn _ -> false end do
	{:ok, returned_activity} = Transmogrifier.handle_incoming(data)

	returned_object = Object.normalize(returned_activity, false)

	refute Activity.get_create_by_object_ap_id(
	"tag:shitposter.club,2017-05-05:noticeId=2827873:objectType=comment"
	)

	assert returned_object.data["inReplyToAtomUri"] ==
	"https://shitposter.club/notice/2827873"
	end
	end

	test "it does not crash if the object in inReplyTo can't be fetched" do
	data =
	File.read!("test/fixtures/mastodon-post-activity.json")
	\|> Poison.decode!()

	object =
	data["object"]
	\|> Map.put("inReplyTo", "https://404.site/whatever")

	data =
	data
	\|> Map.put("object", object)

	assert capture_log(fn ->
	{:ok, _returned_activity} = Transmogrifier.handle_incoming(data)
	end) =~ "[error] Couldn't fetch \"https://404.site/whatever\", error: nil"
	end

	test "it works for incoming notices" do
	data = File.read!("test/fixtures/mastodon-post-activity.json") \|> Poison.decode!()

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)

	assert data["id"] ==
	"http://mastodon.example.org/users/admin/statuses/99512778738411822/activity"

	assert data["context"] ==
	"tag:mastodon.example.org,2018-02-12:objectId=20:objectType=Conversation"

	assert data["to"] == ["https://www.w3.org/ns/activitystreams#Public"]

	assert data["cc"] == [
	"http://mastodon.example.org/users/admin/followers",
	"http://localtesting.pleroma.lol/users/lain"
	]

	assert data["actor"] == "http://mastodon.example.org/users/admin"

	object_data = Object.normalize(data["object"]).data

	assert object_data["id"] ==
	"http://mastodon.example.org/users/admin/statuses/99512778738411822"

	assert object_data["to"] == ["https://www.w3.org/ns/activitystreams#Public"]

	assert object_data["cc"] == [
	"http://mastodon.example.org/users/admin/followers",
	"http://localtesting.pleroma.lol/users/lain"
	]

	assert object_data["actor"] == "http://mastodon.example.org/users/admin"
	assert object_data["attributedTo"] == "http://mastodon.example.org/users/admin"

	assert object_data["context"] ==
	"tag:mastodon.example.org,2018-02-12:objectId=20:objectType=Conversation"

	assert object_data["sensitive"] == true

	user = User.get_cached_by_ap_id(object_data["actor"])

	assert user.note_count == 1
	end

	test "it works for incoming notices with hashtags" do
	data = File.read!("test/fixtures/mastodon-post-activity-hashtag.json") \|> Poison.decode!()

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)
	object = Object.normalize(data["object"])

	assert Enum.at(object.data["tag"], 2) == "moo"
	end

	test "it works for incoming questions" do
	data = File.read!("test/fixtures/mastodon-question-activity.json") \|> Poison.decode!()

	{:ok, %Activity{local: false} = activity} = Transmogrifier.handle_incoming(data)

	object = Object.normalize(activity)

	assert Enum.all?(object.data["oneOf"], fn choice ->
	choice["name"] in [
	"Dunno",
	"Everyone knows that!",
	"25 char limit is dumb",
	"I can't even fit a funny"
	]
	end)
	end

	test "it works for incoming listens" do
	data = %{
	"@context" => "https://www.w3.org/ns/activitystreams",
	"to" => ["https://www.w3.org/ns/activitystreams#Public"],
	"cc" => [],
	"type" => "Listen",
	"id" => "http://mastodon.example.org/users/admin/listens/1234/activity",
	"actor" => "http://mastodon.example.org/users/admin",
	"object" => %{
	"type" => "Audio",
	"id" => "http://mastodon.example.org/users/admin/listens/1234",
	"attributedTo" => "http://mastodon.example.org/users/admin",
	"title" => "lain radio episode 1",
	"artist" => "lain",
	"album" => "lain radio",
	"length" => 180_000
	}
	}

	{:ok, %Activity{local: false} = activity} = Transmogrifier.handle_incoming(data)

	object = Object.normalize(activity)

	assert object.data["title"] == "lain radio episode 1"
	assert object.data["artist"] == "lain"
	assert object.data["album"] == "lain radio"
	assert object.data["length"] == 180_000
	end

	test "it rewrites Note votes to Answers and increments vote counters on question activities" do
	user = insert(:user)

	{:ok, activity} =
	CommonAPI.post(user, %{
	"status" => "suya...",
	"poll" => %{"options" => ["suya", "suya.", "suya.."], "expires_in" => 10}
	})

	object = Object.normalize(activity)

	data =
	File.read!("test/fixtures/mastodon-vote.json")
	\|> Poison.decode!()
	\|> Kernel.put_in(["to"], user.ap_id)
	\|> Kernel.put_in(["object", "inReplyTo"], object.data["id"])
	\|> Kernel.put_in(["object", "to"], user.ap_id)

	{:ok, %Activity{local: false} = activity} = Transmogrifier.handle_incoming(data)
	answer_object = Object.normalize(activity)
	assert answer_object.data["type"] == "Answer"
	object = Object.get_by_ap_id(object.data["id"])

	assert Enum.any?(
	object.data["oneOf"],
	fn
	%{"name" => "suya..", "replies" => %{"totalItems" => 1}} -> true
	_ -> false
	end
	)
	end

	test "it works for incoming notices with contentMap" do
	data =
	File.read!("test/fixtures/mastodon-post-activity-contentmap.json") \|> Poison.decode!()

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)
	object = Object.normalize(data["object"])

	assert object.data["content"] ==
	"<p><span class=\"h-card\"><a href=\"http://localtesting.pleroma.lol/users/lain\" class=\"u-url mention\">@<span>lain</span></a></span></p>"
	end

	test "it works for incoming notices with to/cc not being an array (kroeg)" do
	data = File.read!("test/fixtures/kroeg-post-activity.json") \|> Poison.decode!()

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)
	object = Object.normalize(data["object"])

	assert object.data["content"] ==
	"<p>henlo from my Psion netBook</p><p>message sent from my Psion netBook</p>"
	end

	test "it works for incoming announces with actor being inlined (kroeg)" do
	data = File.read!("test/fixtures/kroeg-announce-with-inline-actor.json") \|> Poison.decode!()

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)

	assert data["actor"] == "https://puckipedia.com/"
	end

	test "it works for incoming notices with tag not being an array (kroeg)" do
	data = File.read!("test/fixtures/kroeg-array-less-emoji.json") \|> Poison.decode!()

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)
	object = Object.normalize(data["object"])

	assert object.data["emoji"] == %{
	"icon_e_smile" => "https://puckipedia.com/forum/images/smilies/icon_e_smile.png"
	}

	data = File.read!("test/fixtures/kroeg-array-less-hashtag.json") \|> Poison.decode!()

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)
	object = Object.normalize(data["object"])

	assert "test" in object.data["tag"]
	end

	test "it works for incoming notices with url not being a string (prismo)" do
	data = File.read!("test/fixtures/prismo-url-map.json") \|> Poison.decode!()

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)
	object = Object.normalize(data["object"])

	assert object.data["url"] == "https://prismo.news/posts/83"
	end

	test "it cleans up incoming notices which are not really DMs" do
	user = insert(:user)
	other_user = insert(:user)

	to = [user.ap_id, other_user.ap_id]

	data =
	File.read!("test/fixtures/mastodon-post-activity.json")
	\|> Poison.decode!()
	\|> Map.put("to", to)
	\|> Map.put("cc", [])

	object =
	data["object"]
	\|> Map.put("to", to)
	\|> Map.put("cc", [])

	data = Map.put(data, "object", object)

	{:ok, %Activity{data: data, local: false} = activity} = Transmogrifier.handle_incoming(data)

	assert data["to"] == []
	assert data["cc"] == to

	object_data = Object.normalize(activity).data

	assert object_data["to"] == []
	assert object_data["cc"] == to
	end

	test "it works for incoming likes" do
	user = insert(:user)
	{:ok, activity} = CommonAPI.post(user, %{"status" => "hello"})

	data =
	File.read!("test/fixtures/mastodon-like.json")
	\|> Poison.decode!()
	\|> Map.put("object", activity.data["object"])

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)

	assert data["actor"] == "http://mastodon.example.org/users/admin"
	assert data["type"] == "Like"
	assert data["id"] == "http://mastodon.example.org/users/admin#likes/2"
	assert data["object"] == activity.data["object"]
	end

	test "it works for incoming misskey likes, turning them into EmojiReacts" do
	user = insert(:user)
	{:ok, activity} = CommonAPI.post(user, %{"status" => "hello"})

	data =
	File.read!("test/fixtures/misskey-like.json")
	\|> Poison.decode!()
	\|> Map.put("object", activity.data["object"])

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)

	assert data["actor"] == data["actor"]
	assert data["type"] == "EmojiReact"
	assert data["id"] == data["id"]
	assert data["object"] == activity.data["object"]
	assert data["content"] == "🍮"
	end

	test "it works for incoming misskey likes that contain unicode emojis, turning them into EmojiReacts" do
	user = insert(:user)
	{:ok, activity} = CommonAPI.post(user, %{"status" => "hello"})

	data =
	File.read!("test/fixtures/misskey-like.json")
	\|> Poison.decode!()
	\|> Map.put("object", activity.data["object"])
	\|> Map.put("_misskey_reaction", "⭐")

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)

	assert data["actor"] == data["actor"]
	assert data["type"] == "EmojiReact"
	assert data["id"] == data["id"]
	assert data["object"] == activity.data["object"]
	assert data["content"] == "⭐"
	end

	test "it works for incoming emoji reactions" do
	user = insert(:user)
	{:ok, activity} = CommonAPI.post(user, %{"status" => "hello"})

	data =
	File.read!("test/fixtures/emoji-reaction.json")
	\|> Poison.decode!()
	\|> Map.put("object", activity.data["object"])

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)

	assert data["actor"] == "http://mastodon.example.org/users/admin"
	assert data["type"] == "EmojiReact"
	assert data["id"] == "http://mastodon.example.org/users/admin#reactions/2"
	assert data["object"] == activity.data["object"]
	assert data["content"] == "👌"
	end

	test "it reject invalid emoji reactions" do
	user = insert(:user)
	{:ok, activity} = CommonAPI.post(user, %{"status" => "hello"})

	data =
	File.read!("test/fixtures/emoji-reaction-too-long.json")
	\|> Poison.decode!()
	\|> Map.put("object", activity.data["object"])

	assert :error = Transmogrifier.handle_incoming(data)

	data =
	File.read!("test/fixtures/emoji-reaction-no-emoji.json")
	\|> Poison.decode!()
	\|> Map.put("object", activity.data["object"])

	assert :error = Transmogrifier.handle_incoming(data)
	end

	test "it works for incoming emoji reaction undos" do
	user = insert(:user)

	{:ok, activity} = CommonAPI.post(user, %{"status" => "hello"})
	{:ok, reaction_activity, _object} = CommonAPI.react_with_emoji(activity.id, user, "👌")

	data =
	File.read!("test/fixtures/mastodon-undo-like.json")
	\|> Poison.decode!()
	\|> Map.put("object", reaction_activity.data["id"])
	\|> Map.put("actor", user.ap_id)

	{:ok, activity} = Transmogrifier.handle_incoming(data)

	assert activity.actor == user.ap_id
	assert activity.data["id"] == data["id"]
	assert activity.data["type"] == "Undo"
	end

	test "it returns an error for incoming unlikes wihout a like activity" do
	user = insert(:user)
	{:ok, activity} = CommonAPI.post(user, %{"status" => "leave a like pls"})

	data =
	File.read!("test/fixtures/mastodon-undo-like.json")
	\|> Poison.decode!()
	\|> Map.put("object", activity.data["object"])

	assert Transmogrifier.handle_incoming(data) == :error
	end

	test "it works for incoming unlikes with an existing like activity" do
	user = insert(:user)
	{:ok, activity} = CommonAPI.post(user, %{"status" => "leave a like pls"})

	like_data =
	File.read!("test/fixtures/mastodon-like.json")
	\|> Poison.decode!()
	\|> Map.put("object", activity.data["object"])

	{:ok, %Activity{data: like_data, local: false}} = Transmogrifier.handle_incoming(like_data)

	data =
	File.read!("test/fixtures/mastodon-undo-like.json")
	\|> Poison.decode!()
	\|> Map.put("object", like_data)
	\|> Map.put("actor", like_data["actor"])

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)

	assert data["actor"] == "http://mastodon.example.org/users/admin"
	assert data["type"] == "Undo"
	assert data["id"] == "http://mastodon.example.org/users/admin#likes/2/undo"
	assert data["object"]["id"] == "http://mastodon.example.org/users/admin#likes/2"
	end

	test "it works for incoming unlikes with an existing like activity and a compact object" do
	user = insert(:user)
	{:ok, activity} = CommonAPI.post(user, %{"status" => "leave a like pls"})

	like_data =
	File.read!("test/fixtures/mastodon-like.json")
	\|> Poison.decode!()
	\|> Map.put("object", activity.data["object"])

	{:ok, %Activity{data: like_data, local: false}} = Transmogrifier.handle_incoming(like_data)

	data =
	File.read!("test/fixtures/mastodon-undo-like.json")
	\|> Poison.decode!()
	\|> Map.put("object", like_data["id"])
	\|> Map.put("actor", like_data["actor"])

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)

	assert data["actor"] == "http://mastodon.example.org/users/admin"
	assert data["type"] == "Undo"
	assert data["id"] == "http://mastodon.example.org/users/admin#likes/2/undo"
	assert data["object"]["id"] == "http://mastodon.example.org/users/admin#likes/2"
	end

	test "it works for incoming announces" do
	data = File.read!("test/fixtures/mastodon-announce.json") \|> Poison.decode!()

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)

	assert data["actor"] == "http://mastodon.example.org/users/admin"
	assert data["type"] == "Announce"

	assert data["id"] ==
	"http://mastodon.example.org/users/admin/statuses/99542391527669785/activity"

	assert data["object"] ==
	"http://mastodon.example.org/users/admin/statuses/99541947525187367"

	assert Activity.get_create_by_object_ap_id(data["object"])
	end

	test "it works for incoming announces with an existing activity" do
	user = insert(:user)
	{:ok, activity} = CommonAPI.post(user, %{"status" => "hey"})

	data =
	File.read!("test/fixtures/mastodon-announce.json")
	\|> Poison.decode!()
	\|> Map.put("object", activity.data["object"])

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)

	assert data["actor"] == "http://mastodon.example.org/users/admin"
	assert data["type"] == "Announce"

	assert data["id"] ==
	"http://mastodon.example.org/users/admin/statuses/99542391527669785/activity"

	assert data["object"] == activity.data["object"]

	assert Activity.get_create_by_object_ap_id(data["object"]).id == activity.id
	end

	test "it works for incoming announces with an inlined activity" do
	data =
	File.read!("test/fixtures/mastodon-announce-private.json")
	\|> Poison.decode!()

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)

	assert data["actor"] == "http://mastodon.example.org/users/admin"
	assert data["type"] == "Announce"

	assert data["id"] ==
	"http://mastodon.example.org/users/admin/statuses/99542391527669785/activity"

	object = Object.normalize(data["object"])

	assert object.data["id"] == "http://mastodon.example.org/@admin/99541947525187368"
	assert object.data["content"] == "this is a private toot"
	end

	@tag capture_log: true
	test "it rejects incoming announces with an inlined activity from another origin" do
	data =
	File.read!("test/fixtures/bogus-mastodon-announce.json")
	\|> Poison.decode!()

	assert :error = Transmogrifier.handle_incoming(data)
	end

	test "it does not clobber the addressing on announce activities" do
	user = insert(:user)
	{:ok, activity} = CommonAPI.post(user, %{"status" => "hey"})

	data =
	File.read!("test/fixtures/mastodon-announce.json")
	\|> Poison.decode!()
	\|> Map.put("object", Object.normalize(activity).data["id"])
	\|> Map.put("to", ["http://mastodon.example.org/users/admin/followers"])
	\|> Map.put("cc", [])

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)

	assert data["to"] == ["http://mastodon.example.org/users/admin/followers"]
	end

	test "it ensures that as:Public activities make it to their followers collection" do
	user = insert(:user)

	data =
	File.read!("test/fixtures/mastodon-post-activity.json")
	\|> Poison.decode!()
	\|> Map.put("actor", user.ap_id)
	\|> Map.put("to", ["https://www.w3.org/ns/activitystreams#Public"])
	\|> Map.put("cc", [])

	object =
	data["object"]
	\|> Map.put("attributedTo", user.ap_id)
	\|> Map.put("to", ["https://www.w3.org/ns/activitystreams#Public"])
	\|> Map.put("cc", [])
	\|> Map.put("id", user.ap_id <> "/activities/12345678")

	data = Map.put(data, "object", object)

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)

	assert data["cc"] == [User.ap_followers(user)]
	end

	test "it ensures that address fields become lists" do
	user = insert(:user)

	data =
	File.read!("test/fixtures/mastodon-post-activity.json")
	\|> Poison.decode!()
	\|> Map.put("actor", user.ap_id)
	\|> Map.put("to", nil)
	\|> Map.put("cc", nil)

	object =
	data["object"]
	\|> Map.put("attributedTo", user.ap_id)
	\|> Map.put("to", nil)
	\|> Map.put("cc", nil)
	\|> Map.put("id", user.ap_id <> "/activities/12345678")

	data = Map.put(data, "object", object)

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)

	assert !is_nil(data["to"])
	assert !is_nil(data["cc"])
	end

	test "it strips internal likes" do
	data =
	File.read!("test/fixtures/mastodon-post-activity.json")
	\|> Poison.decode!()

	likes = %{
	"first" =>
	"http://mastodon.example.org/objects/dbdbc507-52c8-490d-9b7c-1e1d52e5c132/likes?page=1",
	"id" => "http://mastodon.example.org/objects/dbdbc507-52c8-490d-9b7c-1e1d52e5c132/likes",
	"totalItems" => 3,
	"type" => "OrderedCollection"
	}

	object = Map.put(data["object"], "likes", likes)
	data = Map.put(data, "object", object)

	{:ok, %Activity{object: object}} = Transmogrifier.handle_incoming(data)

	refute Map.has_key?(object.data, "likes")
	end

	test "it strips internal reactions" do
	user = insert(:user)
	{:ok, activity} = CommonAPI.post(user, %{"status" => "#cofe"})
	{:ok, _, _} = CommonAPI.react_with_emoji(activity.id, user, "📢")

	%{object: object} = Activity.get_by_id_with_object(activity.id)
	assert Map.has_key?(object.data, "reactions")
	assert Map.has_key?(object.data, "reaction_count")

	object_data = Transmogrifier.strip_internal_fields(object.data)
	refute Map.has_key?(object_data, "reactions")
	refute Map.has_key?(object_data, "reaction_count")
	end

	test "it works for incoming update activities" do
	data = File.read!("test/fixtures/mastodon-post-activity.json") \|> Poison.decode!()

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)
	update_data = File.read!("test/fixtures/mastodon-update.json") \|> Poison.decode!()

	object =
	update_data["object"]
	\|> Map.put("actor", data["actor"])
	\|> Map.put("id", data["actor"])

	update_data =
	update_data
	\|> Map.put("actor", data["actor"])
	\|> Map.put("object", object)

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(update_data)

	assert data["id"] == update_data["id"]

	user = User.get_cached_by_ap_id(data["actor"])
	assert user.name == "gargle"

	assert user.avatar["url"] == [
	%{
	"href" =>
	"https://cd.niu.moe/accounts/avatars/000/033/323/original/fd7f8ae0b3ffedc9.jpeg"
	}
	]

	assert user.banner["url"] == [
	%{
	"href" =>
	"https://cd.niu.moe/accounts/headers/000/033/323/original/850b3448fa5fd477.png"
	}
	]

	assert user.bio == "<p>Some bio</p>"
	end

	test "it works with alsoKnownAs" do
	{:ok, %Activity{data: %{"actor" => actor}}} =
	"test/fixtures/mastodon-post-activity.json"
	\|> File.read!()
	\|> Poison.decode!()
	\|> Transmogrifier.handle_incoming()

	assert User.get_cached_by_ap_id(actor).also_known_as == ["http://example.org/users/foo"]

	{:ok, _activity} =
	"test/fixtures/mastodon-update.json"
	\|> File.read!()
	\|> Poison.decode!()
	\|> Map.put("actor", actor)
	\|> Map.update!("object", fn object ->
	object
	\|> Map.put("actor", actor)
	\|> Map.put("id", actor)
	\|> Map.put("alsoKnownAs", [
	"http://mastodon.example.org/users/foo",
	"http://example.org/users/bar"
	])
	end)
	\|> Transmogrifier.handle_incoming()

	assert User.get_cached_by_ap_id(actor).also_known_as == [
	"http://mastodon.example.org/users/foo",
	"http://example.org/users/bar"
	]
	end

	test "it works with custom profile fields" do
	{:ok, activity} =
	"test/fixtures/mastodon-post-activity.json"
	\|> File.read!()
	\|> Poison.decode!()
	\|> Transmogrifier.handle_incoming()

	user = User.get_cached_by_ap_id(activity.actor)

	assert User.fields(user) == [
	%{"name" => "foo", "value" => "bar"},
	%{"name" => "foo1", "value" => "bar1"}
	]

	update_data = File.read!("test/fixtures/mastodon-update.json") \|> Poison.decode!()

	object =
	update_data["object"]
	\|> Map.put("actor", user.ap_id)
	\|> Map.put("id", user.ap_id)

	update_data =
	update_data
	\|> Map.put("actor", user.ap_id)
	\|> Map.put("object", object)

	{:ok, _update_activity} = Transmogrifier.handle_incoming(update_data)

	user = User.get_cached_by_ap_id(user.ap_id)

	assert User.fields(user) == [
	%{"name" => "foo", "value" => "updated"},
	%{"name" => "foo1", "value" => "updated"}
	]

	Pleroma.Config.put([:instance, :max_remote_account_fields], 2)

	update_data =
	put_in(update_data, ["object", "attachment"], [
	%{"name" => "foo", "type" => "PropertyValue", "value" => "bar"},
	%{"name" => "foo11", "type" => "PropertyValue", "value" => "bar11"},
	%{"name" => "foo22", "type" => "PropertyValue", "value" => "bar22"}
	])

	{:ok, _} = Transmogrifier.handle_incoming(update_data)

	user = User.get_cached_by_ap_id(user.ap_id)

	assert User.fields(user) == [
	%{"name" => "foo", "value" => "updated"},
	%{"name" => "foo1", "value" => "updated"}
	]

	update_data = put_in(update_data, ["object", "attachment"], [])

	{:ok, _} = Transmogrifier.handle_incoming(update_data)

	user = User.get_cached_by_ap_id(user.ap_id)

	assert User.fields(user) == []
	end

	test "it works for incoming update activities which lock the account" do
	data = File.read!("test/fixtures/mastodon-post-activity.json") \|> Poison.decode!()

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)
	update_data = File.read!("test/fixtures/mastodon-update.json") \|> Poison.decode!()

	object =
	update_data["object"]
	\|> Map.put("actor", data["actor"])
	\|> Map.put("id", data["actor"])
	\|> Map.put("manuallyApprovesFollowers", true)

	update_data =
	update_data
	\|> Map.put("actor", data["actor"])
	\|> Map.put("object", object)

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(update_data)

	user = User.get_cached_by_ap_id(data["actor"])
	assert user.locked == true
	end

	test "it works for incoming deletes" do
	activity = insert(:note_activity)
	deleting_user = insert(:user)

	data =
	File.read!("test/fixtures/mastodon-delete.json")
	\|> Poison.decode!()

	object =
	data["object"]
	\|> Map.put("id", activity.data["object"])

	data =
	data
	\|> Map.put("object", object)
	\|> Map.put("actor", deleting_user.ap_id)

	{:ok, %Activity{actor: actor, local: false, data: %{"id" => id}}} =
	Transmogrifier.handle_incoming(data)

	assert id == data["id"]
	refute Activity.get_by_id(activity.id)
	assert actor == deleting_user.ap_id
	end

	test "it fails for incoming deletes with spoofed origin" do
	activity = insert(:note_activity)

	data =
	File.read!("test/fixtures/mastodon-delete.json")
	\|> Poison.decode!()

	object =
	data["object"]
	\|> Map.put("id", activity.data["object"])

	data =
	data
	\|> Map.put("object", object)

	assert capture_log(fn ->
	:error = Transmogrifier.handle_incoming(data)
	end) =~
	"[error] Could not decode user at fetch http://mastodon.example.org/users/gargron, {:error, :nxdomain}"

	assert Activity.get_by_id(activity.id)
	end

	@tag capture_log: true
	test "it works for incoming user deletes" do
	%{ap_id: ap_id} = insert(:user, ap_id: "http://mastodon.example.org/users/admin")

	data =
	File.read!("test/fixtures/mastodon-delete-user.json")
	\|> Poison.decode!()

	{:ok, _} = Transmogrifier.handle_incoming(data)
	ObanHelpers.perform_all()

	refute User.get_cached_by_ap_id(ap_id)
	end

	test "it fails for incoming user deletes with spoofed origin" do
	%{ap_id: ap_id} = insert(:user)

	data =
	File.read!("test/fixtures/mastodon-delete-user.json")
	\|> Poison.decode!()
	\|> Map.put("actor", ap_id)

	assert capture_log(fn ->
	assert :error == Transmogrifier.handle_incoming(data)
	end) =~ "Object containment failed"

	assert User.get_cached_by_ap_id(ap_id)
	end

	test "it works for incoming unannounces with an existing notice" do
	user = insert(:user)
	{:ok, activity} = CommonAPI.post(user, %{"status" => "hey"})

	announce_data =
	File.read!("test/fixtures/mastodon-announce.json")
	\|> Poison.decode!()
	\|> Map.put("object", activity.data["object"])

	{:ok, %Activity{data: announce_data, local: false}} =
	Transmogrifier.handle_incoming(announce_data)

	data =
	File.read!("test/fixtures/mastodon-undo-announce.json")
	\|> Poison.decode!()
	\|> Map.put("object", announce_data)
	\|> Map.put("actor", announce_data["actor"])

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)

	assert data["type"] == "Undo"
	assert object_data = data["object"]
	assert object_data["type"] == "Announce"
	assert object_data["object"] == activity.data["object"]

	assert object_data["id"] ==
	"http://mastodon.example.org/users/admin/statuses/99542391527669785/activity"
	end

	test "it works for incomming unfollows with an existing follow" do
	user = insert(:user)

	follow_data =
	File.read!("test/fixtures/mastodon-follow-activity.json")
	\|> Poison.decode!()
	\|> Map.put("object", user.ap_id)

	{:ok, %Activity{data: _, local: false}} = Transmogrifier.handle_incoming(follow_data)

	data =
	File.read!("test/fixtures/mastodon-unfollow-activity.json")
	\|> Poison.decode!()
	\|> Map.put("object", follow_data)

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)

	assert data["type"] == "Undo"
	assert data["object"]["type"] == "Follow"
	assert data["object"]["object"] == user.ap_id
	assert data["actor"] == "http://mastodon.example.org/users/admin"

	refute User.following?(User.get_cached_by_ap_id(data["actor"]), user)
	end

	test "it works for incoming follows to locked account" do
	pending_follower = insert(:user, ap_id: "http://mastodon.example.org/users/admin")
	user = insert(:user, locked: true)

	data =
	File.read!("test/fixtures/mastodon-follow-activity.json")
	\|> Poison.decode!()
	\|> Map.put("object", user.ap_id)

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)

	assert data["type"] == "Follow"
	assert data["object"] == user.ap_id
	assert data["state"] == "pending"
	assert data["actor"] == "http://mastodon.example.org/users/admin"

	assert [^pending_follower] = User.get_follow_requests(user)
	end

	test "it works for incoming blocks" do
	user = insert(:user)

	data =
	File.read!("test/fixtures/mastodon-block-activity.json")
	\|> Poison.decode!()
	\|> Map.put("object", user.ap_id)

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)

	assert data["type"] == "Block"
	assert data["object"] == user.ap_id
	assert data["actor"] == "http://mastodon.example.org/users/admin"

	blocker = User.get_cached_by_ap_id(data["actor"])

	assert User.blocks?(blocker, user)
	end

	test "incoming blocks successfully tear down any follow relationship" do
	blocker = insert(:user)
	blocked = insert(:user)

	data =
	File.read!("test/fixtures/mastodon-block-activity.json")
	\|> Poison.decode!()
	\|> Map.put("object", blocked.ap_id)
	\|> Map.put("actor", blocker.ap_id)

	{:ok, blocker} = User.follow(blocker, blocked)
	{:ok, blocked} = User.follow(blocked, blocker)

	assert User.following?(blocker, blocked)
	assert User.following?(blocked, blocker)

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)

	assert data["type"] == "Block"
	assert data["object"] == blocked.ap_id
	assert data["actor"] == blocker.ap_id

	blocker = User.get_cached_by_ap_id(data["actor"])
	blocked = User.get_cached_by_ap_id(data["object"])

	assert User.blocks?(blocker, blocked)

	refute User.following?(blocker, blocked)
	refute User.following?(blocked, blocker)
	end

	test "it works for incoming unblocks with an existing block" do
	user = insert(:user)

	block_data =
	File.read!("test/fixtures/mastodon-block-activity.json")
	\|> Poison.decode!()
	\|> Map.put("object", user.ap_id)

	{:ok, %Activity{data: _, local: false}} = Transmogrifier.handle_incoming(block_data)

	data =
	File.read!("test/fixtures/mastodon-unblock-activity.json")
	\|> Poison.decode!()
	\|> Map.put("object", block_data)

	{:ok, %Activity{data: data, local: false}} = Transmogrifier.handle_incoming(data)
	assert data["type"] == "Undo"
	assert data["object"]["type"] == "Block"
	assert data["object"]["object"] == user.ap_id
	assert data["actor"] == "http://mastodon.example.org/users/admin"

	blocker = User.get_cached_by_ap_id(data["actor"])

	refute User.blocks?(blocker, user)
	end

	test "it works for incoming accepts which were pre-accepted" do
	follower = insert(:user)
	followed = insert(:user)

	{:ok, follower} = User.follow(follower, followed)
	assert User.following?(follower, followed) == true

	{:ok, follow_activity} = ActivityPub.follow(follower, followed)

	accept_data =
	File.read!("test/fixtures/mastodon-accept-activity.json")
	\|> Poison.decode!()
	\|> Map.put("actor", followed.ap_id)

	object =
	accept_data["object"]
	\|> Map.put("actor", follower.ap_id)
	\|> Map.put("id", follow_activity.data["id"])

	accept_data = Map.put(accept_data, "object", object)

	{:ok, activity} = Transmogrifier.handle_incoming(accept_data)
	refute activity.local

	assert activity.data["object"] == follow_activity.data["id"]

	assert activity.data["id"] == accept_data["id"]

	follower = User.get_cached_by_id(follower.id)

	assert User.following?(follower, followed) == true
	end

	test "it works for incoming accepts which were orphaned" do
	follower = insert(:user)
	followed = insert(:user, locked: true)

	{:ok, follow_activity} = ActivityPub.follow(follower, followed)

	accept_data =
	File.read!("test/fixtures/mastodon-accept-activity.json")
	\|> Poison.decode!()
	\|> Map.put("actor", followed.ap_id)

	accept_data =
	Map.put(accept_data, "object", Map.put(accept_data["object"], "actor", follower.ap_id))

	{:ok, activity} = Transmogrifier.handle_incoming(accept_data)
	assert activity.data["object"] == follow_activity.data["id"]

	follower = User.get_cached_by_id(follower.id)

	assert User.following?(follower, followed) == true
	end

	test "it works for incoming accepts which are referenced by IRI only" do
	follower = insert(:user)
	followed = insert(:user, locked: true)

	{:ok, follow_activity} = ActivityPub.follow(follower, followed)

	accept_data =
	File.read!("test/fixtures/mastodon-accept-activity.json")
	\|> Poison.decode!()
	\|> Map.put("actor", followed.ap_id)
	\|> Map.put("object", follow_activity.data["id"])

	{:ok, activity} = Transmogrifier.handle_incoming(accept_data)
	assert activity.data["object"] == follow_activity.data["id"]

	follower = User.get_cached_by_id(follower.id)

	assert User.following?(follower, followed) == true
	end

	test "it fails for incoming accepts which cannot be correlated" do
	follower = insert(:user)
	followed = insert(:user, locked: true)

	accept_data =
	File.read!("test/fixtures/mastodon-accept-activity.json")
	\|> Poison.decode!()
	\|> Map.put("actor", followed.ap_id)

	accept_data =
	Map.put(accept_data, "object", Map.put(accept_data["object"], "actor", follower.ap_id))

	:error = Transmogrifier.handle_incoming(accept_data)

	follower = User.get_cached_by_id(follower.id)

	refute User.following?(follower, followed) == true
	end

	test "it fails for incoming rejects which cannot be correlated" do
	follower = insert(:user)
	followed = insert(:user, locked: true)

	accept_data =
	File.read!("test/fixtures/mastodon-reject-activity.json")
	\|> Poison.decode!()
	\|> Map.put("actor", followed.ap_id)

	accept_data =
	Map.put(accept_data, "object", Map.put(accept_data["object"], "actor", follower.ap_id))

	:error = Transmogrifier.handle_incoming(accept_data)

	follower = User.get_cached_by_id(follower.id)

	refute User.following?(follower, followed) == true
	end

	test "it works for incoming rejects which are orphaned" do
	follower = insert(:user)
	followed = insert(:user, locked: true)

	{:ok, follower} = User.follow(follower, followed)
	{:ok, _follow_activity} = ActivityPub.follow(follower, followed)

	assert User.following?(follower, followed) == true

	reject_data =
	File.read!("test/fixtures/mastodon-reject-activity.json")
	\|> Poison.decode!()
	\|> Map.put("actor", followed.ap_id)

	reject_data =
	Map.put(reject_data, "object", Map.put(reject_data["object"], "actor", follower.ap_id))

	{:ok, activity} = Transmogrifier.handle_incoming(reject_data)
	refute activity.local
	assert activity.data["id"] == reject_data["id"]

	follower = User.get_cached_by_id(follower.id)

	assert User.following?(follower, followed) == false
	end

	test "it works for incoming rejects which are referenced by IRI only" do
	follower = insert(:user)
	followed = insert(:user, locked: true)

	{:ok, follower} = User.follow(follower, followed)
	{:ok, follow_activity} = ActivityPub.follow(follower, followed)

	assert User.following?(follower, followed) == true

	reject_data =
	File.read!("test/fixtures/mastodon-reject-activity.json")
	\|> Poison.decode!()
	\|> Map.put("actor", followed.ap_id)
	\|> Map.put("object", follow_activity.data["id"])

	{:ok, %Activity{data: _}} = Transmogrifier.handle_incoming(reject_data)

	follower = User.get_cached_by_id(follower.id)

	assert User.following?(follower, followed) == false
	end

	test "it rejects activities without a valid ID" do
	user = insert(:user)

	data =
	File.read!("test/fixtures/mastodon-follow-activity.json")
	\|> Poison.decode!()
	\|> Map.put("object", user.ap_id)
	\|> Map.put("id", "")

	:error = Transmogrifier.handle_incoming(data)
	end

	test "it remaps video URLs as attachments if necessary" do
	{:ok, object} =
	Fetcher.fetch_object_from_id(
	"https://peertube.moe/videos/watch/df5f464b-be8d-46fb-ad81-2d4c2d1630e3"
	)

	attachment = %{
	"type" => "Link",
	"mediaType" => "video/mp4",
	"href" =>
	"https://peertube.moe/static/webseed/df5f464b-be8d-46fb-ad81-2d4c2d1630e3-480.mp4",
	"mimeType" => "video/mp4",
	"size" => 5_015_880,
	"url" => [
	%{
	"href" =>
	"https://peertube.moe/static/webseed/df5f464b-be8d-46fb-ad81-2d4c2d1630e3-480.mp4",
	"mediaType" => "video/mp4",
	"type" => "Link"
	}
	],
	"width" => 480
	}

	assert object.data["url"] ==
	"https://peertube.moe/videos/watch/df5f464b-be8d-46fb-ad81-2d4c2d1630e3"

	assert object.data["attachment"] == [attachment]
	end

	test "it accepts Flag activities" do
	user = insert(:user)
	other_user = insert(:user)

	{:ok, activity} = CommonAPI.post(user, %{"status" => "test post"})
	object = Object.normalize(activity)

	note_obj = %{
	"type" => "Note",
	"id" => activity.data["id"],
	"content" => "test post",
	"published" => object.data["published"],
	"actor" => AccountView.render("show.json", %{user: user})
	}

	message = %{
	"@context" => "https://www.w3.org/ns/activitystreams",
	"cc" => [user.ap_id],
	"object" => [user.ap_id, activity.data["id"]],
	"type" => "Flag",
	"content" => "blocked AND reported!!!",
	"actor" => other_user.ap_id
	}

	assert {:ok, activity} = Transmogrifier.handle_incoming(message)

	assert activity.data["object"] == [user.ap_id, note_obj]
	assert activity.data["content"] == "blocked AND reported!!!"
	assert activity.data["actor"] == other_user.ap_id
	assert activity.data["cc"] == [user.ap_id]
	end

	test "it correctly processes messages with non-array to field" do
	user = insert(:user)

	message = %{
	"@context" => "https://www.w3.org/ns/activitystreams",
	"to" => "https://www.w3.org/ns/activitystreams#Public",
	"type" => "Create",
	"object" => %{
	"content" => "blah blah blah",
	"type" => "Note",
	"attributedTo" => user.ap_id,
	"inReplyTo" => nil
	},
	"actor" => user.ap_id
	}

	assert {:ok, activity} = Transmogrifier.handle_incoming(message)

	assert ["https://www.w3.org/ns/activitystreams#Public"] == activity.data["to"]
	end

	test "it correctly processes messages with non-array cc field" do
	user = insert(:user)

	message = %{
	"@context" => "https://www.w3.org/ns/activitystreams",
	"to" => user.follower_address,
	"cc" => "https://www.w3.org/ns/activitystreams#Public",
	"type" => "Create",
	"object" => %{
	"content" => "blah blah blah",
	"type" => "Note",
	"attributedTo" => user.ap_id,
	"inReplyTo" => nil
	},
	"actor" => user.ap_id
	}

	assert {:ok, activity} = Transmogrifier.handle_incoming(message)

	assert ["https://www.w3.org/ns/activitystreams#Public"] == activity.data["cc"]
	assert [user.follower_address] == activity.data["to"]
	end

	test "it accepts Move activities" do
	old_user = insert(:user)
	new_user = insert(:user)

	message = %{
	"@context" => "https://www.w3.org/ns/activitystreams",
	"type" => "Move",
	"actor" => old_user.ap_id,
	"object" => old_user.ap_id,
	"target" => new_user.ap_id
	}

	assert :error = Transmogrifier.handle_incoming(message)

	{:ok, _new_user} = User.update_and_set_cache(new_user, %{also_known_as: [old_user.ap_id]})

	assert {:ok, %Activity{} = activity} = Transmogrifier.handle_incoming(message)
	assert activity.actor == old_user.ap_id
	assert activity.data["actor"] == old_user.ap_id
	assert activity.data["object"] == old_user.ap_id
	assert activity.data["target"] == new_user.ap_id
	assert activity.data["type"] == "Move"
	end
	end

	+ describe "`handle_incoming/2`, Mastodon format `replies` handling" do
	+ clear_config([:activitypub, :note_replies_output_limit]) do
	+ Pleroma.Config.put([:activitypub, :note_replies_output_limit], 5)
	+ end
	+
	+ clear_config([:instance, :federation_incoming_replies_max_depth])
	+
	+ setup do
	+ data =
	+ "test/fixtures/mastodon-post-activity.json"
	+ \|> File.read!()
	+ \|> Poison.decode!()
	+
	+ items = get_in(data, ["object", "replies", "first", "items"])
	+ assert length(items) > 0
	+
	+ %{data: data, items: items}
	+ end
	+
	+ test "schedules background fetching of `replies` items if max thread depth limit allows", %{
	+ data: data,
	+ items: items
	+ } do
	+ Pleroma.Config.put([:instance, :federation_incoming_replies_max_depth], 10)
	+
	+ {:ok, _activity} = Transmogrifier.handle_incoming(data)
	+
	+ for id <- items do
	+ job_args = %{"op" => "fetch_remote", "id" => id, "depth" => 1}
	+ assert_enqueued(worker: Pleroma.Workers.RemoteFetcherWorker, args: job_args)
	+ end
	+ end
	+
	+ test "does NOT schedule background fetching of `replies` beyond max thread depth limit allows",
	+ %{data: data} do
	+ Pleroma.Config.put([:instance, :federation_incoming_replies_max_depth], 0)
	+
	+ {:ok, _activity} = Transmogrifier.handle_incoming(data)
	+
	+ assert all_enqueued(worker: Pleroma.Workers.RemoteFetcherWorker) == []
	+ end
	+ end
	+
	+ describe "`handle_incoming/2`, Pleroma format `replies` handling" do
	+ clear_config([:activitypub, :note_replies_output_limit]) do
	+ Pleroma.Config.put([:activitypub, :note_replies_output_limit], 5)
	+ end
	+
	+ clear_config([:instance, :federation_incoming_replies_max_depth])
	+
	+ setup do
	+ user = insert(:user)
	+
	+ {:ok, activity} = CommonAPI.post(user, %{"status" => "post1"})
	+
	+ {:ok, reply1} =
	+ CommonAPI.post(user, %{"status" => "reply1", "in_reply_to_status_id" => activity.id})
	+
	+ {:ok, reply2} =
	+ CommonAPI.post(user, %{"status" => "reply2", "in_reply_to_status_id" => activity.id})
	+
	+ replies_uris = Enum.map([reply1, reply2], fn a -> a.object.data["id"] end)
	+
	+ {:ok, federation_output} = Transmogrifier.prepare_outgoing(activity.data)
	+
	+ Repo.delete(activity.object)
	+ Repo.delete(activity)
	+
	+ %{federation_output: federation_output, replies_uris: replies_uris}
	+ end
	+
	+ test "schedules background fetching of `replies` items if max thread depth limit allows", %{
	+ federation_output: federation_output,
	+ replies_uris: replies_uris
	+ } do
	+ Pleroma.Config.put([:instance, :federation_incoming_replies_max_depth], 1)
	+
	+ {:ok, _activity} = Transmogrifier.handle_incoming(federation_output)
	+
	+ for id <- replies_uris do
	+ job_args = %{"op" => "fetch_remote", "id" => id, "depth" => 1}
	+ assert_enqueued(worker: Pleroma.Workers.RemoteFetcherWorker, args: job_args)
	+ end
	+ end
	+
	+ test "does NOT schedule background fetching of `replies` beyond max thread depth limit allows",
	+ %{federation_output: federation_output} do
	+ Pleroma.Config.put([:instance, :federation_incoming_replies_max_depth], 0)
	+
	+ {:ok, _activity} = Transmogrifier.handle_incoming(federation_output)
	+
	+ assert all_enqueued(worker: Pleroma.Workers.RemoteFetcherWorker) == []
	+ end
	+ end
	+
	describe "prepare outgoing" do
	test "it inlines private announced objects" do
	user = insert(:user)

	{:ok, activity} = CommonAPI.post(user, %{"status" => "hey", "visibility" => "private"})

	{:ok, announce_activity, _} = CommonAPI.repeat(activity.id, user)

	{:ok, modified} = Transmogrifier.prepare_outgoing(announce_activity.data)

	assert modified["object"]["content"] == "hey"
	assert modified["object"]["actor"] == modified["object"]["attributedTo"]
	end

	test "it turns mentions into tags" do
	user = insert(:user)
	other_user = insert(:user)

	{:ok, activity} =
	CommonAPI.post(user, %{"status" => "hey, @#{other_user.nickname}, how are ya? #2hu"})

	{:ok, modified} = Transmogrifier.prepare_outgoing(activity.data)
	object = modified["object"]

	expected_mention = %{
	"href" => other_user.ap_id,
	"name" => "@#{other_user.nickname}",
	"type" => "Mention"
	}

	expected_tag = %{
	"href" => Pleroma.Web.Endpoint.url() <> "/tags/2hu",
	"type" => "Hashtag",
	"name" => "#2hu"
	}

	assert Enum.member?(object["tag"], expected_tag)
	assert Enum.member?(object["tag"], expected_mention)
	end

	test "it adds the sensitive property" do
	user = insert(:user)

	{:ok, activity} = CommonAPI.post(user, %{"status" => "#nsfw hey"})
	{:ok, modified} = Transmogrifier.prepare_outgoing(activity.data)

	assert modified["object"]["sensitive"]
	end

	test "it adds the json-ld context and the conversation property" do
	user = insert(:user)

	{:ok, activity} = CommonAPI.post(user, %{"status" => "hey"})
	{:ok, modified} = Transmogrifier.prepare_outgoing(activity.data)

	assert modified["@context"] == Utils.make_json_ld_header()["@context"]

	assert modified["object"]["conversation"] == modified["context"]
	end

	test "it sets the 'attributedTo' property to the actor of the object if it doesn't have one" do
	user = insert(:user)

	{:ok, activity} = CommonAPI.post(user, %{"status" => "hey"})
	{:ok, modified} = Transmogrifier.prepare_outgoing(activity.data)

	assert modified["object"]["actor"] == modified["object"]["attributedTo"]
	end

	test "it strips internal hashtag data" do
	user = insert(:user)

	{:ok, activity} = CommonAPI.post(user, %{"status" => "#2hu"})

	expected_tag = %{
	"href" => Pleroma.Web.Endpoint.url() <> "/tags/2hu",
	"type" => "Hashtag",
	"name" => "#2hu"
	}

	{:ok, modified} = Transmogrifier.prepare_outgoing(activity.data)

	assert modified["object"]["tag"] == [expected_tag]
	end

	test "it strips internal fields" do
	user = insert(:user)

	{:ok, activity} = CommonAPI.post(user, %{"status" => "#2hu :firefox:"})

	{:ok, modified} = Transmogrifier.prepare_outgoing(activity.data)

	assert length(modified["object"]["tag"]) == 2

	assert is_nil(modified["object"]["emoji"])
	assert is_nil(modified["object"]["like_count"])
	assert is_nil(modified["object"]["announcements"])
	assert is_nil(modified["object"]["announcement_count"])
	assert is_nil(modified["object"]["context_id"])
	end

	test "it strips internal fields of article" do
	activity = insert(:article_activity)

	{:ok, modified} = Transmogrifier.prepare_outgoing(activity.data)

	assert length(modified["object"]["tag"]) == 2

	assert is_nil(modified["object"]["emoji"])
	assert is_nil(modified["object"]["like_count"])
	assert is_nil(modified["object"]["announcements"])
	assert is_nil(modified["object"]["announcement_count"])
	assert is_nil(modified["object"]["context_id"])
	assert is_nil(modified["object"]["likes"])
	end

	test "the directMessage flag is present" do
	user = insert(:user)
	other_user = insert(:user)

	{:ok, activity} = CommonAPI.post(user, %{"status" => "2hu :moominmamma:"})

	{:ok, modified} = Transmogrifier.prepare_outgoing(activity.data)

	assert modified["directMessage"] == false

	{:ok, activity} =
	CommonAPI.post(user, %{"status" => "@#{other_user.nickname} :moominmamma:"})

	{:ok, modified} = Transmogrifier.prepare_outgoing(activity.data)

	assert modified["directMessage"] == false

	{:ok, activity} =
	CommonAPI.post(user, %{
	"status" => "@#{other_user.nickname} :moominmamma:",
	"visibility" => "direct"
	})

	{:ok, modified} = Transmogrifier.prepare_outgoing(activity.data)

	assert modified["directMessage"] == true
	end

	test "it strips BCC field" do
	user = insert(:user)
	{:ok, list} = Pleroma.List.create("foo", user)

	{:ok, activity} =
	CommonAPI.post(user, %{"status" => "foobar", "visibility" => "list:#{list.id}"})

	{:ok, modified} = Transmogrifier.prepare_outgoing(activity.data)

	assert is_nil(modified["bcc"])
	end

	test "it can handle Listen activities" do
	listen_activity = insert(:listen)

	{:ok, modified} = Transmogrifier.prepare_outgoing(listen_activity.data)

	assert modified["type"] == "Listen"

	user = insert(:user)

	{:ok, activity} = CommonAPI.listen(user, %{"title" => "lain radio episode 1"})

	{:ok, _modified} = Transmogrifier.prepare_outgoing(activity.data)
	end
	end

	describe "user upgrade" do
	test "it upgrades a user to activitypub" do
	user =
	insert(:user, %{
	nickname: "rye@niu.moe",
	local: false,
	ap_id: "https://niu.moe/users/rye",
	follower_address: User.ap_followers(%User{nickname: "rye@niu.moe"})
	})

	user_two = insert(:user)
	Pleroma.FollowingRelationship.follow(user_two, user, "accept")

	{:ok, activity} = CommonAPI.post(user, %{"status" => "test"})
	{:ok, unrelated_activity} = CommonAPI.post(user_two, %{"status" => "test"})
	assert "http://localhost:4001/users/rye@niu.moe/followers" in activity.recipients

	user = User.get_cached_by_id(user.id)
	assert user.note_count == 1

	{:ok, user} = Transmogrifier.upgrade_user_from_ap_id("https://niu.moe/users/rye")
	ObanHelpers.perform_all()

	assert user.ap_enabled
	assert user.note_count == 1
	assert user.follower_address == "https://niu.moe/users/rye/followers"
	assert user.following_address == "https://niu.moe/users/rye/following"

	user = User.get_cached_by_id(user.id)
	assert user.note_count == 1

	activity = Activity.get_by_id(activity.id)
	assert user.follower_address in activity.recipients

	assert %{
	"url" => [
	%{
	"href" =>
	"https://cdn.niu.moe/accounts/avatars/000/033/323/original/fd7f8ae0b3ffedc9.jpeg"
	}
	]
	} = user.avatar

	assert %{
	"url" => [
	%{
	"href" =>
	"https://cdn.niu.moe/accounts/headers/000/033/323/original/850b3448fa5fd477.png"
	}
	]
	} = user.banner

	refute "..." in activity.recipients

	unrelated_activity = Activity.get_by_id(unrelated_activity.id)
	refute user.follower_address in unrelated_activity.recipients

	user_two = User.get_cached_by_id(user_two.id)
	assert User.following?(user_two, user)
	refute "..." in User.following(user_two)
	end
	end

	describe "actor rewriting" do
	test "it fixes the actor URL property to be a proper URI" do
	data = %{
	"url" => %{"href" => "http://example.com"}
	}

	rewritten = Transmogrifier.maybe_fix_user_object(data)
	assert rewritten["url"] == "http://example.com"
	end
	end

	describe "actor origin containment" do
	test "it rejects activities which reference objects with bogus origins" do
	data = %{
	"@context" => "https://www.w3.org/ns/activitystreams",
	"id" => "http://mastodon.example.org/users/admin/activities/1234",
	"actor" => "http://mastodon.example.org/users/admin",
	"to" => ["https://www.w3.org/ns/activitystreams#Public"],
	"object" => "https://info.pleroma.site/activity.json",
	"type" => "Announce"
	}

	assert capture_log(fn ->
	:error = Transmogrifier.handle_incoming(data)
	end) =~ "Object containment failed"
	end

	test "it rejects activities which reference objects that have an incorrect attribution (variant 1)" do
	data = %{
	"@context" => "https://www.w3.org/ns/activitystreams",
	"id" => "http://mastodon.example.org/users/admin/activities/1234",
	"actor" => "http://mastodon.example.org/users/admin",
	"to" => ["https://www.w3.org/ns/activitystreams#Public"],
	"object" => "https://info.pleroma.site/activity2.json",
	"type" => "Announce"
	}

	assert capture_log(fn ->
	:error = Transmogrifier.handle_incoming(data)
	end) =~ "Object containment failed"
	end

	test "it rejects activities which reference objects that have an incorrect attribution (variant 2)" do
	data = %{
	"@context" => "https://www.w3.org/ns/activitystreams",
	"id" => "http://mastodon.example.org/users/admin/activities/1234",
	"actor" => "http://mastodon.example.org/users/admin",
	"to" => ["https://www.w3.org/ns/activitystreams#Public"],
	"object" => "https://info.pleroma.site/activity3.json",
	"type" => "Announce"
	}

	assert capture_log(fn ->
	:error = Transmogrifier.handle_incoming(data)
	end) =~ "Object containment failed"
	end
	end

	describe "reserialization" do
	test "successfully reserializes a message with inReplyTo == nil" do
	user = insert(:user)

	message = %{
	"@context" => "https://www.w3.org/ns/activitystreams",
	"to" => ["https://www.w3.org/ns/activitystreams#Public"],
	"cc" => [],
	"type" => "Create",
	"object" => %{
	"to" => ["https://www.w3.org/ns/activitystreams#Public"],
	"cc" => [],
	"type" => "Note",
	"content" => "Hi",
	"inReplyTo" => nil,
	"attributedTo" => user.ap_id
	},
	"actor" => user.ap_id
	}

	{:ok, activity} = Transmogrifier.handle_incoming(message)

	{:ok, _} = Transmogrifier.prepare_outgoing(activity.data)
	end

	test "successfully reserializes a message with AS2 objects in IR" do
	user = insert(:user)

	message = %{
	"@context" => "https://www.w3.org/ns/activitystreams",
	"to" => ["https://www.w3.org/ns/activitystreams#Public"],
	"cc" => [],
	"type" => "Create",
	"object" => %{
	"to" => ["https://www.w3.org/ns/activitystreams#Public"],
	"cc" => [],
	"type" => "Note",
	"content" => "Hi",
	"inReplyTo" => nil,
	"attributedTo" => user.ap_id,
	"tag" => [
	%{"name" => "#2hu", "href" => "http://example.com/2hu", "type" => "Hashtag"},
	%{"name" => "Bob", "href" => "http://example.com/bob", "type" => "Mention"}
	]
	},
	"actor" => user.ap_id
	}

	{:ok, activity} = Transmogrifier.handle_incoming(message)

	{:ok, _} = Transmogrifier.prepare_outgoing(activity.data)
	end
	end

	test "Rewrites Answers to Notes" do
	user = insert(:user)

	{:ok, poll_activity} =
	CommonAPI.post(user, %{
	"status" => "suya...",
	"poll" => %{"options" => ["suya", "suya.", "suya.."], "expires_in" => 10}
	})

	poll_object = Object.normalize(poll_activity)
	# TODO: Replace with CommonAPI vote creation when implemented
	data =
	File.read!("test/fixtures/mastodon-vote.json")
	\|> Poison.decode!()
	\|> Kernel.put_in(["to"], user.ap_id)
	\|> Kernel.put_in(["object", "inReplyTo"], poll_object.data["id"])
	\|> Kernel.put_in(["object", "to"], user.ap_id)

	{:ok, %Activity{local: false} = activity} = Transmogrifier.handle_incoming(data)
	{:ok, data} = Transmogrifier.prepare_outgoing(activity.data)

	assert data["object"]["type"] == "Note"
	end

	describe "fix_explicit_addressing" do
	setup do
	user = insert(:user)
	[user: user]
	end

	test "moves non-explicitly mentioned actors to cc", %{user: user} do
	explicitly_mentioned_actors = [
	"https://pleroma.gold/users/user1",
	"https://pleroma.gold/user2"
	]

	object = %{
	"actor" => user.ap_id,
	"to" => explicitly_mentioned_actors ++ ["https://social.beepboop.ga/users/dirb"],
	"cc" => [],
	"tag" =>
	Enum.map(explicitly_mentioned_actors, fn href ->
	%{"type" => "Mention", "href" => href}
	end)
	}

	fixed_object = Transmogrifier.fix_explicit_addressing(object)
	assert Enum.all?(explicitly_mentioned_actors, &(&1 in fixed_object["to"]))
	refute "https://social.beepboop.ga/users/dirb" in fixed_object["to"]
	assert "https://social.beepboop.ga/users/dirb" in fixed_object["cc"]
	end

	test "does not move actor's follower collection to cc", %{user: user} do
	object = %{
	"actor" => user.ap_id,
	"to" => [user.follower_address],
	"cc" => []
	}

	fixed_object = Transmogrifier.fix_explicit_addressing(object)
	assert user.follower_address in fixed_object["to"]
	refute user.follower_address in fixed_object["cc"]
	end

	test "removes recipient's follower collection from cc", %{user: user} do
	recipient = insert(:user)

	object = %{
	"actor" => user.ap_id,
	"to" => [recipient.ap_id, "https://www.w3.org/ns/activitystreams#Public"],
	"cc" => [user.follower_address, recipient.follower_address]
	}

	fixed_object = Transmogrifier.fix_explicit_addressing(object)

	assert user.follower_address in fixed_object["cc"]
	refute recipient.follower_address in fixed_object["cc"]
	refute recipient.follower_address in fixed_object["to"]
	end
	end

	describe "fix_summary/1" do
	test "returns fixed object" do
	assert Transmogrifier.fix_summary(%{"summary" => nil}) == %{"summary" => ""}
	assert Transmogrifier.fix_summary(%{"summary" => "ok"}) == %{"summary" => "ok"}
	assert Transmogrifier.fix_summary(%{}) == %{"summary" => ""}
	end
	end

	describe "fix_in_reply_to/2" do
	clear_config([:instance, :federation_incoming_replies_max_depth])

	setup do
	data = Poison.decode!(File.read!("test/fixtures/mastodon-post-activity.json"))
	[data: data]
	end

	test "returns not modified object when hasn't containts inReplyTo field", %{data: data} do
	assert Transmogrifier.fix_in_reply_to(data) == data
	end

	test "returns object with inReplyToAtomUri when denied incoming reply", %{data: data} do
	Pleroma.Config.put([:instance, :federation_incoming_replies_max_depth], 0)

	object_with_reply =
	Map.put(data["object"], "inReplyTo", "https://shitposter.club/notice/2827873")

	modified_object = Transmogrifier.fix_in_reply_to(object_with_reply)
	assert modified_object["inReplyTo"] == "https://shitposter.club/notice/2827873"
	assert modified_object["inReplyToAtomUri"] == "https://shitposter.club/notice/2827873"

	object_with_reply =
	Map.put(data["object"], "inReplyTo", %{"id" => "https://shitposter.club/notice/2827873"})

	modified_object = Transmogrifier.fix_in_reply_to(object_with_reply)
	assert modified_object["inReplyTo"] == %{"id" => "https://shitposter.club/notice/2827873"}
	assert modified_object["inReplyToAtomUri"] == "https://shitposter.club/notice/2827873"

	object_with_reply =
	Map.put(data["object"], "inReplyTo", ["https://shitposter.club/notice/2827873"])

	modified_object = Transmogrifier.fix_in_reply_to(object_with_reply)
	assert modified_object["inReplyTo"] == ["https://shitposter.club/notice/2827873"]
	assert modified_object["inReplyToAtomUri"] == "https://shitposter.club/notice/2827873"

	object_with_reply = Map.put(data["object"], "inReplyTo", [])
	modified_object = Transmogrifier.fix_in_reply_to(object_with_reply)
	assert modified_object["inReplyTo"] == []
	assert modified_object["inReplyToAtomUri"] == ""
	end

	@tag capture_log: true
	test "returns modified object when allowed incoming reply", %{data: data} do
	object_with_reply =
	Map.put(
	data["object"],
	"inReplyTo",
	"https://shitposter.club/notice/2827873"
	)

	Pleroma.Config.put([:instance, :federation_incoming_replies_max_depth], 5)
	modified_object = Transmogrifier.fix_in_reply_to(object_with_reply)

	assert modified_object["inReplyTo"] ==
	"tag:shitposter.club,2017-05-05:noticeId=2827873:objectType=comment"

	assert modified_object["inReplyToAtomUri"] == "https://shitposter.club/notice/2827873"

	assert modified_object["conversation"] ==
	"tag:shitposter.club,2017-05-05:objectType=thread:nonce=3c16e9c2681f6d26"

	assert modified_object["context"] ==
	"tag:shitposter.club,2017-05-05:objectType=thread:nonce=3c16e9c2681f6d26"
	end
	end

	describe "fix_url/1" do
	test "fixes data for object when url is map" do
	object = %{
	"url" => %{
	"type" => "Link",
	"mimeType" => "video/mp4",
	"href" => "https://peede8d-46fb-ad81-2d4c2d1630e3-480.mp4"
	}
	}

	assert Transmogrifier.fix_url(object) == %{
	"url" => "https://peede8d-46fb-ad81-2d4c2d1630e3-480.mp4"
	}
	end

	test "fixes data for video object" do
	object = %{
	"type" => "Video",
	"url" => [
	%{
	"type" => "Link",
	"mimeType" => "video/mp4",
	"href" => "https://peede8d-46fb-ad81-2d4c2d1630e3-480.mp4"
	},
	%{
	"type" => "Link",
	"mimeType" => "video/mp4",
	"href" => "https://peertube46fb-ad81-2d4c2d1630e3-240.mp4"
	},
	%{
	"type" => "Link",
	"mimeType" => "text/html",
	"href" => "https://peertube.-2d4c2d1630e3"
	},
	%{
	"type" => "Link",
	"mimeType" => "text/html",
	"href" => "https://peertube.-2d4c2d16377-42"
	}
	]
	}

	assert Transmogrifier.fix_url(object) == %{
	"attachment" => [
	%{
	"href" => "https://peede8d-46fb-ad81-2d4c2d1630e3-480.mp4",
	"mimeType" => "video/mp4",
	"type" => "Link"
	}
	],
	"type" => "Video",
	"url" => "https://peertube.-2d4c2d1630e3"
	}
	end

	test "fixes url for not Video object" do
	object = %{
	"type" => "Text",
	"url" => [
	%{
	"type" => "Link",
	"mimeType" => "text/html",
	"href" => "https://peertube.-2d4c2d1630e3"
	},
	%{
	"type" => "Link",
	"mimeType" => "text/html",
	"href" => "https://peertube.-2d4c2d16377-42"
	}
	]
	}

	assert Transmogrifier.fix_url(object) == %{
	"type" => "Text",
	"url" => "https://peertube.-2d4c2d1630e3"
	}

	assert Transmogrifier.fix_url(%{"type" => "Text", "url" => []}) == %{
	"type" => "Text",
	"url" => ""
	}
	end

	test "retunrs not modified object" do
	assert Transmogrifier.fix_url(%{"type" => "Text"}) == %{"type" => "Text"}
	end
	end

	describe "get_obj_helper/2" do
	test "returns nil when cannot normalize object" do
	assert capture_log(fn ->
	refute Transmogrifier.get_obj_helper("test-obj-id")
	end) =~ "Unsupported URI scheme"
	end

	@tag capture_log: true
	test "returns {:ok, %Object{}} for success case" do
	assert {:ok, %Object{}} =
	Transmogrifier.get_obj_helper("https://shitposter.club/notice/2827873")
	end
	end

	describe "fix_attachments/1" do
	test "returns not modified object" do
	data = Poison.decode!(File.read!("test/fixtures/mastodon-post-activity.json"))
	assert Transmogrifier.fix_attachments(data) == data
	end

	test "returns modified object when attachment is map" do
	assert Transmogrifier.fix_attachments(%{
	"attachment" => %{
	"mediaType" => "video/mp4",
	"url" => "https://peertube.moe/stat-480.mp4"
	}
	}) == %{
	"attachment" => [
	%{
	"mediaType" => "video/mp4",
	"url" => [
	%{
	"href" => "https://peertube.moe/stat-480.mp4",
	"mediaType" => "video/mp4",
	"type" => "Link"
	}
	]
	}
	]
	}
	end

	test "returns modified object when attachment is list" do
	assert Transmogrifier.fix_attachments(%{
	"attachment" => [
	%{"mediaType" => "video/mp4", "url" => "https://pe.er/stat-480.mp4"},
	%{"mimeType" => "video/mp4", "href" => "https://pe.er/stat-480.mp4"}
	]
	}) == %{
	"attachment" => [
	%{
	"mediaType" => "video/mp4",
	"url" => [
	%{
	"href" => "https://pe.er/stat-480.mp4",
	"mediaType" => "video/mp4",
	"type" => "Link"
	}
	]
	},
	%{
	"href" => "https://pe.er/stat-480.mp4",
	"mediaType" => "video/mp4",
	"mimeType" => "video/mp4",
	"url" => [
	%{
	"href" => "https://pe.er/stat-480.mp4",
	"mediaType" => "video/mp4",
	"type" => "Link"
	}
	]
	}
	]
	}
	end
	end

	describe "fix_emoji/1" do
	test "returns not modified object when object not contains tags" do
	data = Poison.decode!(File.read!("test/fixtures/mastodon-post-activity.json"))
	assert Transmogrifier.fix_emoji(data) == data
	end

	test "returns object with emoji when object contains list tags" do
	assert Transmogrifier.fix_emoji(%{
	"tag" => [
	%{"type" => "Emoji", "name" => ":bib:", "icon" => %{"url" => "/test"}},
	%{"type" => "Hashtag"}
	]
	}) == %{
	"emoji" => %{"bib" => "/test"},
	"tag" => [
	%{"icon" => %{"url" => "/test"}, "name" => ":bib:", "type" => "Emoji"},
	%{"type" => "Hashtag"}
	]
	}
	end

	test "returns object with emoji when object contains map tag" do
	assert Transmogrifier.fix_emoji(%{
	"tag" => %{"type" => "Emoji", "name" => ":bib:", "icon" => %{"url" => "/test"}}
	}) == %{
	"emoji" => %{"bib" => "/test"},
	"tag" => %{"icon" => %{"url" => "/test"}, "name" => ":bib:", "type" => "Emoji"}
	}
	end
	end
	+
	+ describe "set_replies/1" do
	+ clear_config([:activitypub, :note_replies_output_limit]) do
	+ Pleroma.Config.put([:activitypub, :note_replies_output_limit], 2)
	+ end
	+
	+ test "returns unmodified object if activity doesn't have self-replies" do
	+ data = Poison.decode!(File.read!("test/fixtures/mastodon-post-activity.json"))
	+ assert Transmogrifier.set_replies(data) == data
	+ end
	+
	+ test "sets `replies` collection with a limited number of self-replies" do
	+ [user, another_user] = insert_list(2, :user)
	+
	+ {:ok, %{id: id1} = activity} = CommonAPI.post(user, %{"status" => "1"})
	+
	+ {:ok, %{id: id2} = self_reply1} =
	+ CommonAPI.post(user, %{"status" => "self-reply 1", "in_reply_to_status_id" => id1})
	+
	+ {:ok, self_reply2} =
	+ CommonAPI.post(user, %{"status" => "self-reply 2", "in_reply_to_status_id" => id1})
	+
	+ # Assuming to _not_ be present in `replies` due to :note_replies_output_limit is set to 2
	+ {:ok, _} =
	+ CommonAPI.post(user, %{"status" => "self-reply 3", "in_reply_to_status_id" => id1})
	+
	+ {:ok, _} =
	+ CommonAPI.post(user, %{
	+ "status" => "self-reply to self-reply",
	+ "in_reply_to_status_id" => id2
	+ })
	+
	+ {:ok, _} =
	+ CommonAPI.post(another_user, %{
	+ "status" => "another user's reply",
	+ "in_reply_to_status_id" => id1
	+ })
	+
	+ object = Object.normalize(activity)
	+ replies_uris = Enum.map([self_reply1, self_reply2], fn a -> a.object.data["id"] end)
	+
	+ assert %{"type" => "Collection", "items" => ^replies_uris} =
	+ Transmogrifier.set_replies(object.data)["replies"]
	+ end
	+ end
	end
	diff --git a/test/federation/activity_pub/views/object_view_test.exs b/test/federation/activity_pub/views/object_view_test.exs
	index dc90638a6..9d62151e6 100644
	--- a/test/federation/activity_pub/views/object_view_test.exs
	+++ b/test/federation/activity_pub/views/object_view_test.exs
	@@ -1,66 +1,86 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2019 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Federation.ActivityPub.ObjectViewTest do
	use Pleroma.DataCase
	import Pleroma.Factory

	alias Pleroma.Object
	alias Pleroma.Federation.ActivityPub.ObjectView
	alias Pleroma.Web.CommonAPI

	test "renders a note object" do
	note = insert(:note)

	result = ObjectView.render("object.json", %{object: note})

	assert result["id"] == note.data["id"]
	assert result["to"] == note.data["to"]
	assert result["content"] == note.data["content"]
	assert result["type"] == "Note"
	assert result["@context"]
	end

	test "renders a note activity" do
	note = insert(:note_activity)
	object = Object.normalize(note)

	result = ObjectView.render("object.json", %{object: note})

	assert result["id"] == note.data["id"]
	assert result["to"] == note.data["to"]
	assert result["object"]["type"] == "Note"
	assert result["object"]["content"] == object.data["content"]
	assert result["type"] == "Create"
	assert result["@context"]
	end

	+ describe "note activity's `replies` collection rendering" do
	+ clear_config([:activitypub, :note_replies_output_limit]) do
	+ Pleroma.Config.put([:activitypub, :note_replies_output_limit], 5)
	+ end
	+
	+ test "renders `replies` collection for a note activity" do
	+ user = insert(:user)
	+ activity = insert(:note_activity, user: user)
	+
	+ {:ok, self_reply1} =
	+ CommonAPI.post(user, %{"status" => "self-reply 1", "in_reply_to_status_id" => activity.id})
	+
	+ replies_uris = [self_reply1.object.data["id"]]
	+ result = ObjectView.render("object.json", %{object: refresh_record(activity)})
	+
	+ assert %{"type" => "Collection", "items" => ^replies_uris} =
	+ get_in(result, ["object", "replies"])
	+ end
	+ end
	+
	test "renders a like activity" do
	note = insert(:note_activity)
	object = Object.normalize(note)
	user = insert(:user)

	{:ok, like_activity, _} = CommonAPI.favorite(note.id, user)

	result = ObjectView.render("object.json", %{object: like_activity})

	assert result["id"] == like_activity.data["id"]
	assert result["object"] == object.data["id"]
	assert result["type"] == "Like"
	end

	test "renders an announce activity" do
	note = insert(:note_activity)
	object = Object.normalize(note)
	user = insert(:user)

	{:ok, announce_activity, _} = CommonAPI.repeat(note.id, user)

	result = ObjectView.render("object.json", %{object: announce_activity})

	assert result["id"] == announce_activity.data["id"]
	assert result["object"] == object.data["id"]
	assert result["type"] == "Announce"
	end
	end
	diff --git a/test/fixtures/mastodon-post-activity.json b/test/fixtures/mastodon-post-activity.json
	index b91263431..5c3d22722 100644
	--- a/test/fixtures/mastodon-post-activity.json
	+++ b/test/fixtures/mastodon-post-activity.json
	@@ -1,64 +1,77 @@
	{
	"@context": [
	"https://www.w3.org/ns/activitystreams",
	"https://w3id.org/security/v1",
	{
	"Emoji": "toot:Emoji",
	"Hashtag": "as:Hashtag",
	"atomUri": "ostatus:atomUri",
	"conversation": "ostatus:conversation",
	"inReplyToAtomUri": "ostatus:inReplyToAtomUri",
	"manuallyApprovesFollowers": "as:manuallyApprovesFollowers",
	"movedTo": "as:movedTo",
	"ostatus": "http://ostatus.org#",
	"sensitive": "as:sensitive",
	"toot": "http://joinmastodon.org/ns#"
	}
	],
	"actor": "http://mastodon.example.org/users/admin",
	"cc": [
	"http://mastodon.example.org/users/admin/followers",
	"http://localtesting.pleroma.lol/users/lain"
	],
	"id": "http://mastodon.example.org/users/admin/statuses/99512778738411822/activity",
	"object": {
	"atomUri": "http://mastodon.example.org/users/admin/statuses/99512778738411822",
	"attachment": [],
	"attributedTo": "http://mastodon.example.org/users/admin",
	"cc": [
	"http://mastodon.example.org/users/admin/followers",
	"http://localtesting.pleroma.lol/users/lain"
	],
	"content": "<p><span class=\"h-card\"><a href=\"http://localtesting.pleroma.lol/users/lain\" class=\"u-url mention\">@<span>lain</span></a></span></p>",
	"conversation": "tag:mastodon.example.org,2018-02-12:objectId=20:objectType=Conversation",
	"id": "http://mastodon.example.org/users/admin/statuses/99512778738411822",
	"inReplyTo": null,
	"inReplyToAtomUri": null,
	"published": "2018-02-12T14:08:20Z",
	+ "replies": {
	+ "id": "http://mastodon.example.org/users/admin/statuses/99512778738411822/replies",
	+ "type": "Collection",
	+ "first": {
	+ "type": "CollectionPage",
	+ "next": "http://mastodon.example.org/users/admin/statuses/99512778738411822/replies?min_id=99512778738411824&page=true",
	+ "partOf": "http://mastodon.example.org/users/admin/statuses/99512778738411822/replies",
	+ "items": [
	+ "http://mastodon.example.org/users/admin/statuses/99512778738411823",
	+ "http://mastodon.example.org/users/admin/statuses/99512778738411824"
	+ ]
	+ }
	+ },
	"sensitive": true,
	"summary": "cw",
	"tag": [
	{
	"href": "http://localtesting.pleroma.lol/users/lain",
	"name": "@lain@localtesting.pleroma.lol",
	"type": "Mention"
	}
	],
	"to": [
	"https://www.w3.org/ns/activitystreams#Public"
	],
	"type": "Note",
	"url": "http://mastodon.example.org/@admin/99512778738411822"
	},
	"published": "2018-02-12T14:08:20Z",
	"signature": {
	"created": "2018-02-12T14:08:20Z",
	"creator": "http://mastodon.example.org/users/admin#main-key",
	"signatureValue": "rnNfcopkc6+Ju73P806popcfwrK9wGYHaJVG1/ZvrlEbWVDzaHjkXqj9Q3/xju5l8CSn9tvSgCCtPFqZsFQwn/pFIFUcw7ZWB2xi4bDm3NZ3S4XQ8JRaaX7og5hFxAhWkGhJhAkfxVnOg2hG+w2d/7d7vRVSC1vo5ip4erUaA/PkWusZvPIpxnRWoXaxJsFmVx0gJgjpJkYDyjaXUlp+jmaoseeZ4EPQUWqHLKJ59PRG0mg8j2xAjYH9nQaN14qMRmTGPxY8gfv/CUFcatA+8VJU9KEsJkDAwLVvglydNTLGrxpAJU78a2eaht0foV43XUIZGe3DKiJPgE+UOKGCJw==",
	"type": "RsaSignature2017"
	},
	"to": [
	"https://www.w3.org/ns/activitystreams#Public"
	],
	"type": "Create"
	}
	diff --git a/test/mix/tasks/instance_test.exs b/test/mix/tasks/instance_test.exs
	index d69275726..975478e29 100644
	--- a/test/mix/tasks/instance_test.exs
	+++ b/test/mix/tasks/instance_test.exs
	@@ -1,89 +1,92 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2019 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.InstanceTest do
	- use ExUnit.Case, async: true
	+ use ExUnit.Case

	setup do
	+ _static_dir = Pleroma.Config.get([:instance, :static_dir])
	File.mkdir_p!(tmp_path())

	on_exit(fn ->
	File.rm_rf(tmp_path())
	static_dir = Pleroma.Config.get([:instance, :static_dir], "test/instance_static/")

	if File.exists?(static_dir) do
	File.rm_rf(Path.join(static_dir, "robots.txt"))
	end
	+
	+ Pleroma.Config.put([:instance, :static_dir], static_dir)
	end)

	:ok
	end

	defp tmp_path do
	"/tmp/generated_files/"
	end

	test "running gen" do
	mix_task = fn ->
	Mix.Tasks.Pleroma.Instance.run([
	"gen",
	"--output",
	tmp_path() <> "generated_config.exs",
	"--output-psql",
	tmp_path() <> "setup.psql",
	"--domain",
	"test.pleroma.social",
	"--instance-name",
	"Pleroma",
	"--admin-email",
	"admin@example.com",
	"--notify-email",
	"notify@example.com",
	"--dbhost",
	"dbhost",
	"--dbname",
	"dbname",
	"--dbuser",
	"dbuser",
	"--dbpass",
	"dbpass",
	"--indexable",
	"y",
	"--db-configurable",
	"y",
	"--rum",
	"y",
	"--listen-port",
	"4000",
	"--listen-ip",
	"127.0.0.1",
	"--uploads-dir",
	"test/uploads",
	"--static-dir",
	"instance/static/"
	])
	end

	ExUnit.CaptureIO.capture_io(fn ->
	mix_task.()
	end)

	generated_config = File.read!(tmp_path() <> "generated_config.exs")
	assert generated_config =~ "host: \"test.pleroma.social\""
	assert generated_config =~ "name: \"Pleroma\""
	assert generated_config =~ "email: \"admin@example.com\""
	assert generated_config =~ "notify_email: \"notify@example.com\""
	assert generated_config =~ "hostname: \"dbhost\""
	assert generated_config =~ "database: \"dbname\""
	assert generated_config =~ "username: \"dbuser\""
	assert generated_config =~ "password: \"dbpass\""
	assert generated_config =~ "configurable_from_database: true"
	assert generated_config =~ "http: [ip: {127, 0, 0, 1}, port: 4000]"
	assert File.read!(tmp_path() <> "setup.psql") == generated_setup_psql()
	end

	defp generated_setup_psql do
	~s(CREATE USER dbuser WITH ENCRYPTED PASSWORD 'dbpass';\nCREATE DATABASE dbname OWNER dbuser;\n\\c dbname;\n--Extensions made by ecto.migrate that need superuser access\nCREATE EXTENSION IF NOT EXISTS citext;\nCREATE EXTENSION IF NOT EXISTS pg_trgm;\nCREATE EXTENSION IF NOT EXISTS \"uuid-ossp\";\nCREATE EXTENSION IF NOT EXISTS rum;\n)
	end
	end
	diff --git a/test/pleroma/captcha/captcha_test.exs b/test/pleroma/captcha/captcha_test.exs
	index 393c8219e..5e29b48b0 100644
	--- a/test/pleroma/captcha/captcha_test.exs
	+++ b/test/pleroma/captcha/captcha_test.exs
	@@ -1,64 +1,116 @@
	# Pleroma: A lightweight social networking server
	-# Copyright © 2017-2019 Pleroma Authors <https://pleroma.social/>
	+# Copyright © 2017-2020 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.CaptchaTest do
	- use ExUnit.Case
	+ use Pleroma.DataCase

	import Tesla.Mock

	+ alias Pleroma.Captcha
	alias Pleroma.Captcha.Kocaptcha
	alias Pleroma.Captcha.Native

	@ets_options [:ordered_set, :private, :named_table, {:read_concurrency, true}]

	+ clear_config([Pleroma.Captcha, :enabled])
	+
	describe "Kocaptcha" do
	setup do
	ets_name = Kocaptcha.Ets
	^ets_name = :ets.new(ets_name, @ets_options)

	mock(fn
	%{method: :get, url: "https://captcha.kotobank.ch/new"} ->
	json(%{
	md5: "63615261b77f5354fb8c4e4986477555",
	token: "afa1815e14e29355e6c8f6b143a39fa2",
	url: "/captchas/afa1815e14e29355e6c8f6b143a39fa2.png"
	})
	end)

	:ok
	end

	test "new and validate" do
	new = Kocaptcha.new()
	- assert new[:type] == :kocaptcha
	- assert new[:token] == "afa1815e14e29355e6c8f6b143a39fa2"

	- assert new[:url] ==
	- "https://captcha.kotobank.ch/captchas/afa1815e14e29355e6c8f6b143a39fa2.png"
	+ token = "afa1815e14e29355e6c8f6b143a39fa2"
	+ url = "https://captcha.kotobank.ch/captchas/afa1815e14e29355e6c8f6b143a39fa2.png"
	+
	+ assert %{
	+ answer_data: answer,
	+ token: ^token,
	+ url: ^url,
	+ type: :kocaptcha
	+ } = new

	- assert Kocaptcha.validate(
	- new[:token],
	- "7oEy8c",
	- new[:answer_data]
	- ) == :ok
	+ assert Kocaptcha.validate(token, "7oEy8c", answer) == :ok
	end
	end

	describe "Native" do
	test "new and validate" do
	new = Native.new()

	assert %{
	answer_data: answer,
	token: token,
	type: :native,
	url: "data:image/png;base64," <> _
	} = new

	assert is_binary(answer)
	assert :ok = Native.validate(token, answer, answer)
	assert {:error, "Invalid CAPTCHA"} == Native.validate(token, answer, answer <> "foobar")
	end
	end
	+
	+ describe "Captcha Wrapper" do
	+ test "validate" do
	+ Pleroma.Config.put([Pleroma.Captcha, :enabled], true)
	+
	+ new = Captcha.new()
	+
	+ assert %{
	+ answer_data: answer,
	+ token: token
	+ } = new
	+
	+ assert is_binary(answer)
	+ assert :ok = Captcha.validate(token, "63615261b77f5354fb8c4e4986477555", answer)
	+ end
	+
	+ test "doesn't validate invalid answer" do
	+ Pleroma.Config.put([Pleroma.Captcha, :enabled], true)
	+
	+ new = Captcha.new()
	+
	+ assert %{
	+ answer_data: answer,
	+ token: token
	+ } = new
	+
	+ assert is_binary(answer)
	+
	+ assert {:error, "Invalid answer data"} =
	+ Captcha.validate(token, "63615261b77f5354fb8c4e4986477555", answer <> "foobar")
	+ end
	+
	+ test "nil answer_data" do
	+ Pleroma.Config.put([Pleroma.Captcha, :enabled], true)
	+
	+ new = Captcha.new()
	+
	+ assert %{
	+ answer_data: answer,
	+ token: token
	+ } = new
	+
	+ assert is_binary(answer)
	+
	+ assert {:error, "Invalid answer data"} =
	+ Captcha.validate(token, "63615261b77f5354fb8c4e4986477555", nil)
	+ end
	+ end
	end
	diff --git a/test/pleroma/healthcheck/stats_test.exs b/test/pleroma/healthcheck/stats_test.exs
	new file mode 100644
	index 000000000..2e27dd246
	--- /dev/null
	+++ b/test/pleroma/healthcheck/stats_test.exs
	@@ -0,0 +1,71 @@
	+# Pleroma: A lightweight social networking server
	+# Copyright © 2017-2019 Pleroma Authors <https://pleroma.social/>
	+# SPDX-License-Identifier: AGPL-3.0-only
	+
	+defmodule Pleroma.Healthcheck.StatsTest do
	+ use Pleroma.DataCase
	+ import Pleroma.Factory
	+ alias Pleroma.Healthcheck.Stats
	+ alias Pleroma.Web.CommonAPI
	+
	+ describe "status visibility count" do
	+ test "on new status" do
	+ user = insert(:user)
	+ other_user = insert(:user)
	+
	+ CommonAPI.post(user, %{"visibility" => "public", "status" => "hey"})
	+
	+ Enum.each(0..1, fn _ ->
	+ CommonAPI.post(user, %{
	+ "visibility" => "unlisted",
	+ "status" => "hey"
	+ })
	+ end)
	+
	+ Enum.each(0..2, fn _ ->
	+ CommonAPI.post(user, %{
	+ "visibility" => "direct",
	+ "status" => "hey @#{other_user.nickname}"
	+ })
	+ end)
	+
	+ Enum.each(0..3, fn _ ->
	+ CommonAPI.post(user, %{
	+ "visibility" => "private",
	+ "status" => "hey"
	+ })
	+ end)
	+
	+ assert %{direct: 3, private: 4, public: 1, unlisted: 2} =
	+ Stats.get_status_visibility_count()
	+ end
	+
	+ test "on status delete" do
	+ user = insert(:user)
	+ {:ok, activity} = CommonAPI.post(user, %{"visibility" => "public", "status" => "hey"})
	+ assert %{public: 1} = Stats.get_status_visibility_count()
	+ CommonAPI.delete(activity.id, user)
	+ assert %{public: 0} = Stats.get_status_visibility_count()
	+ end
	+
	+ test "on status visibility update" do
	+ user = insert(:user)
	+ {:ok, activity} = CommonAPI.post(user, %{"visibility" => "public", "status" => "hey"})
	+ assert %{public: 1, private: 0} = Stats.get_status_visibility_count()
	+ {:ok, _} = CommonAPI.update_activity_scope(activity.id, %{"visibility" => "private"})
	+ assert %{public: 0, private: 1} = Stats.get_status_visibility_count()
	+ end
	+
	+ test "doesn't count unrelated activities" do
	+ user = insert(:user)
	+ other_user = insert(:user)
	+ {:ok, activity} = CommonAPI.post(user, %{"visibility" => "public", "status" => "hey"})
	+ _ = CommonAPI.follow(user, other_user)
	+ CommonAPI.favorite(activity.id, other_user)
	+ CommonAPI.repeat(activity.id, other_user)
	+
	+ assert %{direct: 0, private: 0, public: 1, unlisted: 0} =
	+ Stats.get_status_visibility_count()
	+ end
	+ end
	+end
	diff --git a/test/pleroma/schemas/object/fetcher_test.exs b/test/pleroma/schemas/object/fetcher_test.exs
	index 0cdee3f37..235b753b1 100644
	--- a/test/pleroma/schemas/object/fetcher_test.exs
	+++ b/test/pleroma/schemas/object/fetcher_test.exs
	@@ -1,163 +1,188 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2019 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Object.FetcherTest do
	use Pleroma.DataCase

	alias Pleroma.Activity
	alias Pleroma.Federation.HTTPSignatures.Signature
	alias Pleroma.Object
	alias Pleroma.Object.Fetcher
	import Tesla.Mock
	import Mock

	setup do
	mock(fn
	%{method: :get, url: "https://mastodon.example.org/users/userisgone"} ->
	%Tesla.Env{status: 410}

	%{method: :get, url: "https://mastodon.example.org/users/userisgone404"} ->
	%Tesla.Env{status: 404}

	env ->
	apply(HttpRequestMock, :request, [env])
	end)

	:ok
	end

	+ describe "max thread distance restriction" do
	+ @ap_id "http://mastodon.example.org/@admin/99541947525187367"
	+
	+ clear_config([:instance, :federation_incoming_replies_max_depth])
	+
	+ test "it returns thread depth exceeded error if thread depth is exceeded" do
	+ Pleroma.Config.put([:instance, :federation_incoming_replies_max_depth], 0)
	+
	+ assert {:error, "Max thread distance exceeded."} =
	+ Fetcher.fetch_object_from_id(@ap_id, depth: 1)
	+ end
	+
	+ test "it fetches object if max thread depth is restricted to 0 and depth is not specified" do
	+ Pleroma.Config.put([:instance, :federation_incoming_replies_max_depth], 0)
	+
	+ assert {:ok, _} = Fetcher.fetch_object_from_id(@ap_id)
	+ end
	+
	+ test "it fetches object if requested depth does not exceed max thread depth" do
	+ Pleroma.Config.put([:instance, :federation_incoming_replies_max_depth], 10)
	+
	+ assert {:ok, _} = Fetcher.fetch_object_from_id(@ap_id, depth: 10)
	+ end
	+ end
	+
	describe "actor origin containment" do
	test "it rejects objects with a bogus origin" do
	{:error, _} = Fetcher.fetch_object_from_id("https://info.pleroma.site/activity.json")
	end

	test "it rejects objects when attributedTo is wrong (variant 1)" do
	{:error, _} = Fetcher.fetch_object_from_id("https://info.pleroma.site/activity2.json")
	end

	test "it rejects objects when attributedTo is wrong (variant 2)" do
	{:error, _} = Fetcher.fetch_object_from_id("https://info.pleroma.site/activity3.json")
	end
	end

	describe "fetching an object" do
	test "it fetches an object" do
	{:ok, object} =
	Fetcher.fetch_object_from_id("http://mastodon.example.org/@admin/99541947525187367")

	assert activity = Activity.get_create_by_object_ap_id(object.data["id"])
	assert activity.data["id"]

	{:ok, object_again} =
	Fetcher.fetch_object_from_id("http://mastodon.example.org/@admin/99541947525187367")

	assert [attachment] = object.data["attachment"]
	assert is_list(attachment["url"])

	assert object == object_again
	end
	end

	describe "implementation quirks" do
	test "it can fetch plume articles" do
	{:ok, object} =
	Fetcher.fetch_object_from_id(
	"https://baptiste.gelez.xyz/~/PlumeDevelopment/this-month-in-plume-june-2018/"
	)

	assert object
	end

	test "it can fetch peertube videos" do
	{:ok, object} =
	Fetcher.fetch_object_from_id(
	"https://peertube.moe/videos/watch/df5f464b-be8d-46fb-ad81-2d4c2d1630e3"
	)

	assert object
	end

	test "it can fetch Mobilizon events" do
	{:ok, object} =
	Fetcher.fetch_object_from_id(
	"https://mobilizon.org/events/252d5816-00a3-4a89-a66f-15bf65c33e39"
	)

	assert object
	end

	test "it can fetch wedistribute articles" do
	{:ok, object} =
	Fetcher.fetch_object_from_id("https://wedistribute.org/wp-json/pterotype/v1/object/85810")

	assert object
	end

	test "all objects with fake directions are rejected by the object fetcher" do
	assert {:error, _} =
	Fetcher.fetch_and_contain_remote_object_from_id(
	"https://info.pleroma.site/activity4.json"
	)
	end

	test "handle HTTP 410 Gone response" do
	assert {:error, "Object has been deleted"} ==
	Fetcher.fetch_and_contain_remote_object_from_id(
	"https://mastodon.example.org/users/userisgone"
	)
	end

	test "handle HTTP 404 response" do
	assert {:error, "Object has been deleted"} ==
	Fetcher.fetch_and_contain_remote_object_from_id(
	"https://mastodon.example.org/users/userisgone404"
	)
	end
	end

	describe "pruning" do
	test "it can refetch pruned objects" do
	object_id = "http://mastodon.example.org/@admin/99541947525187367"

	{:ok, object} = Fetcher.fetch_object_from_id(object_id)

	assert object

	{:ok, _object} = Object.prune(object)

	refute Object.get_by_ap_id(object_id)

	{:ok, %Object{} = object_two} = Fetcher.fetch_object_from_id(object_id)

	assert object.data["id"] == object_two.data["id"]
	assert object.id != object_two.id
	end
	end

	describe "signed fetches" do
	clear_config([:activitypub, :sign_object_fetches])

	test_with_mock "it signs fetches when configured to do so",
	Signature,
	[:passthrough],
	[] do
	Pleroma.Config.put([:activitypub, :sign_object_fetches], true)

	Fetcher.fetch_object_from_id("http://mastodon.example.org/@admin/99541947525187367")

	assert called(Signature.sign(:_, :_))
	end

	test_with_mock "it doesn't sign fetches when not configured to do so",
	Signature,
	[:passthrough],
	[] do
	Pleroma.Config.put([:activitypub, :sign_object_fetches], false)

	Fetcher.fetch_object_from_id("http://mastodon.example.org/@admin/99541947525187367")

	refute called(Signature.sign(:_, :_))
	end
	end
	end
	diff --git a/test/support/captcha_mock.ex b/test/support/captcha_mock.ex
	index 65ca6b3bd..6dae94edf 100644
	--- a/test/support/captcha_mock.ex
	+++ b/test/support/captcha_mock.ex
	@@ -1,14 +1,23 @@
	# Pleroma: A lightweight social networking server
	-# Copyright © 2017-2019 Pleroma Authors <https://pleroma.social/>
	+# Copyright © 2017-2020 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Captcha.Mock do
	alias Pleroma.Captcha.Service
	@behaviour Service

	@impl Service
	- def new, do: %{type: :mock}
	+ def new,
	+ do: %{
	+ type: :mock,
	+ token: "afa1815e14e29355e6c8f6b143a39fa2",
	+ answer_data: "63615261b77f5354fb8c4e4986477555",
	+ url: "https://example.org/captcha.png"
	+ }

	@impl Service
	- def validate(_token, _captcha, _data), do: :ok
	+ def validate(_token, captcha, captcha) when not is_nil(captcha), do: :ok
	+
	+ def validate(_token, captcha, answer),
	+ do: {:error, "Invalid CAPTCHA captcha: #{inspect(captcha)} ; answer: #{inspect(answer)}"}
	end
	diff --git a/test/support/oban_helpers.ex b/test/support/oban_helpers.ex
	index 137e1a376..6d518aa5c 100644
	--- a/test/support/oban_helpers.ex
	+++ b/test/support/oban_helpers.ex
	@@ -1,42 +1,46 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2019 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Tests.ObanHelpers do
	@moduledoc """
	Oban test helpers.
	"""

	alias Pleroma.Storage.Repo

	+ def wipe_all do
	+ Repo.delete_all(Oban.Job)
	+ end
	+
	def perform_all do
	Oban.Job
	\|> Repo.all()
	\|> perform()
	end

	def perform(%Oban.Job{} = job) do
	res = apply(String.to_existing_atom("Elixir." <> job.worker), :perform, [job.args, job])
	Repo.delete(job)
	res
	end

	def perform(jobs) when is_list(jobs) do
	for job <- jobs, do: perform(job)
	end

	def member?(%{} = job_args, jobs) when is_list(jobs) do
	Enum.any?(jobs, fn job ->
	member?(job_args, job.args)
	end)
	end

	def member?(%{} = test_attrs, %{} = attrs) do
	Enum.all?(
	test_attrs,
	fn {k, _v} -> member?(test_attrs[k], attrs[k]) end
	)
	end

	def member?(x, y), do: x == y
	end
	diff --git a/test/tasks/refresh_counter_cache_test.exs b/test/tasks/refresh_counter_cache_test.exs
	new file mode 100644
	index 000000000..2fd18728f
	--- /dev/null
	+++ b/test/tasks/refresh_counter_cache_test.exs
	@@ -0,0 +1,43 @@
	+# Pleroma: A lightweight social networking server
	+# Copyright © 2017-2019 Pleroma Authors <https://pleroma.social/>
	+# SPDX-License-Identifier: AGPL-3.0-only
	+
	+defmodule Mix.Tasks.Pleroma.RefreshCounterCacheTest do
	+ use Pleroma.DataCase
	+ import ExUnit.CaptureIO, only: [capture_io: 1]
	+ import Pleroma.Factory
	+ alias Pleroma.Healthcheck.Stats
	+ alias Pleroma.Web.CommonAPI
	+
	+ test "counts statuses" do
	+ user = insert(:user)
	+ other_user = insert(:user)
	+
	+ CommonAPI.post(user, %{"visibility" => "public", "status" => "hey"})
	+
	+ Enum.each(0..1, fn _ ->
	+ CommonAPI.post(user, %{
	+ "visibility" => "unlisted",
	+ "status" => "hey"
	+ })
	+ end)
	+
	+ Enum.each(0..2, fn _ ->
	+ CommonAPI.post(user, %{
	+ "visibility" => "direct",
	+ "status" => "hey @#{other_user.nickname}"
	+ })
	+ end)
	+
	+ Enum.each(0..3, fn _ ->
	+ CommonAPI.post(user, %{
	+ "visibility" => "private",
	+ "status" => "hey"
	+ })
	+ end)
	+
	+ assert capture_io(fn -> Mix.Tasks.Pleroma.RefreshCounterCache.run([]) end) =~ "Done\n"
	+
	+ assert %{direct: 3, private: 4, public: 1, unlisted: 2} = Stats.get_status_visibility_count()
	+ end
	+end
	diff --git a/test/web/admin_api/admin_api_controller_test.exs b/test/web/admin_api/admin_api_controller_test.exs
	index ddb241ca0..7fa9eaea3 100644
	--- a/test/web/admin_api/admin_api_controller_test.exs
	+++ b/test/web/admin_api/admin_api_controller_test.exs
	@@ -1,3555 +1,3574 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2019 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Web.AdminAPI.AdminAPIControllerTest do
	use Pleroma.Web.ConnCase
	use Oban.Testing, repo: Pleroma.Storage.Repo

	import Pleroma.Factory
	import ExUnit.CaptureLog

	alias Pleroma.Activity
	alias Pleroma.Config
	alias Pleroma.ConfigDB
	alias Pleroma.Federation.ActivityPub.Relay
	alias Pleroma.HTML
	alias Pleroma.ModerationLog
	alias Pleroma.Storage.Repo
	alias Pleroma.Storage.ReportNote
	alias Pleroma.Tests.ObanHelpers
	alias Pleroma.User
	alias Pleroma.UserInviteToken
	alias Pleroma.Web.CommonAPI
	alias Pleroma.Web.MastodonAPI.StatusView
	alias Pleroma.Web.MediaProxy

	setup_all do
	Tesla.Mock.mock_global(fn env -> apply(HttpRequestMock, :request, [env]) end)

	:ok
	end

	setup do
	admin = insert(:user, is_admin: true)
	token = insert(:oauth_admin_token, user: admin)

	conn =
	build_conn()
	\|> assign(:user, admin)
	\|> assign(:token, token)

	{:ok, %{admin: admin, token: token, conn: conn}}
	end

	describe "with [:auth, :enforce_oauth_admin_scope_usage]," do
	clear_config([:auth, :enforce_oauth_admin_scope_usage]) do
	Config.put([:auth, :enforce_oauth_admin_scope_usage], true)
	end

	test "GET /api/pleroma/admin/users/:nickname requires admin:read:accounts or broader scope",
	%{admin: admin} do
	user = insert(:user)
	url = "/api/pleroma/admin/users/#{user.nickname}"

	good_token1 = insert(:oauth_token, user: admin, scopes: ["admin"])
	good_token2 = insert(:oauth_token, user: admin, scopes: ["admin:read"])
	good_token3 = insert(:oauth_token, user: admin, scopes: ["admin:read:accounts"])

	bad_token1 = insert(:oauth_token, user: admin, scopes: ["read:accounts"])
	bad_token2 = insert(:oauth_token, user: admin, scopes: ["admin:read:accounts:partial"])
	bad_token3 = nil

	for good_token <- [good_token1, good_token2, good_token3] do
	conn =
	build_conn()
	\|> assign(:user, admin)
	\|> assign(:token, good_token)
	\|> get(url)

	assert json_response(conn, 200)
	end

	for good_token <- [good_token1, good_token2, good_token3] do
	conn =
	build_conn()
	\|> assign(:user, nil)
	\|> assign(:token, good_token)
	\|> get(url)

	assert json_response(conn, :forbidden)
	end

	for bad_token <- [bad_token1, bad_token2, bad_token3] do
	conn =
	build_conn()
	\|> assign(:user, admin)
	\|> assign(:token, bad_token)
	\|> get(url)

	assert json_response(conn, :forbidden)
	end
	end
	end

	describe "unless [:auth, :enforce_oauth_admin_scope_usage]," do
	clear_config([:auth, :enforce_oauth_admin_scope_usage]) do
	Config.put([:auth, :enforce_oauth_admin_scope_usage], false)
	end

	test "GET /api/pleroma/admin/users/:nickname requires " <>
	"read:accounts or admin:read:accounts or broader scope",
	%{admin: admin} do
	user = insert(:user)
	url = "/api/pleroma/admin/users/#{user.nickname}"

	good_token1 = insert(:oauth_token, user: admin, scopes: ["admin"])
	good_token2 = insert(:oauth_token, user: admin, scopes: ["admin:read"])
	good_token3 = insert(:oauth_token, user: admin, scopes: ["admin:read:accounts"])
	good_token4 = insert(:oauth_token, user: admin, scopes: ["read:accounts"])
	good_token5 = insert(:oauth_token, user: admin, scopes: ["read"])

	good_tokens = [good_token1, good_token2, good_token3, good_token4, good_token5]

	bad_token1 = insert(:oauth_token, user: admin, scopes: ["read:accounts:partial"])
	bad_token2 = insert(:oauth_token, user: admin, scopes: ["admin:read:accounts:partial"])
	bad_token3 = nil

	for good_token <- good_tokens do
	conn =
	build_conn()
	\|> assign(:user, admin)
	\|> assign(:token, good_token)
	\|> get(url)

	assert json_response(conn, 200)
	end

	for good_token <- good_tokens do
	conn =
	build_conn()
	\|> assign(:user, nil)
	\|> assign(:token, good_token)
	\|> get(url)

	assert json_response(conn, :forbidden)
	end

	for bad_token <- [bad_token1, bad_token2, bad_token3] do
	conn =
	build_conn()
	\|> assign(:user, admin)
	\|> assign(:token, bad_token)
	\|> get(url)

	assert json_response(conn, :forbidden)
	end
	end
	end

	describe "DELETE /api/pleroma/admin/users" do
	test "single user", %{admin: admin, conn: conn} do
	user = insert(:user)

	conn =
	conn
	\|> put_req_header("accept", "application/json")
	\|> delete("/api/pleroma/admin/users?nickname=#{user.nickname}")

	log_entry = Repo.one(ModerationLog)

	assert ModerationLog.get_log_entry_message(log_entry) ==
	"@#{admin.nickname} deleted users: @#{user.nickname}"

	assert json_response(conn, 200) == user.nickname
	end

	test "multiple users", %{admin: admin, conn: conn} do
	user_one = insert(:user)
	user_two = insert(:user)

	conn =
	conn
	\|> put_req_header("accept", "application/json")
	\|> delete("/api/pleroma/admin/users", %{
	nicknames: [user_one.nickname, user_two.nickname]
	})

	log_entry = Repo.one(ModerationLog)

	assert ModerationLog.get_log_entry_message(log_entry) ==
	"@#{admin.nickname} deleted users: @#{user_one.nickname}, @#{user_two.nickname}"

	response = json_response(conn, 200)
	assert response -- [user_one.nickname, user_two.nickname] == []
	end
	end

	describe "/api/pleroma/admin/users" do
	test "Create", %{conn: conn} do
	conn =
	conn
	\|> put_req_header("accept", "application/json")
	\|> post("/api/pleroma/admin/users", %{
	"users" => [
	%{
	"nickname" => "lain",
	"email" => "lain@example.org",
	"password" => "test"
	},
	%{
	"nickname" => "lain2",
	"email" => "lain2@example.org",
	"password" => "test"
	}
	]
	})

	response = json_response(conn, 200) \|> Enum.map(&Map.get(&1, "type"))
	assert response == ["success", "success"]

	log_entry = Repo.one(ModerationLog)

	assert ["lain", "lain2"] -- Enum.map(log_entry.data["subjects"], & &1["nickname"]) == []
	end

	test "Cannot create user with existing email", %{conn: conn} do
	user = insert(:user)

	conn =
	conn
	\|> put_req_header("accept", "application/json")
	\|> post("/api/pleroma/admin/users", %{
	"users" => [
	%{
	"nickname" => "lain",
	"email" => user.email,
	"password" => "test"
	}
	]
	})

	assert json_response(conn, 409) == [
	%{
	"code" => 409,
	"data" => %{
	"email" => user.email,
	"nickname" => "lain"
	},
	"error" => "email has already been taken",
	"type" => "error"
	}
	]
	end

	test "Cannot create user with existing nickname", %{conn: conn} do
	user = insert(:user)

	conn =
	conn
	\|> put_req_header("accept", "application/json")
	\|> post("/api/pleroma/admin/users", %{
	"users" => [
	%{
	"nickname" => user.nickname,
	"email" => "someuser@plerama.social",
	"password" => "test"
	}
	]
	})

	assert json_response(conn, 409) == [
	%{
	"code" => 409,
	"data" => %{
	"email" => "someuser@plerama.social",
	"nickname" => user.nickname
	},
	"error" => "nickname has already been taken",
	"type" => "error"
	}
	]
	end

	test "Multiple user creation works in transaction", %{conn: conn} do
	user = insert(:user)

	conn =
	conn
	\|> put_req_header("accept", "application/json")
	\|> post("/api/pleroma/admin/users", %{
	"users" => [
	%{
	"nickname" => "newuser",
	"email" => "newuser@pleroma.social",
	"password" => "test"
	},
	%{
	"nickname" => "lain",
	"email" => user.email,
	"password" => "test"
	}
	]
	})

	assert json_response(conn, 409) == [
	%{
	"code" => 409,
	"data" => %{
	"email" => user.email,
	"nickname" => "lain"
	},
	"error" => "email has already been taken",
	"type" => "error"
	},
	%{
	"code" => 409,
	"data" => %{
	"email" => "newuser@pleroma.social",
	"nickname" => "newuser"
	},
	"error" => "",
	"type" => "error"
	}
	]

	assert User.get_by_nickname("newuser") === nil
	end
	end

	describe "/api/pleroma/admin/users/:nickname" do
	test "Show", %{conn: conn} do
	user = insert(:user)

	conn = get(conn, "/api/pleroma/admin/users/#{user.nickname}")

	expected = %{
	"deactivated" => false,
	"id" => to_string(user.id),
	"local" => true,
	"nickname" => user.nickname,
	"roles" => %{"admin" => false, "moderator" => false},
	"tags" => [],
	"avatar" => User.avatar_url(user) \|> MediaProxy.url(),
	"display_name" => HTML.strip_tags(user.name \|\| user.nickname),
	"confirmation_pending" => false
	}

	assert expected == json_response(conn, 200)
	end

	test "when the user doesn't exist", %{conn: conn} do
	user = build(:user)

	conn = get(conn, "/api/pleroma/admin/users/#{user.nickname}")

	assert "Not found" == json_response(conn, 404)
	end
	end

	describe "/api/pleroma/admin/users/follow" do
	test "allows to force-follow another user", %{admin: admin, conn: conn} do
	user = insert(:user)
	follower = insert(:user)

	conn
	\|> put_req_header("accept", "application/json")
	\|> post("/api/pleroma/admin/users/follow", %{
	"follower" => follower.nickname,
	"followed" => user.nickname
	})

	user = User.get_cached_by_id(user.id)
	follower = User.get_cached_by_id(follower.id)

	assert User.following?(follower, user)

	log_entry = Repo.one(ModerationLog)

	assert ModerationLog.get_log_entry_message(log_entry) ==
	"@#{admin.nickname} made @#{follower.nickname} follow @#{user.nickname}"
	end
	end

	describe "/api/pleroma/admin/users/unfollow" do
	test "allows to force-unfollow another user", %{admin: admin, conn: conn} do
	user = insert(:user)
	follower = insert(:user)

	User.follow(follower, user)

	conn
	\|> put_req_header("accept", "application/json")
	\|> post("/api/pleroma/admin/users/unfollow", %{
	"follower" => follower.nickname,
	"followed" => user.nickname
	})

	user = User.get_cached_by_id(user.id)
	follower = User.get_cached_by_id(follower.id)

	refute User.following?(follower, user)

	log_entry = Repo.one(ModerationLog)

	assert ModerationLog.get_log_entry_message(log_entry) ==
	"@#{admin.nickname} made @#{follower.nickname} unfollow @#{user.nickname}"
	end
	end

	describe "PUT /api/pleroma/admin/users/tag" do
	setup %{conn: conn} do
	user1 = insert(:user, %{tags: ["x"]})
	user2 = insert(:user, %{tags: ["y"]})
	user3 = insert(:user, %{tags: ["unchanged"]})

	conn =
	conn
	\|> put_req_header("accept", "application/json")
	\|> put(
	"/api/pleroma/admin/users/tag?nicknames[]=#{user1.nickname}&nicknames[]=" <>
	"#{user2.nickname}&tags[]=foo&tags[]=bar"
	)

	%{conn: conn, user1: user1, user2: user2, user3: user3}
	end

	test "it appends specified tags to users with specified nicknames", %{
	conn: conn,
	admin: admin,
	user1: user1,
	user2: user2
	} do
	assert json_response(conn, :no_content)
	assert User.get_cached_by_id(user1.id).tags == ["x", "foo", "bar"]
	assert User.get_cached_by_id(user2.id).tags == ["y", "foo", "bar"]

	log_entry = Repo.one(ModerationLog)

	users =
	[user1.nickname, user2.nickname]
	\|> Enum.map(&"@#{&1}")
	\|> Enum.join(", ")

	tags = ["foo", "bar"] \|> Enum.join(", ")

	assert ModerationLog.get_log_entry_message(log_entry) ==
	"@#{admin.nickname} added tags: #{tags} to users: #{users}"
	end

	test "it does not modify tags of not specified users", %{conn: conn, user3: user3} do
	assert json_response(conn, :no_content)
	assert User.get_cached_by_id(user3.id).tags == ["unchanged"]
	end
	end

	describe "DELETE /api/pleroma/admin/users/tag" do
	setup %{conn: conn} do
	user1 = insert(:user, %{tags: ["x"]})
	user2 = insert(:user, %{tags: ["y", "z"]})
	user3 = insert(:user, %{tags: ["unchanged"]})

	conn =
	conn
	\|> put_req_header("accept", "application/json")
	\|> delete(
	"/api/pleroma/admin/users/tag?nicknames[]=#{user1.nickname}&nicknames[]=" <>
	"#{user2.nickname}&tags[]=x&tags[]=z"
	)

	%{conn: conn, user1: user1, user2: user2, user3: user3}
	end

	test "it removes specified tags from users with specified nicknames", %{
	conn: conn,
	admin: admin,
	user1: user1,
	user2: user2
	} do
	assert json_response(conn, :no_content)
	assert User.get_cached_by_id(user1.id).tags == []
	assert User.get_cached_by_id(user2.id).tags == ["y"]

	log_entry = Repo.one(ModerationLog)

	users =
	[user1.nickname, user2.nickname]
	\|> Enum.map(&"@#{&1}")
	\|> Enum.join(", ")

	tags = ["x", "z"] \|> Enum.join(", ")

	assert ModerationLog.get_log_entry_message(log_entry) ==
	"@#{admin.nickname} removed tags: #{tags} from users: #{users}"
	end

	test "it does not modify tags of not specified users", %{conn: conn, user3: user3} do
	assert json_response(conn, :no_content)
	assert User.get_cached_by_id(user3.id).tags == ["unchanged"]
	end
	end

	describe "/api/pleroma/admin/users/:nickname/permission_group" do
	test "GET is giving user_info", %{admin: admin, conn: conn} do
	conn =
	conn
	\|> put_req_header("accept", "application/json")
	\|> get("/api/pleroma/admin/users/#{admin.nickname}/permission_group/")

	assert json_response(conn, 200) == %{
	"is_admin" => true,
	"is_moderator" => false
	}
	end

	test "/:right POST, can add to a permission group", %{admin: admin, conn: conn} do
	user = insert(:user)

	conn =
	conn
	\|> put_req_header("accept", "application/json")
	\|> post("/api/pleroma/admin/users/#{user.nickname}/permission_group/admin")

	assert json_response(conn, 200) == %{
	"is_admin" => true
	}

	log_entry = Repo.one(ModerationLog)

	assert ModerationLog.get_log_entry_message(log_entry) ==
	"@#{admin.nickname} made @#{user.nickname} admin"
	end

	test "/:right POST, can add to a permission group (multiple)", %{admin: admin, conn: conn} do
	user_one = insert(:user)
	user_two = insert(:user)

	conn =
	conn
	\|> put_req_header("accept", "application/json")
	\|> post("/api/pleroma/admin/users/permission_group/admin", %{
	nicknames: [user_one.nickname, user_two.nickname]
	})

	assert json_response(conn, 200) == %{"is_admin" => true}

	log_entry = Repo.one(ModerationLog)

	assert ModerationLog.get_log_entry_message(log_entry) ==
	"@#{admin.nickname} made @#{user_one.nickname}, @#{user_two.nickname} admin"
	end

	test "/:right DELETE, can remove from a permission group", %{admin: admin, conn: conn} do
	user = insert(:user, is_admin: true)

	conn =
	conn
	\|> put_req_header("accept", "application/json")
	\|> delete("/api/pleroma/admin/users/#{user.nickname}/permission_group/admin")

	assert json_response(conn, 200) == %{"is_admin" => false}

	log_entry = Repo.one(ModerationLog)

	assert ModerationLog.get_log_entry_message(log_entry) ==
	"@#{admin.nickname} revoked admin role from @#{user.nickname}"
	end

	test "/:right DELETE, can remove from a permission group (multiple)", %{
	admin: admin,
	conn: conn
	} do
	user_one = insert(:user, is_admin: true)
	user_two = insert(:user, is_admin: true)

	conn =
	conn
	\|> put_req_header("accept", "application/json")
	\|> delete("/api/pleroma/admin/users/permission_group/admin", %{
	nicknames: [user_one.nickname, user_two.nickname]
	})

	assert json_response(conn, 200) == %{"is_admin" => false}

	log_entry = Repo.one(ModerationLog)

	assert ModerationLog.get_log_entry_message(log_entry) ==
	"@#{admin.nickname} revoked admin role from @#{user_one.nickname}, @#{
	user_two.nickname
	}"
	end
	end

	describe "POST /api/pleroma/admin/email_invite, with valid config" do
	clear_config([:instance, :registrations_open]) do
	Config.put([:instance, :registrations_open], false)
	end

	clear_config([:instance, :invites_enabled]) do
	Config.put([:instance, :invites_enabled], true)
	end

	test "sends invitation and returns 204", %{admin: admin, conn: conn} do
	recipient_email = "foo@bar.com"
	recipient_name = "J. D."

	conn =
	post(
	conn,
	"/api/pleroma/admin/users/email_invite?email=#{recipient_email}&name=#{recipient_name}"
	)

	assert json_response(conn, :no_content)

	token_record = List.last(Repo.all(Pleroma.UserInviteToken))
	assert token_record
	refute token_record.used

	notify_email = Config.get([:instance, :notify_email])
	instance_name = Config.get([:instance, :name])

	email =
	Pleroma.Emails.UserEmail.user_invitation_email(
	admin,
	token_record,
	recipient_email,
	recipient_name
	)

	Swoosh.TestAssertions.assert_email_sent(
	from: {instance_name, notify_email},
	to: {recipient_name, recipient_email},
	html_body: email.html_body
	)
	end

	test "it returns 403 if requested by a non-admin" do
	non_admin_user = insert(:user)
	token = insert(:oauth_token, user: non_admin_user)

	conn =
	build_conn()
	\|> assign(:user, non_admin_user)
	\|> assign(:token, token)
	\|> post("/api/pleroma/admin/users/email_invite?email=foo@bar.com&name=JD")

	assert json_response(conn, :forbidden)
	end
	end

	describe "POST /api/pleroma/admin/users/email_invite, with invalid config" do
	clear_config([:instance, :registrations_open])
	clear_config([:instance, :invites_enabled])

	test "it returns 500 if `invites_enabled` is not enabled", %{conn: conn} do
	Config.put([:instance, :registrations_open], false)
	Config.put([:instance, :invites_enabled], false)

	conn = post(conn, "/api/pleroma/admin/users/email_invite?email=foo@bar.com&name=JD")

	assert json_response(conn, :internal_server_error)
	end

	test "it returns 500 if `registrations_open` is enabled", %{conn: conn} do
	Config.put([:instance, :registrations_open], true)
	Config.put([:instance, :invites_enabled], true)

	conn = post(conn, "/api/pleroma/admin/users/email_invite?email=foo@bar.com&name=JD")

	assert json_response(conn, :internal_server_error)
	end
	end

	test "/api/pleroma/admin/users/:nickname/password_reset", %{conn: conn} do
	user = insert(:user)

	conn =
	conn
	\|> put_req_header("accept", "application/json")
	\|> get("/api/pleroma/admin/users/#{user.nickname}/password_reset")

	resp = json_response(conn, 200)

	assert Regex.match?(~r/(http:\/\/\|https:\/\/)/, resp["link"])
	end

	describe "GET /api/pleroma/admin/users" do
	test "renders users array for the first page", %{conn: conn, admin: admin} do
	user = insert(:user, local: false, tags: ["foo", "bar"])
	conn = get(conn, "/api/pleroma/admin/users?page=1")

	users =
	[
	%{
	"deactivated" => admin.deactivated,
	"id" => admin.id,
	"nickname" => admin.nickname,
	"roles" => %{"admin" => true, "moderator" => false},
	"local" => true,
	"tags" => [],
	"avatar" => User.avatar_url(admin) \|> MediaProxy.url(),
	"display_name" => HTML.strip_tags(admin.name \|\| admin.nickname),
	"confirmation_pending" => false
	},
	%{
	"deactivated" => user.deactivated,
	"id" => user.id,
	"nickname" => user.nickname,
	"roles" => %{"admin" => false, "moderator" => false},
	"local" => false,
	"tags" => ["foo", "bar"],
	"avatar" => User.avatar_url(user) \|> MediaProxy.url(),
	"display_name" => HTML.strip_tags(user.name \|\| user.nickname),
	"confirmation_pending" => false
	}
	]
	\|> Enum.sort_by(& &1["nickname"])

	assert json_response(conn, 200) == %{
	"count" => 2,
	"page_size" => 50,
	"users" => users
	}
	end

	test "renders empty array for the second page", %{conn: conn} do
	insert(:user)

	conn = get(conn, "/api/pleroma/admin/users?page=2")

	assert json_response(conn, 200) == %{
	"count" => 2,
	"page_size" => 50,
	"users" => []
	}
	end

	test "regular search", %{conn: conn} do
	user = insert(:user, nickname: "bob")

	conn = get(conn, "/api/pleroma/admin/users?query=bo")

	assert json_response(conn, 200) == %{
	"count" => 1,
	"page_size" => 50,
	"users" => [
	%{
	"deactivated" => user.deactivated,
	"id" => user.id,
	"nickname" => user.nickname,
	"roles" => %{"admin" => false, "moderator" => false},
	"local" => true,
	"tags" => [],
	"avatar" => User.avatar_url(user) \|> MediaProxy.url(),
	"display_name" => HTML.strip_tags(user.name \|\| user.nickname),
	"confirmation_pending" => false
	}
	]
	}
	end

	test "search by domain", %{conn: conn} do
	user = insert(:user, nickname: "nickname@domain.com")
	insert(:user)

	conn = get(conn, "/api/pleroma/admin/users?query=domain.com")

	assert json_response(conn, 200) == %{
	"count" => 1,
	"page_size" => 50,
	"users" => [
	%{
	"deactivated" => user.deactivated,
	"id" => user.id,
	"nickname" => user.nickname,
	"roles" => %{"admin" => false, "moderator" => false},
	"local" => true,
	"tags" => [],
	"avatar" => User.avatar_url(user) \|> MediaProxy.url(),
	"display_name" => HTML.strip_tags(user.name \|\| user.nickname),
	"confirmation_pending" => false
	}
	]
	}
	end

	test "search by full nickname", %{conn: conn} do
	user = insert(:user, nickname: "nickname@domain.com")
	insert(:user)

	conn = get(conn, "/api/pleroma/admin/users?query=nickname@domain.com")

	assert json_response(conn, 200) == %{
	"count" => 1,
	"page_size" => 50,
	"users" => [
	%{
	"deactivated" => user.deactivated,
	"id" => user.id,
	"nickname" => user.nickname,
	"roles" => %{"admin" => false, "moderator" => false},
	"local" => true,
	"tags" => [],
	"avatar" => User.avatar_url(user) \|> MediaProxy.url(),
	"display_name" => HTML.strip_tags(user.name \|\| user.nickname),
	"confirmation_pending" => false
	}
	]
	}
	end

	test "search by display name", %{conn: conn} do
	user = insert(:user, name: "Display name")
	insert(:user)

	conn = get(conn, "/api/pleroma/admin/users?name=display")

	assert json_response(conn, 200) == %{
	"count" => 1,
	"page_size" => 50,
	"users" => [
	%{
	"deactivated" => user.deactivated,
	"id" => user.id,
	"nickname" => user.nickname,
	"roles" => %{"admin" => false, "moderator" => false},
	"local" => true,
	"tags" => [],
	"avatar" => User.avatar_url(user) \|> MediaProxy.url(),
	"display_name" => HTML.strip_tags(user.name \|\| user.nickname),
	"confirmation_pending" => false
	}
	]
	}
	end

	test "search by email", %{conn: conn} do
	user = insert(:user, email: "email@example.com")
	insert(:user)

	conn = get(conn, "/api/pleroma/admin/users?email=email@example.com")

	assert json_response(conn, 200) == %{
	"count" => 1,
	"page_size" => 50,
	"users" => [
	%{
	"deactivated" => user.deactivated,
	"id" => user.id,
	"nickname" => user.nickname,
	"roles" => %{"admin" => false, "moderator" => false},
	"local" => true,
	"tags" => [],
	"avatar" => User.avatar_url(user) \|> MediaProxy.url(),
	"display_name" => HTML.strip_tags(user.name \|\| user.nickname),
	"confirmation_pending" => false
	}
	]
	}
	end

	test "regular search with page size", %{conn: conn} do
	user = insert(:user, nickname: "aalice")
	user2 = insert(:user, nickname: "alice")

	conn1 = get(conn, "/api/pleroma/admin/users?query=a&page_size=1&page=1")

	assert json_response(conn1, 200) == %{
	"count" => 2,
	"page_size" => 1,
	"users" => [
	%{
	"deactivated" => user.deactivated,
	"id" => user.id,
	"nickname" => user.nickname,
	"roles" => %{"admin" => false, "moderator" => false},
	"local" => true,
	"tags" => [],
	"avatar" => User.avatar_url(user) \|> MediaProxy.url(),
	"display_name" => HTML.strip_tags(user.name \|\| user.nickname),
	"confirmation_pending" => false
	}
	]
	}

	conn2 = get(conn, "/api/pleroma/admin/users?query=a&page_size=1&page=2")

	assert json_response(conn2, 200) == %{
	"count" => 2,
	"page_size" => 1,
	"users" => [
	%{
	"deactivated" => user2.deactivated,
	"id" => user2.id,
	"nickname" => user2.nickname,
	"roles" => %{"admin" => false, "moderator" => false},
	"local" => true,
	"tags" => [],
	"avatar" => User.avatar_url(user2) \|> MediaProxy.url(),
	"display_name" => HTML.strip_tags(user2.name \|\| user2.nickname),
	"confirmation_pending" => false
	}
	]
	}
	end

	test "only local users" do
	admin = insert(:user, is_admin: true, nickname: "john")
	token = insert(:oauth_admin_token, user: admin)
	user = insert(:user, nickname: "bob")

	insert(:user, nickname: "bobb", local: false)

	conn =
	build_conn()
	\|> assign(:user, admin)
	\|> assign(:token, token)
	\|> get("/api/pleroma/admin/users?query=bo&filters=local")

	assert json_response(conn, 200) == %{
	"count" => 1,
	"page_size" => 50,
	"users" => [
	%{
	"deactivated" => user.deactivated,
	"id" => user.id,
	"nickname" => user.nickname,
	"roles" => %{"admin" => false, "moderator" => false},
	"local" => true,
	"tags" => [],
	"avatar" => User.avatar_url(user) \|> MediaProxy.url(),
	"display_name" => HTML.strip_tags(user.name \|\| user.nickname),
	"confirmation_pending" => false
	}
	]
	}
	end

	test "only local users with no query", %{conn: conn, admin: old_admin} do
	admin = insert(:user, is_admin: true, nickname: "john")
	user = insert(:user, nickname: "bob")

	insert(:user, nickname: "bobb", local: false)

	conn = get(conn, "/api/pleroma/admin/users?filters=local")

	users =
	[
	%{
	"deactivated" => user.deactivated,
	"id" => user.id,
	"nickname" => user.nickname,
	"roles" => %{"admin" => false, "moderator" => false},
	"local" => true,
	"tags" => [],
	"avatar" => User.avatar_url(user) \|> MediaProxy.url(),
	"display_name" => HTML.strip_tags(user.name \|\| user.nickname),
	"confirmation_pending" => false
	},
	%{
	"deactivated" => admin.deactivated,
	"id" => admin.id,
	"nickname" => admin.nickname,
	"roles" => %{"admin" => true, "moderator" => false},
	"local" => true,
	"tags" => [],
	"avatar" => User.avatar_url(admin) \|> MediaProxy.url(),
	"display_name" => HTML.strip_tags(admin.name \|\| admin.nickname),
	"confirmation_pending" => false
	},
	%{
	"deactivated" => false,
	"id" => old_admin.id,
	"local" => true,
	"nickname" => old_admin.nickname,
	"roles" => %{"admin" => true, "moderator" => false},
	"tags" => [],
	"avatar" => User.avatar_url(old_admin) \|> MediaProxy.url(),
	"display_name" => HTML.strip_tags(old_admin.name \|\| old_admin.nickname),
	"confirmation_pending" => false
	}
	]
	\|> Enum.sort_by(& &1["nickname"])

	assert json_response(conn, 200) == %{
	"count" => 3,
	"page_size" => 50,
	"users" => users
	}
	end

	test "load only admins", %{conn: conn, admin: admin} do
	second_admin = insert(:user, is_admin: true)
	insert(:user)
	insert(:user)

	conn = get(conn, "/api/pleroma/admin/users?filters=is_admin")

	users =
	[
	%{
	"deactivated" => false,
	"id" => admin.id,
	"nickname" => admin.nickname,
	"roles" => %{"admin" => true, "moderator" => false},
	"local" => admin.local,
	"tags" => [],
	"avatar" => User.avatar_url(admin) \|> MediaProxy.url(),
	"display_name" => HTML.strip_tags(admin.name \|\| admin.nickname),
	"confirmation_pending" => false
	},
	%{
	"deactivated" => false,
	"id" => second_admin.id,
	"nickname" => second_admin.nickname,
	"roles" => %{"admin" => true, "moderator" => false},
	"local" => second_admin.local,
	"tags" => [],
	"avatar" => User.avatar_url(second_admin) \|> MediaProxy.url(),
	"display_name" => HTML.strip_tags(second_admin.name \|\| second_admin.nickname),
	"confirmation_pending" => false
	}
	]
	\|> Enum.sort_by(& &1["nickname"])

	assert json_response(conn, 200) == %{
	"count" => 2,
	"page_size" => 50,
	"users" => users
	}
	end

	test "load only moderators", %{conn: conn} do
	moderator = insert(:user, is_moderator: true)
	insert(:user)
	insert(:user)

	conn = get(conn, "/api/pleroma/admin/users?filters=is_moderator")

	assert json_response(conn, 200) == %{
	"count" => 1,
	"page_size" => 50,
	"users" => [
	%{
	"deactivated" => false,
	"id" => moderator.id,
	"nickname" => moderator.nickname,
	"roles" => %{"admin" => false, "moderator" => true},
	"local" => moderator.local,
	"tags" => [],
	"avatar" => User.avatar_url(moderator) \|> MediaProxy.url(),
	"display_name" => HTML.strip_tags(moderator.name \|\| moderator.nickname),
	"confirmation_pending" => false
	}
	]
	}
	end

	test "load users with tags list", %{conn: conn} do
	user1 = insert(:user, tags: ["first"])
	user2 = insert(:user, tags: ["second"])
	insert(:user)
	insert(:user)

	conn = get(conn, "/api/pleroma/admin/users?tags[]=first&tags[]=second")

	users =
	[
	%{
	"deactivated" => false,
	"id" => user1.id,
	"nickname" => user1.nickname,
	"roles" => %{"admin" => false, "moderator" => false},
	"local" => user1.local,
	"tags" => ["first"],
	"avatar" => User.avatar_url(user1) \|> MediaProxy.url(),
	"display_name" => HTML.strip_tags(user1.name \|\| user1.nickname),
	"confirmation_pending" => false
	},
	%{
	"deactivated" => false,
	"id" => user2.id,
	"nickname" => user2.nickname,
	"roles" => %{"admin" => false, "moderator" => false},
	"local" => user2.local,
	"tags" => ["second"],
	"avatar" => User.avatar_url(user2) \|> MediaProxy.url(),
	"display_name" => HTML.strip_tags(user2.name \|\| user2.nickname),
	"confirmation_pending" => false
	}
	]
	\|> Enum.sort_by(& &1["nickname"])

	assert json_response(conn, 200) == %{
	"count" => 2,
	"page_size" => 50,
	"users" => users
	}
	end

	test "it works with multiple filters" do
	admin = insert(:user, nickname: "john", is_admin: true)
	token = insert(:oauth_admin_token, user: admin)
	user = insert(:user, nickname: "bob", local: false, deactivated: true)

	insert(:user, nickname: "ken", local: true, deactivated: true)
	insert(:user, nickname: "bobb", local: false, deactivated: false)

	conn =
	build_conn()
	\|> assign(:user, admin)
	\|> assign(:token, token)
	\|> get("/api/pleroma/admin/users?filters=deactivated,external")

	assert json_response(conn, 200) == %{
	"count" => 1,
	"page_size" => 50,
	"users" => [
	%{
	"deactivated" => user.deactivated,
	"id" => user.id,
	"nickname" => user.nickname,
	"roles" => %{"admin" => false, "moderator" => false},
	"local" => user.local,
	"tags" => [],
	"avatar" => User.avatar_url(user) \|> MediaProxy.url(),
	"display_name" => HTML.strip_tags(user.name \|\| user.nickname),
	"confirmation_pending" => false
	}
	]
	}
	end

	test "it omits relay user", %{admin: admin, conn: conn} do
	assert %User{} = Relay.get_actor()

	conn = get(conn, "/api/pleroma/admin/users")

	assert json_response(conn, 200) == %{
	"count" => 1,
	"page_size" => 50,
	"users" => [
	%{
	"deactivated" => admin.deactivated,
	"id" => admin.id,
	"nickname" => admin.nickname,
	"roles" => %{"admin" => true, "moderator" => false},
	"local" => true,
	"tags" => [],
	"avatar" => User.avatar_url(admin) \|> MediaProxy.url(),
	"display_name" => HTML.strip_tags(admin.name \|\| admin.nickname),
	"confirmation_pending" => false
	}
	]
	}
	end
	end

	test "PATCH /api/pleroma/admin/users/activate", %{admin: admin, conn: conn} do
	user_one = insert(:user, deactivated: true)
	user_two = insert(:user, deactivated: true)

	conn =
	patch(
	conn,
	"/api/pleroma/admin/users/activate",
	%{nicknames: [user_one.nickname, user_two.nickname]}
	)

	response = json_response(conn, 200)
	assert Enum.map(response["users"], & &1["deactivated"]) == [false, false]

	log_entry = Repo.one(ModerationLog)

	assert ModerationLog.get_log_entry_message(log_entry) ==
	"@#{admin.nickname} activated users: @#{user_one.nickname}, @#{user_two.nickname}"
	end

	test "PATCH /api/pleroma/admin/users/deactivate", %{admin: admin, conn: conn} do
	user_one = insert(:user, deactivated: false)
	user_two = insert(:user, deactivated: false)

	conn =
	patch(
	conn,
	"/api/pleroma/admin/users/deactivate",
	%{nicknames: [user_one.nickname, user_two.nickname]}
	)

	response = json_response(conn, 200)
	assert Enum.map(response["users"], & &1["deactivated"]) == [true, true]

	log_entry = Repo.one(ModerationLog)

	assert ModerationLog.get_log_entry_message(log_entry) ==
	"@#{admin.nickname} deactivated users: @#{user_one.nickname}, @#{user_two.nickname}"
	end

	test "PATCH /api/pleroma/admin/users/:nickname/toggle_activation", %{admin: admin, conn: conn} do
	user = insert(:user)

	conn = patch(conn, "/api/pleroma/admin/users/#{user.nickname}/toggle_activation")

	assert json_response(conn, 200) ==
	%{
	"deactivated" => !user.deactivated,
	"id" => user.id,
	"nickname" => user.nickname,
	"roles" => %{"admin" => false, "moderator" => false},
	"local" => true,
	"tags" => [],
	"avatar" => User.avatar_url(user) \|> MediaProxy.url(),
	"display_name" => HTML.strip_tags(user.name \|\| user.nickname),
	"confirmation_pending" => false
	}

	log_entry = Repo.one(ModerationLog)

	assert ModerationLog.get_log_entry_message(log_entry) ==
	"@#{admin.nickname} deactivated users: @#{user.nickname}"
	end

	describe "POST /api/pleroma/admin/users/invite_token" do
	test "without options", %{conn: conn} do
	conn = post(conn, "/api/pleroma/admin/users/invite_token")

	invite_json = json_response(conn, 200)
	invite = UserInviteToken.find_by_token!(invite_json["token"])
	refute invite.used
	refute invite.expires_at
	refute invite.max_use
	assert invite.invite_type == "one_time"
	end

	test "with expires_at", %{conn: conn} do
	conn =
	post(conn, "/api/pleroma/admin/users/invite_token", %{
	"expires_at" => Date.to_string(Date.utc_today())
	})

	invite_json = json_response(conn, 200)
	invite = UserInviteToken.find_by_token!(invite_json["token"])

	refute invite.used
	assert invite.expires_at == Date.utc_today()
	refute invite.max_use
	assert invite.invite_type == "date_limited"
	end

	test "with max_use", %{conn: conn} do
	conn = post(conn, "/api/pleroma/admin/users/invite_token", %{"max_use" => 150})

	invite_json = json_response(conn, 200)
	invite = UserInviteToken.find_by_token!(invite_json["token"])
	refute invite.used
	refute invite.expires_at
	assert invite.max_use == 150
	assert invite.invite_type == "reusable"
	end

	test "with max use and expires_at", %{conn: conn} do
	conn =
	post(conn, "/api/pleroma/admin/users/invite_token", %{
	"max_use" => 150,
	"expires_at" => Date.to_string(Date.utc_today())
	})

	invite_json = json_response(conn, 200)
	invite = UserInviteToken.find_by_token!(invite_json["token"])
	refute invite.used
	assert invite.expires_at == Date.utc_today()
	assert invite.max_use == 150
	assert invite.invite_type == "reusable_date_limited"
	end
	end

	describe "GET /api/pleroma/admin/users/invites" do
	test "no invites", %{conn: conn} do
	conn = get(conn, "/api/pleroma/admin/users/invites")

	assert json_response(conn, 200) == %{"invites" => []}
	end

	test "with invite", %{conn: conn} do
	{:ok, invite} = UserInviteToken.create_invite()

	conn = get(conn, "/api/pleroma/admin/users/invites")

	assert json_response(conn, 200) == %{
	"invites" => [
	%{
	"expires_at" => nil,
	"id" => invite.id,
	"invite_type" => "one_time",
	"max_use" => nil,
	"token" => invite.token,
	"used" => false,
	"uses" => 0
	}
	]
	}
	end
	end

	describe "POST /api/pleroma/admin/users/revoke_invite" do
	test "with token", %{conn: conn} do
	{:ok, invite} = UserInviteToken.create_invite()

	conn = post(conn, "/api/pleroma/admin/users/revoke_invite", %{"token" => invite.token})

	assert json_response(conn, 200) == %{
	"expires_at" => nil,
	"id" => invite.id,
	"invite_type" => "one_time",
	"max_use" => nil,
	"token" => invite.token,
	"used" => true,
	"uses" => 0
	}
	end

	test "with invalid token", %{conn: conn} do
	conn = post(conn, "/api/pleroma/admin/users/revoke_invite", %{"token" => "foo"})

	assert json_response(conn, :not_found) == "Not found"
	end
	end

	describe "GET /api/pleroma/admin/reports/:id" do
	test "returns report by its id", %{conn: conn} do
	[reporter, target_user] = insert_pair(:user)
	activity = insert(:note_activity, user: target_user)

	{:ok, %{id: report_id}} =
	CommonAPI.report(reporter, %{
	"account_id" => target_user.id,
	"comment" => "I feel offended",
	"status_ids" => [activity.id]
	})

	response =
	conn
	\|> get("/api/pleroma/admin/reports/#{report_id}")
	\|> json_response(:ok)

	assert response["id"] == report_id
	end

	test "returns 404 when report id is invalid", %{conn: conn} do
	conn = get(conn, "/api/pleroma/admin/reports/test")

	assert json_response(conn, :not_found) == "Not found"
	end
	end

	describe "PATCH /api/pleroma/admin/reports" do
	setup do
	[reporter, target_user] = insert_pair(:user)
	activity = insert(:note_activity, user: target_user)

	{:ok, %{id: report_id}} =
	CommonAPI.report(reporter, %{
	"account_id" => target_user.id,
	"comment" => "I feel offended",
	"status_ids" => [activity.id]
	})

	{:ok, %{id: second_report_id}} =
	CommonAPI.report(reporter, %{
	"account_id" => target_user.id,
	"comment" => "I feel very offended",
	"status_ids" => [activity.id]
	})

	%{
	id: report_id,
	second_report_id: second_report_id
	}
	end

	test "requires admin:write:reports scope", %{conn: conn, id: id, admin: admin} do
	read_token = insert(:oauth_token, user: admin, scopes: ["admin:read"])
	write_token = insert(:oauth_token, user: admin, scopes: ["admin:write:reports"])

	response =
	conn
	\|> assign(:token, read_token)
	\|> patch("/api/pleroma/admin/reports", %{
	"reports" => [%{"state" => "resolved", "id" => id}]
	})
	\|> json_response(403)

	assert response == %{
	"error" => "Insufficient permissions: admin:write:reports."
	}

	conn
	\|> assign(:token, write_token)
	\|> patch("/api/pleroma/admin/reports", %{
	"reports" => [%{"state" => "resolved", "id" => id}]
	})
	\|> json_response(:no_content)
	end

	test "mark report as resolved", %{conn: conn, id: id, admin: admin} do
	conn
	\|> patch("/api/pleroma/admin/reports", %{
	"reports" => [
	%{"state" => "resolved", "id" => id}
	]
	})
	\|> json_response(:no_content)

	activity = Activity.get_by_id(id)
	assert activity.data["state"] == "resolved"

	log_entry = Repo.one(ModerationLog)

	assert ModerationLog.get_log_entry_message(log_entry) ==
	"@#{admin.nickname} updated report ##{id} with 'resolved' state"
	end

	test "closes report", %{conn: conn, id: id, admin: admin} do
	conn
	\|> patch("/api/pleroma/admin/reports", %{
	"reports" => [
	%{"state" => "closed", "id" => id}
	]
	})
	\|> json_response(:no_content)

	activity = Activity.get_by_id(id)
	assert activity.data["state"] == "closed"

	log_entry = Repo.one(ModerationLog)

	assert ModerationLog.get_log_entry_message(log_entry) ==
	"@#{admin.nickname} updated report ##{id} with 'closed' state"
	end

	test "returns 400 when state is unknown", %{conn: conn, id: id} do
	conn =
	conn
	\|> patch("/api/pleroma/admin/reports", %{
	"reports" => [
	%{"state" => "test", "id" => id}
	]
	})

	assert hd(json_response(conn, :bad_request))["error"] == "Unsupported state"
	end

	test "returns 404 when report is not exist", %{conn: conn} do
	conn =
	conn
	\|> patch("/api/pleroma/admin/reports", %{
	"reports" => [
	%{"state" => "closed", "id" => "test"}
	]
	})

	assert hd(json_response(conn, :bad_request))["error"] == "not_found"
	end

	test "updates state of multiple reports", %{
	conn: conn,
	id: id,
	admin: admin,
	second_report_id: second_report_id
	} do
	conn
	\|> patch("/api/pleroma/admin/reports", %{
	"reports" => [
	%{"state" => "resolved", "id" => id},
	%{"state" => "closed", "id" => second_report_id}
	]
	})
	\|> json_response(:no_content)

	activity = Activity.get_by_id(id)
	second_activity = Activity.get_by_id(second_report_id)
	assert activity.data["state"] == "resolved"
	assert second_activity.data["state"] == "closed"

	[first_log_entry, second_log_entry] = Repo.all(ModerationLog)

	assert ModerationLog.get_log_entry_message(first_log_entry) ==
	"@#{admin.nickname} updated report ##{id} with 'resolved' state"

	assert ModerationLog.get_log_entry_message(second_log_entry) ==
	"@#{admin.nickname} updated report ##{second_report_id} with 'closed' state"
	end
	end

	describe "GET /api/pleroma/admin/reports" do
	test "returns empty response when no reports created", %{conn: conn} do
	response =
	conn
	\|> get("/api/pleroma/admin/reports")
	\|> json_response(:ok)

	assert Enum.empty?(response["reports"])
	assert response["total"] == 0
	end

	test "returns reports", %{conn: conn} do
	[reporter, target_user] = insert_pair(:user)
	activity = insert(:note_activity, user: target_user)

	{:ok, %{id: report_id}} =
	CommonAPI.report(reporter, %{
	"account_id" => target_user.id,
	"comment" => "I feel offended",
	"status_ids" => [activity.id]
	})

	response =
	conn
	\|> get("/api/pleroma/admin/reports")
	\|> json_response(:ok)

	[report] = response["reports"]

	assert length(response["reports"]) == 1
	assert report["id"] == report_id

	assert response["total"] == 1
	end

	test "returns reports with specified state", %{conn: conn} do
	[reporter, target_user] = insert_pair(:user)
	activity = insert(:note_activity, user: target_user)

	{:ok, %{id: first_report_id}} =
	CommonAPI.report(reporter, %{
	"account_id" => target_user.id,
	"comment" => "I feel offended",
	"status_ids" => [activity.id]
	})

	{:ok, %{id: second_report_id}} =
	CommonAPI.report(reporter, %{
	"account_id" => target_user.id,
	"comment" => "I don't like this user"
	})

	CommonAPI.update_report_state(second_report_id, "closed")

	response =
	conn
	\|> get("/api/pleroma/admin/reports", %{
	"state" => "open"
	})
	\|> json_response(:ok)

	[open_report] = response["reports"]

	assert length(response["reports"]) == 1
	assert open_report["id"] == first_report_id

	assert response["total"] == 1

	response =
	conn
	\|> get("/api/pleroma/admin/reports", %{
	"state" => "closed"
	})
	\|> json_response(:ok)

	[closed_report] = response["reports"]

	assert length(response["reports"]) == 1
	assert closed_report["id"] == second_report_id

	assert response["total"] == 1

	response =
	conn
	\|> get("/api/pleroma/admin/reports", %{
	"state" => "resolved"
	})
	\|> json_response(:ok)

	assert Enum.empty?(response["reports"])
	assert response["total"] == 0
	end

	test "returns 403 when requested by a non-admin" do
	user = insert(:user)
	token = insert(:oauth_token, user: user)

	conn =
	build_conn()
	\|> assign(:user, user)
	\|> assign(:token, token)
	\|> get("/api/pleroma/admin/reports")

	assert json_response(conn, :forbidden) ==
	%{"error" => "User is not an admin or OAuth admin scope is not granted."}
	end

	test "returns 403 when requested by anonymous" do
	conn = get(build_conn(), "/api/pleroma/admin/reports")

	assert json_response(conn, :forbidden) == %{"error" => "Invalid credentials."}
	end
	end

	describe "GET /api/pleroma/admin/grouped_reports" do
	setup do
	[reporter, target_user] = insert_pair(:user)

	date1 = (DateTime.to_unix(DateTime.utc_now()) + 1000) \|> DateTime.from_unix!()
	date2 = (DateTime.to_unix(DateTime.utc_now()) + 2000) \|> DateTime.from_unix!()
	date3 = (DateTime.to_unix(DateTime.utc_now()) + 3000) \|> DateTime.from_unix!()

	first_status =
	insert(:note_activity, user: target_user, data_attrs: %{"published" => date1})

	second_status =
	insert(:note_activity, user: target_user, data_attrs: %{"published" => date2})

	third_status =
	insert(:note_activity, user: target_user, data_attrs: %{"published" => date3})

	{:ok, first_report} =
	CommonAPI.report(reporter, %{
	"account_id" => target_user.id,
	"status_ids" => [first_status.id, second_status.id, third_status.id]
	})

	{:ok, second_report} =
	CommonAPI.report(reporter, %{
	"account_id" => target_user.id,
	"status_ids" => [first_status.id, second_status.id]
	})

	{:ok, third_report} =
	CommonAPI.report(reporter, %{
	"account_id" => target_user.id,
	"status_ids" => [first_status.id]
	})

	%{
	first_status: Activity.get_by_ap_id_with_object(first_status.data["id"]),
	second_status: Activity.get_by_ap_id_with_object(second_status.data["id"]),
	third_status: Activity.get_by_ap_id_with_object(third_status.data["id"]),
	first_report: first_report,
	first_status_reports: [first_report, second_report, third_report],
	second_status_reports: [first_report, second_report],
	third_status_reports: [first_report],
	target_user: target_user,
	reporter: reporter
	}
	end

	test "returns reports grouped by status", %{
	conn: conn,
	first_status: first_status,
	second_status: second_status,
	third_status: third_status,
	first_status_reports: first_status_reports,
	second_status_reports: second_status_reports,
	third_status_reports: third_status_reports,
	target_user: target_user,
	reporter: reporter
	} do
	response =
	conn
	\|> get("/api/pleroma/admin/grouped_reports")
	\|> json_response(:ok)

	assert length(response["reports"]) == 3

	first_group = Enum.find(response["reports"], &(&1["status"]["id"] == first_status.id))

	second_group = Enum.find(response["reports"], &(&1["status"]["id"] == second_status.id))

	third_group = Enum.find(response["reports"], &(&1["status"]["id"] == third_status.id))

	assert length(first_group["reports"]) == 3
	assert length(second_group["reports"]) == 2
	assert length(third_group["reports"]) == 1

	assert first_group["date"] ==
	Enum.max_by(first_status_reports, fn act ->
	NaiveDateTime.from_iso8601!(act.data["published"])
	end).data["published"]

	assert first_group["status"] ==
	Map.put(
	stringify_keys(StatusView.render("show.json", %{activity: first_status})),
	"deleted",
	false
	)

	assert(first_group["account"]["id"] == target_user.id)

	assert length(first_group["actors"]) == 1
	assert hd(first_group["actors"])["id"] == reporter.id

	assert Enum.map(first_group["reports"], & &1["id"]) --
	Enum.map(first_status_reports, & &1.id) == []

	assert second_group["date"] ==
	Enum.max_by(second_status_reports, fn act ->
	NaiveDateTime.from_iso8601!(act.data["published"])
	end).data["published"]

	assert second_group["status"] ==
	Map.put(
	stringify_keys(StatusView.render("show.json", %{activity: second_status})),
	"deleted",
	false
	)

	assert second_group["account"]["id"] == target_user.id

	assert length(second_group["actors"]) == 1
	assert hd(second_group["actors"])["id"] == reporter.id

	assert Enum.map(second_group["reports"], & &1["id"]) --
	Enum.map(second_status_reports, & &1.id) == []

	assert third_group["date"] ==
	Enum.max_by(third_status_reports, fn act ->
	NaiveDateTime.from_iso8601!(act.data["published"])
	end).data["published"]

	assert third_group["status"] ==
	Map.put(
	stringify_keys(StatusView.render("show.json", %{activity: third_status})),
	"deleted",
	false
	)

	assert third_group["account"]["id"] == target_user.id

	assert length(third_group["actors"]) == 1
	assert hd(third_group["actors"])["id"] == reporter.id

	assert Enum.map(third_group["reports"], & &1["id"]) --
	Enum.map(third_status_reports, & &1.id) == []
	end

	test "reopened report renders status data", %{
	conn: conn,
	first_report: first_report,
	first_status: first_status
	} do
	{:ok, _} = CommonAPI.update_report_state(first_report.id, "resolved")

	response =
	conn
	\|> get("/api/pleroma/admin/grouped_reports")
	\|> json_response(:ok)

	first_group = Enum.find(response["reports"], &(&1["status"]["id"] == first_status.id))

	assert first_group["status"] ==
	Map.put(
	stringify_keys(StatusView.render("show.json", %{activity: first_status})),
	"deleted",
	false
	)
	end

	test "reopened report does not render status data if status has been deleted", %{
	conn: conn,
	first_report: first_report,
	first_status: first_status,
	target_user: target_user
	} do
	{:ok, _} = CommonAPI.update_report_state(first_report.id, "resolved")
	{:ok, _} = CommonAPI.delete(first_status.id, target_user)

	refute Activity.get_by_ap_id(first_status.id)

	response =
	conn
	\|> get("/api/pleroma/admin/grouped_reports")
	\|> json_response(:ok)

	assert Enum.find(response["reports"], &(&1["status"]["deleted"] == true))["status"][
	"deleted"
	] == true

	assert length(Enum.filter(response["reports"], &(&1["status"]["deleted"] == false))) == 2
	end

	test "account not empty if status was deleted", %{
	conn: conn,
	first_report: first_report,
	first_status: first_status,
	target_user: target_user
	} do
	{:ok, _} = CommonAPI.update_report_state(first_report.id, "resolved")
	{:ok, _} = CommonAPI.delete(first_status.id, target_user)

	refute Activity.get_by_ap_id(first_status.id)

	response =
	conn
	\|> get("/api/pleroma/admin/grouped_reports")
	\|> json_response(:ok)

	assert Enum.find(response["reports"], &(&1["status"]["deleted"] == true))["account"]
	end
	end

	describe "PUT /api/pleroma/admin/statuses/:id" do
	setup do
	activity = insert(:note_activity)

	%{id: activity.id}
	end

	test "toggle sensitive flag", %{conn: conn, id: id, admin: admin} do
	response =
	conn
	\|> put("/api/pleroma/admin/statuses/#{id}", %{"sensitive" => "true"})
	\|> json_response(:ok)

	assert response["sensitive"]

	log_entry = Repo.one(ModerationLog)

	assert ModerationLog.get_log_entry_message(log_entry) ==
	"@#{admin.nickname} updated status ##{id}, set sensitive: 'true'"

	response =
	conn
	\|> put("/api/pleroma/admin/statuses/#{id}", %{"sensitive" => "false"})
	\|> json_response(:ok)

	refute response["sensitive"]
	end

	test "change visibility flag", %{conn: conn, id: id, admin: admin} do
	response =
	conn
	\|> put("/api/pleroma/admin/statuses/#{id}", %{"visibility" => "public"})
	\|> json_response(:ok)

	assert response["visibility"] == "public"

	log_entry = Repo.one(ModerationLog)

	assert ModerationLog.get_log_entry_message(log_entry) ==
	"@#{admin.nickname} updated status ##{id}, set visibility: 'public'"

	response =
	conn
	\|> put("/api/pleroma/admin/statuses/#{id}", %{"visibility" => "private"})
	\|> json_response(:ok)

	assert response["visibility"] == "private"

	response =
	conn
	\|> put("/api/pleroma/admin/statuses/#{id}", %{"visibility" => "unlisted"})
	\|> json_response(:ok)

	assert response["visibility"] == "unlisted"
	end

	test "returns 400 when visibility is unknown", %{conn: conn, id: id} do
	conn = put(conn, "/api/pleroma/admin/statuses/#{id}", %{"visibility" => "test"})

	assert json_response(conn, :bad_request) == "Unsupported visibility"
	end
	end

	describe "DELETE /api/pleroma/admin/statuses/:id" do
	setup do
	activity = insert(:note_activity)

	%{id: activity.id}
	end

	test "deletes status", %{conn: conn, id: id, admin: admin} do
	conn
	\|> delete("/api/pleroma/admin/statuses/#{id}")
	\|> json_response(:ok)

	refute Activity.get_by_id(id)

	log_entry = Repo.one(ModerationLog)

	assert ModerationLog.get_log_entry_message(log_entry) ==
	"@#{admin.nickname} deleted status ##{id}"
	end

	test "returns error when status is not exist", %{conn: conn} do
	conn = delete(conn, "/api/pleroma/admin/statuses/test")

	assert json_response(conn, :bad_request) == "Could not delete"
	end
	end

	describe "GET /api/pleroma/admin/config" do
	clear_config(:configurable_from_database) do
	Config.put(:configurable_from_database, true)
	end

	test "when configuration from database is off", %{conn: conn} do
	Config.put(:configurable_from_database, false)
	conn = get(conn, "/api/pleroma/admin/config")

	assert json_response(conn, 400) ==
	"To use this endpoint you need to enable configuration from database."
	end

	test "with settings only in db", %{conn: conn} do
	config1 = insert(:config)
	config2 = insert(:config)

	conn = get(conn, "/api/pleroma/admin/config", %{"only_db" => true})

	%{
	"configs" => [
	%{
	"group" => ":pleroma",
	"key" => key1,
	"value" => _
	},
	%{
	"group" => ":pleroma",
	"key" => key2,
	"value" => _
	}
	]
	} = json_response(conn, 200)

	assert key1 == config1.key
	assert key2 == config2.key
	end

	test "db is added to settings that are in db", %{conn: conn} do
	_config = insert(:config, key: ":instance", value: ConfigDB.to_binary(name: "Some name"))

	%{"configs" => configs} =
	conn
	\|> get("/api/pleroma/admin/config")
	\|> json_response(200)

	[instance_config] =
	Enum.filter(configs, fn %{"group" => group, "key" => key} ->
	group == ":pleroma" and key == ":instance"
	end)

	assert instance_config["db"] == [":name"]
	end

	test "merged default setting with db settings", %{conn: conn} do
	config1 = insert(:config)
	config2 = insert(:config)

	config3 =
	insert(:config,
	value: ConfigDB.to_binary(k1: :v1, k2: :v2)
	)

	%{"configs" => configs} =
	conn
	\|> get("/api/pleroma/admin/config")
	\|> json_response(200)

	assert length(configs) > 3

	received_configs =
	Enum.filter(configs, fn %{"group" => group, "key" => key} ->
	group == ":pleroma" and key in [config1.key, config2.key, config3.key]
	end)

	assert length(received_configs) == 3

	db_keys =
	config3.value
	\|> ConfigDB.from_binary()
	\|> Keyword.keys()
	\|> ConfigDB.convert()

	Enum.each(received_configs, fn %{"value" => value, "db" => db} ->
	assert db in [[config1.key], [config2.key], db_keys]

	assert value in [
	ConfigDB.from_binary_with_convert(config1.value),
	ConfigDB.from_binary_with_convert(config2.value),
	ConfigDB.from_binary_with_convert(config3.value)
	]
	end)
	end

	test "subkeys with full update right merge", %{conn: conn} do
	config1 =
	insert(:config,
	key: ":emoji",
	value: ConfigDB.to_binary(groups: [a: 1, b: 2], key: [a: 1])
	)

	config2 =
	insert(:config,
	key: ":assets",
	value: ConfigDB.to_binary(mascots: [a: 1, b: 2], key: [a: 1])
	)

	%{"configs" => configs} =
	conn
	\|> get("/api/pleroma/admin/config")
	\|> json_response(200)

	vals =
	Enum.filter(configs, fn %{"group" => group, "key" => key} ->
	group == ":pleroma" and key in [config1.key, config2.key]
	end)

	emoji = Enum.find(vals, fn %{"key" => key} -> key == ":emoji" end)
	assets = Enum.find(vals, fn %{"key" => key} -> key == ":assets" end)

	emoji_val = ConfigDB.transform_with_out_binary(emoji["value"])
	assets_val = ConfigDB.transform_with_out_binary(assets["value"])

	assert emoji_val[:groups] == [a: 1, b: 2]
	assert assets_val[:mascots] == [a: 1, b: 2]
	end
	end

	test "POST /api/pleroma/admin/config error", %{conn: conn} do
	conn = post(conn, "/api/pleroma/admin/config", %{"configs" => []})

	assert json_response(conn, 400) ==
	"To use this endpoint you need to enable configuration from database."
	end

	describe "POST /api/pleroma/admin/config" do
	setup do
	http = Application.get_env(:pleroma, :http)

	on_exit(fn ->
	Application.delete_env(:pleroma, :key1)
	Application.delete_env(:pleroma, :key2)
	Application.delete_env(:pleroma, :key3)
	Application.delete_env(:pleroma, :key4)
	Application.delete_env(:pleroma, :keyaa1)
	Application.delete_env(:pleroma, :keyaa2)
	Application.delete_env(:pleroma, Pleroma.Web.Endpoint.NotReal)
	Application.delete_env(:pleroma, Pleroma.Captcha.NotReal)
	Application.put_env(:pleroma, :http, http)
	Application.put_env(:tesla, :adapter, Tesla.Mock)
	Restarter.Pleroma.refresh()
	end)
	end

	clear_config(:configurable_from_database) do
	Config.put(:configurable_from_database, true)
	end

	@tag capture_log: true
	test "create new config setting in db", %{conn: conn} do
	ueberauth = Application.get_env(:ueberauth, Ueberauth)
	on_exit(fn -> Application.put_env(:ueberauth, Ueberauth, ueberauth) end)

	conn =
	post(conn, "/api/pleroma/admin/config", %{
	configs: [
	%{group: ":pleroma", key: ":key1", value: "value1"},
	%{
	group: ":ueberauth",
	key: "Ueberauth",
	value: [%{"tuple" => [":consumer_secret", "aaaa"]}]
	},
	%{
	group: ":pleroma",
	key: ":key2",
	value: %{
	":nested_1" => "nested_value1",
	":nested_2" => [
	%{":nested_22" => "nested_value222"},
	%{":nested_33" => %{":nested_44" => "nested_444"}}
	]
	}
	},
	%{
	group: ":pleroma",
	key: ":key3",
	value: [
	%{"nested_3" => ":nested_3", "nested_33" => "nested_33"},
	%{"nested_4" => true}
	]
	},
	%{
	group: ":pleroma",
	key: ":key4",
	value: %{":nested_5" => ":upload", "endpoint" => "https://example.com"}
	},
	%{
	group: ":idna",
	key: ":key5",
	value: %{"tuple" => ["string", "Pleroma.Captcha.NotReal", []]}
	}
	]
	})

	assert json_response(conn, 200) == %{
	"configs" => [
	%{
	"group" => ":pleroma",
	"key" => ":key1",
	"value" => "value1",
	"db" => [":key1"]
	},
	%{
	"group" => ":ueberauth",
	"key" => "Ueberauth",
	"value" => [%{"tuple" => [":consumer_secret", "aaaa"]}],
	"db" => [":consumer_secret"]
	},
	%{
	"group" => ":pleroma",
	"key" => ":key2",
	"value" => %{
	":nested_1" => "nested_value1",
	":nested_2" => [
	%{":nested_22" => "nested_value222"},
	%{":nested_33" => %{":nested_44" => "nested_444"}}
	]
	},
	"db" => [":key2"]
	},
	%{
	"group" => ":pleroma",
	"key" => ":key3",
	"value" => [
	%{"nested_3" => ":nested_3", "nested_33" => "nested_33"},
	%{"nested_4" => true}
	],
	"db" => [":key3"]
	},
	%{
	"group" => ":pleroma",
	"key" => ":key4",
	"value" => %{"endpoint" => "https://example.com", ":nested_5" => ":upload"},
	"db" => [":key4"]
	},
	%{
	"group" => ":idna",
	"key" => ":key5",
	"value" => %{"tuple" => ["string", "Pleroma.Captcha.NotReal", []]},
	"db" => [":key5"]
	}
	]
	}

	assert Application.get_env(:pleroma, :key1) == "value1"

	assert Application.get_env(:pleroma, :key2) == %{
	nested_1: "nested_value1",
	nested_2: [
	%{nested_22: "nested_value222"},
	%{nested_33: %{nested_44: "nested_444"}}
	]
	}

	assert Application.get_env(:pleroma, :key3) == [
	%{"nested_3" => :nested_3, "nested_33" => "nested_33"},
	%{"nested_4" => true}
	]

	assert Application.get_env(:pleroma, :key4) == %{
	"endpoint" => "https://example.com",
	nested_5: :upload
	}

	assert Application.get_env(:idna, :key5) == {"string", Pleroma.Captcha.NotReal, []}
	end

	test "save configs setting without explicit key", %{conn: conn} do
	level = Application.get_env(:quack, :level)
	meta = Application.get_env(:quack, :meta)
	webhook_url = Application.get_env(:quack, :webhook_url)

	on_exit(fn ->
	Application.put_env(:quack, :level, level)
	Application.put_env(:quack, :meta, meta)
	Application.put_env(:quack, :webhook_url, webhook_url)
	end)

	conn =
	post(conn, "/api/pleroma/admin/config", %{
	configs: [
	%{
	group: ":quack",
	key: ":level",
	value: ":info"
	},
	%{
	group: ":quack",
	key: ":meta",
	value: [":none"]
	},
	%{
	group: ":quack",
	key: ":webhook_url",
	value: "https://hooks.slack.com/services/KEY"
	}
	]
	})

	assert json_response(conn, 200) == %{
	"configs" => [
	%{
	"group" => ":quack",
	"key" => ":level",
	"value" => ":info",
	"db" => [":level"]
	},
	%{
	"group" => ":quack",
	"key" => ":meta",
	"value" => [":none"],
	"db" => [":meta"]
	},
	%{
	"group" => ":quack",
	"key" => ":webhook_url",
	"value" => "https://hooks.slack.com/services/KEY",
	"db" => [":webhook_url"]
	}
	]
	}

	assert Application.get_env(:quack, :level) == :info
	assert Application.get_env(:quack, :meta) == [:none]
	assert Application.get_env(:quack, :webhook_url) == "https://hooks.slack.com/services/KEY"
	end

	test "saving config with partial update", %{conn: conn} do
	config = insert(:config, key: ":key1", value: :erlang.term_to_binary(key1: 1, key2: 2))

	conn =
	post(conn, "/api/pleroma/admin/config", %{
	configs: [
	%{group: config.group, key: config.key, value: [%{"tuple" => [":key3", 3]}]}
	]
	})

	assert json_response(conn, 200) == %{
	"configs" => [
	%{
	"group" => ":pleroma",
	"key" => ":key1",
	"value" => [
	%{"tuple" => [":key1", 1]},
	%{"tuple" => [":key2", 2]},
	%{"tuple" => [":key3", 3]}
	],
	"db" => [":key1", ":key2", ":key3"]
	}
	]
	}
	end

	test "saving config which need pleroma reboot", %{conn: conn} do
	chat = Config.get(:chat)
	on_exit(fn -> Config.put(:chat, chat) end)

	assert post(
	conn,
	"/api/pleroma/admin/config",
	%{
	configs: [
	%{group: ":pleroma", key: ":chat", value: [%{"tuple" => [":enabled", true]}]}
	]
	}
	)
	\|> json_response(200) == %{
	"configs" => [
	%{
	"db" => [":enabled"],
	"group" => ":pleroma",
	"key" => ":chat",
	"value" => [%{"tuple" => [":enabled", true]}]
	}
	],
	"need_reboot" => true
	}

	configs =
	conn
	\|> get("/api/pleroma/admin/config")
	\|> json_response(200)

	assert configs["need_reboot"]

	capture_log(fn ->
	assert conn \|> get("/api/pleroma/admin/restart") \|> json_response(200) == %{}
	end) =~ "pleroma restarted"

	configs =
	conn
	\|> get("/api/pleroma/admin/config")
	\|> json_response(200)

	refute Map.has_key?(configs, "need_reboot")
	end

	test "update setting which need reboot, don't change reboot flag until reboot", %{conn: conn} do
	chat = Config.get(:chat)
	on_exit(fn -> Config.put(:chat, chat) end)

	assert post(
	conn,
	"/api/pleroma/admin/config",
	%{
	configs: [
	%{group: ":pleroma", key: ":chat", value: [%{"tuple" => [":enabled", true]}]}
	]
	}
	)
	\|> json_response(200) == %{
	"configs" => [
	%{
	"db" => [":enabled"],
	"group" => ":pleroma",
	"key" => ":chat",
	"value" => [%{"tuple" => [":enabled", true]}]
	}
	],
	"need_reboot" => true
	}

	assert post(conn, "/api/pleroma/admin/config", %{
	configs: [
	%{group: ":pleroma", key: ":key1", value: [%{"tuple" => [":key3", 3]}]}
	]
	})
	\|> json_response(200) == %{
	"configs" => [
	%{
	"group" => ":pleroma",
	"key" => ":key1",
	"value" => [
	%{"tuple" => [":key3", 3]}
	],
	"db" => [":key3"]
	}
	],
	"need_reboot" => true
	}

	capture_log(fn ->
	assert conn \|> get("/api/pleroma/admin/restart") \|> json_response(200) == %{}
	end) =~ "pleroma restarted"

	configs =
	conn
	\|> get("/api/pleroma/admin/config")
	\|> json_response(200)

	refute Map.has_key?(configs, "need_reboot")
	end

	test "saving config with nested merge", %{conn: conn} do
	config =
	insert(:config, key: ":key1", value: :erlang.term_to_binary(key1: 1, key2: [k1: 1, k2: 2]))

	conn =
	post(conn, "/api/pleroma/admin/config", %{
	configs: [
	%{
	group: config.group,
	key: config.key,
	value: [
	%{"tuple" => [":key3", 3]},
	%{
	"tuple" => [
	":key2",
	[
	%{"tuple" => [":k2", 1]},
	%{"tuple" => [":k3", 3]}
	]
	]
	}
	]
	}
	]
	})

	assert json_response(conn, 200) == %{
	"configs" => [
	%{
	"group" => ":pleroma",
	"key" => ":key1",
	"value" => [
	%{"tuple" => [":key1", 1]},
	%{"tuple" => [":key3", 3]},
	%{
	"tuple" => [
	":key2",
	[
	%{"tuple" => [":k1", 1]},
	%{"tuple" => [":k2", 1]},
	%{"tuple" => [":k3", 3]}
	]
	]
	}
	],
	"db" => [":key1", ":key3", ":key2"]
	}
	]
	}
	end

	test "saving special atoms", %{conn: conn} do
	conn =
	post(conn, "/api/pleroma/admin/config", %{
	"configs" => [
	%{
	"group" => ":pleroma",
	"key" => ":key1",
	"value" => [
	%{
	"tuple" => [
	":ssl_options",
	[%{"tuple" => [":versions", [":tlsv1", ":tlsv1.1", ":tlsv1.2"]]}]
	]
	}
	]
	}
	]
	})

	assert json_response(conn, 200) == %{
	"configs" => [
	%{
	"group" => ":pleroma",
	"key" => ":key1",
	"value" => [
	%{
	"tuple" => [
	":ssl_options",
	[%{"tuple" => [":versions", [":tlsv1", ":tlsv1.1", ":tlsv1.2"]]}]
	]
	}
	],
	"db" => [":ssl_options"]
	}
	]
	}

	assert Application.get_env(:pleroma, :key1) == [
	ssl_options: [versions: [:tlsv1, :"tlsv1.1", :"tlsv1.2"]]
	]
	end

	test "saving full setting if value is in full_key_update list", %{conn: conn} do
	backends = Application.get_env(:logger, :backends)
	on_exit(fn -> Application.put_env(:logger, :backends, backends) end)

	config =
	insert(:config,
	group: ":logger",
	key: ":backends",
	value: :erlang.term_to_binary([])
	)

	conn =
	post(conn, "/api/pleroma/admin/config", %{
	configs: [
	%{
	group: config.group,
	key: config.key,
	value: [":console", %{"tuple" => ["ExSyslogger", ":ex_syslogger"]}]
	}
	]
	})

	assert json_response(conn, 200) == %{
	"configs" => [
	%{
	"group" => ":logger",
	"key" => ":backends",
	"value" => [
	":console",
	%{"tuple" => ["ExSyslogger", ":ex_syslogger"]}
	],
	"db" => [":backends"]
	}
	]
	}

	assert Application.get_env(:logger, :backends) == [
	:console,
	{ExSyslogger, :ex_syslogger}
	]

	capture_log(fn ->
	require Logger
	Logger.warn("Ooops...")
	end) =~ "Ooops..."
	end

	test "saving full setting if value is not keyword", %{conn: conn} do
	config =
	insert(:config,
	group: ":tesla",
	key: ":adapter",
	value: :erlang.term_to_binary(Tesla.Adapter.Hackey)
	)

	conn =
	post(conn, "/api/pleroma/admin/config", %{
	configs: [
	%{group: config.group, key: config.key, value: "Tesla.Adapter.Httpc"}
	]
	})

	assert json_response(conn, 200) == %{
	"configs" => [
	%{
	"group" => ":tesla",
	"key" => ":adapter",
	"value" => "Tesla.Adapter.Httpc",
	"db" => [":adapter"]
	}
	]
	}
	end

	test "update config setting & delete with fallback to default value", %{
	conn: conn,
	admin: admin,
	token: token
	} do
	ueberauth = Application.get_env(:ueberauth, Ueberauth)
	config1 = insert(:config, key: ":keyaa1")
	config2 = insert(:config, key: ":keyaa2")

	config3 =
	insert(:config,
	group: ":ueberauth",
	key: "Ueberauth"
	)

	conn =
	post(conn, "/api/pleroma/admin/config", %{
	configs: [
	%{group: config1.group, key: config1.key, value: "another_value"},
	%{group: config2.group, key: config2.key, value: "another_value"}
	]
	})

	assert json_response(conn, 200) == %{
	"configs" => [
	%{
	"group" => ":pleroma",
	"key" => config1.key,
	"value" => "another_value",
	"db" => [":keyaa1"]
	},
	%{
	"group" => ":pleroma",
	"key" => config2.key,
	"value" => "another_value",
	"db" => [":keyaa2"]
	}
	]
	}

	assert Application.get_env(:pleroma, :keyaa1) == "another_value"
	assert Application.get_env(:pleroma, :keyaa2) == "another_value"
	assert Application.get_env(:ueberauth, Ueberauth) == ConfigDB.from_binary(config3.value)

	conn =
	build_conn()
	\|> assign(:user, admin)
	\|> assign(:token, token)
	\|> post("/api/pleroma/admin/config", %{
	configs: [
	%{group: config2.group, key: config2.key, delete: true},
	%{
	group: ":ueberauth",
	key: "Ueberauth",
	delete: true
	}
	]
	})

	assert json_response(conn, 200) == %{
	"configs" => []
	}

	assert Application.get_env(:ueberauth, Ueberauth) == ueberauth
	refute Keyword.has_key?(Application.get_all_env(:pleroma), :keyaa2)
	end

	test "common config example", %{conn: conn} do
	adapter = Application.get_env(:tesla, :adapter)
	on_exit(fn -> Application.put_env(:tesla, :adapter, adapter) end)

	conn =
	post(conn, "/api/pleroma/admin/config", %{
	configs: [
	%{
	"group" => ":pleroma",
	"key" => "Pleroma.Captcha.NotReal",
	"value" => [
	%{"tuple" => [":enabled", false]},
	%{"tuple" => [":method", "Pleroma.Captcha.Kocaptcha"]},
	%{"tuple" => [":seconds_valid", 60]},
	%{"tuple" => [":path", ""]},
	%{"tuple" => [":key1", nil]},
	%{"tuple" => [":partial_chain", "&:hackney_connect.partial_chain/1"]},
	%{"tuple" => [":regex1", "~r/https:\/\/example.com/"]},
	%{"tuple" => [":regex2", "~r/https:\/\/example.com/u"]},
	%{"tuple" => [":regex3", "~r/https:\/\/example.com/i"]},
	%{"tuple" => [":regex4", "~r/https:\/\/example.com/s"]},
	%{"tuple" => [":name", "Pleroma"]}
	]
	},
	%{
	"group" => ":tesla",
	"key" => ":adapter",
	"value" => "Tesla.Adapter.Httpc"
	}
	]
	})

	assert Application.get_env(:tesla, :adapter) == Tesla.Adapter.Httpc
	assert Config.get([Pleroma.Captcha.NotReal, :name]) == "Pleroma"

	assert json_response(conn, 200) == %{
	"configs" => [
	%{
	"group" => ":pleroma",
	"key" => "Pleroma.Captcha.NotReal",
	"value" => [
	%{"tuple" => [":enabled", false]},
	%{"tuple" => [":method", "Pleroma.Captcha.Kocaptcha"]},
	%{"tuple" => [":seconds_valid", 60]},
	%{"tuple" => [":path", ""]},
	%{"tuple" => [":key1", nil]},
	%{"tuple" => [":partial_chain", "&:hackney_connect.partial_chain/1"]},
	%{"tuple" => [":regex1", "~r/https:\\/\\/example.com/"]},
	%{"tuple" => [":regex2", "~r/https:\\/\\/example.com/u"]},
	%{"tuple" => [":regex3", "~r/https:\\/\\/example.com/i"]},
	%{"tuple" => [":regex4", "~r/https:\\/\\/example.com/s"]},
	%{"tuple" => [":name", "Pleroma"]}
	],
	"db" => [
	":enabled",
	":method",
	":seconds_valid",
	":path",
	":key1",
	":partial_chain",
	":regex1",
	":regex2",
	":regex3",
	":regex4",
	":name"
	]
	},
	%{
	"group" => ":tesla",
	"key" => ":adapter",
	"value" => "Tesla.Adapter.Httpc",
	"db" => [":adapter"]
	}
	]
	}
	end

	test "tuples with more than two values", %{conn: conn} do
	conn =
	post(conn, "/api/pleroma/admin/config", %{
	configs: [
	%{
	"group" => ":pleroma",
	"key" => "Pleroma.Web.Endpoint.NotReal",
	"value" => [
	%{
	"tuple" => [
	":http",
	[
	%{
	"tuple" => [
	":key2",
	[
	%{
	"tuple" => [
	":_",
	[
	%{
	"tuple" => [
	"/api/v1/streaming",
	"Pleroma.Web.MastodonAPI.WebsocketHandler",
	[]
	]
	},
	%{
	"tuple" => [
	"/websocket",
	"Phoenix.Endpoint.CowboyWebSocket",
	%{
	"tuple" => [
	"Phoenix.Transports.WebSocket",
	%{
	"tuple" => [
	"Pleroma.Web.Endpoint",
	"Pleroma.Web.UserSocket",
	[]
	]
	}
	]
	}
	]
	},
	%{
	"tuple" => [
	":_",
	"Phoenix.Endpoint.Cowboy2Handler",
	%{"tuple" => ["Pleroma.Web.Endpoint", []]}
	]
	}
	]
	]
	}
	]
	]
	}
	]
	]
	}
	]
	}
	]
	})

	assert json_response(conn, 200) == %{
	"configs" => [
	%{
	"group" => ":pleroma",
	"key" => "Pleroma.Web.Endpoint.NotReal",
	"value" => [
	%{
	"tuple" => [
	":http",
	[
	%{
	"tuple" => [
	":key2",
	[
	%{
	"tuple" => [
	":_",
	[
	%{
	"tuple" => [
	"/api/v1/streaming",
	"Pleroma.Web.MastodonAPI.WebsocketHandler",
	[]
	]
	},
	%{
	"tuple" => [
	"/websocket",
	"Phoenix.Endpoint.CowboyWebSocket",
	%{
	"tuple" => [
	"Phoenix.Transports.WebSocket",
	%{
	"tuple" => [
	"Pleroma.Web.Endpoint",
	"Pleroma.Web.UserSocket",
	[]
	]
	}
	]
	}
	]
	},
	%{
	"tuple" => [
	":_",
	"Phoenix.Endpoint.Cowboy2Handler",
	%{"tuple" => ["Pleroma.Web.Endpoint", []]}
	]
	}
	]
	]
	}
	]
	]
	}
	]
	]
	}
	],
	"db" => [":http"]
	}
	]
	}
	end

	test "settings with nesting map", %{conn: conn} do
	conn =
	post(conn, "/api/pleroma/admin/config", %{
	configs: [
	%{
	"group" => ":pleroma",
	"key" => ":key1",
	"value" => [
	%{"tuple" => [":key2", "some_val"]},
	%{
	"tuple" => [
	":key3",
	%{
	":max_options" => 20,
	":max_option_chars" => 200,
	":min_expiration" => 0,
	":max_expiration" => 31_536_000,
	"nested" => %{
	":max_options" => 20,
	":max_option_chars" => 200,
	":min_expiration" => 0,
	":max_expiration" => 31_536_000
	}
	}
	]
	}
	]
	}
	]
	})

	assert json_response(conn, 200) ==
	%{
	"configs" => [
	%{
	"group" => ":pleroma",
	"key" => ":key1",
	"value" => [
	%{"tuple" => [":key2", "some_val"]},
	%{
	"tuple" => [
	":key3",
	%{
	":max_expiration" => 31_536_000,
	":max_option_chars" => 200,
	":max_options" => 20,
	":min_expiration" => 0,
	"nested" => %{
	":max_expiration" => 31_536_000,
	":max_option_chars" => 200,
	":max_options" => 20,
	":min_expiration" => 0
	}
	}
	]
	}
	],
	"db" => [":key2", ":key3"]
	}
	]
	}
	end

	test "value as map", %{conn: conn} do
	conn =
	post(conn, "/api/pleroma/admin/config", %{
	configs: [
	%{
	"group" => ":pleroma",
	"key" => ":key1",
	"value" => %{"key" => "some_val"}
	}
	]
	})

	assert json_response(conn, 200) ==
	%{
	"configs" => [
	%{
	"group" => ":pleroma",
	"key" => ":key1",
	"value" => %{"key" => "some_val"},
	"db" => [":key1"]
	}
	]
	}
	end

	test "queues key as atom", %{conn: conn} do
	conn =
	post(conn, "/api/pleroma/admin/config", %{
	configs: [
	%{
	"group" => ":oban",
	"key" => ":queues",
	"value" => [
	%{"tuple" => [":federator_incoming", 50]},
	%{"tuple" => [":federator_outgoing", 50]},
	%{"tuple" => [":web_push", 50]},
	%{"tuple" => [":mailer", 10]},
	%{"tuple" => [":transmogrifier", 20]},
	%{"tuple" => [":scheduled_activities", 10]},
	%{"tuple" => [":background", 5]}
	]
	}
	]
	})

	assert json_response(conn, 200) == %{
	"configs" => [
	%{
	"group" => ":oban",
	"key" => ":queues",
	"value" => [
	%{"tuple" => [":federator_incoming", 50]},
	%{"tuple" => [":federator_outgoing", 50]},
	%{"tuple" => [":web_push", 50]},
	%{"tuple" => [":mailer", 10]},
	%{"tuple" => [":transmogrifier", 20]},
	%{"tuple" => [":scheduled_activities", 10]},
	%{"tuple" => [":background", 5]}
	],
	"db" => [
	":federator_incoming",
	":federator_outgoing",
	":web_push",
	":mailer",
	":transmogrifier",
	":scheduled_activities",
	":background"
	]
	}
	]
	}
	end

	test "delete part of settings by atom subkeys", %{conn: conn} do
	config =
	insert(:config,
	key: ":keyaa1",
	value: :erlang.term_to_binary(subkey1: "val1", subkey2: "val2", subkey3: "val3")
	)

	conn =
	post(conn, "/api/pleroma/admin/config", %{
	configs: [
	%{
	group: config.group,
	key: config.key,
	subkeys: [":subkey1", ":subkey3"],
	delete: true
	}
	]
	})

	assert json_response(conn, 200) == %{
	"configs" => [
	%{
	"group" => ":pleroma",
	"key" => ":keyaa1",
	"value" => [%{"tuple" => [":subkey2", "val2"]}],
	"db" => [":subkey2"]
	}
	]
	}
	end

	test "proxy tuple localhost", %{conn: conn} do
	conn =
	post(conn, "/api/pleroma/admin/config", %{
	configs: [
	%{
	group: ":pleroma",
	key: ":http",
	value: [
	%{"tuple" => [":proxy_url", %{"tuple" => [":socks5", "localhost", 1234]}]},
	%{"tuple" => [":send_user_agent", false]}
	]
	}
	]
	})

	assert json_response(conn, 200) == %{
	"configs" => [
	%{
	"group" => ":pleroma",
	"key" => ":http",
	"value" => [
	%{"tuple" => [":proxy_url", %{"tuple" => [":socks5", "localhost", 1234]}]},
	%{"tuple" => [":send_user_agent", false]}
	],
	"db" => [":proxy_url", ":send_user_agent"]
	}
	]
	}
	end

	test "proxy tuple domain", %{conn: conn} do
	conn =
	post(conn, "/api/pleroma/admin/config", %{
	configs: [
	%{
	group: ":pleroma",
	key: ":http",
	value: [
	%{"tuple" => [":proxy_url", %{"tuple" => [":socks5", "domain.com", 1234]}]},
	%{"tuple" => [":send_user_agent", false]}
	]
	}
	]
	})

	assert json_response(conn, 200) == %{
	"configs" => [
	%{
	"group" => ":pleroma",
	"key" => ":http",
	"value" => [
	%{"tuple" => [":proxy_url", %{"tuple" => [":socks5", "domain.com", 1234]}]},
	%{"tuple" => [":send_user_agent", false]}
	],
	"db" => [":proxy_url", ":send_user_agent"]
	}
	]
	}
	end

	test "proxy tuple ip", %{conn: conn} do
	conn =
	post(conn, "/api/pleroma/admin/config", %{
	configs: [
	%{
	group: ":pleroma",
	key: ":http",
	value: [
	%{"tuple" => [":proxy_url", %{"tuple" => [":socks5", "127.0.0.1", 1234]}]},
	%{"tuple" => [":send_user_agent", false]}
	]
	}
	]
	})

	assert json_response(conn, 200) == %{
	"configs" => [
	%{
	"group" => ":pleroma",
	"key" => ":http",
	"value" => [
	%{"tuple" => [":proxy_url", %{"tuple" => [":socks5", "127.0.0.1", 1234]}]},
	%{"tuple" => [":send_user_agent", false]}
	],
	"db" => [":proxy_url", ":send_user_agent"]
	}
	]
	}
	end
	end

	describe "GET /api/pleroma/admin/restart" do
	clear_config(:configurable_from_database) do
	Config.put(:configurable_from_database, true)
	end

	test "pleroma restarts", %{conn: conn} do
	capture_log(fn ->
	assert conn \|> get("/api/pleroma/admin/restart") \|> json_response(200) == %{}
	end) =~ "pleroma restarted"

	refute Restarter.Pleroma.need_reboot?()
	end
	end

	describe "GET /api/pleroma/admin/users/:nickname/statuses" do
	setup do
	user = insert(:user)

	date1 = (DateTime.to_unix(DateTime.utc_now()) + 2000) \|> DateTime.from_unix!()
	date2 = (DateTime.to_unix(DateTime.utc_now()) + 1000) \|> DateTime.from_unix!()
	date3 = (DateTime.to_unix(DateTime.utc_now()) + 3000) \|> DateTime.from_unix!()

	insert(:note_activity, user: user, published: date1)
	insert(:note_activity, user: user, published: date2)
	insert(:note_activity, user: user, published: date3)

	%{user: user}
	end

	test "renders user's statuses", %{conn: conn, user: user} do
	conn = get(conn, "/api/pleroma/admin/users/#{user.nickname}/statuses")

	assert json_response(conn, 200) \|> length() == 3
	end

	test "renders user's statuses with a limit", %{conn: conn, user: user} do
	conn = get(conn, "/api/pleroma/admin/users/#{user.nickname}/statuses?page_size=2")

	assert json_response(conn, 200) \|> length() == 2
	end

	test "doesn't return private statuses by default", %{conn: conn, user: user} do
	{:ok, _private_status} =
	CommonAPI.post(user, %{"status" => "private", "visibility" => "private"})

	{:ok, _public_status} =
	CommonAPI.post(user, %{"status" => "public", "visibility" => "public"})

	conn = get(conn, "/api/pleroma/admin/users/#{user.nickname}/statuses")

	assert json_response(conn, 200) \|> length() == 4
	end

	test "returns private statuses with godmode on", %{conn: conn, user: user} do
	{:ok, _private_status} =
	CommonAPI.post(user, %{"status" => "private", "visibility" => "private"})

	{:ok, _public_status} =
	CommonAPI.post(user, %{"status" => "public", "visibility" => "public"})

	conn = get(conn, "/api/pleroma/admin/users/#{user.nickname}/statuses?godmode=true")

	assert json_response(conn, 200) \|> length() == 5
	end
	end

	describe "GET /api/pleroma/admin/moderation_log" do
	setup do
	moderator = insert(:user, is_moderator: true)

	%{moderator: moderator}
	end

	test "returns the log", %{conn: conn, admin: admin} do
	Repo.insert(%ModerationLog{
	data: %{
	actor: %{
	"id" => admin.id,
	"nickname" => admin.nickname,
	"type" => "user"
	},
	action: "relay_follow",
	target: "https://example.org/relay"
	},
	inserted_at: NaiveDateTime.truncate(~N[2017-08-15 15:47:06.597036], :second)
	})

	Repo.insert(%ModerationLog{
	data: %{
	actor: %{
	"id" => admin.id,
	"nickname" => admin.nickname,
	"type" => "user"
	},
	action: "relay_unfollow",
	target: "https://example.org/relay"
	},
	inserted_at: NaiveDateTime.truncate(~N[2017-08-16 15:47:06.597036], :second)
	})

	conn = get(conn, "/api/pleroma/admin/moderation_log")

	response = json_response(conn, 200)
	[first_entry, second_entry] = response["items"]

	assert response["total"] == 2
	assert first_entry["data"]["action"] == "relay_unfollow"

	assert first_entry["message"] ==
	"@#{admin.nickname} unfollowed relay: https://example.org/relay"

	assert second_entry["data"]["action"] == "relay_follow"

	assert second_entry["message"] ==
	"@#{admin.nickname} followed relay: https://example.org/relay"
	end

	test "returns the log with pagination", %{conn: conn, admin: admin} do
	Repo.insert(%ModerationLog{
	data: %{
	actor: %{
	"id" => admin.id,
	"nickname" => admin.nickname,
	"type" => "user"
	},
	action: "relay_follow",
	target: "https://example.org/relay"
	},
	inserted_at: NaiveDateTime.truncate(~N[2017-08-15 15:47:06.597036], :second)
	})

	Repo.insert(%ModerationLog{
	data: %{
	actor: %{
	"id" => admin.id,
	"nickname" => admin.nickname,
	"type" => "user"
	},
	action: "relay_unfollow",
	target: "https://example.org/relay"
	},
	inserted_at: NaiveDateTime.truncate(~N[2017-08-16 15:47:06.597036], :second)
	})

	conn1 = get(conn, "/api/pleroma/admin/moderation_log?page_size=1&page=1")

	response1 = json_response(conn1, 200)
	[first_entry] = response1["items"]

	assert response1["total"] == 2
	assert response1["items"] \|> length() == 1
	assert first_entry["data"]["action"] == "relay_unfollow"

	assert first_entry["message"] ==
	"@#{admin.nickname} unfollowed relay: https://example.org/relay"

	conn2 = get(conn, "/api/pleroma/admin/moderation_log?page_size=1&page=2")

	response2 = json_response(conn2, 200)
	[second_entry] = response2["items"]

	assert response2["total"] == 2
	assert response2["items"] \|> length() == 1
	assert second_entry["data"]["action"] == "relay_follow"

	assert second_entry["message"] ==
	"@#{admin.nickname} followed relay: https://example.org/relay"
	end

	test "filters log by date", %{conn: conn, admin: admin} do
	first_date = "2017-08-15T15:47:06Z"
	second_date = "2017-08-20T15:47:06Z"

	Repo.insert(%ModerationLog{
	data: %{
	actor: %{
	"id" => admin.id,
	"nickname" => admin.nickname,
	"type" => "user"
	},
	action: "relay_follow",
	target: "https://example.org/relay"
	},
	inserted_at: NaiveDateTime.from_iso8601!(first_date)
	})

	Repo.insert(%ModerationLog{
	data: %{
	actor: %{
	"id" => admin.id,
	"nickname" => admin.nickname,
	"type" => "user"
	},
	action: "relay_unfollow",
	target: "https://example.org/relay"
	},
	inserted_at: NaiveDateTime.from_iso8601!(second_date)
	})

	conn1 =
	get(
	conn,
	"/api/pleroma/admin/moderation_log?start_date=#{second_date}"
	)

	response1 = json_response(conn1, 200)
	[first_entry] = response1["items"]

	assert response1["total"] == 1
	assert first_entry["data"]["action"] == "relay_unfollow"

	assert first_entry["message"] ==
	"@#{admin.nickname} unfollowed relay: https://example.org/relay"
	end

	test "returns log filtered by user", %{conn: conn, admin: admin, moderator: moderator} do
	Repo.insert(%ModerationLog{
	data: %{
	actor: %{
	"id" => admin.id,
	"nickname" => admin.nickname,
	"type" => "user"
	},
	action: "relay_follow",
	target: "https://example.org/relay"
	}
	})

	Repo.insert(%ModerationLog{
	data: %{
	actor: %{
	"id" => moderator.id,
	"nickname" => moderator.nickname,
	"type" => "user"
	},
	action: "relay_unfollow",
	target: "https://example.org/relay"
	}
	})

	conn1 = get(conn, "/api/pleroma/admin/moderation_log?user_id=#{moderator.id}")

	response1 = json_response(conn1, 200)
	[first_entry] = response1["items"]

	assert response1["total"] == 1
	assert get_in(first_entry, ["data", "actor", "id"]) == moderator.id
	end

	test "returns log filtered by search", %{conn: conn, moderator: moderator} do
	ModerationLog.insert_log(%{
	actor: moderator,
	action: "relay_follow",
	target: "https://example.org/relay"
	})

	ModerationLog.insert_log(%{
	actor: moderator,
	action: "relay_unfollow",
	target: "https://example.org/relay"
	})

	conn1 = get(conn, "/api/pleroma/admin/moderation_log?search=unfo")

	response1 = json_response(conn1, 200)
	[first_entry] = response1["items"]

	assert response1["total"] == 1

	assert get_in(first_entry, ["data", "message"]) ==
	"@#{moderator.nickname} unfollowed relay: https://example.org/relay"
	end
	end

	describe "PATCH /users/:nickname/force_password_reset" do
	test "sets password_reset_pending to true", %{conn: conn} do
	user = insert(:user)
	assert user.password_reset_pending == false

	conn =
	patch(conn, "/api/pleroma/admin/users/force_password_reset", %{nicknames: [user.nickname]})

	assert json_response(conn, 204) == ""

	ObanHelpers.perform_all()

	assert User.get_by_id(user.id).password_reset_pending == true
	end
	end

	describe "relays" do
	test "POST /relay", %{conn: conn, admin: admin} do
	conn =
	post(conn, "/api/pleroma/admin/relay", %{
	relay_url: "http://mastodon.example.org/users/admin"
	})

	assert json_response(conn, 200) == "http://mastodon.example.org/users/admin"

	log_entry = Repo.one(ModerationLog)

	assert ModerationLog.get_log_entry_message(log_entry) ==
	"@#{admin.nickname} followed relay: http://mastodon.example.org/users/admin"
	end

	test "GET /relay", %{conn: conn} do
	relay_user = Relay.get_actor()

	["http://mastodon.example.org/users/admin", "https://mstdn.io/users/mayuutann"]
	\|> Enum.each(fn ap_id ->
	{:ok, user} = User.get_or_fetch_by_ap_id(ap_id)
	User.follow(relay_user, user)
	end)

	conn = get(conn, "/api/pleroma/admin/relay")

	assert json_response(conn, 200)["relays"] -- ["mastodon.example.org", "mstdn.io"] == []
	end

	test "DELETE /relay", %{conn: conn, admin: admin} do
	post(conn, "/api/pleroma/admin/relay", %{
	relay_url: "http://mastodon.example.org/users/admin"
	})

	conn =
	delete(conn, "/api/pleroma/admin/relay", %{
	relay_url: "http://mastodon.example.org/users/admin"
	})

	assert json_response(conn, 200) == "http://mastodon.example.org/users/admin"

	[log_entry_one, log_entry_two] = Repo.all(ModerationLog)

	assert ModerationLog.get_log_entry_message(log_entry_one) ==
	"@#{admin.nickname} followed relay: http://mastodon.example.org/users/admin"

	assert ModerationLog.get_log_entry_message(log_entry_two) ==
	"@#{admin.nickname} unfollowed relay: http://mastodon.example.org/users/admin"
	end
	end

	describe "instances" do
	test "GET /instances/:instance/statuses", %{conn: conn} do
	user = insert(:user, local: false, nickname: "archaeme@archae.me")
	user2 = insert(:user, local: false, nickname: "test@test.com")
	insert_pair(:note_activity, user: user)
	insert(:note_activity, user: user2)

	ret_conn = get(conn, "/api/pleroma/admin/instances/archae.me/statuses")

	response = json_response(ret_conn, 200)

	assert length(response) == 2

	ret_conn = get(conn, "/api/pleroma/admin/instances/test.com/statuses")

	response = json_response(ret_conn, 200)

	assert length(response) == 1

	ret_conn = get(conn, "/api/pleroma/admin/instances/nonexistent.com/statuses")

	response = json_response(ret_conn, 200)

	assert Enum.empty?(response)
	end
	end

	describe "PATCH /confirm_email" do
	test "it confirms emails of two users", %{conn: conn, admin: admin} do
	[first_user, second_user] = insert_pair(:user, confirmation_pending: true)

	assert first_user.confirmation_pending == true
	assert second_user.confirmation_pending == true

	ret_conn =
	patch(conn, "/api/pleroma/admin/users/confirm_email", %{
	nicknames: [
	first_user.nickname,
	second_user.nickname
	]
	})

	assert ret_conn.status == 200

	assert first_user.confirmation_pending == true
	assert second_user.confirmation_pending == true

	log_entry = Repo.one(ModerationLog)

	assert ModerationLog.get_log_entry_message(log_entry) ==
	"@#{admin.nickname} confirmed email for users: @#{first_user.nickname}, @#{
	second_user.nickname
	}"
	end
	end

	describe "PATCH /resend_confirmation_email" do
	test "it resend emails for two users", %{conn: conn, admin: admin} do
	[first_user, second_user] = insert_pair(:user, confirmation_pending: true)

	ret_conn =
	patch(conn, "/api/pleroma/admin/users/resend_confirmation_email", %{
	nicknames: [
	first_user.nickname,
	second_user.nickname
	]
	})

	assert ret_conn.status == 200

	log_entry = Repo.one(ModerationLog)

	assert ModerationLog.get_log_entry_message(log_entry) ==
	"@#{admin.nickname} re-sent confirmation email for users: @#{first_user.nickname}, @#{
	second_user.nickname
	}"
	end
	end

	describe "POST /reports/:id/notes" do
	setup %{conn: conn, admin: admin} do
	[reporter, target_user] = insert_pair(:user)
	activity = insert(:note_activity, user: target_user)

	{:ok, %{id: report_id}} =
	CommonAPI.report(reporter, %{
	"account_id" => target_user.id,
	"comment" => "I feel offended",
	"status_ids" => [activity.id]
	})

	post(conn, "/api/pleroma/admin/reports/#{report_id}/notes", %{
	content: "this is disgusting!"
	})

	post(conn, "/api/pleroma/admin/reports/#{report_id}/notes", %{
	content: "this is disgusting2!"
	})

	%{
	admin_id: admin.id,
	report_id: report_id
	}
	end

	test "it creates report note", %{admin_id: admin_id, report_id: report_id} do
	[note, _] = Repo.all(ReportNote)

	assert %{
	activity_id: ^report_id,
	content: "this is disgusting!",
	user_id: ^admin_id
	} = note
	end

	test "it returns reports with notes", %{conn: conn, admin: admin} do
	conn = get(conn, "/api/pleroma/admin/reports")

	response = json_response(conn, 200)
	notes = hd(response["reports"])["notes"]
	[note, _] = notes

	assert note["user"]["nickname"] == admin.nickname
	assert note["content"] == "this is disgusting!"
	assert note["created_at"]
	assert response["total"] == 1
	end

	test "it deletes the note", %{conn: conn, report_id: report_id} do
	assert ReportNote \|> Repo.all() \|> length() == 2

	[note, _] = Repo.all(ReportNote)

	delete(conn, "/api/pleroma/admin/reports/#{report_id}/notes/#{note.id}")

	assert ReportNote \|> Repo.all() \|> length() == 1
	end
	end

	test "GET /api/pleroma/admin/config/descriptions", %{conn: conn} do
	admin = insert(:user, is_admin: true)

	conn =
	assign(conn, :user, admin)
	\|> get("/api/pleroma/admin/config/descriptions")

	assert [child \| _others] = json_response(conn, 200)

	assert child["children"]
	assert child["key"]
	assert String.starts_with?(child["group"], ":")
	assert child["description"]
	end
	+
	+ describe "/api/pleroma/admin/stats" do
	+ test "status visibility count", %{conn: conn} do
	+ admin = insert(:user, is_admin: true)
	+ user = insert(:user)
	+ CommonAPI.post(user, %{"visibility" => "public", "status" => "hey"})
	+ CommonAPI.post(user, %{"visibility" => "unlisted", "status" => "hey"})
	+ CommonAPI.post(user, %{"visibility" => "unlisted", "status" => "hey"})
	+
	+ response =
	+ conn
	+ \|> assign(:user, admin)
	+ \|> get("/api/pleroma/admin/stats")
	+ \|> json_response(200)
	+
	+ assert %{"direct" => 0, "private" => 0, "public" => 1, "unlisted" => 2} =
	+ response["status_visibility"]
	+ end
	+ end
	end

	# Needed for testing
	defmodule Pleroma.Web.Endpoint.NotReal do
	end

	defmodule Pleroma.Captcha.NotReal do
	end
	diff --git a/test/web/oauth/oauth_controller_test.exs b/test/web/oauth/oauth_controller_test.exs
	index 2bdbd3ee6..978681d84 100644
	--- a/test/web/oauth/oauth_controller_test.exs
	+++ b/test/web/oauth/oauth_controller_test.exs
	@@ -1,1134 +1,1134 @@
	# Pleroma: A lightweight social networking server
	# Copyright © 2017-2019 Pleroma Authors <https://pleroma.social/>
	# SPDX-License-Identifier: AGPL-3.0-only

	defmodule Pleroma.Web.OAuth.OAuthControllerTest do
	use Pleroma.Web.ConnCase
	import Pleroma.Factory

	alias Pleroma.Storage.Repo
	alias Pleroma.User
	alias Pleroma.Web.OAuth.Authorization
	alias Pleroma.Web.OAuth.OAuthController
	alias Pleroma.Web.OAuth.Token

	@session_opts [
	store: :cookie,
	key: "_test",
	signing_salt: "cooldude"
	]

	clear_config([:instance, :account_activation_required])

	describe "in OAuth consumer mode, " do
	setup do
	[
	app: insert(:oauth_app),
	conn:
	build_conn()
	\|> Plug.Session.call(Plug.Session.init(@session_opts))
	\|> fetch_session()
	]
	end

	clear_config([:auth, :oauth_consumer_strategies]) do
	Pleroma.Config.put(
	[:auth, :oauth_consumer_strategies],
	~w(twitter facebook)
	)
	end

	test "GET /oauth/authorize renders auth forms, including OAuth consumer form", %{
	app: app,
	conn: conn
	} do
	conn =
	get(
	conn,
	"/oauth/authorize",
	%{
	"response_type" => "code",
	"client_id" => app.client_id,
	"redirect_uri" => OAuthController.default_redirect_uri(app),
	"scope" => "read"
	}
	)

	assert response = html_response(conn, 200)
	assert response =~ "Sign in with Twitter"
	assert response =~ o_auth_path(conn, :prepare_request)
	end

	test "GET /oauth/prepare_request encodes parameters as `state` and redirects", %{
	app: app,
	conn: conn
	} do
	conn =
	get(
	conn,
	"/oauth/prepare_request",
	%{
	"provider" => "twitter",
	"authorization" => %{
	"scope" => "read follow",
	"client_id" => app.client_id,
	"redirect_uri" => OAuthController.default_redirect_uri(app),
	"state" => "a_state"
	}
	}
	)

	assert response = html_response(conn, 302)

	redirect_query = URI.parse(redirected_to(conn)).query
	assert %{"state" => state_param} = URI.decode_query(redirect_query)
	assert {:ok, state_components} = Poison.decode(state_param)

	expected_client_id = app.client_id
	expected_redirect_uri = app.redirect_uris

	assert %{
	"scope" => "read follow",
	"client_id" => ^expected_client_id,
	"redirect_uri" => ^expected_redirect_uri,
	"state" => "a_state"
	} = state_components
	end

	test "with user-bound registration, GET /oauth/<provider>/callback redirects to `redirect_uri` with `code`",
	%{app: app, conn: conn} do
	registration = insert(:registration)
	redirect_uri = OAuthController.default_redirect_uri(app)

	state_params = %{
	"scope" => Enum.join(app.scopes, " "),
	"client_id" => app.client_id,
	"redirect_uri" => redirect_uri,
	"state" => ""
	}

	conn =
	conn
	\|> assign(:ueberauth_auth, %{provider: registration.provider, uid: registration.uid})
	\|> get(
	"/oauth/twitter/callback",
	%{
	"oauth_token" => "G-5a3AAAAAAAwMH9AAABaektfSM",
	"oauth_verifier" => "QZl8vUqNvXMTKpdmUnGejJxuHG75WWWs",
	"provider" => "twitter",
	"state" => Poison.encode!(state_params)
	}
	)

	assert response = html_response(conn, 302)
	assert redirected_to(conn) =~ ~r/#{redirect_uri}\?code=.+/
	end

	test "with user-unbound registration, GET /oauth/<provider>/callback renders registration_details page",
	%{app: app, conn: conn} do
	user = insert(:user)

	state_params = %{
	"scope" => "read write",
	"client_id" => app.client_id,
	"redirect_uri" => OAuthController.default_redirect_uri(app),
	"state" => "a_state"
	}

	conn =
	conn
	\|> assign(:ueberauth_auth, %{
	provider: "twitter",
	uid: "171799000",
	info: %{nickname: user.nickname, email: user.email, name: user.name, description: nil}
	})
	\|> get(
	"/oauth/twitter/callback",
	%{
	"oauth_token" => "G-5a3AAAAAAAwMH9AAABaektfSM",
	"oauth_verifier" => "QZl8vUqNvXMTKpdmUnGejJxuHG75WWWs",
	"provider" => "twitter",
	"state" => Poison.encode!(state_params)
	}
	)

	assert response = html_response(conn, 200)
	assert response =~ ~r/name="op" type="submit" value="register"/
	assert response =~ ~r/name="op" type="submit" value="connect"/
	assert response =~ user.email
	assert response =~ user.nickname
	end

	test "on authentication error, GET /oauth/<provider>/callback redirects to `redirect_uri`", %{
	app: app,
	conn: conn
	} do
	state_params = %{
	"scope" => Enum.join(app.scopes, " "),
	"client_id" => app.client_id,
	"redirect_uri" => OAuthController.default_redirect_uri(app),
	"state" => ""
	}

	conn =
	conn
	\|> assign(:ueberauth_failure, %{errors: [%{message: "(error description)"}]})
	\|> get(
	"/oauth/twitter/callback",
	%{
	"oauth_token" => "G-5a3AAAAAAAwMH9AAABaektfSM",
	"oauth_verifier" => "QZl8vUqNvXMTKpdmUnGejJxuHG75WWWs",
	"provider" => "twitter",
	"state" => Poison.encode!(state_params)
	}
	)

	assert response = html_response(conn, 302)
	assert redirected_to(conn) == app.redirect_uris
	assert get_flash(conn, :error) == "Failed to authenticate: (error description)."
	end

	test "GET /oauth/registration_details renders registration details form", %{
	app: app,
	conn: conn
	} do
	conn =
	get(
	conn,
	"/oauth/registration_details",
	%{
	"authorization" => %{
	"scopes" => app.scopes,
	"client_id" => app.client_id,
	"redirect_uri" => OAuthController.default_redirect_uri(app),
	"state" => "a_state",
	"nickname" => nil,
	"email" => "john@doe.com"
	}
	}
	)

	assert response = html_response(conn, 200)
	assert response =~ ~r/name="op" type="submit" value="register"/
	assert response =~ ~r/name="op" type="submit" value="connect"/
	end

	test "with valid params, POST /oauth/register?op=register redirects to `redirect_uri` with `code`",
	%{
	app: app,
	conn: conn
	} do
	registration = insert(:registration, user: nil, info: %{"nickname" => nil, "email" => nil})
	redirect_uri = OAuthController.default_redirect_uri(app)

	conn =
	conn
	\|> put_session(:registration_id, registration.id)
	\|> post(
	"/oauth/register",
	%{
	"op" => "register",
	"authorization" => %{
	"scopes" => app.scopes,
	"client_id" => app.client_id,
	"redirect_uri" => redirect_uri,
	"state" => "a_state",
	"nickname" => "availablenick",
	"email" => "available@email.com"
	}
	}
	)

	assert response = html_response(conn, 302)
	assert redirected_to(conn) =~ ~r/#{redirect_uri}\?code=.+/
	end

	test "with unlisted `redirect_uri`, POST /oauth/register?op=register results in HTTP 401",
	%{
	app: app,
	conn: conn
	} do
	registration = insert(:registration, user: nil, info: %{"nickname" => nil, "email" => nil})
	unlisted_redirect_uri = "http://cross-site-request.com"

	conn =
	conn
	\|> put_session(:registration_id, registration.id)
	\|> post(
	"/oauth/register",
	%{
	"op" => "register",
	"authorization" => %{
	"scopes" => app.scopes,
	"client_id" => app.client_id,
	"redirect_uri" => unlisted_redirect_uri,
	"state" => "a_state",
	"nickname" => "availablenick",
	"email" => "available@email.com"
	}
	}
	)

	assert response = html_response(conn, 401)
	end

	test "with invalid params, POST /oauth/register?op=register renders registration_details page",
	%{
	app: app,
	conn: conn
	} do
	another_user = insert(:user)
	registration = insert(:registration, user: nil, info: %{"nickname" => nil, "email" => nil})

	params = %{
	"op" => "register",
	"authorization" => %{
	"scopes" => app.scopes,
	"client_id" => app.client_id,
	"redirect_uri" => OAuthController.default_redirect_uri(app),
	"state" => "a_state",
	"nickname" => "availablenickname",
	"email" => "available@email.com"
	}
	}

	for {bad_param, bad_param_value} <-
	[{"nickname", another_user.nickname}, {"email", another_user.email}] do
	bad_registration_attrs = %{
	"authorization" => Map.put(params["authorization"], bad_param, bad_param_value)
	}

	bad_params = Map.merge(params, bad_registration_attrs)

	conn =
	conn
	\|> put_session(:registration_id, registration.id)
	\|> post("/oauth/register", bad_params)

	assert html_response(conn, 403) =~ ~r/name="op" type="submit" value="register"/
	assert get_flash(conn, :error) == "Error: #{bad_param} has already been taken."
	end
	end

	test "with valid params, POST /oauth/register?op=connect redirects to `redirect_uri` with `code`",
	%{
	app: app,
	conn: conn
	} do
	user = insert(:user, password_hash: Comeonin.Pbkdf2.hashpwsalt("testpassword"))
	registration = insert(:registration, user: nil)
	redirect_uri = OAuthController.default_redirect_uri(app)

	conn =
	conn
	\|> put_session(:registration_id, registration.id)
	\|> post(
	"/oauth/register",
	%{
	"op" => "connect",
	"authorization" => %{
	"scopes" => app.scopes,
	"client_id" => app.client_id,
	"redirect_uri" => redirect_uri,
	"state" => "a_state",
	"name" => user.nickname,
	"password" => "testpassword"
	}
	}
	)

	assert response = html_response(conn, 302)
	assert redirected_to(conn) =~ ~r/#{redirect_uri}\?code=.+/
	end

	test "with unlisted `redirect_uri`, POST /oauth/register?op=connect results in HTTP 401`",
	%{
	app: app,
	conn: conn
	} do
	user = insert(:user, password_hash: Comeonin.Pbkdf2.hashpwsalt("testpassword"))
	registration = insert(:registration, user: nil)
	unlisted_redirect_uri = "http://cross-site-request.com"

	conn =
	conn
	\|> put_session(:registration_id, registration.id)
	\|> post(
	"/oauth/register",
	%{
	"op" => "connect",
	"authorization" => %{
	"scopes" => app.scopes,
	"client_id" => app.client_id,
	"redirect_uri" => unlisted_redirect_uri,
	"state" => "a_state",
	"name" => user.nickname,
	"password" => "testpassword"
	}
	}
	)

	assert response = html_response(conn, 401)
	end

	test "with invalid params, POST /oauth/register?op=connect renders registration_details page",
	%{
	app: app,
	conn: conn
	} do
	user = insert(:user)
	registration = insert(:registration, user: nil)

	params = %{
	"op" => "connect",
	"authorization" => %{
	"scopes" => app.scopes,
	"client_id" => app.client_id,
	"redirect_uri" => OAuthController.default_redirect_uri(app),
	"state" => "a_state",
	"name" => user.nickname,
	"password" => "wrong password"
	}
	}

	conn =
	conn
	\|> put_session(:registration_id, registration.id)
	\|> post("/oauth/register", params)

	assert html_response(conn, 401) =~ ~r/name="op" type="submit" value="connect"/
	assert get_flash(conn, :error) == "Invalid Username/Password"
	end
	end

	describe "GET /oauth/authorize" do
	setup do
	[
	app: insert(:oauth_app, redirect_uris: "https://redirect.url"),
	conn:
	build_conn()
	\|> Plug.Session.call(Plug.Session.init(@session_opts))
	\|> fetch_session()
	]
	end

	test "renders authentication page", %{app: app, conn: conn} do
	conn =
	get(
	conn,
	"/oauth/authorize",
	%{
	"response_type" => "code",
	"client_id" => app.client_id,
	"redirect_uri" => OAuthController.default_redirect_uri(app),
	"scope" => "read"
	}
	)

	assert html_response(conn, 200) =~ ~s(type="submit")
	end

	test "properly handles internal calls with `authorization`-wrapped params", %{
	app: app,
	conn: conn
	} do
	conn =
	get(
	conn,
	"/oauth/authorize",
	%{
	"authorization" => %{
	"response_type" => "code",
	"client_id" => app.client_id,
	"redirect_uri" => OAuthController.default_redirect_uri(app),
	"scope" => "read"
	}
	}
	)

	assert html_response(conn, 200) =~ ~s(type="submit")
	end

	test "renders authentication page if user is already authenticated but `force_login` is tru-ish",
	%{app: app, conn: conn} do
	token = insert(:oauth_token, app: app)

	conn =
	conn
	\|> put_session(:oauth_token, token.token)
	\|> get(
	"/oauth/authorize",
	%{
	"response_type" => "code",
	"client_id" => app.client_id,
	"redirect_uri" => OAuthController.default_redirect_uri(app),
	"scope" => "read",
	"force_login" => "true"
	}
	)

	assert html_response(conn, 200) =~ ~s(type="submit")
	end

	test "renders authentication page if user is already authenticated but user request with another client",
	%{
	app: app,
	conn: conn
	} do
	token = insert(:oauth_token, app: app)

	conn =
	conn
	\|> put_session(:oauth_token, token.token)
	\|> get(
	"/oauth/authorize",
	%{
	"response_type" => "code",
	"client_id" => "another_client_id",
	"redirect_uri" => OAuthController.default_redirect_uri(app),
	"scope" => "read"
	}
	)

	assert html_response(conn, 200) =~ ~s(type="submit")
	end

	test "with existing authentication and non-OOB `redirect_uri`, redirects to app with `token` and `state` params",
	%{
	app: app,
	conn: conn
	} do
	token = insert(:oauth_token, app: app)

	conn =
	conn
	\|> put_session(:oauth_token, token.token)
	\|> get(
	"/oauth/authorize",
	%{
	"response_type" => "code",
	"client_id" => app.client_id,
	"redirect_uri" => OAuthController.default_redirect_uri(app),
	"state" => "specific_client_state",
	"scope" => "read"
	}
	)

	assert URI.decode(redirected_to(conn)) ==
	"https://redirect.url?access_token=#{token.token}&state=specific_client_state"
	end

	test "with existing authentication and unlisted non-OOB `redirect_uri`, redirects without credentials",
	%{
	app: app,
	conn: conn
	} do
	unlisted_redirect_uri = "http://cross-site-request.com"
	token = insert(:oauth_token, app: app)

	conn =
	conn
	\|> put_session(:oauth_token, token.token)
	\|> get(
	"/oauth/authorize",
	%{
	"response_type" => "code",
	"client_id" => app.client_id,
	"redirect_uri" => unlisted_redirect_uri,
	"state" => "specific_client_state",
	"scope" => "read"
	}
	)

	assert redirected_to(conn) == unlisted_redirect_uri
	end

	test "with existing authentication and OOB `redirect_uri`, redirects to app with `token` and `state` params",
	%{
	app: app,
	conn: conn
	} do
	token = insert(:oauth_token, app: app)

	conn =
	conn
	\|> put_session(:oauth_token, token.token)
	\|> get(
	"/oauth/authorize",
	%{
	"response_type" => "code",
	"client_id" => app.client_id,
	"redirect_uri" => "urn:ietf:wg:oauth:2.0:oob",
	"scope" => "read"
	}
	)

	assert html_response(conn, 200) =~ "Authorization exists"
	end
	end

	describe "POST /oauth/authorize" do
	test "redirects with oauth authorization, " <>
	"granting requested app-supported scopes to both admin- and non-admin users" do
	app_scopes = ["read", "write", "admin", "secret_scope"]
	app = insert(:oauth_app, scopes: app_scopes)
	redirect_uri = OAuthController.default_redirect_uri(app)

	non_admin = insert(:user, is_admin: false)
	admin = insert(:user, is_admin: true)
	scopes_subset = ["read:subscope", "write", "admin"]

	# In case scope param is missing, expecting _all_ app-supported scopes to be granted
	for user <- [non_admin, admin],
	{requested_scopes, expected_scopes} <-
	- %{scopes_subset => scopes_subset, nil => app_scopes} do
	+ %{scopes_subset => scopes_subset, nil: app_scopes} do
	conn =
	post(
	build_conn(),
	"/oauth/authorize",
	%{
	"authorization" => %{
	"name" => user.nickname,
	"password" => "test",
	"client_id" => app.client_id,
	"redirect_uri" => redirect_uri,
	"scope" => requested_scopes,
	"state" => "statepassed"
	}
	}
	)

	target = redirected_to(conn)
	assert target =~ redirect_uri

	query = URI.parse(target).query \|> URI.query_decoder() \|> Map.new()

	assert %{"state" => "statepassed", "code" => code} = query
	auth = Repo.get_by(Authorization, token: code)
	assert auth
	assert auth.scopes == expected_scopes
	end
	end

	test "returns 401 for wrong credentials", %{conn: conn} do
	user = insert(:user)
	app = insert(:oauth_app)
	redirect_uri = OAuthController.default_redirect_uri(app)

	result =
	conn
	\|> post("/oauth/authorize", %{
	"authorization" => %{
	"name" => user.nickname,
	"password" => "wrong",
	"client_id" => app.client_id,
	"redirect_uri" => redirect_uri,
	"state" => "statepassed",
	"scope" => Enum.join(app.scopes, " ")
	}
	})
	\|> html_response(:unauthorized)

	# Keep the details
	assert result =~ app.client_id
	assert result =~ redirect_uri

	# Error message
	assert result =~ "Invalid Username/Password"
	end

	test "returns 401 for missing scopes" do
	user = insert(:user, is_admin: false)
	app = insert(:oauth_app, scopes: ["read", "write", "admin"])
	redirect_uri = OAuthController.default_redirect_uri(app)

	result =
	build_conn()
	\|> post("/oauth/authorize", %{
	"authorization" => %{
	"name" => user.nickname,
	"password" => "test",
	"client_id" => app.client_id,
	"redirect_uri" => redirect_uri,
	"state" => "statepassed",
	"scope" => ""
	}
	})
	\|> html_response(:unauthorized)

	# Keep the details
	assert result =~ app.client_id
	assert result =~ redirect_uri

	# Error message
	assert result =~ "This action is outside the authorized scopes"
	end

	test "returns 401 for scopes beyond app scopes hierarchy", %{conn: conn} do
	user = insert(:user)
	app = insert(:oauth_app, scopes: ["read", "write"])
	redirect_uri = OAuthController.default_redirect_uri(app)

	result =
	conn
	\|> post("/oauth/authorize", %{
	"authorization" => %{
	"name" => user.nickname,
	"password" => "test",
	"client_id" => app.client_id,
	"redirect_uri" => redirect_uri,
	"state" => "statepassed",
	"scope" => "read write follow"
	}
	})
	\|> html_response(:unauthorized)

	# Keep the details
	assert result =~ app.client_id
	assert result =~ redirect_uri

	# Error message
	assert result =~ "This action is outside the authorized scopes"
	end
	end

	describe "POST /oauth/token" do
	test "issues a token for an all-body request" do
	user = insert(:user)
	app = insert(:oauth_app, scopes: ["read", "write"])

	{:ok, auth} = Authorization.create_authorization(app, user, ["write"])

	conn =
	build_conn()
	\|> post("/oauth/token", %{
	"grant_type" => "authorization_code",
	"code" => auth.token,
	"redirect_uri" => OAuthController.default_redirect_uri(app),
	"client_id" => app.client_id,
	"client_secret" => app.client_secret
	})

	assert %{"access_token" => token, "me" => ap_id} = json_response(conn, 200)

	token = Repo.get_by(Token, token: token)
	assert token
	assert token.scopes == auth.scopes
	assert user.ap_id == ap_id
	end

	test "issues a token for `password` grant_type with valid credentials, with full permissions by default" do
	password = "testpassword"
	user = insert(:user, password_hash: Comeonin.Pbkdf2.hashpwsalt(password))

	app = insert(:oauth_app, scopes: ["read", "write"])

	# Note: "scope" param is intentionally omitted
	conn =
	build_conn()
	\|> post("/oauth/token", %{
	"grant_type" => "password",
	"username" => user.nickname,
	"password" => password,
	"client_id" => app.client_id,
	"client_secret" => app.client_secret
	})

	assert %{"access_token" => token} = json_response(conn, 200)

	token = Repo.get_by(Token, token: token)
	assert token
	assert token.scopes == app.scopes
	end

	test "issues a token for request with HTTP basic auth client credentials" do
	user = insert(:user)
	app = insert(:oauth_app, scopes: ["scope1", "scope2", "scope3"])

	{:ok, auth} = Authorization.create_authorization(app, user, ["scope1", "scope2"])
	assert auth.scopes == ["scope1", "scope2"]

	app_encoded =
	(URI.encode_www_form(app.client_id) <> ":" <> URI.encode_www_form(app.client_secret))
	\|> Base.encode64()

	conn =
	build_conn()
	\|> put_req_header("authorization", "Basic " <> app_encoded)
	\|> post("/oauth/token", %{
	"grant_type" => "authorization_code",
	"code" => auth.token,
	"redirect_uri" => OAuthController.default_redirect_uri(app)
	})

	assert %{"access_token" => token, "scope" => scope} = json_response(conn, 200)

	assert scope == "scope1 scope2"

	token = Repo.get_by(Token, token: token)
	assert token
	assert token.scopes == ["scope1", "scope2"]
	end

	test "issue a token for client_credentials grant type" do
	app = insert(:oauth_app, scopes: ["read", "write"])

	conn =
	build_conn()
	\|> post("/oauth/token", %{
	"grant_type" => "client_credentials",
	"client_id" => app.client_id,
	"client_secret" => app.client_secret
	})

	assert %{"access_token" => token, "refresh_token" => refresh, "scope" => scope} =
	json_response(conn, 200)

	assert token
	token_from_db = Repo.get_by(Token, token: token)
	assert token_from_db
	assert refresh
	assert scope == "read write"
	end

	test "rejects token exchange with invalid client credentials" do
	user = insert(:user)
	app = insert(:oauth_app)

	{:ok, auth} = Authorization.create_authorization(app, user)

	conn =
	build_conn()
	\|> put_req_header("authorization", "Basic JTIxOiVGMCU5RiVBNCVCNwo=")
	\|> post("/oauth/token", %{
	"grant_type" => "authorization_code",
	"code" => auth.token,
	"redirect_uri" => OAuthController.default_redirect_uri(app)
	})

	assert resp = json_response(conn, 400)
	assert %{"error" => _} = resp
	refute Map.has_key?(resp, "access_token")
	end

	test "rejects token exchange for valid credentials belonging to unconfirmed user and confirmation is required" do
	Pleroma.Config.put([:instance, :account_activation_required], true)
	password = "testpassword"

	{:ok, user} =
	insert(:user, password_hash: Comeonin.Pbkdf2.hashpwsalt(password))
	\|> User.confirmation_changeset(need_confirmation: true)
	\|> User.update_and_set_cache()

	refute Pleroma.User.account_status(user) == :active

	app = insert(:oauth_app)

	conn =
	build_conn()
	\|> post("/oauth/token", %{
	"grant_type" => "password",
	"username" => user.nickname,
	"password" => password,
	"client_id" => app.client_id,
	"client_secret" => app.client_secret
	})

	assert resp = json_response(conn, 403)
	assert %{"error" => _} = resp
	refute Map.has_key?(resp, "access_token")
	end

	test "rejects token exchange for valid credentials belonging to deactivated user" do
	password = "testpassword"

	user =
	insert(:user,
	password_hash: Comeonin.Pbkdf2.hashpwsalt(password),
	deactivated: true
	)

	app = insert(:oauth_app)

	resp =
	build_conn()
	\|> post("/oauth/token", %{
	"grant_type" => "password",
	"username" => user.nickname,
	"password" => password,
	"client_id" => app.client_id,
	"client_secret" => app.client_secret
	})
	\|> json_response(403)

	assert resp == %{
	"error" => "Your account is currently disabled",
	"identifier" => "account_is_disabled"
	}
	end

	test "rejects token exchange for user with password_reset_pending set to true" do
	password = "testpassword"

	user =
	insert(:user,
	password_hash: Comeonin.Pbkdf2.hashpwsalt(password),
	password_reset_pending: true
	)

	app = insert(:oauth_app, scopes: ["read", "write"])

	resp =
	build_conn()
	\|> post("/oauth/token", %{
	"grant_type" => "password",
	"username" => user.nickname,
	"password" => password,
	"client_id" => app.client_id,
	"client_secret" => app.client_secret
	})
	\|> json_response(403)

	assert resp == %{
	"error" => "Password reset is required",
	"identifier" => "password_reset_required"
	}
	end

	test "rejects token exchange for user with confirmation_pending set to true" do
	Pleroma.Config.put([:instance, :account_activation_required], true)
	password = "testpassword"

	user =
	insert(:user,
	password_hash: Comeonin.Pbkdf2.hashpwsalt(password),
	confirmation_pending: true
	)

	app = insert(:oauth_app, scopes: ["read", "write"])

	resp =
	build_conn()
	\|> post("/oauth/token", %{
	"grant_type" => "password",
	"username" => user.nickname,
	"password" => password,
	"client_id" => app.client_id,
	"client_secret" => app.client_secret
	})
	\|> json_response(403)

	assert resp == %{
	"error" => "Your login is missing a confirmed e-mail address",
	"identifier" => "missing_confirmed_email"
	}
	end

	test "rejects an invalid authorization code" do
	app = insert(:oauth_app)

	conn =
	build_conn()
	\|> post("/oauth/token", %{
	"grant_type" => "authorization_code",
	"code" => "Imobviouslyinvalid",
	"redirect_uri" => OAuthController.default_redirect_uri(app),
	"client_id" => app.client_id,
	"client_secret" => app.client_secret
	})

	assert resp = json_response(conn, 400)
	assert %{"error" => _} = json_response(conn, 400)
	refute Map.has_key?(resp, "access_token")
	end
	end

	describe "POST /oauth/token - refresh token" do
	clear_config([:oauth2, :issue_new_refresh_token])

	test "issues a new access token with keep fresh token" do
	Pleroma.Config.put([:oauth2, :issue_new_refresh_token], true)
	user = insert(:user)
	app = insert(:oauth_app, scopes: ["read", "write"])

	{:ok, auth} = Authorization.create_authorization(app, user, ["write"])
	{:ok, token} = Token.exchange_token(app, auth)

	response =
	build_conn()
	\|> post("/oauth/token", %{
	"grant_type" => "refresh_token",
	"refresh_token" => token.refresh_token,
	"client_id" => app.client_id,
	"client_secret" => app.client_secret
	})
	\|> json_response(200)

	ap_id = user.ap_id

	assert match?(
	%{
	"scope" => "write",
	"token_type" => "Bearer",
	"expires_in" => 600,
	"access_token" => _,
	"refresh_token" => _,
	"me" => ^ap_id
	},
	response
	)

	refute Repo.get_by(Token, token: token.token)
	new_token = Repo.get_by(Token, token: response["access_token"])
	assert new_token.refresh_token == token.refresh_token
	assert new_token.scopes == auth.scopes
	assert new_token.user_id == user.id
	assert new_token.app_id == app.id
	end

	test "issues a new access token with new fresh token" do
	Pleroma.Config.put([:oauth2, :issue_new_refresh_token], false)
	user = insert(:user)
	app = insert(:oauth_app, scopes: ["read", "write"])

	{:ok, auth} = Authorization.create_authorization(app, user, ["write"])
	{:ok, token} = Token.exchange_token(app, auth)

	response =
	build_conn()
	\|> post("/oauth/token", %{
	"grant_type" => "refresh_token",
	"refresh_token" => token.refresh_token,
	"client_id" => app.client_id,
	"client_secret" => app.client_secret
	})
	\|> json_response(200)

	ap_id = user.ap_id

	assert match?(
	%{
	"scope" => "write",
	"token_type" => "Bearer",
	"expires_in" => 600,
	"access_token" => _,
	"refresh_token" => _,
	"me" => ^ap_id
	},
	response
	)

	refute Repo.get_by(Token, token: token.token)
	new_token = Repo.get_by(Token, token: response["access_token"])
	refute new_token.refresh_token == token.refresh_token
	assert new_token.scopes == auth.scopes
	assert new_token.user_id == user.id
	assert new_token.app_id == app.id
	end

	test "returns 400 if we try use access token" do
	user = insert(:user)
	app = insert(:oauth_app, scopes: ["read", "write"])

	{:ok, auth} = Authorization.create_authorization(app, user, ["write"])
	{:ok, token} = Token.exchange_token(app, auth)

	response =
	build_conn()
	\|> post("/oauth/token", %{
	"grant_type" => "refresh_token",
	"refresh_token" => token.token,
	"client_id" => app.client_id,
	"client_secret" => app.client_secret
	})
	\|> json_response(400)

	assert %{"error" => "Invalid credentials"} == response
	end

	test "returns 400 if refresh_token invalid" do
	app = insert(:oauth_app, scopes: ["read", "write"])

	response =
	build_conn()
	\|> post("/oauth/token", %{
	"grant_type" => "refresh_token",
	"refresh_token" => "token.refresh_token",
	"client_id" => app.client_id,
	"client_secret" => app.client_secret
	})
	\|> json_response(400)

	assert %{"error" => "Invalid credentials"} == response
	end

	test "issues a new token if token expired" do
	user = insert(:user)
	app = insert(:oauth_app, scopes: ["read", "write"])

	{:ok, auth} = Authorization.create_authorization(app, user, ["write"])
	{:ok, token} = Token.exchange_token(app, auth)

	change =
	Ecto.Changeset.change(
	token,
	%{valid_until: NaiveDateTime.add(NaiveDateTime.utc_now(), -86_400 * 30)}
	)

	{:ok, access_token} = Repo.update(change)

	response =
	build_conn()
	\|> post("/oauth/token", %{
	"grant_type" => "refresh_token",
	"refresh_token" => access_token.refresh_token,
	"client_id" => app.client_id,
	"client_secret" => app.client_secret
	})
	\|> json_response(200)

	ap_id = user.ap_id

	assert match?(
	%{
	"scope" => "write",
	"token_type" => "Bearer",
	"expires_in" => 600,
	"access_token" => _,
	"refresh_token" => _,
	"me" => ^ap_id
	},
	response
	)

	refute Repo.get_by(Token, token: token.token)
	token = Repo.get_by(Token, token: response["access_token"])
	assert token
	assert token.scopes == auth.scopes
	assert token.user_id == user.id
	assert token.app_id == app.id
	end
	end

	describe "POST /oauth/token - bad request" do
	test "returns 500" do
	response =
	build_conn()
	\|> post("/oauth/token", %{})
	\|> json_response(500)

	assert %{"error" => "Bad request"} == response
	end
	end

	describe "POST /oauth/revoke - bad request" do
	test "returns 500" do
	response =
	build_conn()
	\|> post("/oauth/revoke", %{})
	\|> json_response(500)

	assert %{"error" => "Bad request"} == response
	end
	end
	end

File Metadata

Mime Type: text/x-diff
Expires: Sun, Aug 9, 2:18 AM (1 d, 17 h)
Storage Engine: blob
Storage Format: Raw Data
Storage Handle: 1724133
Default Alt Text: (565 KB)

No OneTemporaryActions

View Options

File Metadata

Event Timeline

No OneTemporary
Actions