- Received quotes: read from `quote`, `quoteUrl`, `quoteUri`, `_misskey_quote` or a FEP-e232 Link tag; the quoted post is fetched once; a quoteAuthorization stamp is verified field by field on the quoted author's origin; a consent quote without a stamp is pending; an older-key quote of a public post is shown; Delete of a stamp revokes. Counts and a `quote` notification follow the accepted state. The `quote-inline` fallback survives sanitising and is removed from content when the real quote is shown. - Personas quote through `quoted_status_id`: posts that state a quote policy get a QuoteRequest and stay pending until an Accept brings a stamp we can verify, then an Update adds quoteAuthorization; posts that state none are quoted the older way, without `quote`; another persona's posts cannot be quoted yet (we issue no stamps). Quoting posts are delivered to the quoted author too. - Mastodon API: Status.quote (with the quoted status one level deep), quotes_count, quote_approval from the remote policy, GET /api/v1/statuses/:id/quotes, `quote` notifications, and api_versions.mastodon = 7. Checked live: GoToSocial's author-only quote policy is respected. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_012CzABvBkbcFqoHdmi8b9WB
39 KiB
PrivaPub roadmap
Written 2026-10-01 from the original 2023 code, the decePubClient UI, a federation gap audit of commit 075c222, research on .NET ActivityPub libraries, and the owner's decisions. Each phase ends in a tagged deploy plus verification; tick phases off here as they land.
Status
- P0 Security baseline: v1.1.0, deployed and verified 2026-10-01
- P1.1 Infrastructure and content model: v1.2.0, deployed and verified 2026-10-01
- P1.2 Social graph and timelines: v1.3.0, deployed and verified 2026-10-01
- P2 Mastodon client API: v1.4.0, deployed 2026-10-01; OAuth and the anonymous API verified on production, the signed-in API verified locally (no real-client login on production yet)
- P3 Social features: v1.5.0, deployed 2026-10-01; media, proxy, blocks, mutes, bookmarks, pins and reports verified by tests and locally (no upload on production yet)
- P4 Groups and privacy features: v1.6.0, deployed 2026-10-01; communities, circles and local-only located posts verified by tests. v1.6.1 adds the pasture (
tools/pasture/): live interop with GoToSocial 0.22.1 passes all 25 checks, three runs in a row. Lemmy and a live Mastodon circle member are not run yet; the pasture has GoToSocial only - P5 Lose nothing: v1.7.0 to v1.9.1, deployed 2026-10-01; parsing, typed details, provenance, downvotes, tombstones, federated blocks, all checked live against GoToSocial. Book reviews and forum threads keep their raw form only (typed in P7 and P8)
- P6 Emoji, polls, quotes, reactions, cards, players
- P7 Threads, communities, moderation, the social graph
- P8 Signatures, discovery, the long tail
Intent
It is a self-hosted, Pleroma-like microblogging server for privacy-minded individuals and small communities. It
federates with Mastodon, Pleroma/Akkoma, Misskey and GoToSocial (AvatarServer enum). Its distinguishing idea is
one private login (RootUser) owning several public personas (Avatars), each a separate actor with its own keys.
The rename SocialPub → PrivaPub happened in the commit that added the private avatar service.
Its privacy additions on top of the usual fediverse features:
- Location-ranged posts:
Post.LocationandRangeKm(5 km default), currently unused. - Contacts a persona chooses to share:
Avatar.SharedPersonalContacts, plus a root contact book (ContactItem). - Private notes: about other accounts (
RootUserNote) and on one's own avatar (PersonalNote). - Invitation-gated groups and DM groups.
- Signup without email: email is only for password recovery.
The client (decePubClient) is a near copy of Pleroma-FE plus Pleroma's admin panel: a visibility picker, a subject line, Plain/HTML/Markdown content types, media with alt text, boosts and likes, threads, mutes and blocks, data import/export, and admin sections for users, reports, emoji, MRF policies and uploads. Today it shows mock data and calls nothing.
Leftovers of the collAnon template, not intent:
- the discussion and confrontation resources;
- collAnon's invitation flow;
- QR scanning;
- the "collAnon support" mail sender.
The finishing pass reinterpreted the owner's never-written Group and DmGroup as an ActivityPub Group actor with an
invitation code and a direct-message conversation. The owner confirmed it on 2026-10-01, with groups split into communities
and circles (see Owner decisions).
Status at HEAD:
| Status | Features |
|---|---|
| Works | Accounts and JWT, several avatars, per-avatar actors and keys, posts, replies, CW, delete, DMs, groups and invitations, WebFinger, NodeInfo, signed inbox for Follow/Undo/Create/Delete/Update, delivery queue |
| Missing | Following remote accounts (no outgoing Follow), home/local/federated timelines, notifications, likes, boosts, visibility other than public, media, polls, edits by the author, profile Update federation, mutes, blocks, reports (Flag), Move, custom emoji, the location and contact features, admin and moderation, and a client that talks to the server |
Persona separation is breached in three places today:
- invitation signup names the avatar after the root username;
- logs pair root IDs with IP addresses;
- NodeInfo counts avatars as users.
Where it stood
Works:
- WebFinger, including
acct:for groups - NodeInfo 2.0
- Person, Group and Application actors with SPKI keys
- Outbound cavage signatures (every fetch is signed, so authorized-fetch servers work)
- Inbound cavage verification, with key refetch and a key-owner check
- Shared inbox, durable delivery with backoff
- Follow with auto-Accept or manual approval for groups, and Undo
- Inbound public, group and DM Creates
- Delete and Update restricted to the author
- DMs both ways, with Mention tags
Critical (security):
- S1, actor/key cache poisoning:
RemoteActorService.UpsertandGetActorByKeyIdaccept any document under its ownid, with no origin,publicKey.idorownerchecks. Any remote actor can be impersonated. - S2: no check that an object's
idhost matches its actor's. - S3, SSRF: only string checks. Names resolving to private addresses, redirects and rebinding all get through, and a request can trigger it before authentication.
- S4: unbounded fetch size, and 500s on unexpected content.
- S5: remote HTML is stored raw, with no format flag.
- S6: loose signature freshness.
- S8: DM conversation injection.
- S9: "private" groups federate as Public.
- S14: the "admin" username grants admin, and Swagger is open in production.
Blockers:
- O1: no outgoing Follow, so no home timeline.
- O2, O3: replies and mentions aren't delivered to their targets.
- I1: inbound replies and mentions are stored but invisible, and there are no notifications.
- G1: groups Announce the object URI instead of the activity, so Lemmy and other FEP-1b12 software see empty communities.
- K7: no media, timelines, likes or boosts for local users.
Important:
- Data: no indexes or unique constraints, upsert races (K1-K4).
- Inbox: processing runs synchronously with no idempotency store (I9, I10).
- Delivery: one serial worker, and a single poisoned row can stall the queue (L1-L3).
- Objects:
- Edits and profile updates don't federate (O7).
- No 410 Tombstones (A7).
- Content warning without a title (O5).
- Titles are lost on Mastodon (O6).
- Visibility modes are missing (O4).
- Interactions: likes, boosts and reports are dropped (I2, I3).
- Media: inbound attachments are dropped, and there's no media proxy (I6, S13).
- Actor profile:
- Actor
urlserves JSON to browsers (A1). - No
attachmentfields, Move oralsoKnownAs(A2, A3). - No locked or undiscoverable accounts (A4).
- Actor
- Signatures: inbound RFC 9421 and Content-Digest (H1, H2).
Owner decisions (2026-10-01)
| Question | Decision |
|---|---|
| Client interface | Mastodon client API, so Tusky, Elk, Phanpy, Ivory and the official apps work. Each avatar is its own Mastodon account: at OAuth authorize, the logged-in RootUser picks the avatar the token is for. PrivaPub-only features (avatars, groups, contacts, range posts) stay on /clientapi. Moving decePubClient onto the Mastodon API is out of scope. |
| Personas | Unlinkable to other users and servers. The admin can still see the link in the database. No root IDs next to IPs in logs, NodeInfo counts nothing that links personas, blocks, mutes and notifications are per avatar, and invitation signup no longer names the avatar after the root username. |
| Location-ranged posts | Local only, never federated. Shown to local users within the radius, with coordinates rounded on storage. |
| Groups | Per group, two kinds. A community federates per FEP-1b12, Lemmy-compatible: it Announces the activity, uses audience, and accepts posts from non-followers. A circle is invitation-only: posts are addressed to the members collection, and objects are served only to signed requests from members. |
Owner decisions on what PrivaPub reveals (2026-10-01, from docs/INTEROP.md §6)
| Question | Decision |
|---|---|
| Link previews | The server fetches the linked page itself. It does this only for public posts, after a short random delay, once per link for the whole server (a shared cache, so a fetch never points at one persona), and when the post arrives, never when someone reads it. Cards built from the post's own data are used first. The client never contacts the site. |
| Blocks | Federated. A persona's block is sent to the blocked account's server as Block, and an unblock as Undo{Block}. Their server enforces it too, and they can learn they were blocked. This replaces the earlier "blocks never federate" rule. |
Website authorship (attributionDomains, fediverse:creator) |
Off. It is never emitted, not even as a per-persona option, because it would publicly tie a persona to a website. |
| PeerTube views | Never sent. The remote video file is still downloaded through our proxy when it is played; that cannot be avoided without pre-downloading video. |
| Bluesky bridging (Bridgy Fed) | Allowed per persona, with a clear warning that the posts become far more widely copied. Leaving the bridge must work, through a federated Block sent to the bridge. Persona creation dates are moved back by a random number of days, so personas created the same day no longer share a date. |
| Reactions and votes | Public, with a one-time notice. The client tells each persona once, before its first reaction or vote, that these are public and visible as that persona. |
Libraries (researched; no maintained .NET ActivityPub library exists, so Letterbook and Iceshrimp.NET both wrote their own)
| Area | Choice |
|---|---|
| AS2 / ActivityPub model | Own thin layer on System.Text.Json.Nodes: inbound helpers for single-or-array values, id-or-object, type arrays and the three Public forms; outbound builders with Mastodon's @context. No JSON-LD processing; fetch from the origin instead of verifying LD signatures. |
| HTTP signatures | Keep own draft-cavage (sign and verify). Add NSign 1.2.5 (NSign.AspNetCore) to verify inbound RFC 9421 and Content-Digest. Always answer a bad signature with 401, never 500. |
| HTML | HtmlSanitizer 9.x with Mastodon's allowlist (tags p br span a del pre code em strong b i u ul ol li blockquote, attributes href rel class, microformat classes, a scheme allowlist, forced rel=nofollow noopener noreferrer) |
| Markdown | Markdig 1.4: DisableHtml, autolinks, custom inline parsers for @user@domain and #tag emitting Mastodon's h-card and hashtag markup |
| Media | NetVips (+NetVips.Native) for images: autorotate, strip EXIF/GPS, thumbnails. Blurhash.Core, FFMpegCore for video. Own IMediaStore (local disk now). Not ImageSharp 4, whose license key is enforced at build. |
| OAuth | OpenIddict 7.7 + OpenIddict.MongoDb: authorization code with PKCE, client_credentials, oob redirect, dynamic apps from POST /api/v1/apps, reference tokens |
| Jobs | Own Mongo job collection for both inbox processing and delivery: FindOneAndUpdate leases, a Channel wake-up, per-host circuit breaker, Mastodon's backoff (n⁴+15+jitter, 16 tries). No MassTransit (commercial from v9, no Mongo transport). |
| Tests | New xUnit project with fixture JSON captured from Mastodon, GoToSocial, Misskey, Lemmy and Akkoma; interop checked with Fediverse Pasture, verify.funfedi.dev and activitypub.academy |
FEPs, now: FEP-f1d5 (NodeInfo 2.0 and 2.1), FEP-67ff (FEDERATION.md), FEP-8fcf, FEP-5feb indexable,
FEP-7628 Move, FEP-2c59, FEP-044f quotes (parse, plus interactionPolicy), FEP-1b12 groups.
FEPs, later: FEP-521a, FEP-8b32, FEP-e232, relays (FEP-ae0c).
FEPs, skipped: FEP-c390, FEP-ef61, FEP-fb2a, FEP-844e.
Route names (deliberate; part of the project's character)
The odd names are the owner's and stay. Every new actor-scoped route follows the same theme. The names marked new were agreed on 2026-10-01.
| Thing | Route | Status |
|---|---|---|
| Actor | /peasants/{name} |
kept (/users/{name} 301-redirects here) |
| Inbox | /peasants/{name}/mouth |
kept |
| Outbox | /peasants/{name}/anus |
kept |
| Shared inbox | /human-centipede (and /peasants/{name}/human-centipede) |
kept |
| Token refresh (client API) | /clientapi/user/sniff/again |
kept |
| Followers | /peasants/{name}/groupies |
new, replaces /followers in P1 |
| Following | /peasants/{name}/stalking |
new, replaces /following in P1 |
| Notes (objects) | /peasants/{name}/scribbles/{id} |
new, replaces /posts/{id} in P1 |
| Activities | /peasants/{name}/grunts/{id} |
new, replaces /activities/{id} in P1 |
| Replies, likes, shares collections | /scribbles/{id}/gossip, /drool, /echoes |
new |
| Featured (pins) | /peasants/{name}/trophies |
new |
| Featured tags | /peasants/{name}/tattoos |
new |
| Group members | /peasants/{group}/flock |
new |
| Group moderators | /peasants/{group}/wardens |
new |
| DM conversation context | /peasants/{name}/whispers/{id} |
new, replaces /conversations/{id} |
Routes outside the actor namespace stay conventional, because other software looks for them by name:
/.well-known/*and/nodeinfo/*;- the Mastodon API (
/api/v1/*,/oauth/*); - the human pages
/@{name}and/@{name}/{id}; /media/*.
Once a P1 deploy has federated a name, it is frozen.
Target structure (moved incrementally; entity class names and URI shapes never change)
PrivaPub/
Infrastructure/ Http/ (IpRangeGuard, SafeHttpHandlerFactory, FederationHttp, BoundedReader), Jobs/ (JobQueue, JobWorker,
Backoff, HostCircuitBreaker), Ids/ (PrivacyIdGenerator, PostIds), Data/ (Indexes, Migrations/_NNN_*),
RateLimiting, ErrorHandling
Federation/ Signing/ (DraftCavage ← Services/Federation/HttpSignatures.cs, SignedFetchAuthorizer, Rfc9421Verifier)
Actors/ (LocalActorService, Keys, RemoteActorService, WebFingerClient, ActorParser)
Objects/ (Origin, ObjectFetcher, NoteParser, Addressing, ContentSanitizer)
Inbox/ (InboxReceiver, InboxProcessor, Handlers/{Follow,Accept,Reject,Undo,Create,Update,Delete,Like,Announce,Flag,Move}Handler)
Outbox/ (AudienceResolver, OutboxPublisher, GroupDistributor) Rendering/ (ApContext, Actor/Note/Activity/CollectionRenderer)
Controllers/ (Peasants, WellKnown, NodeInfo, Users)
Domain/ AvatarContext, Statuses/StatusService (← Services/PostsService.cs), Timelines/FanoutService, Notifications/,
Relationships/, Groups/GroupService (← GroupUsersService.cs), Content/ (MarkdownRenderer, PlainTextRenderer,
MentionTagParsers), Privacy/VisibilityPolicy (single CanSee), Media/ (P3), Geo/ (P4)
Api/ ClientApi/Controllers (← Controllers/ClientToServer, routes unchanged), Mastodon/{Controllers,Entities,Mappers,Auth,Infrastructure}
Web/Pages/ Profile, Status (P1); OAuth/Login, ChooseAvatar, Oob (P2)
The first refactor commit is a pure move with namespaces only. Logic changes follow in separate commits.
Phases (each one ends in a tagged deploy plus verification)
P0 Security baseline
- S1, actor verification:
RemoteActorService.GetActoraccepts a document only if itsidequals the final URL, on the same origin.GetActorByKeyIdresolves the owner, then the strict actor, and requirespublicKey.id == keyIdandowner == id.- Upserts become atomic on a unique
ActorURI. - Key refetch is limited to once per 5 minutes.
- S3 and S4, safe outbound HTTP:
- A
SocketsHttpHandler.ConnectCallbackresolves DNS and rejects loopback, private, link-local, CGNAT and ULA addresses, plus NAT64, 6to4, Teredo and IPv4-mapped forms. It then connects to the vetted IP. - Redirects are manual (at most 3, each re-checked).
- Responses are capped at 1 MB with a content-type check and a 15 s timeout, with a negative cache for failing URLs.
- Exceptions map to ProblemDetails: 400 or 401, never 500.
- A
- S2, origin checks:
Origin.Same. An activity's or object'sidmust share the actor's origin, and cross-origin embedded objects are refetched. - S5, sanitising:
ContentSanitizerwith HtmlSanitizer.Post.ContentHtmlandContentFormatare added, and migration_002sanitises stored remote content. - S6, signature freshness:
(request-target)andhostare required, plusdateor(created)anddigest. The window is −1 h to +15 min.(expires)is enforced, and the raw request target is used. - S8, DM injection: a DM joins a conversation by
contextonly if the author is already a member; otherwise it is matched onDmGroup.ParticipantsKey. - S9, groups: a
Group.Kindfield is added. Existing groups become Circles (migration_003), and Circle posts stay local-only until P4. - S14:
- Delete the
"admin"signup branch and add the CLIadmin promote. - Serve Swagger only in Development.
- Return generic error messages (no
ex.Message).
- Delete the
- Privacy:
- Drop the IP, User-Agent and root-id log lines in
RootUserController. - Invitation signup takes its own
AvatarUserName. - All fetches are signed by the instance actor.
- Drop the IP, User-Agent and root-id log lines in
- Indexes and races:
Infrastructure/Data/Indexes.cs, with migration_001deduplicating first.- Unique:
ObjectURI,ForeignAvatar.ActorURI, the Follower triple, RootToAvatar, andReservedName(one username space across avatars and groups). - Plain:
PublicKeyId,(GroupUserId, _id),(GroupId, _id).
- Unique:
- Rate limiting on login, signup, invitation and inbox (per key host).
- Cleanup: delete
Services/ActivityPubClient.csandModels/Post/PostBoost.cs. - New
PrivaPub.Tests(xUnit v3): IpRangeGuard table, signature fixtures (a real Mastodon request plus tampering cases), key-poisoning, origin rules, XSS corpus, DM injection. - CI:
build.ymlruns the tests.deploy.ymlruns the tests and amongodumpbefore swapping.
P1 Interop foundations (two deploys)
P1.1, infrastructure and content model:
-
Mongo job queue (
Job,RemoteInstance):- Leases via
UpdateAndGet,Channelwake-up, a reaper for expired leases. - Workers: delivery 8 (at most 2 per host), inbox 2.
- Backoff
n⁴+15+jitter, 16 tries. Non-transient errors go straight to Dead. - Per-host circuit breaker. Dedupe on
activity.idandactivityId|inbox. - TTL on finished jobs.
- Migration
_004moves pendingDeliveryrows into jobs.
- Leases via
-
Async inbox:
InboxReceiververifies and enqueues, then answers 202 (a duplicate also gets 202).InboxProcessordispatches to the handlers split out ofInboxService. -
Merge DmPost into Post (migration
_005; ids kept;Visibility=Direct,ConversationId). Post gains:Visibility {Public, Unlisted, FollowersOnly, Direct, Circle, LocalGeo}AuthorAccountId,To,Cc,ActivityURI,Url,ContextURIInReplyToURI,InReplyToAccountId,ReblogOfPostIdSpoilerText,Language,Mentions[],Tags[],Media[]- counters,
Revisions[],DeletedAt
/clientapi/dm/*moves onto Post, and every read goes throughVisibilityPolicy.CanSee. -
Parsing inbound content:
NoteParserhandles Note, Article, Page and Question. It readscontent, thencontentMap, then_misskey_content; alsosummary,name,sensitive, thetagarray,attachment(as remote media),inReplyTo,context,audience,updated, and thequotefields (stored as a URI).Addressingclassifies Public, Unlisted, FollowersOnly or Direct. Followers-only is detected by the actor's storedfollowersURL exactly, not by a path suffix.
-
Rendering local text:
MarkdownRenderer(Markdig) andPlainTextRenderer(for Mastodon API input).- Mentions resolved through WebFinger become an h-card plus a
Mentiontag; hashtags become aHashtagtag.
-
Renderers:
ApContext: Mastodon's@context(toot, schema,indexable,blurhash,focalPoint,featured,alsoKnownAs,movedTo,webfinger).- Actor and note
urlpoint at HTML pages; fields becomeattachmentPropertyValue; thewebfingerproperty is added;publishedis truncated to the day. - A title becomes
nameand is also prepended to the content as bold text. - A CW without a title gets a localised "Content warning" summary.
- Routes are renamed to the themed set (
/groupies,/stalking,/scribbles/{id},/grunts/{id},/whispers/{id}), activity URIs resolve, and the outbox gets afirstpage.
-
Web:
- Razor pages
/@{user}and/@{user}/{id}, with content negotiation;/peasants/{u}withtext/htmlredirects there. - WebFinger
profile-pagepoints at the HTML page. - NodeInfo 2.1 (avatars counted as users,
openRegistrationsfrom config) andFEDERATION.md.
- Razor pages
-
Moderation:
DomainBlock(Silence, Suspend, RejectMedia), applied in the receiver, the fetcher and delivery. -
IDs: register
PrivacyIdGeneratorfor Avatar and Group (day-truncated timestamp plus random bytes). Remote post ids are ObjectIds generated from theirpublishedtime.
P1.2, social graph and timelines:
-
Outgoing Follow (
Followingentity, plus Accept, Reject and outbound Undo). A local target is handled in-process. -
AudienceResolverandOutboxPublisher:Visibility to cc Public Public followers + mentions Unlisted followers Public + mentions Followers-only followers mentions Direct mentions (none) Replies are also delivered to the parent's author, and group posts to the group. Mentions are delivered to personal inboxes.
-
Inbound Create:
- The interested set is followers of the author, plus addressed or mentioned local avatars, plus the local parent's author, plus group members. If nobody local is interested, the post is dropped.
- Store the post (idempotent on ObjectURI), then fan out to the
TimelineEntrycollection ({AvatarId, PostId, AuthorAccountId, ReblogOfPostId}, unique(AvatarId, PostId), paged by PostId). - Mastodon's reply, mute and reblog rules apply at write time.
- Mention notifications are written.
-
Notificationentity:{AvatarId, Type, FromAccountId, PostId, DedupeKey}, unique onDedupeKey. -
Edits: outbound
Update{Note}to the same To/Cc, with revisions kept. Profile edits sendUpdate{Person}. -
Deletes: soft delete, a Delete sent to the stored audience, and the object then answers 410 with a Tombstone (a deleted actor answers 410 too).
-
Inbound Like and Announce: a
Favouriteentity, reblog rows with the original refetched, Undo of both, counters and notifications. -
Threads: a
FetchAncestorsbackfill job, depth at most 10. -
Test endpoints:
/clientapi/timeline/home,/clientapi/followand/clientapi/notifications, usable before P2.
P2 Mastodon client API
- OAuth: OpenIddict 7.7 + OpenIddict.MongoDb.
- Storage is
IMongoDatabaseregistered asDB.Default.Database(). - Endpoints:
/oauth/authorize,/oauth/token,/oauth/revokeand/.well-known/oauth-authorization-server. - Flows: authorization code (PKCE optional) and client_credentials.
- Scopes:
read,write,follow,pushand the granular ones. - Tokens are non-expiring reference tokens. The signing and encryption keys are persistent, in
/etc/privapub/oidc-*.pem. - The
oobcode page is supported, as isforce_login. - Authorize UX: log in with the root password (a short-lived cookie limited to
/oauth), choose an avatar, consent. - The token's
subis the avatar id, and no root claim is ever in the principal. A banned or deleted root invalidates its tokens. POST /api/v1/appscreates OpenIddict applications dynamically and prunes unused ones.
- Storage is
- Plumbing:
MastodonJson: snake_case, explicit nulls and empty arrays (Tusky breaks on missing fields).- A binder that merges Rails-style query, form and JSON parameters.
{"error"}responses.Linkpaging onmax_id,since_idandmin_id; CORS exposesLink.Idempotency-Keyhonoured on posting statuses.
- Endpoints:
- Instance: v1 and v2, advertising version
4.2.0 (compatible; PrivaPub). - Accounts:
verify_credentials,update_credentials,:id,:id/statuses,lookup,relationships,search, followers and following, follow and unfollow,follow_requests. - Statuses: CRUD, edit,
context,history,source, favourite and reblog plus their undos (outbound Like and Announce),reblogged_by,favourited_by. - Timelines and the rest: home, public, tag; notifications; markers; conversations;
/api/v2/searchwithresolve. - Stubs:
custom_emojis, filters, lists, announcements, trends, suggestions,followed_tags, preferences.
- Instance: v1 and v2, advertising version
- Mapping:
- Avatar, ForeignAvatar and Group all map to Account (
group: truefor groups).acctuses a WebFinger-verified handle;created_atis truncated to the day; avatar and header always have a placeholder URL. - Post maps to Status. Reblogs wrap the original. Per-viewer flags are loaded in batches.
- LocalGeo never appears in the Mastodon API.
- Avatar, ForeignAvatar and Group all map to Account (
- New Avatar settings:
IsLocked,IsDiscoverable,IsIndexable,IsBot,HideCollections,DefaultVisibility,DefaultSensitive,DefaultLanguage.
P3 Social features
- Media pipeline:
MediaAttachmententity plus/api/v1/mediaand/api/v2/media.- NetVips: autorotate, strip all metadata, 4096 px cap, 640 px thumbnail.
- Blurhash.Core.
- FFMpegCore: remux only, with
-map_metadata -1. - Stored in
/var/lib/privapub/media, outside the web root that deploys replace. nginx serves/media/withnosniffand a strict CSP, and allows larger uploads only on the media endpoints. - A job deletes unattached uploads.
- Remote media proxy:
/media/proxy/{hmac}/{url}, going through the safe HTTP handler, with a ~5 GB disk LRU. The API and avatars use proxied URLs, so clients never contact remote hosts. - Outbound attachments:
mediaType, alt text,blurhash,focalPointand dimensions. Profile avatar and header images are sent asUpdate{Person}. - Bookmarks and pins: pins are served as the
featuredcollection at/peasants/{name}/trophies, with featured tags at/tattoos. - Blocks and mutes: per avatar. Block is not federated: it sends Reject or Undo Follow instead and drops the blocked actor's traffic. Domain blocks per account as well.
- Reports: inbound Flag becomes a
Report. Outbound Flag is sent by the instance actor, so the reporting persona isn't revealed. Moderator endpoints on/clientapi. - Locked accounts: the follow-request flow.
P4 Groups and privacy features
- Group model:
Group.Kind,PostingPolicy,Rules;GroupMember.State; new collections for moderators (/wardens), members (/flock) and featured (/trophies). - Communities (FEP-1b12):
GroupDistributorannounces the full activity (Create, Update, Delete, Like or Undo) withaudienceto the group's followers. New posts additionally getAnnounce(object), so Mastodon shows them.- Top-level posts render as
Pagewith a title; comments asNote. - Posting from non-followers is allowed according to
PostingPolicy. - Inbound Announces from remote groups are refetched from their origin.
- A Mastodon client posts into a group by mentioning
@group@host.
- Circles:
- The actor is undiscoverable, with manual approval and invitation-only joining.
- Posts are addressed
to: [members, group]and delivered to members' personal inboxes, never with Announce. SignedFetchAuthorizerserves circle objects only to a signed request from a member, or from the instance actor of a member's server. Anything else gets 404.FEDERATION.mddocuments the Mastodon limitation: Mastodon members' replies reach only whoever they mention.
- Local-only location posts:
Post.Locationbecomes a GeoJSON point rounded to 2 decimals (about 1 km), withRangeKmclamped to 1–50 and a2dsphereindex. Visibility is LocalGeo./clientapi/post/nearbyruns$geoNearfiltered by each post's own radius. The viewer's position is never stored.- The audience is always empty; ActivityPub endpoints and the Mastodon API never expose these posts.
- Persona hardening: optionally re-key existing avatar ids; an optional
SecureMode(signed GETs required); no suggestions or directories that could relate sibling avatars.
P5 and beyond: rich content and the rest of the fediverse
Rewritten on 2026-10-01 from the research in docs/INTEROP.md, which holds the per-platform evidence and the
priorities. The goal is a future client that shows and links every kind of fediverse content in one place, with a
details view of where each object came from. So the server keeps everything it receives: typed where it understands
it, raw where it doesn't.
P5 Lose nothing (wire tolerance and full objects)
- Cheap fixes that were wrong (done in v1.7.0):
summaryis a content warning only on aNote/Question, or whensensitiveis set; elsewhere it is an excerpt (INTEROP W2). Remote titles now show in the Mastodon API for non-Note objects.- Persona usernames match Mastodon's and Misskey's pattern (groups already did).
- Every term we emit is defined in our JSON-LD context.
Vary: Accept.- Not done on purpose: see "Deliberately not done" below.
- Owner decisions that were small (done in v1.7.0): blocks federate (
Block,Undo{Block}); a persona's and a group'spublishedis a random day up to two weeks before its creation (migration_007). - Parsing every shape (done in v1.8.0,
Federation/Objects/ObjectShapes.cs):url,icon,image,attachmentandattributedToas a value, an object or an array (W1).- A Markdown
contentandsource(W3). - Inferring a missing
mediaType(W4). - Every thumbnail location (W5).
- Language from
@context(W11); alt text fromsummary(W12). - A null
id, a 200Tombstone, aDeletebefore itsCreate(W9, W13).
- Typed payloads (done in v1.8.0 for link, video, audio, event and the cover image; review and thread are still
open):
Post.ObjectTypeplusLink,Video,Audio,Event,CoverURLandSource(INTEROP §4.1). The Mastodon API view: the title above the body, an event's "when · where" line, a card made from the object without fetching, attachments with their thumbnail and duration. Video and audio playback through the proxy is P6. - Raw capture for the details view (done in v1.8.0): the object as received, how it arrived, the signature scheme and
key, received versus
published, the extensions detected, and the origin's software (§4.3). Exposed at/api/privapub/v1/statuses/:id/provenanceand/api/privapub/v1/instances/:host. Checked live against GoToSocial. - Routing by object type (done in v1.9.0):
Accept/Rejectact only on a Follow we sent and ignore any other object (W6); routing to RSVPs and interaction approvals comes with those features.ChatMessagein as a direct message.Dislikeand itsUndoin a downvote ledger, shown with favourites asprivapub.votes.- A
Joinanswered withIgnoreuntil RSVP exists. - Friendica's thread-
Followis ignored without an error. - A deleted object's id is kept for 90 days (W9), and its
ObjectRecordis removed with the post.
- Typed details reach clients (done in v1.9.0) as
Status.privapub. - Delivery: a 503 with
Retry-Afteris waited out like a 429 and no longer counts against the host (done in v1.9.0). We answer 503 withRetry-Afterourselves when a sender's key cannot be fetched for a temporary reason (v1.9.1), so Mastodon 4.7 retries instead of switching to RFC 9421. - Deliberately not done: dereferenceable
Follow,Like,Block,Accept,RejectandUndoids. Serving them would publish who follows, likes and blocks whom, which our collections deliberately hide. Every one of them is sent with its object embedded, which is all Misskey needs.CreateandAnnounceids do dereference.
P6 What people see: emoji, polls, quotes, reactions, cards, players
- Custom emoji on posts, names, fields and poll options, proxied (done in v1.10.0), together with fuller remote profiles: header, fields, locked, published, moved-to, indexable, memorial, image descriptions.
- Polls in and out, with the Misskey, Pleroma and PieFed vote shapes. A count refresh is never an edit (done in v1.10.0; checked live both ways against GoToSocial).
- Quotes (FEP-044f):
- read every key; verify
QuoteAuthorizationon all of its fields; handle revocation (done in v1.13.0); - personas quote others:
quoted_status_id,QuoteRequest,Accept{result}verified,UpdatewithquoteAuthorization; legacy quotes for posts that state no policy (done in v1.13.0);api_versions.mastodon = 7; - still open: be quotable (
canQuoteon our posts, answerQuoteRequest, serve and revoke stamps). It needs a themed route name for stamps, agreed with the owner, and a default quote policy.
- read every key; verify
- Emoji reactions in all three inbound forms, plus outbound
EmojiReact, exposed asemoji_reactions(done in v1.11.0; Pleroma's/api/v1/pleroma/statuses/:id/reactionsendpoints andpleroma:emoji_reactionnotifications). - Link cards (done in v1.12.0):
- from the object, or from FEP-8967
preview, without fetching; - otherwise the server reads the page (owner decision 1): public posts only, 0–60 s after arrival, cached per address
for 7 days across the whole server,
Federation:FetchLinkPreviewsto switch it off. Checked live against a GoToSocial profile page.
- from the object, or from FEP-8967
- Media:
- video playback through the proxy (Range requests, HLS playlist rewriting, the poster), with a
videocard; - audio attachments;
- an article reader view;
- JPEG/PNG renditions kept for Pixelfed.
- video playback through the proxy (Range requests, HLS playlist rewriting, the poster), with a
P7 Threads, communities and the social graph
- Thread backfill:
- read in order:
contextHistory, thencontext(paged, with ETag), thenreplies; - group by the root post;
- publish our own
contextand a pagedreplies.
- read in order:
- Lemmy, PieFed and Mbin:
- the moderation set: removals, locks, bans, featured, moderators,
Warn,Resolve; - votes in and out; link posts; flairs;
Feedactors; community polls; postMove; - the outbound shape Lemmy requires;
- communities we host announce to the author's own instance too;
- Flags from a
Service-typed reporter actor.
- the moderation set: removals, locks, bans, featured, moderators,
- GoToSocial interaction policies: stored and shown; send
ReplyRequest/LikeRequestwhere approval is needed; handleAccept{result}. - Accounts and follows:
- inbound
Movewith Mastodon's checks; - re-run WebFinger on a rename;
- inbound
Block, plusAdd/Removeof pins; - FEP-8fcf followers sync;
indexable/discoverable/searchableBy;- edit history from
formerRepresentations; - PeerTube reply rules and
ApproveReply.
- inbound
- Events: structured RSVP (
Join/Leavewith stable ids).
P8 Signatures, discovery and the long tail
- Signatures:
- RFC 9421 inbound (RSA and Ed25519, Content-Digest);
- outbound double-knock, remembered per host;
publicKeyarrays and FEP-521a Multikey;- FEP-8b32 proof verification;
hs2019with SHA-512.
- Discovery:
- a relay client for both relay styles;
- instance actor discovery (FEP-d556, FEP-2677);
implements(FEP-844e).
- Mastodon API: streaming WebSocket, Web Push, grouped notifications. Then advertise an honest version.
- Backfill: an author's outbox after following them.
- Long tail:
- MFM rendering data;
- Misskey actor extras;
- book reviews (
relatedWith,rating); - Funkwhale and Castopod metadata;
- Pixelfed
place(display only, never re-federated); - Bluesky bridging per persona.
Cut or deferred (deliberately)
- Cut:
- Link-preview cards fetched from the linked page by default. Cards built from the object, or from FEP-8967
previewdata, are in P6; fetching the page is an owner decision (INTEROP §6.1). - Translation, trends, directory and lists (filters stay as stubs).
- Scheduled posts.
- The Mastodon admin API: moderation stays on
/clientapi. POST /api/v1/accountsregistration: avatars are created through/clientapi.- Local custom emoji.
- S3 storage.
- JSON-LD and LD-signature processing. FEP-8b32 proofs need neither (JCS), so they are in P8.
- Link-preview cards fetched from the linked page by default. Cards built from the object, or from FEP-8967
- Deferred: video transcoding (remux only for now).
- Out of scope: moving decePubClient onto the Mastodon API.
Verification (per phase)
-
Unit tests (
PrivaPub.Tests) on every phase. Fixture JSON is captured per peer intoFixtures/{mastodon,gotosocial,misskey,akkoma,lemmy}/. Renderers are checked against golden JSON. Inbound scenarios run as integration tests on a throwaway mongod. -
Interop: Fediverse Pasture runs on the workstation with podman: Mastodon, GoToSocial, Misskey/Sharkey, Akkoma, plus Lemmy for P4. As built,
tools/pasture/run.shruns PrivaPub and GoToSocial behind one Caddy on a podman network, withAllowPrivateNetworks,AllowPlainHttpandAcceptAnyCertificate; startup refuses all three in Production.tools/pasture/interop.shdrives the matrix for GoToSocial; the other peers are still to be added. The matrix, per peer:- follow both ways;
- public, unlisted, followers-only and direct posts both ways;
- a reply landing in the remote thread;
- a mention producing a notification;
- edit, and delete answering 410;
- like and boost counters;
- CW and title rendering on Mastodon;
- Pasture's odd-payload inputs always answered 202 or 4xx, never 500.
Also run verify.funfedi.dev against
/peasants/privapuband one avatar. -
P0:
curlthe inbox with junk and get 400/401. Resolving127.0.0.1.nip.ioor a host with an::1record is refused. Swagger answers 404 in production. -
P1: 500 deliveries queued for a dead host don't delay deliveries to live hosts.
-
P2: Tusky, Elk, Phanpy and Ivory each log in with two avatars of one root as separate accounts. Home paginates both ways; post, reply, DM, follow-by-search, notifications, CW, and edit or delete-and-redraft all work.
tools/smoke/mastodon-api.shruns after every deploy. A test asserts that no response for avatar A contains avatar B's id. -
P3:
exiftoolshows no GPS data on an uploaded original.- Elk renders the blurhash.
- Phanpy's network tab shows no requests to remote hosts.
- Like and boost round-trip with Mastodon and GtS, and a block cuts the follow both ways.
- A Flag reaches the Mastodon admin UI.
-
P4:
- Lemmy follows a community; posts and comments flow both ways; votes show; moderator deletes propagate.
- A Mastodon member of a circle gets a limited post. An unsigned or non-member GET answers 404.
- Two local avatars, 3 km and 8 km away, see a 5 km post correctly, and the post creates no delivery jobs.
-
Every deploy:
/build.jsonreports the commit.privapub.thepra.dev/peasants/privapuband NodeInfo answer.
Risks and sequencing
- Unique indexes fail on existing duplicates, so the dedupe migration runs first. Run a
mongodumpbefore every tagged deploy from P0 on. - Merge DmPost into Post and register
PrivacyIdGeneratorbefore P2 exposes ids to clients. - The publish grows by about 20 MB (OpenIddict, NetVips.Native, FFMpegCore). Keep
deploy.yml's asserted file list current, and add ffmpeg indeploy/max/setup.sh. - Pasture's private-network and plain-HTTP allowances stay out of
appsettings.Production.json, and startup asserts they're off. - Scale: this is several weeks of work. Each phase is a separate tagged release, and I report after each one.