thepraandClaude Opus 5.5
eb7552e8f3
The public projection of a server's place showed only the country for servers reporting fewer than 10 users. The owner never decided that threshold: every located server now shows its city, coordinates (0.1°) and network, and a CDN-fronted one still shows only its CDN, since the address reached is the CDN's edge. Statistics:PublicCityMinUsers is gone; the ROADMAP decision on server locations, CLAUDE.md and the /stargazing explainer are corrected. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01LsXgEaXee4GCU1hwYgPJXw
58 lines
2.5 KiB
Plaintext
58 lines
2.5 KiB
Plaintext
@page "/stargazing"
|
|
@model PrivaPub.Web.Pages.StargazingModel
|
|
@{
|
|
ViewData["Title"] = "Stargazing";
|
|
}
|
|
<header>
|
|
<h1>Stargazing</h1>
|
|
<div class="meta">What this server records about other servers, and how to keep its crawler out.</div>
|
|
</header>
|
|
<article>
|
|
<h2>Servers, never people</h2>
|
|
<p>This server keeps statistics about the fediverse for teaching and curiosity. They name <strong>servers</strong>,
|
|
never accounts: what kind of software a server runs, what it exchanges with us, and how reliably. Distinct accounts are
|
|
only counted, through a key that is destroyed at the end of each day.</p>
|
|
<p>A server we exchange activities with is described once a week, from its public NodeInfo and, when it has one, its
|
|
Mastodon instance API. Its location comes from the address we reached, looked up in an offline database, and is shown
|
|
to the city; for a server behind a CDN, only the CDN is shown, since the address is the CDN's.</p>
|
|
@if (Model.GeoSource is { } geo)
|
|
{
|
|
<p>Locations come from <a href="https://db-ip.com" rel="nofollow noopener">@geo</a>, licensed under
|
|
<a href="https://creativecommons.org/licenses/by/4.0/" rel="nofollow noopener">CC BY 4.0</a>.</p>
|
|
}
|
|
else
|
|
{
|
|
<p>No location database is loaded yet, so servers are not located.</p>
|
|
}
|
|
</article>
|
|
<article>
|
|
<h2>The crawler</h2>
|
|
@if (Model.CrawlerEnabled)
|
|
{
|
|
<p>The crawler is <strong>on</strong> on this server.</p>
|
|
}
|
|
else
|
|
{
|
|
<p>The crawler is <strong>off</strong> on this server: it only learns about servers it already exchanges with.</p>
|
|
}
|
|
<p>When on, it identifies itself as</p>
|
|
<p><code>@Model.UserAgent</code></p>
|
|
<p>It visits one server a minute, each at most once a week, and reads only:</p>
|
|
<ul>
|
|
<li><code>/robots.txt</code></li>
|
|
<li><code>/.well-known/nodeinfo</code> and the NodeInfo document it points to</li>
|
|
<li><code>/api/v2/instance</code> or <code>/api/v1/instance</code></li>
|
|
<li><code>/api/v1/instance/peers</code>, to find other servers</li>
|
|
</ul>
|
|
<p>It never reads accounts, posts, timelines or directories.</p>
|
|
<h2>Keeping it out</h2>
|
|
<p>Add this to your server's <code>robots.txt</code>:</p>
|
|
<pre>User-agent: @StargazerToken
|
|
Disallow: /</pre>
|
|
<p>If your <code>robots.txt</code> cannot be read because of a server error or a timeout, the crawler stays out too.</p>
|
|
</article>
|
|
<footer class="meta">IP geolocation by <a href="https://db-ip.com" rel="nofollow noopener noreferrer">DB-IP</a>, CC BY 4.0.</footer>
|
|
@functions {
|
|
const string StargazerToken = PrivaPub.Federation.Crawler.Stargazer.Token;
|
|
}
|