@page "/stargazing"
@model PrivaPub.Web.Pages.StargazingModel
@{
	ViewData["Title"] = "Stargazing";
}
<header>
	<h1>Stargazing</h1>
	<div class="meta">What this server records about other servers, and how to keep its crawler out.</div>
</header>
<article>
	<h2>Servers, never people</h2>
	<p>This server keeps statistics about the fediverse for teaching and curiosity. They name <strong>servers</strong>,
	never accounts: what kind of software a server runs, what it exchanges with us, and how reliably. Distinct accounts are
	only counted, through a key that is destroyed at the end of each day.</p>
	<p>A server we exchange activities with is described once a week, from its public NodeInfo and, when it has one, its
	Mastodon instance API. Its location comes from the address we reached, looked up in an offline database: only the
	country is shown publicly for small servers, and only the CDN for servers behind one.</p>
</article>
<article>
	<h2>The crawler</h2>
	@if (Model.CrawlerEnabled)
	{
		<p>The crawler is <strong>on</strong> on this server.</p>
	}
	else
	{
		<p>The crawler is <strong>off</strong> on this server: it only learns about servers it already exchanges with.</p>
	}
	<p>When on, it identifies itself as</p>
	<p><code>@Model.UserAgent</code></p>
	<p>It visits one server a minute, each at most once a week, and reads only:</p>
	<ul>
		<li><code>/robots.txt</code></li>
		<li><code>/.well-known/nodeinfo</code> and the NodeInfo document it points to</li>
		<li><code>/api/v2/instance</code> or <code>/api/v1/instance</code></li>
		<li><code>/api/v1/instance/peers</code>, to find other servers</li>
	</ul>
	<p>It never reads accounts, posts, timelines or directories.</p>
	<h2>Keeping it out</h2>
	<p>Add this to your server's <code>robots.txt</code>:</p>
	<pre>User-agent: @StargazerToken
Disallow: /</pre>
	<p>If your <code>robots.txt</code> cannot be read because of a server error or a timeout, the crawler stays out too.</p>
</article>
<footer class="meta">IP geolocation by <a href="https://db-ip.com" rel="nofollow noopener noreferrer">DB-IP</a>, CC BY 4.0.</footer>
@functions {
	const string StargazerToken = PrivaPub.Federation.Crawler.Stargazer.Token;
}