snac.8 15 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500
  1. .Dd $Mdocdate$
  2. .Dt SNAC 8
  3. .Os
  4. .Sh NAME
  5. .Nm snac
  6. .Nd snac administration
  7. .Sh DESCRIPTION
  8. The
  9. .Nm
  10. daemon processes messages from other servers in the Fediverse
  11. using the ActivityPub protocol.
  12. .Pp
  13. This is the admin manual. For user operation, see
  14. .Xr snac 1 .
  15. For file and data formats, see
  16. .Xr snac 5 .
  17. .Ss Special cares about your snac you must know beforehand
  18. .Nm
  19. makes heavy use of hard links and link reference counts for its work, so
  20. don't even think of using it on a filesystem that doesn't support this
  21. feature. Most UNIX-like operating systems (Linux, the BSDs, the old DEC
  22. Ultrix machine in your grandfather basement, probably MacOS) support hard
  23. links on their native filesystems. Don't do fancy things like moving the
  24. subdirectories to different filesystems. Also, if you move your
  25. .Nm
  26. installation to another server, do it with a tool that respect hard
  27. link counts. Remember:
  28. .Nm
  29. is a very UNIXy program that loves hard links.
  30. .Ss Building and Installation
  31. A C compiler must be installed in the system, as well as the development
  32. headers and libraries for OpenSSL (or compatible) and curl. To build
  33. .Nm ,
  34. run
  35. .Bd -literal -offset indent
  36. make
  37. .Ed
  38. .Pp
  39. And, after that, run as root
  40. .Bd -literal -offset indent
  41. make install
  42. .Ed
  43. .Ss Data storage Initialization
  44. Once
  45. .Nm
  46. is properly installed on the system, designate a directory where
  47. the server and user data are to be stored. This directory
  48. must not exist yet.
  49. .Nm
  50. must always be run as a regular user; you can create one for
  51. it or use your own. To initialize the data storage, execute
  52. .Bd -literal -offset indent
  53. snac init $HOME/snac-data
  54. .Ed
  55. .Pp
  56. A small set of questions will be asked regarding the installation,
  57. specially the host name it will run under, the local network address
  58. and port
  59. .Nm
  60. will listen to, the optional path prefix and possibly other things.
  61. .Pp
  62. You can launch the
  63. .Nm
  64. process by running
  65. .Bd -literal -offset indent
  66. snac httpd $HOME/snac-data
  67. .Ed
  68. .Pp
  69. Use a web browser to connect to the specified address and port. You
  70. should see a greeting page.
  71. .Pp
  72. Log messages are sent to the standard error stream. By default, only
  73. relevant information is written there. You can increase the debugging
  74. level by editing the 'dbglevel' field in the
  75. .Pa server.json
  76. file or by setting a numeric value between 0 and 3 to the DEBUG
  77. environment variable, see below.
  78. .Pp
  79. If you operate a Linux systemd-enabled system, OpenBSD or FreeBSD, there are
  80. startup scripts and configuration data in the
  81. .Pa examples
  82. directory.
  83. For other operating systems, please read the appropriate documentation
  84. on how to install a daemon as a non-root service.
  85. .Ss Upgrading to a new version
  86. Sometimes, the data storage disk layout changes between versions. If there
  87. is such a change,
  88. .Nm
  89. will refuse to run and require an upgrade. Do this by running
  90. .Bd -literal -offset indent
  91. snac upgrade $HOME/snac-data
  92. .Ed
  93. .Pp
  94. Take special care to execute this upgrade operation without any
  95. .Nm
  96. processes serving on the same folder. You can break everything. I know
  97. this because Tyler knows this.
  98. .Pp
  99. .Ss Server Setup
  100. .Pp
  101. An http server with TLS and proxying support must already be
  102. installed and configured.
  103. .Nm
  104. runs as a daemon and listens on a TCP/IP socket, preferrably
  105. on a local interface. It can serve the full domain or only
  106. a directory. The http server must be configured to route to the
  107. .Nm
  108. socket all related traffic and also the webfinger standard
  109. address. The Host header must be propagated.
  110. See the examples below.
  111. .Ss Adding Users
  112. .Pp
  113. Users must be created from the command line.
  114. You can do it by running
  115. .Bd -literal -offset indent
  116. snac adduser $HOME/snac-data
  117. .Ed
  118. .Pp
  119. All needed data will be prompted for. There is no artificial limit
  120. on the number of users that can be created.
  121. .Ss Customization
  122. The
  123. .Pa server.json
  124. configuration file allows some behaviour tuning:
  125. .Bl -tag -width tenletters
  126. .It Ic host
  127. The host name.
  128. .It Ic prefix
  129. The URL path prefix.
  130. .It Ic address
  131. The listen network address.
  132. .It Ic port
  133. The listen network port.
  134. .It Ic dbglevel
  135. The debug level. An integer value, being 0 the less verbose (the default).
  136. .It Ic layout
  137. The disk storage layout version. Never touch this.
  138. .It Ic queue_retry_max
  139. Messages sent out are stored in a queue. If the posting of a messages fails,
  140. it's re-enqueued for later. This integer configures the maximum count of
  141. times the sending will be retried.
  142. .It Ic queue_retry_minutes
  143. The number of minutes to wait before the failed posting of a message is
  144. retried. This is not linear, but multipled by the number of retries
  145. already done.
  146. .It Ic max_timeline_entries
  147. This is the maximum timeline entries shown in the web interface.
  148. .It Ic timeline_purge_days
  149. Entries in the timeline older that this number of days are purged.
  150. If you don't want any timeline purging and enjoy your data drives
  151. fill up with old crap and finally burst in flames, you can disable
  152. purging by setting this to 0.
  153. .It Ic local_purge_days
  154. Same as before, but for the user-generated entries in the local timeline.
  155. .It Ic cssurls
  156. This is a list of URLs to CSS files that will be inserted, in this order,
  157. in the HTML before the user CSS. Use these files to configure the global
  158. site layout.
  159. .It Ic disable_cache
  160. If set to true, timeline caching is not done. This is only useful for
  161. debugging purposes; don't enable it unless you know what do you want, as
  162. it makes everything slower.
  163. .It Ic disable_openbsd_security
  164. If running under OpenBSD,
  165. .Nm
  166. makes use of the enhanced security functions
  167. .Xr unveil 2
  168. and
  169. .Xr pledge 2 .
  170. Setting this to true disables their usage. These functions limit severely
  171. what an intruder can do in case of a security vulnerability, so only enable
  172. this option if something is very broken.
  173. .It Ic num_threads
  174. By setting this value, you can specify the exact number of threads
  175. .Nm
  176. will use when processing connections. Values lesser than 4 will be ignored.
  177. .It Ic disable_email_notifications
  178. By setting this to true, no email notification will be sent for any user.
  179. .It Ic disable_inbox_collection
  180. By setting this to true, no inbox collection is done. Inbox collection helps
  181. being discovered from remote instances, but also increases network traffic.
  182. .It http_headers
  183. If you need to add more HTTP response headers for whatever reason, you can
  184. fill this object with the required header/value pairs.
  185. .It Ic show_instance_timeline
  186. If this is set to true, the instance base URL will show a timeline with the latest
  187. user posts instead of the default greeting static page. If other information
  188. fields are set (see below), they are also shown.
  189. .It Ic admin_email
  190. The email address of the instance administrator (optional).
  191. .It Ic admin_account
  192. The user name of the instance administrator (optional).
  193. .It Ic short_description
  194. A textual short description about the instance (optional).
  195. .It Ic fastcgi
  196. If set to true,
  197. .Nm
  198. will use the FastCGI interface to communicate with the upper level
  199. http server, that must be configured accordingly.
  200. .It Ic disable_history
  201. If set to true, history monthly snapshots are not served nor their links shown.
  202. .It Ic shared_inboxes
  203. This boolean value selects if shared inboxes are announced or not. Enabling
  204. shared inboxes helps (somewhat) in optimizing incoming traffic for instances
  205. with a large number of users.
  206. .El
  207. .Pp
  208. You must restart the server to make effective these changes.
  209. .Pp
  210. If a file named
  211. .Pa greeting.html
  212. is present in the server base directory, it will be returned whenever
  213. the base URL of the server is requested. Fill it with whatever
  214. information about the instance you want to supply to people
  215. visiting the server, like sign up requirements, site policies
  216. and such. The special %userlist% mark in the file will cause
  217. the list of users in this instance to be inserted.
  218. .Pp
  219. Users can change a bit of information about themselves from the
  220. web interface. See
  221. .Xr snac 1
  222. for details. Further, every user can have a private CSS file in their
  223. .Pa static/style.css
  224. that will be served instead of the server-wide one.
  225. It's not modifiable from the web interface to avoid users
  226. shooting themselves in the foot by destroying everything.
  227. .Ss Old Data Purging
  228. From version 2.06, there is no longer a need to add a special
  229. cron job for purging old data, as this is managed internally.
  230. .Ss ActivityPub Support
  231. These are the following activities and objects that
  232. .Nm
  233. supports:
  234. .Bl -tag -width tenletters
  235. .It Vt Follow
  236. Complete support, on input and output.
  237. .It Vt Undo
  238. For
  239. .Vt Follow
  240. objects, on input and output.
  241. .It Vt Create
  242. For
  243. .Vt Note ,
  244. .Vt Question
  245. and
  246. .Vt Page
  247. objects, on input and output.
  248. .It Vt Accept
  249. For
  250. .Vt Follow
  251. objects, on input and output.
  252. .It Vt Like
  253. For
  254. .Vt Note
  255. objects, on input and output.
  256. .It Vt Announce
  257. For
  258. .Vt Note
  259. objects, on input and output.
  260. .It Vt Update
  261. For
  262. .Vt Person ,
  263. .Vt Note
  264. and
  265. .Vt Question
  266. objects, on input and output.
  267. .It Vt Delete
  268. Supported for
  269. .Vt Note
  270. and
  271. .Vt Tomsbtone
  272. objects on input, and for
  273. .Vt Note
  274. objects on output.
  275. .El
  276. .Pp
  277. The rest of activities and objects are dropped on input.
  278. .Pp
  279. There is partial support for
  280. .Vt OrderedCollection
  281. objects in the
  282. .Pa /outbox
  283. (with the last 20 entries of the local timeline shown). No pagination
  284. is supported. Intentionally, the
  285. .Pa /followers
  286. and
  287. .Pa /following
  288. paths return empty lists.
  289. .Ss Migrating from Mastodon
  290. User migration from different Fediverse instances is a pain in the ass
  291. that has been implemented everywhere as a kludgy afterthought. There is
  292. not much that can be done, other than importing the list of people you
  293. follow to your new
  294. .Nm
  295. account.
  296. .Pp
  297. To do this, download the user's list of accounts being followed (in CSV
  298. format) from the Mastodon web interface and execute this:
  299. .Bd -literal -offset indent
  300. awk -F, 'NR > 1 { print $1 }' /path/to/following_accounts.csv | \\
  301. xargs -n 1 snac follow $SNAC_BASEDIR $SNAC_USER
  302. .Ed
  303. .Ss Instance blocking
  304. Full instances can be blocked. This operation must be done from
  305. the command-line tool. See
  306. .Xr snac 1 .
  307. .Ss Other Considerations
  308. .Nm
  309. stores all the messages it receives as JSON files, which are usually
  310. bloated and filled with redundant information. Using a filesystem with
  311. file compression enabled (like btrfs or zfs) will probably be a good
  312. choice to store the
  313. .Nm
  314. data storage into.
  315. .Sh ENVIRONMENT
  316. .Bl -tag -width Ds
  317. .It Ev DEBUG
  318. Overrides the debugging level from the server 'dbglevel' configuration
  319. variable. Set it to an integer value. The higher, the deeper in meaningless
  320. verbiage you'll find yourself into.
  321. .El
  322. .Sh EXAMPLES
  323. You want to install the
  324. .Nm
  325. Fediverse daemon in the host example.com, that is correctly configured
  326. with a valid TLS certificate and running the nginx httpd server.
  327. The service will be installed under the
  328. .Pa fedi
  329. location. Two users, walter and jessie, will be hosted in the system.
  330. Their Fediverse presence addresses will be
  331. .Lk https://example.com/fedi/walter
  332. and
  333. .Lk https://example.com/fedi/jesse ,
  334. respectively. They will be known
  335. in the Fediverse as @walter@example.com and @jesse@example.com. The
  336. .Nm
  337. daemon will run as the user snacusr in the system and listen to the
  338. localhost:8001 network socket. All data will be stored in the
  339. .Pa /home/snacusr/fedidata
  340. directory.
  341. .Pp
  342. Log into the system as snacusr and execute:
  343. .Bd -literal -offset indent
  344. snac init /home/snacusr/fedidata
  345. .Ed
  346. .Pp
  347. Answer "example.com" to the host name question, "/fedi" to the path
  348. prefix question, "localhost" to the address and "8001" to the port.
  349. .Pp
  350. Create the users
  351. .Bd -literal -offset indent
  352. snac adduser /home/snacusr/fedidata walter
  353. snac adduser /home/snacusr/fedidata jesse
  354. .Ed
  355. .Pp
  356. Answer the questions with reasonable values.
  357. .Pp
  358. Execute the server:
  359. .Bd -literal -offset indent
  360. snac httpd /home/snacusr/fedidata
  361. .Ed
  362. .Pp
  363. Edit the nginx configuration and add the following snippet to the
  364. example.com server section:
  365. .Bd -literal -offset indent
  366. # nginx configuration example
  367. # main web access point
  368. location /fedi {
  369. proxy_pass http://localhost:8001;
  370. proxy_set_header Host $http_host;
  371. }
  372. # webfinger
  373. location /.well-known/webfinger {
  374. proxy_pass http://localhost:8001;
  375. proxy_set_header Host $http_host;
  376. }
  377. # Mastodon API (entry points)
  378. location /api/v1/ {
  379. proxy_pass http://localhost:8001;
  380. proxy_set_header Host $http_host;
  381. }
  382. location /api/v2/ {
  383. proxy_pass http://localhost:8001;
  384. proxy_set_header Host $http_host;
  385. }
  386. # Mastodon API (OAuth support)
  387. location /oauth {
  388. proxy_pass http://localhost:8001;
  389. proxy_set_header Host $http_host;
  390. }
  391. # optional
  392. location /.well-known/nodeinfo {
  393. proxy_pass http://localhost:8001;
  394. proxy_set_header Host $http_host;
  395. }
  396. .Ed
  397. .Pp
  398. Restart the nginx daemon and connect to
  399. .Lk https://example.com/fedi/walter .
  400. The empty, default screen will be shown. Enter the admin section with the
  401. credentials defined for this user. Search people, start following
  402. them, engage in arid discussions and generally enjoy the frustrating
  403. experience of Social Media.
  404. .Pp
  405. This is an example of a similar configuration for the Apache2 web server:
  406. .Bd -literal -offset indent
  407. # apache2 configuration example
  408. ProxyPreserveHost On
  409. # Main web access point
  410. <Location /social>
  411. ProxyPass http://127.0.0.1:8001/social
  412. </Location>
  413. # WebFinger
  414. <Location /.well-known/webfinger>
  415. ProxyPass http://127.0.0.1:8001/.well-known/webfinger
  416. </Location>
  417. # NodeInfo (optional)
  418. <Location /.well-known/nodeinfo>
  419. ProxyPass http://127.0.0.1:8001/.well-known/nodeinfo
  420. </Location>
  421. # Mastodon API (entry points)
  422. <Location /api/v1/>
  423. ProxyPass http://127.0.0.1:8001/api/v1/
  424. </Location>
  425. <Location /api/v2/>
  426. ProxyPass http://127.0.0.1:8001/api/v2/
  427. </Location>
  428. # Mastodon API (OAuth support)
  429. <Location /oauth>
  430. ProxyPass http://127.0.0.1:8001/oauth
  431. </Location>
  432. .Ed
  433. .Pp
  434. Since version 2.43,
  435. .Nm
  436. supports communicating from / to the front end http server using the FastCGI
  437. protocol. There is no special advantage in using this, only that some servers
  438. allow for simpler configuration. For example, in the case of nginx, you can
  439. replace the two 'proxy_pass' and 'proxy_set_header' lines in the example
  440. above with just
  441. .Bd -literal -offset indent
  442. fastcgi_pass localhost:8001;
  443. .Ed
  444. .Pp
  445. The only thing to change on
  446. .Nm
  447. size is to the set 'fastcgi' value to true in
  448. .Pa server.json .
  449. .Pp
  450. Further, using the FastCGI interface allows a much simpler configuration
  451. under OpenBSD's native httpd, given that it's natively implemented there
  452. and you no longer need to configure the complicated relayd server. This is
  453. an example:
  454. .Bd -literal -offset indent
  455. # OpenBSD httpd configuration example
  456. # other server configuration
  457. [...]
  458. location "/fedi*" {
  459. fastcgi socket tcp "127.0.0.1" 8001
  460. }
  461. location "/.well-known/webfinger" {
  462. fastcgi socket tcp "127.0.0.1" 8001
  463. }
  464. location "/oauth/*" {
  465. fastcgi socket tcp "127.0.0.1" 8001
  466. }
  467. location "/api/v1/*" {
  468. fastcgi socket tcp "127.0.0.1" 8001
  469. }
  470. location "/api/v2/*" {
  471. fastcgi socket tcp "127.0.0.1" 8001
  472. }
  473. location "/.well-known/nodeinfo" {
  474. fastcgi socket tcp "127.0.0.1" 8001
  475. }
  476. .Ed
  477. .Sh SEE ALSO
  478. .Xr snac 1 ,
  479. .Xr snac 5
  480. .Sh AUTHORS
  481. .An grunfink Lk https://comam.es/snac/grunfink @grunfink@comam.es
  482. .Sh LICENSE
  483. See the LICENSE file for details.
  484. .Sh CAVEATS
  485. JSON files are fragile when modified by hand. Take care.