The ungleich Matrix infrastructure » History » Version 16
Jin-Guk Kwon, 11/19/2020 08:35 AM
| 1 | 1 | Timothée Floure | h1. The ungleich Matrix infrastructure |
|---|---|---|---|
| 2 | |||
| 3 | 16 | Jin-Guk Kwon | {{toc}} |
| 4 | |||
| 5 | 14 | Timothée Floure | *%{color:red}This document concerns the infrastructure side of our MaaS offer and is intended for ungleich staff. See [[Ungleich Matrix-as-a-Service (MaaS)]] page for end-user/customer documentation. Common operations can be found on: [[https://redmine.ungleich.ch/projects/open-infrastructure/wiki/Common_operations_on_X-as-a-Service]].%* |
| 6 | 1 | Timothée Floure | |
| 7 | h2. Status |
||
| 8 | |||
| 9 | 10 | Timothée Floure | This document is *A DRAFT*. This service is not in production. Ask @fnux for details. |
| 10 | 2 | Timothée Floure | |
| 11 | 4 | Timothée Floure | h2. Environment |
| 12 | 2 | Timothée Floure | |
| 13 | Our Matrix deployments make use of the "Synapse (reference) Matrix homeserver":https://github.com/matrix-org/synapse/ and "Riot web client":https://about.riot.im/. We use Debian buster as base Operating system, leveraging the "matrix-synapse package from the buster-backports repository":https://packages.debian.org/buster-backports/matrix-synapse. The riot client (= static files) is directly fetched from "upstream releases on github":https://github.com/vector-im/riot-web/releases. |
||
| 14 | |||
| 15 | 5 | Timothée Floure | The matrix deployments run on ipv6only VMs, HTTP(S) traffic - including federation - being proxy by the [[How to use the IPv4-to-IPv6-Proxy|ungleich v4-to-v6 proxy]]. Federation is delegated using a @/.well-known/@ URI as described in [[Ungleich Matrix-as-a-Service (MaaS)|the customer FAQ]]. |
| 16 | 2 | Timothée Floure | |
| 17 | 6 | Timothée Floure | !maas.jpg! |
| 18 | |||
| 19 | 2 | Timothée Floure | h2. Tooling |
| 20 | |||
| 21 | The whole MaaS setup is defined in the *manifest/matrix-as-a-service* of *dot-cdist* file, which wraps the *__ungleich_matrix* type. This type leverages: |
||
| 22 | |||
| 23 | * *__matrix_synapse* |
||
| 24 | * *__matrix_riot* |
||
| 25 | * *__ungleich_nginx_static_type* |
||
| 26 | * *__postgres_role* and *__postgres_database* from upstream cdist. |
||
| 27 | |||
| 28 | 8 | Timothée Floure | The "matterbridge":https://github.com/42wim/matterbridge application service can be deployed with the *__matterbridge* type. |
| 29 | |||
| 30 | 7 | Timothée Floure | *Matrix Federation Tester: https://federationtester.matrix.org/* |
| 31 | |||
| 32 | 12 | Timothée Floure | h2. Synapse Admin UI |
| 33 | |||
| 34 | * Available on: https://admin.matrix.ungleich.cloud |
||
| 35 | * Leverages https://github.com/Awesome-Technologies/synapse-admin/ |
||
| 36 | * Static deployment hence hosted on staticweb. |
||
| 37 | |||
| 38 | * Allows manual admin management of users and rooms. |
||
| 39 | 13 | Timothée Floure | * Use direct address of homeserver for login: @https://XXXX.matrix.ungleich.cloud@ |
| 40 | 12 | Timothée Floure | |
| 41 | 4 | Timothée Floure | h2. Monitoring |
| 42 | 1 | Timothée Floure | |
| 43 | 15 | Timothée Floure | Autodiscovered from consul in monitoring LAN. |
| 44 | 14 | Timothée Floure | |
| 45 | 4 | Timothée Floure | h2. Ungleich Deployments |
| 46 | 2 | Timothée Floure | |
| 47 | 4 | Timothée Floure | We maintain our own deployments alongside the customer MaaS, both for our own usage and for testing. |
| 48 | |||
| 49 | 2 | Timothée Floure | h3. matrix-staging.ungleich.ch |
| 50 | |||
| 51 | 4 | Timothée Floure | Staging instance used to tests the deployment pipeline and Matrix updates. |
| 52 | 2 | Timothée Floure | |
| 53 | h3. matrix.ungleich.ch |
||
| 54 | |||
| 55 | 9 | Timothée Floure | Production instance for ungleich. Some rooms are bridged to the "chat.ungleich.ch":https://chat.ungleich.ch mattermost instance. The bridge makes use of the @#matterbridge:ungleich.ch@ local matrix user (i.e. not from LDAP) and @matterbridge@ mattermost user (linked to matterbridge AT ungleich ch). |
| 56 | 11 | Timothée Floure | |
| 57 | h2. Customer Deployments |
||
| 58 | |||
| 59 | That's too sensitive to be public: "this way":https://redmine.ungleich.ch/projects/datacenterlight/wiki/Matrix_customer_deployments ! |
||
| 60 | 10 | Timothée Floure | |
| 61 | 1 | Timothée Floure | h2. Shared TURN server |
| 62 | 10 | Timothée Floure | |
| 63 | 14 | Timothée Floure | Coturn is running at matrix-turn.ungleich.ch. See @matrix-as-a-service@ manifest in dot-cdist for details. |
| 64 | 16 | Jin-Guk Kwon | |
| 65 | h2. create mass users on matrix host |
||
| 66 | |||
| 67 | - info.txt |
||
| 68 | |||
| 69 | <pre> |
||
| 70 | user_id1 pw1 |
||
| 71 | user_id2 pw2 |
||
| 72 | user_id3 pw3 |
||
| 73 | </pre> |
||
| 74 | |||
| 75 | - creating user shall script |
||
| 76 | |||
| 77 | <pre> |
||
| 78 | while read A B |
||
| 79 | do |
||
| 80 | register_new_matrix_user -u $A -p $B --no-admin -c /etc/matrix-synapse/homeserver.yaml http://localhost:8008 |
||
| 81 | echo "$A" "$B" |
||
| 82 | done < info.txt |
||
| 83 | </pre> |
||
| 84 | |||
| 85 | h2. invite mass users on matrix host |
||
| 86 | |||
| 87 | - info.txt |
||
| 88 | |||
| 89 | <pre> |
||
| 90 | user_id1 pw1 |
||
| 91 | user_id2 pw2 |
||
| 92 | user_id3 pw3 |
||
| 93 | </pre> |
||
| 94 | |||
| 95 | - get user token |
||
| 96 | |||
| 97 | --> user : admin room user |
||
| 98 | |||
| 99 | <pre> |
||
| 100 | curl -XPOST -d '{"type":"m.login.password", "user":"[user_id]", "password":"[user_password]"}' "http://localhost:8008/_matrix/client/r0/login" |
||
| 101 | </pre> |
||
| 102 | |||
| 103 | - inviting user script |
||
| 104 | |||
| 105 | <pre> |
||
| 106 | matrixserver="testbr.lab.ungleich.ch" |
||
| 107 | |||
| 108 | generate_post_data() |
||
| 109 | { |
||
| 110 | cat <<EOF |
||
| 111 | { |
||
| 112 | "user_id":"@$A:$matrixserver" |
||
| 113 | } |
||
| 114 | EOF |
||
| 115 | } |
||
| 116 | |||
| 117 | while read A B |
||
| 118 | do |
||
| 119 | curl -XPOST -d "$(generate_post_data)" "http://localhost:8008/_matrix/client/r0/rooms/[room_id]/invite?access_token=[user_token]" |
||
| 120 | done < info.txt |
||
| 121 | </pre> |