Add a TUI to guide users through filling out and validating thier yaml files (#83)

* fix minio config file generation

* additional minio tweaks

* switch to using minio class called BetterMinio instead of anything else

* clean up matrix and mastodon minio objects

* clean up the minio obj returns for init

* do some more house cleaning for argocd appset secret plugin secrets and reloads

* only install nextcloud via argocd if it's not already installed

* some linting

* add more info to mastodon config

* add mastodon as a default namespace

* move mastodon insto mastodon namespace by default

* fix more mastodon bugs

* linting

* fix mastodon postgres dyslexia typo

* clear up weird vouch secret key issue

* generate secrets for mastodon with rake

* add docker pre-req

* add mastodon_rake as it's own file for testing

* check if nextcloud, vouch, matrix, and mastodon are installed before installing via argo

* bump the ingress nginx version to 4.8.3

* adding s3 stuff to matrix

* fix where we remind user where creds are

* combined the kubernetes_util and k8s_lib files into one class, and updated to always update bitwarden IDs for special init apps

* clean up matrix to always update the bitwarden IDs as well as clean up some copy paste issues where matrix was used mastodon as a name for bitwarden secrets

* fix copy paste typo for zitadel core_id

* fix vouch hostname issue

* tidy up ending notes

* fix grabbing the argocd oidc id in the zitadel file

* always check the rollout status of a deployment when we scale it back up before returning

* add an argocd sync function

* add more to the matrix db bitwarden item

* add more scaffolding for matrix oidc app

* centralize matrix oidc stuff to zitadel

* add todo note

* add more for minio and matrix for oidc stuff

* update minio oidc info

* add pgsql password note for nextcloud

* make sure minio is accepted by zitadel configuration function

* fix vouch allowance for creating lists in init values widget

* cleaned up how we utilize the zitadel api to be centralized to each app that needs it

* fix TypeError: setup_oidc_provider() takes from 1 to 6 positional arguments but 8 were given

* fix zitadel return

* add project id setting for zitadel object

* fix project name query

* adding more debug stuff

* clean up zitadel api and try excepts for setting project and user ids

* fox resouce owner tpyo

* fix create project name

* update zitadel project and user system around zitadel

* catch the error of an existing application, though this should rarely happen

* check env for mail server

* clean up minio grabbing root credentials and add proper env var checking for all special sensitive init apps

* fix mastodon generating rake secrets

* fix colors on final cli output and fix matrix's bitwarden secret for oidc creds to have an issuer

* fix non-bitwarden matrix oidc secret

* add a web app sync for mastodon

* add a display name for the minio sso

* change redirect urls for zitadel to append /oauth_callback for minio

* fixing the url used for minio oidc to be the user console and not the api

* we continue the saga of trying to get minio user console to use oidc

* fix matrix element hostname

* cleaning up minio oidc now that it's working

* support federation hostname for matrix app

* add correct callback url for matrix oidc config

* update the matrix config file

* templating out the identity provider name and id for matrix to support more than zitadel in the future

* add directory recusion as an option for the argo dict via the cli and add some more optional init values for nextcloud and an isolated tenant hostname for minio for mastodon as a default secret key

* create nextcloud occ class for creating nextcloud apps

* attempt to support the new direcory recusion param for argocd app values in the tui

* clean up default config notes

* update argo.path and update comments for mastodon

* filled in pod command for nextcloud pods

* rigging up the directory recursion feature for argocd

* add extra code to create isolated minio tenant credentials

* add a nextcloud oidc application

* finish configuring the nextcloud social login app

* add nextcloud occ commands

* make subprocess more capable and also update the nextcloud occ commands class

* clean up nextcloud oidc commands

* clean up nextcloud occ commands

* clean up oidc config for nextcloud including the group mappings

* fix nextcloud redirect url for the social login plugin

* allow users to use the minio tenant, or don't :)

* finally finishing the nextcloud oidc saga

* make it so that if no explicit version is passed into the helm obj, we grab the live version in the argocd-apps repo

* always pull the version we install from the live small-hack/argocd-apps repo

* change default social apps architecture to always use minio operator to create tenants

* don't pass in minio object by default

* fix use_local_minio to be create_minio_tenant

* fix app inputs widget yield

* fix switch event conflict

* update how we get the current version of basic apps

* fix capital kind

* try to fix the argocd appset

* updating appset secret updates

* fix zitadel groupsClaim action for api object

* making sure that default_config explains that minio tenant params are optional

* fix trying to print hostnames after run if there's no argocd enabled

* temporarily use eso-helmchart-test as the argocd branch for checking the latest version of argo

* clean up zitadel api a bit

* only do minio oidc stuff if they're spinning up a default tenant

* update minio to be seperate parts for the operator and tenant

* default encrypt bucket

* update nextcloud to create namespace before starting init functions

* replace ref with revision everywhere

* clean up some old references to minio vs minio tenant and operator

* don't fail if argocd project already exists

* make minio operator app name just minio

* fix minio app wait

* fix minio operator check

* remove whitespace

* pass in zitadel object to nextcloud

* adding a bit more logging around what we're doing in bitwarden cli

* changing bitwarden log levels

* fix create password for s3 bucket

* fix s3 endpoint in secrets for nextcloud

* unquoting lots of stuff and adding minio operator to nextcloud namespace for argocd project

* add cnpg operator

* adding the cnpg operator to list of things we deploy by default

* fix minio pathing

* cleaning up operators again

* remove quotes and update more projects for more operators

* fix ref to be revision

* fix s3 hostname in bitwarden id for nextcloud

* update correct pg tenant repos allowed

* fix argocd appset scaler

* switch username and password for postgres secret keys for nextcloud

* create smtp hostname as a custom bitwarden field called hostname for nextcloud

* fix the privatekeysecretref for cert manager's prod clusterissuer

* fix vouch oidc app creation

* use zitadel.hostname directly for nextcloud and matrix, install ingress_nginx Argo CD application immediately, bundle argocd into the basic apps, clean up __init__ for how we do hostnames

* fix passing in argocd domain

* fix when we create an oidc bitwarden item for nextcloud

* wait first on nextcloud web app being up, then wait on nextcloud web app

* add a default region of eu-west

* fix nextcloud encryption key generation

* add s3_region secret key to matrix and mastodon, and update bweso/matrix to the new small-hack org locations

* Add Minio backup secrets (#93)

* add initial secrets needed for minio backups

* Update smol_k8s_lab/config/default_config.yaml

* Update smol_k8s_lab/config/default_config.yaml

---------

Co-authored-by: Max Roby <[email protected]>
Co-authored-by: JesseBot <[email protected]>

* clean up matrix install as we use a fresh minio tenant and we don't need to stript the zitadel.api url. we can just use zitadel.hostname directly

* always make sure the matrix access key is set when using minio

* fix how we generate the database hostname for matrix

* fix zitadel oidc issuers

* fix matrix default s3 credentials

* add space

* add https:// to any url that doesn't have it for s3 endpoints done delivered via bitwarden

* add new dir for mastodon app

* update poetry dependencies and change this to version 2.0

* clean up namespaces to fix duplicate namespace in project issue

* remove default namespace for metallb-system

* clean up s3 credentials for minio tenants for zitadel and matrix

* add default source repos for mastodon

* don't try to sync the mastodon web app till the mastodon app is totally up

* fix pg-cluster naming

* make sure the namespace is created for mastodon

* create elastic search credentials for mastodon

* change how we create admin users for mastodon

* fix the tootctl command issue

* sync the web-app itself and then wait for it

* update s3_endpoint via secret to always have https://

* add both an s3 hostname and s3 endpoint for mastodon bitwarden secret

* add set anonymous download for our minio mastodon bucket

* settting anonymous download for media objects for the mastodon minio

* cleaning up providing passwords for databases now that we use TLS everywhere

* clean up old db passwords, always write to local minio alias, and make sure we still pass in s3 endpoint for zitadel

* make sure we still create an s3 credentials file for postgresql

* create namespace properly

* add more secrets management stuff for vault

* add unsealing process for vault

* add vault as an alpha app officially

* add more vault logging

* fix vault info log message

* make sure vault gets deployed alongside bitwarden provider

* add init enabled to vault in default config

* fixing init values to not include the minio tenant creation for user dict for zitadel

* fix logging issue and be extremely clear about vault being a community lead project

* fix custom columns arg for vault setup

* make vault setup script runnable directly and fix using the namespace everywhere

* only initialize vault if it's not installed already

* reduce info logging

* clean up namespace and secret creation for zitadel

* give apps list more room

* clean up apps screen tui

* fix apps config link hovers

* log that we're changing the namespace and authing argo against k8s context

* try to fix minioAdmin class usage

* fix vouch oauth config

* disable s3 encryption key for now

* change external secrets to take providers

* add some basic setup for seaweedfs

* add creating bitwarden id for seaweedfs

* update seaweedfs bitwarden secret

* allow seaweedfs to take bitwarden objects

* always use a local s3 endpoint, but allow changing between minio or seaweedfs

* remove checking for initial s3 secrets for local s3 provider and add seaweedfs as a valid project source repo for matrix, mastodon, and nextcloud

* remove create_minio_tenant from the config in favor of app.init.values.s3_provider

* adding default pvc capacity to the nextcloud app

* if zitadel fails saying there's already an app for nextcloud, just fetch the credentials from bitwarden

* preparing for backups of nextcloud

* fix nextcloud bitwarden secrets typo

* fix default config for zitadel

* switching zitadel to seaweedfs

* fix comment

* add seaweedfs and seaweedfs_csi_driver to default apps

* clean up default seaweedfs csi driver

* add seaweedfs csi driver

* don't do anything fancy for smtp in sensitive values

* add zitadel to apps for sensitive values

* update default zitadel config

* forgot to add the s3 provider

* add examples of exporting env vars for mastodon and zitadel

* attempt to fix seaweedfs default config

* k8up is enabled by default now

* workin with mah best buddy max <3

* add seaweedfs repo to project to start

* always deploy k8up as a default operator ahead of the storage stuff

* add pvc capacity for zitadel

* give capacity to zitadel as well

* add more stuff for mastodon and matrix for s3

* use correct zitadel backup key

* make sure restic repo password gets created as a custom field in bitwarden for zitadel

* try to fix zitadel pvc issues

* fix seaweedfs root credentials

* change default bucket name to nextcloud-data

* switch from alpha to demo directory everywhere, clean up descriptions

* allow matrix and mastodon to be more flexible with how they create s3 endpoints and credentials

* clean up zitadel to always create admin credentials for s3

* fix zitadel issue

* don't bother with the restic_repo_password for the user dict either

* don't need to care about smtp password either

* add registry-1.docker.io for nextcloud

* modify mastodon to always create the admin user

* actually don't create the mastodon user via k8s, insead use smol-k8s-lab to do it via k exec because the tootctl command for new users and updating passwords doesn't let you specify a password

* can't spell protocal

* don't sleep when scaling a replica set down, instead just do a rollout status

* allow matrix to have pre-existing oidc credentials

* fix matrix s3 bucket

* fix s3_backup from backup_s3 everywhere

* fix nextcloud oidc_login install

* we now handle user apps via a post install hook via argocd

* tidy nextcloud a bit

* clean up default config descriptions

* switching all backup_s3 to s3_backup

* add sleep back :(

* upgrading all the poetry dependencies

* explain that 2.0.0a is on its way

* updating all eso-helm-chart-test to main

* update the poetry lock file

* make sure a fresh install with no clusters reminds users using TTS that you have to press tab before pressing c to configure acessibility options

* update all the docs for our postgres backed apps

* add a seaweedfs app

---------

Co-authored-by: Max! <[email protected]>
Co-authored-by: Max Roby <[email protected]>

Author: 3 people

README.md

@@ -0,0 +1,94 @@
+Copyright (c) 2022, Matthias Tellen [email protected],
+with Reserved Font Name mononoki.
+
+This Font Software is licensed under the SIL Open Font License, Version 1.1.
+This license is copied below, and is also available with a FAQ at:
+http://scripts.sil.org/OFL
+
+
+-----------------------------------------------------------
+SIL OPEN FONT LICENSE Version 1.1 - 26 February 2007
+-----------------------------------------------------------
+
+PREAMBLE
+The goals of the Open Font License (OFL) are to stimulate worldwide
+development of collaborative font projects, to support the font creation
+efforts of academic and linguistic communities, and to provide a free and
+open framework in which fonts may be shared and improved in partnership
+with others.
+
+The OFL allows the licensed fonts to be used, studied, modified and
+redistributed freely as long as they are not sold by themselves. The
+fonts, including any derivative works, can be bundled, embedded, 
+redistributed and/or sold with any software provided that any reserved
+names are not used by derivative works. The fonts and derivatives,
+however, cannot be released under any other type of license. The
+requirement for fonts to remain under this license does not apply
+to any document created using the fonts or their derivatives.
+
+DEFINITIONS
+"Font Software" refers to the set of files released by the Copyright
+Holder(s) under this license and clearly marked as such. This may
+include source files, build scripts and documentation.
+
+"Reserved Font Name" refers to any names specified as such after the
+copyright statement(s).
+
+"Original Version" refers to the collection of Font Software components as
+distributed by the Copyright Holder(s).
+
+"Modified Version" refers to any derivative made by adding to, deleting,
+or substituting -- in part or in whole -- any of the components of the
+Original Version, by changing formats or by porting the Font Software to a
+new environment.
+
+"Author" refers to any designer, engineer, programmer, technical
+writer or other person who contributed to the Font Software.
+
+PERMISSION & CONDITIONS
+Permission is hereby granted, free of charge, to any person obtaining
+a copy of the Font Software, to use, study, copy, merge, embed, modify,
+redistribute, and sell modified and unmodified copies of the Font
+Software, subject to the following conditions:
+
+1) Neither the Font Software nor any of its individual components,
+in Original or Modified Versions, may be sold by itself.
+
+2) Original or Modified Versions of the Font Software may be bundled,
+redistributed and/or sold with any software, provided that each copy
+contains the above copyright notice and this license. These can be
+included either as stand-alone text files, human-readable headers or
+in the appropriate machine-readable metadata fields within text or
+binary files as long as those fields can be easily viewed by the user.
+
+3) No Modified Version of the Font Software may use the Reserved Font
+Name(s) unless explicit written permission is granted by the corresponding
+Copyright Holder. This restriction only applies to the primary font name as
+presented to the users.
+
+4) The name(s) of the Copyright Holder(s) or the Author(s) of the Font
+Software shall not be used to promote, endorse or advertise any
+Modified Version, except to acknowledge the contribution(s) of the
+Copyright Holder(s) and the Author(s) or with their explicit written
+permission.
+
+5) The Font Software, modified or unmodified, in part or in whole,
+must be distributed entirely under this license, and must not be
+distributed under any other license. The requirement for fonts to
+remain under this license does not apply to any document created
+using the Font Software.
+
+TERMINATION
+This license becomes null and void if any of the above conditions are
+not met.
+
+DISCLAIMER
+THE FONT SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
+EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO ANY WARRANTIES OF
+MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT
+OF COPYRIGHT, PATENT, TRADEMARK, OR OTHER RIGHT. IN NO EVENT SHALL THE
+COPYRIGHT HOLDER BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY,
+INCLUDING ANY GENERAL, SPECIAL, INDIRECT, INCIDENTAL, OR CONSEQUENTIAL
+DAMAGES, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
+FROM, OUT OF THE USE OR INABILITY TO USE THE FONT SOFTWARE OR FROM
+OTHER DEALINGS IN THE FONT SOFTWARE.