Skip to content

feat: vertically scale cluster machine; reduce overall ec2 count #285

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
DecFox wants to merge 3 commits into
base: main
Choose a base branch
from
Open

feat: vertically scale cluster machine; reduce overall ec2 count #285

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
2306c56
feat: vertically scale cluster machine; reduce overall ec2 count
DecFox Nov 20, 2025
77ae1f1
chore: also decrease service desired count for ooniprobe service
DecFox Nov 20, 2025
f0c0a61
feat: increase oonimeasurements memory reserve; decrease task count
DecFox Nov 20, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
24 changes: 12 additions & 12 deletions tf/environments/prod/main.tf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -521,11 +521,11 @@ module "ooniapi_cluster" {
subnet_ids = module.network.vpc_subnet_public[*].id

# You need be careful how these are tweaked.
asg_min = 2
asg_max = 10
asg_desired = 7
asg_min = 1
Copy link
Contributor

@LDiazN LDiazN Nov 21, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

min should be 2 to have one instance per AZ

asg_max = 5
asg_desired = 4

instance_type = "t3a.medium"
instance_type = "t3a.large"

monitoring_sg_ids = [
# The clickhouse proxy has an nginx configuration
Expand All @@ -550,11 +550,11 @@ module "oonitier1plus_cluster" {
vpc_id = module.network.vpc_id
subnet_ids = module.network.vpc_subnet_private[*].id

asg_min = 2
asg_max = 5
asg_desired = 3
asg_min = 1
Copy link
Contributor

@LDiazN LDiazN Nov 21, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same here

asg_max = 4
asg_desired = 2

instance_type = "t3a.medium"
instance_type = "t3a.large"

monitoring_sg_ids = [
# The clickhouse proxy has an nginx configuration
Expand Down Expand Up @@ -624,9 +624,9 @@ module "ooniapi_ooniprobe" {
dns_zone_ooni_io = local.dns_zone_ooni_io
key_name = module.adm_iam_roles.oonidevops_key_name
ecs_cluster_id = module.ooniapi_cluster.cluster_id
task_memory = 128
task_memory = 512
Copy link
Contributor

@LDiazN LDiazN Nov 21, 2025 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would try with 256 first to see how it behaves, ooniprobe doesn't needs that much memory


service_desired_count = 8
service_desired_count = 2

task_secrets = {
POSTGRESQL_URL = data.aws_ssm_parameter.oonipg_url.arn
Expand Down Expand Up @@ -933,7 +933,7 @@ module "ooniapi_oonimeasurements_deployer" {
module "ooniapi_oonimeasurements" {
source = "../../modules/ooniapi_service"

task_memory = 256
task_memory = 512

first_run = true
vpc_id = module.network.vpc_id
Expand All @@ -946,7 +946,7 @@ module "ooniapi_oonimeasurements" {
ecs_cluster_id = module.oonitier1plus_cluster.cluster_id
# ecs_cluster_id = module.ooniapi_cluster.cluster_id

service_desired_count = 8
service_desired_count = 4

task_secrets = {
POSTGRESQL_URL = data.aws_ssm_parameter.oonipg_url.arn
Expand Down
Loading