Repository architecture¶
This page explains how the machine is built: which entry points exist, how a CLI command becomes an
ansible-playbook run, how site.yml is laid out, what every service role has in common, and which custom modules
actually touch the hosts. The other pages build on the vocabulary defined here.
Note
Key answers
reconfigureisdeploy. Of the 54 roles that have areconfigure.yml, 51 only doimport_tasks: deploy.yml, soreconfigurere-runs Keystone registration, DB creation and the bootstrap (DB sync) container of most services CODE (§4.2).- A config change is applied by a full stop/start, never a reload. A changed file, a changed container definition,
a changed systemd unit or drift reported by
kolla_set_configs --checknotifies the restart handler, which recreates the container when the image or parameters differ and otherwise restarts its systemd unit CODE (§4.3). - The stop timeout is the 60 s of
docker_graceful_timeout. The value fromdocker_common_optionsreaches the module and is written into each container's systemd unit (stop <name> -t 60) CODE (§6). deployandreconfigurepull an image only if it is absent locally (start_container). A rebuilt image pushed under the same tag is not fetched bydeployorreconfigure; it takes an explicitpullCODE (§6).- Batching is off by default.
ANSIBLE_SERIALdefaults to 0, which means all hosts of a play in one batch, and the wrapper passeskolla_serialonly forreconfigureandupgradeCODE (§2). New in 2024.1: every play ofsite.ymlcarries amax_fail_percentagethat defaults to 100, which never stops a play early CODE (§3). - Changed in 2024.1: the container module is
kolla_container, for Docker or Podman.kolla_dockeris gone;kolla_containerpicks a Docker or a Podman worker fromkolla_container_engine(defaultdocker) CODE (§6). commonis a play of its own, taggedcommon. No role has a meta dependency on it:-t common reconfigurerenders and restarts the common containers, and-t novadoes not runcommonCODE (§5.1).- Host bootstrap lives outside the repository.
bootstrap-serversrunsopenstack.kolla.baremetalfrom ansible-collection-kolla, whichkolla-ansible install-depsinstalls fromrequirements.yml; the collection now installs Docker or Podman CODE (§1).
Scope: the
2024.1-eomtag ofopenstack/kolla-ansible(commit890396f), with ansible-collection-kolla at thestable/2024.1branch thatrequirements.ymlpins (studied at its2024.1-eomtag, commit82a0f5c). Every path below is relative to the root of the kolla-ansible checkout; paths prefixedansible-collection-kolla,kollaoransible-core 2.16.20point into the collection, the kolla image repository (2024.1-eom, commited7a36a) or the Ansible source. The evidence labels CODE and NOT AVAILABLE are defined once, in Evidence labels.
1. Top-level layout¶
| Path | What it is | Why it matters for Day 2 |
|---|---|---|
tools/ |
Bash wrapper. Maps sub-commands to a playbook plus -e kolla_action=<action>; checks that ansible-core is between 2.15 and 2.16 (tools/) |
Decides which playbook runs and whether kolla_serial is passed (§2) |
requirements.yml |
Ansible Galaxy requirements: one collection, https://opendev.org/, type: git, version: stable/ (requirements.yml:2-5) |
Installed by kolla-ansible install-deps (ansible-galaxy collection install -r requirements.yml --force, tools/). Without it bootstrap-servers cannot find its role. A branch, not a tag: what is installed is whatever the branch holds at install time |
requirements-core.yml |
New in 2024.1. Seven Galaxy collections with upper bounds: ansible.netcommon, ansible.posix, ansible.utils, community.crypto, community.general, community.docker, containers.podman (requirements-core.yml:2-23) |
install-deps installs it only when pip show ansible fails, i.e. when only ansible-core is installed (tools/) |
ansible-collection-kolla (openstack.kolla, galaxy.yml:2-3) |
Separate repository, roles only (no modules or plugins): apparmor_libvirt, baremetal, docker, docker_sdk, etc_hosts, kolla_user, packages, and, new in 2024.1, podman and podman_sdk |
Holds the host-bootstrap code. kolla-ansible references it in one place: kolla-host.yml:13 (role: openstack.kolla.baremetal). baremetal imports etc_hosts, packages, openstack.kolla.{{ container_engine }}, kolla_user, openstack.kolla.{{ container_engine }}_sdk and apparmor_libvirt, with container_engine defaulting to kolla_container_engine or docker (ansible-collection-kolla roles/, install.yml:34-38, post-install.yml:2-19, defaults/) |
ansible/ |
The main playbook (71 plays once gather-facts.yml, mariadb.yml, rabbitmq.yml and nova.yml are expanded: 51 + 2 + 5 + 3 + 10) |
Every deploy, reconfigure, upgrade, pull, stop, prechecks, genconfig, validate-config, deploy-containers run goes through it |
ansible/ |
Imported first by site.yml (and by kolla-host.yml) |
Fact gathering, including the special --limit path (see Compute scaling) |
ansible/, ansible/ |
Imported by site.yml:400 and :468 |
MariaDB in 5 plays, RabbitMQ in 3 plays (the outward RabbitMQ plays of 2023.1 are gone); the restart plays use serial: "33%" (mariadb.yml:24, :42; rabbitmq.yml:36) |
ansible/ |
Imported by site.yml:609 |
Nova is split into 10 plays (see Nova deep dive) |
ansible/ |
bootstrap-servers: gather-facts.yml, then one play on baremetal with serial: kolla_serial applying openstack.kolla.baremetal (kolla-host.yml:1-14) |
Installs the container engine and changes the host OS. Can restart the Docker daemon (ansible-collection-kolla roles/) |
ansible/, prune-images.yml, mariadb_backup.yml, mariadb_recovery.yml, post-deploy.yml, certificates.yml, octavia-certificates.yml, bifrost.yml, nova-libvirt-cleanup.yml, rabbitmq-reset-state.yml, rabbitmq-upgrade.yml |
Single-purpose playbooks. monasca_cleanup.yml of 2023.1 is gone |
See Operations |
ansible/roles/ |
71 roles, none with a meta/ directory. 54 are applied by the plays of site.yml (51 service roles plus prechecks, common and loadbalancer); 5 by their own playbooks (bifrost, certificates, octavia-certificates, destroy, prune-images); 12 are helper roles imported by the others. Gone since 2023.1: freezer, kafka, monasca, murano, sahara, senlin, solum, storm, vitrage, zookeeper; new: letsencrypt (service) and sysctl (helper) |
§4 and §5 |
ansible/ |
1,383 lines of defaults (every enable_*, ports, transport URLs, container options, kolla_container_engine: "docker" at :92) |
Lowest-priority defaults. globals.yml overrides them |
ansible/ |
Example inventories that define 180 groups each | Group membership drives where every container runs |
ansible/ |
Custom modules: kolla_container (replaces kolla_docker), kolla_toolbox, kolla_container_facts, kolla_container_volume_facts |
Main container interface: the service roles' container lifecycle goes through kolla_container. Many role tasks also run {{ kolla_container_engine }} exec/inspect directly (§6) |
ansible/ |
kolla_container_worker.py (shared comparison logic), kolla_docker_worker.py (Docker SDK calls), kolla_podman_worker.py (Podman SDK calls, new), kolla_systemd_worker.py (one systemd unit per container) |
Where kolla_container actually decides and acts (§6) |
ansible/ |
merge_configs (INI merge) and merge_yaml |
How /etc/ overrides are merged (§7) |
ansible/, kolla_ansible/ |
Jinja filters: service_enabled_and_mapped_to_host, select_services_enabled_and_mapped_to_host, kolla_address, kolla_url (new), put_address_in_context, database_shards_info; role-local extract_cell (nova-cell) and customise_fluentd (common) |
Decide placement of a service on a host (§4.4) |
etc/, etc/ |
Templates copied to /etc/kolla/ by the operator |
globals.yml (and every *.yml in /etc/) is passed as extra-vars (§2.1) |
tools/cleanup-*, tools/, tools/ |
Host utilities | cleanup-host deletes network namespaces and links (tools/; see Risk register) |
doc/source/ |
Documentation (user/, reference/, …) |
Used only to cross-check, never as the source of truth |
No ansible.cfg is shipped for operators CODE (no ansible.cfg in the kolla-ansible tree; fact sheet E
§12). Forks,
pipelining, fact caching and SSH settings come from whatever ansible.cfg or environment the operator provides.
2. From CLI to ansible-playbook¶
tools/kolla-ansible builds a single command line (tools/kolla-ansible:600-607):
GLOBALS_DIR="${CONFIG_DIR}/globals.d"
EXTRA_GLOBALS=$([ -d "${GLOBALS_DIR}" ] && find ${GLOBALS_DIR} -maxdepth 1 -type f -name '*.yml' -printf ' -e @%p' || true 2>/dev/null)
PASSWORDS_FILE="${PASSWORDS_FILE:-${CONFIG_DIR}/passwords.yml}"
CONFIG_OPTS="-e @${CONFIG_DIR}/globals.yml ${EXTRA_GLOBALS} -e @${PASSWORDS_FILE} -e CONFIG_DIR=${CONFIG_DIR}"
CMD="ansible-playbook $CONFIG_OPTS $EXTRA_OPTS $PLAYBOOK $VERBOSITY"
for INVENTORY in ${INVENTORIES[@]}; do
CMD="${CMD} --inventory $INVENTORY"
done
| Command | Playbook | Extra vars added | kolla_serial passed? |
Evidence |
|---|---|---|---|---|
prechecks |
site.yml |
kolla_action=precheck |
no | tools/ |
check |
– | the sub-command does not exist; it falls to usage and exit 3 |
– | :595-597 |
bootstrap-servers |
kolla-host.yml |
kolla_action=bootstrap-servers |
no (the playbook has its own serial: kolla_serial) |
:485-489 |
deploy |
site.yml |
kolla_action=deploy |
no | :490-493 |
deploy-containers |
site.yml |
kolla_action=deploy-containers |
no | :499-502 |
pull |
site.yml |
kolla_action=pull |
no | :516-519 |
upgrade |
site.yml |
kolla_action=upgrade -e kolla_serial=${ANSIBLE_SERIAL} |
yes | :520-523 |
reconfigure |
site.yml |
kolla_action=reconfigure -e kolla_serial=${ANSIBLE_SERIAL} |
yes | :529-532 |
genconfig |
site.yml |
kolla_action=config |
no | :557-560 |
validate-config |
site.yml |
kolla_action=config_validate |
no | :561-564 |
stop |
site.yml |
kolla_action=stop (needs --yes-i-really-really-mean-it) |
no | :533-545 |
destroy |
destroy.yml |
inventories_comma_separated=<the -i paths> (new in 2024.1), optional destroy_include_images/destroy_include_dev (needs --yes-i-really-really-mean-it) |
no | :458-484 |
mariadb_recovery |
mariadb_recovery.yml |
kolla_action=deploy |
no | :448-452 |
mariadb_backup |
mariadb_backup.yml |
kolla_action=backup -e mariadb_backup_type=<full|incremental> |
no | :453-457 |
post-deploy |
post-deploy.yml |
– | no | :512-515 |
prune-images |
prune-images.yml |
(needs --yes-i-really-really-mean-it) |
no | :565-576 |
install-deps |
– | runs ansible-galaxy collection install -r requirements.yml --force (plus requirements-core.yml when the ansible package is absent) and exits |
– | :131-144, :440-443 |
The 2024.1 wrapper also has deploy-bifrost, deploy-servers, upgrade-bifrost, gather-facts, certificates,
octavia-certificates (with a new --check-expiry <days> that adds octavia_certs_check_expiry=yes),
nova-libvirt-cleanup, rabbitmq-reset-state and rabbitmq-upgrade (:494-498, :503-511, :524-528, :546-556,
:577-590), none of which passes kolla_serial. monasca_cleanup no longer exists: it is not in the case and falls
to usage (:595-597).
Consequences CODE:
ANSIBLE_SERIALdefaults to 0 (tools/kolla-ansible:294-296), which means all hosts of a play in one batch: ansible-core turns a serial value of 0 or less into a single batch of every host (ansible-core 2.16.20lib/ansible/executor/playbook_executor.py:295-302). The comment in the wrapper reads "Serial is not recommended and disabled by default".kolla_serialis overridden forreconfigureandupgrade. The wrapper appends-e kolla_serial=${ANSIBLE_SERIAL}after the user's-eoptions. For those two commands a user-supplied-e kolla_serial=Nis therefore silently replaced byANSIBLE_SERIAL. Use the environment variable instead (fact sheet E §11).- Other commands default to 0. For
deployand the rest,kolla_serialis not passed, and the plays fall back tokolla_serial|default("0"). --tags,--skip-tags,--limit,--forks,--checkand--diffpass straight through (:312-330,:376-384).EXTRA_OPTSfrom the environment is passed through as well (:287), which is the only way to reach--list-tasks,--list-tagsor--list-hoststhrough the wrapper.-ican be given several times, and without it no inventory is passed. Each-iadds a--inventory(:302-305, :605-607). TheINVENTORYdefault toansible/inventory/all-in-one(:284) is never used: the loop variable overwrites it, so a command without-iruns on whatever inventory the Ansible configuration names./etc/kolla/globals.d/*.ymlare extra-vars too, loaded afterglobals.ymland beforepasswords.yml(:600-603).- Bug:
--ask-vault-pass. The branch setsVERBOSITY="$EXTRA_OPTS --ask-vault-pass"(:391-394), which duplicates all options seen so far and drops earlier-vflags. Still present in 2024.1.
2.1 Variable precedence that matters¶
globals.yml and passwords.yml are passed with -e @file. That is extra-vars, the highest precedence in Ansible:
Ansible merges role defaults first, group vars and host vars later, and extra-vars last (ansible-core 2.16.20
lib/ansible/vars/manager.py:202-221, :290-303, :421). Consequences CODE:
- A value in
globals.ymlcannot be overridden per host or per group in the inventory. Per-host variation must come from variables that are not set inglobals.yml. Inventoryhost_varsoverride role defaults andgroup_vars/all.yml, but not extra-vars. - Anything placed in
globals.yml(orglobals.d/) applies to every play and every host. This is why "global" switches such asenable_barbican,openstack_tag,nova_compute_virt_typeorkolla_container_enginehave fleet-wide effects (see Operations). - The same holds for the collection:
openstack.kolla.baremetaland the roles it imports read the variables of the run, so a Docker, Podman or host setting placed inglobals.ymloverrides the collection's role defaults.
3. Anatomy of site.yml¶
flowchart TB
subgraph pre["Always-run plays (tag: always)"]
GF1["gather-facts.yml play 1<br/>setup on all hosts<br/>(skipped if facts cached)"] --> GF2["gather-facts.yml play 2<br/>delegated setup when --limit is used"]
GF2 --> GB["Group hosts based on configuration<br/>group_by: kolla_action_*,<br/>enable_<svc>_True/False"]
end
GB --> PRE["Apply role prechecks<br/>(hosts: kolla_action_precheck)"]
PRE --> COM["common (cron, fluentd, kolla-logs, kolla-toolbox hosts; tag: common)"]
COM --> INFRA["loadbalancer (+39 loadbalancer includes) → letsencrypt → collectd → influxdb → telegraf → redis<br/>→ mariadb.yml (5 plays) → memcached → prometheus → iscsi → multipathd<br/>→ rabbitmq.yml (3 plays) → etcd"]
INFRA --> CP1["keystone → opensearch → swift → ceph-rgw → glance → ironic → cinder → placement"]
CP1 --> NOVA["nova.yml (10 plays)"]
NOVA --> NET["openvswitch | ovs-dpdk → ovn-controller → ovn-db → neutron → kuryr → hacluster"]
NET --> CP2["heat → horizon → magnum → mistral → manila → gnocchi → ceilometer → aodh → barbican<br/>→ cyborg → designate → trove → watcher → grafana → cloudkitty → tacker → octavia → zun<br/>→ blazar → masakari → venus → skyline"]
Facts about the structure CODE (ansible/site.yml):
- One play per service, in a fixed order. There is no dependency resolver. The deployment order is the order of
plays in
site.yml(see Execution flow). The only exception is the loadbalancer play (site.yml:105-326): it runs before the services it fronts, and configures all of their frontends in one place through 39include_role … tasks_from: loadbalancer, run only whenenable_haproxyis true and fordeploy,reconfigure,upgradeandconfig(site.yml:324-326). Themurano,solum,sahara,freezer,senlinandvitrageplays and includes of 2023.1 are gone; aletsencryptplay follows the loadbalancer play (site.yml:328-340). - The "group by configuration" optimisation. The play at
site.yml:7-75puts every host into groups such asenable_nova_True. Every service play then intersects its host list with&enable_<svc>_True, for examplehosts: [compute, …, '&enable_neutron_True'](site.yml:671-685). If a service is disabled, the play matches no host and Ansible skips it entirely, which avoids evaluating hundreds ofwhen:clauses per host. The NOTE atsite.yml:4-6says this exists because "in large environments, even tasks that are skipped can take a significant amount of time". - Serial, failure threshold and tags differ between plays. Almost every play has
serial: '{{ kolla_serial|default("0") }}'.- Exceptions: the setup plays
Group hosts based on configurationandApply role prechecks(site.yml:7-86) have noserialkey. Changed in 2024.1: theetcdplay has noserialkey either (site.yml:470-481). Outsideupgrade(andconfig), etcd's handlers restart the non-leaders in four index-modulo-4 waves, then the leader (roles/etcd/handlers/main.yml:40-65); onupgradea handler loops over theetcdgroup for the non-leaders without using the loop item, so each non-leader includes the restart tasks once per etcd member (:28-36); its comment says "one by one", but whether the members really restart one after another depends on how ansible-core orders those includes across hosts, which is NOT AVAILABLE. MariaDB and RabbitMQ are not single plays: their apply and post-configuration plays have noserialkey (all members in one batch), while their restart plays use a fixedserial: "33%"thatANSIBLE_SERIALdoes not change (mariadb.yml:18-52,rabbitmq.yml:30-49). The handlers only sort hosts into themariadb_restart/rabbitmq_restartgroups; the restart itself happens in those plays (fact sheet B §1–2; Tags). - Bug:
cyborg(site.yml:876) usesserial|default("0"), notkolla_serial, soANSIBLE_SERIALhas no effect on cyborg. Still present in 2024.1. - New in 2024.1:
max_fail_percentageon every play. All 51 plays ofsite.yml(and those ofmariadb.yml,rabbitmq.yml,nova.ymlandkolla-host.yml) setmax_fail_percentageto<name>_max_fail_percentage | default(kolla_max_fail_percentage) | default(100)(e.g.site.yml:10-13, :96-99). Neither variable is defined inansible/(kolla_max_fail_percentageis only a commented example,etc/kolla/globals.yml:31), so the value is 100. ansible-core stops a batch only when the share of failed hosts is greater than the percentage (ansible-core 2.16.20lib/ansible/plugins/strategy/linear.py:336-350), so by default no play is cut short by failures of other hosts. - Tag placement varies:
- Most plays tag the role, e.g.
roles: - { role: kuryr, tags: kuryr }. - The
commonand loadbalancer plays, themariadb.ymlandrabbitmq.ymlplays and allnova.ymlplays put tags at play level (site.yml:100-101, :115-118;mariadb.yml:12-13;nova.yml:34-38). memcachedhas two tags,[memcache, memcached](site.yml:413-414);ovn-controllerandovn-dbshareovn(site.yml:652-653, :668-669).- The
prechecksplay has no tag at all (site.yml:77-86).
- Most plays tag the role, e.g.
- Exceptions: the setup plays
commonis a play, not a dependency. No role has ameta/directory, so nothing pullscommonin. It runs in its own play,Apply role common, on the hosts ofcron,fluentd,kolla-logsandkolla-toolbox(site.yml:88-103), which in the example inventories are children ofcommon= control, network, compute, storage, monitoring (ansible/inventory/multinode:49-54, :203-213) (§5.1).
The complete table of plays (hosts, tags, serial) is generated from the source in Generated inventory §1.
4. Anatomy of a service role¶
Every service role follows the same skeleton. glance is a typical example (in 2024.1 nova keeps its bootstrap in
separate nova.yml plays, so its deploy.yml has no bootstrap step, roles/nova/tasks/deploy.yml:1-9):
roles/<svc>/
defaults/main.yml <svc>_services dict (containers), images, volumes, healthchecks, ks users/endpoints, ports
vars/main.yml project_name (and, for nova-cell, kolla_role_name)
handlers/main.yml "Restart <service-key> container" handlers (kolla_container recreate_or_restart_container)
tasks/main.yml - include_tasks: "{{ kolla_action }}.yml" <-- dynamic dispatch
tasks/deploy.yml register.yml → config.yml → check-containers.yml → bootstrap.yml → flush_handlers
tasks/reconfigure.yml - import_tasks: deploy.yml <-- reconfigure == deploy
tasks/upgrade.yml service-specific (stop/rolling, DB migrations, check-containers, flush)
tasks/deploy-containers.yml - import_tasks: check-containers.yml
tasks/pull.yml import_role: service-images-pull
tasks/stop.yml import_role: service-stop
tasks/precheck.yml import_role: service-precheck + port checks
tasks/check.yml (in most roles, usually empty; glance has none)
tasks/config.yml (also run alone for kolla_action=config, i.e. `genconfig`)
tasks/config_validate.yml import_role: service-config-validate (kolla_action=config_validate, `validate-config`)
tasks/copy-certs.yml import_role: service-cert-copy (from config.yml, when CA copy or backend TLS is enabled)
tasks/loadbalancer.yml import_role: loadbalancer-config (tags: always) <-- called from the loadbalancer play
templates/ <service>.json.j2 (kolla_set_configs manifest), <svc>.conf.j2, …
There is no meta/main.yml: no role in ansible/roles/ has a meta/ directory CODE. Evidence for glance:
roles/glance/tasks/main.yml:2, deploy.yml:2-15, reconfigure.yml:2, pull.yml:2-3, precheck.yml:2-6,
config.yml:38-40, loadbalancer.yml:2-7, check-containers.yml:2-19, handlers/main.yml:2-18; for nova:
roles/nova/tasks/deploy.yml, config_validate.yml, vars/main.yml.
4.1 kolla_action dispatch¶
tasks/main.yml is a dynamic include_tasks: "{{ kolla_action }}.yml". Two consequences follow CODE:
--list-tasksis blind to role internals. It shows only theinclude_tasksplaceholder of every role: the listing walks the statically compiled play (play.compile()) and does not load dynamically included files (ansible-core 2.16.20lib/ansible/cli/playbook.py:193-219); dynamic includes are loaded at run time (lib/ansible/plugins/strategy/linear.py:252). You cannot use--list-tasksto see what a tag will do in Kolla-Ansible. The linked list-tasks-nova.txt is the Ussuri parse; it shows the same placeholders.- Tags reach the role's tasks only through inheritance. The included tasks inherit the role and play tags (e.g.
nova), not tags written on theinclude_tasksstatement itself (see Tags §2). An include is not statically loaded, so the block of included tasks skips the include's tags and inherits those of the role, its dependency chain and the play (ansible-core 2.16.20lib/ansible/playbook/task_include.py:50,lib/ansible/playbook/block.py:310-361).
4.2 reconfigure is deploy¶
Of the 54 roles that have a reconfigure.yml, 51 only do import_tasks: deploy.yml. skyline does the same with
include_tasks (roles/skyline/tasks/reconfigure.yml:2). swift and bifrost have their own reconfigure logic:
swift fails if a container is down, runs kolla_set_configs --check and restarts only drifted containers
(roles/swift/tasks/reconfigure.yml:32-54 and following).
The bifrost copy cannot work and no kolla-ansible command runs it: it uses a group and a container named
bifrost-deploy (roles/bifrost/tasks/reconfigure.yml:2-24), but the container is bifrost_deploy
(roles/bifrost/tasks/start.yml:8), the example inventory has a bifrost group but no bifrost-deploy group
(ansible/inventory/multinode:174), roles/bifrost/templates/ holds no config.json template, and the wrapper sends
reconfigure to site.yml, which has no bifrost play (tools/kolla-ansible:529-532). Still holds in 2024.1.
See the generated column "reconf→deploy" in Generated inventory
§3. So reconfigure re-runs
Keystone registration, DB creation and the bootstrap (DB sync) container of most services, exactly like deploy
CODE (e.g. roles/glance/tasks/reconfigure.yml:2, roles/glance/tasks/deploy.yml:2-15). The only built-in
differences between deploy and reconfigure are:
kolla_serialis passed fromANSIBLE_SERIAL(§2).- No
when: kolla_action == ...condition separates them. Every condition inansible/that namesdeployorreconfigurenames both (nova.yml:55, :91, :172;mariadb.yml:86;rabbitmq.yml:67;site.yml:326). Neutron's DB-sync container (bootstrap_neutron) is imported without any condition (roles/neutron/tasks/bootstrap.yml:38,roles/neutron/tasks/bootstrap_service.yml:2-21), so it runs on everydeployandreconfigure;neutron_enable_rolling_upgrade(roles/neutron/defaults/main.yml:732) is read only byroles/neutron/tasks/upgrade.yml:5, :8. Nova's bootstrap plays run on bothdeployandreconfigure(ansible/nova.yml:49-55, :85-91).
4.3 The config → check → handler pattern¶
This is the heart of Day-2 behaviour:
sequenceDiagram
autonumber
participant DH as Deploy host (ansible-playbook)
participant H as Target host
participant C as Container
DH->>DH: render template / merge_configs locally (Jinja + INI merge)
DH->>H: copy module: compare checksum of /etc/kolla/<svc>/<file>
alt content differs
DH->>H: write file (changed) → notify "Restart <svc> container"
end
DH->>H: kolla_container compare_container (check-containers.yml)
H->>C: engine inspect (image id/tag, volumes, volumes_from, env, privileged, pid/ipc/cgroupns, caps, dimensions, labels, command, healthcheck, state)
H->>C: exec kolla_set_configs --check (config drift between /var/lib/kolla/config_files and live files)
H->>H: compare /etc/systemd/system/kolla-<name>-container.service with the unit it would write
alt differs or drift
DH-->>DH: notify "Restart <svc> container"
end
Note over DH,H: meta: flush_handlers (end of deploy.yml) or end of play
DH->>H: handler: kolla_container recreate_or_restart_container
alt image or container params differ
H->>C: pull image if absent → systemd stop (stop -t 60) → rm → create + unit → systemd start (RECREATE)
else only config changed (COPY_ALWAYS)
H->>C: rewrite unit if needed → systemd RestartUnit (stop -t 60, start) (RESTART)
end
- Files are rendered on the deploy host and copied. The
templateandmerge_configssteps render on the deploy host, then thecopylogic compares checksums on the target (ansible/action_plugins/merge_configs.py:168-216). So every config task costs one SSH round trip per host per item, even when nothing changes (see Compute scaling). -
Three independent triggers lead to the same handler. A changed file notifies directly. The
compare_containertask (module_utils/kolla_container_worker.py:58-65) also notifies when:- the container's definition differs (
check_container_differs,kolla_container_worker.py:67-89: capabilities, security options, image ID or tag, ipc/pid/cgroupns mode, labels, privileged, tmpfs, volumes,volumes_from, environment, state, dimensions, command, healthcheck); or kolla_set_configs --checkinside the running container reports drift. With Docker (module_utils/kolla_docker_worker.py:146-181) a container that cannot be exec'd into counts as drifted (:155-163) and so does exit code 137 (:173-177); with Podman (module_utils/kolla_podman_worker.py:428-453) a container that is notrunningcounts as drifted (:432-433); or- the container's systemd unit file is missing or differs from the one the module would write
(
module_utils/kolla_systemd_worker.py:154-167), for example afterdocker_graceful_timeout,docker_restart_policyordocker_client_timeoutchanged, since all three are written into the unit (kolla_systemd_worker.py:20-39, :50-79); a policy change betweenunless-stoppedandalwaysrenders the sameRestart=alwaysand changes nothing (:56-58).
The
--checkpath means a config file changed by an earliergenconfig, or by hand, will still restart the container on the nextdeploy/reconfigure/deploy-containersCODE. - the container's definition differs (
-
Restart and recreate are both full stop/start cycles. A config change is applied only by stopping and starting the container;
kolla_containerhas no reload action (library/kolla_container.py:272-287). The only signal Kolla-Ansible sends to a running containerised service is SIGHUP tonova_scheduler(cell-cache refresh), throughkill -HUPon the PID read with{{ kolla_container_engine }} inspect. It is sent only on adeploy/reconfigurethat runs thenova,nova-apiornova-refresh-scheduler-cell-cachetag (or no tag) and whose--limit, if any, includes thenova-schedulerhosts (roles/nova/tasks/refresh_scheduler_cell_cache.yml:10-12,ansible/nova.yml:152-172). It loads no new config files. (Outside containers, theReload libvirtdhandler reloads a host libvirtd when the external-Ceph tasks change its secrets andenable_nova_libvirt_containeris false,roles/nova-cell/handlers/main.yml:143-149,roles/nova-cell/tasks/external_ceph.yml:172, :197, :208-211.) The handler callsrecreate_or_restart_container(module_utils/kolla_docker_worker.py:341-363; Podmankolla_podman_worker.py:507-524):- recreate when the image or parameters differ (or
COPY_ONCE): pull the image if absent, stop, remove, start; - otherwise restart: rewrite the unit if needed and ask systemd to restart it (
restart_container,kolla_docker_worker.py:439-459,kolla_podman_worker.py:602-617;kolla_systemd_worker.py:106-113).
The stop timeout is
docker_graceful_timeout, 60 s by default (§6). - recreate when the image or parameters differ (or
-
Handlers run in definition order, on every notified host of the batch at once. Unless
kolla_serialis set, "Restart nova-compute container" restarts nova_compute on all notified computes in the same step CODE (ansible-core 2.16.20lib/ansible/executor/play_iterator.py:200copies the play's handlers in definition order and:427-443walks them per host; the linear strategy runs tasks, and the handlers inserted atflush_handlers, in lockstep across the hosts of the batch,lib/ansible/plugins/strategy/linear.py:50-93).
4.4 Containers and placement¶
Each role's defaults/main.yml defines a <role>_services dict with an entry per container. The fields are
container_name, group or host_in_groups, enabled, image, volumes, dimensions, privileged,
pid_mode/ipc_mode/cgroupns_mode, healthcheck and haproxy. The filter service_enabled_and_mapped_to_host
(kolla_ansible/filters.py:87-96, with service_mapped_to_host at :59-84) decides placement:
host_in_groups(a per-host boolean expression) wins overgroup(filters.py:73-75).group: allmeans every host (filters.py:77-79).
select_services_enabled_and_mapped_to_host (filters.py:99-109) applies the same test to a whole dict; the helper
roles service-images-pull, service-stop, service-config-validate and others loop over its result
(e.g. roles/service-images-pull/tasks/main.yml:14, roles/service-stop/tasks/main.yml:12).
The 2024.1 roles define 159 containers (188 in 2023.1, before the removal of the ten roles listed in §1). They are listed in Generated inventory §2.
5. Shared helper roles¶
| Role | Used by | What it does | Scope |
|---|---|---|---|
common |
its own play (site.yml:88-103); no role depends on it |
Deploys fluentd, kolla_toolbox, cron on the hosts of their groups (children of common: every host of the example inventory). Renders td-agent.conf and logrotate.conf |
Once per host per run that executes the common play (§5.1) |
service-ks-register |
31 roles | Creates the Keystone service, endpoints, project, user, role and grants through kolla_toolbox |
run_once: once per play, or once per batch when kolla_serial is set (roles/) |
service-rabbitmq |
nova-cell only (roles/, imported from bootstrap.yml:37) |
Creates RabbitMQ vhost and user through kolla_toolbox, delegated to the first host of the cell's RPC (or notify) RabbitMQ group |
once per cell, on the cell's first nova-conductor host (the notify pass only when its group or users differ from RPC) |
service-images-pull |
the pull.yml of 51 roles |
kolla_container pull_image for every enabled container mapped to the host, with retries (roles/) |
per host × per container |
service-stop |
the stop.yml of 51 roles |
kolla_container stop_container, honouring skip_stop_containers (roles/) |
per host × per container |
service-precheck |
the precheck.yml of 48 roles |
Validates that the inventory groups exist | per host |
service-cert-copy |
copy-certs.yml of 38 roles |
Copies the CA (and backend certs) into each service config dir when kolla_copy_ca_into_containers or the service's backend TLS is set (e.g. roles/) |
per host × per service |
service-config-validate |
config_validate.yml of 28 roles |
validate-config: runs the oslo-config validator for each enabled service mapped to the host (roles/) |
per host × per service |
loadbalancer-config |
every role's loadbalancer.yml (39 roles; nova-cell through proxy_loadbalancer.yml) |
Imports haproxy-config (when haproxy_config_install) and proxysql-config (when enable_proxysql) (roles/) |
per loadbalancer host |
haproxy-config |
loadbalancer-config only |
Renders /etc/ (custom templates under /etc/ win), adds the service to external-frontend-map when haproxy_single_external_frontend is set (new), and opens external ports in firewalld when enabled (roles/) |
per loadbalancer host |
proxysql-config |
loadbalancer-config only |
Renders the ProxySQL users and rules files for the service | per loadbalancer host |
module-load |
nova-cell (br_netfilter), neutron, openvswitch, loadbalancer, ironic, iscsi (configfs), multipathd, from each role's config-host.yml |
modprobe and persistence in /etc/ |
per host |
sysctl |
New in 2024.1: neutron and loadbalancer, from config-host.yml (roles/, roles/) |
Sets or removes kernel parameters in kolla_sysctl_conf_path; a value KOLLA_UNSET removes the key, KOLLA_SKIP leaves it alone (roles/) |
per host |
5.1 The common role and the common_run guard¶
The guard does not exist in 2024.1. roles/common/tasks/main.yml:1-2 is only:
- include_tasks: "{{ kolla_action }}.yml"
No file in ansible/ or tools/ mentions common_run, and roles/common/defaults/main.yml starts directly with
common_services CODE. How common runs:
commonruns in one play of its own (site.yml:88-103: hostscron,fluentd,kolla-logs,kolla-toolbox;serial: kolla_serial; play tagcommon). It runs before the loadbalancer play and before any service play, on every host of those groups, once per run.-t commonselects that play and nothing else. The included tasks inherit the play tagcommon(ansible-core 2.16.20lib/ansible/playbook/block.py:352-361; included blocks are filtered by tag atlib/ansible/plugins/strategy/linear.py:272), so-t common reconfigurerenders the common configs and restarts what changed CODE.- Service tags do not drag
commonin. No role has ameta/directory, so-t nova(or any service tag) skips the common play, which carries onlycommonCODE (Tags §2.1). -
fluentdandcronconfigs are global.td-agent.confandlogrotate.confare rendered from the globalenable_*flags (roles/common/tasks/config.yml:140-270). Enabling a service listed influentd_input_openstack_services(roles/common/defaults/main.yml:154-210) and/orcron_logrotate_services(roles/common/tasks/config.yml:212-261), such as nova, neutron or barbican, changestd-agent.confand/orlogrotate.confon every host. Services only in the logrotate list (e.g. mariadb, rabbitmq, zun, prometheus, redis) change onlylogrotate.conf. Changed in 2024.1:enable_redisnow changeslogrotate.conf(config.yml:254),enable_ovnnow changestd-agent.conf(roles/common/templates/conf/input/10-openvswitch.conf.j2:31), andenable_letsencryptadds an input file totd-agent.conf(config.yml:166-167); a flag such asenable_memcachedstill changes neither file (no mention in thecommonrole).Since
commondoes not run with a service tag, enabling a service with-t <svc> deploydoes not update these files; they change on the next run that executes the common play (a full run or-t common). That run restarts the container whose file changed (fluentdand/orcron). Through loop-notify on the loopedCheck common containerstask (roles/common/tasks/check-containers.yml:2-17) it also restarts the other common containers (kolla_toolbox, plusfluentdorcronwhen only one of the two files changed), although their config did not change CODE (when any item of a looped task changes, Ansible marks the whole task changed and notifies the handlers of every item that was not skipped, ansible-core 2.16.20lib/ansible/executor/task_executor.py:126-130, :483, :819-820,lib/ansible/plugins/strategy/__init__.py:648-671; see Tags §2.4).
6. Custom modules — container lifecycle via kolla_container¶
Changed in 2024.1: ansible/library/kolla_docker.py no longer exists. Its successor, kolla_container, keeps the
same actions and the same comparison logic, and adds a Podman back end.
| Module | Purpose | Key behaviour (evidence) |
|---|---|---|
kolla_container (ansible/, 433 lines, plus module_utils/ 578, kolla_docker_worker.py 503, kolla_podman_worker.py 677, kolla_systemd_worker.py 216) |
Every container lifecycle operation of the service roles (364 kolla_container: tasks under ansible/roles/) |
Actions: compare_container, compare_image, create_volume, ensure_image, get_container_env, get_container_state, pull_image, recreate_or_restart_container, remove_container, remove_image, remove_volume, restart_container, start_container, stop_container, stop_and_remove_container (kolla_container.py:272-287). Picks DockerWorker when container_engine is docker, PodmanWorker otherwise (kolla_container.py:415-420); container_engine comes from docker_common_options (group_vars/) and defaults to docker in the module (kolla_container.py:372). Uses host networking with both engines (kolla_docker_worker.py:278-279; kolla_podman_worker.py:75-78). Every non-oneshot container gets a systemd unit kolla-<name>-container.service that starts, stops and restarts it (below) |
kolla_toolbox (library/) |
Runs an Ansible module inside the kolla_toolbox container (ansible localhost -m <module>, kolla_toolbox.py:113-114; Docker exec_create, :163; Podman exec_run, :225) |
Used for MySQL, Keystone (os_*) and RabbitMQ (rabbitmq_user/) operations. Takes a required container_engine parameter, docker or podman (:255, :265-269). Needs a running kolla_toolbox on the target |
kolla_container_facts |
Returns the containers by name; takes a required container_engine (kolla_container_facts.py:117, :123-126) |
Used by prechecks and upgrade logic (e.g. roles/) |
kolla_container_volume_facts |
Returns container volume facts | Used by roles/ and roles/ |
The bslurp module of Ussuri is still absent from ansible/library/. Swift rings are copied from
{{ node_custom_config }}/swift (roles/swift/tasks/config.yml:183-197), and Fernet keys are distributed by
fernet-push.sh, run with {{ kolla_container_engine }} exec in the keystone_fernet container
(roles/keystone/tasks/distribute_fernet.yml:14).
These modules are not the only container interface. Many role tasks call the container CLI directly through
command/shell as {{ kolla_container_engine }} exec|inspect (21 roles, among them keystone, mariadb, rabbitmq,
etcd, openvswitch, ovn-db, nova-cell, swift and bifrost): fernet-push.sh, ovs-vsctl, kolla_set_configs --check
(swift, bifrost), the mysql/rabbitmqctl calls of the MariaDB and RabbitMQ roles (e.g.
roles/mariadb/tasks/restart_services.yml:34), etcdctl (roles/etcd/tasks/restart_services.yml:32-34), and
inspect plus kill -HUP for nova_scheduler. Outside the service roles, destroy stops and removes containers with
the tools/cleanup-containers script, passing the engine (roles/destroy/tasks/cleanup_containers.yml:3; the script
accepts docker or podman, tools/cleanup-containers:4-10); prune-images uses the docker_prune module with
Docker and podman image prune with Podman (roles/prune-images/tasks/prune_images.yml:2-16). docker_prune is
not part of ansible-core 2.16.20 (lib/ansible/modules/ has no docker module); requirements-core.yml:18-20 lists
community.docker, but which collection provides docker_prune is not read in this study NOT AVAILABLE. And
bootstrap-servers runs docker start on the previously running containers after a Docker package upgrade
(ansible-collection-kolla roles/docker/tasks/install.yml:44-72) CODE.
How kolla_container decides CODE:
start_containerpulls the image only if it is absent locally (Dockermodule_utils/kolla_docker_worker.py:366-367, wherecheck_imagelooks for the exactrepository:tagamong the local images,:71-79; Podmanensure_image,kolla_podman_worker.py:527, :675-677). A rebuilt image pushed under the same tag is therefore not fetched bydeployorreconfigure. It takes an explicitpull(kolla-ansible pull) to download it, after whichcompare_imagesees a new image ID and recreates the container (kolla_docker_worker.py:107-122, :341-363). It then creates the container and its unit if needed and starts it through systemd, failing with "Container timed out" if the unit is notrunningwithinclient_timeout(120 s) (kolla_docker_worker.py:369-389;kolla_systemd_worker.py:64, :97-104, :205-216). One-shot containers (restart_policy: oneshot) get no unit and are started directly (kolla_docker_worker.py:338-339, :381-382).compare_imagecompares image ID and tag, using the local image for that reference (kolla_docker_worker.py:107-122).pull_imagereports changed only if the local image changed (Docker: image ID,kolla_docker_worker.py:189-223; Podman: image attributes,kolla_podman_worker.py:455-474).docker_graceful_timeoutanddocker_client_timeouttake effect.generate_module()starts fromcommon_options(=docker_common_options, which carriesgraceful_timeout: "{{ docker_graceful_timeout }}",client_timeout: "{{ docker_client_timeout }}"andcontainer_engine: "{{ kolla_container_engine }}",group_vars/all.yml:142-153). It overwrites a key only when the task sets that parameter; a parameter the task leaves unset keeps thecommon_optionsvalue, and only when that is absent too does the module default (10 s, 120 s,docker) apply (kolla_container.py:361-407).graceful_timeoutandclient_timeouthave no default in the argument spec (kolla_container.py:313, :335). Handlers passcommon_options(e.g.roles/nova-cell/handlers/main.yml:151-169), so the effective stop timeout isdocker_graceful_timeout, 60 s by default (group_vars/all.yml:139).- The value is written into the unit:
ExecStop=/usr/bin/<engine> stop <name> -t <graceful_timeout>(kolla_systemd_worker.py:32, :74). With Docker,stop_containeruses systemd when the unit exists anddocker stopwith the same timeout otherwise (kolla_docker_worker.py:415-431); with Podman, it writes the unit if needed and stops through systemd for every non-oneshot container (kolla_podman_worker.py:575-593).restart_containerasks systemd to restart the unit (kolla_docker_worker.py:439-459,kolla_podman_worker.py:602-617). - Practical effect: a container still running 60 s after SIGTERM is killed. This holds for handler restarts,
recreates and
stopCODE (the SIGTERM-then-SIGKILL meaning of the timeout is kolla-ansible's own comment,ansible/group_vars/all.yml:138: "Timeout after Docker sends SIGTERM before sending SIGKILL."). The unit sets noTimeoutStopSec, so systemd's own stop timeout also applies; its value is host configuration NOT AVAILABLE.
- The restart policy lives in the unit, not in the engine. Docker's
build_host_configpasses no restart policy (kolla_docker_worker.py:277-311) and the Podman worker drops it (kolla_podman_worker.py:142);docker_restart_policy: "unless-stopped"(group_vars/all.yml:117) becomesRestart=alwaysin the unit, withStartLimitBurst=docker_restart_policy_retry(kolla_systemd_worker.py:28, :33, :56-58). The FIXME "restart_policy is not checked in the container" now sits inkolla_container.py:19, but a changed policy changes the unit, whichcompare_containerdoes detect (§4.3). - Changed in 2024.1: the unit names its engine. The template writes
Description=<engine> …,ExecStart=/usr/bin/<engine> start -a <name>andExecStop=/usr/bin/<engine> stop …;After=/Wants=aredocker.servicefor Docker andnetwork-online.targetfor Podman; the start-limit line isStartLimitInterval=(kolla_systemd_worker.py:20-39, :50-54, :69-79). Becausecompare_containercompares the whole unit text (:154-167), a unit file whose text differs from this template, such as one written by 2023.1 (whose template hard-codeddocker, so with Docker only itsStartLimitIntervalSec=line and the blank line after it differ), is reported as changed and its container is restarted by the handler, which rewrites the unit first CODE. kolla_container_engineis an engine switch. It defaults to"docker"(group_vars/all.yml:92). It selects the worker ofkolla_container, the engine ofkolla_toolbox,kolla_container_factsandkolla_container_volume_facts, the CLI of theexec/inspecttasks, the volume path (container_engine_volumes_path,group_vars/all.yml:156-158), engine-specific dimensions and/runmounts (group_vars/all.yml:165-172, :187-201), and, in ansible-collection-kolla, which enginebootstrap-serversinstalls. How the Podman path behaves on a real host is NOT AVAILABLE (source only, nothing was run).
7. Configuration generation and overrides¶
- INI files go through
merge_configs.merge_configs(ansible/action_plugins/merge_configs.py) renders each listed source as a Jinja template on the deploy host, merges them as INI (later sources win), then calls thecopyaction (merge_configs.py:168-216). For nova-compute the sources are (roles/nova-cell/tasks/config.yml:69-89):templates/nova.conf.j2→/etc/kolla/config/global.conf→/etc/kolla/config/nova.conf→/etc/kolla/config/nova/nova-compute.conf→/etc/kolla/config/nova/<inventory_hostname>/nova.conf→/etc/kolla/config/nova/<inventory_hostname>/nova-compute.conf. The last, per-host per-service source is new in 2024.1 and exists only innova-cell; thenovarole stops atnova/<inventory_hostname>/nova.conf(roles/nova/tasks/config.yml:64-82). - Overrides are scoped by file location. Putting a value into
/etc/kolla/config/nova.confaffects every nova container that has anova.confon every host (nova-api, scheduler, super-conductor, conductor, novncproxy and every nova-compute). The content of/etc/kolla/config/nova/nova-compute.confis merged only into nova-compute'snova.conf, so the control-plane nova services are untouched CODE (thenovaandnova-cellroles each mergenova/<service>.confonly into that service's ownnova.conf,roles/nova/tasks/config.yml:64-82,roles/nova-cell/tasks/config.yml:69-89,roles/nova/defaults/main.yml:2-58,roles/nova-cell/defaults/main.yml:485-491). Operationally,-t nova reconfigureafter changing it still restartsnova_compute,nova_libvirtandnova_sshon every compute host CODE. The changed file makeskolla_set_configs --checkreport drift innova_compute(module_utils/kolla_docker_worker.py:146-181). libvirt and ssh restart through loop-notify in the looped "Check nova-cell containers" task (roles/nova-cell/tasks/check-containers.yml:2-22, handlersroles/nova-cell/handlers/main.yml:74-169; Ansible lines in §5.1), not because their config changed. - Some overrides leak to other services. Neutron's
ml2_conf.ini(template plusneutron/ml2_conf.iniandneutron/<host>/ml2_conf.inioverrides) is rendered only forneutron-serverandneutron-infoblox-ipam-agent(roles/neutron/tasks/config.yml:159-179), andopenvswitch_agent.inimerges only its own template andneutron/openvswitch_agent.inioverrides (:198-213). A change meant forneutron-servertherefore does not restartneutron_openvswitch_agentCODE (Reconfigure Neutron). Still holds in 2024.1. The file-location scoping of point 2 is still the rule:/etc/kolla/config/neutron.conforglobal.confreach every container whose template merges them. -
The container receives its config through a manifest. The
config.json(rendered from<service>.json.j2) tellskolla_set_configs, inside the image, which files to copy from/var/lib/kolla/config_files(bind-mounted from/etc/kolla/<service>/) to their final location. It also names the command to start. Withconfig_strategy: COPY_ALWAYS(group_vars/all.yml:43) the copy happens at every container start. That is why a restart is enough to apply a changed or added config file, and why Kolla-Ansible never applies config by reloading a service.In 2024.1 a restart also applies most removals CODE. Before copying,
kolla_set_configs(kolla 2024.1-eom) reads a state file kept inside the container,/etc/kolla/defaults/state, and for every destination it has ever written either restores the image's original file (saved under/etc/kolla/defaults/) or deletes it when the image had none; it then records any new destinations (kolladocker/base/set_configs.py:32-33, :452-474, :477-513, :516-532, :535-553). So a file whose entry was dropped fromconfig.json(e.g. a removed Keystone policy file,roles/keystone/templates/keystone.json.j2:31-37), or whose optional source is gone (the copy then skips it,set_configs.py:143-145), returns to the image default or disappears at the next start. Limits:- The state lives in the container's own filesystem, so a recreate starts with an empty state. A stale file on a
named volume (e.g. nova-compute's SASL
auth.confunder/var/lib/nova,roles/nova-cell/templates/nova-compute.json.j2:64-70, which is thenova_computevolume when libvirt runs in a container,group_vars/all.yml:1128) whose entry was dropped is then neither restored nor deleted. kolla_set_configs --checkcompares only the entries of the currentconfig.json(set_configs.py:556-559, :220-243), so a dropped entry alone does not report drift; the restart comes from the changedconfig.jsonfile itself.- Deleting a custom file such as
/etc/kolla/config/keystone/keystone-paste.inileaves its rendered copy in/etc/kolla/keystone/(roles/keystone/tasks/config.yml:169-193), and the optional manifest entry (keystone.json.j2:18-24) keeps copying it in, even after a recreate.
The image-side start path and
--checkare described in Kolla images §2-§3. - The state lives in the container's own filesystem, so a recreate starts with an empty state. A stale file on a
named volume (e.g. nova-compute's SASL
8. Inventory model¶
- Groups are mostly aliases of a few physical groups. The physical groups are
control,network,compute,storage,monitoringanddeployment(ansible/inventory/multinode:3-33). Service groups are defined as children. Examples:[nova-api:children] nova,[nova:children] control(multinode:227-228, :99-100).[loadbalancer:children] network(multinode:84-85). In the 2024.1 example inventory, HAProxy and keepalived sit on the network nodes; there is nohaproxygroup. The new[letsencrypt:children]isloadbalancer(multinode:192-193).[openvswitch:children] network, compute, manila-share(multinode:105-108).[common:children]= control, network, compute, storage, monitoring, andcron,fluentd,kolla-logs,kolla-toolboxare children ofcommon(multinode:49-54, :203-213).
- Groups that include
computein the example inventory (29 in total, counted fromansible/inventory/multinode):computeitself and the groups that list it directly as a child:baremetal,common,collectd,telegraf,hacluster-remote,openvswitch,cyborg,neutron-ovn-metadata-agent,neutron-ovn-agent,iscsid,ceilometer-compute,ceilometer-ipmi,cyborg-agent,multipathd,zun-compute,zun-cni-daemon,prometheus-node-exporter,prometheus-cadvisor,prometheus-libvirt-exporter,masakari-instancemonitor,ovn-controller-compute.- Through nesting:
cron,fluentd,kolla-logsandkolla-toolbox(viacommon),cyborg-apiandcyborg-conductor(children ofcyborg, which is control + compute, so they also land on compute hosts), andovn-controller(viaovn-controller-compute). Themonasca-agentgroups of 2023.1 are gone with the role.
- The neutron play also targets every compute host. It lists
computeandmanila-shareexplicitly (site.yml:671-685); the agents'host_in_groupsdecides what lands there. - Inventory order is semantically significant CODE.
groups['<grp>'][0]is the target of almost everyrun_once/delegate_tobootstrap step. Examples:groups[nova_cell_conductor_group][0]for cell creation and compute discovery (roles/nova-cell/tasks/bootstrap.yml:15, :34); the firstglance-apihost as the only glance host with the default file backend (group_vars/all.yml:1011; fact sheet C). Other index-sensitive logic:- keepalived priority is the index in
groups['loadbalancer']plus 1 (roles/loadbalancer/templates/keepalived/keepalived.conf.j2:15; fact sheet A §1.8 C); - HAProxy's single active MariaDB backend is the first host of the default shard, the others being
backup(roles/mariadb/defaults/main.yml:64). MariaDB restarts in theserial: "33%"batches of theRestart mariadb servicesplay (mariadb.yml:18-34); in which batch the active backend restarts is NOT AVAILABLE (R9; fact sheet B §1.5); - outside
upgradeandconfig, etcd's rolling restart waves of non-leaders aregroups.etcd.index(inventory_hostname) % 4, and the leader restarts after them (roles/etcd/handlers/main.yml:40-65).
- keepalived priority is the index in
Related¶
- Tags (how tags select this work)
- Execution flow (execution order and the action matrix)
- Generated inventory (every play, container, role and handler)
- Tag index, Components and Glossary (tag index, service index, glossary)
To remember
Lumo: if you keep only 5 things from this page, keep these.
reconfigureisdeploy: it re-runs Keystone registration, DB creation and the bootstrap (DB sync) container of most services. CODE- A config change is applied by a full stop/start, never a reload; the stop timeout is the 60 s of
docker_graceful_timeout, written into each container's systemd unit. CODE deployandreconfigurepull an image only if it is absent locally; a rebuilt image pushed under the same tag takes an explicitpull. CODE- Batching is off by default:
ANSIBLE_SERIALdefaults to 0, which means all hosts of a play in one batch. CODE - The container module is now
kolla_container: it drives Docker or Podman, chosen bykolla_container_engine(defaultdocker). CODE
Check yourself
Lumo: 4 quick questions to check the main ideas of this page. Choose an answer to see the explanation and the section that gives the evidence. Your score counts your first choices and stays in this browser only.
Lumo: ready for the next step? Take your time: you can come back to this page whenever you need it.
Lumo: nicely done! One more page on your journey.