2024-12-21 14:00:06 [INFO ] Automatically setting 'supported' flag due to label: RC-20241221.0. 2024-12-21 14:00:07 [DEBUG ] Notification: '/usr/bin/pungi-fedmsg-notification' 'status-change', {'status': 'STARTED', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:00:07 [DEBUG ] Notification: 'pungi-wait-for-signed-ostree-handler' 'status-change', {'status': 'STARTED', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:00:08 [INFO ] Host: compose-iot01.iad2.fedoraproject.org 2024-12-21 14:00:08 [INFO ] Pungi version: pungi-4.7.0-4.1.fc40.noarch 2024-12-21 14:00:08 [INFO ] User name: root 2024-12-21 14:00:08 [INFO ] Working directory: /tmp/f40-bootc.qjEDdc/pungi-iot 2024-12-21 14:00:08 [INFO ] Command line: /usr/bin/pungi-koji --notification-script=/usr/bin/pungi-fedmsg-notification --notification-script=pungi-wait-for-signed-ostree-handler --config=fedora-bootc.conf --old-composes=/mnt/koji/compose/iot --label=RC-20241221.0 --target-dir=/mnt/koji/compose/iot 2024-12-21 14:00:08 [INFO ] Compose top directory: /mnt/koji/compose/iot/Fedora-IoT-40-20241221.0 2024-12-21 14:00:08 [INFO ] Current timezone offset: +00:00 2024-12-21 14:00:08 [INFO ] COMPOSE_ID=Fedora-IoT-40-20241221.0 2024-12-21 14:00:08 [INFO ] Logging installed packages to /mnt/koji/compose/iot/Fedora-IoT-40-20241221.0/logs/global/installed-pkgs.global.log 2024-12-21 14:00:08 [DEBUG ] Writing variants file: /mnt/koji/compose/iot/Fedora-IoT-40-20241221.0/work/global/variants.xml 2024-12-21 14:00:08 [DEBUG ] Exporting file /tmp/f40-bootc.qjEDdc/pungi-iot/variants-fedora.xml from current working directory... 2024-12-21 14:00:08 [INFO ] Excluding variant IoT: filtered by configuration. 2024-12-21 14:00:08 [INFO ] Config section 'live_media' was not found. Skipping. 2024-12-21 14:00:08 [INFO ] Config section 'image_build' was not found. Skipping. 2024-12-21 14:00:08 [INFO ] Config section 'ostree' was not found. Skipping. 2024-12-21 14:00:08 [INFO ] Config section 'ostree_installer' was not found. Skipping. 2024-12-21 14:00:08 [INFO ] Config section 'extra_isos' was not found. Skipping. 2024-12-21 14:00:08 [INFO ] Config section 'osbs' was not found. Skipping. 2024-12-21 14:00:08 [INFO ] Config section 'osbuild' was not found. Skipping. 2024-12-21 14:00:08 [INFO ] Config section 'image_container' was not found. Skipping. 2024-12-21 14:00:08 [INFO ] Config section 'kiwibuild' was not found. Skipping. 2024-12-21 14:00:08 [INFO ] [BEGIN] ---------- PHASE: INIT ---------- 2024-12-21 14:00:08 [DEBUG ] Notification: '/usr/bin/pungi-fedmsg-notification' 'phase-start', {'phase_name': 'init', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:00:09 [DEBUG ] Notification: 'pungi-wait-for-signed-ostree-handler' 'phase-start', {'phase_name': 'init', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:00:09 [DEBUG ] Writing global comps file: /mnt/koji/compose/iot/Fedora-IoT-40-20241221.0/work/global/comps/comps-global.xml 2024-12-21 14:00:09 [DEBUG ] Exporting file comps-f40.xml from git https://pagure.io/fedora-comps.git (branch 78dbc0e68e5442c7dcf62dd6a9452c6d12ecc5dd)... 2024-12-21 14:00:11 [DEBUG ] Running "make comps-f40.xml" 2024-12-21 14:00:13 [DEBUG ] Writing comps file for arch 'aarch64': /mnt/koji/compose/iot/Fedora-IoT-40-20241221.0/work/aarch64/comps/comps-aarch64.xml 2024-12-21 14:00:13 [DEBUG ] Writing comps file for arch 'x86_64': /mnt/koji/compose/iot/Fedora-IoT-40-20241221.0/work/x86_64/comps/comps-x86_64.xml 2024-12-21 14:00:13 [INFO ] [BEGIN] Creating comps repo for arch 'aarch64' variant 'None' 2024-12-21 14:00:13 [INFO ] [BEGIN] Creating comps repo for arch 'x86_64' variant 'None' 2024-12-21 14:00:13 [INFO ] [DONE ] Creating comps repo for arch 'x86_64' variant 'None' 2024-12-21 14:00:13 [INFO ] [DONE ] Creating comps repo for arch 'aarch64' variant 'None' 2024-12-21 14:00:14 [DEBUG ] Writing comps file (arch: aarch64, variant: bootc): /mnt/koji/compose/iot/Fedora-IoT-40-20241221.0/work/aarch64/comps/comps-bootc.aarch64.xml 2024-12-21 14:00:14 [DEBUG ] Writing comps file (arch: x86_64, variant: bootc): /mnt/koji/compose/iot/Fedora-IoT-40-20241221.0/work/x86_64/comps/comps-bootc.x86_64.xml 2024-12-21 14:00:15 [INFO ] [BEGIN] Creating comps repo for arch 'x86_64' variant 'bootc' 2024-12-21 14:00:15 [INFO ] [BEGIN] Creating comps repo for arch 'aarch64' variant 'bootc' 2024-12-21 14:00:15 [INFO ] [DONE ] Creating comps repo for arch 'aarch64' variant 'bootc' 2024-12-21 14:00:15 [INFO ] [DONE ] Creating comps repo for arch 'x86_64' variant 'bootc' 2024-12-21 14:00:15 [INFO ] [DONE ] ---------- PHASE: INIT ---------- 2024-12-21 14:00:15 [INFO ] PHASE INIT took 8 seconds 2024-12-21 14:00:15 [DEBUG ] Notification: '/usr/bin/pungi-fedmsg-notification' 'phase-stop', {'phase_name': 'init', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:00:16 [DEBUG ] Notification: 'pungi-wait-for-signed-ostree-handler' 'phase-stop', {'phase_name': 'init', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:00:16 [INFO ] [BEGIN] ---------- PHASE: PKGSET ---------- 2024-12-21 14:00:16 [DEBUG ] Notification: '/usr/bin/pungi-fedmsg-notification' 'phase-start', {'phase_name': 'pkgset', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:00:17 [DEBUG ] Notification: 'pungi-wait-for-signed-ostree-handler' 'phase-start', {'phase_name': 'pkgset', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:00:18 [INFO ] Getting koji event 2024-12-21 14:00:18 [INFO ] Koji event: 142765134 2024-12-21 14:00:18 [INFO ] Loading package set for tag f40-iot 2024-12-21 14:00:18 [INFO ] Trying to reuse pkgset data of old compose 2024-12-21 14:00:18 [DEBUG ] Koji event doesn't match, querying changes between event 142708282 and 142765134 2024-12-21 14:00:18 [DEBUG ] Loading reuse file: /mnt/koji/compose/iot/Fedora-IoT-40-20241220.0/work/global/pkgset_f40-iot_reuse.pickle 2024-12-21 14:00:18 [INFO ] Copying repo data for reuse: /mnt/koji/compose/iot/Fedora-IoT-40-20241220.0/work/global/repo/f40-iot 2024-12-21 14:00:18 [INFO ] Writing pkgset reuse file: /mnt/koji/compose/iot/Fedora-IoT-40-20241221.0/work/global/pkgset_f40-iot_reuse.pickle 2024-12-21 14:00:19 [INFO ] Populating package set for arch: aarch64 2024-12-21 14:00:19 [DEBUG ] [BEGIN] Merging package sets for aarch64: ['aarch64', 'noarch', 'src'] 2024-12-21 14:00:19 [DEBUG ] [DONE ] Merging package sets for aarch64: ['aarch64', 'noarch', 'src'] 2024-12-21 14:00:19 [INFO ] Populating package set for arch: x86_64 2024-12-21 14:00:19 [DEBUG ] [BEGIN] Merging package sets for x86_64: ['x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch', 'src'] 2024-12-21 14:00:19 [DEBUG ] [DONE ] Merging package sets for x86_64: ['x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch', 'src'] 2024-12-21 14:00:19 [INFO ] [BEGIN] Copying repodata for reuse: /mnt/koji/compose/iot/Fedora-IoT-40-20241220.0/work/aarch64/repo/f40-iot 2024-12-21 14:00:19 [INFO ] [BEGIN] Copying repodata for reuse: /mnt/koji/compose/iot/Fedora-IoT-40-20241220.0/work/x86_64/repo/f40-iot 2024-12-21 14:00:19 [INFO ] [DONE ] Copying repodata for reuse: /mnt/koji/compose/iot/Fedora-IoT-40-20241220.0/work/aarch64/repo/f40-iot 2024-12-21 14:00:19 [INFO ] [DONE ] Copying repodata for reuse: /mnt/koji/compose/iot/Fedora-IoT-40-20241220.0/work/x86_64/repo/f40-iot 2024-12-21 14:00:20 [INFO ] [DONE ] ---------- PHASE: PKGSET ---------- 2024-12-21 14:00:20 [INFO ] PHASE PKGSET took 4 seconds 2024-12-21 14:00:20 [DEBUG ] Notification: '/usr/bin/pungi-fedmsg-notification' 'phase-stop', {'phase_name': 'pkgset', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:00:21 [DEBUG ] Notification: 'pungi-wait-for-signed-ostree-handler' 'phase-stop', {'phase_name': 'pkgset', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:00:21 [INFO ] [BEGIN] ---------- PHASE: WEAVER ---------- 2024-12-21 14:00:21 [INFO ] [BEGIN] Running pipeline (1/5). Phases: buildinstall 2024-12-21 14:00:21 [WARNING ] [SKIP ] ---------- PHASE: BUILDINSTALL ---------- 2024-12-21 14:00:21 [INFO ] [DONE ] Running pipeline (1/5). Phases: buildinstall 2024-12-21 14:00:21 [INFO ] [BEGIN] Running pipeline (2/5). Phases: gather, createrepo 2024-12-21 14:00:21 [INFO ] [BEGIN] Running pipeline (3/5). Phases: extra_files 2024-12-21 14:00:21 [INFO ] [BEGIN] ---------- PHASE: GATHER ---------- 2024-12-21 14:00:21 [WARNING ] [SKIP ] ---------- PHASE: EXTRA_FILES ---------- 2024-12-21 14:00:21 [INFO ] [DONE ] Running pipeline (3/5). Phases: extra_files 2024-12-21 14:00:21 [INFO ] [BEGIN] Running pipeline (4/5). Phases: ostree, ostree_installer 2024-12-21 14:00:21 [INFO ] Config section 'ostree' was not found. Skipping. 2024-12-21 14:00:21 [WARNING ] [SKIP ] ---------- PHASE: OSTREE ---------- 2024-12-21 14:00:21 [INFO ] Config section 'ostree_installer' was not found. Skipping. 2024-12-21 14:00:21 [WARNING ] [SKIP ] ---------- PHASE: OSTREE_INSTALLER ---------- 2024-12-21 14:00:21 [INFO ] [DONE ] Running pipeline (4/5). Phases: ostree, ostree_installer 2024-12-21 14:00:21 [INFO ] [BEGIN] Running pipeline (5/5). Phases: ostree_container 2024-12-21 14:00:21 [INFO ] [BEGIN] ---------- PHASE: OSTREE_CONTAINER ---------- 2024-12-21 14:00:21 [DEBUG ] Notification: '/usr/bin/pungi-fedmsg-notification' 'phase-start', {'phase_name': 'gather', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:00:22 [DEBUG ] Notification: 'pungi-wait-for-signed-ostree-handler' 'phase-start', {'phase_name': 'gather', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:00:23 [DEBUG ] Notification: '/usr/bin/pungi-fedmsg-notification' 'phase-start', {'phase_name': 'ostree_container', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:00:23 [INFO ] [SKIP ] Gathering packages (arch: aarch64, variant: bootc) 2024-12-21 14:00:23 [INFO ] [SKIP ] Gathering packages (arch: x86_64, variant: bootc) 2024-12-21 14:00:23 [INFO ] [BEGIN] Writing package list (arch: aarch64, variant: bootc) 2024-12-21 14:00:23 [INFO ] [DONE ] Writing package list (arch: aarch64, variant: bootc) 2024-12-21 14:00:23 [INFO ] [BEGIN] Writing package list (arch: x86_64, variant: bootc) 2024-12-21 14:00:23 [INFO ] [DONE ] Writing package list (arch: x86_64, variant: bootc) 2024-12-21 14:00:23 [INFO ] Writing RPM manifest: /mnt/koji/compose/iot/Fedora-IoT-40-20241221.0/compose/metadata/rpms.json 2024-12-21 14:00:23 [INFO ] [DONE ] ---------- PHASE: GATHER ---------- 2024-12-21 14:00:23 [INFO ] PHASE GATHER took 2 seconds 2024-12-21 14:00:23 [DEBUG ] Notification: 'pungi-wait-for-signed-ostree-handler' 'phase-start', {'phase_name': 'ostree_container', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:00:24 [DEBUG ] Notification: '/usr/bin/pungi-fedmsg-notification' 'phase-stop', {'phase_name': 'gather', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:00:24 [INFO ] [BEGIN] OSTree container phase for variant bootc, arch x86_64 2024-12-21 14:00:24 [INFO ] [BEGIN] OSTree container phase for variant bootc, arch aarch64 2024-12-21 14:00:24 [DEBUG ] Exporting directory . from git https://pagure.io/fedora-iot/base-images (branch main)... 2024-12-21 14:00:24 [DEBUG ] Exporting directory . from git https://pagure.io/fedora-iot/base-images (branch main)... 2024-12-21 14:00:25 [DEBUG ] Notification: 'pungi-wait-for-signed-ostree-handler' 'phase-stop', {'phase_name': 'gather', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:00:25 [WARNING ] [SKIP ] ---------- PHASE: CREATEREPO ---------- 2024-12-21 14:00:25 [INFO ] Writing modules metadata: /mnt/koji/compose/iot/Fedora-IoT-40-20241221.0/compose/metadata/modules.json 2024-12-21 14:00:25 [INFO ] [DONE ] Running pipeline (2/5). Phases: gather, createrepo 2024-12-21 14:02:37 [ERROR ] [FAIL] Ostree container (variant bootc, arch aarch64) failed, but going on anyway. 2024-12-21 14:02:37 [ERROR ] Runroot task failed: 127084794. See /mnt/koji/compose/iot/Fedora-IoT-40-20241221.0/logs/aarch64/bootc/ostree-container-2/runroot.log for more details. 2024-12-21 14:02:37 [DEBUG ] Traceback (most recent call last): File "/usr/lib/python3.12/site-packages/pungi/util.py", line 596, in failable yield File "/usr/lib/python3.12/site-packages/pungi/phases/ostree_container.py", line 68, in process self.worker(compose, variant, arch, config) File "/usr/lib/python3.12/site-packages/pungi/phases/ostree_container.py", line 113, in worker self._run_ostree_container_cmd( File "/usr/lib/python3.12/site-packages/pungi/phases/ostree_container.py", line 154, in _run_ostree_container_cmd runroot.run( File "/usr/lib/python3.12/site-packages/pungi/runroot.py", line 291, in run self._run_koji( File "/usr/lib/python3.12/site-packages/pungi/runroot.py", line 139, in _run_koji raise RuntimeError( RuntimeError: Runroot task failed: 127084794. See /mnt/koji/compose/iot/Fedora-IoT-40-20241221.0/logs/aarch64/bootc/ostree-container-2/runroot.log for more details. 2024-12-21 14:02:50 [ERROR ] [FAIL] Ostree container (variant bootc, arch x86_64) failed, but going on anyway. 2024-12-21 14:02:50 [ERROR ] Runroot task failed: 127084793. See /mnt/koji/compose/iot/Fedora-IoT-40-20241221.0/logs/x86_64/bootc/ostree-container-1/runroot.log for more details. 2024-12-21 14:02:50 [DEBUG ] Traceback (most recent call last): File "/usr/lib/python3.12/site-packages/pungi/util.py", line 596, in failable yield File "/usr/lib/python3.12/site-packages/pungi/phases/ostree_container.py", line 68, in process self.worker(compose, variant, arch, config) File "/usr/lib/python3.12/site-packages/pungi/phases/ostree_container.py", line 113, in worker self._run_ostree_container_cmd( File "/usr/lib/python3.12/site-packages/pungi/phases/ostree_container.py", line 154, in _run_ostree_container_cmd runroot.run( File "/usr/lib/python3.12/site-packages/pungi/runroot.py", line 291, in run self._run_koji( File "/usr/lib/python3.12/site-packages/pungi/runroot.py", line 139, in _run_koji raise RuntimeError( RuntimeError: Runroot task failed: 127084793. See /mnt/koji/compose/iot/Fedora-IoT-40-20241221.0/logs/x86_64/bootc/ostree-container-1/runroot.log for more details. 2024-12-21 14:02:50 [INFO ] [DONE ] ---------- PHASE: OSTREE_CONTAINER ---------- 2024-12-21 14:02:50 [INFO ] PHASE OSTREE_CONTAINER took 150 seconds 2024-12-21 14:02:50 [DEBUG ] Notification: '/usr/bin/pungi-fedmsg-notification' 'phase-stop', {'phase_name': 'ostree_container', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:02:51 [DEBUG ] Notification: 'pungi-wait-for-signed-ostree-handler' 'phase-stop', {'phase_name': 'ostree_container', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:02:52 [INFO ] [DONE ] Running pipeline (5/5). Phases: ostree_container 2024-12-21 14:02:52 [INFO ] [DONE ] ---------- PHASE: WEAVER ---------- 2024-12-21 14:02:52 [INFO ] [BEGIN] ---------- PHASE: WEAVER ---------- 2024-12-21 14:02:52 [INFO ] [BEGIN] Running pipeline (1/3). Phases: weaver, weaver 2024-12-21 14:02:52 [INFO ] [BEGIN] ---------- PHASE: WEAVER ---------- 2024-12-21 14:02:52 [INFO ] [BEGIN] Running pipeline (2/3). Phases: osbs 2024-12-21 14:02:52 [INFO ] Config section 'osbs' was not found. Skipping. 2024-12-21 14:02:52 [WARNING ] [SKIP ] ---------- PHASE: OSBS ---------- 2024-12-21 14:02:52 [INFO ] [DONE ] Running pipeline (2/3). Phases: osbs 2024-12-21 14:02:52 [INFO ] [BEGIN] Running pipeline (1/6). Phases: createiso 2024-12-21 14:02:52 [INFO ] [BEGIN] Running pipeline (3/3). Phases: repoclosure 2024-12-21 14:02:52 [INFO ] [BEGIN] Running pipeline (2/6). Phases: extra_isos 2024-12-21 14:02:52 [INFO ] [BEGIN] Running pipeline (3/6). Phases: image_build 2024-12-21 14:02:52 [INFO ] [BEGIN] ---------- PHASE: CREATEISO ---------- 2024-12-21 14:02:52 [INFO ] [BEGIN] ---------- PHASE: REPOCLOSURE ---------- 2024-12-21 14:02:52 [INFO ] Config section 'extra_isos' was not found. Skipping. 2024-12-21 14:02:52 [INFO ] [BEGIN] Running pipeline (4/6). Phases: live_media 2024-12-21 14:02:52 [INFO ] Config section 'image_build' was not found. Skipping. 2024-12-21 14:02:52 [INFO ] [BEGIN] Running pipeline (5/6). Phases: osbuild 2024-12-21 14:02:52 [INFO ] [BEGIN] Running pipeline (6/6). Phases: kiwibuild 2024-12-21 14:02:52 [WARNING ] [SKIP ] ---------- PHASE: EXTRA_ISOS ---------- 2024-12-21 14:02:52 [INFO ] Config section 'live_media' was not found. Skipping. 2024-12-21 14:02:52 [WARNING ] [SKIP ] ---------- PHASE: IMAGE_BUILD ---------- 2024-12-21 14:02:52 [DEBUG ] Notification: '/usr/bin/pungi-fedmsg-notification' 'phase-start', {'phase_name': 'createiso', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:02:52 [INFO ] Config section 'osbuild' was not found. Skipping. 2024-12-21 14:02:52 [INFO ] Config section 'kiwibuild' was not found. Skipping. 2024-12-21 14:02:52 [INFO ] [DONE ] Running pipeline (2/6). Phases: extra_isos 2024-12-21 14:02:52 [WARNING ] [SKIP ] ---------- PHASE: LIVE_MEDIA ---------- 2024-12-21 14:02:52 [INFO ] [DONE ] Running pipeline (3/6). Phases: image_build 2024-12-21 14:02:52 [WARNING ] [SKIP ] ---------- PHASE: OSBUILD ---------- 2024-12-21 14:02:52 [WARNING ] [SKIP ] ---------- PHASE: KIWIBUILD ---------- 2024-12-21 14:02:52 [INFO ] [DONE ] Running pipeline (4/6). Phases: live_media 2024-12-21 14:02:52 [INFO ] [DONE ] Running pipeline (5/6). Phases: osbuild 2024-12-21 14:02:52 [INFO ] [DONE ] Running pipeline (6/6). Phases: kiwibuild 2024-12-21 14:02:53 [DEBUG ] Notification: 'pungi-wait-for-signed-ostree-handler' 'phase-start', {'phase_name': 'createiso', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:02:53 [DEBUG ] Notification: '/usr/bin/pungi-fedmsg-notification' 'phase-start', {'phase_name': 'repoclosure', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:02:54 [DEBUG ] Notification: 'pungi-wait-for-signed-ostree-handler' 'phase-start', {'phase_name': 'repoclosure', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:02:55 [INFO ] [BEGIN] Running repoclosure 2024-12-21 14:02:55 [DEBUG ] Notification: '/usr/bin/pungi-fedmsg-notification' 'createiso-targets', {'deliverables': [], 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:02:55 [INFO ] [DONE ] Running repoclosure 2024-12-21 14:02:55 [INFO ] [DONE ] ---------- PHASE: REPOCLOSURE ---------- 2024-12-21 14:02:55 [INFO ] PHASE REPOCLOSURE took 3 seconds 2024-12-21 14:02:55 [DEBUG ] Notification: 'pungi-wait-for-signed-ostree-handler' 'createiso-targets', {'deliverables': [], 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:02:56 [INFO ] [DONE ] ---------- PHASE: CREATEISO ---------- 2024-12-21 14:02:56 [DEBUG ] Notification: '/usr/bin/pungi-fedmsg-notification' 'phase-stop', {'phase_name': 'repoclosure', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:02:56 [INFO ] PHASE CREATEISO took 5 seconds 2024-12-21 14:02:57 [DEBUG ] Notification: 'pungi-wait-for-signed-ostree-handler' 'phase-stop', {'phase_name': 'repoclosure', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:02:57 [INFO ] [DONE ] Running pipeline (3/3). Phases: repoclosure 2024-12-21 14:02:57 [DEBUG ] Notification: '/usr/bin/pungi-fedmsg-notification' 'phase-stop', {'phase_name': 'createiso', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:02:58 [DEBUG ] Notification: 'pungi-wait-for-signed-ostree-handler' 'phase-stop', {'phase_name': 'createiso', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:02:59 [INFO ] [DONE ] Running pipeline (1/6). Phases: createiso 2024-12-21 14:02:59 [INFO ] [DONE ] ---------- PHASE: WEAVER ---------- 2024-12-21 14:02:59 [INFO ] [BEGIN] ---------- PHASE: WEAVER ---------- 2024-12-21 14:02:59 [INFO ] [BEGIN] Running pipeline (1/2). Phases: image_checksum 2024-12-21 14:02:59 [INFO ] [BEGIN] Running pipeline (2/2). Phases: image_container 2024-12-21 14:02:59 [INFO ] [BEGIN] ---------- PHASE: IMAGE_CHECKSUM ---------- 2024-12-21 14:02:59 [INFO ] Config section 'image_container' was not found. Skipping. 2024-12-21 14:02:59 [WARNING ] [SKIP ] ---------- PHASE: IMAGE_CONTAINER ---------- 2024-12-21 14:02:59 [INFO ] [DONE ] Running pipeline (2/2). Phases: image_container 2024-12-21 14:02:59 [DEBUG ] Notification: '/usr/bin/pungi-fedmsg-notification' 'phase-start', {'phase_name': 'image_checksum', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:03:00 [DEBUG ] Notification: 'pungi-wait-for-signed-ostree-handler' 'phase-start', {'phase_name': 'image_checksum', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:03:00 [INFO ] [DONE ] ---------- PHASE: IMAGE_CHECKSUM ---------- 2024-12-21 14:03:00 [INFO ] PHASE IMAGE_CHECKSUM took 2 seconds 2024-12-21 14:03:00 [DEBUG ] Notification: '/usr/bin/pungi-fedmsg-notification' 'phase-stop', {'phase_name': 'image_checksum', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:03:01 [DEBUG ] Notification: 'pungi-wait-for-signed-ostree-handler' 'phase-stop', {'phase_name': 'image_checksum', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:03:02 [INFO ] [DONE ] Running pipeline (1/2). Phases: image_checksum 2024-12-21 14:03:02 [INFO ] [DONE ] ---------- PHASE: WEAVER ---------- 2024-12-21 14:03:02 [INFO ] [DONE ] Running pipeline (1/3). Phases: weaver, weaver 2024-12-21 14:03:02 [INFO ] [DONE ] ---------- PHASE: WEAVER ---------- 2024-12-21 14:03:02 [INFO ] [BEGIN] Writing composeinfo 2024-12-21 14:03:02 [INFO ] [DONE ] Writing composeinfo 2024-12-21 14:03:02 [INFO ] [BEGIN] ---------- PHASE: TEST ---------- 2024-12-21 14:03:02 [DEBUG ] Notification: '/usr/bin/pungi-fedmsg-notification' 'phase-start', {'phase_name': 'test', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:03:02 [DEBUG ] Notification: 'pungi-wait-for-signed-ostree-handler' 'phase-start', {'phase_name': 'test', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:03:03 [INFO ] [DONE ] ---------- PHASE: TEST ---------- 2024-12-21 14:03:03 [INFO ] PHASE TEST took 2 seconds 2024-12-21 14:03:03 [DEBUG ] Notification: '/usr/bin/pungi-fedmsg-notification' 'phase-stop', {'phase_name': 'test', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:03:04 [DEBUG ] Notification: 'pungi-wait-for-signed-ostree-handler' 'phase-stop', {'phase_name': 'test', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:03:04 [INFO ] Failed ostree-container on variant , arch , subvariant . 2024-12-21 14:03:04 [INFO ] Failed ostree-container on variant , arch , subvariant . 2024-12-21 14:03:04 [DEBUG ] Notification: '/usr/bin/pungi-fedmsg-notification' 'status-change', {'status': 'FINISHED_INCOMPLETE', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:03:05 [DEBUG ] Notification: 'pungi-wait-for-signed-ostree-handler' 'status-change', {'status': 'FINISHED_INCOMPLETE', 'compose_id': 'Fedora-IoT-40-20241221.0', 'location': 'https://kojipkgs.fedoraproject.org/compose/iot/Fedora-IoT-40-20241221.0/compose', 'compose_date': '20241221', 'compose_type': 'production', 'compose_respin': 0, 'compose_label': 'RC-20241221.0', 'compose_path': '/mnt/koji/compose/iot/Fedora-IoT-40-20241221.0', 'release_short': 'Fedora-IoT', 'release_name': 'Fedora-IoT', 'release_version': '40', 'release_type': 'ga', 'release_is_layered': False} 2024-12-21 14:03:06 [INFO ] Compose finished: /mnt/koji/compose/iot/Fedora-IoT-40-20241221.0