Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on prd-centos8-builder-2c-2g-498 (centos8-builder-2c-2g) in workspace /w/workspace/ci-management-jenkins-sandbox-cleanup
[ssh-agent] Looking for ssh-agent implementation...
$ ssh-agent
SSH_AUTH_SOCK=/tmp/ssh-hFLNs0Vck9uc/agent.5373
SSH_AGENT_PID=5375
[ssh-agent] Started.
Running ssh-add (command line suppressed)
Identity added: /w/workspace/ci-management-jenkins-sandbox-cleanup@tmp/private_key_18319558777905035072.key (/w/workspace/ci-management-jenkins-sandbox-cleanup@tmp/private_key_18319558777905035072.key)
[ssh-agent] Using credentials rotterdam-jobbuilder (Rotterdam JJB)
provisioning config files...
copy managed file [npmrc] to file:/home/jenkins/.npmrc
copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
provisioning config files...
copy managed file [jjbini] to file:/home/jenkins/.config/jenkins_jobs/jenkins_jobs.ini
[ci-management-jenkins-sandbox-cleanup] $ /bin/bash /tmp/jenkins12222982805736314079.sh
---> jenkins-sandbox-cleanup.sh
Setup pyenv:
  system
* 3.8.13 (set by /opt/pyenv/version)
* 3.9.13 (set by /opt/pyenv/version)
* 3.10.6 (set by /opt/pyenv/version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-kzlH
lf-activate-venv(): INFO: Save venv in file: /tmp/.jjb_venv
lf-activate-venv(): INFO: Installing: jenkins-job-builder==6.0.0 
lf-activate-venv(): INFO: Adding /tmp/venv-kzlH/bin to PATH
/tmp/venv-kzlH/lib/python3.10/site-packages/jenkins_jobs/registry.py:21: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
  import pkg_resources
ERROR:stevedore.extension:Could not load 'delete': No module named 'pkg_resources.extern'
ERROR:stevedore.extension:Could not load 'delete-all': No module named 'pkg_resources.extern'
ERROR:stevedore.extension:Could not load 'get-plugins-info': No module named 'pkg_resources.extern'
ERROR:stevedore.extension:Could not load 'list': No module named 'pkg_resources.extern'
ERROR:stevedore.extension:Could not load 'test': No module named 'pkg_resources.extern'
ERROR:stevedore.extension:Could not load 'update': No module named 'pkg_resources.extern'
Traceback (most recent call last):
  File "/tmp/venv-kzlH/bin/jenkins-jobs", line 8, in <module>
    sys.exit(main())
  File "/tmp/venv-kzlH/lib/python3.10/site-packages/jenkins_jobs/cli/entry.py", line 177, in main
    jjb = JenkinsJobs(argv)
  File "/tmp/venv-kzlH/lib/python3.10/site-packages/jenkins_jobs/cli/entry.py", line 60, in __init__
    self.parser = create_parser()
  File "/tmp/venv-kzlH/lib/python3.10/site-packages/jenkins_jobs/cli/parser.py", line 112, in create_parser
    extension_manager.map(parse_subcommand_args, subparser)
  File "/tmp/venv-kzlH/lib/python3.10/site-packages/stevedore/extension.py", line 276, in map
    raise NoMatches('No %s extensions found' % self.namespace)
stevedore.exception.NoMatches: No jjb.cli.subcommands extensions found
Build step 'Execute shell' marked build as failure
$ ssh-agent -k
unset SSH_AUTH_SOCK;
unset SSH_AGENT_PID;
echo Agent pid 5375 killed;
[ssh-agent] Stopped.
[PostBuildScript] - [INFO] Executing post build scripts.
[ci-management-jenkins-sandbox-cleanup] $ /bin/bash /tmp/jenkins3677888020536963130.sh
---> sysstat.sh
[ci-management-jenkins-sandbox-cleanup] $ /bin/bash /tmp/jenkins15983440534870119275.sh
---> package-listing.sh
++ facter osfamily
++ tr '[:upper:]' '[:lower:]'
+ OS_FAMILY=redhat
+ workspace=/w/workspace/ci-management-jenkins-sandbox-cleanup
+ START_PACKAGES=/tmp/packages_start.txt
+ END_PACKAGES=/tmp/packages_end.txt
+ DIFF_PACKAGES=/tmp/packages_diff.txt
+ PACKAGES=/tmp/packages_start.txt
+ '[' /w/workspace/ci-management-jenkins-sandbox-cleanup ']'
+ PACKAGES=/tmp/packages_end.txt
+ case "${OS_FAMILY}" in
+ rpm -qa
+ sort
+ '[' -f /tmp/packages_start.txt ']'
+ '[' -f /tmp/packages_end.txt ']'
+ diff /tmp/packages_start.txt /tmp/packages_end.txt
+ '[' /w/workspace/ci-management-jenkins-sandbox-cleanup ']'
+ mkdir -p /w/workspace/ci-management-jenkins-sandbox-cleanup/archives/
+ cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-jenkins-sandbox-cleanup/archives/
[ci-management-jenkins-sandbox-cleanup] $ /bin/bash /tmp/jenkins16139239166351091378.sh
---> capture-instance-metadata.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
* 3.10.6 (set by /w/workspace/ci-management-jenkins-sandbox-cleanup/.python-version)
lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-TWzj
lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-TWzj/bin to PATH
INFO: Running in OpenStack, capturing instance metadata
[ci-management-jenkins-sandbox-cleanup] $ /bin/bash /tmp/jenkins15303593001758088467.sh
provisioning config files...
copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-jenkins-sandbox-cleanup@tmp/config8438351301306692120tmp
Regular expression run condition: Expression=[^.*logs-s3.*], Label=[fdio-logs-s3-cloudfront-index]
Run condition [Regular expression match] enabling perform for step [Provide Configuration files]
provisioning config files...
copy managed file [jenkins-s3-log-ship] to file:/home/jenkins/.aws/credentials
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content 
SERVER_ID=logs

[EnvInject] - Variables injected successfully.
[ci-management-jenkins-sandbox-cleanup] $ /bin/bash /tmp/jenkins6779054367333472220.sh
---> create-netrc.sh
[ci-management-jenkins-sandbox-cleanup] $ /bin/bash /tmp/jenkins15939596863534886695.sh
---> python-tools-install.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
* 3.10.6 (set by /w/workspace/ci-management-jenkins-sandbox-cleanup/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-TWzj from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-TWzj/bin to PATH
Generating Requirements File
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
lftools 0.37.12 requires requests<2.32.0, but you have requests 2.32.3 which is incompatible.
Python 3.10.6
pip 25.1.1 from /tmp/venv-TWzj/lib/python3.10/site-packages/pip (python 3.10)
appdirs==1.4.4
argcomplete==3.6.2
aspy.yaml==1.3.0
attrs==25.3.0
autopage==0.5.2
beautifulsoup4==4.13.4
boto3==1.38.27
botocore==1.38.27
bs4==0.0.2
cachetools==5.5.2
certifi==2025.4.26
cffi==1.17.1
cfgv==3.4.0
chardet==5.2.0
charset-normalizer==3.4.2
click==8.2.1
cliff==4.10.0
cmd2==2.5.11
cryptography==3.3.2
debtcollector==3.0.0
decorator==5.2.1
defusedxml==0.7.1
Deprecated==1.2.18
distlib==0.3.9
dnspython==2.7.0
docker==4.2.2
dogpile.cache==1.4.0
durationpy==0.10
email_validator==2.2.0
filelock==3.18.0
future==1.0.0
gitdb==4.0.12
GitPython==3.1.44
google-auth==2.40.2
httplib2==0.22.0
identify==2.6.12
idna==3.10
importlib-resources==1.5.0
iso8601==2.1.0
Jinja2==3.1.6
jmespath==1.0.1
jsonpatch==1.33
jsonpointer==3.0.0
jsonschema==4.24.0
jsonschema-specifications==2025.4.1
keystoneauth1==5.11.0
kubernetes==32.0.1
lftools==0.37.12
lxml==5.4.0
MarkupSafe==3.0.2
msgpack==1.1.0
multi_key_dict==2.0.3
munch==4.0.0
netaddr==1.3.0
niet==1.4.2
nodeenv==1.9.1
oauth2client==4.1.3
oauthlib==3.2.2
openstacksdk==4.5.0
os-client-config==2.1.0
os-service-types==1.7.0
osc-lib==4.0.2
oslo.config==9.8.0
oslo.context==6.0.0
oslo.i18n==6.5.1
oslo.log==7.1.0
oslo.serialization==5.7.0
oslo.utils==9.0.0
packaging==25.0
pbr==6.1.1
platformdirs==4.3.8
prettytable==3.16.0
psutil==7.0.0
pyasn1==0.6.1
pyasn1_modules==0.4.2
pycparser==2.22
pygerrit2==2.0.15
PyGithub==2.6.1
PyJWT==2.10.1
PyNaCl==1.5.0
pyparsing==2.4.7
pyperclip==1.9.0
pyrsistent==0.20.0
python-cinderclient==9.7.0
python-dateutil==2.9.0.post0
python-heatclient==4.2.0
python-jenkins==1.8.2
python-keystoneclient==5.6.0
python-magnumclient==4.8.1
python-openstackclient==8.1.0
python-swiftclient==4.8.0
PyYAML==6.0.2
referencing==0.36.2
requests==2.32.3
requests-oauthlib==2.0.0
requestsexceptions==1.4.0
rfc3986==2.0.0
rpds-py==0.25.1
rsa==4.9.1
ruamel.yaml==0.18.12
ruamel.yaml.clib==0.2.12
s3transfer==0.13.0
simplejson==3.20.1
six==1.17.0
smmap==5.0.2
soupsieve==2.7
stevedore==5.4.1
tabulate==0.9.0
toml==0.10.2
tomlkit==0.13.2
tqdm==4.67.1
typing_extensions==4.13.2
tzdata==2025.2
urllib3==1.26.20
virtualenv==20.31.2
wcwidth==0.2.13
websocket-client==1.8.0
wrapt==1.17.2
xdg==6.0.0
xmltodict==0.14.2
yq==3.4.3
[ci-management-jenkins-sandbox-cleanup] $ /bin/bash /tmp/jenkins4183780600139121578.sh
---> sudo-logs.sh
Archiving 'sudo' log..
[ci-management-jenkins-sandbox-cleanup] $ /bin/bash /tmp/jenkins12425192476778136457.sh
---> job-cost.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
* 3.10.6 (set by /w/workspace/ci-management-jenkins-sandbox-cleanup/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-TWzj from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
lftools 0.37.12 requires requests<2.32.0, but you have requests 2.32.3 which is incompatible.
lf-activate-venv(): INFO: Adding /tmp/venv-TWzj/bin to PATH
INFO: No Stack...
INFO: Retrieving Pricing Info for: v3-standard-2
INFO: Archiving Costs
[ci-management-jenkins-sandbox-cleanup] $ /bin/bash -l /tmp/jenkins5629203016354744787.sh
---> logs-deploy.sh
Setup pyenv:
  system
  3.8.13
  3.9.13
* 3.10.6 (set by /w/workspace/ci-management-jenkins-sandbox-cleanup/.python-version)
lf-activate-venv(): INFO: Reuse venv:/tmp/venv-TWzj from file:/tmp/.os_lf_venv
lf-activate-venv(): INFO: Installing: lftools 
lf-activate-venv(): INFO: Adding /tmp/venv-TWzj/bin to PATH
WARNING: Nexus logging server not set
INFO: S3 path logs/production/vex-yul-rot-jenkins-1/ci-management-jenkins-sandbox-cleanup/357/
INFO: archiving logs to S3
---> uname -a:
Linux prd-centos8-builder-2c-2g-498.novalocal 4.18.0-489.el8.x86_64 #1 SMP Thu Apr 27 17:02:11 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux


---> lscpu:
Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  1
Socket(s):           2
NUMA node(s):        1
Vendor ID:           AuthenticAMD
CPU family:          23
Model:               49
Model name:          AMD EPYC-Rome Processor
Stepping:            0
CPU MHz:             2799.998
BogoMIPS:            5599.99
Virtualization:      AMD-V
Hypervisor vendor:   KVM
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            512K
L3 cache:            16384K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities


---> nproc:
2


---> df -h:
Filesystem      Size  Used Avail Use% Mounted on
devtmpfs        3.8G     0  3.8G   0% /dev
tmpfs           3.8G     0  3.8G   0% /dev/shm
tmpfs           3.8G   17M  3.8G   1% /run
tmpfs           3.8G     0  3.8G   0% /sys/fs/cgroup
/dev/vda1        40G  9.1G   31G  23% /
tmpfs           770M     0  770M   0% /run/user/1001


---> free -m:
              total        used        free      shared  buff/cache   available
Mem:           7697         598        4976          19        2122        6804
Swap:          1023           0        1023


---> ip addr:
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
    link/ether fa:16:3e:97:a7:b0 brd ff:ff:ff:ff:ff:ff
    altname enp0s3
    altname ens3
    inet 10.30.87.224/23 brd 10.30.87.255 scope global dynamic noprefixroute eth0
       valid_lft 86121sec preferred_lft 86121sec
    inet6 fe80::f816:3eff:fe97:a7b0/64 scope link 
       valid_lft forever preferred_lft forever
3: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default 
    link/ether 02:42:08:39:af:f5 brd ff:ff:ff:ff:ff:ff
    inet 10.250.0.254/24 brd 10.250.0.255 scope global docker0
       valid_lft forever preferred_lft forever


---> sar -b -r -n DEV:
Linux 4.18.0-489.el8.x86_64 (centos-stream-8-builder-644fe243-c7e5-cbd2-69d3-83c8767e993e.nov) 	05/31/2025 	_x86_64_	(2 CPU)

08:01:41     LINUX RESTART	(2 CPU)

08:03:02 AM       tps      rtps      wtps   bread/s   bwrtn/s
08:04:01 AM     26.98      1.98     25.00    139.77   2681.16
08:05:01 AM     52.61      0.48     52.12     58.79   3988.14
08:06:01 AM     56.09      0.05     56.04      1.07   5178.92
08:07:01 AM     53.27      0.23     53.04     23.60   4446.16
Average:        47.32      0.68     46.64     55.46   4079.42

08:03:02 AM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
08:04:01 AM   5486484   7078652   2395832     30.40      2688   1788320    961724     10.77    305288   1818348     50244
08:05:01 AM   5285212   7048128   2597104     32.95      2688   1947716    954128     10.68    312332   1968544    128080
08:06:01 AM   5253352   7040360   2628964     33.35      2688   1971268    951100     10.65    313964   1994124     27292
08:07:01 AM   5066668   6936560   2815648     35.72      2688   2048392   1033196     11.57    321576   2149580     21684
Average:      5272929   7025925   2609387     33.10      2688   1938924    975037     10.92    313290   1982649     56825

08:03:02 AM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
08:04:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
08:04:01 AM      eth0     23.56     17.39    240.93      3.93      0.00      0.00      0.00      0.00
08:04:01 AM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
08:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
08:05:01 AM      eth0     33.26     23.93    609.72      5.39      0.00      0.00      0.00      0.00
08:05:01 AM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
08:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
08:06:01 AM      eth0     10.73      9.37     92.77      2.21      0.00      0.00      0.00      0.00
08:06:01 AM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
08:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
08:07:01 AM      eth0     19.10     15.10    161.83      5.01      0.00      0.00      0.00      0.00
08:07:01 AM   docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
Average:         eth0     21.65     16.44    276.46      4.13      0.00      0.00      0.00      0.00
Average:      docker0      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00


---> sar -P ALL:
Linux 4.18.0-489.el8.x86_64 (centos-stream-8-builder-644fe243-c7e5-cbd2-69d3-83c8767e993e.nov) 	05/31/2025 	_x86_64_	(2 CPU)

08:01:41     LINUX RESTART	(2 CPU)

08:03:02 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
08:04:01 AM     all     13.75      0.00      1.66      0.46      0.09     84.04
08:04:01 AM       0     13.93      0.00      1.83      0.42      0.10     83.72
08:04:01 AM       1     13.57      0.00      1.49      0.49      0.08     84.36
08:05:01 AM     all     16.03      0.00      1.87      0.63      0.07     81.40
08:05:01 AM       0     20.83      0.00      2.15      0.70      0.07     76.26
08:05:01 AM       1     11.22      0.00      1.58      0.57      0.08     86.55
08:06:01 AM     all     12.71      0.00      1.22      0.70      0.08     85.28
08:06:01 AM       0     14.87      0.00      1.30      0.68      0.08     83.06
08:06:01 AM       1     10.56      0.00      1.15      0.72      0.08     87.49
08:07:01 AM     all     20.22      0.00      2.00      0.57      0.09     77.12
08:07:01 AM       0     22.13      0.00      2.08      0.28      0.08     75.42
08:07:01 AM       1     18.32      0.00      1.91      0.85      0.10     78.82
Average:        all     15.69      0.00      1.69      0.59      0.09     81.95
Average:          0     17.96      0.00      1.84      0.52      0.08     79.60
Average:          1     13.42      0.00      1.53      0.66      0.09     84.30