![AWS pcluster が MasterServerWaitCondition の FAILURE 信号を受信し、iptables と chef バージョン エラーが発生して失敗する](https://rvso.com/image/768939/AWS%20pcluster%20%E3%81%8C%20MasterServerWaitCondition%20%E3%81%AE%20FAILURE%20%E4%BF%A1%E5%8F%B7%E3%82%92%E5%8F%97%E4%BF%A1%E3%81%97%E3%80%81iptables%20%E3%81%A8%20chef%20%E3%83%90%E3%83%BC%E3%82%B8%E3%83%A7%E3%83%B3%20%E3%82%A8%E3%83%A9%E3%83%BC%E3%81%8C%E7%99%BA%E7%94%9F%E3%81%97%E3%81%A6%E5%A4%B1%E6%95%97%E3%81%99%E3%82%8B.png)
parallelcluster 用の AMI を作成しようとしています。Amazon の標準 AMI (us-west-2、現在いるリージョン、および alinux 用の ami-0436692c7b452bae4) を使用し、いくつかのパッケージを追加して少し変更しました。
しかし、実行するとpcluster create foo --norollback
次のエラーが発生します:
Beginning cluster creation for cluster: stockAWS
Creating stack named: parallelcluster-stockAWS
Status: parallelcluster-stockAWS - ROLLBACK_IN_PROGRESS
Cluster creation failed. Failed events:
- AWS::AutoScaling::AutoScalingGroup ComputeFleet Resource creation cancelled
- AWS::CloudFormation::WaitCondition MasterServerWaitCondition Received FAILURE signal with UniqueId i-booyaa
次に、実行してssh foo
ログを確認すると、/var/log/cfncluster-init.log
長いエラー ログが表示されます。その下部を以下に示します。
2021-07-28 23:16:49,659 [ERROR] Command chef (chef-client --local-mode --config /etc/chef/client.rb --log_level auto --force-formatter --no-color --chef-zero-port 8889 --json-attributes /etc/chef/dna.json --override-runlist aws-parallelcluster::_prep_env) failed
2021-07-28 23:16:49,659 [DEBUG] Command chef output: Starting Chef Client, version 14.2.0
[2021-07-28T23:16:47+00:00] WARN: Run List override has been provided.
[2021-07-28T23:16:47+00:00] WARN: Run List override has been provided.
[2021-07-28T23:16:47+00:00] WARN: Original Run List: [recipe[aws-parallelcluster::slurm_config]]
[2021-07-28T23:16:47+00:00] WARN: Original Run List: [recipe[aws-parallelcluster::slurm_config]]
[2021-07-28T23:16:47+00:00] WARN: Overridden Run List: [recipe[aws-parallelcluster::_prep_env]]
[2021-07-28T23:16:47+00:00] WARN: Overridden Run List: [recipe[aws-parallelcluster::_prep_env]]
resolving cookbooks for run list: ["aws-parallelcluster::_prep_env"]
Synchronizing Cookbooks:
- aws-parallelcluster (2.5.1)
- poise-python (1.7.0)
- tar (2.1.1)
- selinux (2.1.1)
- nfs (2.6.4)
- yum (5.1.0)
- yum-epel (3.1.0)
- openssh (2.6.3)
- apt (7.0.0)
- hostname (0.4.2)
- line (2.4.1)
- ulimit (1.0.0)
- pyenv (3.1.1)
- kernel_module (1.1.2)
- poise (2.8.2)
- poise-languages (2.1.2)
- iptables (8.0.0)
- hostsfile (3.0.1)
- poise-archive (1.5.0)
Running handlers:
[2021-07-28T23:16:49+00:00] ERROR: Running exception handlers
[2021-07-28T23:16:49+00:00] ERROR: Running exception handlers
Running handlers complete
[2021-07-28T23:16:49+00:00] ERROR: Exception handlers complete
[2021-07-28T23:16:49+00:00] ERROR: Exception handlers complete
Chef Client failed. 0 resources updated in 11 seconds
[2021-07-28T23:16:49+00:00] FATAL: Stacktrace dumped to /etc/chef/local-mode-cache/cache/chef-stacktrace.out
[2021-07-28T23:16:49+00:00] FATAL: Stacktrace dumped to /etc/chef/local-mode-cache/cache/chef-stacktrace.out
[2021-07-28T23:16:49+00:00] FATAL: Please provide the contents of the stacktrace.out file if you file a bug report
[2021-07-28T23:16:49+00:00] FATAL: Please provide the contents of the stacktrace.out file if you file a bug report
[2021-07-28T23:16:49+00:00] FATAL: Chef::Exceptions::CookbookChefVersionMismatch: Cookbook 'iptables' version '8.0.0' depends on chef version [">= 15.3"], but the running chef version is 14.2.0
[2021-07-28T23:16:49+00:00] FATAL: Chef::Exceptions::CookbookChefVersionMismatch: Cookbook 'iptables' version '8.0.0' depends on chef version [">= 15.3"], but the running chef version is 14.2.0
2021-07-28 23:16:49,659 [ERROR] Error encountered during build of chefPrepEnv: Command chef failed
Traceback (most recent call last):
File "/usr/lib/python3.7/site-packages/cfnbootstrap/construction.py", line 573, in run_config
CloudFormationCarpenter(config, self._auth_config).build(worklog)
File "/usr/lib/python3.7/site-packages/cfnbootstrap/construction.py", line 273, in build
self._config.commands)
File "/usr/lib/python3.7/site-packages/cfnbootstrap/command_tool.py", line 127, in apply
raise ToolError(u"Command %s failed" % name)
cfnbootstrap.construction_errors.ToolError: Command chef failed
2021-07-28 23:16:49,661 [ERROR] -----------------------BUILD FAILED!------------------------
実行するとiptables --version
、v1.8.4
sudoで実行した場合も同様です。chefは14.2.0
イライラするのは、標準の AWS AMI を使用して parallelcluster スタックを作成すると、まったく同じ動作が発生することです。これは何が起きているのでしょうか?