Error when install salt server

Question

2017-06-19 16:57:40Z [cation-new.deploy_install]: CREATE_FAILED  RemoteError: resources.deploy_install: Remote error: ClientException Object HEAD failed: http://10.0.146.60:8080/v1/AUTH_5c6e814e4c1c443a823e1bc75a3e79a5/8db199ab-2b00-4f44-9633-61307ebc028b/cation-new-deploy_install-hakw3rccjcla 401 Unauthorized

[u'Trace

2017-06-19 16:57:40Z [cation-new]: CREATE_FAILED  Resource CREATE failed: RemoteError: resources.deploy_install: Remote error: ClientException Object HEAD failed: http://10.0.146.60:8080/v1/AUTH_5c6e814e4c1c443a823e1bc75a3e79a5/8db199ab-2b00-4f44-9633-61307ebc028b/cation-new-deploy_install-hakw3rccjcla 4

 Stack cation-new CREATE_FAILED

Command 'openstack stack create --timeout 120 --wait --template pnda.yaml --environment pnda_env.yaml --parameter ZookeeperNodes=3 --parameter KafkaNodes=2 --parameter DataNodes=3 --parameter OpentsdbNodes=1 --parameter PndaFlavor=pico --parameter KeyName=admin-keypair cation-new' failed

How to troubleshooting this problem?

I run openstack  stack output show  and see: 

| install_stderr      | {                                                                                                                                        |

|                     |   "output_value": null,                                                                                                                  |

|                     |   "output_error": "No JSON object could be decoded\nTraceback (most recent call last):\n\n  File \"/usr/lib/python2.7/site-              |

|                     | packages/oslo_messaging/rpc/server.py\", line 133, in _process_incoming\n    from oslo_messaging.rpc import dispatcher as                |

|                     | rpc_dispatcher\n\n  File \"/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py\", line 150, in dispatch\n    :param        |

|                     | endpoints: list of endpoint objects for dispatching to\n\n  File \"/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py\",  |

|                     | line 121, in _do_dispatch\n    if hasattr(endpoint, method):\n\n  File \"/usr/lib/python2.7/site-packages/osprofiler/profiler.py\", line |

|                     | 154, in wrapper\n    return f(*args, **kwargs)\n\n  File \"/usr/lib/python2.7/site-packages/heat/common/context.py\", line 424, in       |

|                     | wrapped\n    return func(self, ctx, *args, **kwargs)\n\n  File \"/usr/lib/python2.7/site-packages/heat/engine/service.py\", line 2215,   |

|                     | in show_software_deployment\n    cnxt, deployment_id)\n\n  File \"/usr/lib/python2.7/site-                                               |

|                     | packages/heat/engine/service_software_config.py\", line 239, in show_software_deployment\n    sd = self._show_software_deployment(cnxt,  |

|                     | deployment_id)\n\n  File \"/usr/lib/python2.7/site-packages/heat/engine/service_software_config.py\", line 232, in                       |

|                     | _show_software_deployment\n    cnxt, sd, input_values.get('deploy_signal_id'))\n\n  File \"/usr/lib/python2.7/site-                      |

|                     | packages/heat/engine/service_software_config.py\", line 169, in _refresh_swift_software_deployment\n    cnxt, sd.id,                     |

|                     | jsonutils.loads(obj),\n\n  File \"/usr/lib/python2.7/site-packages/oslo_serialization/jsonutils.py\", line 241, in loads\n    return     |

|                     | json.loads(encodeutils.safe_decode(s, encoding), **kwargs)\n\n  File \"/usr/lib64/python2.7/json/__init__.py\", line 338, in loads\n     |

|                     | return _default_decoder.decode(s)\n\n  File \"/usr/lib64/python2.7/json/decoder.py\", line 366, in decode\n    obj, end =                |

|                     | self.raw_decode(s, idx=_w(s, 0).end())\n\n  File \"/usr/lib64/python2.7/json/decoder.py\", line 384, in raw_decode\n    raise            |

|                     | ValueError(\"No JSON object could be decoded\")\n\nValueError: No JSON object could be decoded\n",                                       |

|                     |   "output_key": "install_stderr",                                                                                                        |

|                     |   "description": "No description given"

And I see the log in /var/log/message in swift service node:

Jun 20 00:40:07 overcloud-controller-1 proxy-server: 10.0.143.33 10.0.143.33 20/Jun/2017/00/40/07 HEAD /v1/AUTH_33785a3e73524ed68a0d937fba884b62 HTTP/1.0 204 - python-swiftclient-3.1.0 00c1c81a7eba424e... - - - tx5c9f8e3be2c64e6f8b0cd-0059486ee7 - 0.0129 - - 1497919207.742204905 1497919207.755089998 -

Jun 20 00:40:07 overcloud-controller-1 proxy-server: 10.0.143.33 10.0.143.33 20/Jun/2017/00/40/07 HEAD /v1/AUTH_c09116b99d01497e96700e03418fb9b5 HTTP/1.0 204 - python-swiftclient-3.1.0 00c1c81a7eba424e... - - - tx35fee0e9d4444cbbb97ce-0059486ee7 - 0.0112 - - 1497919207.796508074 1497919207.807734966 -

Jun 20 00:40:13 overcloud-controller-1 os-collect-config: /var/lib/os-collect-config/local-data not found. Skipping

Jun 20 00:40:13 overcloud-controller-1 os-collect-config: No local metadata found (['/var/lib/os-collect-config/local-data'])

Jun 20 00:40:44 overcloud-controller-1 os-collect-config: /var/lib/os-collect-config/local-data not found. Skipping

Answer 1

I login the virtual machine , and curl Get the swift resource manually and it return correctly..so how to troubleshooting the problem?

Comments

The error above is from OpenStack rather than PNDA - please make sure your OpenStack installation is stable and working properly.

In particular it might be worthwhile looking at the configuration of Swift. There is some more information on a similar problem here - https://github.com/pndaproject/pnda-heat-templates/issues/64.