500 Server Error: Internal Server Error ("invalid tag format")

I am having an issue launching a service into a stack.

I am getting two errors popping up in the Rancher Master logs:

2016-08-30 14:38:37,186 ERROR [be066688-e421-4d04-b3bb-f5b73526633b:1975] [instance:123][instance.start->(InstanceStart)] [] [utorService-275] [i.c.p.process.instance.InstanceStart] Failed to Storage for instance [123]
2016-08-30 14:39:07,193 ERROR [6afc983e-4265-426d-b9de-b550c00a58d5:1984] [instance:124->imageStoragePoolMap:65] [instance.start->(InstanceStart)->volume.activate->(VolumeActivate)->imagestoragepoolmap.activate] [] [utorService-271] [c.p.e.p.i.DefaultProcessInstanceImpl] Unknown exception io.cattle.platform.eventing.exception.EventExecutionException: 500 Server Error: Internal Server Error ("invalid tag format")

and

2016-08-30 14:39:07,195 ERROR [6afc983e-4265-426d-b9de-b550c00a58d5:1984] [instance:124->volume:125] [instance.start->(InstanceStart)->volume.activate] [] [utorService-271] [c.p. e.p.i.DefaultProcessInstanceImpl] Unknown exception io.cattle.platform.eventing.exception.EventExecutionException: 500 Server Error: Internal Server Error ("invalid tag format")

It is on a single Host. Disk/Memory/CPU on the host are all under 30% use, so I doubt it is a hardware issue.
Has anyone seen this before? This will be the third service in my only (the “Default”) stack.

Can you share what your service definition is?

This is the relevant section of the rancher-compose.yml if that is what you are referring to (sorry, I’m a bit of a neophyte in Rancher)

UserService:
  scale: 1
  health_check:
    port: 80
    interval: 2000
    initializing_timeout: 60000
    unhealthy_threshold: 3
    strategy: recreate
    response_timeout: 2000
    request_line: GET "/usvc/v1/ping" "HTTP/1.0"
    healthy_threshold: 2

I would actually like to see both the docker-compose.yml and rancher-compose.yml.

Sure, here’s that section (EnvVars redacted):

UserService:
  ports:
  - 4000:80/tcp
  environment:
    BACKBONE_AUTHENTICATOR_URL: [REDACTED]
    BACKBONE_AUTHENTICATOR_PORT: [REDACTED]
    AWS_ACCESS_KEY_ID: [REDACTED]
    AWS_SECRET_ACCESS_KEY: [REDACTED]
    AWS_REGION: [REDACTED]
    DYNAMO_USER_TABLE: [REDACTED]
    DYNAMO_ROLE_TABLE: [REDACTED]
    PORT: [REDACTED]
  labels:
    io.rancher.container.pull_image: always
  tty: true
  image: 'peopleadmin/userservice: latest'
  stdin_open: true

sigh … I see what I did wrong. The image: has a space in it :confused:

Thanks for your time! Fixing that seems to have worked.