500 Server Error: Internal Server Error ("invalid tag format")

Rancher 1.x
1

I am having an issue launching a service into a stack.

I am getting two errors popping up in the Rancher Master logs:

2016-08-30 14:38:37,186 ERROR [be066688-e421-4d04-b3bb-f5b73526633b:1975] [instance:123][instance.start->(InstanceStart)] [] [utorService-275] [i.c.p.process.instance.InstanceStart] Failed to Storage for instance [123]
2016-08-30 14:39:07,193 ERROR [6afc983e-4265-426d-b9de-b550c00a58d5:1984] [instance:124->imageStoragePoolMap:65] [instance.start->(InstanceStart)->volume.activate->(VolumeActivate)->imagestoragepoolmap.activate] [] [utorService-271] [c.p.e.p.i.DefaultProcessInstanceImpl] Unknown exception io.cattle.platform.eventing.exception.EventExecutionException: 500 Server Error: Internal Server Error ("invalid tag format")

and

2016-08-30 14:39:07,195 ERROR [6afc983e-4265-426d-b9de-b550c00a58d5:1984] [instance:124->volume:125] [instance.start->(InstanceStart)->volume.activate] [] [utorService-271] [c.p. e.p.i.DefaultProcessInstanceImpl] Unknown exception io.cattle.platform.eventing.exception.EventExecutionException: 500 Server Error: Internal Server Error ("invalid tag format")

It is on a single Host. Disk/Memory/CPU on the host are all under 30% use, so I doubt it is a hardware issue.
Has anyone seen this before? This will be the third service in my only (the “Default”) stack.

2

Can you share what your service definition is?

3

This is the relevant section of the rancher-compose.yml if that is what you are referring to (sorry, I’m a bit of a neophyte in Rancher)

UserService:
  scale: 1
  health_check:
    port: 80
    interval: 2000
    initializing_timeout: 60000
    unhealthy_threshold: 3
    strategy: recreate
    response_timeout: 2000
    request_line: GET "/usvc/v1/ping" "HTTP/1.0"
    healthy_threshold: 2
4

I would actually like to see both the docker-compose.yml and rancher-compose.yml.

5

Sure, here’s that section (EnvVars redacted):

UserService:
  ports:
  - 4000:80/tcp
  environment:
    BACKBONE_AUTHENTICATOR_URL: [REDACTED]
    BACKBONE_AUTHENTICATOR_PORT: [REDACTED]
    AWS_ACCESS_KEY_ID: [REDACTED]
    AWS_SECRET_ACCESS_KEY: [REDACTED]
    AWS_REGION: [REDACTED]
    DYNAMO_USER_TABLE: [REDACTED]
    DYNAMO_ROLE_TABLE: [REDACTED]
    PORT: [REDACTED]
  labels:
    io.rancher.container.pull_image: always
  tty: true
  image: 'peopleadmin/userservice: latest'
  stdin_open: true

sigh … I see what I did wrong. The image: has a space in it :confused:

Thanks for your time! Fixing that seems to have worked.