ChatGPT解决这个技术问题 Extra ChatGPT

How can I keep a container running on Kubernetes?

I'm now trying to run a simple container with shell (/bin/bash) on a Kubernetes cluster.

I thought that there was a way to keep a container running on a Docker container by using pseudo-tty and detach option (-td option on docker run command).

For example,

$ sudo docker run -td ubuntu:latest

Is there an option like this in Kubernetes?

I've tried running a container by using a kubectl run-container command like:

kubectl run-container test_container ubuntu:latest --replicas=1

But the container exits for a few seconds (just like launching with the docker run command without options I mentioned above). And ReplicationController launches it again repeatedly.

Is there a way to keep a container running on Kubernetes like the -td options in the docker run command?

Using this image (as Kubernetes docs suggests) is quite handy: kubectl run curl --image=radial/busyboxplus:curl -i --tty
This question has been mentioned at this video: Kubernetes the very hard way at Datadog with a slide-title of "Cargo culting. From wikipedia: The term cargo cult programmer may apply when an unskilled or novice computer programmer (or one inexperienced with the problem at hand) copies some program code from one place to another with little or no understanding of how it works or whether it is required in its new position.

J
Joel B

Containers are meant to run to completion. You need to provide your container with a task that will never finish. Something like this should work:

apiVersion: v1
kind: Pod
metadata:
  name: ubuntu
spec:
  containers:
  - name: ubuntu
    image: ubuntu:latest
    # Just spin & wait forever
    command: [ "/bin/bash", "-c", "--" ]
    args: [ "while true; do sleep 30; done;" ]

But is this a best practice?
@aneeshjoshi I wouldn't say this is best practice. This is just an example providing a pod that will run without immediately exiting. Best practice is to create your containers to do the job they were designed for (a job that runs to completion, a webserver that runs perpetually, etc.). I posted this as an example because Kubernetes can feel initially frustrating when you keep creating pods only to have the disappear since the default command exits immediately.
thanks for this as I am in need of a container that can live for awhile allowing me to enter it. I was trying to do the same with a lighter image than ubuntu and tried bash image but couldn't get it to work. Any idea how to do the same as this with bash image?
I know this is an old issue; however, Kubernetes is started to support ephemeral containers. link:kubernetes.io/docs/concepts/workloads/pods/ephemeral-containers. These containers have some limitations like resource limits, however they are designed for debugging purposes.
@cryanbhu For a lighter image, you may use alpine, the container spec can look like: {"name": "util", "image": "alpine", "command": [ "/bin/sh", "-c", "--" ], "args": [ "while true; do sleep 30; done;" ]} (only json because the yaml won't format in comments here.) The important bit being /bin/sh instead of /bin/bash.
i
itsafire

You could use this CMD in your Dockerfile:

CMD exec /bin/bash -c "trap : TERM INT; sleep infinity & wait"

This will keep your container alive until it is told to stop. Using trap and wait will make your container react immediately to a stop request. Without trap/wait stopping will take a few seconds.

For busybox based images (used in alpine based images) sleep does not know about the infinity argument. This workaround gives you the same immediate response to a docker stop like in the above example:

CMD exec /bin/sh -c "trap : TERM INT; sleep 9999999999d & wait"

I'm using the same on kubernetes deployment yaml for debugging purposes
this gives me "sleep: invalid number 'infinity'"
@arunkjn Thanks for this. You are probably stuck with an image that uses busybox (like alpine images). See the updated answer.
Instead of sleep infinity, just use sleep 999999999d where d indicates days.
Thank you for the info on trapping TERM/INT! I couldn't understand why my container wasn't stopping correctly, since sleep will respond to it from the terminal
A
Adrian Mouat

A container exits when its main process exits. Doing something like:

docker run -itd debian

to hold the container open is frankly a hack that should only be used for quick tests and examples. If you just want a container for testing for a few minutes, I would do:

docker run -d debian sleep 300

Which has the advantage that the container will automatically exit if you forget about it. Alternatively, you could put something like this in a while loop to keep it running forever, or just run an application such as top. All of these should be easy to do in Kubernetes.

The real question is why would you want to do this? Your container should be providing a service, whose process will keep the container running in the background.


Thank you for your answer. I'm now trying to understand the behavior of containers, with dozens of containers running at the same time. Endless loop and using other heavy command, prevent me to know what is the behavior of containers. That is the reason why I need simple container like only running /bin/bash.
For now, I'll try running cat without arguments and top and sleep with argument of large number.
sleep infinity works in a lot of cases (not busybox)
There's plenty of reasons to do this. For example, you might deploy your pods with helm releases and injected configuration, which is going to make recreation of similar environments annoying and cumbersome. But having a container with that configuration in cases where the other pods crash/are deleted can be infinitely useful.
@КонстантинВан Hey, younger me! You want to make a Pod instead! You don't put everything in a single "container."
S
Soviut

In your Dockerfile use this command: CMD ["sh", "-c", "tail -f /dev/null"] Build your docker image. Push it to your cluster or similar, just to make sure the image it's available. kubectl run debug-container -it --image=


Great tips for debugging the container.
Do you need the sh -c? I'm pretty sure thie does the trick too: CMD ["tail", "-f", "/dev/null"]
@PeterV.Mørch, I doubt, but still think that in case you write it without sh -c and it will work like a charm.
A
Arbaaz

In order to keep a POD running it should to be performing certain task, otherwise Kubernetes will find it unnecessary, therefore it stops. There are many ways to keep a POD running.

I have faced similar problems when I needed a POD just to run continuously without doing any useful operation. The following are the two ways those worked for me:

Running sleep command while running the container. Running an infinite loop inside the container.

Although the first option is easier than the second one and may suffice the requirement, it is not the best option. As, there is a limit as far as the number of seconds you are going to assign in the sleep command. But a container with infinite loop running inside it never exits.

However, I will describe both the ways(Considering you are running busybox container):

1. Sleep Command

apiVersion: v1
kind: Pod
metadata:
  name: busybox
  labels:
    app: busybox
spec:
  containers:
  - name: busybox
    image: busybox
    ports:
    - containerPort: 80
    command: ["/bin/sh", "-ec", "sleep 1000"]

2. Infinite Loop

apiVersion: v1
kind: Pod
metadata:
  name: busybox
  labels:
    app: busybox
spec:
  containers:
  - name: busybox
    image: busybox
    ports:
    - containerPort: 80
    command: ["/bin/sh", "-ec", "while :; do echo '.'; sleep 5 ; done"]

Run the following command to run the pod:

kubectl apply -f <pod-yaml-file-name>.yaml

Hope it helps!


May I ask, what is sleep? Is it a command internal to Ubuntu? Or docker command?
@Faraz It's a linux shell command, it's not specific to docker.
W
Wlodek B.

The simplest command as it can be for k8s pod manifest to run container forever:

apiVersion: v1
kind: Pod
metadata:
  name: ubuntu
spec:
  containers:
  - name: ubuntu
    image: ubuntu:latest
    # Just sleep forever
    command: [ "sleep" ]
    args: [ "infinity" ]

The most elegant and minimalistic solution.
Getting an error with that exact code The Pod "ubuntu" is invalid: spec: Forbidden: pod updates may not change fields other than `spec.containers[*].image`, `spec.initContainers[*].image`, `spec.activeDeadlineSeconds` or `spec.tolerations` (only additions to existing tolerations)
It means you're trying to change part of manifest which is immutable (with kubectl apply). Try with kubectl replace with optional --force flag
P
Peter Mortensen

I was able to get this to work with the command sleep infinity in Kubernetes, which will keep the container open. See this answer for alternatives when that doesn't work.


This does not provide an answer to the question. To critique or request clarification from an author, leave a comment below their post. - From Review
@Will Sure it does. sleep infinity keeps the container open, providing the same type of functionality that the question asks about (for most types of containers). It also provides a link to alternatives for cases when that specific command doesn't work
This was from review. If you add the comment text there to the answer then it's a quality answer :) My initial flag/commend was based on saying your comment wasn't successful, making me think this was supposed to be a comment. Added a quick edit and upvoted.
"...sleep infinity in Kubernetes" is an uninformed statement. It implies that there is no unix and no docker in the picture.
L
Lukasz Dynowski

My few cents on the subject. Assuming that kubectl is working then the closest command that would be equivalent to the docker command that you mentioned in your question, would be something like this.

$ kubectl run ubuntu --image=ubuntu --restart=Never --command sleep infinity

Above command will create a single Pod in default namespace and, it will execute sleep command with infinity argument -this way you will have a process that runs in foreground keeping container alive.

Afterwords, you can interact with Pod by running kubectl exec command.

$ kubectl exec ubuntu -it -- bash

This technique is very useful for creating a Pod resource and ad-hoc debugging.


Works great. No need for the --restart=Never, just call kubectl run ubuntu --image=ubuntu -- sleep infinity
or if you want to do old fashioned thicker commands you can always do something like kubectl run busybox --image=busybox --restart=Never -- /bin/sh -c 'i=0; while true; do echo "$i: $(date)"; i=$((i+1)); sleep 1; done;'
O
Omar Khaled

Use this command inside you Dockerfile to keep the container running in your K8s cluster:

CMD tail -f /dev/null


M
Maha Hamza

add this : in template ->in spec-> in container ->in ports & after container port line

    command: ["/bin/sh", "-ec", "while :; do echo '.'; sleep 6 ; done"]

sharing the whole file with command would be more helpful to others instead of command.
S
Stefan L

In my case, a pod with an initContainer failed to initialize. Running docker ps -a and then docker logs exited-container-id-here gave me a log message which kubectl logs podname didn't display. Mystery solved :-)


I
Ivan Aracki

There are many different ways for accomplishing this, but one of the most elegant one is:

kubectl run -i --tty --image ubuntu:latest ubuntu-test --restart=Never --rm /bin/sh

Why do you consider it the most elegant solution?
@mordowiciel, because it directly relates to docker command and it's not split into two commands like the most of the other answers.
H
Hackaholic

I did a hack by putting it in background:

[root@localhost ~]# kubectl run hello -it --image ubuntu -- bash &
[2] 128461

Exec on pod hello

[root@localhost ~]# kubectl exec -it hello -- whoami
root
[root@localhost ~]# kubectl exec -it hello -- hostname
hello

Getting a shell

[root@localhost ~]# kubectl exec -it hello -- bash
root@hello:/# ls
bin  boot  dev  etc  home  lib  lib32  lib64  libx32  media  mnt  opt  proc  root  run  sbin  srv  sys  tmp  usr  var