I am trying to start a docker container with the below command.

    docker run -it -p 50070:50070 -p 8088:8088 -p 8080:8080 suhothayan/hadoop-spark-pig-hive:2.9.2 bash

It ended up with the following error.

&gt; docker: error response from daemon: Ports are not available: listen tcp 0.0.0.0/50070: bind: An attempt was made to access a socket in a way forbidden by its access permissions.

As I understand, the error has occurred as the port 50070 is used by another process. I&#39;ve tried to identify the process in order to kill that with the below command in the command prompt, but it does not give an output nor an error.

    netstat -ano | findstr :50080



Ports are not available: listen tcp 0.0.0.0/50070: bind: An attempt was made to access a socket in a way forbidden by its access permissions

What I&#39;m currently doing:

Dockerfile:

    FROM python:3.5.1
    
    ENV PYTHONUNBUFFERED 1
    
    RUN mkdir /www
    WORKDIR /www
    ADD deps.txt /www/
    RUN pip3 install -r deps.txt
    ADD . /www/
    RUN chmod 0755 /www/docker-init.sh

Build command:

    docker build -t my-djnago-app:latest .

Tagging:

    docker tag my-djnago-app:latest lolorama/my-djnago-app-img:latest

Pushing:

    docker push lolorama/my-djnago-app-img:latest

----
After following these steps, the repository image still hasn&#39;t updated. I keep getting this message - &quot;Layer already exists&quot;.

    The push refers to a repository [docker.io/lolorama/my-django-app-img]
    fd5aa641b308: Layer already exists
    d9c60c6f98e8: Layer already exists
    d9d14867f6d7: Layer already exists
    64ce166099ca: Layer already exists
    73b670e35c69: Layer already exists
    5f70bf18a086: Layer already exists
    9ea142d097a5: Layer already exists
    52f5845b1de0: Layer already exists
    e7fadb3ab9d4: Layer already exists
    cef72744de05: Layer already exists
    591569fa6c34: Layer already exists
    998608e2fcd4: Layer already exists
    c12ecfd4861d: Layer already exists


**What am I doing wrong?**

Docker - What is proper way to rebuild and push updated image to docker cloud?

I have downloaded the Ubuntu image inside Docker on Windows.

I can run Ubuntu by:

    docker run -it ubuntu

I only see `root`, but I don&#39;t see the Ubuntu GUI. How do I install or configure the GUI for that image and run applications on that GUI like we run in a VM?


How to open Ubuntu GUI inside a Docker image

When using Docker, we start with a base image. We boot it up, create changes and those changes are saved in layers forming another image.

So eventually I have an image for my PostgreSQL instance and an image for my web application, changes to which keep on being persisted.

What is a container?



What is the difference between a Docker image and a container?

I am trying

    docker rmi c565603bc87f

Error:

&gt; Error response from daemon: conflict: unable to delete c565603bc87f
&gt; (cannot be forced) - image has dependent child images

So i can&#39;t delete image even with -f flag. How to delete image then and all of its children ?

Linux and docker version: 

uname -a
Linux goracio-pc 4.4.0-24-generic #43-Ubuntu SMP Wed Jun 8 19:27:37 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux

docker version
Client:
Version: 1.11.2
API version: 1.23
Go version: go1.5.4
Git commit: b9f10c9
Built: Wed Jun 1 22:00:43 2016
OS/Arch: linux/amd64

Server:
Version: 1.11.2
API version: 1.23
Go version: go1.5.4
Git commit: b9f10c9
Built: Wed Jun 1 22:00:43 2016
OS/Arch: linux/amd64

Can’t delete docker image with dependent child images

I managed to find the containers under directory `/var/lib/docker/containers`, but I can&#39;t find the images.

What are the directories and files under `/var/lib/docker`?


Where are Docker images stored on the host machine?

I&#39;ve seen a bunch of tutorials that seem do the same thing I&#39;m trying to do, but for some reason my Docker containers exit. Basically, I&#39;m setting up a web-server and a few daemons inside a Docker container. I do the final parts of this through a bash script called `run-all.sh` that I run through CMD in my Dockerfile. `run-all.sh` looks like this:

    service supervisor start
    service nginx start

And I start it inside of my Dockerfile as follows:

    CMD [&quot;sh&quot;, &quot;/root/credentialize_and_run.sh&quot;]

I can see that the services all start up correctly when I run things manually (i.e. getting on to the image with -i -t /bin/bash), and everything looks like it runs correctly when I run the image, but it exits once it finishes starting up my processes. I&#39;d like the processes to run indefinitely, and as far as I understand, the container has to keep running for this to happen. Nevertheless, when I run `docker ps -a`, I see:

    ➜  docker_test  docker ps -a
    CONTAINER ID        IMAGE                            COMMAND                CREATED             STATUS                      PORTS               NAMES
    c7706edc4189        some_name/some_repo:blah   &quot;sh /root/run-all.sh   8 minutes ago       Exited (0) 8 minutes ago                        grave_jones

What gives? Why is it exiting? I know I could just put a while loop at the end of my bash script to keep it up, but what&#39;s the right way to keep it from exiting?

How to keep Docker container running after starting services?

When running Docker for a long time, there are a lot of images in system. How can I remove all unused Docker images at once safety to free up the storage?

In addition, I also want to remove images pulled months ago, which have the correct `TAG`.

So, I&#39;m not asking for removing untagged images only. I&#39;m searching for a way to remove general unused images, which includes both untagged and other images such as pulled months ago with correct `TAG`.



How to remove old and unused Docker images

On Ubuntu&amp;nbsp;14.04 (Trusty Tahr) I&#39;m looking for a way to stop a running container and the only information I have is the image name that was used in the Docker run command.  

Is there a command to find all the matching running containers that match that image name and stop them?


Stopping Docker containers by image name - Ubuntu

For research purposes I&#39;m trying to crawl the public Docker registry ( https://registry.hub.docker.com/ ) and find out 1) how many layers an average image has and 2) the sizes of these layers to get an idea of the distribution.

However I studied the API and public libraries as well as the details on the github but I cant find any method to:

- retrieve all the public repositories/images (even if those are thousands I still need a starting list to iterate through)
- find all the layers of an image
- find the size for a layer (so not an image but for the individual layer).

Can anyone help me find a way to retrieve this information?

Thank you!

EDIT: is anyone able to verify that searching for &#39;\*&#39; in Docker registry is returning all the repositories and not just anything that mentions &#39;\*&#39; anywhere? https://registry.hub.docker.com/search?q=\*

Finding the layers and layer sizes for each Docker image

After building a Docker image from a `dockerfile`, I see the image was built successfully, but what do I do with it? Shouldn&#39;t i be able to run it as a container?

Run a Docker image as a container

I have a few Dockerfiles right now.

One is for Cassandra 3.5, and it is `FROM cassandra:3.5`

I also have a Dockerfile for Kafka, but t is quite a bit more complex. It is `FROM java:openjdk-8-fre` and it runs a long command to install Kafka and Zookeeper.

Finally, I have an application written in Scala that uses SBT. 

For that Dockerfile, it is `FROM broadinstitute/scala-baseimage`, which gets me Java 8, Scala 2.11.7, and STB 0.13.9, which are what I need.

Perhaps, I don&#39;t understand how Docker works, but my Scala program has Cassandra and Kafka as dependencies and for development purposes, I want others to be able to simply clone my repo with the `Dockerfile` and then be able to build it with Cassandra, Kafka, Scala, Java and SBT all baked in so that they can just compile the source. I&#39;m having a lot of issues with this though. 

How do I combine these Dockerfiles? How do I simply make an environment with those things baked in?

Is there a way to combine Docker images into 1 container?

I want to create a docker image. This is my work directory:
Dockerfile.in   test.json   test.py

And this is my Dockerfile:

    COPY ./test.json /home/test.json
    COPY ./test.py /home/test.py

    RUN python test.py

When i launch this command: 
`docker build -f Dockerfile.in -t 637268723/test:1.0 .`


It gives me this error: 

    `Step 1/5 : COPY ./test.json /home/test.json
     ---&gt; Using cache
     ---&gt; 6774cd225d60
     Step 2/5 : COPY ./test.py /home/test.py
     COPY failed: stat /var/lib/docker/tmp/docker-builder428014112/test.py: 
     no such file or directory`



Can anyone help me?

Can&#39;t create a docker image for COPY failed: stat /var/lib/docker/tmp/docker-builder error

According to tutorial I read so far, use &quot;`docker run -d`&quot; will start a container from image, and the container will run in background. This is how it looks like, we can see we already have container id.

    root@docker:/home/root# docker run -d centos
    605e3928cdddb844526bab691af51d0c9262e0a1fc3d41de3f59be1a58e1bd1d

But if I ran &quot;**`docker ps`**&quot;, nothing was returned.

So I tried &quot;**`docker ps -a`**&quot;, I can see container already exited:

    root@docker:/home/root# docker ps -a
    CONTAINER ID        IMAGE                 COMMAND             CREATED             STATUS                         PORTS               NAMES
    605e3928cddd        centos:latest         &quot;/bin/bash&quot;         31 minutes ago      Exited (0) 31 minutes ago                          kickass_swartz

Anything I did wrong? How can I troubleshoot this issue?


Docker container will automatically stop after &quot;docker run -d&quot;

I had multiple stopped containers and images in my machine.  
I wanted to clean up and removed all containers:  
`docker ps -a` returns nothing.  
I run `docker rmi $(docker images -q)` to remove the cached images but I get:  

&gt; Error response from daemon: conflict: unable to delete ...
&gt; (must be forced) - image is referenced in multiple repositories  

What repositories is it talking about?  

Can not remove images even though no container is running

I understand the difference between `export` (for containers) and `save` (for images). But at the end of the day the tarball produced by either save or export should be used as *an image*. 

So why are there 2 commands to make an image from a tarball?

What is the difference between import and load in Docker?

I am just looking at docker images in https://hub.docker.com/_/node/

For every version, the images are categorized into Alpine, Jessie, Stretch, Buster etc. What&#39;s their meaning?

In Docker image names what is the difference between Alpine, Jessie, Stretch, and Buster?

I am getting the below error while building an image

    Step 1/10 : FROM ubuntu:14.04
    Get https://registry-1.docker.io/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

Error &quot;Get https://registry-1.docker.io/v2/: net/http: request canceled&quot; while building image

In the docker world, one can easily see logs for docker container (that is, a running image). But during image creation, one usually issues multiple commands. For example npm install commands in node projects. It would be beneficial to see logs for those commands as well. I quickly searched from the documentation, but didn&#39;t find how one can obtain logs for docker image. Is it possible?

How to view logs for a docker image?

I try to locate one specific tag for a Docker image. How can I do it on the command line? I want to avoid downloading all the images and then removing the unneeded ones.

In the official Ubuntu release, https://registry.hub.docker.com/_/ubuntu/, there are several tags (release for it), while when I search it on the command line,

    user@ubuntu:~$ docker search ubuntu | grep ^ubuntu
    ubuntu              Official Ubuntu base image                          354
    ubuntu-upstart      Upstart is an event-based replacement for ...   7
    ubuntufan/ping                                                0
    ubuntu-debootstrap                                                   0

Also in the help of command line `search` https://docs.docker.com/engine/reference/commandline/search/, no clue how it can work?

Is it possible in the `docker search` command?

If I use a raw command to search via the [Docker registry API][1], then the information can be fetched:

       $ curl https://registry.hub.docker.com//v1/repositories/ubuntu/tags | python -mjson.tool
       [
        {
            &quot;layer&quot;: &quot;ef83896b&quot;,
            &quot;name&quot;: &quot;latest&quot;
        },
        .....
        {
            &quot;layer&quot;: &quot;463ff6be&quot;,
            &quot;name&quot;: &quot;raring&quot;
        },
        {
            &quot;layer&quot;: &quot;195eb90b&quot;,
            &quot;name&quot;: &quot;saucy&quot;
        },
        {
            &quot;layer&quot;: &quot;ef83896b&quot;,
            &quot;name&quot;: &quot;trusty&quot;
        }
    ]

  [1]: https://docs.docker.com/registry/spec/api/#tags



How can I find a Docker image with a specific tag in Docker registry on the Docker command line?

How are [Packer](https://packer.io) and [Docker](https://docker.com) different? Which one is easier/quickest to provision/maintain and why? What is the pros and cons of having a `dockerfile`?

How are Packer and Docker different? Which one should I prefer when provisioning images?

I&#39;m trying to run MULTIPLE commands like this.

    docker run image cd /path/to/somewhere &amp;&amp; python a.py

But this gives me &quot;No such file or directory&quot; error because it is interpreted as...

    &quot;docker run image cd /path/to/somewhere&quot; &amp;&amp; &quot;python a.py&quot;


It seems that some ESCAPE characters like &quot;&quot; or () are needed.

So I also tried 

    docker run image &quot;cd /path/to/somewhere &amp;&amp; python a.py&quot;
    docker run image (cd /path/to/somewhere &amp;&amp; python a.py)

but these didn&#39;t work.

I have searched for [Docker Run Reference][1] but have not find any hints about ESCAPE characters.

  [1]: https://docs.docker.com/reference/run/

All Docker Image Solutions on Gang of Coders

Total of 22 Docker Image Solutions