If you need to resume an scp transfer **from local to remote**, try with rsync:

    rsync --partial --progress --rsh=ssh local_file user@host:remote_file

Short version, as [pointed out by @aurelijus-rozenas][1]: 

    rsync -P -e ssh local_file user@host:remote_file

[1]: https://stackoverflow.com/a/20860920/537554#comment-38527478

In general the order of args for rsync is

    rsync [options] SRC DEST

This is all you need.

     rsync -e ssh file host:/directory/.

Is it possible to attach the IntelliJ IDEA debugger to a running Java process? If yes, how?

Attach IntelliJ IDEA debugger to a running Java process

So nothing new here I am just trying to get some clarification and cannot seem to find any in other posts.

I am creating a new resource restulfully, say:

    /books (POST)

with a body:

    {
      title: &#39;The Lion, the Witch and the Wardrobe&#39;,
      author: &#39;C. S. Lewis&#39;
    }

I know that I should return a 201 (Created) with a Location header of the new resource:

    Location: /books/12345

The question I cannot seem to answer for myself is what should the server return in the body.

I have often done this type of response:

    {
      id: 12345,
      title: &#39;The Lion, the Witch and the Wardrobe&#39;,
      author: &#39;C. S. Lewis&#39;
    }

I have done this for a couple reasons:

 1. I have written api for front end frameworks like angularjs.  In my
    particular case I am using angular resources and I often need just
    the id for the resource to locate it.  If I did not return the id in
    the response body I would need to parse it out of the Location
    header.
 2. In a GET of all books I usually return the entire object not just
    the id.  In this sense my client code does not have to differentiate
    where to get the id from (location header or body).

Now I know I am really in the grey area here, but most people are saying that returning the entire resource is &#39;bad&#39; practice.  But what if the server changes/adds information to the resource.  It definitely adds the id, but might also add other things like a timestamp.  In the case that I do not return the entire resource, is it really better to do a POST, return the id, then have the client perform a GET to get the new resource.


&#39;Best&#39; practice for restful POST response

I am copying 7.5 GB file to a remote server using *scp* command. At some point in time file transfer breaks and I have to start all over again.

Is the temporary amount of file being transferred completely lost ? Can I somehow restart the transfer from where it has stopped at previous attempt ? If not, is there some standard Unix command line file transfer command for doing that ?

Is there a way to continue broken scp (secure copy) command process in Linux?

I am copying 7.5 GB file to a remote server using scp command. At some point in time file transfer breaks and I have to start all over again.
Is the temporary amount of file being transferred completely lost ? Can I somehow restart the transfer from where it has stopped at previous attempt ? If not, is there some standard Unix command line file transfer command for doing that ?

With a `find` command, I can display directories names with multiple levels. The following command display all directories under `/var` path with a depth of 2:

    find /var -maxdepth 2 -type d;

The result shows:

    /var
    /var/log
    /var/log/sssd
    /var/log/samba
    /var/log/audit
    /var/log/ConsoleKit
    /var/log/gdm
    /var/log/sa

With a `stat` command, I can find the modified date time:

    stat /var/log/samba | grep &#39;Modify:&#39;

The result is:

    Modify: 2014-01-02 11:21:27.762346214 -0800 

Is there a way to combine the two commands so that directories will be listed with modified date time?

How to display modified date time with &#39;find&#39; command?

To count the number of files in a directory, I typically use

    ls directory | wc -l

But is there another command that doesn&#39;t use `wc` ?

Count number of files within a directory in Linux?

I have begun to combine different commands in the linux terminal. I am wondering why the backslash and semicolon are required for a command such as:

    find ./ -name &#39;blabla&#39; -exec cp {} ./test \;

when a simple cp command is simply:

    cp randomfile ./test

without the `\;`

Are they to clearly indicate the end of a command, or is it simply required in the documentation? What is the underlying principle?

Why are the backslash and semicolon required with the find command&#39;s -exec option?

I installed Neo4j on Ubuntu 12.04 using these instructions: http://www.neo4j.org/download/linux

    wget -O - http://debian.neo4j.org/neotechnology.gpg.key | apt-key add - 
    echo &#39;deb http://debian.neo4j.org/repo stable/&#39; &gt; /etc/apt/sources.list.d/neo4j.list
    apt-get update
    apt-get install neo4j

I made sure to have the right jdk:

    root@precise64:~# java -version
    java version &quot;1.7.0_45&quot;
    Java(TM) SE Runtime Environment (build 1.7.0_45-b18)
    Java HotSpot(TM) 64-Bit Server VM (build 24.45-b08, mixed mode)

And when I startup neo4j I get this error:

&gt; WARNING: Max 1024 open files allowed, minimum of 40 000 recommended.
&gt; See the Neo4j manual.

So I follow the instructions here: http://docs.neo4j.org/chunked/1.6.2/configuration-linux-notes.html

And add these contents to `/etc/security/limits.conf`

    neo4j   soft    nofile  40000
    neo4j   hard    nofile  40000

And uncomment this line in `/etc/pam.d/su`

    session    required   pam_limits.so

After I restart the server I validate the new limit

    neo4j@precise64:~$ ulimit -n
    40000

Then I restart my server.  I still get the same error when starting up.  

    root@precise64:~# service neo4j-service start
    WARNING: Max 1024 open files allowed, minimum of 40 000 recommended. See the Neo4j manual.
    Using additional JVM arguments:  -server -XX:+DisableExplicitGC -Dorg.neo4j.server.properties=conf/neo4j-server.properties -Djava.util.logging.config.file=conf/logging.properties -Dlog4j.configuration=file:conf/log4j.properties -XX:+UseConcMarkSweepGC -XX:+CMSClassUnloadingEnabled
    Starting Neo4j Server...WARNING: not changing user
    process [3161]... waiting for server to be ready....... OK.
    http://localhost:7474/ is ready.

Even though the service is running as the neo4j user:

    root@precise64:~# ps -ef | grep 3161
    neo4j     3161     1  2 17:43 pts/0    00:00:10 /usr/bin/java -cp /var/lib/neo4j/lib/concurrentlinkedhashmap-lru-1.3.1.jar:/var/lib/neo4j/lib/geronimo-jta_1.1_spec-1.1.1.jar:/var/lib/neo4j/lib/lucene-core-3.6.2.jar:/var/lib/neo4j/lib/neo4j-cypher-2.0.0.jar:/var/lib/neo4j/lib/neo4j-cypher-commons-2.0.0.jar:/var/lib/neo4j/lib/neo4j-cypher-compiler-1.9-2.0.0.jar:/var/lib/neo4j/lib/neo4j-cypher-compiler-2.0-2.0.0.jar:/var/lib/neo4j/lib/neo4j-graph-algo-2.0.0.jar:/var/lib/neo4j/lib/neo4j-graph-matching-2.0.0.jar:/var/lib/neo4j/lib/neo4j-jmx-2.0.0.jar:/var/lib/neo4j/lib/neo4j-kernel-2.0.0.jar:/var/lib/neo4j/lib/neo4j-lucene-index-2.0.0.jar:/var/lib/neo4j/lib/neo4j-shell-2.0.0.jar:/var/lib/neo4j/lib/neo4j-udc-2.0.0.jar:/var/lib/neo4j/lib/org.apache.servicemix.bundles.jline-0.9.94_1.jar:/var/lib/neo4j/lib/parboiled-core-1.1.6.jar:/var/lib/neo4j/lib/parboiled-scala_2.10-1.1.6.jar:/var/lib/neo4j/lib/scala-library-2.10.3.jar:/var/lib/neo4j/lib/server-api-2.0.0.jar:/var/lib/neo4j/system/lib/asm-3.1.jar:/var/lib/neo4j/system/lib/bcprov-jdk16-140.jar:/var/lib/neo4j/system/lib/commons-beanutils-1.8.0.jar:/var/lib/neo4j/system/lib/commons-beanutils-core-1.8.0.jar:/var/lib/neo4j/system/lib/commons-collections-3.2.1.jar:/var/lib/neo4j/system/lib/commons-compiler-2.6.1.jar:/var/lib/neo4j/system/lib/commons-configuration-1.6.jar:/var/lib/neo4j/system/lib/commons-digester-1.8.1.jar:/var/lib/neo4j/system/lib/commons-io-1.4.jar:/var/lib/neo4j/system/lib/commons-lang-2.4.jar:/var/lib/neo4j/system/lib/commons-logging-1.1.1.jar:/var/lib/neo4j/system/lib/jackson-core-asl-1.9.7.jar:/var/lib/neo4j/system/lib/jackson-jaxrs-1.9.7.jar:/var/lib/neo4j/system/lib/jackson-mapper-asl-1.9.7.jar:/var/lib/neo4j/system/lib/janino-2.6.1.jar:/var/lib/neo4j/system/lib/javax.servlet-3.0.0.v201112011016.jar:/var/lib/neo4j/system/lib/jcl-over-slf4j-1.6.1.jar:/var/lib/neo4j/system/lib/jersey-core-1.9.jar:/var/lib/neo4j/system/lib/jersey-multipart-1.9.jar:/var/lib/neo4j/system/lib/jersey-server-1.9.jar:/var/lib/neo4j/system/lib/jetty-http-9.0.5.v20130815.jar:/var/lib/neo4j/system/lib/jetty-io-9.0.5.v20130815.jar:/var/lib/neo4j/system/lib/jetty-security-9.0.5.v20130815.jar:/var/lib/neo4j/system/lib/jetty-server-9.0.5.v20130815.jar:/var/lib/neo4j/system/lib/jetty-servlet-9.0.5.v20130815.jar:/var/lib/neo4j/system/lib/jetty-util-9.0.5.v20130815.jar:/var/lib/neo4j/system/lib/jetty-webapp-9.0.5.v20130815.jar:/var/lib/neo4j/system/lib/jetty-xml-9.0.5.v20130815.jar:/var/lib/neo4j/system/lib/jsr311-api-1.1.2.r612.jar:/var/lib/neo4j/system/lib/logback-access-1.0.9.jar:/var/lib/neo4j/system/lib/logback-classic-1.0.9.jar:/var/lib/neo4j/system/lib/logback-core-1.0.9.jar:/var/lib/neo4j/system/lib/mimepull-1.6.jar:/var/lib/neo4j/system/lib/neo4j-browser-2.0.0.jar:/var/lib/neo4j/system/lib/neo4j-server-2.0.0-static-web.jar:/var/lib/neo4j/system/lib/neo4j-server-2.0.0.jar:/var/lib/neo4j/system/lib/rhino-1.7R3.jar:/var/lib/neo4j/system/lib/rrd4j-2.0.7.jar:/var/lib/neo4j/system/lib/slf4j-api-1.6.2.jar:/var/lib/neo4j/conf/ -server -XX:+DisableExplicitGC -Dorg.neo4j.server.properties=conf/neo4j-server.properties -Djava.util.logging.config.file=conf/logging.properties -Dlog4j.configuration=file:conf/log4j.properties -XX:+UseConcMarkSweepGC -XX:+CMSClassUnloadingEnabled -Dneo4j.home=/var/lib/neo4j -Dneo4j.instance=/var/lib/neo4j -Dfile.encoding=UTF-8 org.neo4j.server.Bootstrapper
    root      3238  2056  0 17:49 pts/0    00:00:00 grep --color=auto 3161

So I think that maybe starting the service as root is the issue, so I shut it down and start it up as the neo4j user.

    root@precise64:~# service neo4j-service stop
    root@precise64:~# su - neo4j 
    neo4j@precise64:~$ service neo4j-service start
    Using additional JVM arguments:  -server -XX:+DisableExplicitGC -    Dorg.neo4j.server.properties=conf/neo4j-server.properties -Djava.util.logging.config.file=conf/logging.properties -Dlog4j.configuration=file:conf/log4j.properties -XX:+UseConcMarkSweepGC -XX:+CMSClassUnloadingEnabled
    Starting Neo4j Server...WARNING: not changing user
    process [3435]... waiting for server to be ready....... OK.
    http://localhost:7474/ is ready.
    cp: cannot create regular file `/var/run/neo4j.pid&#39;: Permission denied

And it fails because the pid file cannot be created.  Which I assume means this is not the correct approach, but I go ahead and edit `/etc/init.d/neo4j-service` to change the location of the pid file to the home folder of the neo4j user:

    #PIDFILE=/var/run/$NAME.pid
    PIDFILE=/var/lib/neo4j/$Name.pid

And then things startup without error when I run the service as the Neo4j user.  

So, my question is:  What is the intended behavior? Should starting the service as root work as long as the neo4j user has the correct ulimit permissions, or do I need to modify the startup script/permissions to allow the neo4j user to create it&#39;s PID file?


   







Neo4j WARNING: Max 1024 open files allowed, minimum of 40 000 recommended. See the Neo4j manual

The code bases I work with are checked out from Git repositories onto my Linux machine. Since our production code is written to be deployed on Linux, I do all the testing on my Linux machine but like to use Windows for everyday usage, including code editing/authoring. 

For that purpose, I have created a **Samba share** of the folder (my home folder) where I checkout the code to, like this:

    [wgrover]
        path = /home/wgrover
        available = yes
        valid users = wgrover
        read only = no
        browsable = yes
        public = yes
        writable = yes

However, when I edit a file from the samba share `\\linux-box\wgrover` in Windows, **the file permission in Linux keeps changing to `755` even though it was `644` before editing**. 

This keeps showing up in my `git diff` like this:

    diff --git a/debian/maggie.nginx.conf b/debian/maggie.nginx.conf
    old mode 100644
    new mode 100755
    index 7cda506..7eab574

It is possible to set a `create mask` in smb.conf but that will also not  &quot;preserve&quot; the original file permissions. I can ignore file mode changes in git by setting `fileMode = false` in `.gitconfig` but that also ignores the problem.

***Is there any way to preserve the file permissions when they are modified from linux?***

preserving file permissions for samba shares when file is edited

I created key pair using `puttygen.exe` (client is windows 8). On server (Ubuntu 12.04.3 LTS), I have put my public key in `~/.ssh/authorized_keys`. The public key is this:

    ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAopfM6RHOgnuc4Aftn3t4k5UIAT3StCAbn/vg/IMbphbXadshC+79sIlRq3P4zGzMjFTP4hKnzu6ehLV5lmj/qorq3SKT+bPO5Qrac3VbIlrGvuBFDDjP82I2Hwg3HzlsFTstqk++KToapaTYZ7jENEYyPl2wnzITJnt//+4U1o6juoXTKgdNE02hHnRZyHOV/bnkZyJJCEwJv5U0eXSThQnhmXtUxGT8U0HQNFiXfqIIVllhWiCnyrhhIaKz/CIJNAd2VmzyJzQtJtTQX8aWSNVrZju6Sv2/RncTNvsACdNgjjh/FH8PQXaep00jlJ3MOdsC8vz6VSPFbh6iKy1oLQ== rsa-key-20131231

So it&#39;s correct (one line, no comments, starts with ssh-rsa, etc.)

`.ssh` dir permission level is 700, authorized_keys file permission is 600. Both directory and file owned by the actual user that I try to log in. 

When I try connecting I&#39;m getting `&#39;server refused our key&#39;` and server asks for password. That&#39;s all. Nothing is logged to `/var/log/auth.log` when attempting to log in with the key. 

I&#39;ve looked everywhere and all articles and tips mention setting chmod 600 and 700 for the file/directory and formatting the key correctly. I&#39;ve done all this still getting &#39;refused our key&#39; error and I&#39;m out of ideas.

Putty: Getting Server refused our key Error

I&#39;m looking for a way to disable SSH clients from accessing the password prompt as noted [here][1].

I am unable to disable the `password:` prompt for *root login*. I have change the `sshd_config` file to read:

    ChallengeResponseAuthentication no
    PasswordAuthentication no
    UsePAM no

and have also changed the permissions `chmod 700 ~/.ssh` and `chmod 600 ~/.ssh/authorized_keys`. What am I missing? Does this require I have a passphrase?

Verbose dump:

    debug1: Authentications that can continue: publickey,password
    debug1: Next authentication method: publickey
    debug1: Offering RSA public key: /home/user/.ssh/id_rsa
    debug1: Authentications that can continue: publickey,password
    debug1: Trying private key: /home/user/.ssh/id_dsa
    debug1: Trying private key: /home/user/.ssh/id_ecdsa
    debug1: Next authentication method: password

### File /etc/ssh/sshd_config:

    # Package generated configuration file
    # See the sshd_config(5) manpage for details

    # What ports, IPs and protocols we listen for
    Port 22
    # Use these options to restrict which interfaces/protocols sshd will bind to
    #ListenAddress ::
    #ListenAddress 0.0.0.0
    Protocol 2
    # HostKeys for protocol version 2
    HostKey /etc/ssh/ssh_host_rsa_key
    HostKey /etc/ssh/ssh_host_dsa_key
    HostKey /etc/ssh/ssh_host_ecdsa_key
    #Privilege Separation is turned on for security
    UsePrivilegeSeparation yes

    # Lifetime and size of ephemeral version 1 server key
    KeyRegenerationInterval 3600
    ServerKeyBits 768

    # Logging
    SyslogFacility AUTH
    LogLevel INFO

    # Authentication:
    LoginGraceTime 120
    PermitRootLogin no
    StrictModes yes

    RSAAuthentication yes
    PubkeyAuthentication yes
    #AuthorizedKeysFile    %h/.ssh/authorized_keys

    # Don&#39;t read the user&#39;s ~/.rhosts and ~/.shosts files
    IgnoreRhosts yes
    # For this to work you will also need host keys in /etc/ssh_known_hosts
    RhostsRSAAuthentication no
    # similar for protocol version 2
    HostbasedAuthentication no
    # Uncomment if you don&#39;t trust ~/.ssh/known_hosts for RhostsRSAAuthentication
    #IgnoreUserKnownHosts yes

    # To enable empty passwords, change to yes (NOT RECOMMENDED)
    PermitEmptyPasswords no

    # Change to yes to enable challenge-response passwords (beware issues with
    # some PAM modules and threads)
    ChallengeResponseAuthentication no

    # Change to no to disable tunnelled clear text passwords
    #PasswordAuthentication no

    # Kerberos options
    #KerberosAuthentication no
    #KerberosGetAFSToken no
    #KerberosOrLocalPasswd yes
    #KerberosTicketCleanup yes

    # GSSAPI options
    #GSSAPIAuthentication no
    #GSSAPICleanupCredentials yes

    X11Forwarding yes
    X11DisplayOffset 10
    PrintMotd no
    PrintLastLog yes
    TCPKeepAlive yes
    #UseLogin no

    #MaxStartups 10:30:60
    Banner /etc/issue.net

    # Allow client to pass locale environment variables
    AcceptEnv LANG LC_*

    Subsystem sftp /usr/lib/openssh/sftp-server

    # Set this to &#39;yes&#39; to enable PAM authentication, account processing,
    # and session processing. If this is enabled, PAM authentication will
    # be allowed through the ChallengeResponseAuthentication and
    # PasswordAuthentication.  Depending on your PAM configuration,
    # PAM authentication via ChallengeResponseAuthentication may bypass
    # the setting of &quot;PermitRootLogin without-password&quot;.
    # If you just want the PAM account and session checks to run without
    # PAM authentication, then enable this but set PasswordAuthentication
    # and ChallengeResponseAuthentication to &#39;no&#39;.
    UsePAM no

  [1]: https://help.ubuntu.com/community/SSH/OpenSSH/Configuring











Disable password authentication for SSH

I&#39;ve been somewhat &#39;putting up&#39; with Github always asking for my username and password when I clone a repository.  I want to bypass this step because it is an annoyance within my workflow. 

I tried setting up an SSH key (which I successfully did) using this guide. https://help.github.com/articles/generating-ssh-keys and I was successful.  

My problem is that I am still asked for my github password and passphrase when cloning a repository (using SSH).  My understanding was that after I set up this SSH key, I would no longer have to do that.

I am a little unsure what to ask, so I will just state my goal.  

&gt;_I want to be able to clone repositories without having to put in my Github information all the time_.

What am I missing with my SSH key? If anyone can provide some guidance or resources I would appreciate it, because I&#39;ve always felt a little lost when it came to SSH authentication in GitHub.

From my knowledge, this is a command that tests if things are working properly, here are the output from my console:

    ~ $ ssh -T git@github.com
    Saving password to keychain failed
    Enter passphrase for key &#39;/Users/MYNAME/.ssh/id_rsa&#39;:
    Hi MYNAME! You&#39;ve successfully authenticated, but GitHub does not provide shell access.

When I input my password, should that fail first? Then, when I enter my passphrase, it passes.

SSH Key - Still asking for password and passphrase

I have created two GitHub accounts.  One for my work user and one for my personal self.  I needed to do catch up on some work and as such cloned my work repo onto my personal PC.  In order to do simple &quot;git push origin master&quot; commits without entering my username and password the whole time I simply want to add my public key from my home pc to the work repo.  However Github gives this error:

    Error: Key already use

After a bit of Googling I came across this [link][1] which states &quot;To resolve the issue, remove the key from the other account or repository and add it to your account&quot;  Of course there is a duplicate key as I&#39;ve added my home public key to github so that I can code on my own personal projects. After all I want to be able to code to my work repo using both my work pc and personal pc.

How can you add multiple &quot;same&quot; public keys without Github throwing that error and also why in the world, is that error thrown in the first place?


  [1]: https://help.github.com/articles/error-key-already-in-use

GitHub Error: Key already in use

I&#39;m getting the standard 

    WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED!
    IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY!
    Someone could be eavesdropping on you right now (man-in-the-middle attack)!
    It is also possible that the RSA host key has just been changed.
    The fingerprint for the RSA key sent by the remote host is

error message. However, the system (Appworx) that executes the command (sftp I think, not that it matters) is automated and I can&#39;t easily accept the new key, even after checking with the third party vendor that it is a valid change. I can add a new shell script that I can execute from the same system (and user), but there doesn&#39;t seem to be a command or command-line argument that will tell ssh to accept the key. I can&#39;t find anything in the man page or on Google. Surely this is possible?



How can I force ssh to accept a new host fingerprint from the command line?

How does one list all locally installed NuGet packages?

Is there a NuGet equivalent of `RPM -qa`? Within [Chocolatey][1] there is the `chocolatey list -localonly`, but for the life of me I cannot find the NuGet equivalent of that command.

  [1]: https://en.wikipedia.org/wiki/NuGet#Chocolatey



How do I list all installed NuGet packages?

I have the Atom editor and was wondering how you can open a file or folder from the terminal in Atom. I am using a Mac. I am looking for a way to do this:

    atom . (opens folder)
    
    atom file.js (opens file)
    
    atom (opens editor)

Is this possible and how do I set it up?


How can I open the Atom editor from the command line in OS X?

When I try to run a script that contains the envsubst command, I get this error. Looking online, this seems to be a standard bash command, so I am not sure what to install in order to get it to work.

envsubst: command not found on Mac OS X 10.8

I&#39;m a newcomer to Go. I extremely like the language, but I quickly realised that I needed to start dividing my files due to an increase in program size. 

`go run main.go` (with main.go having been the file with my main() function)

didn&#39;t work and I hit a barrier for a while, because I had no clue how to get my program working. 

Some quick searching lead me to the answer of

`go run main.go other.go ..` 

where by typing all the files that my `package main` consists of, I could get the programming running. However, this is utterly cumbersome and frustrating to do each time.

I write the following self-answered question in order to prevent others like myself who may again hit this barrier.

How to run all .go files within current directory through the command line (multi file package)

I have a profile __activated by default__ in my maven setting file __~/.m2/settings.xml__.

Is it possible to deactivate it from the command line by doing something like this:

    mvn -P!profileActivatedByDefault

Content Type	Original Author	Original Content on Stackoverflow
Question	Matko	View Question on Stackoverflow
Solution 1 - Linux	Tom McClure	View Answer on Stackoverflow
Solution 2 - Linux	DigitalRoss	View Answer on Stackoverflow

Is there a way to continue broken scp (secure copy) command process in Linux?

Linux Problem Overview

Linux Solutions

Solution 1 - Linux

Solution 2 - Linux

'Best' practice for restful POST response

Attach IntelliJ IDEA debugger to a running Java process

Attributions