Recently posted a question regarding the `HttpClient` over Https ([found here][1]).  I&#39;ve made some headway, but I&#39;ve run into new issues. As with my last problem, I can&#39;t seem to find an example anywhere that works for me. Basically, I want my client to accept any certificate (because I&#39;m only ever pointing to one server) but I keep getting a `javax.net.ssl.SSLException: Not trusted server certificate exception.`

So this is what I have:

```java
    
    public void connect() throws A_WHOLE_BUNCH_OF_EXCEPTIONS {

        HttpPost post = new HttpPost(new URI(PROD_URL));
    	post.setEntity(new StringEntity(BODY));
 
    	KeyStore trusted = KeyStore.getInstance(&quot;BKS&quot;);
    	trusted.load(null, &quot;&quot;.toCharArray());
    	SSLSocketFactory sslf = new SSLSocketFactory(trusted);
        sslf.setHostnameVerifier(SSLSocketFactory.ALLOW_ALL_HOSTNAME_VERIFIER);
	
    	SchemeRegistry schemeRegistry = new SchemeRegistry();
    	schemeRegistry.register(new Scheme (&quot;https&quot;, sslf, 443));
    	SingleClientConnManager cm = new SingleClientConnManager(post.getParams(),
                schemeRegistry);
		
    	HttpClient client = new DefaultHttpClient(cm, post.getParams());
    	HttpResponse result = client.execute(post);
    }
```

And here&#39;s the error I&#39;m getting:

```bash
    W/System.err(  901): javax.net.ssl.SSLException: Not trusted server certificate 
    W/System.err(  901): 	at org.apache.harmony.xnet.provider.jsse.OpenSSLSocketImpl.startHandshake(OpenSSLSocketImpl.java:360) 
    W/System.err(  901): 	at org.apache.http.conn.ssl.AbstractVerifier.verify(AbstractVerifier.java:92) 
    W/System.err(  901): 	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:321) 
    W/System.err(  901): 	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:129) 
    W/System.err(  901): 	at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:164) 
    W/System.err(  901): 	at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:119) 
    W/System.err(  901): 	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:348) 
    W/System.err(  901): 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:555) 
    W/System.err(  901): 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:487) 
    W/System.err(  901): 	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:465) 
    W/System.err(  901): 	at me.harrisonlee.test.ssl.MainActivity.connect(MainActivity.java:129) 
    W/System.err(  901): 	at me.harrisonlee.test.ssl.MainActivity.access$0(MainActivity.java:77) 
    W/System.err(  901): 	at me.harrisonlee.test.ssl.MainActivity$2.run(MainActivity.java:49) 
    W/System.err(  901): Caused by: java.security.cert.CertificateException: java.security.InvalidAlgorithmParameterException: the trust anchors set is empty 
    W/System.err(  901): 	at org.apache.harmony.xnet.provider.jsse.TrustManagerImpl.checkServerTrusted(TrustManagerImpl.java:157) 
    W/System.err(  901): 	at org.apache.harmony.xnet.provider.jsse.OpenSSLSocketImpl.startHandshake(OpenSSLSocketImpl.java:355) 
    W/System.err(  901): 	... 12 more 
    W/System.err(  901): Caused by: java.security.InvalidAlgorithmParameterException: the trust anchors set is empty 
    W/System.err(  901): 	at java.security.cert.PKIXParameters.checkTrustAnchors(PKIXParameters.java:645) 
    W/System.err(  901): 	at java.security.cert.PKIXParameters.&lt;init&gt;(PKIXParameters.java:89) 
    W/System.err(  901): 	at org.apache.harmony.xnet.provider.jsse.TrustManagerImpl.&lt;init&gt;(TrustManagerImpl.java:89) 
    W/System.err(  901): 	at org.apache.harmony.xnet.provider.jsse.TrustManagerFactoryImpl.engineGetTrustManagers(TrustManagerFactoryImpl.java:134) 
    W/System.err(  901): 	at javax.net.ssl.TrustManagerFactory.getTrustManagers(TrustManagerFactory.java:226)W/System.err(  901): 	at org.apache.http.conn.ssl.SSLSocketFactory.createTrustManagers(SSLSocketFactory.java:263) 
    W/System.err(  901): 	at org.apache.http.conn.ssl.SSLSocketFactory.&lt;init&gt;(SSLSocketFactory.java:190) 
    W/System.err(  901): 	at org.apache.http.conn.ssl.SSLSocketFactory.&lt;init&gt;(SSLSocketFactory.java:216) 
    W/System.err(  901): 	at me.harrisonlee.test.ssl.MainActivity.connect(MainActivity.java:107) 
    W/System.err(  901): 	... 2 more
```


  [1]: https://stackoverflow.com/questions/2603691/android-httpclient-and-https

Trusting all certificates using HttpClient over HTTPS

I have a simple class written in Android Studio:

    package com.mysite.myapp;
    
    import org.apache.http.client.HttpClient;
    
    public class Whatever {
        public void headBangingAgainstTheWallExample () {
            HttpClient client = new DefaultHttpClient();
        }
    }

and from this I get the following compile time error:

`Cannot resolve symbol HttpClient`

Isn&#39;t `HttpClient` included in the Android Studio SDK? Even if it is not, I added it to my Gradle build like this:

    dependencies {
        compile fileTree(dir: &#39;libs&#39;, include: [&#39;*.jar&#39;])
        compile &#39;com.android.support:appcompat-v7:23.0.0&#39;
        compile &#39;org.apache.httpcomponents:httpclient:4.5&#39;
    }

With or without the last compile line, the error is the same. What am I missing?

HttpClient won&#39;t import in Android Studio

I know there used to be a way to get it with Apache Commons as documented here:

http://hc.apache.org/httpclient-legacy/apidocs/org/apache/commons/httpclient/HttpMethod.html

...and an example here:

http://www.kodejava.org/examples/416.html

...but I believe this is deprecated.

Is there any other way to make an http get request in Java and get the response body as a string and not a stream? 


How can I get an HTTP response body as a string?

All I&#39;m trying to do is download some JSON and deserialize it into an object. I haven&#39;t got as far as downloading the JSON yet.

Almost every single HttpClient example I can find, including those on the apache site looks something like...

    import org.apache.http.client.HttpClient;
    import org.apache.http.impl.client.DefaultHttpClient;
    
    public void blah() {
        HttpClient client = new DefaultHttpClient();
        ...
    }

However, Netbeans tells me that `DefaultHttpClient` is deprecated. I&#39;ve tried googling for `DefaultHttpClient deprecated` and as many other variations as I can think of and can&#39;t find any useful results, so I&#39;m obviously missing something.

What is the correct Java7 way to download the contents of a webpage? Is there really no decent Http Client as part of the language? I find that hard to believe.

My Maven dependency for this is...

    &lt;dependency&gt;
        &lt;groupId&gt;org.apache.httpcomponents&lt;/groupId&gt;
        &lt;artifactId&gt;httpclient&lt;/artifactId&gt;
        &lt;version&gt;LATEST&lt;/version&gt;
        &lt;type&gt;jar&lt;/type&gt;
    &lt;/dependency&gt;


Deprecated Java HttpClient - How hard can it be?

How do I bypass invalid SSL certificate errors with Apache [HttpClient][1] 4.0?

  [1]: http://hc.apache.org/httpclient-3.x/


How to ignore SSL certificate errors in Apache HttpClient 4.0

I&#39;m trying to use `org.apache.httpcomponents` to consume a Rest API, which will post JSON format data to API.

I get this exception: 

&gt; Caused by: com.fasterxml.jackson.core.JsonParseException: Illegal
&gt; unquoted character ((CTRL-CHAR, code 10)): has to be escaped using
&gt; backslash to be included in string.

The reason is because `ctrl-char` is included in the JSON string.

Is there any way to replace this or some other solution? 

JsonParseException : Illegal unquoted character ((CTRL-CHAR, code 10)

I&#39;m studying an application developed by our company. It uses the Apache HttpClient library. In the source code it uses the `HttpClient` class to create instances to connect to a server. 

I want to learn about Apache HttpClient and I&#39;ve gone trough [this set of examples][1]. All the examples use `CloseableHttpClient` instead of `HttpClient`. So I think `CloseableHttpClient` is an extended version of `HttpClient`. If this is the case I have two questions:

- What is the difference between these two?
- Which class is recommended to use for my new development?

  [1]: http://hc.apache.org/httpcomponents-client-ga/examples.html


What is the difference between CloseableHttpClient and HttpClient in Apache HttpClient API?

I am using commons HttpClient to make an http call to a Spring servlet. I need to add a few parameters in the query string. So I do the following:

    HttpRequestBase request = new HttpGet(url);
    HttpParams params = new BasicHttpParams();
    params.setParameter(&quot;key1&quot;, &quot;value1&quot;);
    params.setParameter(&quot;key2&quot;, &quot;value2&quot;);
    params.setParameter(&quot;key3&quot;, &quot;value3&quot;);
    request.setParams(params);
    HttpClient httpClient = new DefaultHttpClient();
    httpClient.execute(request);

However when i try to read the parameter in the servlet using

    ((ServletRequestAttributes) RequestContextHolder.currentRequestAttributes()).getRequest().getParameter(&quot;key&quot;);

it returns null. In fact the parameterMap is completely empty. When I manually append the parameters to the url before creating the HttpGet request, the parameters are available in the servlet. Same when I hit the servlet from the browser using the URL with queryString appended. 

What&#39;s the error here? In httpclient 3.x, GetMethod had a setQueryString() method to append the querystring. What&#39;s the equivalent in 4.x?



commons httpclient - Adding query string parameters to GET/POST request

I&#39;m pretty green to HttpClient and I&#39;m finding the lack of (and or blatantly incorrect) documentation extremely frustrating.  I&#39;m trying to implement the following post (listed below) with Apache Http Client, but have no idea how to actually do it.  I&#39;m going to bury myself in documentation for the next week, but perhaps more experienced HttpClient coders could get me an answer sooner.

Post:

    Content-Type: multipart/form-data; boundary=---------------------------1294919323195
    Content-Length: 502
    -----------------------------1294919323195
    Content-Disposition: form-data; name=&quot;number&quot;
    
    5555555555
    -----------------------------1294919323195
    Content-Disposition: form-data; name=&quot;clip&quot;
    
    rickroll
    -----------------------------1294919323195
    Content-Disposition: form-data; name=&quot;upload_file&quot;; filename=&quot;&quot;
    Content-Type: application/octet-stream
    
    
    -----------------------------1294919323195
    Content-Disposition: form-data; name=&quot;tos&quot;
    
    agree
    -----------------------------1294919323195--

Apache HttpClient making multipart form post

I have a loop over a bunch of URLs, for each one I&#39;m doing the following:


    private String doQuery(String url) {

      HttpGet httpGet = new HttpGet(url);
      setDefaultHeaders(httpGet); // static method
      HttpResponse response = httpClient.execute(httpGet);   // httpClient instantiated in constructor

      int rc = response.getStatusLine().getStatusCode();
		
      if (rc != 200) {
        // some stuff...
        return;
      }
		
      HttpEntity entity = response.getEntity();
		
      if (entity == null) {
        // some stuff...
        return;
      }

      // process the entity, get input stream etc

    }

The first query is fine, the second throws this exception:

&gt; Exception in thread &quot;main&quot;
&gt; java.lang.IllegalStateException:
&gt; Invalid use of
&gt; SingleClientConnManager: connection
&gt; still allocated. Make sure to release
&gt; the connection before allocating
&gt; another one. 	at
&gt; org.apache.http.impl.conn.SingleClientConnManager.getConnection(SingleClientConnManager.java:199)
&gt; 	at
&gt; org.apache.http.impl.conn.SingleClientConnManager$1.getConnection(SingleClientConnManager.java:173)......


This is just a simple single-threaded app. How can I release this connection?

HttpClient 4.0.1 - how to release connection?

I want to write the body of a request with XML content-type but I don&#39;t know how with HttpClient Object ( http://hc.apache.org/httpclient-3.x/apidocs/index.html )

    DefaultHttpClient httpClient = new DefaultHttpClient();
    HttpPost httpRequest = new HttpPost(this.url);
    httpRequest.setHeader(&quot;Content-Type&quot;, &quot;application/xml&quot;);

And I don&#39;t know how to continue to write the body with my XML ...

Write in body request with HttpClient

Performing millions of HTTP requests with different Java libraries gives me threads hanged on:

`java.net.SocketInputStream.socketRead0()`

Which is `native` function.

I tried to set up Apche Http Client and `RequestConfig` to have timeouts on  (I hope) everythig that is possible but still, **I have (probably infinite) hangs on `socketRead0`. How to get rid of them?**

Hung ratio is about ~1 per 10000 requests (to 10000 different hosts) and it can last probably forever (I&#39;ve confirmed thread hung as still valid after 10 hours).

JDK 1.8 on Windows 7.

My `HttpClient` factory:

    SocketConfig socketConfig = SocketConfig.custom()
                .setSoKeepAlive(false)
                .setSoLinger(1)
                .setSoReuseAddress(true)
                .setSoTimeout(5000)
                .setTcpNoDelay(true).build();

        HttpClientBuilder builder = HttpClientBuilder.create();
        builder.disableAutomaticRetries();
        builder.disableContentCompression();
        builder.disableCookieManagement();
        builder.disableRedirectHandling();
        builder.setConnectionReuseStrategy(new NoConnectionReuseStrategy());
        builder.setDefaultSocketConfig(socketConfig);

        return HttpClientBuilder.create().build();

My `RequestConfig` factory:

        HttpGet request = new HttpGet(url);

        RequestConfig config = RequestConfig.custom()
                .setCircularRedirectsAllowed(false)
                .setConnectionRequestTimeout(8000)
                .setConnectTimeout(4000)
                .setMaxRedirects(1)
                .setRedirectsEnabled(true)
                .setSocketTimeout(5000)
                .setStaleConnectionCheckEnabled(true).build();
        request.setConfig(config);

        return new HttpGet(url);

[OpenJDK `socketRead0` source][1]

Note: Actually I have some &quot;trick&quot; - I can schedule `.getConnectionManager().shutdown()` in other `Thread` with cancellation of `Future` if request finished properly, but it is depracated and also it kills whole `HttpClient`, not only that single request.


  [1]: http://hg.openjdk.java.net/jdk8/jdk8/jdk/file/687fd7c7986d/src/windows/native/java/net/SocketInputStream.c

How to prevent hangs on SocketInputStream.socketRead0 in Java?

I am trying to get Apache HttpClient to fire an HTTP request, and then display the HTTP response code (200, 404, 500, etc.) as well as the HTTP response body (text string). It is important to note that I am using `v4.2.2` because most HttpClient examples out there are from `v.3.x.x` and the API changed greatly from version 3 to version 4.

Unfortunately I&#39;ve only been able to get HttpClient returning the status code **or** the response body (but not both).

Here&#39;s what I have:

    // Getting the status code.
    HttpClient client = new DefaultHttpClient();
    HttpGet httpGet = new HttpGet(&quot;http://whatever.blah.com&quot;);
    HttpResponse resp = client.execute(httpGet);

    int statusCode = resp.getStatusLine().getStatusCode();


    // Getting the response body.
    HttpClient client = new DefaultHttpClient();
    HttpGet httpGet = new HttpGet(&quot;http://whatever.blah.com&quot;);
    ResponseHandler&lt;String&gt; handler = new BasicResponseHandler();

    String body = client.execute(httpGet, handler);

So I ask: **Using the `v4.2.2` library, how can I obtain both status code and response body from the same `client.execute(...)` call?** Thanks in advance!

How to get HttpClient returning status code and response body?

Is there a way to specify a timeout for the whole execution of [`HttpClient`][1]?

I have tried the following:

&lt;!-- language: java --&gt;

    httpClient.getParams().setParameter(&quot;http.socket.timeout&quot;, timeout * 1000);
    httpClient.getParams().setParameter(&quot;http.connection.timeout&quot;, timeout * 1000);
    httpClient.getParams().setParameter(&quot;http.connection-manager.timeout&quot;, new Long(timeout * 1000));
    httpClient.getParams().setParameter(&quot;http.protocol.head-body-timeout&quot;, timeout * 1000);

It actually works fine, except if a remote host sends back data - even at one byte/second - it will continue to read forever! But I want to interrupt the connection in 10 seconds max, whether or not the host responds.


  [1]: http://hc.apache.org/httpcomponents-client-ga/index.html

Apache HttpClient timeout

First of all, I&#39;m not trying to start a flame-war here. I know Jersey sufficiently well, but have hardly used httpclient.

What are the key differences between jersey-client and Apache&#39;s httpclient? In what areas is one better than the other? Is there a good comparison chart somewhere? Which one performs better with larger files (say 2048 MB)?

Many thanks for your comments!



How do Jersey-client and Apache HTTP Client compare?

    public HttpClientVM() {
    
        BasicHttpParams params = new BasicHttpParams();
        ConnManagerParams.setMaxTotalConnections(params, 10);
        HttpProtocolParams.setVersion(params, HttpVersion.HTTP_1_1);
        HttpProtocolParams.setUseExpectContinue(params, false);
        HttpConnectionParams.setStaleCheckingEnabled(params, true);
        HttpConnectionParams.setConnectionTimeout(params, 30000);
        HostnameVerifier hostnameVerifier=
              org.apache.http.conn.ssl.SSLSocketFactory.ALLOW_ALL_HOSTNAME_VERIFIER;
        HttpsURLConnection.setDefaultHostnameVerifier(hostnameVerifier);
        SSLSocketFactory socketFactory = SSLSocketFactory.getSocketFactory();
        socketFactory.setHostnameVerifier((X509HostnameVerifier) hostnameVerifier);
        SchemeRegistry schemeRegistry = new SchemeRegistry();
        schemeRegistry.register(new Scheme(&quot;http&quot;,socketFactory, 80));
        schemeRegistry.register(new Scheme(&quot;https&quot;,socketFactory, 443));
    		ThreadSafeClientConnManager manager = new ThreadSafeClientConnManager(params, schemeRegistry);
    		// Set verifier     
    		client = new DefaultHttpClient(manager, params);	
    	}

**Problem:**

When executing `client.accessURL(url)`, the following error occurs:

    Exception in thread &quot;main&quot; javax.net.ssl.SSLPeerUnverifiedException: peer not authenticated
    	at com.sun.net.ssl.internal.ssl.SSLSessionImpl.getPeerCertificates(SSLSessionImpl.java:352)
    	at org.apache.http.conn.ssl.AbstractVerifier.verify(AbstractVerifier.java:128)
    	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:397)
    	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:495)
    	at org.apache.http.conn.scheme.SchemeSocketFactoryAdaptor.connectSocket(SchemeSocketFactoryAdaptor.java:62)
    	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:148)
    	at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:150)
    	at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:121)
    	at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:575)
    	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:425)
    	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820)
    	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
    	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732)

***Additional information:***

- Window 7
- HttpClient 4

Exception : javax.net.ssl.SSLPeerUnverifiedException: peer not authenticated

I have rather simple HttpClient 4 code that calls HttpGet to get HTML output. The HTML returns with scripts and image locations all set to local (e.g. `&lt;img src=&quot;/images/foo.jpg&quot;/&gt;`) so I need calling URL to make these into absolute (`&lt;img src=&quot;http://foo.com/images/foo.jpg&quot;/&gt;`) Now comes the problem - during the call there may be one or two 302 redirects so the original URL is no longer reflects the location of HTML. 

How do I get the latest URL of the returned content given all the redirects I may (or may not) have?

I looked at `HttpGet#getAllHeaders()` and `HttpResponse#getAllHeaders()` - couldn&#39;t find anything.

Edited: `HttpGet#getURI()` returns original calling address

All Apache Httpclient-4.x Solutions on Gang of Coders

Total of 17 Apache Httpclient-4.x Solutions