You can use the argument `list.len`:

    str(df, list.len=ncol(df))

and if you want to print more observations you could set the argument `vec.len`, also have a look at `?str` for documentation of all arguments.


By using argument list.len one can choose the number of variables in the data frame to list. There are two options:

a) You choose the number of variables that you want to list;

    str(df, list.len = 602) # in this case I&#39;m listing 602 variables.

b) You choose to list the total number of variables of the data frame (as mentioned by user1981275);

    str(df, list.len = ncol(df))

Check R help for more info

    &gt; ?str

Just to add, if you want to change the default of `str()` parameter  `list.len` which is set to 99, use 

`options(str = strOptions(list.len = 9999))`

then `str(df)` will show all of the variables at once without truncation.

I am trying to get the inner text of HTML string, using a JS function(the string is passed as an argument). Here is the code:

&lt;!-- begin snippet: js hide: false console: true babel: false --&gt;

&lt;!-- language: lang-js --&gt;

    function extractContent(value) {
      var content_holder = &quot;&quot;;

      for (var i = 0; i &lt; value.length; i++) {
        if (value.charAt(i) === &#39;&gt;&#39;) {
          continue;
          while (value.charAt(i) != &#39;&lt;&#39;) {
            content_holder += value.charAt(i);
          }
        }

      }
      console.log(content_holder);
    }

    extractContent(&quot;&lt;p&gt;Hello&lt;/p&gt;&lt;a href=&#39;http://w3c.org&#39;&gt;W3C&lt;/a&gt;&quot;);

&lt;!-- end snippet --&gt;

The problem is that nothing gets printed on the `console(*content_holder* stays empty)`. I think the problem is caused by the `===` operator.



Extract the text out of HTML string using JavaScript

I&#39;m using `Spring data jpa repositories`, Got a requirement to give search feature with different fields. Entering fields before search is optional.I have 5 fields say `EmployeeNumber`, `Name`, `Married`,`Profession` and `DateOfBirth`.  
Here i need to query only with the given values by user and other fields should be ignored.Ex,

    Input : EmployeeNumber: ,Name:St,Married: ,Professsion:IT,DateOfBirth: 
    Query : Select * from Employee e where Name like &#39;St%&#39; and Profession like &#39;IT%&#39;;  
  
    Input : EmployeeNumber:10,Name: ,Married: ,Professsion:IT,DateOfBirth:
    Query : Select * from Employee e where EmployeeNumber like &#39;10%&#39; and Profession like &#39;IT%&#39;;  
So here we are considering values entered and querying. In this case, Spring data is having a limitation as mentioned in [this post][1] (**Not scalable and all possible queries should be written**) 
I&#39;m using `Querydsl`, but still the problem exists as `null` fields should be ignored and almost all possible queries need to be developed. In this `case 31 queries`.
what if search fields are `6,7,8...` ??

**What is the best approach to implement search option with optional fields ?**



  [1]: http://blog.credera.com/technology-insights/java/can-querydsl-part-1-enhance-simplify-existing-spring-data-jpa-repositories/

Dynamic spring data jpa repository query with arbitrary AND clauses

I have a data.frame `df` with 600+ variables.  I&#39;m writing a function that automates the creation of columns and need to visually check them once.

The `str` function provides a good summary: 

    str(df)
    &#39;data.frame&#39;:	29 obs. of  602 variables:
     $ uniqueSessionsIni: POSIXct, format: &quot;2015-01-05 15:00:00&quot; &quot;2015-01-05 16:00:00&quot; &quot;2015-01-05 17:00:00&quot; ...
     $ uniqueSessionsEnd: POSIXct, format: &quot;2015-01-05 15:59:00&quot; &quot;2015-01-05 16:59:00&quot; &quot;2015-01-05 17:59:00&quot; ...
     $ m0p0             : POSIXct, format: &quot;2015-01-05 15:00:00&quot; &quot;2015-01-05 15:00:00&quot; &quot;2015-01-05 15:00:00&quot; ...
     $ m1p0             : POSIXct, format: &quot;2015-01-05 15:01:00&quot; &quot;2015-01-05 15:01:00&quot; &quot;2015-01-05 15:01:00&quot; ...
     $ m2p0             : POSIXct, format: &quot;2015-01-05 15:02:00&quot; &quot;2015-01-05 15:02:00&quot; &quot;2015-01-05 15:02:00&quot; ...    

and it goes on...  
but truncates the output, as below:

    $ m33p1            : POSIXct, format: &quot;2015-01-05 15:34:00&quot; &quot;2015-01-05 15:34:00&quot; &quot;2015-01-05 15:34:00&quot; ...
    $ m34p1            : POSIXct, format: &quot;2015-01-05 15:35:00&quot; &quot;2015-01-05 15:35:00&quot; &quot;2015-01-05 15:35:00&quot; ...
    $ m35p1            : POSIXct, format: &quot;2015-01-05 15:36:00&quot; &quot;2015-01-05 15:36:00&quot; &quot;2015-01-05 15:36:00&quot; ...
    $ m36p1            : POSIXct, format: &quot;2015-01-05 15:37:00&quot; &quot;2015-01-05 15:37:00&quot; &quot;2015-01-05 15:37:00&quot; ...
    [list output truncated]
How can I display the full list of 602 variables?

list output truncated - How to expand listed variables with str() in R

I have a data.frame <code>df</code> with 600+ variables. I'm writing a function that automates the creation of columns and need to visually check them once.
The <code>str</code> function provides a good summary:
<pre><code class="hljs language-python">str(df)
'data.frame':	29 obs. of 602 variables:
 $ uniqueSessionsIni: POSIXct, format: "2015-01-05 15:00:00" "2015-01-05 16:00:00" "2015-01-05 17:00:00" ...
 $ uniqueSessionsEnd: POSIXct, format: "2015-01-05 15:59:00" "2015-01-05 16:59:00" "2015-01-05 17:59:00" ...
 $ m0p0 : POSIXct, format: "2015-01-05 15:00:00" "2015-01-05 15:00:00" "2015-01-05 15:00:00" ...
 $ m1p0 : POSIXct, format: "2015-01-05 15:01:00" "2015-01-05 15:01:00" "2015-01-05 15:01:00" ...
 $ m2p0 : POSIXct, format: "2015-01-05 15:02:00" "2015-01-05 15:02:00" "2015-01-05 15:02:00" ... 
</code></pre>
and it goes on... 
but truncates the output, as below:
<pre><code class="hljs language-lua">$ m33p1 : POSIXct, format: "2015-01-05 15:34:00" "2015-01-05 15:34:00" "2015-01-05 15:34:00" ...
$ m34p1 : POSIXct, format: "2015-01-05 15:35:00" "2015-01-05 15:35:00" "2015-01-05 15:35:00" ...
$ m35p1 : POSIXct, format: "2015-01-05 15:36:00" "2015-01-05 15:36:00" "2015-01-05 15:36:00" ...
$ m36p1 : POSIXct, format: "2015-01-05 15:37:00" "2015-01-05 15:37:00" "2015-01-05 15:37:00" ...
[list output truncated]
</code></pre>
How can I display the full list of 602 variables?

I have a quite long title in a rmarkdown document and I would like to force a line break in a specific position.

Minimum example:

    ---
    title: &quot;Quite long title want the * line break at the asterisk&quot;
    output: html_document
    ---

I have tried: \n, \newline, \\\\ and a manual line break. None of them seem to work.

I believe it has to be quite straightforward but I haven&#39;t been able to find a solution.





How can I force a line break in rmarkdown&#39;s title?

So we are used to say to every R new user that &quot;*`apply` isn&#39;t vectorized, check out the Patrick Burns [R Inferno](http://www.burns-stat.com/pages/Tutor/R_inferno.pdf) Circle 4*&quot; which says (I quote):

&gt; A common reflex is to use a function in the apply family. **This is not**
&gt; **vectorization, it is loop-hiding**. The apply function has a for loop in
&gt; its definition. The lapply function buries the loop, but execution
&gt; times tend to be roughly equal to an explicit for loop.

Indeed, a quick look on the `apply` source code reveals the loop:

    grep(&quot;for&quot;, capture.output(getAnywhere(&quot;apply&quot;)), value = TRUE)
    ## [1] &quot;        for (i in 1L:d2) {&quot;  &quot;    else for (i in 1L:d2) {&quot;

Ok so far, but a look at `lapply` or `vapply` actually reveals a completely different picture:

    lapply
    ## function (X, FUN, ...) 
    ## {
    ##     FUN &lt;- match.fun(FUN)
    ##     if (!is.vector(X) || is.object(X)) 
    ##        X &lt;- as.list(X)
    ##     .Internal(lapply(X, FUN))
    ## }
    ## &lt;bytecode: 0x000000000284b618&gt;
    ## &lt;environment: namespace:base&gt;

So apparently there is no R `for` loop hiding there, rather they are calling internal C written function. 

A quick look in the [rabbit](https://github.com/wch/r-source/blob/trunk/src/main/names.c#L627-L630) [hole](https://github.com/wch/r-source/blob/trunk/src/main/apply.c#L34) reveals pretty much the same picture

Moreover, let&#39;s take the `colMeans` function for example, which was never accused in not being vectorised

    colMeans
    # function (x, na.rm = FALSE, dims = 1L) 
    # {
    #   if (is.data.frame(x)) 
    #     x &lt;- as.matrix(x)
    #   if (!is.array(x) || length(dn &lt;- dim(x)) &lt; 2L) 
    #     stop(&quot;&#39;x&#39; must be an array of at least two dimensions&quot;)
    #   if (dims &lt; 1L || dims &gt; length(dn) - 1L) 
    #     stop(&quot;invalid &#39;dims&#39;&quot;)
    #   n &lt;- prod(dn[1L:dims])
    #   dn &lt;- dn[-(1L:dims)]
    #   z &lt;- if (is.complex(x)) 
    #     .Internal(colMeans(Re(x), n, prod(dn), na.rm)) + (0+1i) * 
    #     .Internal(colMeans(Im(x), n, prod(dn), na.rm))
    #   else .Internal(colMeans(x, n, prod(dn), na.rm))
    #   if (length(dn) &gt; 1L) {
    #     dim(z) &lt;- dn
    #     dimnames(z) &lt;- dimnames(x)[-(1L:dims)]
    #   }
    #   else names(z) &lt;- dimnames(x)[[dims + 1]]
    #   z
    # }
    # &lt;bytecode: 0x0000000008f89d20&gt;
    #   &lt;environment: namespace:base&gt;

Huh? It also just calls `.Internal(colMeans(...` which we can also find in the [rabbit hole](https://github.com/wch/r-source/blob/trunk/src/main/names.c#L731). So how is this different from `.Internal(lapply(..`?

Actually a quick benchmark reveals that `sapply` performs no worse than `colMeans` and much better than a `for` loop for a big data set

    m &lt;- as.data.frame(matrix(1:1e7, ncol = 1e5))
    system.time(colMeans(m))
    # user  system elapsed 
    # 1.69    0.03    1.73 
    system.time(sapply(m, mean))
    # user  system elapsed 
    # 1.50    0.03    1.60 
    system.time(apply(m, 2, mean))
    # user  system elapsed 
    # 3.84    0.03    3.90 
    system.time(for(i in 1:ncol(m)) mean(m[, i]))
    # user  system elapsed 
    # 13.78    0.01   13.93 

In other words, is it correct to say that `lapply` and `vapply` **are actually vectorised** (compared to `apply` which is a `for` loop that also calls `lapply`) and what did Patrick Burns really mean to say?


Is the &quot;*apply&quot; family really not vectorized?

I know that in Shiny Server Pro there is a function of password control.
The question is that Shiny has function passwordInput(), which is like textInput()
Has anybody thought about how to do the following:

1) Launching the application only after correct password input
2) Launching the part of application after correct password input (for example, I have some tabs in shinydashboard, and I want to make an acces to one of them only by password)

Thanks!

Starting Shiny app after password input

What&#39;s the difference between `doParallel` and `doMC` in R concerning `foreach` function? `doParallel` supports windows, unix-like, while `doMC` supports unix-like only. In other words, why `doParallel` cannot replace `doMC` directly? Thank you.


Update:
`doParallel` is built on `parallel`, which is essentially a merger of `multicore` and `snow` and automatically uses the appropriate tool for your system. As a result, we can use `doParallel` to support multi systems. In other words, we can use `doParallel` to replace `doMC`.

ref: http://michaeljkoontz.weebly.com/uploads/1/9/9/4/19940979/parallel.pdf

BTW, what is the difference between `registerDoParallel(ncores=3)` and 

    cl &lt;- makeCluster(3)
    registerDoParallel(cl)


It seems `registerDoParallel(ncores=3)` can stop cluster automatically, while the second do not stop automatically and needs `stopCluster(cl)`.

ref: http://cran.r-project.org/web/packages/doParallel/vignettes/gettingstartedParallel.pdf



the difference between doMC and doParallel in R

I want to select multiple columns based on their names with a *regex* expression. I am trying to do it with the piping syntax of the `dplyr` package. I checked the other topics, but only found answers about a single string.

With base R:

    library(dplyr)    
    mtcars[grepl(&#39;m|ar&#39;, names(mtcars))]
    ###                      mpg am gear carb
    ### Mazda RX4           21.0  1    4    4
    ### Mazda RX4 Wag       21.0  1    4    4

However it doesn&#39;t work with the select/contains way:

    mtcars %&gt;% select(contains(&#39;m|ar&#39;))
    ### data frame with 0 columns and 32 rows

What&#39;s wrong?


select columns based on multiple strings with dplyr contains()

I&#39;ve two pandas data frames that have some rows in common.

Suppose dataframe2 is a subset of dataframe1.

**How can I get the rows of dataframe1 which are not in dataframe2?**

    df1 = pandas.DataFrame(data = {&#39;col1&#39; : [1, 2, 3, 4, 5], &#39;col2&#39; : [10, 11, 12, 13, 14]}) 
    df2 = pandas.DataFrame(data = {&#39;col1&#39; : [1, 2, 3], &#39;col2&#39; : [10, 11, 12]})

df1

       col1  col2
    0     1    10
    1     2    11
    2     3    12
    3     4    13
    4     5    14

df2

       col1  col2
    0     1    10
    1     2    11
    2     3    12

Expected result:

       col1  col2
    3     4    13
    4     5    14



pandas get rows which are NOT in other dataframe

I have a column in my dataframe like this:

    range
    &quot;(2,30)&quot;
    &quot;(50,290)&quot;
    &quot;(400,1000)&quot;
    ... 

and I want to replace the `,` comma with `-` dash. I&#39;m currently using this method but nothing is changed. 

    org_info_exc[&#39;range&#39;].replace(&#39;,&#39;, &#39;-&#39;, inplace=True)

Can anybody help?


How to replace text in a string column of a Pandas dataframe?

Looking at the new spark DataFrame API, it is unclear whether it is possible to modify dataframe columns.

How would I go about changing a value in row `x` column `y` of a dataframe?

In `pandas` this would be:
```
df.ix[x,y] = new_value
```

**Edit**: Consolidating what was said below, you can&#39;t modify the existing dataframe as it is immutable, but you can return a new dataframe with the desired modifications.

If you just want to replace a value in a column based on a condition, like `np.where`:

    from pyspark.sql import functions as F
    
    update_func = (F.when(F.col(&#39;update_col&#39;) == replace_val, new_value)
                    .otherwise(F.col(&#39;update_col&#39;)))
    df = df.withColumn(&#39;new_column_name&#39;, update_func)


If you want to perform some operation on a column and create a new column that is added to the dataframe:

    import pyspark.sql.functions as F
    import pyspark.sql.types as T

    def my_func(col):
        do stuff to column here
        return transformed_value

    # if we assume that my_func returns a string
    my_udf = F.UserDefinedFunction(my_func, T.StringType())

    df = df.withColumn(&#39;new_column_name&#39;, my_udf(&#39;update_col&#39;))

If you want the new column to have the same name as the old column, you could add the additional step:

    df = df.drop(&#39;update_col&#39;).withColumnRenamed(&#39;new_column_name&#39;, &#39;update_col&#39;)

Updating a dataframe column in spark

I&#39;m trying to apply a function to all rows of a pandas DataFrame (actually just one column in that DataFrame)

I&#39;m sure this is a syntax error but I&#39;m know sure what I&#39;m doing wrong

    df[&#39;col&#39;].apply(lambda x, y:(x - y).total_seconds(), args=[d1], axis=1)

The `col` column contains a bunch a `datetime.datetime` objects and and `d1` is the earliest of them.  I&#39;m trying to get a column of the total number of seconds for each of the rows

**EDIT** I keep getting the following error

    TypeError: &lt;lambda&gt;() got an unexpected keyword argument &#39;axis&#39;

I don&#39;t understand why `axis` is getting passed to my `lambda` function

**EDIT 2**

I&#39;ve also tried doing

    def diff_dates(d1, d2):
        return (d1-d2).total_seconds()

    df[&#39;col&#39;].apply(diff_dates, args=[d1], axis=1)

And I get the same error

Trouble passing in lambda to apply for pandas DataFrame

I am working with this Pandas DataFrame in Python.

    File    heat	Farheit	Temp_Rating
       1    YesQ	     75		    N/A
       1    NoR	        115		    N/A
       1    YesA	     63		    N/A
       1    NoT	         83		     41
       1    NoY	        100   		 80
       1    YesZ	     56		     12
       2    YesQ	    111		    N/A
       2    NoR    	     60	        N/A
       2    YesA	     19	        N/A
       2    NoT	        106	         77
       2    NoY    	     45     	 21
       2    YesZ	     40		     54
       3    YesQ	     84		    N/A
       3    NoR	         67		    N/A
       3    YesA	     94		    N/A
       3    NoT	         68		     39
       3    NoY    	     63		     46
       3    YesZ	     34		     81

I need to replace all NaNs in the `Temp_Rating` column with the value from the `Farheit` column.

This is what I need:

    File        heat	Temp_Rating
       1        YesQ	         75
       1	     NoR            115
       1	    YesA	         63
       1	    YesQ	         41
       1	     NoR             80
       1	    YesA	         12
       2	    YesQ	        111
       2	     NoR             60
       2	    YesA	         19
       2	     NoT   	         77
       2	     NoY             21
       2	    YesZ	         54
       3	    YesQ	         84
       3    	 NoR             67
       3	    YesA	         94
       3	     NoT             39
       3	     NoY             46
       3	    YesZ	         81

If I do a Boolean selection, I can pick out only one of these columns at a time. The problem is if I then try to join them, I am not able to do this while preserving the correct order.

How can I only find `Temp_Rating` rows with the `NaN`s and replace them with the value in the same row of the `Farheit` column?

Python Pandas replace NaN in one column with value from corresponding row of second column

I have build errors in my Xcode project (Objective-C), and I no longer &quot;stumble upon&quot; the build command string nor the build output logs. This is Xcode 6.3.1.

All I can inspect is a left-side panel listing errors/warnings.

I want the build command and build console output to compare between two projects; there&#39;s a platform-specific issue present in one but not the other; my intuition says that the build settings are different between the two and that seeing the output would be the easiest way to identify the diff.

How do I get to see the build command string, and, the build output logs in this xcode?

Xcode - how to see build command and log?

Is it possible instruct cURL to suppress output of response body?

In my case, the response body is an HTML page, which overflows the CLI buffer, making it difficult to find the relevant information. I want to examine the other parts of the output such as HTTP response code, headers, e.t.c. - everything *except* the actual HTML.

cURL suppress response body

I want to do some simple logging for my server which is a small Flask app running in a Docker container.

Here is the Dockerfile

    # Dockerfile
    FROM dreen/flask
    MAINTAINER dreen
    WORKDIR /srv

    # Get source
    RUN mkdir -p /srv
    COPY perfektimprezy.tar.gz /srv/perfektimprezy.tar.gz
    RUN tar x -f perfektimprezy.tar.gz
    RUN rm perfektimprezy.tar.gz

    # Run server
    EXPOSE 80
    CMD [&quot;python&quot;, &quot;index.py&quot;, &quot;1&gt;server.log&quot;, &quot;2&gt;server.log&quot;]

As you can see on the last line I redirect stderr and stdout to a file. Now I run this container and shell into it

    docker run -d -p 80:80 perfektimprezy
    docker exec -it &quot;... id of container ...&quot; bash

And observe the following things:

The server is running and the website working

There is no `/srv/server.log`

`ps aux | grep python` yields:

    root         1  1.6  3.2  54172 16240 ?        Ss   13:43   0:00 python index.py 1&gt;server.log 2&gt;server.log
    root        12  1.9  3.3 130388 16740 ?        Sl   13:43   0:00 /usr/bin/python index.py 1&gt;server.log 2&gt;server.log
    root        32  0.0  0.0   8860   388 ?        R+   13:43   0:00 grep --color=auto python

But there are no logs... HOWEVER, if I `docker attach` to the container I can see the app generating output in the console.

How do I properly redirect stdout/err to a file when using Docker?

Redirecting command output in docker

Does anyone know how to create multiple output paths in a webpack.config.js file? I&#39;m using bootstrap-sass which comes with a few different font files, etc. For webpack to process these i&#39;ve included file-loader which is working correctly, however the files it outputs are being saved to the output path i specified for the rest of my files: 

&lt;!-- language: lang-js --&gt;

        output: {
          path: __dirname + &quot;/js&quot;,
          filename: &quot;scripts.min.js&quot;
        }

I&#39;d like to achieve something where I can maybe look at the extension types for whatever webpack is outputting and for things ending in .woff .eot, etc, have them diverted to a different output path. Is this possible? 

I did a little googling and came across this *issue on github where a couple of solutions are offered, **edit:** 

but it looks as if you need to know the entry point in able to specify an output using the hash method 
eg: 

&lt;!-- language: lang-js --&gt;

    var entryPointsPathPrefix = &#39;./src/javascripts/pages&#39;;
    var WebpackConfig = {
      entry : {
        a: entryPointsPathPrefix + &#39;/a.jsx&#39;,
        b: entryPointsPathPrefix + &#39;/b.jsx&#39;,
        c: entryPointsPathPrefix + &#39;/c.jsx&#39;,
        d: entryPointsPathPrefix + &#39;/d.jsx&#39;
      },
    
      // send to distribution
      output: {
        path: &#39;./dist/js&#39;,
        filename: &#39;[name].js&#39;
      }
    }


*https://github.com/webpack/webpack/issues/1189

however in my case, as far as the font files are concerned, the input process is kind of abstracted away and all i know is the output. in the case of my other files undergoing transformations, there&#39;s a known point where i&#39;m requiring them in to be then handled by my loaders. if there was a way of finding out where this step was happening, i could then use the hash method to customize output paths, but i don&#39;t know where these files are being required in. 

How to create multiple output paths in Webpack config

It&#39;s possible to send data from the parent to a child through @Input, or to call a method on the parent from the child with @Output, but I&#39;d like to do exactly the other way around, which is calling a method on the child from the parent. Basically something like that:

&lt;!-- language: typescript --&gt;

    @Component({
      selector: &#39;parent&#39;,
      directives: [Child],
      template: `
    &lt;child
      [fn]=&quot;parentFn&quot;
    &gt;&lt;/child&gt;
    `
    })
    class Parent {
      constructor() {
        this.parentFn()
      }
      parentFn() {
        console.log(&#39;Parent triggering&#39;)
      }
    }

and the child:

&lt;!-- language: typescript --&gt;

    @Component({
      selector: &#39;child&#39;,
      template: `...`
    })
    class Child {
      @Input()
      fn() {
        console.log(&#39;triggered from the parent&#39;)
      }

      constructor() {}
    }

Background is a kind of &quot;get&quot; request, i.e. for getting an up-to-date status from the child.

Now I know I could achieve that with a service and Subject/Observable, but I was wondering whether there is not something more straightforward?

Content Type	Original Author	Original Content on Stackoverflow
Question	jpinelo	View Question on Stackoverflow
Solution 1 - R	user1981275	View Answer on Stackoverflow
Solution 2 - R	jpinelo	View Answer on Stackoverflow
Solution 3 - R	Matthew Son	View Answer on Stackoverflow

list output truncated - How to expand listed variables with str() in R

R Problem Overview

R Solutions

Solution 1 - R

Solution 2 - R

Solution 3 - R

Dynamic spring data jpa repository query with arbitrary AND clauses

Extract the text out of HTML string using JavaScript

Attributions