The checkpoints are similar files as the original notebooks but are only updated on a manual save. The original notebooks are updated with autosave and when manually saving (thanks @Thomas K). 

The question to you is if you want to share your manual saves with your collaborators. I prefer not to share those because git already provides the functionality to go back to an older version. 

Also, I use https://www.gitignore.io/ to create `.gitignore` files and according to them the checkpoints are temporary data.

I have docker-compose which fetches some of the images and builds one.
When I run `docker-compose up` , I am getting the following error 

 

&gt; **ERROR:** An HTTP request took too long to complete. Retry with --verbose
&gt; to obtain debug information. If you encounter this issue regularly
&gt; because of slow network conditions, consider setting
&gt; COMPOSE_HTTP_TIMEOUT to a higher value (current value: 60).

**Question:** How to pass the `COMPOSE_HTTP_TIMEOUT` with `docker-compose` command?

How to override the default value of COMPOSE_HTTP_TIMEOUT with docker-compose command

I’ve successfully used snowfall to setup a cluster on a single server with 16 processors.

    require(snowfall)
    if (sfIsRunning() == TRUE) sfStop()
    
    number.of.cpus &lt;- 15
    sfInit(parallel = TRUE, cpus = number.of.cpus)
    stopifnot( sfCpus() == number.of.cpus )
    stopifnot( sfParallel() == TRUE )
    
    # Print the hostname for each cluster member
    sayhello &lt;- function()
    {
        info &lt;- Sys.info()[c(&quot;nodename&quot;, &quot;machine&quot;)]
        paste(&quot;Hello from&quot;, info[1], &quot;with CPU type&quot;, info[2])
    }
    names &lt;- sfClusterCall(sayhello)
    print(unlist(names))

Now, I am looking for complete instructions on **how to move to a distributed model**. I have 4 different Windows machines with a total of 16 cores that I would like to use for a 16 node cluster. So far, I understand that I could manually setup a SOCK connection or leverage MPI. While it appears possible, I haven’t found clear and complete directions as to how.

**The SOCK route** appears to depend on code in a snowlib script. I can generate a stub from the master side with the following code:

    winOptions &lt;-
        list(host=&quot;172.01.01.03&quot;,
             rscript=&quot;C:/Program Files/R/R-2.7.1/bin/Rscript.exe&quot;,
             snowlib=&quot;C:/Rlibs&quot;)
    
    cl &lt;- makeCluster(c(rep(list(winOptions), 2)), type = &quot;SOCK&quot;, manual = T)

It yields the following:

    Manually start worker on 172.01.01.03 with
         &quot;C:/Program Files/R/R-2.7.1/bin/Rscript.exe&quot;
          C:/Rlibs/snow/RSOCKnode.R
          MASTER=Worker02 PORT=11204 OUT=/dev/null SNOWLIB=C:/Rlibs

It feels like a reasonable start. I found code for `RSOCKnode.R` on GitHub under the snow package:

    local({
        master &lt;- &quot;localhost&quot;
        port &lt;- &quot;&quot;
        snowlib &lt;- Sys.getenv(&quot;R_SNOW_LIB&quot;)
        outfile &lt;- Sys.getenv(&quot;R_SNOW_OUTFILE&quot;) ##**** defaults to &quot;&quot;; document
    
        args &lt;- commandArgs()
        pos &lt;- match(&quot;--args&quot;, args)
        args &lt;- args[-(1 : pos)]
        for (a in args) {
            pos &lt;- regexpr(&quot;=&quot;, a)
            name &lt;- substr(a, 1, pos - 1)
            value &lt;- substr(a,pos + 1, nchar(a))
            switch(name,
                   MASTER = master &lt;- value,
                   PORT = port &lt;- value,
                   SNOWLIB = snowlib &lt;- value,
                   OUT = outfile &lt;- value)
        }
    
        if (! (snowlib %in% .libPaths()))
            .libPaths(c(snowlib, .libPaths()))
        library(methods) ## because Rscript as of R 2.7.0 doesn&#39;t load methods
        library(snow)
    
        if (port == &quot;&quot;) port &lt;- getClusterOption(&quot;port&quot;)
    
        sinkWorkerOutput(outfile)
        cat(&quot;starting worker for&quot;, paste(master, port, sep = &quot;:&quot;), &quot;\n&quot;)
        slaveLoop(makeSOCKmaster(master, port))
    })

It’s not clear how to actually start a SOCK listener on the workers, unless it is buried in `snow::recvData`.

Looking into **the MPI route**, as far as I can tell, Microsoft MPI version 7 is a starting point. However, I could not find a Windows alternative for sfCluster. I was able to start the MPI service, but it does not appear to listen on port 22 and no amount of bashing against it with `snowfall::makeCluster` has yielded a result. I’ve disabled the firewall and tried testing with makeCluster and directly connecting to the worker from the master with PuTTY.

---

Is there a comprehensive, step-by-step guide to setting up a snowfall cluster on Windows workers that I’ve missed? I am fond of `snowfall::sfClusterApplyLB` and would like to continue using that, but if there is an easier solution, I’d be willing to change course. Looking into Rmpi and parallel, I found alternative solutions for the master side of the work, but still little to no specific detail on how to setup workers running Windows.

Due to the nature of the work environment, neither moving to AWS, nor Linux is an option.

Related questions without definitive answers for Windows worker nodes:

  * [How to set up cluster slave nodes (on Windows)](https://stackoverflow.com/q/22605238)
  * [Parallel R on a Windows cluster](https://stackoverflow.com/q/17547994)
  * [Create a cluster of co-workers&#39; Windows 7 PCs for parallel processing in R?](https://stackoverflow.com/q/15039039)

How to setup workers for parallel processing in R using snowfall and multiple Windows nodes?

As the title says: I&#39;m checking a Jupyter notebook into a GitHub repo, should I store the `.ipynb_checkpoints` folder in GitHub too, or are they best `.gitignore`d and kept locally?

I&#39;m not really sure what they are for, so I don&#39;t know whether to include them or not. 

Should ipynb checkpoints be stored in Git?

<p>As the title says: I'm checking a Jupyter notebook into a GitHub repo, should I store the <code>.ipynb_checkpoints</code> folder in GitHub too, or are they best <code>.gitignore</code>d and kept locally?</p>
<p>I'm not really sure what they are for, so I don't know whether to include them or not.</p>


I have two branches - A and B. B was created from A.

Work on both branches continued in parallel. Work on branch A was bad (resulting in a non-working version) while work on branch B was good. During this time branch B was sometimes merged into branch A (but not the other way around).

Now I want to make branch A identical to branch B. I can&#39;t use git revert because I need to revert too many commits - I only want to revert the commits that were done on branch A but not as a result of merging branch B.

The solution I found was to clone branch B into a another folder, delete all the files from the working folder of branch A, copy the files from the temp branch B folder and add all untracked files.

Is there a git command that does the same thing? Some git revert switch I missed?

Making two branches identical

Using `git branch --all` shows all *remote* and *local* branches. When does Git refresh this list?

On pull/push? And how do I refresh it using [Git Bash][1]?

  [1]: https://superuser.com/questions/1053633


When does Git refresh the list of remote branches?

##I&#39;m very confused about git-submodules.
Basically my problem is that I can&#39;t make git understand that `~/main-project/submodule` is a submodule.

--------
**I have good experience with git submodules:**&lt;br&gt;
in my [dotfiles repository][1] I created the .gitmodules file in `~/dotfiles-repo` and I added there paths and urls. Since then, If I make changes to the files within the submodules and run `git status`, I&#39;d get something like like: `.vim/bundle/auto-complete (new commits) # in red`

I created the `.gitmodules` file in `~/main-project` but:

 - If I make changes to `~/main-project/submodule` and even push the changes, I don&#39;t get a similar response like `&lt;submodule&gt; (new commits) # in red` when running `git status` in `~/main-project`. **I just get the changes that were made in those directories**
 - When I hit the folders&#39; links at `github` for these directories it&#39;s not directing me to the repositories themselves but I stay in the same repository.

 1. Maybe I&#39;m missing the whole point. What are the main features of submodules?
 2. Why does git understands the submodules in [the dotfiles repo][2] but not [in my other repo][3]?
 3. Is it because I have already told git to add the files inside `~/main-project/submodule` to the index?

I&#39;ve read [this question][4] which led me to [this answer][5] But I&#39;m not sure I need `git-subtree`. I don&#39;t want to do things that might do changes hard to be revert.

&gt; Edit: [This suggested duplicate-solution][6] didn&#39;t work either, I recieved an error that `Updates were rejected because the remote contains work that you do not have locally`. It seems that [@GabLeRoux][7] practically told me to push `&lt;repo-A&gt;` to the url of `&lt;repo-B&gt;`.


  [1]: https://github.com/Doron-Behar/dotfiles
  [2]: https://github.com/Doron-Behar/dotfiles/tree/master/.vim/bundle
  [3]: https://github.com/Doron-Behar/RFID-entry-permissions-sys
  [4]: https://stackoverflow.com/questions/1593620/how-to-make-part-of-an-existing-git-repository-a-submodule
  [5]: https://stackoverflow.com/questions/920165/howto-extract-a-git-subdirectory-and-make-a-submodule-out-of-it/1307969#1307969
  [6]: https://stackoverflow.com/questions/17413493/create-a-submodule-repository-from-a-folder-and-keep-its-git-commit-history
  [7]: https://stackoverflow.com/users/1092815/gableroux

How to make an existing directory within a git repository a git submodule

I want to create a public repo to put some sample files from my main repo (private). Is there any way to soft link few folders from a git repo to another git repo?

How to link folder from a git repo to another repo?

I need to open 2 Visual Studio instances: one will be to just look at the code of the Project X / Branch 1, and the other will be used to code in the Project X / Branch 2.

How can I do that without losing changes when committing? 

How to open 2 Visual Studio instances, with same Git projects and different branches

I created a table with an interactive slider that allows me to toggle between different periods on my table. It was working for the past few days, until today, when I re-ran the notebook, the slide bar doesn&#39;t show anymore. No error messages appear. The code seem to run just fine, as the table appears, but the slide bar just doesn&#39;t appear. I didn&#39;t change my code either, as I was working on a separate part of my notebook. 

I tried many approaches, including searching in this space but was still unable to come up with a solution. I was wondering if anyone faced a similar issue, and have any solution to this.

Below is my code snippet. Anything before was solely to get my data into the desired form for tabulation. 

    from IPython.display import display
    from ipywidgets import widgets, interactive
    v = interactive(by_q, quarter=([&#39;q1y2015&#39;, &#39;q2y2015&#39;, &#39;q3y2015&#39;, &#39;q4y2015&#39;]), days=(1, 180))
    display(v)


IPython Notebook ipywidgets does not show

I have made my plots inline on my Ipython Notebook with &quot;`%matplotlib inline`.&quot;

Now, the plot appears.  However, it is very small.  Is there a way to make it appear larger using either notebook settings or plot settings?

[![enter image description here][1]][1]


  [1]: http://i.stack.imgur.com/TiQum.png

How to make inline plots in Jupyter Notebook larger?

I am using jupyter-notebooks for python coding. Is there a way to wrap text/code in a jupyter notebook code cell?  

Picture provided below.

[![Text not wrapping][1]][1]


  [1]: http://i.stack.imgur.com/0fUai.png

By wrap text means &quot;how text is wrapped in MS-word&quot;

How to wrap code/text in Jupyter notebooks

In iPython Notebook, is it possible to disable the autoscrolling of long outputs? Or at least set a threshold for the output length before autoscrolling sets in?

Tried the following command 

    %%javascript
    IPython.OutputArea.auto_scroll_threshold = 9999;

but it gives an error

    Javascript error adding output!
    SyntaxError: Unexpected identifier
    See your browser Javascript console for more details.

Disable iPython Notebook Autoscrolling

I want to learn how to use Jupyter Notebook. So far, I have managed to download and install it (using pip), but I&#39;m having trouble opening it.

I am opening it by typing:

    jupyter notebook

in my terminal. It opens in my browser, with the URL:

    http://localhost:8888/tree

and I just get a big:

    500 : Internal Server Error

message. Could someone point me in the right direction of what&#39;s going wrong please?

The full error message in my terminal:

    [E 17:53:52.034 NotebookApp] Uncaught exception GET /tree (::1)
        HTTPServerRequest(protocol=&#39;http&#39;, host=&#39;localhost:8888&#39;, method=&#39;GET&#39;, uri=&#39;/tree&#39;, version=&#39;HTTP/1.1&#39;, remote_ip=&#39;::1&#39;, headers={&#39;Accept-Language&#39;: &#39;en-US,en;q=0.8,es;q=0.6&#39;, &#39;Accept-Encoding&#39;: &#39;gzip, deflate, sdch&#39;, &#39;Host&#39;: &#39;localhost:8888&#39;, &#39;Accept&#39;: &#39;text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8&#39;, &#39;User-Agent&#39;: &#39;Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.112 Safari/537.36&#39;, &#39;Connection&#39;: &#39;keep-alive&#39;, &#39;Upgrade-Insecure-Requests&#39;: &#39;1&#39;})
        Traceback (most recent call last):
          File &quot;/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/tornado/web.py&quot;, line 1443, in _execute
            result = method(*self.path_args, **self.path_kwargs)
          File &quot;/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/tornado/web.py&quot;, line 2800, in wrapper
            return method(self, *args, **kwargs)
          File &quot;/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/notebook/tree/handlers.py&quot;, line 50, in get
            terminals_available=self.settings[&#39;terminals_available&#39;],
          File &quot;/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/notebook/base/handlers.py&quot;, line 302, in render_template
            template = self.get_template(name)
          File &quot;/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/notebook/base/handlers.py&quot;, line 298, in get_template
            return self.settings[&#39;jinja2_env&#39;].get_template(name)
          File &quot;/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/Jinja2-2.6-py2.7.egg/jinja2/environment.py&quot;, line 719, in get_template
            return self._load_template(name, self.make_globals(globals))
          File &quot;/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/Jinja2-2.6-py2.7.egg/jinja2/environment.py&quot;, line 693, in _load_template
            template = self.loader.load(self, name, globals)
          File &quot;/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/Jinja2-2.6-py2.7.egg/jinja2/loaders.py&quot;, line 127, in load
            code = environment.compile(source, name, filename)
          File &quot;/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/Jinja2-2.6-py2.7.egg/jinja2/environment.py&quot;, line 493, in compile
            self.handle_exception(exc_info, source_hint=source)
          File &quot;/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/notebook/templates/tree.html&quot;, line 8, in template
            data-base-url=&quot;{{base_url | urlencode}}&quot;
        TemplateAssertionError: no filter named &#39;urlencode&#39;
    [E 17:53:52.819 NotebookApp] {
          &quot;Accept-Language&quot;: &quot;en-US,en;q=0.8,es;q=0.6&quot;,
          &quot;Accept-Encoding&quot;: &quot;gzip, deflate, sdch&quot;,
          &quot;Host&quot;: &quot;localhost:8888&quot;,
          &quot;Accept&quot;: &quot;text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8&quot;,
          &quot;User-Agent&quot;: &quot;Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.112 Safari/537.36&quot;,
          &quot;Connection&quot;: &quot;keep-alive&quot;,
          &quot;Upgrade-Insecure-Requests&quot;: &quot;1&quot;
        }
    [E 17:53:52.819 NotebookApp] 500 GET /tree (::1) 874.29ms referer=None

--------------------
EDIT

When attempting to update ipython as advised, the following error message was produced:

    Exception:
    Traceback (most recent call last):
      File &quot;/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/pip/basecommand.py&quot;, line 209, in main
        status = self.run(options, args)
      File &quot;/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/pip/commands/install.py&quot;, line 317, in run
        prefix=options.prefix_path,
      File &quot;/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/pip/req/req_set.py&quot;, line 732, in install
        **kwargs
      File &quot;/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/pip/req/req_install.py&quot;, line 835, in install
        self.move_wheel_files(self.source_dir, root=root, prefix=prefix)
      File &quot;/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/pip/req/req_install.py&quot;, line 1030, in move_wheel_files
        isolated=self.isolated,
      File &quot;/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/pip/wheel.py&quot;, line 247, in move_wheel_files
        prefix=prefix,
      File &quot;/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/pip/locations.py&quot;, line 142, in distutils_scheme
        i = d.get_command_obj(&#39;install&#39;, create=True)
      File &quot;/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/distutils/dist.py&quot;, line 845, in get_command_obj
        klass = self.get_command_class(command)
      File &quot;/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/setuptools/dist.py&quot;, line 430, in get_command_class
        self.cmdclass[command] = cmdclass = ep.load()
      File &quot;/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/pkg_resources/__init__.py&quot;, line 2229, in load
        return self.resolve()
      File &quot;/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/pkg_resources/__init__.py&quot;, line 2235, in resolve
        module = __import__(self.module_name, fromlist=[&#39;__name__&#39;], level=0)
    ImportError: No module named command.install

Content Type	Original Author	Original Content on Stackoverflow
Question	Richard	View Question on Stackoverflow
Solution 1 - Git	Pieter	View Answer on Stackoverflow

Should ipynb checkpoints be stored in Git?

Git Problem Overview

Git Solutions

Solution 1 - Git

How to setup workers for parallel processing in R using snowfall and multiple Windows nodes?

How to override the default value of COMPOSE_HTTP_TIMEOUT with docker-compose command

Attributions