Use [`drop_duplicates`](http://pandas.pydata.org/pandas-docs/stable/generated/pandas.DataFrame.drop_duplicates.html) with specifying column `COL2` for check duplicates:

    df = df.drop_duplicates(&#39;COL2&#39;)
    #same as
    #df = df.drop_duplicates(&#39;COL2&#39;, keep=&#39;first&#39;)
    print (df)
        COL1  COL2
    0  a.com    22
    1  b.com    45
    2  c.com    34
    4  f.com    56

You can also keep only last values:

    df = df.drop_duplicates(&#39;COL2&#39;, keep=&#39;last&#39;)
    print (df)
        COL1  COL2
    2  c.com    34
    4  f.com    56
    5  g.com    22
    6  h.com    45

Or remove all duplicates:

    df = df.drop_duplicates(&#39;COL2&#39;, keep=False)
    print (df)
        COL1  COL2
    2  c.com    34
    4  f.com    56

You can use `groupby` in combination with `first` and `last` methods.
To get the first row from each group:

    df.groupby(&#39;COL2&#39;, as_index=False).first()

Output:

       COL2   COL1
    0    22  a.com
    1    34  c.com
    2    45  b.com
    3    56  f.com

To get the last row from each group:

    df.groupby(&#39;COL2&#39;, as_index=False).last()

Output:

       COL2   COL1
    0    22  g.com
    1    34  c.com
    2    45  h.com
    3    56  f.com



I&#39;m new to Jenkins pipeline; I&#39;m defining a declarative syntax pipeline and I don&#39;t know if I can solve my problem, because I didn&#39;t find a solution.

In this example, I need to pass a variable to ansible plugin (in old version I use an ENV_VAR or injecting it from file with inject plugin) that variable comes from a script.

This is my perfect scenario (but it doesn&#39;t work because environment{}):

    pipeline {
      agent { node { label &#39;jenkins-node&#39;}}

      stages {
        stage(&#39;Deploy&#39;) {
          environment {
            ANSIBLE_CONFIG = &#39;${WORKSPACE}/chimera-ci/ansible/ansible.cfg&#39;
            VERSION = sh(&quot;python3.5 docker/get_version.py&quot;)
          }
          steps {
            ansiblePlaybook credentialsId: &#39;example-credential&#39;, extras: &#39;-e version=${VERSION}&#39;, inventory: &#39;development&#39;, playbook: &#39;deploy.yml&#39;
          }
        }
      }
    }

I tried other ways to test how env vars work in other post, example:

    pipeline {
      agent { node { label &#39;jenkins-node&#39;}}

      stages {
        stage(&#39;PREPARE VARS&#39;) {
          steps {
            script {
              env[&#39;VERSION&#39;] = sh(script: &quot;python3.5 get_version.py&quot;)
            }
            echo env.VERSION
          }
        }
      }
    }

but &quot;echo env.VERSION&quot; return null.

Also tried the same example with:
- VERSION=`python3.5 get_version.py`
- VERSION=`python3.5 get_version.py` &gt; props.file (and try to inject it, but didnt found how)

If this is not possible I will do it in the ansible role.


**UPDATE**

There is another &quot;issue&quot; in Ansible Plugin, to use vars in extra vars it must have double quotes instead of single.

    ansiblePlaybook credentialsId: &#39;example-credential&#39;, extras: &quot;-e version=${VERSION}&quot;, inventory: &#39;development&#39;, playbook: &#39;deploy.yml&#39;


Jenkinsfile Declarative Pipeline defining dynamic env vars

I&#39;m trying to connect to a MySQL database from Symfony 3 application. But when trying to create MySQL schema from a Symfony console command I get this error: `PDO::__construct(): Server sent charset (255) unknown to the client. Please, report to the developers`

Both PHP and MySQL are running in Docker containers.

MySQL version: `8.0.1`

PHP version: `7.1.3`

Driver: `pdo_mysql`

charset: `UTF8`

dsn: `&quot;mysql:host=mysql;dbname=database;charset=UTF8;&quot;`

Any ideas?

PDO::__construct(): Server sent charset (255) unknown to the client. Please, report to the developers

How can I get the rows by distinct values in `COL2`?

For example, I have the dataframe below:

    COL1   COL2
    a.com  22
    b.com  45
    c.com  34
    e.com  45
    f.com  56
    g.com  22
    h.com  45

I want to get the rows based on unique values in `COL2`:

    COL1  COL2
    a.com 22
    b.com 45
    c.com 34
    f.com 56

So, how can I get that? I would appreciate it very much if anyone can provide any help.

Get rows based on distinct values from one column

How can I get the rows by distinct values in <code>COL2</code>?
For example, I have the dataframe below:
<pre><code class="hljs language-css">COL1 COL2
a.com 22
b.com 45
c.com 34
e.com 45
f.com 56
g.com 22
h.com 45
</code></pre>
I want to get the rows based on unique values in <code>COL2</code>:
<pre><code class="hljs language-css">COL1 COL2
a.com 22
b.com 45
c.com 34
f.com 56
</code></pre>
So, how can I get that? I would appreciate it very much if anyone can provide any help.

Is there an easy way to run a Python file inside Visual Studio Code with arguments?

I know I can add a custom configuration in the `launch.json` file with the `args` keyword. However, it is annoying to modify the *launch.json* file every time just because I want to use different arguments.




Visual Studio Code: run Python file with arguments

I have a directory `apkmirror-scraper-compose` with the following structure:

    .
    ├── docker-compose.yml
    ├── privoxy
    │&#160;&#160; ├── config
    │&#160;&#160; └── Dockerfile
    ├── scraper
    │&#160;&#160; ├── Dockerfile
    │&#160;&#160; ├── newnym.py
    │&#160;&#160; └── requirements.txt
    └── tor
        └── Dockerfile

I&#39;m trying to run the following `docker-compose.yml`:

    version: &#39;3&#39;
    
    services:
      privoxy:
        build: ./privoxy
        ports:
          - &quot;8118:8118&quot;
        links:
          - tor
    
      tor:
        build:
          context: ./tor
          args:
            password: &quot;&quot;
        ports:
          - &quot;9050:9050&quot;
          - &quot;9051:9051&quot;
    
      scraper:
        build: ./scraper
        links:
          - tor
          - privoxy

where the `Dockerfile` for `tor` is

    FROM alpine:latest
    EXPOSE 9050 9051
    ARG password
    RUN apk --update add tor
    RUN echo &quot;ControlPort 9051&quot; &gt;&gt; /etc/tor/torrc
    RUN echo &quot;HashedControlPassword $(tor --quiet --hash-password $password)&quot; &gt;&gt; /etc/tor/torrc
    CMD [&quot;tor&quot;]

that for `privoxy` is

    FROM alpine:latest
    EXPOSE 8118
    RUN apk --update add privoxy
    COPY config /etc/privoxy/config
    CMD [&quot;privoxy&quot;, &quot;--no-daemon&quot;]

where `config` consists of the two lines

    listen-address 0.0.0.0:8118
    forward-socks5 / tor:9050 .

and the `Dockerfile` for `scraper` is

    FROM python:2.7-alpine
    ADD . /scraper
    WORKDIR /scraper
    RUN pip install -r requirements.txt
    CMD [&quot;python&quot;, &quot;newnym.py&quot;]

where `requirements.txt` contains the single line `requests`. Finally, the program `newnym.py` is designed to simply test whether changing the IP address using Tor is working:

    from time import sleep, time
    
    import requests as req
    import telnetlib
    
    
    def get_ip():
        IPECHO_ENDPOINT = &#39;http://ipecho.net/plain&#39;
        HTTP_PROXY = &#39;http://privoxy:8118&#39;
        return req.get(IPECHO_ENDPOINT, proxies={&#39;http&#39;: HTTP_PROXY}).text
    
    
    def request_ip_change():
        tn = telnetlib.Telnet(&#39;tor&#39;, 9051)
        tn.read_until(&quot;Escape character is &#39;^]&#39;.&quot;, 2)
        tn.write(&#39;AUTHENTICATE &quot;&quot;\r\n&#39;)
        tn.read_until(&quot;250 OK&quot;, 2)
        tn.write(&quot;signal NEWNYM\r\n&quot;)
        tn.read_until(&quot;250 OK&quot;, 2)
        tn.write(&quot;quit\r\n&quot;)
        tn.close()
    
    
    if __name__ == &#39;__main__&#39;:
        dts = []
        try:
            while True:
                ip = get_ip()
                t0 = time()
                request_ip_change()
                while True:
                    new_ip = get_ip()
                    if new_ip == ip:
                        sleep(1)
                    else:
                        break
                dt = time() - t0
                dts.append(dt)
                print(&quot;{} -&gt; {} in ~{}s&quot;.format(ip, new_ip, int(dt)))
        except KeyboardInterrupt:
            print(&quot;Stopping...&quot;)
            print(&quot;Average: {}&quot;.format(sum(dts) / len(dts)))

The `docker-compose build` builds successfully, but if I try `docker-compose up`, I get the following error message:

    Creating network &quot;apkmirrorscrapercompose_default&quot; with the default driver
    ERROR: could not find an available, non-overlapping IPv4 address pool among the defaults to assign to the network

I tried searching for help on this error message, but couldn&#39;t find any. What is causing this error?


Docker &quot;ERROR: could not find an available, non-overlapping IPv4 address pool among the defaults to assign to the network&quot;

I have read multiple posts regarding this error, but I still can&#39;t figure it out. When I try to loop through my function:

    def fix_Plan(location):
        letters_only = re.sub(&quot;[^a-zA-Z]&quot;,  # Search for all non-letters
                              &quot; &quot;,          # Replace all non-letters with spaces
                              location)     # Column and row to search    
    
        words = letters_only.lower().split()     
        stops = set(stopwords.words(&quot;english&quot;))      
        meaningful_words = [w for w in words if not w in stops]      
        return (&quot; &quot;.join(meaningful_words))    
    
    col_Plan = fix_Plan(train[&quot;Plan&quot;][0])    
    num_responses = train[&quot;Plan&quot;].size    
    clean_Plan_responses = []
    
    for i in range(0,num_responses):
        clean_Plan_responses.append(fix_Plan(train[&quot;Plan&quot;][i]))

Here is the error:

    Traceback (most recent call last):
      File &quot;C:/Users/xxxxx/PycharmProjects/tronc/tronc2.py&quot;, line 48, in &lt;module&gt;
        clean_Plan_responses.append(fix_Plan(train[&quot;Plan&quot;][i]))
      File &quot;C:/Users/xxxxx/PycharmProjects/tronc/tronc2.py&quot;, line 22, in fix_Plan
        location)  # Column and row to search
      File &quot;C:\Users\xxxxx\AppData\Local\Programs\Python\Python36\lib\re.py&quot;, line 191, in sub
        return _compile(pattern, flags).sub(repl, string, count)
    TypeError: expected string or bytes-like object

re.sub erroring with &quot;Expected string or bytes-like object&quot;

This is the first time I&#39;ve really sat down and tried python 3, and seem to be failing miserably. I have the following two files:

 1. test.py
 2. config.py

config.py has a few functions defined in it as well as a few variables. I&#39;ve stripped it down to the following:

**config.py**

    debug = True

**test.py**

    import config
    print (config.debug)

I also have an `__init__.py`

However, I&#39;m getting the following error:

    ModuleNotFoundError: No module named &#39;config&#39;

I&#39;m aware that the py3 convention is to use absolute imports:

    from . import config

However, this leads to the following error:

    ImportError: cannot import name &#39;config&#39;

So I&#39;m at a loss as to what to do here... Any help is greatly appreciated. :)

Relative imports - ModuleNotFoundError: No module named x

I have a function that takes in a variable that would work if it is any of the following three types

     1. pandas Series
     2. numpy array (ndarray)
     3. python list

Any other type should be rejected. What is the most efficient way to check this?

How to check if a variable is either a python list, numpy array or pandas series

I was just wondering if I can rename column names by their positions.
I know how to rename them by their actual names using:

`df.rename(columns = {})` 

How do I do it if I do not know the column names and know only their positions?

Pandas rename column by position?

I have a massive dataframe, and I&#39;m getting the error:

`TypeError: (&quot;Empty &#39;DataFrame&#39;: no numeric data to plot&quot;, &#39;occurred at index 159220&#39;)`

I&#39;ve already dropped nulls, and checked dtypes for the DataFrame so I have no guess as to why it&#39;s failing on that row.

How do I print out just that row (at index 159220) of the data frame?

Thanks

How to print a specific row of a pandas DataFrame?

Given this dataframe, how to select only those rows that have &quot;Col2&quot; equal to `NaN`?

    df = pd.DataFrame([range(3), [0, np.NaN, 0], [0, 0, np.NaN], range(3), range(3)], columns=[&quot;Col1&quot;, &quot;Col2&quot;, &quot;Col3&quot;])
    
which looks like:

       0   1   2
    0  0   1   2
    1  0 NaN   0
    2  0   0 NaN
    3  0   1   2
    4  0   1   2

The result should be this one:

       0   1   2
    1  0 NaN   0

Content Type	Original Author	Original Content on Stackoverflow
Question	import.zee	View Question on Stackoverflow
Solution 1 - Python	jezrael	View Answer on Stackoverflow
Solution 2 - Python	Mykola Zotko	View Answer on Stackoverflow

Get rows based on distinct values from one column

Python Problem Overview

Python Solutions

Solution 1 - Python

Solution 2 - Python

PDO::__construct(): Server sent charset (255) unknown to the client. Please, report to the developers

Jenkinsfile Declarative Pipeline defining dynamic env vars

Attributions