In jq, how can I convert a JSON to a string with `key=value`?

From:

    {
        &quot;var&quot;: 1,
        &quot;foo&quot;: &quot;bar&quot;,
        &quot;x&quot;: &quot;test&quot;
    }

To:

    var=1
    foo=bar
    x=test

How to convert a JSON object to key=value format in jq?

Here is my config.json:

    {
        &quot;env&quot;: &quot;dev&quot;,
        &quot;dev&quot;: {
            &quot;projects&quot; : {
                &quot;prj1&quot;: {
                    &quot;dependencies&quot;: {},
                    &quot;description&quot;: &quot;&quot;
                }
            }
        }
    }

Here are my bash commands:

    PRJNAME=&#39;prj1&#39;
    
    echo $PRJNAME
    
    jq --arg v &quot;$PRJNAME&quot; &#39;.dev.projects.&quot;$v&quot;&#39; config.json 
    jq &#39;.dev.projects.prj1&#39; config.json 
   


The output:


    prj1
    null
    {
      &quot;dependencies&quot;: {},
      &quot;description&quot;: &quot;&quot;
    }


So $PRJNAME is prj1, but the first invocation only outputs `null`.

Can someone help me?

passing arguments to jq filter

Say I have the following JSON, stored in my variable *jsonVariable*.

    {
        &quot;id&quot;: 1,
        &quot;details&quot;: {
            &quot;username&quot;: &quot;jamesbrown&quot;,
            &quot;name&quot;: &quot;James Brown&quot;
        }
    }

I parse this JSON with jq using the following:

    echo $jsonVariable | jq &#39;.details.name | select(.name == &quot;James Brown&quot;)&#39;

This would give me the output

*James Brown*

But what if I want to get the id of this person as well? Now, I&#39;m aware this is a rough and simple example - the program I&#39;m working with at the moment is 5 or 6 levels deep with many different JQ functions other than select. I need a way to select a parent&#39;s field when I am already 5 or 6 layers deep after carrying out various methods of filtering.

Can anyone help? Is there any way of &#39;going in reverse&#39;, back up to the parent? (Not sure if I&#39;m making sense!)

jq - How do I print a parent value of an object when I am already deep into the object&#39;s children?

I want to list the public IP addresses of my EC2 instances using Bash, separated by a delimiter (space or a new-line).

I tried to pipe the output to [jq][1] with `aws ec2 describe-instances | jq`, but can&#39;t seem to isolate just the IP addresses.


  [1]: https://stedolan.github.io/jq/

Can this be done by `aws` alone, specifying arguments to `jq`, or something else entirely?

List public IP addresses of EC2 instances

I have an aws query that I want to filter in `jq`.
I want to filter all the `imageTags` that **don&#39;t** end with &quot;latest&quot;

So far I did this but it filters things containing &quot;latest&quot; while I want to filter things not containing &quot;latest&quot; (or not ending with &quot;latest&quot;)

    aws ecr describe-images --repository-name &lt;repo&gt; --output json | jq &#39;.[]&#39; | jq &#39;.[]&#39; | jq &quot;select ((.imagePushedAt &lt; 14893094695) and (.imageTags[] | contains(\&quot;latest\&quot;)))&quot;

Thanks

jq - How to filter a json that does not contain

I&#39;m getting this kind of `JSON` reply from a `curl` command:

    [
      {
        &quot;cid&quot;: 49,
        &quot;pyn&quot;: &quot;yi4&quot;,
        &quot;hans&quot;: &quot;亿&quot;,
        &quot;hant&quot;: &quot;億&quot;,
        &quot;tid&quot;: 68,
        &quot;l10n&quot;: &quot;cent million&quot;,
        &quot;pid&quot;: 1,
        &quot;pos&quot;: &quot;num&quot;,
        &quot;pos_txt&quot;: &quot;&quot;
      },
      {
        &quot;cid&quot;: 50,
        &quot;pyn&quot;: &quot;yi4&quot;,
        &quot;hans&quot;: &quot;亿&quot;,
        &quot;hant&quot;: &quot;億&quot;,
        &quot;tid&quot;: 69,
        &quot;l10n&quot;: &quot;100 millions&quot;,
        &quot;pid&quot;: 1,
        &quot;pos&quot;: &quot;num&quot;,
        &quot;pos_txt&quot;: &quot;&quot;
      }
    ]

How can I count the number of items in the array (here `2`), using `Bash` or a command line (e.g. `underscore`) ?

How to count items in JSON object using command line?

How can I run a Bash command for every JSON object in a JSON array using `jq`? So far I have this:

    cat credentials.json | jq -r &#39;.[] | .user, .date, .email&#39; | mycommand -u {user} -d {date} -e {email}

This doesn&#39;t seem to work. How can I take the parameters out of the JSON array into my command?

My JSON file looks something like this:

    [
       &quot;user&quot;: &quot;danielrvt&quot;,
       &quot;date&quot;: &quot;11/10/1988&quot;,
       &quot;email&quot;: &quot;myemail@domain.com&quot;,
       ...
    ]

Using jq with bash to run command for each object in array

I can&#39;t seem to get `jq` to behave &quot;normally&quot; in a shell pipeline.  For example:

    $ curl -s https://api.github.com/users/octocat/repos | jq | cat

results in `jq` simply printing out its help text*.  The same thing happens if I try to redirect `jq`&#39;s output to a file:

    $ curl -s https://api.github.com/users/octocat/repos | jq &gt; /tmp/stuff.json

Is `jq` deliberately bailing out if it determines that it&#39;s not being run from a tty?  How can I prevent this behavior so that I can use `jq` in a pipeline?

Edit: it looks like this is no longer an issue in recent versions of `jq`. I have `jq-1.6` now and the examples above work as expected.

---

\* &lt;sub&gt;(I realize this example contains a [useless use of cat](http://porkmail.org/era/unix/award.html); it&#39;s for illustration purposes only)&lt;/sub&gt;

How to use `jq` in a shell pipeline?

`curl http://testhost.test.com:8080/application/app/version | jq &#39;.version&#39; | jq &#39;.[]&#39;`

 The above command outputs only the values as below:

    &quot;madireddy@test.com&quot;
    
    &quot;2323&quot;
    
    &quot;test&quot;
    
    &quot;02-03-2014-13:41&quot;
    
    &quot;application&quot;
    
 How can I get the key names instead like the below:
    
    email
    
    versionID
    
    context
    
    date
    
    versionName



How to get key names from JSON using jq

I&#39;m using the [jq][1] tools (jq-json-processor) in shell script to parse json.

I&#39;ve got 2 json files and **want to merge them into one unique file**

Here the content of files:

**file1**

    {
        &quot;value1&quot;: 200,
        &quot;timestamp&quot;: 1382461861,
        &quot;value&quot;: {
            &quot;aaa&quot;: {
                &quot;value1&quot;: &quot;v1&quot;,
                &quot;value2&quot;: &quot;v2&quot;
            },
            &quot;bbb&quot;: {
                &quot;value1&quot;: &quot;v1&quot;,
                &quot;value2&quot;: &quot;v2&quot;
            },
            &quot;ccc&quot;: {
                &quot;value1&quot;: &quot;v1&quot;,
                &quot;value2&quot;: &quot;v2&quot;
            }
        }
    }

**file2**

    {
        &quot;status&quot;: 200,
        &quot;timestamp&quot;: 1382461861,
        &quot;value&quot;: {
            &quot;aaa&quot;: {
                &quot;value3&quot;: &quot;v3&quot;,
                &quot;value4&quot;: 4
            },
            &quot;bbb&quot;: {
                &quot;value3&quot;: &quot;v3&quot;
            },      
            &quot;ddd&quot;: {
                &quot;value3&quot;: &quot;v3&quot;,
                &quot;value4&quot;: 4
            }
        }
    }

**expected result**

    {
        &quot;value&quot;: {
            &quot;aaa&quot;: {
                &quot;value1&quot;: &quot;v1&quot;,
                &quot;value2&quot;: &quot;v2&quot;,
                &quot;value3&quot;: &quot;v3&quot;,
                &quot;value4&quot;: 4
            },
            &quot;bbb&quot;: {
                &quot;value1&quot;: &quot;v1&quot;,
                &quot;value2&quot;: &quot;v2&quot;,
                &quot;value3&quot;: &quot;v3&quot;
            },
            &quot;ccc&quot;: {
                &quot;value1&quot;: &quot;v1&quot;,
                &quot;value2&quot;: &quot;v2&quot;
            },
            &quot;ddd&quot;: {
                &quot;value3&quot;: &quot;v3&quot;,
                &quot;value4&quot;: 4
            }
        }
    }

I try a lot of combinations but the only result i get is the following, which is not the expected result:

    {
      &quot;ccc&quot;: {
        &quot;value2&quot;: &quot;v2&quot;,
        &quot;value1&quot;: &quot;v1&quot;
      },
      &quot;bbb&quot;: {
        &quot;value2&quot;: &quot;v2&quot;,
        &quot;value1&quot;: &quot;v1&quot;
      },
      &quot;aaa&quot;: {
        &quot;value2&quot;: &quot;v2&quot;,
        &quot;value1&quot;: &quot;v1&quot;
      }
    }
    {
      &quot;ddd&quot;: {
        &quot;value4&quot;: 4,
        &quot;value3&quot;: &quot;v3&quot;
      },
      &quot;bbb&quot;: {
        &quot;value3&quot;: &quot;v3&quot;
      },
      &quot;aaa&quot;: {
        &quot;value4&quot;: 4,
        &quot;value3&quot;: &quot;v3&quot;
      }
    }


Using this command:

    jq -s &#39;.[].value&#39; file1 file2

  [1]: https://github.com/stedolan/jq

How to merge 2 JSON objects from 2 files using jq?

I have a json and at the moment using select to get only the data which match one condition, I need to filter based on more conditions.

For e.g:



    .[] | select((.processedBarsVolume &lt;= 5) &amp;&amp; .processedBars &gt; 0)

How I can do this ?


JQ: Select multiple conditions

I have written a script to retrieve certain value from `file.json`. It works if I provide the value to jq `select`, but the variable doesn&#39;t seem to work (or I don&#39;t know how to use it).

    #!/bin/sh

    #this works ***
    projectID=$(cat file.json | jq -r &#39;.resource[] | select(.username==&quot;myemail@hotmail.com&quot;) | .id&#39;)
    echo &quot;$projectID&quot;

    EMAILID=myemail@hotmail.com

    #this does not work *** no value is printed
    projectID=$(cat file.json | jq -r &#39;.resource[] | select(.username==&quot;$EMAILID&quot;) | .id&#39;)
    echo &quot;$projectID&quot;

Passing bash variable to jq

My input file looks something like this:

    {
      &quot;login&quot;: &quot;dmaxfield&quot;,
      &quot;id&quot;: 7449977,
      ...
    }
    {
      &quot;login&quot;: &quot;dmaxfield&quot;,
      &quot;id&quot;: 7449977,
      ...
    }

I can get all the login names with this : `cat members | jq &#39;.[].login&#39;`

but I have not been able to crack the syntax to get both the login and id?

How do I select multiple fields in jq?

I need to know the most efficient way of installing JQ on Mac (El Capitan). The code is downloaded to my Mac but I would like to know how I can install and operate it via the command line.

How to install JQ on Mac on the command line?

Appologies if I&#39;ve overlooked something very obvious; I&#39;ve just found `jq` and am trying to use it to update one JSON value without affecting the surrounding data.


I&#39;d like to pipe a `curl` result into `jq`, update a value, and pipe the updated JSON to a `curl -X PUT`.  Something like 

    curl http://example.com/shipping.json | jq &#39;.&#39; field: value | curl -X PUT http://example.com/shipping.json

So far I&#39;ve hacked it together using `sed`, but after looking at a few examples of the `|=` operator in `jq` I&#39;m sure that I don&#39;t need these.

Here&#39;s a JSON sample--how would I use `jq` to set `&quot;local&quot;: false`, while preserving the rest of the JSON?

    {
      &quot;shipping&quot;: {
        &quot;local&quot;: true,
        &quot;us&quot;: true,
        &quot;us_rate&quot;: {
          &quot;amount&quot;: &quot;0.00&quot;,
          &quot;currency&quot;: &quot;USD&quot;,
          &quot;symbol&quot;: &quot;$&quot;
        }
      }
    }



How do I update a single value in a json document using jq?

Using [jq][1], how can arbitrary JSON encoding an array of shallow objects be converted to CSV?

There are plenty of Q&amp;As on this site that cover specific data models which hard-code the fields, but answers to this question should work given any JSON, with the only restriction that it&#39;s an array of objects with scalar properties (no deep/complex/sub-objects, as flattening these is another question). The result should contain a header row giving the field names. Preference will be given to answers that preserve the field order of the first object, but it&#39;s not a requirement. Results may enclose all cells with double-quotes, or only enclose those that require quoting (e.g. &#39;a,b&#39;).

## Examples

1. Input:

        [
            {&quot;code&quot;: &quot;NSW&quot;, &quot;name&quot;: &quot;New South Wales&quot;, &quot;level&quot;:&quot;state&quot;, &quot;country&quot;: &quot;AU&quot;},
            {&quot;code&quot;: &quot;AB&quot;, &quot;name&quot;: &quot;Alberta&quot;, &quot;level&quot;:&quot;province&quot;, &quot;country&quot;: &quot;CA&quot;},
            {&quot;code&quot;: &quot;ABD&quot;, &quot;name&quot;: &quot;Aberdeenshire&quot;, &quot;level&quot;:&quot;council area&quot;, &quot;country&quot;: &quot;GB&quot;},
            {&quot;code&quot;: &quot;AK&quot;, &quot;name&quot;: &quot;Alaska&quot;, &quot;level&quot;:&quot;state&quot;, &quot;country&quot;: &quot;US&quot;}
        ]

    Possible output:

        code,name,level,country
        NSW,New South Wales,state,AU
        AB,Alberta,province,CA
        ABD,Aberdeenshire,council area,GB
        AK,Alaska,state,US

    Possible output:

        &quot;code&quot;,&quot;name&quot;,&quot;level&quot;,&quot;country&quot;
        &quot;NSW&quot;,&quot;New South Wales&quot;,&quot;state&quot;,&quot;AU&quot;
        &quot;AB&quot;,&quot;Alberta&quot;,&quot;province&quot;,&quot;CA&quot;
        &quot;ABD&quot;,&quot;Aberdeenshire&quot;,&quot;council area&quot;,&quot;GB&quot;
        &quot;AK&quot;,&quot;Alaska&quot;,&quot;state&quot;,&quot;US&quot;

2. Input:

        [
            {&quot;name&quot;: &quot;bang&quot;, &quot;value&quot;: &quot;!&quot;, &quot;level&quot;: 0},
            {&quot;name&quot;: &quot;letters&quot;, &quot;value&quot;: &quot;a,b,c&quot;, &quot;level&quot;: 0},
            {&quot;name&quot;: &quot;letters&quot;, &quot;value&quot;: &quot;x,y,z&quot;, &quot;level&quot;: 1},
            {&quot;name&quot;: &quot;bang&quot;, &quot;value&quot;: &quot;\&quot;!\&quot;&quot;, &quot;level&quot;: 1}
        ]

    Possible output:

        name,value,level
        bang,!,0
        letters,&quot;a,b,c&quot;,0
        letters,&quot;x,y,z&quot;,1
        bang,&quot;&quot;&quot;!&quot;&quot;&quot;,0

    Possible output:

        &quot;name&quot;,&quot;value&quot;,&quot;level&quot;
        &quot;bang&quot;,&quot;!&quot;,&quot;0&quot;
        &quot;letters&quot;,&quot;a,b,c&quot;,&quot;0&quot;
        &quot;letters&quot;,&quot;x,y,z&quot;,&quot;1&quot;
        &quot;bang&quot;,&quot;&quot;&quot;!&quot;&quot;&quot;,&quot;1&quot;


  [1]: https://stedolan.github.io/jq/

How to convert arbitrary simple JSON to CSV using jq?

Are there any command line utilities that can be used to find if two JSON files are identical with invariance to within-dictionary-key and within-list-element ordering?

Could this be done with [`jq`][1] or some other equivalent tool?

## Examples:

These two JSON files are identical

`A`:

    {
      &quot;People&quot;: [&quot;John&quot;, &quot;Bryan&quot;],
      &quot;City&quot;: &quot;Boston&quot;,
      &quot;State&quot;: &quot;MA&quot;
    }
`B`:

    {
      &quot;People&quot;: [&quot;Bryan&quot;, &quot;John&quot;],
      &quot;State&quot;: &quot;MA&quot;,
      &quot;City&quot;: &quot;Boston&quot;
    }

but these two JSON files are different:

`A`:

    {
      &quot;People&quot;: [&quot;John&quot;, &quot;Bryan&quot;, &quot;Carla&quot;],
      &quot;City&quot;: &quot;Boston&quot;,
      &quot;State&quot;: &quot;MA&quot;
    }
`C`:

    {
      &quot;People&quot;: [&quot;Bryan&quot;, &quot;John&quot;],
      &quot;State&quot;: &quot;MA&quot;,
      &quot;City&quot;: &quot;Boston&quot;
    }

That would be:

    $ some_diff_command A.json B.json

    $ some_diff_command A.json C.json
    The files are not structurally identical


  [1]: http://stedolan.github.io/jq/

Using jq or alternative command line tools to compare JSON files

I&#39;m trying to get `jq` to parse a JSON structure like:
  
    {
      &quot;a&quot; : 1,
      &quot;b&quot; : 2,
      &quot;c&quot; : &quot;{\&quot;id\&quot;:\&quot;9ee ...\&quot;,\&quot;parent\&quot;:\&quot;abc...\&quot;}\n&quot;
    }

That is, an element in the JSON is a string with escaped json.

So, I have something along the lines of
`$ jq [.c] myFile.json | jq [.id]`

But that crashes with `jq: error: Cannot index string with string`

This is because the output of .c is a string, not more JSON.
How do I get jq to parse this string?

My initial solution is to use sed to replace all the escape chars (`\&quot;:\&quot;`, `\&quot;,\&quot;` and `\&quot;`) but that&#39;s messy, I assume there&#39;s a way built into `jq` to do this?

Thanks!

edit:
Also, the jq version available here is:
    
    $ jq --version
    jq version 1.3

I guess I could update it if required.

how to parse a JSON String with jq (or other alternatives)?

Just started out with Bash scripting and stumbled upon jq to work with JSON.

I need to transform a JSON string like below to a table for output in the terminal.

    [{
        &quot;name&quot;: &quot;George&quot;,
        &quot;id&quot;: 12,
        &quot;email&quot;: &quot;george@domain.com&quot;
    }, {
        &quot;name&quot;: &quot;Jack&quot;,
        &quot;id&quot;: 18,
        &quot;email&quot;: &quot;jack@domain.com&quot;
    }, {
        &quot;name&quot;: &quot;Joe&quot;,
        &quot;id&quot;: 19,
        &quot;email&quot;: &quot;joe@domain.com&quot;
    }]

What I want to display in the terminal:

    ID        Name
    =================
    12        George
    18        Jack
    19        Joe

Notice how I don&#39;t want to display the email property for each row, so the jq command should involve some filtering. The following gives me a plain list of names and id&#39;s:

    list=$(echo &quot;$data&quot; | jq -r &#39;.[] | .name, .id&#39;)
    printf &quot;$list&quot;

The problem with that is, I cannot display it like a table. I know jq has some formatting options, but not nearly as good as the options I have when using `printf`. I think I want to get these values in an array which I can then loop through myself to do the formatting...? The things I tried give me varying results, but never what I really want.

Can someone point me in the right direction?

How to format a JSON string as a table using jq?

I got below output using: https://stackoverflow.com/a/40330344

     (.issues[] | {key, status: .fields.status.name, assignee: .fields.assignee.emailAddress})
 
 
 Output:
 
     {  
       &quot;key&quot;: &quot;SEA-739&quot;,
       &quot;status&quot;: &quot;Open&quot;,
       &quot;assignee&quot;: null
     }
     {
       &quot;key&quot;: &quot;SEA-738&quot;,
       &quot;status&quot;: &quot;Resolved&quot;,
       &quot;assignee&quot;: &quot;user2@mycompany.com&quot;
     }

But I need to parse each and every line but it&#39;s tough to identify which assignee is for which key as far as key group is concerned. Is this possible to make one bunch in one row using jq?

Expected output:

    { &quot;key&quot;: &quot;SEA-739&quot;, &quot;status&quot;: &quot;Open&quot;, &quot;assignee&quot;: null }
    { &quot;key&quot;: &quot;SEA-738&quot;, &quot;status&quot;: &quot;Resolved&quot;, &quot;assignee&quot;: &quot;user2@mycompany.com&quot;}

OR

    { &quot;SEA-739&quot;, &quot;Open&quot;, null }
    { &quot;SEA-738&quot;, &quot;Resolved&quot;, user2@mycompany.com }

Get outputs from jq on a single line

How do I get **jq** to take json like this:

    {
      &quot;host1&quot;: { &quot;ip&quot;: &quot;10.1.2.3&quot; },
      &quot;host2&quot;: { &quot;ip&quot;: &quot;10.1.2.2&quot; },
      &quot;host3&quot;: { &quot;ip&quot;: &quot;10.1.18.1&quot; }
    }

and generate this output:

    host1, 10.1.2.3
    host2, 10.1.2.2
    host3, 10.1.18.1

I&#39;m not interested in the formatting, I just can&#39;t figure out how to access the key name and value.

jq: print key and value for each entry in an object

I have a json in which I want to modify a particular value but the terminal always displays the json with the modified value but it does not actually change the value in the particular file. Sample json:

    {
       name: &#39;abcd&#39;,
       age: 30,
       address: &#39;abc&#39;
    }
I want to change the value of address in the file itself but so far I&#39;ve been unable to do so. I tried using:

    jq &#39;.address = &quot;abcde&quot;&#39; test.json
but it didn&#39;t work. Any suggestions?

Modify a key-value in a json using jq in-place

I am using `jq` to reformat my `JSON`.

JSON String:

`{&quot;channel&quot;: &quot;youtube&quot;, &quot;profile_type&quot;: &quot;video&quot;, &quot;member_key&quot;: &quot;hello&quot;}`

Wanted output:

`{&quot;channel&quot; : &quot;profile_type.youtube&quot;}`

My command:

`echo &#39;{&quot;channel&quot;: &quot;youtube&quot;, &quot;profile_type&quot;: &quot;video&quot;, &quot;member_key&quot;: &quot;hello&quot;}&#39; | jq -c &#39;. | {channel: .profile_type + &quot;.&quot; + .member_key}&#39;`


I know that the command below concatenates the string. But it is not working in the same logic as above:

`echo &#39;{&quot;channel&quot;: &quot;youtube&quot;, &quot;profile_type&quot;: &quot;video&quot;, &quot;member_key&quot;: &quot;hello&quot;}&#39; | jq -c &#39;.profile_type + &quot;.&quot; + .member_key&#39;`

How can I achieve my result using ONLY jq?

Concat 2 fields in JSON using jq

I&#39;m using [jq][1] to play with json. I was wondering how to conditionally print something in that.

Say I am interested in a field call `geo`. I used the following command and find out there is only one entry whose `geo` is `null`:

    % cat all.json | jq &#39;.geo != null&#39; | sort | uniq -c              
       1 false
    6891 true

How can I print out that entry only without printing everything else?

Didn&#39;t see something like `print` command in the manual. And this doesn&#39;t work: `cat all.json | jq &#39;if .place == null then . end&#39;`. `jq` complained about syntax error.


  [1]: http://stedolan.github.io/jq/

jq Conditional output

We&#39;re building a website using the Pentaho CTools library, which has a graphical dashboard editor which writes out JSON-format files for part of the dashboard.

I&#39;d like to apply a transform to these files before check-in to git in order to sort them by key and then by the value of certain keys. The purpose is to make diffs easier, since the editor has a habit of rearranging all of the json fields.

For example, we might have something like this:

    {
      &quot;components&quot;: {
        &quot;rows&quot;: [
          {
            &quot;id&quot;: &quot;CHARTS&quot;,
            &quot;name&quot;: &quot;Charts&quot;,
            &quot;parent&quot;: &quot;UnIqEiD&quot;,
            &quot;properties&quot;: [
              {
                &quot;name&quot;: &quot;Group&quot;,
                &quot;type&quot;: &quot;Label&quot;,
                &quot;value&quot;: &quot;Charts&quot;
              }
            ],
            &quot;type&quot;: &quot;Label&quot;,
            &quot;typeDesc&quot;: &quot;&lt;i&gt;Group&lt;/i&gt;&quot;
          },
          {
            &quot;id&quot;: &quot;kjalajsdjf&quot;,
            &quot;meta_cdwSupport&quot;: &quot;true&quot;,
            &quot;parent&quot;: &quot;CHARTS&quot;,
            &quot;properties&quot;: [
              {
                &quot;name&quot;: &quot;name&quot;,
                &quot;type&quot;: &quot;Id&quot;,
                &quot;value&quot;: &quot;Value1&quot;
              },
              {
                &quot;name&quot;: &quot;title&quot;,
                &quot;type&quot;: &quot;String&quot;,
                &quot;value&quot;: &quot;Value2&quot;
              },
              {
                &quot;name&quot;: &quot;listeners&quot;,
                &quot;type&quot;: &quot;Listeners&quot;,
                &quot;value&quot;: &quot;[]&quot;
              },
    ...


We are able to `jq --sort-keys` (http://stedolan.github.io/jq/) to sort all of the keys, but I&#39;m struggling to find out how to use the `sort_by` function to then sort certain specific elements by the value of certain keys (so, in the example above, sorting by `properties.name` for example. Any ideas?

How to sort a json file by keys and values of those keys in jq

I have a json file that needs to be updated on a certain condition. 

Sample json

    {
       &quot;Actions&quot; : [
          {
             &quot;value&quot; : &quot;1&quot;,
             &quot;properties&quot; : {
                &quot;name&quot; : &quot;abc&quot;,
                &quot;age&quot; : &quot;2&quot;,
                &quot;other &quot;: &quot;test1&quot;
              }
          },
          {
             &quot;value&quot; : &quot;2&quot;,
             &quot;properties&quot; : {
                &quot;name&quot; : &quot;def&quot;,
                &quot;age&quot; : &quot;3&quot;,
                &quot;other&quot; : &quot;test2&quot;
              }
          }
       ]
    }

I am writing a script that makes use of Jq to match a value and update, as shown below

    cat sample.json |  jq &#39;.Actions[] | select (.properties.age == &quot;3&quot;) .properties.other = &quot;no-test&quot;&#39;

Output (printed to terminal)

    {
      &quot;value&quot;: &quot;1&quot;,
      &quot;properties&quot;: {
        &quot;name&quot;: &quot;abc&quot;,
        &quot;age&quot;: &quot;2&quot;,
        &quot;other &quot;: &quot;test1&quot;
      }
    }
    {
      &quot;value&quot;: &quot;2&quot;,
      &quot;properties&quot;: {
        &quot;name&quot;: &quot;def&quot;,
        &quot;age&quot;: &quot;3&quot;,
        &quot;other&quot;: &quot;no-test&quot;
      }
    }

While this command makes the needed change, it outputs the entire json on the terminal and does not make change to the file itself. 

Please advise if there is an option to have jq make changes on the file directly (similar to sed -i).

Jq to replace text directly on file (like sed -i)

I have a JSON output as follows:

    {
      &quot;example&quot;: {
        &quot;sub-example&quot;: [
          {
            &quot;name&quot;: &quot;123-345&quot;,
            &quot;tag&quot; : 100
          },
          {
            &quot;name&quot;: &quot;234-456&quot;,
            &quot;tag&quot; : 100
          },
          {
            &quot;name&quot;: &quot;4a7-a07a5&quot;,
            &quot;tag&quot; : 100
          }
        ]
      }
    }

I want to extract the values of the three &quot;name&quot; fields and store it in three variables.

I tried `cat json_file | jq &#39;.[&quot;example.sub-example.name&quot;]&#39;` to extract the value of the &quot;name&quot; field but that doesn&#39;t work.

Can anyone tell me how to achieve this using jq (or some other method)?

Extract a specific field from JSON output using jq

Given the following jq command and Json:


    jq &#39;.[]|[.string,.number]|join(&quot;: &quot;)&#39; &lt;&lt;&lt; &#39;
    [
      {
        &quot;number&quot;: 3,
        &quot;string&quot;: &quot;threee&quot;
      },
      {
        &quot;number&quot;: 7,
        &quot;string&quot;: &quot;seven&quot;
      }
    ]
    &#39;
I&#39;m trying to format the output as:

    three: 3
    seven: 7

Unfortunately, my attempt is resulting in the following error:

&gt; jq: error: string and number cannot be added

How do I convert the number to string so both can be joined?

How do I use jq to convert number to string?

I&#39;m using jq to parse a JSON file as shown [here][1]. However, the results for string values contain the &quot;double-quotes&quot; as expected, as shown below:

&lt;!-- language-all: none --&gt;

    $ cat json.txt | jq &#39;.name&#39;
    &quot;Google&quot;

How can I pipe this into another command to remove the &quot;&quot;? so I get

    $ cat json.txt | jq &#39;.name&#39; | some_other_command
    Google

What `some_other_command` can I use?

  [1]: http://xmodulo.com/how-to-parse-json-string-via-command-line-on-linux.html#comment-13001

How to remove double-quotes in jq output for parsing json files in bash?

I want to append an element to an array in a JSON file using the `jq``add` command, but it&#39;s not working. 

`report-2017-01-07.json` file:

    {  
       &quot;report&quot;: &quot;1.0&quot;,
       &quot;data&quot;: {  
          &quot;date&quot;: &quot;2010-01-07&quot;,
          &quot;messages&quot;: [  
             {  
                &quot;date&quot;: &quot;2010-01-07T19:58:42.949Z&quot;,
                &quot;xml&quot;: &quot;xml_samplesheet_2017_01_07_run_09.xml&quot;,
                &quot;status&quot;: &quot;OK&quot;,
                &quot;message&quot;: &quot;metadata loaded into iRODS successfully&quot;
             },
             {  
                &quot;date&quot;: &quot;2010-01-07T20:22:46.949Z&quot;,
                &quot;xml&quot;: &quot;xml_samplesheet_2017_01_07_run_09.xml&quot;,
                &quot;status&quot;: &quot;NOK&quot;,
                &quot;message&quot;: &quot;metadata duplicated into iRODS&quot;
             },
             {  
                &quot;date&quot;: &quot;2010-01-07T22:11:55.949Z&quot;,
                &quot;xml&quot;: &quot;xml_samplesheet_2017_01_07_run_09.xml&quot;,
                &quot;status&quot;: &quot;NOK&quot;,
                &quot;message&quot;: &quot;metadata was not validated by XSD schema&quot;
             }
          ]
       }
    }



I am using this command:

    $ cat report-2017-01-07.json 
    | jq -s &#39;.data.messages {&quot;date&quot;: &quot;2010-01-07T19:55:99.999Z&quot;, &quot;xml&quot;: &quot;xml_samplesheet_2017_01_07_run_09.xml&quot;, &quot;status&quot;: &quot;OKKK&quot;, &quot;message&quot;: &quot;metadata loaded into iRODS successfullyyyyy&quot;}&#39;
    jq: error: syntax error, unexpected &#39;{&#39;, expecting $end (Unix shell quoting issues?) at &lt;top-level&gt;, line 1:
    .data.messages {&quot;date&quot;: &quot;2010-01-07T19:55:99.999Z&quot;, &quot;xml&quot;: &quot;xml_samplesheet_2017_01_07_run_09.xml&quot;, &quot;status&quot;: &quot;OKKK&quot;, &quot;message&quot;: &quot;metadata loaded into iRODS successfullyyyyy&quot;}               
    jq: 1 compile error


Here&#39;s how I want the output to look:

    {
        &quot;report&quot;: &quot;1.0&quot;,
        &quot;data&quot;: {
            &quot;date&quot;: &quot;2010-01-07&quot;,
            &quot;messages&quot;: [{
                &quot;date&quot;: &quot;2010-01-07T19:58:42.949Z&quot;,
                &quot;xml&quot;: &quot;xml_samplesheet_2017_01_07_run_09.xml&quot;,
                &quot;status&quot;: &quot;OK&quot;,
                &quot;message&quot;: &quot;metadata loaded into iRODS successfully&quot;
            }, {
                &quot;date&quot;: &quot;2010-01-07T20:22:46.949Z&quot;,
                &quot;xml&quot;: &quot;xml_samplesheet_2017_01_07_run_09.xml&quot;,
                &quot;status&quot;: &quot;NOK&quot;,
                &quot;message&quot;: &quot;metadata duplicated into iRODS&quot;
            }, {
                &quot;date&quot;: &quot;2010-01-07T22:11:55.949Z&quot;,
                &quot;xml&quot;: &quot;xml_samplesheet_2017_01_07_run_09.xml&quot;,
                &quot;status&quot;: &quot;NOK&quot;,
                &quot;message&quot;: &quot;metadata was not validated by XSD schema&quot;
            }, {
                &quot;date&quot;: &quot;2010-01-07T19:55:99.999Z&quot;,
                &quot;xml&quot;: &quot;xml_samplesheet_2017_01_07_run_09.xml&quot;,
                &quot;status&quot;: &quot;OKKKKKKK&quot;,
                &quot;message&quot;: &quot;metadata loaded into iRODS successfullyyyyy&quot;
            }]
        }
    }

Add new element to existing JSON array with jq

I get `Cannot iterate over null (null)` from the below query because `.property_history` is not present in `result` object.

How do i check for the presence of `.property_history` key before proceeding with `map(...)` ?

I tried using something like ``sold_year= `echo &quot;$content&quot; | jq &#39;if has(&quot;property_history&quot;) then 
map(select(.event_name == &quot;Sold&quot;))[0].date&#39; else null end``

**Original Query:**

    sold_year=`echo &quot;$content&quot; | jq &#39;.result.property_history | map(select(.event_name == &quot;Sold&quot;))[0].date&#39;`

**JSON:**

    {  
       &quot;result&quot;:{  
          &quot;property_history&quot;:[  
             {  
                &quot;date&quot;:&quot;01/27/2016&quot;,
                &quot;price_changed&quot;:0,
                &quot;price&quot;:899750,
                &quot;event_name&quot;:&quot;Listed&quot;,
                &quot;sqft&quot;:0
             },
             {  
                &quot;date&quot;:&quot;12/15/2015&quot;,
                &quot;price_changed&quot;:0,
                &quot;price&quot;:899750,
                &quot;event_name&quot;:&quot;Listed&quot;,
                &quot;sqft&quot;:2357
             },
             {  
                &quot;date&quot;:&quot;08/30/2004&quot;,
                &quot;price_changed&quot;:0,
                &quot;price&quot;:739000,
                &quot;event_name&quot;:&quot;Sold&quot;,
                &quot;sqft&quot;:2357
             }
          ]
       }
    }



How to check for presence of &#39;key&#39; in jq before iterating over the values

I would like to convert the stream of objects:

    {
      &quot;a&quot;: &quot;green&quot;,
      &quot;b&quot;: &quot;white&quot;
    }
    {
      &quot;a&quot;: &quot;red&quot;,
      &quot;c&quot;: &quot;purple&quot;
    }

into one object:

    {
      &quot;a&quot;: &quot;red&quot;,
      &quot;b&quot;: &quot;white&quot;,
      &quot;c&quot;: &quot;purple&quot;
    }


Also, how can I wrap the same sequence into an array?

    [
        {
          &quot;a&quot;: &quot;green&quot;,
          &quot;b&quot;: &quot;white&quot;
        },
        {
          &quot;a&quot;: &quot;red&quot;,
          &quot;c&quot;: &quot;purple&quot;
        }
    ]


Sadly, the manual is seriously lacking in comprehensiveness, and googling doesn&#39;t find the answers either.


How to combine the sequence of objects in jq into one object?

I have the following in a file (which I will call &quot;myfile&quot;):

    [{
    	&quot;id&quot;: 123,
    	&quot;name&quot;: &quot;John&quot;,
    	&quot;aux&quot;: [{
    		&quot;abc&quot;: &quot;random&quot;,
    		&quot;def&quot;: &quot;I want this&quot;
    	}],
    	&quot;blah&quot;: 23.11
    }]

I can parse it without the `[` and `]` as follows:

    $ cat myfile | jq -r &#39;.aux[] | .def&#39;
    I want this
    $

but with the `[` and `]` I get:

    $ cat myfile | jq -r &#39;.aux[] | .def&#39;
    jq: error: Cannot index array with string

How can I deal with the `[` and `]` using jq? (I&#39;m sure I could parse them off with a different tool but I want to learn correct usage of jq.

jq: Cannot index array with string

I want to convert JSON string into an array in bash.
The JSON string is passed to the bash script as an argument (it doesn&#39;t exist in a file).

Is there a way of achieving it without using some temp files?

Similarly to this:

    script.sh

    #! /bin/bash
    json_data=&#39;{&quot;key&quot;:&quot;value&quot;}&#39;
    jq &#39;.key&#39; $json_data

    jq: error: Could not open file {key:value}: No such file or directory

Can I pass a string variable to jq not the file?

I can get the 1st element in a json inside []

    $ echo &#39;[{&quot;a&quot;:&quot;x&quot;, &quot;b&quot;:true}, {&quot;a&quot;:&quot;XML&quot;, &quot;b&quot;:false}]&#39; | jq &#39;.[1]&#39;
    {
      &quot;a&quot;: &quot;XML&quot;,
      &quot;b&quot;: false
    }
But if the json is already disassembled (for instance, after filtering entries using &#39;select&#39;), how can I choose a single entry and avoid the error seen here?

    $ echo &#39;[{&quot;a&quot;:&quot;x&quot;, &quot;b&quot;:true}, {&quot;a&quot;:&quot;x&quot;, &quot;b&quot;:false},{&quot;a&quot;:&quot;XML&quot;, &quot;b&quot;:false}]&#39; | jq &#39;.[] | select( .a == &quot;x&quot;)&#39;
    {
      &quot;a&quot;: &quot;x&quot;,
      &quot;b&quot;: true
    }
    {
      &quot;a&quot;: &quot;x&quot;,
      &quot;b&quot;: false
    }
    $ echo &#39;[{&quot;a&quot;:&quot;x&quot;, &quot;b&quot;:true}, {&quot;a&quot;:&quot;x&quot;, &quot;b&quot;:false},{&quot;a&quot;:&quot;XML&quot;, &quot;b&quot;:false}]&#39; | jq &#39;.[] | select( .a == &quot;x&quot;) | .[1]&#39;
    jq: error (at &lt;stdin&gt;:1): Cannot index object with number



get the first (or n&#39;th) element in a jq json parsing

Say I have the input:

    {
        &quot;name&quot;: &quot;John&quot;,
        &quot;email&quot;: &quot;john@company.com&quot;
    }
    {
        &quot;name&quot;: &quot;Brad&quot;,
        &quot;email&quot;: &quot;brad@company.com&quot;
    }

How do I get the output:

    [
        {
            &quot;name&quot;: &quot;John&quot;,
            &quot;email&quot;: &quot;john@company.com&quot;
        },
        {
            &quot;name&quot;: &quot;Brad&quot;,
            &quot;email&quot;: &quot;brad@company.com&quot;
        }
    ]

I tried both:

    jq &#39;[. | {name, email}]&#39;

and 

    jq &#39;. | [{name, email}]&#39;

which both gave me the output

    [
        {
            &quot;name&quot;: &quot;John&quot;,
            &quot;email&quot;: &quot;john@company.com&quot;
        }
    ]
    [
        {
            &quot;name&quot;: &quot;Brad&quot;,
            &quot;email&quot;: &quot;brad@company.com&quot;
        }
    ]

I also saw no options for an array output in the documentations, any help appreciated

jq: output array of json objects

I have the following json file:

    {
        &quot;FOO&quot;: {
            &quot;name&quot;: &quot;Donald&quot;,
            &quot;location&quot;: &quot;Stockholm&quot;
        },
        &quot;BAR&quot;: {
            &quot;name&quot;: &quot;Walt&quot;,
            &quot;location&quot;: &quot;Stockholm&quot;
        },
        &quot;BAZ&quot;: {
            &quot;name&quot;: &quot;Jack&quot;,
            &quot;location&quot;: &quot;Whereever&quot;
        }
    }

I am using jq and want to get the &quot;name&quot; elements of the objects where &#39;location&#39; is &#39;Stockholm&#39;. 

I know I can get all names by

    cat json | jq .[] | jq .&quot;name&quot;
    &quot;Jack&quot;
    &quot;Walt&quot;
    &quot;Donald&quot;

But I can&#39;t figure out how to print only certain objects, given the value of a sub key (here: `&quot;location&quot; : &quot;Stockholm&quot;`). 

Select objects based on value of variable in object using jq

I have this Json

    {
        &quot;users&quot;: [
            {
                &quot;first&quot;: &quot;Stevie&quot;,
                &quot;last&quot;: &quot;Wonder&quot;
            },
            {
                &quot;first&quot;: &quot;Michael&quot;,
                &quot;last&quot;: &quot;Jackson&quot;
            }
        ]
    }

Using jq I&#39;d like to display first and last name serially. Like so - 

    Stevie Wonder
    Michael Jackson

This is how far I have gotten - 

    jq &#39;.users[].first, .users[].last&#39;

But it displays

    &quot;Stevie&quot;
    &quot;Michael&quot;
    &quot;Wonder&quot;
    &quot;Jackson&quot;

Notice the following:

1. The double quotes that I do not want.
2. The carriage return that I do not want.
3. It&#39;s jumbled up. My query displays all the first names first, and then all the last names. However, I want first-last, first-last pair.

Using jq to parse and display multiple fields in a json serially

I have `gitbash` in Windows. I am trying to run `jq` but its giving me error.

    $ ./jq-win64.exe 
    jq 
    parse error: Invalid numeric literal at line 2, column 0

*Intention*: I want to use `jq` to parse json.



How to run jq from gitbash in windows?

Given this input:

    [
      {
        &quot;Id&quot;: &quot;cb94e7a42732b598ad18a8f27454a886c1aa8bbba6167646d8f064cd86191e2b&quot;,
        &quot;Names&quot;: [
          &quot;condescending_jones&quot;,
          &quot;loving_hoover&quot;
        ]
      },
      {
        &quot;Id&quot;: &quot;186db739b7509eb0114a09e14bcd16bf637019860d23c4fc20e98cbe068b55aa&quot;,
        &quot;Names&quot;: [
          &quot;foo_data&quot;
        ]
      },
      {
        &quot;Id&quot;: &quot;a4b7e6f5752d8dcb906a5901f7ab82e403b9dff4eaaeebea767a04bac4aada19&quot;,
        &quot;Names&quot;: [
          &quot;jovial_wozniak&quot;
        ]
      },
      {
        &quot;Id&quot;: &quot;76b71c496556912012c20dc3cbd37a54a1f05bffad3d5e92466900a003fbb623&quot;,
        &quot;Names&quot;: [
          &quot;bar_data&quot;
        ]
      }
    ]

I&#39;m trying to construct a filter with [jq](http://stedolan.github.io/jq/) that returns all objects with `Id`s that **do not** contain &quot;data&quot; in the inner `Names` array, with the output being newline-separated.  For the above data, the output I&#39;d like is:

    cb94e7a42732b598ad18a8f27454a886c1aa8bbba6167646d8f064cd86191e2b
    a4b7e6f5752d8dcb906a5901f7ab82e403b9dff4eaaeebea767a04bac4aada19

I think I&#39;m somewhat close with this:

    (. - select(.Names[] contains(&quot;data&quot;))) | .[] .Id

but the `select` filter is not correct and it doesn&#39;t compile (get `error: syntax error, unexpected IDENT`).

How to filter an array of objects based on values in an inner array with jq?

## Background ##

I have a json file that contains a string of json within an object:

    {
        &quot;requestType&quot;: &quot;POST&quot;,
        &quot;response&quot;: {
            &quot;size&quot;: 78,
            &quot;text&quot;: &quot;{\&quot;recordID\&quot;:123, \&quot;title\&quot;:\&quot;Hello World\&quot;, \&quot;content\&quot;:\&quot;Lorem ipsum...\&quot;}&quot;
        }
    }

I need to interperet the contents of the `.response.text` string as json using the json command line interpereter, [jq][1].

When I run this command:

    jq &#39;.response.text | @json&#39;

Output: `&quot;\&quot;{\\\&quot;recordID\\\&quot;:123, \\\&quot;title\\\&quot;:\\\&quot;Hello World\\\&quot;, \\\&quot;content\\\&quot;:\\\&quot;Lorem ipsum...\\\&quot;}\&quot;&quot;`

I get some weird escaped json string instead of json that I can access via something like this: `.response.text | @json | .recordID`.

I realize that the `@json` function will take json and output a json escaped string, so there must be another way, but `@text` doesn&#39;t seem to do anything.

## Question ##

Is there some way to convert a string of escaped json to actual json that I can parse with a command such as this: `jq &#39;.response.text | @json | .title&#39;` and get this output: `&quot;Hello World&quot;`?

  [1]: https://stedolan.github.io/jq/

Convert string to json in jq

Is there a way to install jq JSON processor on Ubuntu 10.04?

I Tried the usual `sudo apt-get install jq` but got the error `E: Couldn&#39;t find package jq`

Install jq JSON processor on Ubuntu 10.04

I have an array:

    [
        {
            &quot;AssetId&quot;: 14462955,
            &quot;Name&quot;: &quot;Cultural Item&quot;
        },
        {
            &quot;AssetId&quot;: 114385498,
            &quot;Name&quot;: &quot;Redspybot&quot;
        },
        {
            &quot;AssetId&quot;: 29715011,
            &quot;Name&quot;: &quot;American Cowboy&quot;
        },
        {
            &quot;AssetId&quot;: 98253651,
            &quot;Name&quot;: &quot;Mahem&quot;
        }
    ]


   
I would like to loop through each object in this array, and pick out the value of each key called `AssetId` and output it.
How would I do this using jq for the command line?



Output specific key value in object for each element in array with jq for JSON

I like to filter json files using [jq](https://stedolan.github.io/jq/):

    jq . some.json

Given the json containing an array of objects:

    {
      &quot;theList&quot;: [
        {
          &quot;id&quot;: 1,
          &quot;name&quot;: &quot;Horst&quot;
        },
        {
          &quot;id&quot;: 2,
          &quot;name&quot;: &quot;Fritz&quot;
        },
        {
          &quot;id&quot;: 3,
          &quot;name&quot;: &quot;Walter&quot;
        },
        {
          &quot;id&quot;: 4,
          &quot;name&quot;: &quot;Gerhart&quot;
        },
        {
          &quot;id&quot;: 5,
          &quot;name&quot;: &quot;Harmut&quot;
        }
      ]
    }

I want to filter that list to only show the elements with id having the value 2 and 4, so the expected output is:

    {
      &quot;id&quot;: 2,
      &quot;name&quot;: &quot;Fritz&quot;
    },
    {
      &quot;id&quot;: 4,
      &quot;name&quot;: &quot;Gerhart&quot;
    }

How do I filter the json using jq? I have played around with select and map, yet didn&#39;t got any of those to work, e.g.:

    $ jq &#39;.theList[] | select(.id == 2) or select(.id == 4)&#39; array.json
    true

How to filter array of objects by element property values using jq?

I have a JSON data as follows in data.json file

    [
      {&quot;original_name&quot;:&quot;pdf_convert&quot;,&quot;changed_name&quot;:&quot;pdf_convert_1&quot;},
      {&quot;original_name&quot;:&quot;video_encode&quot;,&quot;changed_name&quot;:&quot;video_encode_1&quot;},
      {&quot;original_name&quot;:&quot;video_transcode&quot;,&quot;changed_name&quot;:&quot;video_transcode_1&quot;}
    ]


I want to iterate through the array and extract the value for each element in a loop. I saw [jq][1]. I find it difficult to use it to iterate. How can I do that?


  [1]: https://stedolan.github.io/jq/manual/

All Jq Solutions on Gang of Coders

Total of 45 Jq Solutions