d718c5a372
CI / compile_and_lint (push) Failing after 0s
CI / docker_build (linux/amd64, -linux-amd64-duckdb, duckdb) (push) Failing after 0s
CI / docker_build (linux/arm64, -linux-arm64, minimal) (push) Failing after 2s
CI / docker_build (linux/arm64, -linux-arm64-duckdb, duckdb) (push) Failing after 1s
CI / docker_build (linux/amd64, minimal) (push) Failing after 1s
CI / test (, sqlite, sqlite::memory:) (push) Has been skipped
CI / test (mssql, mssql, mssql://root:Password123!@127.0.0.1/sqlpage) (push) Has been skipped
CI / test (mysql, mysql, mysql://root:Password123!@127.0.0.1/sqlpage) (push) Has been skipped
CI / test (oracle, oracle, Driver=Oracle 21 ODBC driver;Dbq=//127.0.0.1:1521/FREEPDB1;Uid=root;Pwd=Password123!) (push) Has been skipped
CI / test (postgres, odbc, Driver=PostgreSQL Unicode;Server=127.0.0.1;Port=5432;Database=sqlpage;UID=root;PWD=Password123!, true) (push) Has been skipped
CI / test (postgres, postgres, postgres://root:Password123!@127.0.0.1/sqlpage) (push) Has been skipped
CI / playwright (push) Has been skipped
CI / docker_build (linux/arm/v7, -linux-arm-v7, minimal) (push) Failing after 0s
CI / hurl_examples (push) Failing after 8s
deploy website / deploy_official_site (push) Failing after 1s
CI / hurl (${{ matrix.example }}) (push) Has been skipped
CI / docker_push (duckdb) (push) Has been cancelled
CI / docker_push (minimal) (push) Has been cancelled
CI / windows_test (push) Has been cancelled
585 lines
15 KiB
SQL
585 lines
15 KiB
SQL
INSERT INTO blog_posts (title, description, icon, created_at, content)
|
|
VALUES
|
|
(
|
|
'JSON in SQL: A Comprehensive Guide',
|
|
'A comprehensive guide to working with JSON data in SQLite, PostgreSQL, MySQL, and SQL Server.',
|
|
'braces',
|
|
'2024-09-03',
|
|
'
|
|
# JSON in SQL: A Comprehensive Guide
|
|
|
|
## Introduction
|
|
|
|
JSON (JavaScript Object Notation) is a popular data format for unstructured data. It allows storing composite data types, such as arrays and objects, in a single SQL value.
|
|
Many modern applications use JSON to store and exchange data. As a result, SQL databases have incorporated JSON support to allow developers to work with structured and semi-structured data within the same database.
|
|
|
|
This guide will cover JSON operations in SQLite, PostgreSQL, MySQL, and SQL Server, focusing on querying JSON data.
|
|
|
|
SQLPage uses JSON both to pass data to the database (when a SQLPage variable contains an array), and to pass data to components (when a component has a JSON parameter).
|
|
Thus, understanding how to work with JSON in SQL will allow you to fully leverage advanced SQLPage features.
|
|
|
|
JSON supports the following data types:
|
|
|
|
- **Objects**: A mapping between keys and values (`{ "key": "value" }`). Keys must be strings, and values can be of different types.
|
|
- **Arrays**: An ordered list of values enclosed in square brackets (`[ "value1", "value2" ]`). Values can be of different types.
|
|
- **Strings**: A sequence of characters enclosed in double quotes (`"Hello, World!"`).
|
|
- **Numbers**: An integer or floating-point number (`42`, `3.14`).
|
|
- **Boolean**: A true or false value (`true`, `false`).
|
|
- **Null**: A null value (`null`).
|
|
|
|
## Sample Table
|
|
|
|
We''ll use the following sample table for our examples:
|
|
|
|
```sql
|
|
CREATE TABLE users (
|
|
id INT PRIMARY KEY,
|
|
name VARCHAR(50),
|
|
birthday DATE,
|
|
group_name VARCHAR(50)
|
|
);
|
|
|
|
INSERT INTO users (id, name, birthday, group_name) VALUES
|
|
(1, ''Alice'', ''1990-01-15'', ''Admin''),
|
|
(2, ''Bob'', ''1985-05-22'', ''User''),
|
|
(3, ''Charlie'', ''1992-09-30'', ''User'');
|
|
```
|
|
|
|
## SQLite
|
|
|
|
SQLite provides increasingly better JSON support since version 3.38.0.
|
|
See [the list of JSON functions in SQLite](https://www.sqlite.org/json1.html) for more details.
|
|
|
|
### Creating a JSON object
|
|
|
|
We can use the standard `json_object()` function to create a JSON object from columns in a table:
|
|
|
|
```sql
|
|
SELECT json_object(''name'', name, ''birthday'', birthday) AS user_json
|
|
FROM users;
|
|
```
|
|
|
|
| user_json |
|
|
|-----------|
|
|
| `{"name":"Alice","birthday":"1990-01-15"}` |
|
|
| `{"name":"Bob","birthday":"1985-05-22"}` |
|
|
| `{"name":"Charlie","birthday":"1992-09-30"}` |
|
|
|
|
### Creating a JSON array
|
|
|
|
```sql
|
|
SELECT json_array(name, birthday, group_name) AS user_array
|
|
FROM users;
|
|
```
|
|
|
|
| user_array |
|
|
|------------|
|
|
| `["Alice","1990-01-15","Admin"]` |
|
|
| `["Bob","1985-05-22","User"]` |
|
|
| `["Charlie","1992-09-30","User"]` |
|
|
|
|
### Aggregating multiple values into a JSON array
|
|
|
|
```sql
|
|
SELECT json_group_array(name) AS names
|
|
FROM users;
|
|
```
|
|
|
|
| names |
|
|
|-------|
|
|
| `["Alice","Bob","Charlie"]` |
|
|
|
|
### Aggregating values into a JSON object
|
|
|
|
```sql
|
|
SELECT json_group_object(name, group_name) AS name_group_map
|
|
FROM users;
|
|
```
|
|
|
|
| name_group_map |
|
|
|-------------------|
|
|
| `{"Alice":"Admin", "Bob":"User", "Charlie":"User"}` |
|
|
|
|
|
|
### Iterating over a JSON array
|
|
|
|
SQLite provides the `json_each()` table-valued function to iterate over JSON arrays. This function returns one row for each element in the JSON array.
|
|
|
|
```sql
|
|
SELECT value FROM json_each(''["Alice", "Bob", "Charlie"]'');
|
|
```
|
|
|
|
| value |
|
|
|-------|
|
|
| Alice |
|
|
| Bob |
|
|
| Charlie |
|
|
|
|
The `json_each()` function returns a table with several columns. The most commonly used are:
|
|
|
|
- `key`: The array index (0-based) for elements of a JSON array
|
|
- `value`: The value of the current element
|
|
- `type`: The type of the current element (e.g., ''text'', ''integer'', ''real'', ''true'', ''false'', ''null'')
|
|
|
|
For more complex JSON structures, you can use the `json_tree()` function, which recursively walks through the entire JSON structure.
|
|
|
|
These iteration functions can be used to check if specific values exist in a JSON array.
|
|
Here''s a practical example:
|
|
Let''s say you have a form with a [multiple-choice dropdown](documentation.sql?component=form#component) that allows selecting multiple users.
|
|
Some users might already be selected, and their IDs are stored in a JSON array passed as an URL parameter called `$selected_ids`.
|
|
You can create this dropdown using the following query:
|
|
|
|
```sql
|
|
select json_group_array(json_object(
|
|
''label'', name,
|
|
''value'', id,
|
|
''selected'', id in (select value from json_each_text($selected_ids))
|
|
)) as options
|
|
from users;
|
|
```
|
|
|
|
This query will:
|
|
1. Create a dropdown option for each user
|
|
2. Use their name as the display label
|
|
3. Use their ID as the value
|
|
4. Mark the option as selected if the user''s ID exists in the $selected_ids array
|
|
|
|
### Combining two JSON objects
|
|
|
|
SQLite provides the `json_patch()` function to combine two JSON objects. This function takes two JSON objects as arguments and returns a new JSON object that is the result of merging the two input objects.
|
|
|
|
```sql
|
|
SELECT json_patch(''{"name": "Alice"}'', ''{"birthday": "1990-01-15"}'') AS user_json;
|
|
```
|
|
|
|
| user_json |
|
|
|-----------|
|
|
| {"name": "Alice", "birthday": "1990-01-15"} |
|
|
|
|
## PostgreSQL
|
|
|
|
PostgreSQL has extensive support for JSON, including the `jsonb` type, which offers better performance and more functionality than the `json` type.
|
|
See [the list of JSON functions in PostgreSQL](https://www.postgresql.org/docs/current/functions-json.html) for more details.
|
|
|
|
### Creating a JSON object
|
|
|
|
```sql
|
|
SELECT
|
|
jsonb_build_object(
|
|
''name'', name,
|
|
''birthday'', birthday
|
|
) AS user_json
|
|
FROM users;
|
|
```
|
|
|
|
| user_json |
|
|
|-----------|
|
|
| `{"name":"Alice","birthday":"1990-01-15"}` |
|
|
| `{"name":"Bob","birthday":"1985-05-22"}` |
|
|
| `{"name":"Charlie","birthday":"1992-09-30"}` |
|
|
|
|
### Creating a JSON array
|
|
|
|
```sql
|
|
SELECT
|
|
jsonb_build_array(
|
|
name, birthday, group_name
|
|
) AS user_array
|
|
FROM users;
|
|
```
|
|
|
|
| user_array |
|
|
|------------|
|
|
| `["Alice", "1990-01-15", "Admin"]` |
|
|
| `["Bob", "1985-05-22", "User"]` |
|
|
| `["Charlie", "1992-09-30", "User"]` |
|
|
|
|
### Aggregating multiple values into a JSON array
|
|
|
|
```sql
|
|
SELECT jsonb_agg(name) AS names FROM users;
|
|
```
|
|
|
|
| names |
|
|
|-------|
|
|
| `["Alice","Bob","Charlie"]` |
|
|
|
|
### Aggregating values into a JSON object
|
|
|
|
```sql
|
|
SELECT
|
|
jsonb_object_agg(
|
|
name, birthday
|
|
) AS name_birthday_map
|
|
FROM users;
|
|
```
|
|
|
|
| name_birthday_map |
|
|
|-------------------|
|
|
| `{"Alice":"1990-01-15","Bob":"1985-05-22","Charlie":"1992-09-30"}` |
|
|
|
|
|
|
### Iterating over a JSON array
|
|
|
|
```sql
|
|
SELECT name FROM jsonb_array_elements_text(''["Alice", "Bob", "Charlie"]''::jsonb) AS name;
|
|
```
|
|
|
|
| name |
|
|
|------|
|
|
| Alice |
|
|
| Bob |
|
|
| Charlie |
|
|
|
|
You can use this function to test whether a value is present in a JSON array. For instance, to create a
|
|
[multi-value select dropdown](documentation.sql?component=form#component) with pre-selected values, you can use the following query:
|
|
|
|
```sql
|
|
SELECT jsonb_agg(jsonb_build_object(
|
|
''label'', name,
|
|
''value'', id,
|
|
''selected'', id in (SELECT value FROM jsonb_array_elements_text($selected_ids::jsonb))
|
|
)) AS options
|
|
FROM users;
|
|
```
|
|
|
|
### Iterating over a JSON object
|
|
|
|
```sql
|
|
SELECT key, value
|
|
FROM jsonb_each_text(''{"name": "Alice", "birthday": "1990-01-15"}''::jsonb);
|
|
```
|
|
|
|
| key | value |
|
|
|-----|-------|
|
|
| name | Alice |
|
|
| birthday | 1990-01-15 |
|
|
|
|
### Querying JSON data
|
|
|
|
PostgreSQL allows you to query JSON data using the `->` and `->>` operators:
|
|
|
|
```sql
|
|
SELECT name, user_data->>''age'' AS age
|
|
FROM (
|
|
SELECT name, jsonb_build_object(''age'', EXTRACT(YEAR FROM AGE(birthday))) AS user_data
|
|
FROM users
|
|
) subquery
|
|
WHERE (user_data->>''age'')::int > 30;
|
|
```
|
|
|
|
| name | age |
|
|
|------|-----|
|
|
| Bob | 38 |
|
|
|
|
### Combining two JSON objects
|
|
|
|
PostgreSQL provides the `||` operator to combine two JSON objects.
|
|
|
|
```sql
|
|
SELECT ''{"name": "Alice"}''::jsonb || ''{"birthday": "1990-01-15"}''::jsonb AS user_json;
|
|
```
|
|
|
|
| user_json |
|
|
|-----------|
|
|
| {"name": "Alice", "birthday": "1990-01-15"} |
|
|
|
|
## MySQL / MariaDB
|
|
|
|
MySQL has good support for JSON operations starting from version 5.7.
|
|
See [the list of JSON functions in MySQL](https://dev.mysql.com/doc/refman/8.0/en/json-functions.html) for more details.
|
|
|
|
### Creating a JSON object
|
|
|
|
```sql
|
|
SELECT JSON_OBJECT(''name'', name, ''birthday'', birthday) AS user_json
|
|
FROM users;
|
|
```
|
|
|
|
| user_json |
|
|
|-----------|
|
|
| `{"name":"Alice","birthday":"1990-01-15"}` |
|
|
| `{"name":"Bob","birthday":"1985-05-22"}` |
|
|
| `{"name":"Charlie","birthday":"1992-09-30"}` |
|
|
|
|
### Creating a JSON array
|
|
|
|
```sql
|
|
SELECT JSON_ARRAY(name, birthday, group_name) AS user_array
|
|
FROM users;
|
|
```
|
|
|
|
| user_array |
|
|
|------------|
|
|
| `["Alice","1990-01-15","Admin"]` |
|
|
| `["Bob","1985-05-22","User"]` |
|
|
| `["Charlie","1992-09-30","User"]` |
|
|
|
|
### Aggregating multiple values into a JSON array
|
|
|
|
```sql
|
|
SELECT JSON_ARRAYAGG(name) AS names
|
|
FROM users;
|
|
```
|
|
|
|
| names |
|
|
|-------|
|
|
| `["Alice","Bob","Charlie"]` |
|
|
|
|
### Aggregating values into a JSON object
|
|
|
|
```sql
|
|
SELECT JSON_OBJECTAGG(name, birthday) AS name_birthday_map
|
|
FROM users;
|
|
```
|
|
|
|
| name_birthday_map |
|
|
|-------------------|
|
|
| `{"Alice":"1990-01-15","Bob":"1985-05-22","Charlie":"1992-09-30"}` |
|
|
|
|
### Iterating over a JSON array
|
|
|
|
MySQL provides the JSON_TABLE() function to iterate over JSON arrays. This powerful function allows you to convert JSON data into a relational table format, making it easy to work with JSON arrays.
|
|
|
|
Here''s an example of how to use JSON_TABLE() to iterate over a JSON array:
|
|
|
|
```sql
|
|
SELECT jt.name
|
|
FROM JSON_TABLE(
|
|
''["Alice", "Bob", "Charlie"]'',
|
|
''$[*]'' COLUMNS( name VARCHAR(50) PATH ''$'' )
|
|
) AS jt;
|
|
```
|
|
|
|
| name |
|
|
|---------|
|
|
| Alice |
|
|
| Bob |
|
|
| Charlie |
|
|
|
|
In this example:
|
|
- The first argument to JSON_TABLE() is the JSON array.
|
|
- `''$[*]''` is the path expression that selects all elements of the array.
|
|
- The `COLUMNS` clause defines the structure of the output table. In our case, we want a single column named `name`:
|
|
- `name VARCHAR(50) PATH ''$''` creates a text column that contains the raw value of each array element in its entirety (`$` is the current element).
|
|
|
|
You can also use JSON_TABLE() with more complex JSON structures:
|
|
|
|
```sql
|
|
SELECT jt.*
|
|
FROM JSON_TABLE(
|
|
''[{"id": 1, "name": "Alice"}, {"id": 2, "name": "Bob"}, {"id": 3, "name": "Charlie"}]'',
|
|
''$[*]'' COLUMNS(
|
|
id INT PATH ''$.id'',
|
|
name VARCHAR(50) PATH ''$.name''
|
|
)
|
|
) AS jt;
|
|
```
|
|
|
|
| id | name |
|
|
|----|---------|
|
|
| 1 | Alice |
|
|
| 2 | Bob |
|
|
| 3 | Charlie |
|
|
|
|
This approach allows you to easily iterate over JSON arrays and access their elements in a tabular format, which can be very useful for further processing or joining with other tables in your database.
|
|
|
|
### Iterating over a JSON object
|
|
|
|
The `JSON_TABLE` function can also be used to iterate over JSON objects:
|
|
|
|
```sql
|
|
SELECT jt.*
|
|
FROM JSON_TABLE(
|
|
''{"name": "Alice", "birthday": "1990-01-15"}'',
|
|
''$.*'' COLUMNS (
|
|
value JSON PATH ''$''
|
|
)
|
|
) AS jt;
|
|
```
|
|
|
|
| value |
|
|
|-------|
|
|
| "Alice" |
|
|
| "1990-01-15" |
|
|
|
|
#### Iterating over key-value pairs
|
|
|
|
You can use the `JSON_KEYS()` function to retrieve the list of keys in a JSON object as a JSON array,
|
|
then use that array to iterate over the keys of a JSON object:
|
|
|
|
```sql
|
|
SELECT json_key, json_extract(json_str, CONCAT(''$.'', json_key)) as json_value
|
|
FROM
|
|
(select ''{"name": "Alice", "birthday": "1990-01-15"}'' as json_str) AS my_json,
|
|
JSON_TABLE(json_keys(json_str), ''$[*]'' COLUMNS (json_key JSON PATH ''$'')) AS json_keys;
|
|
```
|
|
|
|
| json_key | json_value |
|
|
|----------|------------|
|
|
| name | Alice |
|
|
| birthday | 1990-01-15 |
|
|
|
|
### Querying JSON data
|
|
|
|
MySQL allows you to query JSON data using the `->` and `->>` operators:
|
|
|
|
```sql
|
|
SELECT name, user_data->''$.age'' AS age
|
|
FROM (
|
|
SELECT name, JSON_OBJECT(''age'', YEAR(CURDATE()) - YEAR(birthday)) AS user_data
|
|
FROM users
|
|
) subquery
|
|
WHERE user_data->''$.age'' > 30;
|
|
```
|
|
|
|
| name | age |
|
|
|------|-----|
|
|
| Bob | 38 |
|
|
|
|
## Microsoft SQL Server
|
|
|
|
SQL Server has support for JSON operations starting from SQL Server 2016.
|
|
See [the list of JSON functions in SQL Server](https://learn.microsoft.com/en-us/sql/t-sql/functions/json-functions-transact-sql?view=sql-server-ver16) for more details.
|
|
|
|
# JSON in SQL: A Comprehensive Guide
|
|
|
|
[Previous sections remain unchanged]
|
|
|
|
## Microsoft SQL Server
|
|
|
|
SQL Server has support for JSON operations starting from SQL Server 2016. It provides a comprehensive set of functions for working with JSON data.
|
|
See [the list of JSON functions in SQL Server](https://learn.microsoft.com/en-us/sql/t-sql/functions/json-functions-transact-sql?view=sql-server-ver16) for more details.
|
|
|
|
### Creating a JSON object
|
|
|
|
Use the `FOR JSON PATH` clause to create a JSON object:
|
|
|
|
```sql
|
|
SELECT (SELECT name, birthday FOR JSON PATH, WITHOUT_ARRAY_WRAPPER) AS user_json
|
|
FROM users;
|
|
```
|
|
|
|
| user_json |
|
|
|-----------|
|
|
| `{"name":"Alice","birthday":"1990-01-15"}` |
|
|
| `{"name":"Bob","birthday":"1985-05-22"}` |
|
|
| `{"name":"Charlie","birthday":"1992-09-30"}` |
|
|
|
|
Alternatively, you can use the `JSON_OBJECT` function:
|
|
|
|
```sql
|
|
SELECT JSON_OBJECT(''name'': name, ''birthday'': birthday) AS user_json
|
|
FROM users;
|
|
```
|
|
|
|
### Creating a JSON array
|
|
|
|
Use the `FOR JSON PATH` clause to create a JSON array:
|
|
|
|
```sql
|
|
SELECT (SELECT name, birthday, group_name FOR JSON PATH) AS user_array
|
|
FROM users;
|
|
```
|
|
|
|
| user_array |
|
|
|------------|
|
|
| `[{"name":"Alice","birthday":"1990-01-15","group_name":"Admin"}]` |
|
|
| `[{"name":"Bob","birthday":"1985-05-22","group_name":"User"}]` |
|
|
| `[{"name":"Charlie","birthday":"1992-09-30","group_name":"User"}]` |
|
|
|
|
You can also use the `JSON_ARRAY` function:
|
|
|
|
```sql
|
|
SELECT JSON_ARRAY(name, birthday, group_name) AS user_array
|
|
FROM users;
|
|
```
|
|
|
|
### Aggregating multiple values into a JSON array
|
|
|
|
Use the `FOR JSON PATH` clause to aggregate values into a JSON array:
|
|
|
|
```sql
|
|
SELECT (SELECT name FROM users FOR JSON PATH) AS names;
|
|
```
|
|
|
|
| names |
|
|
|-------|
|
|
| `[{"name":"Alice"},{"name":"Bob"},{"name":"Charlie"}]` |
|
|
|
|
Alternatively, use the `JSON_ARRAYAGG` function:
|
|
|
|
```sql
|
|
SELECT JSON_ARRAYAGG(name) AS names FROM users;
|
|
```
|
|
|
|
### Aggregating values into a JSON object
|
|
|
|
```sql
|
|
SELECT JSON_OBJECTAGG(name: birthday) AS name_birthday_map FROM users;
|
|
```
|
|
|
|
### Iterating over a JSON array
|
|
|
|
Use the `OPENJSON` function to iterate over JSON arrays:
|
|
|
|
```sql
|
|
SELECT value FROM OPENJSON(''["Alice", "Bob", "Charlie"]'');
|
|
```
|
|
|
|
| value |
|
|
|-------|
|
|
| Alice |
|
|
| Bob |
|
|
| Charlie |
|
|
|
|
### Iterating over a JSON object
|
|
|
|
Use `OPENJSON` to iterate over JSON objects:
|
|
|
|
```sql
|
|
SELECT *
|
|
FROM OPENJSON(''{"name": "Alice", "birthday": "1990-01-15"}'')
|
|
WITH (
|
|
name NVARCHAR(50) ''$.name'',
|
|
birthday DATE ''$.birthday''
|
|
);
|
|
```
|
|
|
|
| name | birthday |
|
|
|------|----------|
|
|
| Alice | 1990-01-15 |
|
|
|
|
### Querying JSON data
|
|
|
|
Use the `JSON_VALUE` function to extract scalar values from JSON:
|
|
|
|
```sql
|
|
SELECT JSON_VALUE(''{"age": 38}'', ''$.age'') AS age
|
|
```
|
|
|
|
| age |
|
|
|-----|
|
|
| 38 |
|
|
|
|
### Additional JSON Functions
|
|
|
|
SQL Server provides several other useful JSON functions:
|
|
|
|
- `ISJSON`: Tests whether a string contains valid JSON.
|
|
- `JSON_MODIFY`: Updates the value of a property in a JSON string.
|
|
- `JSON_PATH_EXISTS`: Tests whether a specified SQL/JSON path exists in the input JSON string.
|
|
- `JSON_QUERY`: Extracts an object or an array from a JSON string.
|
|
|
|
Example using `JSON_MODIFY`:
|
|
|
|
```sql
|
|
SELECT JSON_MODIFY(''{"name": "Alice", "age": 30}'', ''$.age'', 31) AS updated_json;
|
|
```
|
|
|
|
| updated_json |
|
|
|--------------|
|
|
| {"name": "Alice", "age": 31} |
|
|
|
|
This comprehensive guide covers the basics of working with JSON in SQLite, PostgreSQL, MySQL, and SQL Server. Each database has its own set of functions and syntax for JSON operations, but the general concepts remain similar across all platforms.
|
|
'); |