| Stage Id ▾ | Description | Submitted | Duration | Tasks: Succeeded/Total | Input | Output | Shuffle Read | Shuffle Write |
|---|---|---|---|---|---|---|---|---|
| 39 | Spark Connect - session_id: "de6f26de-bb97-4181-a42a-3ea99c6daf12"
plan {
command {
create_dataframe_view {
input {
commo... Spark Connect - session_id: "de6f26de-bb97-4181-a42a-3ea99c6daf12"
plan {
command {
create_dataframe_view {
input {
commo... session_id: "de6f26de-bb97-4181-a42a-3ea99c6daf12"
plan {
command {
create_dataframe_view {
input {
common {
plan_id: 5
}
read {
data_source {
format: "json"
schema: ""
options {
key: "multiLine"
value: "true"
}
paths: "/home/jovyan/data/openaq-api-data/"
}
}
}
name: "test"
replace: true
}
}
}
client_type: "_SPARK_CONNECT_PYTHON spark/4.1.0 os/linux python/3.13.11"
request_options {
result_chunking_options {
allow_arrow_batch_chunking: true
}
}
request_options {
reattach_options {
reattachable: true
}
}
operation_id: "c00afd96-7af4-48ee-b25f-0e0ba0605efc"
client_observed_server_side_session_id: "d27997a0-9ca3-4529-947c-db8688c113aa"
| 2026/09/01 05:43:28 | 0.6 s |
1/1
| 247.4 KiB |