| Stage Id ▾ | Description | Submitted | Duration | Tasks: Succeeded/Total | Input | Output | Shuffle Read | Shuffle Write |
|---|---|---|---|---|---|---|---|---|
| 4 | Spark Connect - session_id: "caaeb6b5-f41c-4883-bf72-76dc5dc7c347"
plan {
root {
common {
plan_id: 2
}
limit {
inpu... Spark Connect - session_id: "caaeb6b5-f41c-4883-bf72-76dc5dc7c347"
plan {
root {
common {
plan_id: 2
}
limit {
inpu... session_id: "caaeb6b5-f41c-4883-bf72-76dc5dc7c347"
plan {
root {
common {
plan_id: 2
}
limit {
input {
common {
plan_id: 0
}
read {
data_source {
format: "json"
schema: ""
options {
key: "multiLine"
value: "true"
}
paths: "/home/jovyan/data/openaq-api-data/"
}
}
}
limit: 1000
}
}
}
client_type: "_SPARK_CONNECT_PYTHON spark/4.1.0 os/linux python/3.13.11"
request_options {
result_chunking_options {
allow_arrow_batch_chunking: true
}
}
request_options {
reattach_options {
reattachable: true
}
}
operation_id: "712cb346-1233-4fb4-a5cf-d4830df65817"
client_observed_server_side_session_id: "08731768-ca98-4261-91f5-7b2066e67530"
| 2026/08/31 22:08:19 | 0.5 s |
1/1
| 3.0 KiB | |||
| 3 | Spark Connect - session_id: "caaeb6b5-f41c-4883-bf72-76dc5dc7c347"
plan {
root {
common {
plan_id: 2
}
limit {
inpu... Spark Connect - session_id: "caaeb6b5-f41c-4883-bf72-76dc5dc7c347"
plan {
root {
common {
plan_id: 2
}
limit {
inpu... session_id: "caaeb6b5-f41c-4883-bf72-76dc5dc7c347"
plan {
root {
common {
plan_id: 2
}
limit {
input {
common {
plan_id: 0
}
read {
data_source {
format: "json"
schema: ""
options {
key: "multiLine"
value: "true"
}
paths: "/home/jovyan/data/openaq-api-data/"
}
}
}
limit: 1000
}
}
}
client_type: "_SPARK_CONNECT_PYTHON spark/4.1.0 os/linux python/3.13.11"
request_options {
result_chunking_options {
allow_arrow_batch_chunking: true
}
}
request_options {
reattach_options {
reattachable: true
}
}
operation_id: "712cb346-1233-4fb4-a5cf-d4830df65817"
client_observed_server_side_session_id: "08731768-ca98-4261-91f5-7b2066e67530"
| 2026/08/31 22:08:18 | 0.3 s |
2/2
| 15.5 KiB | 3.0 KiB |