| Stage Id ▾ | Description | Submitted | Duration | Tasks: Succeeded/Total | Input | Output | Shuffle Read | Shuffle Write |
|---|---|---|---|---|---|---|---|---|
| 152 | Spark Connect - session_id: "0cbd7a31-b3a1-4d9c-a2f9-9dc4a6c93a95"
plan {
root {
common {
plan_id: 16
}
limit {
inp... session_id: "0cbd7a31-b3a1-4d9c-a2f9-9dc4a6c93a95"
plan {
root {
common {
plan_id: 16
}
limit {
input {
common {
plan_id: 15
}
sql {
query: "select * except(passenger_count), cast(passenger_count as string) from trips"
}
}
limit: 1000
}
}
}
client_type: "_SPARK_CONNECT_PYTHON spark/4.1.0 os/linux python/3.13.11"
request_options {
result_chunking_options {
allow_arrow_batch_chunking: true
}
}
request_options {
reattach_options {
reattachable: true
}
}
operation_id: "d08dab23-ecf9-408d-a2ce-a89a8b47509f"
client_observed_server_side_session_id: "1d64c7ed-cc1f-47c0-8ed9-f514b8adc785"
| Unknown | Unknown |
0/1
|
| Stage Id ▾ | Description | Submitted | Duration | Tasks: Succeeded/Total | Input | Output | Shuffle Read | Shuffle Write | Failure Reason |
|---|---|---|---|---|---|---|---|---|---|
| 151 | Spark Connect - session_id: "0cbd7a31-b3a1-4d9c-a2f9-9dc4a6c93a95"
plan {
root {
common {
plan_id: 16
}
limit {
inp... Spark Connect - session_id: "0cbd7a31-b3a1-4d9c-a2f9-9dc4a6c93a95"
plan {
root {
common {
plan_id: 16
}
limit {
inp... session_id: "0cbd7a31-b3a1-4d9c-a2f9-9dc4a6c93a95"
plan {
root {
common {
plan_id: 16
}
limit {
input {
common {
plan_id: 15
}
sql {
query: "select * except(passenger_count), cast(passenger_count as string) from trips"
}
}
limit: 1000
}
}
}
client_type: "_SPARK_CONNECT_PYTHON spark/4.1.0 os/linux python/3.13.11"
request_options {
result_chunking_options {
allow_arrow_batch_chunking: true
}
}
request_options {
reattach_options {
reattachable: true
}
}
operation_id: "d08dab23-ecf9-408d-a2ce-a89a8b47509f"
client_observed_server_side_session_id: "1d64c7ed-cc1f-47c0-8ed9-f514b8adc785"
| 2026/09/03 06:04:57 | 4 s |
6/62
(7 failed)
(2 killed: Stage cancelled: [FAILED_READ_FILE.PARQUET_COLUMN_DATA_TYPE_MISMATCH] Encountered error while reading file file:///home/jovyan/data/yellow-taxi/yellow_tripdata_2018-10.parquet. Data type mismatches when reading Parquet column [passenger_count]. Expected Spark type bigint, actual Parquet type DOUBLE. SQLSTATE: KD001)
| 140.9 KiB | 326.8 KiB | FAILED_READ_FILE.PARQUET_COLUMN_DATA_TYPE_MISMATCH[FAILED_READ_FILE.PARQUET_COLUMN_DATA_TYPE_MISMATCH] Encountered error while reading file file:///home/jovyan/data/yellow-taxi/yellow_tripdata_2018-10.parquet. Data type mismatches when reading Parquet column [passenger_count]. Expected Spark type bigint, actual Parquet type DOUBLE. SQLSTATE: KD001 |