| Stage Id ▾ | Description | Submitted | Duration | Tasks: Succeeded/Total | Input | Output | Shuffle Read | Shuffle Write | Failure Reason |
|---|---|---|---|---|---|---|---|---|---|
| 80 | analyzePlan at SparkConnectServiceGrpc.java:1170 org.apache.spark.sql.connect.service.SparkConnectService.analyzePlan(SparkConnectService.scala:98) org.apache.spark.connect.proto.SparkConnectServiceGrpc$MethodHandlers.invoke(SparkConnectServiceGrpc.java:1170) org.sparkproject.connect.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:182) org.sparkproject.connect.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:356) org.sparkproject.connect.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:861) org.sparkproject.connect.grpc.internal.ContextRunnable.run(ContextRunnable.java:37) org.sparkproject.connect.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133) java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) java.base/java.lang.Thread.run(Thread.java:1583) | 2026/09/02 21:12:20 | 0.4 s |
0/2
(7 failed)
(1 killed: Stage cancelled: [CANNOT_MERGE_SCHEMAS] Failed merging schemas:
Initial schema:
"STRUCT<VendorID: BIGINT, tpep_pickup_datetime: TIMESTAMP_NTZ, tpep_dropoff_datetime: TIMESTAMP_NTZ, passenger_count: DOUBLE, trip_distance: DOUBLE, RatecodeID: DOUBLE, store_and_fwd_flag: STRING, PULocationID: BIGINT, DOLocationID: BIGINT, payment_type: BIGINT, fare_amount: DOUBLE, extra: DOUBLE, mta_tax: DOUBLE, tip_amount: DOUBLE, tolls_amount: DOUBLE, improvement_surcharge: DOUBLE, total_amount: DOUBLE, congestion_surcharge: DOUBLE, airport_fee: DOUBLE>"
Schema that cannot be merged with the initial schema:
"STRUCT<VendorID: INT, tpep_pickup_datetime: TIMESTAMP_NTZ, tpep_dropoff_datetime: TIMESTAMP_NTZ, passenger_count: BIGINT, trip_distance: DOUBLE, RatecodeID: BIGINT, store_and_fwd_flag: STRING, PULocationID: INT, DOLocationID: INT, payment_type: BIGINT, fare_amount: DOUBLE, extra: DOUBLE, mta_tax: DOUBLE, tip_amount: DOUBLE, tolls_amount: DOUBLE, improvement_surcharge: DOUBLE, total_amount: DOUBLE, congestion_surcharge: DOUBLE, Airport_fee: DOUBLE>". SQLSTATE: 42KD9)
| CANNOT_MERGE_SCHEMAS[CANNOT_MERGE_SCHEMAS] Failed merging schemas: Initial schema: "STRUCT<VendorID: BIGINT, tpep_pickup_datetime: TIMESTAMP_NTZ, tpep_dropoff_datetime: TIMESTAMP_NTZ, passenger_count: DOUBLE, trip_distance: DOUBLE, RatecodeID: DOUBLE, store_and_fwd_flag: STRING, PULocationID: BIGINT, DOLocationID: BIGINT, payment_type: BIGINT, fare_amount: DOUBLE, extra: DOUBLE, mta_tax: DOUBLE, tip_amount: DOUBLE, tolls_amount: DOUBLE, improvement_surcharge: DOUBLE, total_amount: DOUBLE, congestion_surcharge: DOUBLE, airport_fee: DOUBLE>" Schema that cannot be merged with the initial schema: "STRUCT<VendorID: INT, tpep_pickup_datetime: TIMESTAMP_NTZ, tpep_dropoff_datetime: TIMESTAMP_NTZ, passenger_count: BIGINT, trip_distance: DOUBLE, RatecodeID: BIGINT, store_and_fwd_flag: STRING, PULocationID: INT, DOLocationID: INT, payment_type: BIGINT, fare_amount: DOUBLE, extra: DOUBLE, mta_tax: DOUBLE, tip_amount: DOUBLE, tolls_amount: DOUBLE, improvement_surcharge: DOUBLE, total_amount: DOUBLE, congestion_surcharge: DOUBLE, Airport_fee: DOUBLE>". SQLSTATE: 42KD9 |