Spark Connect

  • Started at: 2026/08/31 21:18:51
  • Time since start: 12 minutes 15 seconds

2 session(s) are online, running 1 Request(s)

Session Statistics (2)

Page:
User Session ID Start Time ▾ Finish Time Duration Total Execute
c137a60c-ada0-4182-9b2f-8196ee9ba103 2026/08/31 21:29:04 2 minutes 2 seconds 4
f679d0a7-9093-4f5b-a08c-e6e153a9e111 2026/08/31 21:23:33 7 minutes 33 seconds 3
Page:

Request Statistics (7)

Page:
User Job ID SQL Query ID Session ID Start Time ▾ Finish Time Close Time Execution Time Duration Statement State Operation ID Job Tag Spark Session Tags Detail
[3][4] [31][32][33] c137a60c-ada0-4182-9b2f-8196ee9ba103 2026/08/31 21:30:33 34 seconds 216 ms 34 seconds 216 ms sql_command { input { common { plan_id: 5 } sql { query: "create table if not exists test.fhvhv_trip1 using delta as select * from parquet.`/home/jovyan/Inbound/fhvhv_tripdata_2025-01.parquet`" } } } RUNNING 0a37cf72-9f3d-4081-967b-fbd3bdc3d001 SparkConnect_OperationTag_User__Session_c137a60c-ada0-4182-9b2f-8196ee9ba103_Operation_0a37cf72-9f3d-4081-967b-fbd3bdc3d001
[2] [29][30] c137a60c-ada0-4182-9b2f-8196ee9ba103 2026/08/31 21:29:37 2026/08/31 21:29:38 2026/08/31 21:29:38 889 ms 895 ms sql_command { input { common { plan_id: 4 } sql { query: "create table if not exists test.fhvhv_trip using delta as select * from parquet.`/home/jovyan/Inbound/fhvhv_tripdata_2025-01.parquet`" } } } CLOSED c8a17489-c357-47cc-88cd-f9834dd9f3ea SparkConnect_OperationTag_User__Session_c137a60c-ada0-4182-9b2f-8196ee9ba103_Operation_c8a17489-c357-47cc-88cd-f9834dd9f3ea DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION +details
[28] c137a60c-ada0-4182-9b2f-8196ee9ba103 2026/08/31 21:29:36 2026/08/31 21:29:36 2026/08/31 21:29:36 61 ms 77 ms sql_command { input { common { plan_id: 2 } sql { query: "create schema if not exists test" } } } CLOSED 19b19ed2-b2cf-45b0-aef4-98cc09ea85fe SparkConnect_OperationTag_User__Session_c137a60c-ada0-4182-9b2f-8196ee9ba103_Operation_19b19ed2-b2cf-45b0-aef4-98cc09ea85fe
[1] [26][27] c137a60c-ada0-4182-9b2f-8196ee9ba103 2026/08/31 21:29:04 2026/08/31 21:29:06 2026/08/31 21:29:06 1 second 130 ms 1 second 137 ms sql_command { input { common { plan_id: 1 } sql { query: "create table if not exists test.fhvhv_trip using delta as select * from parquet.`/home/jovyan/Inbound/fhvhv_tripdata_2025-01.parquet`" } } } CLOSED a7cb65f7-ae82-490a-86ff-78357ad52b57 SparkConnect_OperationTag_User__Session_c137a60c-ada0-4182-9b2f-8196ee9ba103_Operation_a7cb65f7-ae82-490a-86ff-78357ad52b57 SCHEMA_NOT_FOUND +details
[0] [1] f679d0a7-9093-4f5b-a08c-e6e153a9e111 2026/08/31 21:23:37 2026/08/31 21:23:40 2026/08/31 21:23:40 3 seconds 32 ms 3 seconds 196 ms common { plan_id: 4 } show_string { input { common { plan_id: 3 } sql { query: "select * from tt cross join tt cross join tt cross join tt" } } num_rows: 20 truncate: 20 } CLOSED 0eaa6718-5e03-4057-a9a7-df7ce2ee9583 SparkConnect_OperationTag_User__Session_f679d0a7-9093-4f5b-a08c-e6e153a9e111_Operation_0eaa6718-5e03-4057-a9a7-df7ce2ee9583
f679d0a7-9093-4f5b-a08c-e6e153a9e111 2026/08/31 21:23:37 2026/08/31 21:23:37 2026/08/31 21:23:37 193 ms 217 ms sql_command { input { common { plan_id: 2 } sql { query: "select * from tt cross join tt cross join tt cross join tt" } } } CLOSED 22d8c8ae-1a5d-4367-b2d7-863793d046b7 SparkConnect_OperationTag_User__Session_f679d0a7-9093-4f5b-a08c-e6e153a9e111_Operation_22d8c8ae-1a5d-4367-b2d7-863793d046b7
[0] f679d0a7-9093-4f5b-a08c-e6e153a9e111 2026/08/31 21:23:33 2026/08/31 21:23:35 2026/08/31 21:23:35 1 second 551 ms 1 second 588 ms create_dataframe_view { input { common { plan_id: 0 } range { start: 0 end: 100000000000 step: 1 } } name: "tt" replace: true } CLOSED 14b1722f-6b23-4e6d-ac9a-037490d73682 SparkConnect_OperationTag_User__Session_f679d0a7-9093-4f5b-a08c-e6e153a9e111_Operation_14b1722f-6b23-4e6d-ac9a-037490d73682
Page: