[VL] partition write assert failed

[FelixYBW]

Backend

VL (Velox)

Bug description

If I run 2 SQL in the same spark context, the first one can offload to native parquet write, the second one fallbacked, then we will hit assert failure at here:

incubator-gluten/shims/spark32/src/main/scala/org/apache/spark/sql/execution/datasources/FileFormatWriter.scala

Line 157 in 27c32f1

assert(plan.isInstanceOf[IFakeRowAdaptor])

The root cause is the sparkSession.sparkContext.getLocalProperty("isNativeAppliable") isn't reset before each query plan generation.

@JkSelf can you check where is the best place to reset the local property?

Spark version

None

Spark configurations

No response

System information

No response

Relevant logs

No response