Skip to content

[Spark] Add geoTypes to GeoTypesShim#7053

Open
harperjiang wants to merge 1 commit into
delta-io:masterfrom
harperjiang:v3geoshim
Open

[Spark] Add geoTypes to GeoTypesShim#7053
harperjiang wants to merge 1 commit into
delta-io:masterfrom
harperjiang:v3geoshim

Conversation

@harperjiang

Copy link
Copy Markdown
Collaborator

Description

Adds a geoTypes member to GeoTypesShim listing the geospatial Catalyst type classes:

  • Spark 4.2 shim: Seq(classOf[GeometryType], classOf[GeographyType])
  • Spark 4.0 shim: Seq.empty[Class[_]] (these types do not exist on Spark 4.0)

The Spark 4.1 shim is intentionally left unchanged and will be updated in a separate PR.

How was this patch tested?

Trivial member addition. The Spark 4.2 shim already imports and uses GeometryType/GeographyType; the 4.0 shim returns an empty Seq with no new imports. No behavior change to existing methods.

Does this PR introduce any user-facing changes?

No.

This pull request and its description were written by Isaac.

Add a `geoTypes` member to GeoTypesShim listing the geospatial Catalyst
type classes. The Spark 4.2 shim returns Seq(GeometryType, GeographyType);
the Spark 4.0 shim, where these types do not exist, returns an empty Seq.

The Spark 4.1 shim is intentionally left unchanged and will be updated in a
separate PR.

Co-authored-by: Isaac
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant