-
Notifications
You must be signed in to change notification settings - Fork 22
Description
Hi @novakov-alexey,
Now that the reunification of Flink 1 and 2 is complete, I’m opening this ticket to discuss the serializers we wrote for our needs and that we can share here.
These serializers are in production on our side and have been running for several months.
Serializers missing in Flink:
java.time.ZoneId
java.time.ZoneOffset
java.time.ZonedDateTime
java.time.OffsetDateTime
Serializers for the Scala standard library:
scala.concurrent.duration.Duration
&scala.concurrent.duration.FiniteDuration
scala.Enumeration
scala.math.Ordering
& subclasses (required for sorted sets)
Serializers for Scala mutable collections:
scala.collection.mutable.ArrayDeque
scala.collection.mutable.Buffer
&scala.collection.mutable.ArrayBuffer
scala.collection.mutable.Queue
scala.collection.mutable.Map
&scala.collection.mutable.HashMap
scala.collection.mutable.Set
&scala.collection.mutable.HashSet
scala.collection.mutable.SortedSet
&scala.collection.mutable.TreeSet
In fact, pretty much the only thing missing is SortedMap
, which we apparently don’t use in our state.
So, let me know which serializers you’re interested in and which ones you want first. I think I’ll have less time to devote to this, but I’ll try to add them progressively.
Of course, all of this is up for discussion, and just because we implemented it a certain way internally doesn’t mean we can’t do better here.