-
Notifications
You must be signed in to change notification settings - Fork 5
Description
toArray and toString are critically memory-intensive calls for any large dataset. We are already operating in ES environments with limited memory and these methods will punish the library when GC panics.
What is the purpose of toArray anyway? The way I see it, there are no legitimate use-cases for an array of quads that cannot be handled by Dataset alone or in tandem with a serializer.
toString is also redundant. This sort of task should be handled by piping to a serializer. We should document all these as examples.
toCanonical is another dangerous 'buffer-everything-into-a-string' method. This should be replaced with a method that returns a new Dataset, and complemented with another method that returns the normalized hash string of a dataset.