DEV Community

Nondeterminism in purely functional languages?

DrBearhands on February 21, 2019

This is something I have been wondering for a while. Is there a place for nondeterministic functions in a purely functional language? I'm talking a...
Collapse
 
nestedsoftware profile image
Nested Software • Edited

For your example of a function that gets a random number from an outside source of random data, it seems analogous to me to a function that gets a user’s input.

In, for e.g. Haskell, we’d presumably wrap that code in an IO monad to keep the function nominally pure.

Collapse
 
drbearhands profile image
DrBearhands

User input is inherently statefull; user and machine interact by sharing a state. Therefore a monadic representation seems necessary (although you may be able to successfully fuck around with linear types, input getter functions and interleaving, probably not a good idea though).

Randomness is not inherently statefull. A true random function, unlike a pseudorandom, will not give two shits about when, in what order or by whom it is called. It will produce an 'equally random' result in every case.

Haskell may use IO monads, but that does not mean it is necessary or even good. I don't think quantum random number generators were in the back of everybody's mind in the late 80's when Haskell was first created after all ;-)

Collapse
 
jvanbruegge profile image
Jan van Brügge

Purity is not about state, it's about referencial transparency. A function is pure iff (if and only if) given same arguments it returns the same output.

A random generator takes no argument and returns a different result every time, so it is inherently impure.

Thread Thread
 
drbearhands profile image
DrBearhands

That's an excellent point.

Would you know of any practical arguments (besides memoization) in favor of referential transparency, insofar as it is lost by introducing non-determinism?

Thread Thread
 
jvanbruegge profile image
Jan van Brügge

Reverseability for example. Haskell has STM (software transactional memory) which is like a global shared variable between threads, but instead of race conditions of two threads try to write at the same time, the actions get rolled back and then redone one after another. The type system guarantees that you cannot do monadic actions when writing to STM, just pure stuff. If you would have randomness in there, rollback and redoing would not be the same thing.

Thread Thread
 
drbearhands profile image
DrBearhands

That's true, but sort-of isn't. The new computation "may as well" have been the old one: it is still equally correct because true randomness has no hidden state that was affected by the rollback and redo.

This is all still ignoring the de-facto pseudorandom / deterministic nature of most of our machines.

Collapse
 
nestedsoftware profile image
Nested Software • Edited

To me the situation seems fairly simple in that the world is still different afterward than it was before. In terms of consistency also, if a language guarantees purity (like elm or haskell), it seems a bit silly to equivocate about that.

Thread Thread
 
drbearhands profile image
DrBearhands

That's only true if you use seeds, which as I mentioned is theoretically unecessary and could be abstracted away in practice.

Collapse
 
louy2 profile image
Yufan Lou • Edited

There is a formal definition of purity in What is a Purely Functional Language by Amr Saby:

Definition 4.7 (Purely Functional Language)
A language is purely functional if:

  1. it is a conservative extension of the simply-typed λ-calculus,
  2. it has well defined call-by-value, call-by-need, and call-by-name evaluation functions (implementations), and
  3. all three evaluation functions (implementations) are weakly equivalent.

Non-determinism conflicts with this definition, specifically the definition of "weakly equivalent":

Definition 4.6 (Weak Equivalence)
Let P be a set of programs, B be a set of observables, and eval1 and eval2 be two partial functions (implementations), from programs to observables. We say eval1 is weakly equivalent to eval2 when the following conditions hold:

  • if eval1(P) = B then either eval2(P) = B or eval2(P) is undefined.
  • if eval2(P) = B then either eval1(P) = B or eval1(P) is undefined.

A naive inclusion of a nondeterministic variable breaks this equivalence.

EDIT: fix typo V => B

Collapse
 
drbearhands profile image
DrBearhands

I had conceded this point to Jan van Brugge in another comment.

Seeing this particular definition, though, I hesitate (assuming Amr Saby is an authoritative figure).
If we assume B is a superposition of all outcomes of the non-deterministic operation, one that only collapses to a single value once we observe it, which would have been an IO operation anyway, weak equivalence holds. I'm hardly familiar with quantum computing so maybe I'm abusing some terminology.

Even if this idea holds, though, I guess sharing a non-deterministic redex by value would give faulty results.

Collapse
 
louy2 profile image
Yufan Lou

If we assume B is a superposition of all outcomes of the non-deterministic operation, one that only collapses to a single value once we observe it, which would have been an IO operation anyway, weak equivalence holds.

This would be the same strategy used to make all effects including IO pure, described in the section 5.1 Effects as values of the paper. Notice nondeterministic algorithms like quick sort needs the value of the random number, making a sequence of collapses, mandating an order therefore a monadic implementation. Actual quantum algorithms like quantum annealing of Shor's factorization algorithm may be fully lifted into the Applicative, but don't take my word for it.

Btw, you do not need to create qubits for randomness. A piece of hardware sampling electrical noise usually has enough entropy. In Haskell, true random number can be obtained from hardware via operating system with getHardwareEntropy.

Thread Thread
 
drbearhands profile image
DrBearhands

Interesting points.

I would argue there is at least some difference between "regular" effects-as-values and non-determinism since the latter does not set order requirements or dependencies on "the outside". Classifying non-determinism as an effect seems therefore incorrect.

Quicksort is an interesting case since it's only non-deterministic in evaluation, not in result; weak equivalence holds.

Thread Thread
 
louy2 profile image
Yufan Lou • Edited

Classifying non-determinism as an effect seems therefore incorrect.

Although I am more skeptical of what I wrote after a good sleep, no that's not what I meant. I agree with you that they are different, it just so happens that we can wrap it in a monad to deal with it. (Monad is everything) (Not really but pretty much).

Being Haskell, there is a paper for it: Purely Functional Lazy Non-deterministic Programming. We can use Monad to represent deterministic computation. To add non-determinism, we instead use MonadPlus, which is monoid under monad constraints, because the monoid law requires the binary operation to be commutative.