Note [Fundeps with instances, and equality orientation]
This Note describes a delicate interaction that constrains the orientation of equalities. This one is about fundeps, but the /exact/ same thing arises for type-family injectivity constraints: see Note [Improvement orientation]. doTopFunDepImprovement compares the constraint with all the instance declarations, to see if we can produce any equalities. E.g class C2 a b | a -> b instance C Int Bool Then the constraint (C Int ty) generates the equality [W] ty ~ Bool. There is a nasty corner in #19415 which led to the typechecker looping: class C s t b | s -> t instance ... => C (T kx x) (T ky y) Int T :: forall k. k -> Type work_item: dwrk :: C (T @ka (a::ka)) (T @kb0 (b0::kb0)) Char where kb0, b0 are unification vars ==> {doTopFunDepImprovement: compare work_item with instance, generate /fresh/ unification variables kfresh0, yfresh0, emit a new Wanted, and add dwrk to inert set} Suppose we emit this new Wanted from the fundep: [W] T kb0 (b0::kb0) ~ T kfresh0 (yfresh0::kfresh0) ==> {solve that equality kb0 := kfresh0, b0 := yfresh0} Now kick out dwrk, since it mentions kb0 But now we are back to the start! Loop! NB1: This example relies on an instance that does not satisfy the coverage condition (although it may satisfy the weak coverage condition), and hence whose fundeps generate fresh unification variables. Not satisfying the coverage condition is known to lead to termination trouble, but in this case it's plain silly. NB2: In this example, the third parameter to C ensures that the instance doesn't actually match the Wanted, so we can't use it to solve the Wanted We solve the problem by (#21703): carefully orienting the new Wanted so that all the freshly-generated unification variables are on the LHS. Thus we call unifyWanteds on T kfresh0 (yfresh0::kfresh0) ~ T kb0 (b0::kb0) and /NOT/ T kb0 (b0::kb0) ~ T kfresh0 (yfresh0::kfresh0) Now we'll unify kfresh0:=kb0, yfresh0:=b0, and all is well. The general idea is that we want to preferentially eliminate those freshly-generated unification variables, rather than unifying older variables, which causes kick-out etc. Keeping younger variables on the left also gives very minor improvement in the compiler performance by having less kick-outs and allocations (-0.1% on average). Indeed Historical Note [Eliminate younger unification variables] in GHC.Tc.Utils.Unify describes an earlier attempt to do so systematically, apparently now in abeyance. But this is is a delicate solution. We must take care to /preserve/ orientation during solving. Wrinkles: (W1) We start with [W] T kfresh0 (yfresh0::kfresh0) ~ T kb0 (b0::kb0) Decompose to [W] kfresh0 ~ kb0 [W] (yfresh0::kfresh0) ~ (b0::kb0) Preserve orientation when decomposing!! (W2) Suppose we happen to tackle the second Wanted from (W1) first. Then in canEqCanLHSHetero we emit a /kind/ equality, as well as a now-homogeneous type equality [W] kco : kfresh0 ~ kb0 [W] (yfresh0::kfresh0) ~ (b0::kb0) |> (sym kco) Preserve orientation in canEqCanLHSHetero!! (Failing to preserve orientation here was the immediate cause of #21703.) (W3) There is a potential interaction with the swapping done by GHC.Tc.Utils.Unify.swapOverTyVars. We think it's fine, but it's a slight worry. See especially Note [TyVar/TyVar orientation] in that module. The trouble is that "preserving orientation" is a rather global invariant, and sometimes we definitely do want to swap (e.g. Int ~ alpha), so we don't even have a precise statement of what the invariant is. The advantage of the preserve-orientation plan is that it is extremely cheap to implement, and apparently works beautifully. Alternative plan (1) --- Rather than have an ill-defined invariant, another possiblity is to elminate those fresh unification variables at birth, when generating the new fundep-inspired equalities. The key idea is to call `instFlexiX` in `emitFunDepWanteds` on only those type variables that are guaranteed to give us some progress. This means we have to locally (without calling emitWanteds) identify the type variables that do not give us any progress. In the above example, we _know_ that emitting the two wanteds `kco` and `co` is fruitless. Q: How do we identify such no-ops? 1. Generate a matching substitution from LHS to RHS ɸ = [kb0 :-> k0, b0 :-> y0] 2. Call `instFlexiX` on only those type variables that do not appear in the domain of ɸ ɸ' = instFlexiX ɸ (tvs - domain ɸ) 3. Apply ɸ' on LHS and then call emitWanteds unifyWanteds ... (subst ɸ' LHS) RHS Why will this work? The matching substitution ɸ will be a best effort substitution that gives us all the easy solutions. It can be generated with modified version of `Core/Unify.unify_tys` where we run it in a matching mode and never generate `SurelyApart` and always return a `MaybeApart Subst` instead. The same alternative plan would work for type-family injectivity constraints: see Note [Improvement orientation] in GHC.Tc.Solver.Equality. End of Alternative plan (1) --- Alternative plan (2) --- We could have a new flavour of TcTyVar (like `TauTv`, `TyVarTv` etc; see GHC.Tc.Utils.TcType.MetaInfo) for the fresh unification variables introduced by functional dependencies. Say `FunDepTv`. Then in GHC.Tc.Utils.Unify.swapOverTyVars we could arrange to keep a `FunDepTv` on the left if possible. Looks possible, but it's one more complication. End of Alternative plan (2) --- Historical note: Failed Alternative Plan (3) --- Previously we used a flag `cc_fundeps` in `CDictCan`. It would flip to False once we used a fun dep to hint the solver to break and to stop emitting more wanteds. This solution was not complete, and caused a failures while trying to solve for transitive functional dependencies (test case: T21703) End of Historical note: Failed Alternative Plan (3) --
References 2
- Improvement orientation GHC.Tc.Solver.Equality
- TyVar/TyVar orientation GHC.Tc.Utils.Unify
Referenced by 6
- GHC.Tc.Solver.Dict call site
- GHC.Tc.Solver.Equality call site
- Improvement orientation GHC.Tc.Solver.Equality
- unifyFunDeps GHC.Tc.Solver.Monad
- GHC.Tc.Utils.Unify call site
- TyVar/TyVar orientation GHC.Tc.Utils.Unify