Skip to content
Snippets Groups Projects
  1. May 11, 2021
    • Müller, Alexander's avatar
      changed tolerances to fix failing tests · a2647f48
      Müller, Alexander authored
      The tests failed since the construction of values of ProductManifold<> in ValueFactory uses random entries between [0.9..1.1]. These are then used for the tests and are projected onto the manifold. 
      
      To pass this tests it is needed to adjust several Taylor expansions and thresholds. For example this commit increases the threshold from `1e-4` to `1e-2` and adds more terms to the Taylor expansion. The reason for this change is explained in the following. 
      
      The problem is, even if the tolerance `1e-4` is sufficient to have a correct function value within machine precision, it is not always sufficient to get correct derivatives since here we lose orders of correctness.
      
      For  example of for sinc(x) we need to put the threshold at `1e-4` to get the correct function value if we use  `1.0-x*x/6.0` as approximation formula.
      
      If we then use this formula within automatic differentiation or finite differences, e.g. the derivative algorithms  "sees" only the following formulas of the first and second derivative:
      
      - Function value: `1.0-x*x/6.0`   This function is implemented
      - First deriv: `-x/3.0`      This sees the derivative algorithms as first derivative
      - Second: `-1.0/3.0`       This sees the derivative algorithms as second derivative
      
      Obviously, this is the case if the function value is inside the region where the Taylor expansion is used.
      
      If we use these functions to test the exactness of the derivatives we need to set the threshold to `x<1e-6` to get exact second order derivatives where the error is within machine precision. Therefore, for larger values `x>1e-6` the exact formula has to be used to get correct results. Unfortunately, in this range the exact derivative are already unstable.
      E.g. the first derivative formula behaves already strange near `x=1e-4`.
      
      Therefore,
      to get a correct derivative value we need to switch to the Taylor expansion earlier (`1e-4`) to prevent using the unstable exact formula. But in this range the Taylor expansion is unable to reproduce an approximation error within machine precision.
      
      I think the only way to fix this problem is to add more terms to the Taylor expansions. Since even if they seem to be sufficient in terms of function value, usually they are not sufficient in terms of derivatives.
      
      For `sin(x)/x` a test ist at https://godbolt.org/z/T995hGec3 and for `acos(x)^2` https://godbolt.org/z/TG9E15jjf.
      a2647f48
  2. May 04, 2021
  3. Apr 30, 2021
  4. Apr 22, 2021
  5. Feb 16, 2021
  6. Feb 10, 2021
  7. Feb 08, 2021
  8. Jan 20, 2021
  9. Jan 19, 2021
  10. Jan 07, 2021
  11. Nov 30, 2020
  12. Nov 21, 2020
  13. Nov 20, 2020
  14. Nov 13, 2020
  15. Nov 10, 2020
  16. Nov 08, 2020
Loading