Fixed errors within last commit. Graphing works pretty well now with the new system.

2016-05-11 20:38:33 -04:00
parent 4282f6b25c
commit b0902c8f50
3 changed files with 4 additions and 2 deletions
@@ -178,7 +178,7 @@ public:
                 * actual signal. This extends the sign bits out so that the integer result reads as the proper negative
                 * value. We dont need to do any of this if the sign bit wasn't set.
                */
-                int64_t signedMask = ~((1ULL << sigSize) - 1);
+                uint64_t signedMask = ~((1ULL << sigSize) - 1);
                result = (-1LL & signedMask) | result;
            }
        }