Asserts are not intended to be used in performance builds. We should first make sure that we can disable them safely and then add -DNDEBUG to the flags by default. We probably should add a --enable-debug which also controls thhe optimization levels, debug information (-g) and leaving the frame pointer.