Acknowledgements Thanks to bug1989 [https:/bug1989] for contributing the initial quantized int8 inference code and a large variety of device benchmark