quantized results description

[burui11087]

Thanks for your great work in advance!

I have some questions about the following description:

tensorflow-handbook/docs/zh/deployment/lite.html

Line 446 in 3b4abc3

<p>Quantized模型是对原模型进行转换过程中，将float参数转化为uint8类型，进而产生的模型会更小、运行更快，但是精度会有所下降。</p>

In my daily experiments, I find that the quantized results(accuracy) can go down as well as up when task is classification. So I think it's better to modify this description.

Thanks again.

[dpinthinker]

@burui11087 Could you tell me on which condition the quantized size will be bigger than the original one?

[dpinthinker]

Post-training quantization is a conversion technique that can reduce model size while also improving CPU and hardware accelerator latency, with little degradation in model accuracy.
From https://www.tensorflow.org/lite/performance/post_training_quantization

[burui11087]

Post-training quantization is a conversion technique that can reduce model size while also improving CPU and hardware accelerator latency, with little degradation in model accuracy.
From https://www.tensorflow.org/lite/performance/post_training_quantization

I am not a researcher in the direction of model quantization. At first I thought the official description you posted was correct, but after a lot of experiments( a classification task), I found the quantized results could go down as well as up(I can't post my experiment results here because of corporate data security). After discuss with my colleague, we think the quantization operation can be treated as reducing overfitting like L1,L2, but this is just speculation. However I think the official description should be verified again. Maybe I should open a issue in tensorflow github repository.

[burui11087]

Post-training quantization is a conversion technique that can reduce model size while also improving CPU and hardware accelerator latency, with little degradation in model accuracy.
From https://www.tensorflow.org/lite/performance/post_training_quantization

I think that's my fault after reread https://tf.wiki/zh/deployment/lite.html#quantization . I find what you talk about is post-training quantization, it will cause accuracy loss. I use quantization-aware training in my daily work, that will make the accuracy better or worse.

[burui11087]

@burui11087 Could you tell me on which condition the quantized size will be bigger than the original one?

not quantized size, it's accuracy.

[dpinthinker]

@burui11087
Yes, I just try to talk about post training quantization here.

Thank you for your careful reviewing. I am a beginner in tflite. If you have found any issue in this chapter, or have any idea, please let me know.

[dpinthinker]

@snowkylin maybe we need add training-aware-quantization content later.