Hello and thank you for the open source code. I have a question about generating model activation scales.
When running this code, an error occurs as shown here
python examples/generate_act_scales.py
--model-name <model_name_or_path>
--output-path <output_act_scales_file_path>
--num-samples <num_samples>
--seq-len <sequence_length>
--dataset-path <path_to_the_calibration_dataset>
Hello and thank you for the open source code. I have a question about generating model activation scales.
When running this code, an error occurs as shown here
python examples/generate_act_scales.py
--model-name <model_name_or_path>
--output-path <output_act_scales_file_path>
--num-samples <num_samples>
--seq-len <sequence_length>
--dataset-path <path_to_the_calibration_dataset>