Overview
The users notice that a lot of Statsd errors start appearing in logs, like the following and can happen during or after some missing reporting on graphs or no reporting at all. It shows some or all the .dat files in stats directory are corrupted.
Aug 4 16:54:13 statsd[8182]: [statsd.ERR]: st_chd_calculate(), st_chd.c:259, build 1: CHD 'wm_reduction_fiveminutes': error computing
Aug 4 16:54:13 statsd[8182]: [statsd.ERR]: st_handle_pending_timers(), st_main.c:516, build 1: Error code 14001 (unexpected NULL) returned
Aug 4 16:54:13 statsd[8182]: [statsd.ERR]: st_sample_do_one(), st_sample.c:116, build 1: Error code 14001 (unexpected NULL) returned
Aug 4 16:54:13 statsd[8182]: [statsd.ERR]: st_sample_handle_timer(), st_sample.c:139, build 1: Error code 14001 (unexpected NULL) returned
Aug 4 16:54:13 statsd[8182]: [statsd.ERR]: lew_universal_event_handler(), libevent_wrapper.c:303, build 1: Error code 14001 (unexpected NULL) returned
Aug 4 16:54:14 statsd[8182]: [statsd.ERR]: st_chd_get_instructions(), st_chd.c:332, build 1: Unexpected NULL
Aug 4 16:54:14 statsd[8182]: [statsd.ERR]: st_chd_calculate(), st_chd.c:179, build 1: Error code 14001 (unexpected NULL) returned
Aug 4 16:54:14 statsd[8182]: [statsd.ERR]: st_chd_calculate(), st_chd.c:259, build 1: CHD 'web_cache_hour': error computing
Aug 4 16:54:14 statsd[8182]: [statsd.ERR]: st_chd_handle_timer(), st_chd.c:129, build 1: Error code 14001 (unexpected NULL) returned
Aug 4 16:54:14 statsd[8182]: [statsd.ERR]: st_chd_get_instructions(), st_chd.c:332, build 1: Unexpected NULL
Aug 4 16:54:14 statsd[8182]: [statsd.ERR]: st_chd_calculate(), st_chd.c:179, build 1: Error code 14001 (unexpected NULL) returned
Aug 4 16:54:13 statsd[8182]: [statsd.ERR]: st_chd_calculate(), st_chd.c:259, build 1: CHD 'wm_reduction_fiveminutes': error computing
Aug 4 16:54:13 statsd[8182]: [statsd.ERR]: st_handle_pending_timers(), st_main.c:516, build 1: Error code 14001 (unexpected NULL) returned
Aug 4 16:54:13 statsd[8182]: [statsd.ERR]: st_sample_do_one(), st_sample.c:116, build 1: Error code 14001 (unexpected NULL) returned
Aug 4 16:54:13 statsd[8182]: [statsd.ERR]: st_sample_handle_timer(), st_sample.c:139, build 1: Error code 14001 (unexpected NULL) returned
Aug 4 16:54:13 statsd[8182]: [statsd.ERR]: lew_universal_event_handler(), libevent_wrapper.c:303, build 1: Error code 14001 (unexpected NULL) returned
Aug 4 16:54:14 statsd[8182]: [statsd.ERR]: st_chd_get_instructions(), st_chd.c:332, build 1: Unexpected NULL
Aug 4 16:54:14 statsd[8182]: [statsd.ERR]: st_chd_calculate(), st_chd.c:179, build 1: Error code 14001 (unexpected NULL) returned
Aug 4 16:54:14 statsd[8182]: [statsd.ERR]: st_chd_calculate(), st_chd.c:259, build 1: CHD 'web_cache_hour': error computing
Aug 4 16:54:14 statsd[8182]: [statsd.ERR]: st_chd_handle_timer(), st_chd.c:129, build 1: Error code 14001 (unexpected NULL) returned
Aug 4 16:54:14 statsd[8182]: [statsd.ERR]: st_chd_get_instructions(), st_chd.c:332, build 1: Unexpected NULL
Aug 4 16:54:14 statsd[8182]: [statsd.ERR]: st_chd_calculate(), st_chd.c:179, build 1: Error code 14001 (unexpected NULL) returned
This article provides a resolution for this error.
Root Cause
This can be caused by unexpected shutdowns or after firmware upgrades that result in statsd files getting corrupted when they try to roll on the data again.
Resolution
Contact Exinda TAC and someone will assist in getting rid of the errors and corrupted files.
Priyanka Bhotika
Comments