You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Script import_logs.py seems to hang at log format detection if first line of the log is a wierd request.
I run import_logs.py in daily crontab -> I first grep the access logs for yesterdays date and then import that using import_logs.py. Unfortunately, it seems that first request yesterday was a bit wierd. That seems to break the script's log detection and script hangs indefinitely.
2013-07-11 04:11:36,728: [DEBUG] Detecting the log format
2013-07-11 04:11:36,728: [DEBUG] Format icecast2 does not match
2013-07-11 04:11:36,728: [DEBUG] Format iis does not match
2013-07-11 04:11:36,728: [DEBUG] Format s3 does not match
2013-07-11 04:11:36,728: [DEBUG] Format common_complete does not match
2013-07-11 04:11:36,728: [DEBUG] Format common does not match
2013-07-11 04:11:36,728: [DEBUG] Format common_vhost does not match
2013-07-11 04:11:36,729: [DEBUG] Format ncsa_extended does not match
0 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
0 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
(and this repeats indefinitely)
Script import_logs.py seems to hang at log format detection if first line of the log is a wierd request.
I run import_logs.py in daily crontab -> I first grep the access logs for yesterdays date and then import that using import_logs.py. Unfortunately, it seems that first request yesterday was a bit wierd. That seems to break the script's log detection and script hangs indefinitely.
2013-07-11 04:11:36,728: [DEBUG] Detecting the log format
2013-07-11 04:11:36,728: [DEBUG] Format icecast2 does not match
2013-07-11 04:11:36,728: [DEBUG] Format iis does not match
2013-07-11 04:11:36,728: [DEBUG] Format s3 does not match
2013-07-11 04:11:36,728: [DEBUG] Format common_complete does not match
2013-07-11 04:11:36,728: [DEBUG] Format common does not match
2013-07-11 04:11:36,728: [DEBUG] Format common_vhost does not match
2013-07-11 04:11:36,729: [DEBUG] Format ncsa_extended does not match
0 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
0 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
(and this repeats indefinitely)
This is the log file which causes it to hang:
The text was updated successfully, but these errors were encountered: