Modul 93_DbRep - Reporting und Management von Datenbankinhalten (DbLog)

RalfRog · 29 Mai 2021, 12:38:26

Damit der Zusammenhang erhalten bleibt hier die Test#1 bis 3 am DBLog selbst durch Aufarbeitung der Logdatei vom 17.5

Test #1 auf DBLog Device (DBTest) mit reduceLogNbl requested with DAYS=18:48, INCLUDE=Jet:E10
Testdatenbank mit Daten von 30.03 bis 17.05 / ReduceLog von 30.03 bis 28.04
am 30.03 werden jeweils ganze Tage auf stündliche Werte reduziert; nur der jüngste Tag am 28.04 wird nach 20:30 nicht mehr reduziert
==> also am Ende des Zeitraus etwas unsauber; es sollten vielleicht immer ganze Tage sein

Code Auswählen


2021.05.17 20:17:24.140 5: DbLog DBTest -> Start DbLog_reduceLogNbl
2021.05.17 20:17:24.153 3: DbLog DBTest: reduceLogNbl requested with DAYS=18:48, INCLUDE=Jet:E10
2021.05.17 20:17:24.153 4: DbLog DBTest -> AutoCommit mode: ON, Transaction mode: ON
2021.05.17 20:17:24.198 3: DbLog DBTest: reduceLogNbl deleting 8 records of day: 2021-03-30
2021.05.17 20:17:24.199 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 10:33:54) AND (VALUE=147.9)
2021.05.17 20:17:24.202 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 10:44:54) AND (VALUE=145.9)
2021.05.17 20:17:24.205 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 11:57:54) AND (VALUE=140.9)
2021.05.17 20:17:24.207 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 13:38:56) AND (VALUE=143.9)
2021.05.17 20:17:24.210 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 14:43:56) AND (VALUE=139.9)
2021.05.17 20:17:24.212 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 16:38:58) AND (VALUE=141.9)
2021.05.17 20:17:24.215 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 17:51:09) AND (VALUE=143.9)
2021.05.17 20:17:24.218 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 19:28:06) AND (VALUE=142.9)
2021.05.17 20:17:24.230 3: DbLog DBTest: reduceLogNbl deleting 11 records of day: 2021-03-31
2021.05.17 20:17:24.232 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-31 06:52:10) AND (VALUE=151.9)
2021.05.17 20:17:24.234 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-31 08:37:10) AND (VALUE=146.9)
2021.05.17 20:17:24.236 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-31 09:28:10) AND (VALUE=147.9)
2021.05.17 20:17:24.238 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-31 10:39:12) AND (VALUE=145.9)
2021.05.17 20:17:24.241 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-31 12:29:13) AND (VALUE=148.9)
2021.05.17 20:17:24.243 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-31 14:13:13) AND (VALUE=144.9)
2021.05.17 20:17:24.245 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-31 14:19:13) AND (VALUE=143.9)
2021.05.17 20:17:24.247 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-31 15:29:14) AND (VALUE=147.9)
2021.05.17 20:17:24.249 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-31 16:44:14) AND (VALUE=145.9)
2021.05.17 20:17:24.251 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-31 16:53:14) AND (VALUE=143.9)
2021.05.17 20:17:24.253 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-31 19:27:14) AND (VALUE=146.9)
.....
31.03 bis 26.04 ok und daher aus dem Log genommen
.....
2021.05.17 20:17:25.025 3: DbLog DBTest: reduceLogNbl deleting 13 records of day: 2021-04-27
2021.05.17 20:17:25.026 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 09:26:53) AND (VALUE=153.9)
2021.05.17 20:17:25.028 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 10:44:54) AND (VALUE=148.9)
2021.05.17 20:17:25.031 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 11:08:54) AND (VALUE=144.9)
2021.05.17 20:17:25.033 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 12:27:55) AND (VALUE=148.9)
2021.05.17 20:17:25.035 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 13:39:56) AND (VALUE=147.9)
2021.05.17 20:17:25.037 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 14:16:56) AND (VALUE=146.9)
2021.05.17 20:17:25.038 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 14:18:56) AND (VALUE=144.9)
2021.05.17 20:17:25.040 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 15:28:57) AND (VALUE=148.9)
2021.05.17 20:17:25.042 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 16:38:58) AND (VALUE=146.9)
2021.05.17 20:17:25.044 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 17:17:58) AND (VALUE=143.9)
2021.05.17 20:17:25.046 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 17:26:58) AND (VALUE=146.9)
2021.05.17 20:17:25.048 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 19:28:00) AND (VALUE=145.9)
2021.05.17 20:17:25.050 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 22:52:02) AND (VALUE=147.9)
2021.05.17 20:17:25.061 3: DbLog DBTest: reduceLogNbl deleting 9 records of day: 2021-04-28
2021.05.17 20:17:25.062 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 06:53:08) AND (VALUE=151.9)
2021.05.17 20:17:25.065 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 08:34:10) AND (VALUE=149.9)
2021.05.17 20:17:25.067 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 11:24:11) AND (VALUE=147.9)
2021.05.17 20:17:25.069 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 12:28:12) AND (VALUE=151.9)
2021.05.17 20:17:25.071 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 13:38:13) AND (VALUE=147.9)
2021.05.17 20:17:25.073 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 14:59:14) AND (VALUE=143.9)
2021.05.17 20:17:25.075 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 16:48:15) AND (VALUE=145.9)
2021.05.17 20:17:25.077 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 17:29:15) AND (VALUE=146.9)
2021.05.17 20:17:25.079 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 19:28:17) AND (VALUE=142.9)
2021.05.17 20:17:25.086 3: DbLog DBTest: reduceLogNbl finished. Rows processed: 992, deleted: 271, time: 0.95sec
2021.05.17 20:17:25.087 5: DbLog DBTest -> DbLog_reduceLogNbl finished
-------------------------------------------------------------------------------------------------
Daten:
"2021-04-28 23:53:20";"Jet";"HTTPMOD";"E10: 145.9  Cent";"E10";"145.9";"Cent"

"2021-04-28 22:53:19";"Jet";"HTTPMOD";"E10: 145.9  Cent";"E10";"145.9";"Cent" => nicht gelöscht nok

"2021-04-28 22:24:19";"Jet";"HTTPMOD";"E10: 141.9  Cent";"E10";"141.9";"Cent" 
"2021-04-28 21:24:18";"Jet";"HTTPMOD";"E10: 141.9  Cent";"E10";"141.9";"Cent"
"2021-04-28 20:24:18";"Jet";"HTTPMOD";"E10: 141.9  Cent";"E10";"141.9";"Cent"
"2021-04-28 19:28:17";"Jet";"HTTPMOD";"E10: 142.9  Cent";"E10";"142.9";"Cent" => gelöscht ok 
"2021-04-28 19:19:17";"Jet";"HTTPMOD";"E10: 139.9  Cent";"E10";"139.9";"Cent"
"2021-04-28 18:19:16";"Jet";"HTTPMOD";"E10: 139.9  Cent";"E10";"139.9";"Cent"
"2021-04-28 17:29:15";"Jet";"HTTPMOD";"E10: 146.9  Cent";"E10";"146.9";"Cent" => gelöscht ok 
"2021-04-28 17:09:15";"Jet";"HTTPMOD";"E10: 144.9  Cent";"E10";"144.9";"Cent"

Test #2 auf DBLog Device (DBTest) mit reduceLogNbl requested with DAYS=18:48, AVERAGE=HOUR, INCLUDE=Jet:E10
Testdatenbank mit Daten von 30.03 bis 17.05 / ReduceLog Average von 30.03 bis 28.04
ab 30.03 werden jeweils ganze Tage auf stündlichen Durchschnitt um hh:30 reduziert; nur der jüngste Tag am 28.04 wird nach 20:30 nicht mehr reduziert
==> also am Ende des Zeitraus unsauber; Durchschnitt wird gebildet aber am Ende nicht alle entsprechenden Daten gelöscht; es sollten vielleicht immer ganze Tage bearbeitet werden

Code Auswählen


2021.05.17 20:38:55.034 5: DbLog DBTest -> Start DbLog_reduceLogNbl
2021.05.17 20:38:55.044 3: DbLog DBTest: reduceLogNbl requested with DAYS=18:48, AVERAGE=HOUR, INCLUDE=Jet:E10
2021.05.17 20:38:55.045 4: DbLog DBTest -> AutoCommit mode: ON, Transaction mode: ON
2021.05.17 20:38:55.088 3: DbLog DBTest: reduceLogNbl deleting 8 records of day: 2021-03-30
2021.05.17 20:38:55.090 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 10:33:54) AND (VALUE=147.9)
2021.05.17 20:38:55.093 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 10:44:54) AND (VALUE=145.9)
2021.05.17 20:38:55.095 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 11:57:54) AND (VALUE=140.9)
2021.05.17 20:38:55.098 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 13:38:56) AND (VALUE=143.9)
2021.05.17 20:38:55.101 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 14:43:56) AND (VALUE=139.9)
2021.05.17 20:38:55.103 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 16:38:58) AND (VALUE=141.9)
2021.05.17 20:38:55.105 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 17:51:09) AND (VALUE=143.9)
2021.05.17 20:38:55.107 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 19:28:06) AND (VALUE=142.9)
2021.05.17 20:38:55.117 3: DbLog DBTest: reduceLogNbl (hourly-average) updating 7 records of day: 2021-03-30
2021.05.17 20:38:55.118 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-03-30 10:30:00, EVENT='rl_av_h', VALUE=149.233 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-03-30 10:26:54 AND VALUE=153.9
2021.05.17 20:38:55.121 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-03-30 11:30:00, EVENT='rl_av_h', VALUE=142.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-03-30 11:17:54 AND VALUE=144.9
2021.05.17 20:38:55.124 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-03-30 13:30:00, EVENT='rl_av_h', VALUE=144.400 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-03-30 13:26:55 AND VALUE=144.9
2021.05.17 20:38:55.128 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-03-30 14:30:00, EVENT='rl_av_h', VALUE=141.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-03-30 14:38:56 AND VALUE=143.9
2021.05.17 20:38:55.131 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-03-30 16:30:00, EVENT='rl_av_h', VALUE=142.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-03-30 16:26:58 AND VALUE=143.9
2021.05.17 20:38:55.134 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-03-30 17:30:00, EVENT='rl_av_h', VALUE=143.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-03-30 17:27:59 AND VALUE=143.9
2021.05.17 20:38:55.138 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-03-30 19:30:00, EVENT='rl_av_h', VALUE=141.400 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-03-30 19:20:06 AND VALUE=139.9
....
31.03 bis 26.04 ok und daher aus dem Log genommen
....
2021.05.17 20:38:56.838 3: DbLog DBTest: reduceLogNbl deleting 13 records of day: 2021-04-27
2021.05.17 20:38:56.840 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 09:26:53) AND (VALUE=153.9)
2021.05.17 20:38:56.843 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 10:44:54) AND (VALUE=148.9)
2021.05.17 20:38:56.845 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 11:08:54) AND (VALUE=144.9)
2021.05.17 20:38:56.847 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 12:27:55) AND (VALUE=148.9)
2021.05.17 20:38:56.849 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 13:39:56) AND (VALUE=147.9)
2021.05.17 20:38:56.851 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 14:16:56) AND (VALUE=146.9)
2021.05.17 20:38:56.853 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 14:18:56) AND (VALUE=144.9)
2021.05.17 20:38:56.855 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 15:28:57) AND (VALUE=148.9)
2021.05.17 20:38:56.857 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 16:38:58) AND (VALUE=146.9)
2021.05.17 20:38:56.859 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 17:17:58) AND (VALUE=143.9)
2021.05.17 20:38:56.861 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 17:26:58) AND (VALUE=146.9)
2021.05.17 20:38:56.863 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 19:28:00) AND (VALUE=145.9)
2021.05.17 20:38:56.865 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 22:52:02) AND (VALUE=147.9)
2021.05.17 20:38:56.873 3: DbLog DBTest: reduceLogNbl (hourly-average) updating 11 records of day: 2021-04-27
2021.05.17 20:38:56.874 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-27 09:30:00, EVENT='rl_av_h', VALUE=151.400 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-27 09:24:53 AND VALUE=148.9
2021.05.17 20:38:56.877 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-27 10:30:00, EVENT='rl_av_h', VALUE=149.400 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-27 10:18:53 AND VALUE=149.9
2021.05.17 20:38:56.880 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-27 11:30:00, EVENT='rl_av_h', VALUE=146.400 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-27 11:05:54 AND VALUE=147.9
2021.05.17 20:38:56.883 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-27 12:30:00, EVENT='rl_av_h', VALUE=146.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-27 12:08:55 AND VALUE=144.9
2021.05.17 20:38:56.886 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-27 13:30:00, EVENT='rl_av_h', VALUE=148.400 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-27 13:27:55 AND VALUE=148.9
2021.05.17 20:38:56.888 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-27 14:30:00, EVENT='rl_av_h', VALUE=145.567 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-27 14:08:56 AND VALUE=144.9
2021.05.17 20:38:56.891 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-27 15:30:00, EVENT='rl_av_h', VALUE=146.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-27 15:18:57 AND VALUE=144.9
2021.05.17 20:38:56.894 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-27 16:30:00, EVENT='rl_av_h', VALUE=147.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-27 16:28:57 AND VALUE=148.9
2021.05.17 20:38:56.897 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-27 17:30:00, EVENT='rl_av_h', VALUE=145.233 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-27 17:01:58 AND VALUE=144.9
2021.05.17 20:38:56.899 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-27 19:30:00, EVENT='rl_av_h', VALUE=144.400 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-27 19:18:59 AND VALUE=142.9
2021.05.17 20:38:56.902 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-27 22:30:00, EVENT='rl_av_h', VALUE=145.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-27 22:03:02 AND VALUE=143.9
2021.05.17 20:38:56.914 3: DbLog DBTest: reduceLogNbl deleting 9 records of day: 2021-04-28
2021.05.17 20:38:56.916 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 06:53:08) AND (VALUE=151.9)
2021.05.17 20:38:56.918 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 08:34:10) AND (VALUE=149.9)
2021.05.17 20:38:56.921 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 11:24:11) AND (VALUE=147.9)
2021.05.17 20:38:56.923 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 12:28:12) AND (VALUE=151.9)
2021.05.17 20:38:56.925 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 13:38:13) AND (VALUE=147.9)
2021.05.17 20:38:56.927 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 14:59:14) AND (VALUE=143.9)
2021.05.17 20:38:56.928 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 16:48:15) AND (VALUE=145.9)
2021.05.17 20:38:56.931 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 17:29:15) AND (VALUE=146.9)
2021.05.17 20:38:56.933 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 19:28:17) AND (VALUE=142.9)
2021.05.17 20:38:56.940 3: DbLog DBTest: reduceLogNbl (hourly-average) updating 10 records of day: 2021-04-28
2021.05.17 20:38:56.941 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-28 06:30:00, EVENT='rl_av_h', VALUE=150.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-28 06:01:08 AND VALUE=149.9
2021.05.17 20:38:56.944 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-28 08:30:00, EVENT='rl_av_h', VALUE=150.400 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-28 08:25:09 AND VALUE=150.9
2021.05.17 20:38:56.947 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-28 11:30:00, EVENT='rl_av_h', VALUE=149.400 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-28 11:19:11 AND VALUE=150.9
2021.05.17 20:38:56.950 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-28 12:30:00, EVENT='rl_av_h', VALUE=149.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-28 12:24:12 AND VALUE=147.9
2021.05.17 20:38:56.953 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-28 13:30:00, EVENT='rl_av_h', VALUE=148.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-28 13:19:13 AND VALUE=149.9
2021.05.17 20:38:56.956 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-28 14:30:00, EVENT='rl_av_h', VALUE=144.400 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-28 14:09:13 AND VALUE=144.9
2021.05.17 20:38:56.959 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-28 16:30:00, EVENT='rl_av_h', VALUE=146.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-28 16:29:15 AND VALUE=147.9
2021.05.17 20:38:56.961 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-28 17:30:00, EVENT='rl_av_h', VALUE=145.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-28 17:09:15 AND VALUE=144.9
2021.05.17 20:38:56.964 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-28 19:30:00, EVENT='rl_av_h', VALUE=141.400 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-28 19:19:17 AND VALUE=139.9
2021.05.17 20:38:56.967 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-28 22:30:00, EVENT='rl_av_h', VALUE=143.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-28 22:24:19 AND VALUE=141.9
2021.05.17 20:38:56.976 3: DbLog DBTest: reduceLogNbl finished. Rows processed: 992, deleted: 271, updated: 240, time: 1.94sec
2021.05.17 20:38:56.977 5: DbLog DBTest -> DbLog_reduceLogNbl finished
-------------------------------------------------------------------------------------------------
Daten:
"2021-04-28 23:53:20";"Jet";"HTTPMOD";"E10: 145.9  Cent";"E10";"145.9";"Cent"  => unverändert ok 

"2021-04-28 22:53:19";"Jet";"HTTPMOD";"E10: 145.9  Cent";"E10";"145.9";"Cent" => nicht gelöscht nok

"2021-04-28 22:24:19";"Jet";"HTTPMOD";"E10: 141.9  Cent";"E10";"141.9";"Cent" => Update Mittelwert ok
"2021-04-28 21:24:18";"Jet";"HTTPMOD";"E10: 141.9  Cent";"E10";"141.9";"Cent"  => unverändert ok
"2021-04-28 20:24:18";"Jet";"HTTPMOD";"E10: 141.9  Cent";"E10";"141.9";"Cent" => unverändert ok
"2021-04-28 19:28:17";"Jet";"HTTPMOD";"E10: 142.9  Cent";"E10";"142.9";"Cent" => gelöscht ok
"2021-04-28 19:19:17";"Jet";"HTTPMOD";"E10: 139.9  Cent";"E10";"139.9";"Cent" => Update Mittelwert ok
"2021-04-28 18:19:16";"Jet";"HTTPMOD";"E10: 139.9  Cent";"E10";"139.9";"Cent" => unverändert ok
"2021-04-28 17:29:15";"Jet";"HTTPMOD";"E10: 146.9  Cent";"E10";"146.9";"Cent" => gelöscht ok
"2021-04-28 17:09:15";"Jet";"HTTPMOD";"E10: 144.9  Cent";"E10";"144.9";"Cent" => Update Mittelwert ok

Test #3 auf DBLog Device (DBTest) mit reduceLogNbl requested with DAYS=18:48, AVERAGE=DAY, INCLUDE=Jet:E10
Testdatenbank mit Daten von 30.03 bis 17.05 / ReduceLog Average=Day von 30.03 bis 28.04
ab 30.03 werden jeweils ganze Tage auf den stündlichen Durchschnitt und danach auf täglichen Durchschnitt reduziert; am jüngste Tag 28.4 wird direkt im Log ersichtlich kein täglicher Durchschnitt gebildet
==> also am Ende des Zeitraus unsauber; Durchschnitt wird gebildet aber am Ende nicht alle entsprechenden Daten gelöscht; es sollten vielleicht immer ganze Tage bearbeitet werden

Code Auswählen


2021.05.17 20:58:30.474 5: DbLog DBTest -> Start DbLog_reduceLogNbl
2021.05.17 20:58:30.484 3: DbLog DBTest: reduceLogNbl requested with DAYS=18:48, AVERAGE=DAY, INCLUDE=Jet:E10
2021.05.17 20:58:30.485 4: DbLog DBTest -> AutoCommit mode: ON, Transaction mode: ON
2021.05.17 20:58:30.523 3: DbLog DBTest: reduceLogNbl deleting 8 records of day: 2021-03-30
2021.05.17 20:58:30.525 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 10:33:54) AND (VALUE=147.9)
2021.05.17 20:58:30.528 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 10:44:54) AND (VALUE=145.9)
2021.05.17 20:58:30.530 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 11:57:54) AND (VALUE=140.9)
2021.05.17 20:58:30.532 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 13:38:56) AND (VALUE=143.9)
2021.05.17 20:58:30.535 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 14:43:56) AND (VALUE=139.9)
2021.05.17 20:58:30.537 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 16:38:58) AND (VALUE=141.9)
2021.05.17 20:58:30.539 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 17:51:09) AND (VALUE=143.9)
2021.05.17 20:58:30.542 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 19:28:06) AND (VALUE=142.9)
2021.05.17 20:58:30.554 3: DbLog DBTest: reduceLogNbl (hourly-average) updating 7 records of day: 2021-03-30
2021.05.17 20:58:30.556 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-03-30 10:30:00, EVENT='rl_av_h', VALUE=149.233 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-03-30 10:26:54 AND VALUE=153.9
2021.05.17 20:58:30.560 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-03-30 11:30:00, EVENT='rl_av_h', VALUE=142.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-03-30 11:17:54 AND VALUE=144.9
2021.05.17 20:58:30.563 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-03-30 13:30:00, EVENT='rl_av_h', VALUE=144.400 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-03-30 13:26:55 AND VALUE=144.9
2021.05.17 20:58:30.567 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-03-30 14:30:00, EVENT='rl_av_h', VALUE=141.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-03-30 14:38:56 AND VALUE=143.9
2021.05.17 20:58:30.570 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-03-30 16:30:00, EVENT='rl_av_h', VALUE=142.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-03-30 16:26:58 AND VALUE=143.9
2021.05.17 20:58:30.573 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-03-30 17:30:00, EVENT='rl_av_h', VALUE=143.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-03-30 17:27:59 AND VALUE=143.9
2021.05.17 20:58:30.576 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-03-30 19:30:00, EVENT='rl_av_h', VALUE=141.400 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-03-30 19:20:06 AND VALUE=139.9
2021.05.17 20:58:30.587 3: DbLog DBTest: reduceLogNbl (daily-average) updating 1, deleting 23 records of day: 2021-03-30
2021.05.17 20:58:30.588 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-03-30 00:26:45'
2021.05.17 20:58:30.591 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-03-30 01:26:46'
2021.05.17 20:58:30.593 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-03-30 02:26:47'
2021.05.17 20:58:30.595 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-03-30 03:26:48'
2021.05.17 20:58:30.597 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-03-30 04:26:48'
2021.05.17 20:58:30.598 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-03-30 05:26:49'
2021.05.17 20:58:30.600 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-03-30 06:26:50'
2021.05.17 20:58:30.602 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-03-30 07:26:51'
2021.05.17 20:58:30.604 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-03-30 08:26:51'
2021.05.17 20:58:30.606 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-03-30 09:26:52'
2021.05.17 20:58:30.608 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-03-30 10:30:00'
2021.05.17 20:58:30.610 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-03-30 11:30:00'
2021.05.17 20:58:30.612 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-03-30 12:26:55'
2021.05.17 20:58:30.614 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-03-30 13:30:00'
2021.05.17 20:58:30.616 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-03-30 14:30:00'
2021.05.17 20:58:30.618 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-03-30 15:26:57'
2021.05.17 20:58:30.620 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-03-30 16:30:00'
2021.05.17 20:58:30.622 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-03-30 17:30:00'
2021.05.17 20:58:30.624 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-03-30 18:20:06'
2021.05.17 20:58:30.625 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-03-30 19:30:00'
2021.05.17 20:58:30.627 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-03-30 20:24:06'
2021.05.17 20:58:30.629 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-03-30 21:24:07'
2021.05.17 20:58:30.631 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-03-30 22:24:07'
2021.05.17 20:58:30.633 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-03-30 12:00:00, EVENT='rl_av_d', VALUE=147.247 WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-03-30 23:24:07)
...
31.03 bis 26.04 ok und daher aus dem Log genommen
...
2021.05.17 20:58:34.119 3: DbLog DBTest: reduceLogNbl deleting 13 records of day: 2021-04-27
2021.05.17 20:58:34.121 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 09:26:53) AND (VALUE=153.9)
2021.05.17 20:58:34.123 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 10:44:54) AND (VALUE=148.9)
2021.05.17 20:58:34.126 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 11:08:54) AND (VALUE=144.9)
2021.05.17 20:58:34.128 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 12:27:55) AND (VALUE=148.9)
2021.05.17 20:58:34.130 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 13:39:56) AND (VALUE=147.9)
2021.05.17 20:58:34.132 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 14:16:56) AND (VALUE=146.9)
2021.05.17 20:58:34.134 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 14:18:56) AND (VALUE=144.9)
2021.05.17 20:58:34.136 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 15:28:57) AND (VALUE=148.9)
2021.05.17 20:58:34.138 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 16:38:58) AND (VALUE=146.9)
2021.05.17 20:58:34.140 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 17:17:58) AND (VALUE=143.9)
2021.05.17 20:58:34.142 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 17:26:58) AND (VALUE=146.9)
2021.05.17 20:58:34.144 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 19:28:00) AND (VALUE=145.9)
2021.05.17 20:58:34.147 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 22:52:02) AND (VALUE=147.9)
2021.05.17 20:58:34.158 3: DbLog DBTest: reduceLogNbl (hourly-average) updating 11 records of day: 2021-04-27
2021.05.17 20:58:34.160 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-27 09:30:00, EVENT='rl_av_h', VALUE=151.400 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-27 09:24:53 AND VALUE=148.9
2021.05.17 20:58:34.163 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-27 10:30:00, EVENT='rl_av_h', VALUE=149.400 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-27 10:18:53 AND VALUE=149.9
2021.05.17 20:58:34.166 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-27 11:30:00, EVENT='rl_av_h', VALUE=146.400 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-27 11:05:54 AND VALUE=147.9
2021.05.17 20:58:34.169 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-27 12:30:00, EVENT='rl_av_h', VALUE=146.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-27 12:08:55 AND VALUE=144.9
2021.05.17 20:58:34.172 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-27 13:30:00, EVENT='rl_av_h', VALUE=148.400 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-27 13:27:55 AND VALUE=148.9
2021.05.17 20:58:34.176 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-27 14:30:00, EVENT='rl_av_h', VALUE=145.567 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-27 14:08:56 AND VALUE=144.9
2021.05.17 20:58:34.179 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-27 15:30:00, EVENT='rl_av_h', VALUE=146.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-27 15:18:57 AND VALUE=144.9
2021.05.17 20:58:34.182 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-27 16:30:00, EVENT='rl_av_h', VALUE=147.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-27 16:28:57 AND VALUE=148.9
2021.05.17 20:58:34.185 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-27 17:30:00, EVENT='rl_av_h', VALUE=145.233 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-27 17:01:58 AND VALUE=144.9
2021.05.17 20:58:34.189 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-27 19:30:00, EVENT='rl_av_h', VALUE=144.400 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-27 19:18:59 AND VALUE=142.9
2021.05.17 20:58:34.192 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-27 22:30:00, EVENT='rl_av_h', VALUE=145.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-27 22:03:02 AND VALUE=143.9
2021.05.17 20:58:34.203 3: DbLog DBTest: reduceLogNbl (daily-average) updating 1, deleting 23 records of day: 2021-04-27
2021.05.17 20:58:34.204 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-04-27 00:52:46'
2021.05.17 20:58:34.206 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-04-27 01:52:47'
2021.05.17 20:58:34.209 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-04-27 02:52:47'
2021.05.17 20:58:34.211 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-04-27 03:52:48'
2021.05.17 20:58:34.214 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-04-27 04:52:49'
2021.05.17 20:58:34.216 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-04-27 05:52:50'
2021.05.17 20:58:34.218 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-04-27 06:52:51'
2021.05.17 20:58:34.221 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-04-27 07:24:51'
2021.05.17 20:58:34.223 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-04-27 08:24:52'
2021.05.17 20:58:34.226 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-04-27 09:30:00'
2021.05.17 20:58:34.228 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-04-27 10:30:00'
2021.05.17 20:58:34.231 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-04-27 11:30:00'
2021.05.17 20:58:34.233 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-04-27 12:30:00'
2021.05.17 20:58:34.235 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-04-27 13:30:00'
2021.05.17 20:58:34.238 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-04-27 14:30:00'
2021.05.17 20:58:34.240 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-04-27 15:30:00'
2021.05.17 20:58:34.242 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-04-27 16:30:00'
2021.05.17 20:58:34.245 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-04-27 17:30:00'
2021.05.17 20:58:34.247 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-04-27 18:18:59'
2021.05.17 20:58:34.250 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-04-27 19:30:00'
2021.05.17 20:58:34.252 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-04-27 20:28:01'
2021.05.17 20:58:34.255 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-04-27 21:03:01'
2021.05.17 20:58:34.257 5: DbLog DBTest: DELETE FROM history WHERE DEVICE='Jet' AND READING='E10' AND TIMESTAMP='2021-04-27 22:30:00'
2021.05.17 20:58:34.259 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-27 12:00:00, EVENT='rl_av_d', VALUE=147.546 WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-27 23:52:03)
2021.05.17 20:58:34.273 3: DbLog DBTest: reduceLogNbl deleting 9 records of day: 2021-04-28
2021.05.17 20:58:34.276 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 06:53:08) AND (VALUE=151.9)
2021.05.17 20:58:34.280 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 08:34:10) AND (VALUE=149.9)
2021.05.17 20:58:34.282 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 11:24:11) AND (VALUE=147.9)
2021.05.17 20:58:34.285 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 12:28:12) AND (VALUE=151.9)
2021.05.17 20:58:34.287 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 13:38:13) AND (VALUE=147.9)
2021.05.17 20:58:34.289 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 14:59:14) AND (VALUE=143.9)
2021.05.17 20:58:34.292 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 16:48:15) AND (VALUE=145.9)
2021.05.17 20:58:34.294 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 17:29:15) AND (VALUE=146.9)
2021.05.17 20:58:34.296 4: DbLog DBTest: DELETE FROM history WHERE (DEVICE=Jet) AND (READING=E10) AND (TIMESTAMP=2021-04-28 19:28:17) AND (VALUE=142.9)
2021.05.17 20:58:34.307 3: DbLog DBTest: reduceLogNbl (hourly-average) updating 10 records of day: 2021-04-28
2021.05.17 20:58:34.308 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-28 06:30:00, EVENT='rl_av_h', VALUE=150.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-28 06:01:08 AND VALUE=149.9
2021.05.17 20:58:34.312 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-28 08:30:00, EVENT='rl_av_h', VALUE=150.400 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-28 08:25:09 AND VALUE=150.9
2021.05.17 20:58:34.315 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-28 11:30:00, EVENT='rl_av_h', VALUE=149.400 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-28 11:19:11 AND VALUE=150.9
2021.05.17 20:58:34.318 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-28 12:30:00, EVENT='rl_av_h', VALUE=149.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-28 12:24:12 AND VALUE=147.9
2021.05.17 20:58:34.322 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-28 13:30:00, EVENT='rl_av_h', VALUE=148.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-28 13:19:13 AND VALUE=149.9
2021.05.17 20:58:34.325 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-28 14:30:00, EVENT='rl_av_h', VALUE=144.400 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-28 14:09:13 AND VALUE=144.9
2021.05.17 20:58:34.328 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-28 16:30:00, EVENT='rl_av_h', VALUE=146.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-28 16:29:15 AND VALUE=147.9
2021.05.17 20:58:34.331 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-28 17:30:00, EVENT='rl_av_h', VALUE=145.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-28 17:09:15 AND VALUE=144.9
2021.05.17 20:58:34.335 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-28 19:30:00, EVENT='rl_av_h', VALUE=141.400 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-28 19:19:17 AND VALUE=139.9
2021.05.17 20:58:34.338 4: DbLog DBTest: UPDATE history SET TIMESTAMP=2021-04-28 22:30:00, EVENT='rl_av_h', VALUE=143.900 WHERE DEVICE=Jet AND READING=E10 AND TIMESTAMP=2021-04-28 22:24:19 AND VALUE=141.9
2021.05.17 20:58:34.347 3: DbLog DBTest: reduceLogNbl finished. Rows processed: 992, deleted: 938, updated: 269, time: 3.87sec
2021.05.17 20:58:34.348 5: DbLog DBTest -> DbLog_reduceLogNbl finished
-------------------------------------------------------------------------------------------------
Daten:
"2021-04-28 23:53:20";"Jet";"HTTPMOD";"E10: 145.9  Cent";"E10";"145.9";"Cent"  => unverändert ok 

"2021-04-28 22:53:19";"Jet";"HTTPMOD";"E10: 145.9  Cent";"E10";"145.9";"Cent" => nicht gelöscht nok

"2021-04-28 22:24:19";"Jet";"HTTPMOD";"E10: 141.9  Cent";"E10";"141.9";"Cent" => Update Mittelwert ok
"2021-04-28 21:24:18";"Jet";"HTTPMOD";"E10: 141.9  Cent";"E10";"141.9";"Cent"  => unverändert ok
"2021-04-28 20:24:18";"Jet";"HTTPMOD";"E10: 141.9  Cent";"E10";"141.9";"Cent" => unverändert ok
"2021-04-28 19:28:17";"Jet";"HTTPMOD";"E10: 142.9  Cent";"E10";"142.9";"Cent" => gelöscht ok
"2021-04-28 19:19:17";"Jet";"HTTPMOD";"E10: 139.9  Cent";"E10";"139.9";"Cent" => Update Mittelwert ok
"2021-04-28 18:19:16";"Jet";"HTTPMOD";"E10: 139.9  Cent";"E10";"139.9";"Cent" => unverändert ok
"2021-04-28 17:29:15";"Jet";"HTTPMOD";"E10: 146.9  Cent";"E10";"146.9";"Cent" => gelöscht ok
"2021-04-28 17:09:15";"Jet";"HTTPMOD";"E10: 144.9  Cent";"E10";"144.9";"Cent" => Update Mittelwert ok
Final kein Tagesmittelwert gebildet; es ist wie bei Test#2 unsauber bei den stündlichen Werten am Ende

supergrobi · 16 Juli 2021, 10:12:22

Guten Morgen Forum,

Erst einmal vielen Dank an Heiko für diesess tolle Modul.
Ich hab es nun schon einige Zeit im Einsatz und bin nun leider auf ein Problem gestossen, dass ich magels Kenntnisse wohl nicht allein lösen kann.

Ich habe mir mehrere AT's definiert, die z.b. MIN/MAX/AVG berechnen sollen. Hier mal ein Beispiel:

Code Auswählen

defmod at.Energy.Tag.BZRadio at *00:11:00 attr DBReporting_LaCrosse device FBDECT_fbahahttp_08761_0060122;;\
attr DBReporting_LaCrosse reading power;;\
attr DBReporting_LaCrosse aggregation day;;\
attr DBReporting_LaCrosse timestamp_begin previous_day_begin;;\
attr DBReporting_LaCrosse timestamp_end previous_day_end;;\
set DBReporting_LaCrosse averageValue writeToDBSingle\

attr at.Energy.Tag.BZRadio DbLogExclude .*
attr at.Energy.Tag.BZRadio group Berechnung
attr at.Energy.Tag.BZRadio room System

setstate at.Energy.Tag.BZRadio Next: 00:11:00
setstate at.Energy.Tag.BZRadio 2021-07-16 00:11:00 state Next: 00:11:00

Wenn ich das mache, Erschein jetzt im Log:

Code Auswählen

2021.07.15 06:39:59 3: DbRep DBReporting_LaCrosse - get initial structure information of database "fhem", remaining attempts: 3
2021.07.15 06:39:59 3: DbRep DBReporting_LaCrosse - Connectiontest to database mysql:database=fhem;host=192.168.x.x;port=xxx with user xxx
2021.07.15 06:39:59 3: DbRep DBReporting_LaCrosse - Index Report_Idx exists. Check ok
2021.07.15 06:39:59 3: DbRep DBReporting_LaCrosse - Initial data information retrieved successfully - total time used: 0.0056 seconds

Starte ich das zweite, erscheint dann im Log:

Code Auswählen

2021.07.15 06:41:00 3: DbRep DBReporting_LaCrosse - WARNING - running process DEAD:750 will be killed now to start a new operation
2021.07.15 06:41:00 3: DbRep DBReporting_LaCrosse - get initial structure information of database "fhem", remaining attempts: 2
2021.07.15 06:41:00 3: DbRep DBReporting_LaCrosse - Connectiontest to database mysql:database=fhem;host=192.168.x.x;port=xxx with user xxx
2021.07.15 06:41:00 3: DbRep DBReporting_LaCrosse - Index Report_Idx exists. Check ok
2021.07.15 06:41:00 3: DbRep DBReporting_LaCrosse - Initial data information retrieved successfully - total time used: 0.0140 seconds

warum wird der Prozess gekillt, obwohl er doch eigentlich nach 0.0056 s abgeschlossen war
Es werden leider auch keine Werte berechnen und in die DB eingetragen...

DS_Starter · 16 Juli 2021, 12:29:31

Zitat
warum wird der Prozess gekillt, obwohl er doch eigentlich nach 0.0056 s abgeschlossen war
Es werden leider auch keine Werte berechnen und in die DB eingetragen...

Es ist fraglich dass sich die Meldung "WARNING - running process DEAD:750 will be killed now to start a new operation" auf den vorangegangenen "get initial structure information" bezieht.

Ich vermute vielmehr du verwendest mehrere at um zeitgleich bzw. mit zu kurzen Zeitabständen ein und dasselbe DbRep-Device anzustarten um MIN/MAX/AVG zu berechnen ?

LG,
Heiko

RalfRog · 16 Juli 2021, 16:42:01

Zitat von: RalfRog am 29 Mai 2021, 12:38:26
Damit der Zusammenhang erhalten bleibt hier die Test#1 bis 3 am DBLog ....

Hi...
Ich häng mich hier nochmal mit der reduceLog(Nbl)-Problematik und dem/den "Fehler/n" am Ende der ReduceLogPeriode rein.

Gruß Ralf

DS_Starter · 16 Juli 2021, 16:53:30

Hallo Ralf,

ich habe deine Posts nicht vergessen.
Das kommt an die Reihe wenn ich mich mal wieder DbRep widme.
Zur Zeit will ich SolarForecast mal soweit abschliessen.
Zuviel Multitasking schädigt auf Dauer das Gedächtnis habe ich gerade in einem Buch von David Precht gelesen. 😉

Lg,
Heiko

RalfRog · 16 Juli 2021, 16:59:25

Ok
Ich halte es im Hinterkopf und checke hin und wieder die Nachrichten.
Zur Aufarbeitung kann ich dann soweit möglich zuarbeiten.

Ja verstehe ich Multitasking kann einen schon recht kirre machen

supergrobi · 16 Juli 2021, 17:44:15

Zitat von: DS_Starter am 16 Juli 2021, 12:29:31
Ich vermute vielmehr du verwendest mehrere at um zeitgleich bzw. mit zu kurzen Zeitabständen ein und dasselbe DbRep-Device anzustarten um MIN/MAX/AVG zu berechnen ?

Hallo Heiko,
das hatte ich auch vermutet. Jedoch hatte ich die beiden geposteten Aufrufe mit dem Logfile Eintrag händisch aufgerufen (morgens 6:41). Der nächste Aufruf ist dann aber erst am nächsten Tag um 0:01 Uhr usw.

Code Auswählen

2021.07.16 00:01:00 3: DbRep DBReporting_LaCrosse - WARNING - running process DEAD:795 will be killed now to start a new operation
2021.07.16 00:01:00 3: DbRep DBReporting_LaCrosse - get initial structure information of database "fhem", remaining attempts: 1
2021.07.16 00:01:00 3: DbRep DBReporting_LaCrosse - Connectiontest to database mysql:database=fhem;host=192.168.xxx.xxx;port=xxx with user xxx
2021.07.16 00:01:00 3: DbRep DBReporting_LaCrosse - Index Report_Idx exists. Check ok
2021.07.16 00:01:00 3: DbRep DBReporting_LaCrosse - Initial data information retrieved successfully - total time used: 0.0053 seconds
2021.07.16 00:02:00 3: DbRep DBReporting_LaCrosse - WARNING - running process DEAD:23144 will be killed now to start a new operation
2021.07.16 00:02:00 3: DbRep DBReporting_LaCrosse - get initial structure information of database "fhem", remaining attempts: 0
2021.07.16 00:03:00 3: DbRep DBReporting_LaCrosse - WARNING - running process DEAD:23144 will be killed now to start a new operation
2021.07.16 00:03:00 3: DbRep DBReporting_LaCrosse - get initial structure information of database "fhem", remaining attempts: 3
2021.07.16 00:03:00 3: DbRep DBReporting_LaCrosse - Connectiontest to database mysql:database=fhem;host=192.168.xxx.xxx;port=xxx with user xxx
2021.07.16 00:03:00 3: DbRep DBReporting_LaCrosse - Index Report_Idx exists. Check ok
2021.07.16 00:03:00 3: DbRep DBReporting_LaCrosse - Initial data information retrieved successfully - total time used: 0.0051 seconds
2021.07.16 00:04:04 3: DbRep DBReporting_LaCrosse - WARNING - running process DEAD:23179 will be killed now to start a new operation
2021.07.16 00:04:04 3: DbRep DBReporting_LaCrosse - get initial structure information of database "fhem", remaining attempts: 2
2021.07.16 00:04:04 3: DbRep DBReporting_LaCrosse - Connectiontest to database mysql:database=fhem;host=192.168.xxx.xxx;port=xxx with user xxx
2021.07.16 00:04:04 3: DbRep DBReporting_LaCrosse - Index Report_Idx exists. Check ok
2021.07.16 00:04:04 3: DbRep DBReporting_LaCrosse - Initial data information retrieved successfully - total time used: 0.0043 seconds

auch wenn ich das DbRep jetzt nur einmalig ausführe, kommt besagte Fehlermeldung:

Code Auswählen

2021.07.16 17:37:19 3: DbRep DBReporting_LaCrosse - WARNING - running process  will be killed now to start a new operation
2021.07.16 17:37:19 3: DbRep DBReporting_LaCrosse - get initial structure information of database "fhem", remaining attempts: 3
2021.07.16 17:37:19 3: DbRep DBReporting_LaCrosse - Connectiontest to database mysql:database=fhem;host=192.168.xxx.xxx;port=xxx with user xxx
2021.07.16 17:37:19 3: DbRep DBReporting_LaCrosse - Index Report_Idx exists. Check ok
2021.07.16 17:37:19 3: DbRep DBReporting_LaCrosse - Initial data information retrieved successfully - total time used: 0.0070 seconds

DS_Starter · 16 Juli 2021, 18:38:32

Ich sehe jetzt dass deine Nebenprozesse wohl immer sterben, siehe

DEAD:23144

Stell doch mal versose 4 oder 5 in dem device an.

supergrobi · 17 Juli 2021, 07:40:42

Hier mal das Log mit Verbose 5

Code Auswählen

2021.07.17 07:36:06 3: DbRep DBReporting_LaCrosse - WARNING - running process DEAD:53461 will be killed now to start a new operation
2021.07.17 07:36:06 3: DbRep DBReporting_LaCrosse - get initial structure information of database "fhem", remaining attempts: 3
2021.07.17 07:36:06 3: DbRep DBReporting_LaCrosse - Connectiontest to database mysql:database=fhem;host=192.168.xxx.xxx;port=xxx with user xxx
2021.07.17 07:36:06 4: DbRep DBReporting_LaCrosse - database user for operation: xxx
2021.07.17 07:36:06 3: DbRep DBReporting_LaCrosse - Index Report_Idx exists. Check ok
2021.07.17 07:36:06 4: DbRep DBReporting_LaCrosse - all grants: SHOW VIEW,DROP,SELECT,EVENT,LOCK TABLES,CREATE VIEW,UPDATE,EXECUTE,ALTER ROUTINE,CREATE ROUTINE,CREATE,REFERENCES,INSERT,ALTER,DELETE,INDEX,USAGE,CREATE TEMPORARY TABLES,TRIGGER
2021.07.17 07:36:06 3: DbRep DBReporting_LaCrosse - Initial data information retrieved successfully - total time used: 0.0123 seconds

DS_Starter · 17 Juli 2021, 07:53:12

Und danach kommt nichts mehr ?

DS_Starter · 17 Juli 2021, 08:27:28

Also ein normaler Ablauf mit verbose 5 sieht so aus:

Code Auswählen


2021.07.17 08:17:15.187 4: DbRep Rep.CPU - database user for operation: fhemtest
2021.07.17 08:17:15.190 3: DbRep Rep.CPU - Index Report_Idx exists. Check ok
2021.07.17 08:17:15.192 4: DbRep Rep.CPU - all grants: DELETE,FILE,INDEX,INSERT,PROCESS,SELECT,UPDATE
2021.07.17 08:17:15.192 3: DbRep Rep.CPU - Initial data information retrieved successfully - total time used: 0.0075 seconds
2021.07.17 08:17:15.236 3: DbRep Rep.CPU - Connectiontest to db mysql:database=fhemtest;host=192.168.2.44;port=3306 successful
2021.07.17 08:17:15.248 4: DbRep Rep.CPU - -------- New selection --------- 
2021.07.17 08:17:15.249 4: DbRep Rep.CPU - Command: countEntries history
2021.07.17 08:17:15.249 4: DbRep Rep.CPU - Timestamp begin human readable: not set
2021.07.17 08:17:15.250 4: DbRep Rep.CPU - Timestamp end human readable: not set
2021.07.17 08:17:15.250 4: DbRep Rep.CPU - Aggregation: no
2021.07.17 08:17:15.272 5: DbRep Rep.CPU - IsTimeSet: 0, IsAggrSet: 0
2021.07.17 08:17:15.274 5: DbRep Rep.CPU - Timestamp-Array: 
....

Die initialen Daten werden nur beim ersten Start ermittelt. Wichtig ist dabei die Meldung "Connectiontest to db mysql:database=fhemtest;host=192.168.2.44;port=3306 successful".
Sie zeigt an dass der nebenläufige Prozess auch fertig geworden ist. Bei dir scheint das nicht der Fall zu sein. Das heißt der Nebenprozess kommt nicht zurück, was auch zu den DEAD Meldungen passt.
Fraglich ist wieso es bei dir so ist ... mal nach Linuxprozesse DEAD googeln...

DS_Starter · 17 Juli 2021, 09:36:01

In meinem contrib liegt eine neue Version. Sie bringt am Anfang etwas mehr Infos welcher Prozess gestartet wird:

2021.07.17 09:27:09.747 3: DbRep Rep.Import - Connectiontest to database mysql:database=fhemtest;host=192.168.2.44;port=3306 with user fhemtest
2021.07.17 09:27:09.758 5: DbRep Rep.Import - start getInitData with PID "3599"
2021.07.17 09:27:09.808 4: DbRep Rep.Import - database user for operation: fhemtest
2021.07.17 09:27:09.811 3: DbRep Rep.Import - Index Report_Idx exists. Check ok
2021.07.17 09:27:09.813 4: DbRep Rep.Import - all grants: INSERT,PROCESS,SELECT,UPDATE,DELETE,FILE,INDEX
2021.07.17 09:27:09.814 3: DbRep Rep.Import - Initial data information retrieved successfully - total time used: 0.0086 seconds
2021.07.17 09:27:09.829 5: DbRep Rep.Import - getInitData finished PID "3599"
2021.07.17 09:27:09.875 3: DbRep Rep.Import - Connectiontest to db mysql:database=fhemtest;host=192.168.2.44;port=3306 successful
2021.07.17 09:27:09.888 4: DbRep Rep.Import - -------- New selection ---------
2021.07.17 09:27:09.889 4: DbRep Rep.Import - Command: countEntries history
....

Wenn der Prozess nicht beendet wird, kann man gezielt nach dieser PID im Linux suchen.
Ich checke die Version noch ein, aber kannst damit schonmal arbeiten.

supergrobi · 17 Juli 2021, 10:48:18

Hallo Heiko,

hier mal das neue Log...

Code Auswählen

2021.07.17 10:40:32 3: DbRep DBReporting_LaCrosse - WARNING - running process DEAD:1127 will be killed now to start a new operation
2021.07.17 10:40:32 3: DbRep DBReporting_LaCrosse - get initial structure information of database "fhem", remaining attempts: 3
2021.07.17 10:40:32 3: DbRep DBReporting_LaCrosse - Connectiontest to database mysql:database=fhem;host=192.168.xxx.xxx;port=xxx with user xxx
2021.07.17 10:40:32 5: DbRep DBReporting_LaCrosse - start getInitData with PID "1153"
2021.07.17 10:40:32 4: DbRep DBReporting_LaCrosse - database user for operation: xxx
2021.07.17 10:40:32 3: DbRep DBReporting_LaCrosse - Index Report_Idx exists. Check ok
2021.07.17 10:40:32 4: DbRep DBReporting_LaCrosse - all grants: REFERENCES,CREATE,ALTER ROUTINE,EVENT,DROP,SELECT,LOCK TABLES,EXECUTE,DELETE,CREATE ROUTINE,INSERT,INDEX,SHOW VIEW,CREATE VIEW,USAGE,TRIGGER,CREATE TEMPORARY TABLES,UPDATE,ALTER
2021.07.17 10:40:32 3: DbRep DBReporting_LaCrosse - Initial data information retrieved successfully - total time used: 0.0042 seconds
2021.07.17 10:41:05 3: DbRep DBReporting_LaCrosse - WARNING - running process DEAD:1153 will be killed now to start a new operation
2021.07.17 10:41:05 3: DbRep DBReporting_LaCrosse - get initial structure information of database "fhem", remaining attempts: 2
2021.07.17 10:41:05 3: DbRep DBReporting_LaCrosse - Connectiontest to database mysql:database=fhem;host=192.168.xxx.xxx;port=xxx with user xxx
2021.07.17 10:41:05 5: DbRep DBReporting_LaCrosse - start getInitData with PID "1167"
2021.07.17 10:41:05 4: DbRep DBReporting_LaCrosse - database user for operation: xxx
2021.07.17 10:41:05 3: DbRep DBReporting_LaCrosse - Index Report_Idx exists. Check ok
2021.07.17 10:41:05 4: DbRep DBReporting_LaCrosse - all grants: REFERENCES,CREATE,EVENT,DROP,ALTER ROUTINE,SELECT,LOCK TABLES,EXECUTE,CREATE ROUTINE,DELETE,INSERT,INDEX,SHOW VIEW,CREATE VIEW,USAGE,CREATE TEMPORARY TABLES,TRIGGER,UPDATE,ALTER
2021.07.17 10:41:05 3: DbRep DBReporting_LaCrosse - Initial data information retrieved successfully - total time used: 0.0044 seconds

laut HTOP werden diese Prozesse (hier der PID 1153 und aktuell der PID 1167) jedoch sofort wieder beendet und werden trotzdem beim nächsten Start mit "...will be Killed..." angezeigt. Teilweise werden die so schnell aufgerufen und beendet, dass sie in HTOP gar nicht erst auftauchen.

DS_Starter · 17 Juli 2021, 11:45:28

Zitat
laut HTOP werden diese Prozesse (hier der PID 1153 und aktuell der PID 1167) jedoch sofort wieder beendet und werden trotzdem beim nächsten Start mit "...will be Killed..." angezeigt.

Ja, das ist normal in diesem Fall. Für FHEM/das Modul läuft der Prozess ja noch weil er sich bisher nicht zurück gemeldet hatte.

Die zentrale Frage ist wodurch diese Prozesse bei dir einfach sterben. Sie kommen ja nichtmal mit einem Fehler zurück der angezeigt werden würde.
Ich wette du findest im DbRep mit "get <> blockinginfo" einige DEAD Prozesse.
Du kannst im FHEMWEB in der Kommandozeile auch BlockingInfo ausführen.

Eine Vermutung die ich habe liegt im Umfeld von Telnet. Es muß ein verfügbares Device vom Type "telnet" bei dir geben.
Die oben angegebenen Kommandos sollten weiteren Aufschluß geben.

supergrobi · 17 Juli 2021, 12:09:25

BlockingInfo liefert folgendes:

Code Auswählen

Pid:3012 Fn:PRESENCE_DoLocalPingScan Arg:Klaus_WLAN_Device_2|192.168.2.162|0|4 Timeout:60 ConnectedVia:telnetPort_127.0.0.1_56316
Pid:3014 Fn:PRESENCE_DoLocalPingScan Arg:Baerbel_WLAN_Device_2|192.168.2.168|0|4 Timeout:60 ConnectedVia:telnetPort_127.0.0.1_56322

aber ich stecke da echt nicht so tief drin, dass ich das in Verbindung bringen könnte