WARNING : number of outputs for step 13596 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11881 final have less inputs used (1) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11881 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13625 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 11884 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 3 of step 11884 have datatype=6 WARNING : type of output 1 of step 13596 doesn't seem to be define in the database( WARNING : type of input 3 of step 11881 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 0 of step 13625 have datatype=18 WARNING : type of output 1 of step 13625 doesn't seem to be define in the database( WARNING : type of input 5 of step 11884 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 2, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier Fonction SLA_RUBBIA TODO : Insert select and so on ***** analysis of device with port 30073 for dashboard arc_en_ciel_jrm ***** **** analysis of day 2025/04/15/ **** VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! 0:00:00 apple pause between two photos 10 Find filename in sqlite. Info from logs total number of images : 8551 coverage for 10 seconds : 23:27:07 (97.72%) coverage for 20 seconds : 23:49:10 (99.25%) max time between two photos : 0:01:21 results of pre-diagnostic : light ok 8477, not duplicated 2694, two criteria ok 2694, nb forced upload 79 end of day status of photos as found in sqllite duplicated : 5778 nothing_done : 1 uploaded : 2772 Info from dashboard total number of uploaded images : 2954 number of useful images : 2850 number of finished photos : 1797 (63.05% of two criteria ok) number of finished photos for older algorithm : 0 (0.00% of two criteria ok) number of started photos : 1053 (36.95% of two criteria ok) number of finished batches : 30 (66.67% of total) number of finished batches for older algorithm : 0 (0.00% of total) number of started batches : 15 (33.33% of total) last update : 2025-04-16 11:10:38 **** analysis of day 2025/04/16/ **** VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! 0:00:00 apple pause between two photos 10 Find filename in sqlite. Info from logs total number of images : 8544 coverage for 10 seconds : 23:26:55 (97.70%) coverage for 20 seconds : 23:47:59 (99.17%) max time between two photos : 0:01:21 results of pre-diagnostic : light ok 8478, not duplicated 3396, two criteria ok 3396, nb forced upload 66 end of day status of photos as found in sqllite duplicated : 5082 nothing_done : 1 ok_for_neural_classification : 1 uploaded : 3460 Info from dashboard total number of uploaded images : 3462 number of useful images : 3396 number of finished photos : 3389 (99.79% of two criteria ok) number of finished photos for older algorithm : 0 (0.00% of two criteria ok) number of started photos : 0 (0.00% of two criteria ok) number of finished batches : 62 (100.00% of total) number of finished batches for older algorithm : 0 (0.00% of total) number of started batches : 0 (0.00% of total) last update : 2025-04-17 08:35:37 **** analysis of day 2025/04/17/ **** VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! 0:00:00 apple pause between two photos 10 Find filename in sqlite. Info from logs total number of images : 8574 coverage for 10 seconds : 23:33:23 (98.15%) coverage for 20 seconds : 23:53:00 (99.52%) max time between two photos : 0:01:20 results of pre-diagnostic : light ok 8482, not duplicated 4276, two criteria ok 4276, nb forced upload 92 end of day status of photos as found in sqllite duplicated : 4206 nothing_done : 1 ok_for_neural_classification : 5 uploaded : 4362 Info from dashboard total number of uploaded images : 4382 number of useful images : 4363 number of finished photos : 4363 (100.00% of two criteria ok) number of finished photos for older algorithm : 0 (0.00% of two criteria ok) number of started photos : 0 (0.00% of two criteria ok) number of finished batches : 78 (100.00% of total) number of finished batches for older algorithm : 0 (0.00% of total) number of started batches : 0 (0.00% of total) last update : 2025-04-18 07:00:42 **** analysis of day 2025/04/18/ **** VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! 0:00:00 apple pause between two photos 10 Find filename in sqlite. Info from logs total number of images : 8557 coverage for 10 seconds : 23:29:35 (97.89%) coverage for 20 seconds : 23:50:06 (99.31%) max time between two photos : 0:01:20 results of pre-diagnostic : light ok 8478, not duplicated 4183, two criteria ok 4183, nb forced upload 84 end of day status of photos as found in sqllite duplicated : 4295 nothing_done : 1 ok_for_neural_classification : 1 uploaded : 4260 Info from dashboard total number of uploaded images : 4275 number of useful images : 4214 number of finished photos : 4214 (100.00% of two criteria ok) number of finished photos for older algorithm : 0 (0.00% of two criteria ok) number of started photos : 0 (0.00% of two criteria ok) number of finished batches : 71 (100.00% of total) number of finished batches for older algorithm : 0 (0.00% of total) number of started batches : 0 (0.00% of total) last update : 2025-04-19 11:55:40 **** analysis of day 2025/04/19/ **** VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! 0:00:00 apple pause between two photos 10 Find filename in sqlite. Info from logs total number of images : 1783 coverage for 10 seconds : 4:53:20 (97.78%) coverage for 20 seconds : 4:57:59 (99.33%) max time between two photos : 0:01:20 results of pre-diagnostic : light ok 1771, not duplicated 44, two criteria ok 44, nb forced upload 12 end of day status of photos as found in sqllite duplicated : 1727 nothing_done : 1 uploaded : 55 Unable to find info for batches (last_run_id 1740087) in MTRPhoto.dashboard_results Info from dashboard total number of uploaded images : 56 number of useful images : 44 number of finished photos : 0 (0.00% of two criteria ok) number of finished photos for older algorithm : 0 (0.00% of two criteria ok) number of started photos : 0 (0.00% of two criteria ok) **** analysis of day 2025/04/20/ **** VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! No photos configured for this day pause between two photos 10 Unable to retrieve photo time from log, find in sqlite. Find filename in sqlite. Info from logs total number of images : 0 coverage for 10 seconds : 0:00:00 (-0.00%) coverage for 20 seconds : 0:00:00 (-0.00%) max time between two photos : 0:00:00 results of pre-diagnostic : light ok 0, not duplicated 0, two criteria ok 0, nb forced upload 0 end of day status of photos as found in sqllite Unable to find info for dashboard number 10 for day 2025-04-20 06:30:28.667685 Info from dashboard total number of uploaded images : 0 number of useful images : 0 **** analysis of day 2025/04/21/ **** VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! 5:00:00 apple pause between two photos 10 Find filename in sqlite. Info from logs total number of images : 6779 coverage for 10 seconds : 18:36:00 (97.90%) coverage for 20 seconds : 18:52:59 (99.39%) max time between two photos : 0:01:20 results of pre-diagnostic : light ok 6726, not duplicated 1, two criteria ok 1, nb forced upload 53 end of day status of photos as found in sqllite duplicated : 6725 nothing_done : 1 uploaded : 53 Unable to find info for batches (last_run_id 1743820) in MTRPhoto.dashboard_results Info from dashboard total number of uploaded images : 54 number of useful images : 1 number of finished photos : 0 (0.00% of two criteria ok) number of finished photos for older algorithm : 0 (0.00% of two criteria ok) number of started photos : 0 (0.00% of two criteria ok) **** analysis for all days **** Info from logs total number of images : 42788 coverage for 10 seconds : 4 days, 21:26:20 (97.88%) coverage for 20 seconds : 4 days, 23:11:13 (99.34%) max time between two photos : 0:08:02 results of pre-diagnostic : light ok 42412, not duplicated 14594, two criteria ok 14594, nb forced upload 386 end of day status of photos as found in sqllite duplicated : 27813 nothing_done : 6 uploaded : 14962 ok_for_neural_classification : 7 Info from dashboard total number of uploaded images : 15183 number of useful images : 14816 number of finished photos : 13763 (92.89% of two criteria ok) number of finished photos for older algorithm : 0 (0.00% of two criteria ok) number of started photos : 1053 (7.11% of two criteria ok) number of finished batches : 241 (94.14% of total) number of finished batches for older algorithm : 0 (0.00% of total) number of started batches : 15 (5.86% of total) last update : 2025-04-22 06:00:38 You can launch datou with following url to update dashboard https://www.fotonower.com/api/v1/datou/current/set?mtr_portfolio_id=22024890&mtr_datou_id=4878 cvs resume : date,nb_photos,% time,nb ok,uploaded,to upload, % uploaded, nb useful, % completed photos, last_update, remark 2025/04/15,8551,97.72%,2694,2772,0,100.00%,2850,63.05%,2025/04/16, 2025/04/16,8544,97.70%,3396,3460,1,99.97%,3389,100.00%,2025/04/17, 2025/04/17,8574,98.15%,4276,4362,5,99.89%,4363,100.00%,2025/04/18, 2025/04/18,8557,97.89%,4183,4260,1,99.98%,4214,100.00%,2025/04/19, 2025/04/19,1783,97.78%,44,55,0,100.00%,0,0.00%,2025/04/20, 2025/04/20,0,-0.00%,0,0,0,0.00%,0,0.00%,0000/00/00, 2025/04/21,6779,97.90%,1,53,0,100.00%,0,0.00%,2025/04/22, coverage for this period for every 10 second 2025/04/15/ 0.9771756617553444 2025/04/16/ 0.9770367712589266 2025/04/17/ 0.9815275639764349 2025/04/18/ 0.9788886445444971 2025/04/19/ 0.9778321017834324 2025/04/20/ -0.0 2025/04/21/ 0.9788069473576981 mean value for this period : 0.8387525272394762 coverage for this period for every 20 second 2025/04/15/ 0.9924883389854049 2025/04/16/ 0.9916665702149331 2025/04/17/ 0.9951504068334124 2025/04/18/ 0.9931364946353546 2025/04/19/ 0.9933329629423857 2025/04/20/ -0.0 2025/04/21/ 0.9933763028610852 mean value for this period : 0.8513072966389394 2.90user 0.76system 0:07.54elapsed 48%CPU (0avgtext+0avgdata 197544maxresident)k 151928inputs+72outputs (600major+108122minor)pagefaults 0swaps