python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4883' -s datou_current_4883 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 648230 load datou : 4883 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 3462>1000 please execute split_portfolio.py -i 22055303 -l 1000 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4883, datou_cur_ids : ['2727250'] with mtr_portfolio_ids : ['22055303'] and first list_photo_ids : [] new path : /proc/648230/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.03454422950744629 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Thu Apr 17 01:19:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3379, 'mtr_user_id': 31, 'name': 'learn_classif_flux_maj_generique_effnet_v2_s_02062022', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '5515864,5515840,5515844,5515850,6244400,6237996,6237998,5515847,5515841,5515868,5515866', 'photo_hashtag_type': 4374, 'photo_desc_type': 5680, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('00', 9), ('01', 10), ('02', 14), ('03', 11), ('04', 8), ('05', 240), ('06', 183), ('07', 285), ('08', 211), ('09', 134), ('10', 176), ('11', 287), ('12', 14), ('13', 110), ('14', 243), ('15', 261), ('16', 236), ('17', 143), ('18', 238), ('19', 170), ('20', 160), ('21', 138), ('22', 82), ('23', 99)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 3349, 2: 2} 16042025 22055303 Nombre de photos uploadées : 99 / 23040 (0%) 16042025 22055303 Nombre de photos taguées (types de déchets): 3351 / 99 (3384%) 16042025 22055303 Nombre de photos taguées (volume) : 3351 / 99 (3384%) elapsed_time : load_data_split_time_score 2.6226043701171875e-06 elapsed_time : order_list_meta_photo_and_scores 0.0010936260223388672 ??? elapsed_time : fill_and_build_computed_from_old_data 0.006095409393310547 elapsed_time : insert_dashboard_record_day_entry 0.031688690185546875 Creating list_photo_by_hashtags Hashtag is None Hashtag is None Hashtag is None elapsed_time : list_photo_by_hashtags 0.009716510772705078 ***** BEGIN SPLIT TIME ***** 1744761600.0 `1744835704.010084 1744835700.0 `1744838734.010145 1744838700.0 `1744838775.010137 1744838760.0 `1744838785.010133 1744838760.0 `1744838794.00913 1744838760.0 `1744838804.010144 1744838760.0 `1744838814.01014 1744838760.0 `1744838825.010161 1744838820.0 `1744838835.010138 1744838820.0 `1744838845.010136 1744838820.0 `1744838905.010136 1744838880.0 `1744838915.010154 1744838880.0 `1744838934.009127 1744838880.0 `1744838954.010137 1744838940.0 `1744838964.010134 1744838940.0 `1744838995.010135 1744838940.0 `1744839004.009154 1744839000.0 `1744839014.010134 1744839000.0 `1744839024.010134 1744839000.0 `1744839034.010144 1744839000.0 `1744839045.010137 1744839000.0 `1744839055.010141 1744839000.0 `1744839065.010155 1744839060.0 `1744839074.009124 1744839060.0 `1744839084.010136 1744839060.0 `1744839104.010137 1744839060.0 `1744839115.010143 1744839060.0 `1744839125.010139 1744839120.0 `1744839144.009125 1744839120.0 `1744839154.010135 1744839120.0 `1744839164.010137 1744839120.0 `1744839174.010136 1744839120.0 `1744839185.010154 1744839180.0 `1744839224.009125 1744839180.0 `1744839234.010136 1744839180.0 `1744839244.010142 1744839240.0 `1744839255.010136 1744839240.0 `1744839265.010136 1744839240.0 `1744839275.010143 1744839240.0 `1744839285.010138 1744839240.0 `1744839294.009127 1744839240.0 `1744839304.010162 1744839300.0 `1744839314.010135 1744839300.0 `1744839364.00915 1744839360.0 `1744839384.010134 1744839360.0 `1744839394.010141 1744839360.0 `1744839405.010139 1744839360.0 `1744839415.010138 1744839360.0 `1744839425.010153 1744839420.0 `1744839434.009128 1744839420.0 `1744839475.010136 1744839420.0 `1744839495.010134 1744839480.0 `1744839514.009134 1744839480.0 `1744839524.010139 1744839480.0 `1744839534.010136 1744839480.0 `1744839545.010155 1744839540.0 `1744839555.010137 1744839540.0 `1744839565.010139 1744839540.0 `1744839575.010145 1744839540.0 `1744839584.00913 1744839540.0 `1744839594.010141 1744839540.0 `1744839604.010142 1744839600.0 `1744839615.010136 1744839600.0 `1744839625.010136 1744839600.0 `1744839635.010134 1744839600.0 `1744839664.01015 1744839660.0 `1744839674.010133 1744839660.0 `1744839684.010138 1744839660.0 `1744839695.010135 1744839660.0 `1744839705.010136 1744839660.0 `1744839715.010136 1744839660.0 `1744839724.009151 1744839720.0 `1744839734.010137 1744839720.0 `1744839744.010136 1744839720.0 `1744839754.010136 1744839720.0 `1744839765.010145 1744839720.0 `1744839775.01014 1744839720.0 `1744839785.010162 1744839780.0 `1744839794.009125 1744839780.0 `1744840264.010163 1744840260.0 `1744840275.010133 1744840260.0 `1744840285.010134 1744840260.0 `1744840295.01014 1744840260.0 `1744840305.010138 1744840260.0 `1744840314.009129 1744840260.0 `1744840324.010161 1744840320.0 `1744840334.010136 1744840320.0 `1744840345.010135 1744840320.0 `1744840355.010135 1744840320.0 `1744840365.010135 1744840320.0 `1744840404.010137 1744840380.0 `1744840414.010137 1744840380.0 `1744840425.010135 1744840380.0 `1744840464.010133 1744840440.0 `1744840474.010145 1744840440.0 `1744840484.010139 1744840440.0 `1744840604.009126 1744840560.0 `1744840614.010135 1744840560.0 `1744840684.010159 1744840680.0 list printed: [[0], [1], [2, 3, 4, 5, 6], [7, 8, 9], [10, 11, 12], [13, 14, 15], [16, 17, 18, 19, 20, 21], [22, 23, 24, 25, 26], [27, 28, 29, 30, 31], [32, 33, 34], [35, 36, 37, 38, 39, 40], [41, 42], [43, 44, 45, 46, 47], [48, 49, 50], [51, 52, 53, 54], [55, 56, 57, 58, 59, 60], [61, 62, 63, 64], [65, 66, 67, 68, 69, 70], [71, 72, 73, 74, 75, 76], [77, 78], [79, 80, 81, 82, 83, 84], [85, 86, 87, 88, 89], [90, 91, 92], [93, 94, 95], [96, 97], [98]] forced_hashtag: JRM force hashtag to JRM elapsed_time : SPLIT_TIME 0.008523941040039062 ***** END SPLIT TIME ***** NUMBER BATCH : 26 list_ponderation used : [1e-05, 1e-05, 1e-05, 1e-05, 1e-05] , list_hashtag_class_create_as_list : ['jrm'] Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! result_one_balle_Type_JRM:{'day': '16042025', 'map_nb_amount': {0: 0, 1: 5, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 39.00000286102295, 'nb_balles_papier': 5e-05, 'begin_time_port': 'image_16042025_23_26_15_010137m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 5e-05 We reject this portfolio because of the condition_save_data : 2025-04-16 23:26:15.010137 Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! result_one_balle_Type_JRM:{'day': '16042025', 'map_nb_amount': {0: 0, 1: 3, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 19.999974966049194, 'nb_balles_papier': 3.0000000000000004e-05, 'begin_time_port': 'image_16042025_23_27_05_010161m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 3.0000000000000004e-05 We reject this portfolio because of the condition_save_data : 2025-04-16 23:27:05.010161 Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! result_one_balle_Type_JRM:{'day': '16042025', 'map_nb_amount': {0: 0, 1: 3, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 28.998991012573242, 'nb_balles_papier': 3.0000000000000004e-05, 'begin_time_port': 'image_16042025_23_28_25_010136m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 3.0000000000000004e-05 We reject this portfolio because of the condition_save_data : 2025-04-16 23:28:25.010136 Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! result_one_balle_Type_JRM:{'day': '16042025', 'map_nb_amount': {0: 0, 1: 3, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 40.99999785423279, 'nb_balles_papier': 3.0000000000000004e-05, 'begin_time_port': 'image_16042025_23_29_14_010137m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 3.0000000000000004e-05 We reject this portfolio because of the condition_save_data : 2025-04-16 23:29:14.010137 Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! result_one_balle_Type_JRM:{'day': '16042025', 'map_nb_amount': {0: 0, 1: 6, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 51.0009868144989, 'nb_balles_papier': 6e-05, 'begin_time_port': 'image_16042025_23_30_04_009154m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 6e-05 We reject this portfolio because of the condition_save_data : 2025-04-16 23:30:04.009154 Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751014 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! result_one_balle_Type_JRM:{'day': '16042025', 'map_nb_amount': {0: 1, 1: 4, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 49.999988079071045, 'nb_balles_papier': 5e-05, 'begin_time_port': 'image_16042025_23_31_05_010155m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 5e-05 We reject this portfolio because of the condition_save_data : 2025-04-16 23:31:05.010155 Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! result_one_balle_Type_JRM:{'day': '16042025', 'map_nb_amount': {0: 0, 1: 5, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 48.99999690055847, 'nb_balles_papier': 5e-05, 'begin_time_port': 'image_16042025_23_32_05_010139m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 5e-05 We reject this portfolio because of the condition_save_data : 2025-04-16 23:32:05.010139 Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! result_one_balle_Type_JRM:{'day': '16042025', 'map_nb_amount': {0: 0, 1: 3, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 48.99998188018799, 'nb_balles_papier': 3.0000000000000004e-05, 'begin_time_port': 'image_16042025_23_33_05_010154m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 3.0000000000000004e-05 We reject this portfolio because of the condition_save_data : 2025-04-16 23:33:05.010154 Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751016 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751016 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751014 : jrm should be duplicate or empty carpet ! result_one_balle_Type_JRM:{'day': '16042025', 'map_nb_amount': {0: 1, 1: 3, 2: 2, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 49.998984813690186, 'nb_balles_papier': 6e-05, 'begin_time_port': 'image_16042025_23_34_04_010142m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 6e-05 We reject this portfolio because of the condition_save_data : 2025-04-16 23:34:04.010142 Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! result_one_balle_Type_JRM:{'day': '16042025', 'map_nb_amount': {0: 0, 1: 2, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 0, 'nb_balles_papier': 2e-05, 'begin_time_port': 'image'} Production hashtag (incorrect ponderation at 20-10-18) : 2e-05 We reject this portfolio because of the condition_save_data : 2025-04-16 23:35:04.010162 Missing time_diff : 2107751016 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751016 : jrm should be duplicate or empty carpet ! result_one_balle_Type_JRM:{'day': '16042025', 'map_nb_amount': {0: 0, 1: 3, 2: 2, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 51.0009880065918, 'nb_balles_papier': 5e-05, 'begin_time_port': 'image_16042025_23_36_04_009150m0.jpg 1e-05 for time 1, id_amount 3 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 5e-05 We reject this portfolio because of the condition_save_data : 2025-04-16 23:36:04.009150 Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! result_one_balle_Type_JRM:{'day': '16042025', 'map_nb_amount': {0: 0, 1: 3, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 49.999982833862305, 'nb_balles_papier': 3.0000000000000004e-05, 'begin_time_port': 'image_16042025_23_37_05_010153m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 3.0000000000000004e-05 We reject this portfolio because of the condition_save_data : 2025-04-16 23:37:05.010153 Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751014 : jrm should be duplicate or empty carpet ! result_one_balle_Type_JRM:{'day': '16042025', 'map_nb_amount': {0: 1, 1: 3, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 39.00000190734863, 'nb_balles_papier': 4e-05, 'begin_time_port': 'image_16042025_23_38_15_010134m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 4e-05 We reject this portfolio because of the condition_save_data : 2025-04-16 23:38:15.010134 Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751014 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! result_one_balle_Type_JRM:{'day': '16042025', 'map_nb_amount': {0: 1, 1: 5, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 48.99998593330383, 'nb_balles_papier': 6e-05, 'begin_time_port': 'image_16042025_23_39_05_010155m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 6e-05 We reject this portfolio because of the condition_save_data : 2025-04-16 23:39:05.010155 Missing time_diff : 2107751016 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751016 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! result_one_balle_Type_JRM:{'day': '16042025', 'map_nb_amount': {0: 0, 1: 2, 2: 2, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 30.99999189376831, 'nb_balles_papier': 4e-05, 'begin_time_port': 'image_16042025_23_40_04_010142m0.jpg 1e-05 for time 1, id_amount 3 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 4e-05 We reject this portfolio because of the condition_save_data : 2025-04-16 23:40:04.010142 Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751016 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751016 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751016 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751016 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751014 : jrm should be duplicate or empty carpet ! result_one_balle_Type_JRM:{'day': '16042025', 'map_nb_amount': {0: 1, 1: 1, 2: 4, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 50.99998593330383, 'nb_balles_papier': 6e-05, 'begin_time_port': 'image_16042025_23_41_04_010150m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 6e-05 We reject this portfolio because of the condition_save_data : 2025-04-16 23:41:04.010150 Missing time_diff : 2107751016 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751016 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751017 : jrm should be duplicate or empty carpet ! result_one_balle_Type_JRM:{'day': '16042025', 'map_nb_amount': {0: 0, 1: 3, 2: 2, 3: 1, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 51.00098896026611, 'nb_balles_papier': 6e-05, 'begin_time_port': 'image_16042025_23_42_04_009151m0.jpg 1e-05 for time 1, id_amount 3 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 6e-05 We reject this portfolio because of the condition_save_data : 2025-04-16 23:42:04.009151 Missing time_diff : 2107751016 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! result_one_balle_Type_JRM:{'day': '16042025', 'map_nb_amount': {0: 0, 1: 1, 2: 1, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 0, 'nb_balles_papier': 2e-05, 'begin_time_port': 'image'} Production hashtag (incorrect ponderation at 20-10-18) : 2e-05 We reject this portfolio because of the condition_save_data : 2025-04-16 23:43:05.010162 Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751016 : jrm should be duplicate or empty carpet ! result_one_balle_Type_JRM:{'day': '16042025', 'map_nb_amount': {0: 0, 1: 5, 2: 1, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 49.99896597862244, 'nb_balles_papier': 6e-05, 'begin_time_port': 'image_16042025_23_51_04_010163m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 6e-05 We reject this portfolio because of the condition_save_data : 2025-04-16 23:51:04.010163 Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751014 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! result_one_balle_Type_JRM:{'day': '16042025', 'map_nb_amount': {0: 1, 1: 4, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 40.99997401237488, 'nb_balles_papier': 5e-05, 'begin_time_port': 'image_16042025_23_52_04_010161m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 5e-05 We reject this portfolio because of the condition_save_data : 2025-04-16 23:52:04.010161 Missing time_diff : 2107751016 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751016 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! result_one_balle_Type_JRM:{'day': '16042025', 'map_nb_amount': {0: 0, 1: 1, 2: 2, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 20.999997854232788, 'nb_balles_papier': 3.0000000000000004e-05, 'begin_time_port': 'image_16042025_23_53_24_010137m0.jpg 1e-05 for time 1, id_amount 3 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 3.0000000000000004e-05 We reject this portfolio because of the condition_save_data : 2025-04-16 23:53:24.010137 Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751017 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! result_one_balle_Type_JRM:{'day': '16042025', 'map_nb_amount': {0: 0, 1: 2, 2: 0, 3: 1, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 20.000005960464478, 'nb_balles_papier': 3.0000000000000004e-05, 'begin_time_port': 'image_16042025_23_54_24_010133m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 3.0000000000000004e-05 We reject this portfolio because of the condition_save_data : 2025-04-16 23:54:24.010133 Missing time_diff : 2107751014 : jrm should be duplicate or empty carpet ! Missing time_diff : 2107751015 : jrm should be duplicate or empty carpet ! result_one_balle_Type_JRM:{'day': '16042025', 'map_nb_amount': {0: 1, 1: 1, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 0, 'nb_balles_papier': 2e-05, 'begin_time_port': 'image'} Production hashtag (incorrect ponderation at 20-10-18) : 2e-05 We reject this portfolio because of the condition_save_data : 2025-04-16 23:56:44.009126 We have rejected 3 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 0 elapsed_time : count_nb_balles_and_create_portfolio 0.4349074363708496 # DISPLAY ALL COLLECTED DATA : {'16042025': {'nb_upload': 99, 'nb_taggue_class': 3351, 'nb_taggue_densite': 3351}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [] Looping around the photos to save general results len do output : 1 /22055303Didn't retrieve data . before output type Here is an output not treated by saveGeneral : error in checking portfolio photo link list index out of range [('4883', None, '22055303', 'None', None, None, None, None, '2727250')] [] begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 time used for this insertion : 0.019652605056762695 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.8236632347106934 time spend to save output : 0.01990818977355957 total time spend for step 1 : 0.8435714244842529 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 1.10user 0.89system 0:05.07elapsed 39%CPU (0avgtext+0avgdata 102136maxresident)k 0inputs+64outputs (12major+49549minor)pagefaults 0swaps