python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4887 -l 20 --fifo' -s datou_current_sts -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3882216 load datou : 4887 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 113>20 please execute split_portfolio.py -i 23471128 -l 20 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4887, datou_cur_ids : ['2993240'] with mtr_portfolio_ids : ['23471128'] and first list_photo_ids : [] new path : /proc/3882216/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.018483638763427734 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Sat May 31 08:38:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3892, 'mtr_user_id': 31, 'name': 'learn_MM_generique_26022025', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,emr,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '17736100,17736101,17736102,17736103,17736104,20837895,20837896,17736107,17736108,17736109,17736110,18876169', 'photo_hashtag_type': 4989, 'photo_desc_type': 6092, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,616987804,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('01', 14), ('00', 21), ('02', 29), ('03', 25), ('04', 22), ('05', 2)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 113} 31052025 23471128 Nombre de photos uploadées : 113 / 23040 (0%) 31052025 23471128 Nombre de photos taguées (types de déchets): 113 / 113 (100%) 31052025 23471128 Nombre de photos taguées (volume) : 113 / 113 (100%) elapsed_time : load_data_split_time_score 3.814697265625e-06 elapsed_time : order_list_meta_photo_and_scores 6.866455078125e-05 elapsed_time : fill_and_build_computed_from_old_data 0.006629467010498047 elapsed_time : insert_dashboard_record_day_entry 0.031148910522460938 Creating list_photo_total elapsed_time : select_descriptors 0.00739598274230957 31052025 23471128 Nombre de photos avec descriptors (type 6092) : 0 / 0 (0%) Missing descriptors for photos 0 and 1361900594 0:00:00|ON:Missing descriptors for photos 1361900594 and 1361900642 Missing descriptors for photos 1361900642 and 1361900837 Missing descriptors for photos 1361900837 and 1361904457 Missing descriptors for photos 1361904457 and 1361900672 Missing descriptors for photos 1361900672 and 1361900742 Missing descriptors for photos 1361900742 and 1361900700 Missing descriptors for photos 1361900700 and 1361900714 Missing descriptors for photos 1361900714 and 1361900675 Missing descriptors for photos 1361900675 and 1361900728 Missing descriptors for photos 1361900728 and 1361900645 Missing descriptors for photos 1361900645 and 1361900767 Missing descriptors for photos 1361900767 and 1361904427 Missing descriptors for photos 1361904427 and 1361904398 Missing descriptors for photos 1361904398 and 1361904367 Missing descriptors for photos 1361904367 and 1361904338 Missing descriptors for photos 1361904338 and 1361905858 Missing descriptors for photos 1361905858 and 1361900612 Missing descriptors for photos 1361900612 and 1361900285 Missing descriptors for photos 1361900285 and 1361905784 Missing descriptors for photos 1361905784 and 1361908513 Missing descriptors for photos 1361908513 and 1361908482 Missing descriptors for photos 1361908482 and 1361912007 Missing descriptors for photos 1361912007 and 1361900228 Missing descriptors for photos 1361900228 and 1361900148 Missing descriptors for photos 1361900148 and 1361900091 Missing descriptors for photos 1361900091 and 1361900040 Missing descriptors for photos 1361900040 and 1361911929 Missing descriptors for photos 1361911929 and 1361912831 Missing descriptors for photos 1361912831 and 1361899942 Missing descriptors for photos 1361899942 and 1361912799 Missing descriptors for photos 1361912799 and 1361912739 Missing descriptors for photos 1361912739 and 1361913154 Missing descriptors for photos 1361913154 and 1361913124 Missing descriptors for photos 1361913124 and 1361913257 Missing descriptors for photos 1361913257 and 1361913252 Missing descriptors for photos 1361913252 and 1361913714 Missing descriptors for photos 1361913714 and 1361913663 Missing descriptors for photos 1361913663 and 1361913632 Missing descriptors for photos 1361913632 and 1361913599 Missing descriptors for photos 1361913599 and 1361913579 Missing descriptors for photos 1361913579 and 1361913918 Missing descriptors for photos 1361913918 and 1361913914 Missing descriptors for photos 1361913914 and 1361914702 Missing descriptors for photos 1361914702 and 1361907302 Missing descriptors for photos 1361907302 and 1361909081 Missing descriptors for photos 1361909081 and 1361911012 Missing descriptors for photos 1361911012 and 1361914592 Missing descriptors for photos 1361914592 and 1361915147 Missing descriptors for photos 1361915147 and 1361915148 Missing descriptors for photos 1361915148 and 1361913111 Missing descriptors for photos 1361913111 and 1361915108 Missing descriptors for photos 1361915108 and 1361915029 Missing descriptors for photos 1361915029 and 1361915026 Missing descriptors for photos 1361915026 and 1361915023 Missing descriptors for photos 1361915023 and 1361915020 Missing descriptors for photos 1361915020 and 1361915017 Missing descriptors for photos 1361915017 and 1361928485 Missing descriptors for photos 1361928485 and 1361914035 Missing descriptors for photos 1361914035 and 1361914036 Missing descriptors for photos 1361914036 and 1361918251 Missing descriptors for photos 1361918251 and 1361918253 Missing descriptors for photos 1361918253 and 1361923392 Missing descriptors for photos 1361923392 and 1361923396 Missing descriptors for photos 1361923396 and 1361926885 Missing descriptors for photos 1361926885 and 1361928403 Missing descriptors for photos 1361928403 and 1361929814 Missing descriptors for photos 1361929814 and 1361931114 Missing descriptors for photos 1361931114 and 1361931047 Missing descriptors for photos 1361931047 and 1361932799 Missing descriptors for photos 1361932799 and 1361931406 Missing descriptors for photos 1361931406 and 1361933199 Missing descriptors for photos 1361933199 and 1361933812 Missing descriptors for photos 1361933812 and 1361933809 Missing descriptors for photos 1361933809 and 1361934583 Missing descriptors for photos 1361934583 and 1361934776 Missing descriptors for photos 1361934776 and 1361934745 Missing descriptors for photos 1361934745 and 1361940140 Missing descriptors for photos 1361940140 and 1361938621 Missing descriptors for photos 1361938621 and 1361940254 Missing descriptors for photos 1361940254 and 1361940251 Missing descriptors for photos 1361940251 and 1361940247 Missing descriptors for photos 1361940247 and 1361940243 Missing descriptors for photos 1361940243 and 1361940240 Missing descriptors for photos 1361940240 and 1361940236 Missing descriptors for photos 1361940236 and 1361954849 Missing descriptors for photos 1361954849 and 1361941076 Missing descriptors for photos 1361941076 and 1361941077 Missing descriptors for photos 1361941077 and 1361946157 Missing descriptors for photos 1361946157 and 1361950785 Missing descriptors for photos 1361950785 and 1361953447 Missing descriptors for photos 1361953447 and 1361954845 Missing descriptors for photos 1361954845 and 1361955732 Missing descriptors for photos 1361955732 and 1361954888 Missing descriptors for photos 1361954888 and 1361955761 Missing descriptors for photos 1361955761 and 1361960621 Missing descriptors for photos 1361960621 and 1361957446 Missing descriptors for photos 1361957446 and 1361960509 Missing descriptors for photos 1361960509 and 1361960381 Missing descriptors for photos 1361960381 and 1361961915 Missing descriptors for photos 1361961915 and 1361963956 Missing descriptors for photos 1361963956 and 1361962193 Missing descriptors for photos 1361962193 and 1361963983 Missing descriptors for photos 1361963983 and 1361964906 Missing descriptors for photos 1361964906 and 1361966430 Missing descriptors for photos 1361966430 and 1361966294 Missing descriptors for photos 1361966294 and 1361967582 Missing descriptors for photos 1361967582 and 1361967277 Missing descriptors for photos 1361967277 and 1361968249 Missing descriptors for photos 1361968249 and 1361969907 Missing descriptors for photos 1361969907 and 1361970723 Missing descriptors for photos 1361970723 and 1361972173 Missing descriptors for photos 1361972173 and 1361972176 31052025 Removing 0 photos because of the 'same image' condition Total on : 0 Total off : 0.0 list_time_off Warning in study_and_display_distrib_list : min=max : 0.0 0.0 dist_desc Warning in study_and_display_distrib_list : min=max : -1 -1 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 113 time used for this insertion : 1.3165419101715088 photos_removed : len 0 elapsed_time : remove_photo_duplicate 1.3396859169006348 Creating list_photo_total elapsed_time : count_sum_diff_and_build_graph 0.0006539821624755859 Total photos : 113 .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info Total photos : 113 Number of lists : 0 counter photos in port : 0 hashtag : aluminium(493546845) : 0 photos in 0 portfolios ! hashtag : ela(492741797) : 0 photos in 0 portfolios ! hashtag : emr(616987804) : 0 photos in 0 portfolios ! hashtag : film_pedb(2107760237) : 0 photos in 0 portfolios ! hashtag : flux_dev(2107760238) : 0 photos in 0 portfolios ! hashtag : jrm(495916461) : 0 photos in 0 portfolios ! hashtag : pcm(560181804) : 0 photos in 0 portfolios ! hashtag : pcnc(1284539308) : 0 photos in 0 portfolios ! hashtag : pehd_pp(2107760239) : 0 photos in 0 portfolios ! hashtag : pet_clair(2107755846) : 0 photos in 0 portfolios ! hashtag : refus(538914404) : 0 photos in 0 portfolios ! hashtag : tapis_vide(2107748999) : 0 photos in 0 portfolios ! elapsed_time : group_photo_by_moyenne_exp 0.003186941146850586 elapsed_time : compute_and_correct_tag_with_moyenne_mobile 2.86102294921875e-06 today str has not a value , we define it as the date of the first image todaystr_first : 31052025 attention , prev_timestamp is 0 , we do nothing o*o*o*o*o**********************o****o*o*o*************o********************oCount Time bigger than 30s : 65 #Number Photos for regression : {'31052025': {493546845: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 492741797: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 616987804: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107760237: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107760238: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 495916461: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 560181804: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 1284539308: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107760239: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107755846: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 538914404: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107748999: {2107751013: 0, 2107751014: 0, 2107751015: 2378.9952516555786, 2107751016: 0, 2107751017: 0}}} 31052025|aluminium, 05102018_papier_non_papier_dense:0 31052025|aluminium, 05102018_papier_non_papier_peu_dense:0 31052025|aluminium, 05102018_papier_non_papier_presque_vide:0 31052025|aluminium, 05102018_papier_non_papier_tres_dense:0 31052025|aluminium, 05102018_papier_non_papier_tres_peu_dense:0 31052025|ela, 05102018_papier_non_papier_dense:0 31052025|ela, 05102018_papier_non_papier_peu_dense:0 31052025|ela, 05102018_papier_non_papier_presque_vide:0 31052025|ela, 05102018_papier_non_papier_tres_dense:0 31052025|ela, 05102018_papier_non_papier_tres_peu_dense:0 31052025|emr, 05102018_papier_non_papier_dense:0 31052025|emr, 05102018_papier_non_papier_peu_dense:0 31052025|emr, 05102018_papier_non_papier_presque_vide:0 31052025|emr, 05102018_papier_non_papier_tres_dense:0 31052025|emr, 05102018_papier_non_papier_tres_peu_dense:0 31052025|film_pedb, 05102018_papier_non_papier_dense:0 31052025|film_pedb, 05102018_papier_non_papier_peu_dense:0 31052025|film_pedb, 05102018_papier_non_papier_presque_vide:0 31052025|film_pedb, 05102018_papier_non_papier_tres_dense:0 31052025|film_pedb, 05102018_papier_non_papier_tres_peu_dense:0 31052025|flux_dev, 05102018_papier_non_papier_dense:0 31052025|flux_dev, 05102018_papier_non_papier_peu_dense:0 31052025|flux_dev, 05102018_papier_non_papier_presque_vide:0 31052025|flux_dev, 05102018_papier_non_papier_tres_dense:0 31052025|flux_dev, 05102018_papier_non_papier_tres_peu_dense:0 31052025|jrm, 05102018_papier_non_papier_dense:0 31052025|jrm, 05102018_papier_non_papier_peu_dense:0 31052025|jrm, 05102018_papier_non_papier_presque_vide:0 31052025|jrm, 05102018_papier_non_papier_tres_dense:0 31052025|jrm, 05102018_papier_non_papier_tres_peu_dense:0 31052025|pcm, 05102018_papier_non_papier_dense:0 31052025|pcm, 05102018_papier_non_papier_peu_dense:0 31052025|pcm, 05102018_papier_non_papier_presque_vide:0 31052025|pcm, 05102018_papier_non_papier_tres_dense:0 31052025|pcm, 05102018_papier_non_papier_tres_peu_dense:0 31052025|pcnc, 05102018_papier_non_papier_dense:0 31052025|pcnc, 05102018_papier_non_papier_peu_dense:0 31052025|pcnc, 05102018_papier_non_papier_presque_vide:0 31052025|pcnc, 05102018_papier_non_papier_tres_dense:0 31052025|pcnc, 05102018_papier_non_papier_tres_peu_dense:0 31052025|pehd_pp, 05102018_papier_non_papier_dense:0 31052025|pehd_pp, 05102018_papier_non_papier_peu_dense:0 31052025|pehd_pp, 05102018_papier_non_papier_presque_vide:0 31052025|pehd_pp, 05102018_papier_non_papier_tres_dense:0 31052025|pehd_pp, 05102018_papier_non_papier_tres_peu_dense:0 31052025|pet_clair, 05102018_papier_non_papier_dense:0 31052025|pet_clair, 05102018_papier_non_papier_peu_dense:0 31052025|pet_clair, 05102018_papier_non_papier_presque_vide:0 31052025|pet_clair, 05102018_papier_non_papier_tres_dense:0 31052025|pet_clair, 05102018_papier_non_papier_tres_peu_dense:0 31052025|refus, 05102018_papier_non_papier_dense:0 31052025|refus, 05102018_papier_non_papier_peu_dense:0 31052025|refus, 05102018_papier_non_papier_presque_vide:0 31052025|refus, 05102018_papier_non_papier_tres_dense:0 31052025|refus, 05102018_papier_non_papier_tres_peu_dense:0 31052025|tapis_vide, 05102018_papier_non_papier_dense:0 31052025|tapis_vide, 05102018_papier_non_papier_peu_dense:0 31052025|tapis_vide, 05102018_papier_non_papier_presque_vide:2378.9952516555786 31052025|tapis_vide, 05102018_papier_non_papier_tres_dense:0 31052025|tapis_vide, 05102018_papier_non_papier_tres_peu_dense:0 #Number Photos for regression amount gros magasin papier (time_diff then nb_photo) : We have not displayed the number of photos removed for one material since Rungis_Papier wasn't in the thcl used ! 31052025_time_diff_distrib Number amount portfolio for this type of dechet : aluminium 0 Number amount portfolio for this type of dechet : ela 0 Number amount portfolio for this type of dechet : emr 0 Number amount portfolio for this type of dechet : film_pedb 0 Number amount portfolio for this type of dechet : flux_dev 0 Number amount portfolio for this type of dechet : jrm 0 Number amount portfolio for this type of dechet : pcm 0 Number amount portfolio for this type of dechet : pcnc 0 Number amount portfolio for this type of dechet : pehd_pp 0 Number amount portfolio for this type of dechet : pet_clair 0 Number amount portfolio for this type of dechet : refus 0 Number amount portfolio for this type of dechet : tapis_vide 71 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=31052025_tapis_vide_05102018_papier_non_papier_presque_vide&access_token=08f99e4316eab7bf4779f7398f9aa5cd Created to study and clean : 23483948 with name like 31052025_tapis_vide_05102018_papier_non_papier_presque_vide begin to remove the low_density images haven't found thcl_volume NUMBER BATCH : 0 list_ponderation used : [0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001] , list_hashtag_class_create_as_list : ['emr', 'pcm', 'pcnc', 'jrm', 'ela', 'pet_clair', 'film_pedb', 'pehd_pp', 'flux_dev', 'aluminium', 'tapis_vide', 'refus'] We have rejected 0 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 0 elapsed_time : count_nb_balles_and_create_portfolio 1.243872880935669 # DISPLAY ALL COLLECTED DATA : {'31052025': {'nb_upload': 113, 'nb_taggue_class': 113, 'nb_taggue_densite': 113, 'nb_descriptors': 0, 'number_port': 0, 'count_photo_in_port': 0, 'nb_port_per_class': {'aluminium': {'nb_photos': 0, 'nb_portfolios': 0}, 'ela': {'nb_photos': 0, 'nb_portfolios': 0}, 'emr': {'nb_photos': 0, 'nb_portfolios': 0}, 'film_pedb': {'nb_photos': 0, 'nb_portfolios': 0}, 'flux_dev': {'nb_photos': 0, 'nb_portfolios': 0}, 'jrm': {'nb_photos': 0, 'nb_portfolios': 0}, 'pcm': {'nb_photos': 0, 'nb_portfolios': 0}, 'pcnc': {'nb_photos': 0, 'nb_portfolios': 0}, 'pehd_pp': {'nb_photos': 0, 'nb_portfolios': 0}, 'pet_clair': {'nb_photos': 0, 'nb_portfolios': 0}, 'refus': {'nb_photos': 0, 'nb_portfolios': 0}, 'tapis_vide': {'nb_photos': 0, 'nb_portfolios': 0}}}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1361972176, 1361972173, 1361970723, 1361969907, 1361968249, 1361967582, 1361967277, 1361966430, 1361966294, 1361964906, 1361963983, 1361963956, 1361962193, 1361961915, 1361960621, 1361960509, 1361960381, 1361957446, 1361955761, 1361955732] Looping around the photos to save general results len do output : 1 /23471128Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4887', None, None, None, None, None, None, None, '2993240') ('4887', '23471128', '1361972176', None, None, None, None, None, '2993240') ('4887', None, None, None, None, None, None, None, '2993240') ('4887', '23471128', '1361972173', None, None, None, None, None, '2993240') ('4887', None, None, None, None, None, None, None, '2993240') ('4887', '23471128', '1361970723', None, None, None, None, None, '2993240') ('4887', None, None, None, None, None, None, None, '2993240') ('4887', '23471128', '1361969907', None, None, None, None, None, '2993240') ('4887', None, None, None, None, None, None, None, '2993240') ('4887', '23471128', '1361968249', None, None, None, None, None, '2993240') ('4887', None, None, None, None, None, None, None, '2993240') ('4887', '23471128', '1361967582', None, None, None, None, None, '2993240') ('4887', None, None, None, None, None, None, None, '2993240') ('4887', '23471128', '1361967277', None, None, None, None, None, '2993240') ('4887', None, None, None, None, None, None, None, '2993240') ('4887', '23471128', '1361966430', None, None, None, None, None, '2993240') ('4887', None, None, None, None, None, None, None, '2993240') ('4887', '23471128', '1361966294', None, None, None, None, None, '2993240') ('4887', None, None, None, None, None, None, None, '2993240') ('4887', '23471128', '1361964906', None, None, None, None, None, '2993240') ('4887', None, None, None, None, None, None, None, '2993240') ('4887', '23471128', '1361963983', None, None, None, None, None, '2993240') ('4887', None, None, None, None, None, None, None, '2993240') ('4887', '23471128', '1361963956', None, None, None, None, None, '2993240') ('4887', None, None, None, None, None, None, None, '2993240') ('4887', '23471128', '1361962193', None, None, None, None, None, '2993240') ('4887', None, None, None, None, None, None, None, '2993240') ('4887', '23471128', '1361961915', None, None, None, None, None, '2993240') ('4887', None, None, None, None, None, None, None, '2993240') ('4887', '23471128', '1361960621', None, None, None, None, None, '2993240') ('4887', None, None, None, None, None, None, None, '2993240') ('4887', '23471128', '1361960509', None, None, None, None, None, '2993240') ('4887', None, None, None, None, None, None, None, '2993240') ('4887', '23471128', '1361960381', None, None, None, None, None, '2993240') ('4887', None, None, None, None, None, None, None, '2993240') ('4887', '23471128', '1361957446', None, None, None, None, None, '2993240') ('4887', None, None, None, None, None, None, None, '2993240') ('4887', '23471128', '1361955761', None, None, None, None, None, '2993240') ('4887', None, None, None, None, None, None, None, '2993240') ('4887', '23471128', '1361955732', None, None, None, None, None, '2993240') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.11058402061462402 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.7288661003112793 time spend to save output : 0.11093902587890625 total time spend for step 1 : 2.8398051261901855 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 1.00user 0.75system 0:06.34elapsed 27%CPU (0avgtext+0avgdata 101572maxresident)k 0inputs+64outputs (5major+35994minor)pagefaults 0swaps