python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4887 -l 20 --fifo' -s datou_current_sts -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1235260 load datou : 4887 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 366>20 please execute split_portfolio.py -i 23436764 -l 20 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4887, datou_cur_ids : ['2982599'] with mtr_portfolio_ids : ['23436764'] and first list_photo_ids : [] new path : /proc/1235260/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.019711017608642578 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Thu May 29 08:08:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3892, 'mtr_user_id': 31, 'name': 'learn_MM_generique_26022025', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,emr,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '17736100,17736101,17736102,17736103,17736104,20837895,20837896,17736107,17736108,17736109,17736110,18876169', 'photo_hashtag_type': 4989, 'photo_desc_type': 6092, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,616987804,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('07', 366),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 366} 29052025 23436764 Nombre de photos uploadées : 366 / 23040 (1%) 29052025 23436764 Nombre de photos taguées (types de déchets): 366 / 366 (100%) 29052025 23436764 Nombre de photos taguées (volume) : 366 / 366 (100%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 0.00016689300537109375 elapsed_time : fill_and_build_computed_from_old_data 0.016251087188720703 elapsed_time : insert_dashboard_record_day_entry 0.0224301815032959 Creating list_photo_total elapsed_time : select_descriptors 5.048021078109741 29052025 23436764 Nombre de photos avec descriptors (type 6092) : 108 / 108 (100%) Missing descriptors for photos 0 and 1361601114 0:00:00|ON:Missing descriptors for photos 1361601114 and 1361601112 Missing descriptors for photos 1361601112 and 1361601108 Missing descriptors for photos 1361601108 and 1361601105 Missing descriptors for photos 1361601105 and 1361601102 Missing descriptors for photos 1361601102 and 1361601099 Missing descriptors for photos 1361601099 and 1361601156 Missing descriptors for photos 1361601156 and 1361601150 Missing descriptors for photos 1361601150 and 1361601146 Missing descriptors for photos 1361601146 and 1361601142 Missing descriptors for photos 1361601142 and 1361601138 Missing descriptors for photos 1361601138 and 1361601134 Missing descriptors for photos 1361601134 and 1361601192 Missing descriptors for photos 1361601192 and 1361601193 Missing descriptors for photos 1361601193 and 1361601130 Missing descriptors for photos 1361601130 and 1361601182 Missing descriptors for photos 1361601182 and 1361601178 Missing descriptors for photos 1361601178 and 1361601174 Missing descriptors for photos 1361601174 and 1361601171 Missing descriptors for photos 1361601171 and 1361601168 Missing descriptors for photos 1361601168 and 1361601165 Missing descriptors for photos 1361601165 and 1361601233 Missing descriptors for photos 1361601233 and 1361601231 Missing descriptors for photos 1361601231 and 1361601222 Missing descriptors for photos 1361601222 and 1361601219 Missing descriptors for photos 1361601219 and 1361601216 Missing descriptors for photos 1361601216 and 1361601212 Missing descriptors for photos 1361601212 and 1361601207 Missing descriptors for photos 1361601207 and 1361601202 Missing descriptors for photos 1361601202 and 1361601260 Missing descriptors for photos 1361601260 and 1361601256 Missing descriptors for photos 1361601256 and 1361601253 Missing descriptors for photos 1361601253 and 1361601250 Missing descriptors for photos 1361601250 and 1361601292 Missing descriptors for photos 1361601292 and 1361601291 Missing descriptors for photos 1361601291 and 1361601290 Missing descriptors for photos 1361601290 and 1361601287 Missing descriptors for photos 1361601287 and 1361601280 Missing descriptors for photos 1361601280 and 1361601277 Missing descriptors for photos 1361601277 and 1361601275 Missing descriptors for photos 1361601275 and 1361601272 Missing descriptors for photos 1361601272 and 1361601270 Missing descriptors for photos 1361601270 and 1361601267 Missing descriptors for photos 1361601267 and 1361601325 Missing descriptors for photos 1361601325 and 1361601323 Missing descriptors for photos 1361601323 and 1361601320 Missing descriptors for photos 1361601320 and 1361601317 Missing descriptors for photos 1361601317 and 1361601315 Missing descriptors for photos 1361601315 and 1361601311 Missing descriptors for photos 1361601311 and 1361601364 Missing descriptors for photos 1361601364 and 1361601366 Missing descriptors for photos 1361601366 and 1361601361 Missing descriptors for photos 1361601361 and 1361601363 Missing descriptors for photos 1361601363 and 1361601358 Missing descriptors for photos 1361601358 and 1361601359 Missing descriptors for photos 1361601359 and 1361601348 Missing descriptors for photos 1361601348 and 1361601345 Missing descriptors for photos 1361601345 and 1361601342 Missing descriptors for photos 1361601342 and 1361601339 Missing descriptors for photos 1361601339 and 1361601335 Missing descriptors for photos 1361601335 and 1361601332 Missing descriptors for photos 1361601332 and 1361601632 Missing descriptors for photos 1361601632 and 1361601629 Missing descriptors for photos 1361601629 and 1361601495 Missing descriptors for photos 1361601495 and 1361601492 Missing descriptors for photos 1361601492 and 1361601483 Missing descriptors for photos 1361601483 and 1361601459 Missing descriptors for photos 1361601459 and 1361601449 Missing descriptors for photos 1361601449 and 1361601432 Missing descriptors for photos 1361601432 and 1361601627 Missing descriptors for photos 1361601627 and 1361601585 Missing descriptors for photos 1361601585 and 1361601582 Missing descriptors for photos 1361601582 and 1361601578 Missing descriptors for photos 1361601578 and 1361601575 Missing descriptors for photos 1361601575 and 1361601574 Missing descriptors for photos 1361601574 and 1361601573 Missing descriptors for photos 1361601573 and 1361601610 Missing descriptors for photos 1361601610 and 1361601606 Missing descriptors for photos 1361601606 and 1361601602 Missing descriptors for photos 1361601602 and 1361601600 Missing descriptors for photos 1361601600 and 1361601597 Missing descriptors for photos 1361601597 and 1361601594 Missing descriptors for photos 1361601594 and 1361601625 Missing descriptors for photos 1361601625 and 1361601622 Missing descriptors for photos 1361601622 and 1361601618 Missing descriptors for photos 1361601618 and 1361601672 Missing descriptors for photos 1361601672 and 1361601666 Missing descriptors for photos 1361601666 and 1361601664 Missing descriptors for photos 1361601664 and 1361601661 Missing descriptors for photos 1361601661 and 1361601656 Missing descriptors for photos 1361601656 and 1361601652 Missing descriptors for photos 1361601652 and 1361601647 Missing descriptors for photos 1361601647 and 1361601752 Missing descriptors for photos 1361601752 and 1361601704 Missing descriptors for photos 1361601704 and 1361601701 Missing descriptors for photos 1361601701 and 1361601696 Missing descriptors for photos 1361601696 and 1361601693 Missing descriptors for photos 1361601693 and 1361601687 Missing descriptors for photos 1361601687 and 1361601684 Missing descriptors for photos 1361601684 and 1361601750 Missing descriptors for photos 1361601750 and 1361601744 Missing descriptors for photos 1361601744 and 1361601742 Missing descriptors for photos 1361601742 and 1361601737 Missing descriptors for photos 1361601737 and 1361601727 Missing descriptors for photos 1361601727 and 1361601720 Missing descriptors for photos 1361601720 and 1361601717 Missing descriptors for photos 1361601717 and 1361603054 Missing descriptors for photos 1361603054 and 1361603050 Missing descriptors for photos 1361601903 and 1361601859 Missing descriptors for photos 1361601859 and 1361601857 Missing descriptors for photos 1361601857 and 1361601854 Missing descriptors for photos 1361601854 and 1361601850 Missing descriptors for photos 1361601850 and 1361601848 Missing descriptors for photos 1361601848 and 1361601846 Missing descriptors for photos 1361601846 and 1361601898 Missing descriptors for photos 1361601898 and 1361601895 Missing descriptors for photos 1361601895 and 1361601894 Missing descriptors for photos 1361601894 and 1361601893 Missing descriptors for photos 1361601893 and 1361601883 Missing descriptors for photos 1361601883 and 1361601880 Missing descriptors for photos 1361601880 and 1361601876 Missing descriptors for photos 1361601876 and 1361601873 Missing descriptors for photos 1361601873 and 1361601870 Missing descriptors for photos 1361601870 and 1361601867 Missing descriptors for photos 1361601867 and 1361601938 Missing descriptors for photos 1361601938 and 1361601935 Missing descriptors for photos 1361601935 and 1361601932 Missing descriptors for photos 1361601932 and 1361601930 Missing descriptors for photos 1361601930 and 1361601927 Missing descriptors for photos 1361601927 and 1361602079 Missing descriptors for photos 1361602079 and 1361601999 Missing descriptors for photos 1361601999 and 1361601996 Missing descriptors for photos 1361601996 and 1361601981 Missing descriptors for photos 1361601981 and 1361601969 Missing descriptors for photos 1361601969 and 1361601960 Missing descriptors for photos 1361601960 and 1361601952 Missing descriptors for photos 1361601952 and 1361602074 Missing descriptors for photos 1361602074 and 1361602027 Missing descriptors for photos 1361602027 and 1361602024 Missing descriptors for photos 1361602111 and 1361602107 Missing descriptors for photos 1361602107 and 1361602103 Missing descriptors for photos 1361602103 and 1361602100 Missing descriptors for photos 1361602100 and 1361602098 Missing descriptors for photos 1361602098 and 1361602096 Missing descriptors for photos 1361602096 and 1361602208 Missing descriptors for photos 1361602208 and 1361602204 Missing descriptors for photos 1361602204 and 1361602201 Missing descriptors for photos 1361602201 and 1361602200 Missing descriptors for photos 1361602200 and 1361602134 Missing descriptors for photos 1361602134 and 1361602131 Missing descriptors for photos 1361602131 and 1361602128 Missing descriptors for photos 1361602128 and 1361602125 Missing descriptors for photos 1361602125 and 1361602122 Missing descriptors for photos 1361602122 and 1361602119 Missing descriptors for photos 1361602119 and 1361602199 Missing descriptors for photos 1361602199 and 1361602198 Missing descriptors for photos 1361602198 and 1361602188 Missing descriptors for photos 1361602142 and 1361602185 Missing descriptors for photos 1361602185 and 1361602182 Missing descriptors for photos 1361602182 and 1361602179 Missing descriptors for photos 1361602179 and 1361602176 Missing descriptors for photos 1361602176 and 1361602173 Missing descriptors for photos 1361602173 and 1361603022 Missing descriptors for photos 1361603022 and 1361602233 Missing descriptors for photos 1361602233 and 1361602230 Missing descriptors for photos 1361602230 and 1361602227 Missing descriptors for photos 1361602227 and 1361602225 Missing descriptors for photos 1361602225 and 1361602223 Missing descriptors for photos 1361602223 and 1361602221 Missing descriptors for photos 1361602221 and 1361602315 Missing descriptors for photos 1361602315 and 1361602312 Missing descriptors for photos 1361602259 and 1361602256 Missing descriptors for photos 1361602256 and 1361602253 Missing descriptors for photos 1361602253 and 1361602247 Missing descriptors for photos 1361602247 and 1361602244 Missing descriptors for photos 1361602307 and 1361602305 Missing descriptors for photos 1361602305 and 1361602303 Missing descriptors for photos 1361602303 and 1361602296 Missing descriptors for photos 1361602296 and 1361602294 Missing descriptors for photos 1361602278 and 1361603018 0:33:19.001387|OFF:0:00:17.999985|ON:Missing descriptors for photos 1361602634 and 1361602627 Missing descriptors for photos 1361602627 and 1361602556 Missing descriptors for photos 1361602556 and 1361602548 Missing descriptors for photos 1361602548 and 1361602542 Missing descriptors for photos 1361602542 and 1361602539 Missing descriptors for photos 1361602539 and 1361602536 Missing descriptors for photos 1361602536 and 1361602532 Missing descriptors for photos 1361602532 and 1361602620 0:03:40.998711|OFF:0:00:07.001173|ON:0:00:00|OFF:0:00:05.999986|ON:0:00:00|OFF:0:00:05.999921|ON:Missing descriptors for photos 1361602684 and 1361602686 Missing descriptors for photos 1361602686 and 1361602678 Missing descriptors for photos 1361602678 and 1361602679 Missing descriptors for photos 1361602679 and 1361602673 Missing descriptors for photos 1361602673 and 1361602676 Missing descriptors for photos 1361602676 and 1361602978 Missing descriptors for photos 1361602978 and 1361602738 Missing descriptors for photos 1361602738 and 1361602734 Missing descriptors for photos 1361602734 and 1361602728 Missing descriptors for photos 1361602728 and 1361602726 Missing descriptors for photos 1361602726 and 1361602724 Missing descriptors for photos 1361602724 and 1361602722 Missing descriptors for photos 1361602722 and 1361602837 Missing descriptors for photos 1361602837 and 1361602831 Missing descriptors for photos 1361602831 and 1361602761 Missing descriptors for photos 1361602761 and 1361602760 Missing descriptors for photos 1361602760 and 1361602758 Missing descriptors for photos 1361602758 and 1361602755 Missing descriptors for photos 1361602755 and 1361602752 Missing descriptors for photos 1361602752 and 1361602746 Missing descriptors for photos 1361602746 and 1361602828 Missing descriptors for photos 1361602828 and 1361602825 Missing descriptors for photos 1361602825 and 1361602823 Missing descriptors for photos 1361602823 and 1361602820 Missing descriptors for photos 1361602820 and 1361602812 Missing descriptors for photos 1361602812 and 1361602805 Missing descriptors for photos 1361602805 and 1361602801 Missing descriptors for photos 1361602801 and 1361602791 Missing descriptors for photos 1361602791 and 1361602777 Missing descriptors for photos 1361602777 and 1361602974 Missing descriptors for photos 1361602974 and 1361602771 Missing descriptors for photos 1361602771 and 1361602869 Missing descriptors for photos 1361602869 and 1361602864 Missing descriptors for photos 1361602864 and 1361602859 Missing descriptors for photos 1361602859 and 1361602856 Missing descriptors for photos 1361602856 and 1361602855 Missing descriptors for photos 1361602855 and 1361602853 Missing descriptors for photos 1361602853 and 1361602970 Missing descriptors for photos 1361602970 and 1361602919 Missing descriptors for photos 1361602919 and 1361602921 Missing descriptors for photos 1361602921 and 1361602917 Missing descriptors for photos 1361602917 and 1361602918 Missing descriptors for photos 1361602918 and 1361602911 Missing descriptors for photos 1361602911 and 1361602913 Missing descriptors for photos 1361602913 and 1361602907 Missing descriptors for photos 1361602907 and 1361602908 Missing descriptors for photos 1361602908 and 1361602904 Missing descriptors for photos 1361602904 and 1361602905 Missing descriptors for photos 1361602905 and 1361602901 Missing descriptors for photos 1361602901 and 1361602902 Missing descriptors for photos 1361602902 and 1361602966 Missing descriptors for photos 1361602966 and 1361602949 Missing descriptors for photos 1361602949 and 1361602946 Missing descriptors for photos 1361602946 and 1361602942 Missing descriptors for photos 1361602942 and 1361602938 Missing descriptors for photos 1361602938 and 1361602934 Missing descriptors for photos 1361602934 and 1361602930 Missing descriptors for photos 1361602930 and 1361602962 Missing descriptors for photos 1361602962 and 1361603069 Missing descriptors for photos 1361603069 and 1361603721 Missing descriptors for photos 1361603721 and 1361603722 29052025 Removing 5 photos because of the 'same image' condition Total on : 2220.000098 list_time_on Total off : 37.001065 list_time_off dist_desc begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 366 time used for this insertion : 0.07659006118774414 photos_removed : len 5 elapsed_time : remove_photo_duplicate 0.1511824131011963 Creating list_photo_total XXXXXtime_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average elapsed_time : count_sum_diff_and_build_graph 0.0638878345489502 Total photos : 366 .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 0 hashtag : 2107755846 photo_id =1361603047 : pet_clair .Change port : 1 hashtag : 2107760237 photo_id =1361603042 : film_pedb .................can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ............can't find max_score_info ..Change port : 29 hashtag : 538914404 photo_id =1361602036 : refus ...can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 3 hashtag : 2107755846 photo_id =1361602159 : pet_clair .....can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 5 hashtag : 495916461 photo_id =1361602266 : jrm .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 1 hashtag : 2107760239 photo_id =1361602309 : pehd_pp .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ....can't find max_score_info .can't find max_score_info ................................can't find max_score_info .can't find max_score_info .....can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ........................can't find max_score_info ..can't find max_score_info .Change port : 63 hashtag : 2107760237 photo_id =1361602687 : film_pedb .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info Total photos : 366 Number of lists : 8 counter photos in port : 103 hashtag : aluminium(493546845) : 0 photos in 0 portfolios ! hashtag : ela(492741797) : 0 photos in 0 portfolios ! hashtag : emr(616987804) : 0 photos in 0 portfolios ! hashtag : film_pedb(2107760237) : 30 photos in 2 portfolios ! hashtag : flux_dev(2107760238) : 0 photos in 0 portfolios ! hashtag : jrm(495916461) : 1 photos in 1 portfolios ! hashtag : pcm(560181804) : 0 photos in 0 portfolios ! hashtag : pcnc(1284539308) : 0 photos in 0 portfolios ! hashtag : pehd_pp(2107760239) : 63 photos in 1 portfolios ! hashtag : pet_clair(2107755846) : 6 photos in 2 portfolios ! hashtag : refus(538914404) : 3 photos in 1 portfolios ! hashtag : tapis_vide(2107748999) : 0 photos in 1 portfolios ! elapsed_time : group_photo_by_moyenne_exp 0.010039091110229492 elapsed_time : compute_and_correct_tag_with_moyenne_mobile 2.384185791015625e-06 today str has not a value , we define it as the date of the first image todaystr_first : 29052025 attention , prev_timestamp is 0 , we do nothing o*ooo*oooooooooooo* BIG TIME 228.00014996528625 (631.0004405975342, 10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0.36677238, 0, 0.22510012419223785, 0.0303, 0.0013001167058944703, 1.9, 0.005999985933303833, -0.0) on 103 1361603069 2025-05-29 07:48:47.006406 id_data : 363 * BIG TIME 594.0 (631.0004405975342, 10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0.36677238, 0, 0.22510012419223785, 0.0303, 0.0013001167058944703, 1.9, 0.005999985933303833, -0.0) on 103 1361603721 2025-05-29 07:58:41.006406 id_data : 364 oCount Time bigger than 30s : 4 #Number Photos for regression : {'29052025': {493546845: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 492741797: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 616987804: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107760237: {2107751013: 0, 2107751014: 33.997621059417725, 2107751015: 77.99987387657166, 2107751016: 0, 2107751017: 13.002265930175781}, 2107760238: {2107751013: 0, 2107751014: 4.999011039733887, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 495916461: {2107751013: 0, 2107751014: 13.002182006835938, 2107751015: 48.999653339385986, 2107751016: 0, 2107751017: 6.0000159740448}, 560181804: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 1284539308: {2107751013: 0, 2107751014: 0, 2107751015: 7.00113320350647, 2107751016: 0, 2107751017: 0}, 2107760239: {2107751013: 0, 2107751014: 187.00278306007385, 2107751015: 110.99442267417908, 2107751016: 0, 2107751017: 4.998802900314331}, 2107755846: {2107751013: 0, 2107751014: 0, 2107751015: 62.0023832321167, 2107751016: 0, 2107751017: 0}, 538914404: {2107751013: 0, 2107751014: 6.0001749992370605, 2107751015: 61.00010323524475, 2107751016: 0, 2107751017: 0}, 2107748999: {2107751013: 0, 2107751014: 0, 2107751015: 1990.9995975494385, 2107751016: 0, 2107751017: 0}}} 29052025|aluminium, 05102018_papier_non_papier_dense:0 29052025|aluminium, 05102018_papier_non_papier_peu_dense:0 29052025|aluminium, 05102018_papier_non_papier_presque_vide:0 29052025|aluminium, 05102018_papier_non_papier_tres_dense:0 29052025|aluminium, 05102018_papier_non_papier_tres_peu_dense:0 29052025|ela, 05102018_papier_non_papier_dense:0 29052025|ela, 05102018_papier_non_papier_peu_dense:0 29052025|ela, 05102018_papier_non_papier_presque_vide:0 29052025|ela, 05102018_papier_non_papier_tres_dense:0 29052025|ela, 05102018_papier_non_papier_tres_peu_dense:0 29052025|emr, 05102018_papier_non_papier_dense:0 29052025|emr, 05102018_papier_non_papier_peu_dense:0 29052025|emr, 05102018_papier_non_papier_presque_vide:0 29052025|emr, 05102018_papier_non_papier_tres_dense:0 29052025|emr, 05102018_papier_non_papier_tres_peu_dense:0 29052025|film_pedb, 05102018_papier_non_papier_dense:0 29052025|film_pedb, 05102018_papier_non_papier_peu_dense:33.997621059417725 29052025|film_pedb, 05102018_papier_non_papier_presque_vide:77.99987387657166 29052025|film_pedb, 05102018_papier_non_papier_tres_dense:0 29052025|film_pedb, 05102018_papier_non_papier_tres_peu_dense:13.002265930175781 29052025|flux_dev, 05102018_papier_non_papier_dense:0 29052025|flux_dev, 05102018_papier_non_papier_peu_dense:4.999011039733887 29052025|flux_dev, 05102018_papier_non_papier_presque_vide:0 29052025|flux_dev, 05102018_papier_non_papier_tres_dense:0 29052025|flux_dev, 05102018_papier_non_papier_tres_peu_dense:0 29052025|jrm, 05102018_papier_non_papier_dense:0 29052025|jrm, 05102018_papier_non_papier_peu_dense:13.002182006835938 29052025|jrm, 05102018_papier_non_papier_presque_vide:48.999653339385986 29052025|jrm, 05102018_papier_non_papier_tres_dense:0 29052025|jrm, 05102018_papier_non_papier_tres_peu_dense:6.0000159740448 29052025|pcm, 05102018_papier_non_papier_dense:0 29052025|pcm, 05102018_papier_non_papier_peu_dense:0 29052025|pcm, 05102018_papier_non_papier_presque_vide:0 29052025|pcm, 05102018_papier_non_papier_tres_dense:0 29052025|pcm, 05102018_papier_non_papier_tres_peu_dense:0 29052025|pcnc, 05102018_papier_non_papier_dense:0 29052025|pcnc, 05102018_papier_non_papier_peu_dense:0 29052025|pcnc, 05102018_papier_non_papier_presque_vide:7.00113320350647 29052025|pcnc, 05102018_papier_non_papier_tres_dense:0 29052025|pcnc, 05102018_papier_non_papier_tres_peu_dense:0 29052025|pehd_pp, 05102018_papier_non_papier_dense:0 29052025|pehd_pp, 05102018_papier_non_papier_peu_dense:187.00278306007385 29052025|pehd_pp, 05102018_papier_non_papier_presque_vide:110.99442267417908 29052025|pehd_pp, 05102018_papier_non_papier_tres_dense:0 29052025|pehd_pp, 05102018_papier_non_papier_tres_peu_dense:4.998802900314331 29052025|pet_clair, 05102018_papier_non_papier_dense:0 29052025|pet_clair, 05102018_papier_non_papier_peu_dense:0 29052025|pet_clair, 05102018_papier_non_papier_presque_vide:62.0023832321167 29052025|pet_clair, 05102018_papier_non_papier_tres_dense:0 29052025|pet_clair, 05102018_papier_non_papier_tres_peu_dense:0 29052025|refus, 05102018_papier_non_papier_dense:0 29052025|refus, 05102018_papier_non_papier_peu_dense:6.0001749992370605 29052025|refus, 05102018_papier_non_papier_presque_vide:61.00010323524475 29052025|refus, 05102018_papier_non_papier_tres_dense:0 29052025|refus, 05102018_papier_non_papier_tres_peu_dense:0 29052025|tapis_vide, 05102018_papier_non_papier_dense:0 29052025|tapis_vide, 05102018_papier_non_papier_peu_dense:0 29052025|tapis_vide, 05102018_papier_non_papier_presque_vide:1990.9995975494385 29052025|tapis_vide, 05102018_papier_non_papier_tres_dense:0 29052025|tapis_vide, 05102018_papier_non_papier_tres_peu_dense:0 #Number Photos for regression amount gros magasin papier (time_diff then nb_photo) : We have not displayed the number of photos removed for one material since Rungis_Papier wasn't in the thcl used ! 29052025_time_diff_distrib Number amount portfolio for this type of dechet : aluminium 0 Number amount portfolio for this type of dechet : ela 0 Number amount portfolio for this type of dechet : emr 0 Number amount portfolio for this type of dechet : film_pedb 21 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=29052025_film_pedb_05102018_papier_non_papier_peu_dense&access_token=08f99e4316eab7bf4779f7398f9aa5cd Created to study and clean : 23437329 with name like 29052025_film_pedb_05102018_papier_non_papier_peu_dense https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=29052025_film_pedb_05102018_papier_non_papier_presque_vide&access_token=08f99e4316eab7bf4779f7398f9aa5cd Created to study and clean : 23437330 with name like 29052025_film_pedb_05102018_papier_non_papier_presque_vide https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=29052025_film_pedb_05102018_papier_non_papier_tres_peu_dense&access_token=08f99e4316eab7bf4779f7398f9aa5cd Created to study and clean : 23437331 with name like 29052025_film_pedb_05102018_papier_non_papier_tres_peu_dense Number amount portfolio for this type of dechet : flux_dev 1 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=29052025_flux_dev_05102018_papier_non_papier_peu_dense&access_token=08f99e4316eab7bf4779f7398f9aa5cd Created to study and clean : 23437332 with name like 29052025_flux_dev_05102018_papier_non_papier_peu_dense Number amount portfolio for this type of dechet : jrm 11 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=29052025_jrm_05102018_papier_non_papier_peu_dense&access_token=08f99e4316eab7bf4779f7398f9aa5cd Created to study and clean : 23437333 with name like 29052025_jrm_05102018_papier_non_papier_peu_dense https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=29052025_jrm_05102018_papier_non_papier_presque_vide&access_token=08f99e4316eab7bf4779f7398f9aa5cd Created to study and clean : 23437334 with name like 29052025_jrm_05102018_papier_non_papier_presque_vide https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=29052025_jrm_05102018_papier_non_papier_tres_peu_dense&access_token=08f99e4316eab7bf4779f7398f9aa5cd Created to study and clean : 23437335 with name like 29052025_jrm_05102018_papier_non_papier_tres_peu_dense Number amount portfolio for this type of dechet : pcm 0 Number amount portfolio for this type of dechet : pcnc 1 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=29052025_pcnc_05102018_papier_non_papier_presque_vide&access_token=08f99e4316eab7bf4779f7398f9aa5cd Created to study and clean : 23437336 with name like 29052025_pcnc_05102018_papier_non_papier_presque_vide Number amount portfolio for this type of dechet : pehd_pp 49 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=29052025_pehd_pp_05102018_papier_non_papier_peu_dense&access_token=08f99e4316eab7bf4779f7398f9aa5cd Created to study and clean : 23437337 with name like 29052025_pehd_pp_05102018_papier_non_papier_peu_dense https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=29052025_pehd_pp_05102018_papier_non_papier_presque_vide&access_token=08f99e4316eab7bf4779f7398f9aa5cd Created to study and clean : 23437338 with name like 29052025_pehd_pp_05102018_papier_non_papier_presque_vide https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=29052025_pehd_pp_05102018_papier_non_papier_tres_peu_dense&access_token=08f99e4316eab7bf4779f7398f9aa5cd Created to study and clean : 23437356 with name like 29052025_pehd_pp_05102018_papier_non_papier_tres_peu_dense Number amount portfolio for this type of dechet : pet_clair 9 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=29052025_pet_clair_05102018_papier_non_papier_presque_vide&access_token=08f99e4316eab7bf4779f7398f9aa5cd Created to study and clean : 23437357 with name like 29052025_pet_clair_05102018_papier_non_papier_presque_vide Number amount portfolio for this type of dechet : refus 11 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=29052025_refus_05102018_papier_non_papier_peu_dense&access_token=08f99e4316eab7bf4779f7398f9aa5cd Created to study and clean : 23437358 with name like 29052025_refus_05102018_papier_non_papier_peu_dense https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=29052025_refus_05102018_papier_non_papier_presque_vide&access_token=08f99e4316eab7bf4779f7398f9aa5cd Created to study and clean : 23437376 with name like 29052025_refus_05102018_papier_non_papier_presque_vide Number amount portfolio for this type of dechet : tapis_vide 255 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=29052025_tapis_vide_05102018_papier_non_papier_presque_vide&access_token=08f99e4316eab7bf4779f7398f9aa5cd Created to study and clean : 23437377 with name like 29052025_tapis_vide_05102018_papier_non_papier_presque_vide begin to remove the low_density images haven't found thcl_volume NUMBER BATCH : 8 list_ponderation used : [0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001] , list_hashtag_class_create_as_list : ['emr', 'pcm', 'pcnc', 'jrm', 'ela', 'pet_clair', 'film_pedb', 'pehd_pp', 'flux_dev', 'aluminium', 'tapis_vide', 'refus'] We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_film_pedb:{'day': '29052025', 'map_nb_amount': {0: 6, 1: 20, 2: 0, 3: 3, 4: 0}, 'map_time_amount': {0: 32.99663805961609, 1: 128.0011911392212, 2: 0, 3: 19.00228190422058, 4: 0}, 'duration': 449.9999167919159, 'nb_balles_papier': 0.18000011110305783, 'begin_time_port': 'image_29052025_07_16_17_6400.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.18000011110305783 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_pehd_pp:{'day': '29052025', 'map_nb_amount': {0: 32, 1: 30, 2: 0, 3: 1, 4: 0}, 'map_time_amount': {0: 207.0061230659485, 1: 178.99533224105835, 2: 0, 3: 4.998802900314331, 4: 0}, 'duration': 504.000079870224, 'nb_balles_papier': 0.39100025820732115, 'begin_time_port': 'image_29052025_07_29_59_6241.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.39100025820732115 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We have rejected 11 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 2 list_same_port_ids : [] https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=film_pedb_diff_batch__29052025_07_16_17_006400&access_token=08f99e4316eab7bf4779f7398f9aa5cd list_same_port_ids : [] https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=pehd_pp_diff_batch__29052025_07_29_59_006241&access_token=08f99e4316eab7bf4779f7398f9aa5cd # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23437378 AND mptpi.`type`=4461 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23437379 AND mptpi.`type`=4211 To do elapsed_time : count_nb_balles_and_create_portfolio 16.35218644142151 # DISPLAY ALL COLLECTED DATA : {'29052025': {'nb_upload': 366, 'nb_taggue_class': 366, 'nb_taggue_densite': 366, 'nb_descriptors': 108, 'number_port': 8, 'count_photo_in_port': 103, 'nb_port_per_class': {'aluminium': {'nb_photos': 0, 'nb_portfolios': 0}, 'ela': {'nb_photos': 0, 'nb_portfolios': 0}, 'emr': {'nb_photos': 0, 'nb_portfolios': 0}, 'film_pedb': {'nb_photos': 30, 'nb_portfolios': 2}, 'flux_dev': {'nb_photos': 0, 'nb_portfolios': 0}, 'jrm': {'nb_photos': 1, 'nb_portfolios': 1}, 'pcm': {'nb_photos': 0, 'nb_portfolios': 0}, 'pcnc': {'nb_photos': 0, 'nb_portfolios': 0}, 'pehd_pp': {'nb_photos': 63, 'nb_portfolios': 1}, 'pet_clair': {'nb_photos': 6, 'nb_portfolios': 2}, 'refus': {'nb_photos': 3, 'nb_portfolios': 1}, 'tapis_vide': {'nb_photos': 0, 'nb_portfolios': 1}}}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1361603722, 1361603721, 1361603069, 1361603054, 1361603050, 1361603047, 1361603042, 1361603038, 1361603032, 1361603030, 1361603026, 1361603022, 1361603018, 1361603014, 1361603001, 1361602998, 1361602994, 1361602992, 1361602990, 1361602988] Looping around the photos to save general results len do output : 1 /23436764Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4887', None, None, None, None, None, None, None, '2982599') ('4887', '23436764', '1361603722', None, None, None, None, None, '2982599') ('4887', None, None, None, None, None, None, None, '2982599') ('4887', '23436764', '1361603721', None, None, None, None, None, '2982599') ('4887', None, None, None, None, None, None, None, '2982599') ('4887', '23436764', '1361603069', None, None, None, None, None, '2982599') ('4887', None, None, None, None, None, None, None, '2982599') ('4887', '23436764', '1361603054', None, None, None, None, None, '2982599') ('4887', None, None, None, None, None, None, None, '2982599') ('4887', '23436764', '1361603050', None, None, None, None, None, '2982599') ('4887', None, None, None, None, None, None, None, '2982599') ('4887', '23436764', '1361603047', None, None, None, None, None, '2982599') ('4887', None, None, None, None, None, None, None, '2982599') ('4887', '23436764', '1361603042', None, None, None, None, None, '2982599') ('4887', None, None, None, None, None, None, None, '2982599') ('4887', '23436764', '1361603038', None, None, None, None, None, '2982599') ('4887', None, None, None, None, None, None, None, '2982599') ('4887', '23436764', '1361603032', None, None, None, None, None, '2982599') ('4887', None, None, None, None, None, None, None, '2982599') ('4887', '23436764', '1361603030', None, None, None, None, None, '2982599') ('4887', None, None, None, None, None, None, None, '2982599') ('4887', '23436764', '1361603026', None, None, None, None, None, '2982599') ('4887', None, None, None, None, None, None, None, '2982599') ('4887', '23436764', '1361603022', None, None, None, None, None, '2982599') ('4887', None, None, None, None, None, None, None, '2982599') ('4887', '23436764', '1361603018', None, None, None, None, None, '2982599') ('4887', None, None, None, None, None, None, None, '2982599') ('4887', '23436764', '1361603014', None, None, None, None, None, '2982599') ('4887', None, None, None, None, None, None, None, '2982599') ('4887', '23436764', '1361603001', None, None, None, None, None, '2982599') ('4887', None, None, None, None, None, None, None, '2982599') ('4887', '23436764', '1361602998', None, None, None, None, None, '2982599') ('4887', None, None, None, None, None, None, None, '2982599') ('4887', '23436764', '1361602994', None, None, None, None, None, '2982599') ('4887', None, None, None, None, None, None, None, '2982599') ('4887', '23436764', '1361602992', None, None, None, None, None, '2982599') ('4887', None, None, None, None, None, None, None, '2982599') ('4887', '23436764', '1361602990', None, None, None, None, None, '2982599') ('4887', None, None, None, None, None, None, None, '2982599') ('4887', '23436764', '1361602988', None, None, None, None, None, '2982599') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.13543033599853516 save_final save missing photos in datou_result : time spend for datou_step_exec : 21.780285358428955 time spend to save output : 0.13576078414916992 total time spend for step 1 : 21.916046142578125 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 1.67user 0.87system 0:26.13elapsed 9%CPU (0avgtext+0avgdata 104548maxresident)k 1008inputs+1032outputs (1major+50142minor)pagefaults 0swaps