python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4891' -s datou_current_4891 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1298118 load datou : 4891 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Current got : datou_id : 4891, datou_cur_ids : ['4335374'] with mtr_portfolio_ids : ['30211848'] and first list_photo_ids : [] new path : /proc/1298118/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.027562856674194336 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Mon Jan 26 07:00:28 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3892, 'mtr_user_id': 31, 'name': 'learn_MM_generique_26022025', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,emr,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '17736100,17736101,17736102,17736103,17736104,20837895,20837896,17736107,17736108,17736109,17736110,18876169', 'photo_hashtag_type': 4989, 'photo_desc_type': 6092, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,616987804,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('06', 338),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 332} 26012026 30211848 Nombre de photos uploadées : 338 / 23040 (1%) 26012026 30211848 Nombre de photos taguées (types de déchets): 332 / 338 (98%) 26012026 30211848 Nombre de photos taguées (volume) : 332 / 338 (98%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 0.0001251697540283203 ?????? elapsed_time : fill_and_build_computed_from_old_data 0.015082120895385742 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2308213710784912 Creating list_photo_total elapsed_time : select_descriptors 5.951241731643677 26012026 30211848 Nombre de photos avec descriptors (type 6092) : 111 / 117 (94%) Missing descriptors for photos 0 and 1405522282 0:00:00|ON:Missing descriptors for photos 1405522282 and 1405522283 Missing descriptors for photos 1405522283 and 1405522284 Missing descriptors for photos 1405522284 and 1405522307 Missing descriptors for photos 1405522307 and 1405522928 Missing descriptors for photos 1405522928 and 1405523004 Missing descriptors for photos 1405523004 and 1405523081 Missing descriptors for photos 1405523081 and 1405523152 Missing descriptors for photos 1405523152 and 1405523223 Missing descriptors for photos 1405523223 and 1405523300 Missing descriptors for photos 1405523300 and 1405523630 Missing descriptors for photos 1405523630 and 1405523669 Missing descriptors for photos 1405523669 and 1405523714 Missing descriptors for photos 1405523714 and 1405523734 Missing descriptors for photos 1405523734 and 1405523735 Missing descriptors for photos 1405523735 and 1405523736 Missing descriptors for photos 1405523736 and 1405523775 Missing descriptors for photos 1405523775 and 1405523813 Missing descriptors for photos 1405523813 and 1405523831 Missing descriptors for photos 1405523831 and 1405523832 Missing descriptors for photos 1405523832 and 1405523842 Missing descriptors for photos 1405523842 and 1405523881 Missing descriptors for photos 1405523881 and 1405523895 Missing descriptors for photos 1405523895 and 1405523896 Missing descriptors for photos 1405523896 and 1405523897 Missing descriptors for photos 1405523897 and 1405523898 Missing descriptors for photos 1405523898 and 1405523899 Missing descriptors for photos 1405523899 and 1405523901 Missing descriptors for photos 1405523901 and 1405523902 Missing descriptors for photos 1405523902 and 1405523903 Missing descriptors for photos 1405523903 and 1405523904 Missing descriptors for photos 1405523904 and 1405523905 Missing descriptors for photos 1405523905 and 1405523906 Missing descriptors for photos 1405523906 and 1405523908 Missing descriptors for photos 1405523908 and 1405523910 Missing descriptors for photos 1405523910 and 1405523911 Missing descriptors for photos 1405523911 and 1405523912 Missing descriptors for photos 1405523912 and 1405523913 Missing descriptors for photos 1405523913 and 1405523914 Missing descriptors for photos 1405523914 and 1405523915 Missing descriptors for photos 1405523915 and 1405523916 Missing descriptors for photos 1405523916 and 1405523917 Missing descriptors for photos 1405523917 and 1405523918 Missing descriptors for photos 1405523918 and 1405523919 Missing descriptors for photos 1405523919 and 1405523922 Missing descriptors for photos 1405523922 and 1405523924 Missing descriptors for photos 1405523924 and 1405523925 Missing descriptors for photos 1405523925 and 1405523926 Missing descriptors for photos 1405523926 and 1405523927 Missing descriptors for photos 1405523927 and 1405523928 Missing descriptors for photos 1405523928 and 1405523929 Missing descriptors for photos 1405523929 and 1405523930 Missing descriptors for photos 1405523930 and 1405523931 Missing descriptors for photos 1405523931 and 1405523932 Missing descriptors for photos 1405523932 and 1405523933 Missing descriptors for photos 1405523933 and 1405523934 Missing descriptors for photos 1405523934 and 1405523936 Missing descriptors for photos 1405523936 and 1405523943 Missing descriptors for photos 1405523943 and 1405523945 Missing descriptors for photos 1405523945 and 1405523946 Missing descriptors for photos 1405523946 and 1405523947 Missing descriptors for photos 1405523947 and 1405523948 Missing descriptors for photos 1405523948 and 1405523949 Missing descriptors for photos 1405523949 and 1405523950 Missing descriptors for photos 1405523950 and 1405523951 Missing descriptors for photos 1405523951 and 1405523952 Missing descriptors for photos 1405523952 and 1405523953 Missing descriptors for photos 1405523953 and 1405523954 Missing descriptors for photos 1405523954 and 1405523955 Missing descriptors for photos 1405523955 and 1405523959 Missing descriptors for photos 1405523959 and 1405523960 Missing descriptors for photos 1405523960 and 1405523961 Missing descriptors for photos 1405523961 and 1405523962 Missing descriptors for photos 1405523962 and 1405523963 Missing descriptors for photos 1405523963 and 1405523965 Missing descriptors for photos 1405523965 and 1405523966 Missing descriptors for photos 1405523966 and 1405523967 Missing descriptors for photos 1405523967 and 1405523968 Missing descriptors for photos 1405523968 and 1405523969 Missing descriptors for photos 1405523969 and 1405523970 Missing descriptors for photos 1405523970 and 1405523972 Missing descriptors for photos 1405523972 and 1405523974 Missing descriptors for photos 1405523974 and 1405523975 Missing descriptors for photos 1405523975 and 1405523977 Missing descriptors for photos 1405523977 and 1405523978 Missing descriptors for photos 1405523978 and 1405523979 Missing descriptors for photos 1405523979 and 1405523981 Missing descriptors for photos 1405523981 and 1405523982 Missing descriptors for photos 1405523982 and 1405523983 Missing descriptors for photos 1405523983 and 1405523984 Missing descriptors for photos 1405523984 and 1405523985 0:16:58.998202|OFF:0:00:31.001220|ON:0:01:20.000198|OFF:0:00:09.999775|ON:0:02:10.000003|OFF:0:00:20.000100|ON:0:01:40.000140|OFF:0:00:09.999741|ON:Missing descriptors for photos 1405524053 and 1405524049 Missing descriptors for photos 1405524049 and 1405524054 Missing descriptors for photos 1405524054 and 1405524055 Missing descriptors for photos 1405524055 and 1405524056 Missing descriptors for photos 1405524056 and 1405524058 Missing descriptors for photos 1405524058 and 1405524059 Missing descriptors for photos 1405524059 and 1405524060 Missing descriptors for photos 1405524060 and 1405524061 Missing descriptors for photos 1405524061 and 1405524062 Missing descriptors for photos 1405524062 and 1405524064 Missing descriptors for photos 1405524064 and 1405524065 Missing descriptors for photos 1405524065 and 1405524066 Missing descriptors for photos 1405524066 and 1405524067 Missing descriptors for photos 1405524067 and 1405524068 Missing descriptors for photos 1405524068 and 1405524069 Missing descriptors for photos 1405524069 and 1405524070 Missing descriptors for photos 1405524070 and 1405524071 Missing descriptors for photos 1405524071 and 1405524072 Missing descriptors for photos 1405524072 and 1405524073 Missing descriptors for photos 1405524073 and 1405524074 Missing descriptors for photos 1405524074 and 1405524075 Missing descriptors for photos 1405524075 and 1405524077 Missing descriptors for photos 1405524077 and 1405524079 Missing descriptors for photos 1405524079 and 1405524080 Missing descriptors for photos 1405524080 and 1405524081 Missing descriptors for photos 1405524081 and 1405524082 Missing descriptors for photos 1405524082 and 1405524083 Missing descriptors for photos 1405524083 and 1405524084 Missing descriptors for photos 1405524084 and 1405524086 Missing descriptors for photos 1405524086 and 1405524087 Missing descriptors for photos 1405524087 and 1405524088 Missing descriptors for photos 1405524088 and 1405524090 Missing descriptors for photos 1405524090 and 1405524091 Missing descriptors for photos 1405524091 and 1405524093 Missing descriptors for photos 1405524093 and 1405524095 Missing descriptors for photos 1405524095 and 1405524096 Missing descriptors for photos 1405524096 and 1405524097 Missing descriptors for photos 1405524115 and 1405524119 Missing descriptors for photos 1405524119 and 1405524120 Missing descriptors for photos 1405524120 and 1405524123 Missing descriptors for photos 1405524123 and 1405524124 Missing descriptors for photos 1405524124 and 1405524125 Missing descriptors for photos 1405524125 and 1405524126 Missing descriptors for photos 1405524126 and 1405524127 Missing descriptors for photos 1405524127 and 1405524128 Missing descriptors for photos 1405524128 and 1405524129 Missing descriptors for photos 1405524129 and 1405524130 Missing descriptors for photos 1405524130 and 1405524131 Missing descriptors for photos 1405524131 and 1405524132 Missing descriptors for photos 1405524132 and 1405524133 Missing descriptors for photos 1405524133 and 1405524135 Missing descriptors for photos 1405524135 and 1405524137 Missing descriptors for photos 1405524137 and 1405524138 Missing descriptors for photos 1405524138 and 1405524139 Missing descriptors for photos 1405524139 and 1405524140 Missing descriptors for photos 1405524140 and 1405524141 Missing descriptors for photos 1405524141 and 1405524143 Missing descriptors for photos 1405524143 and 1405524144 Missing descriptors for photos 1405524144 and 1405524145 Missing descriptors for photos 1405524145 and 1405524146 Missing descriptors for photos 1405524146 and 1405524147 Missing descriptors for photos 1405524147 and 1405524148 Missing descriptors for photos 1405524148 and 1405524150 Missing descriptors for photos 1405524150 and 1405524156 Missing descriptors for photos 1405524156 and 1405524158 Missing descriptors for photos 1405524158 and 1405524159 Missing descriptors for photos 1405524159 and 1405524160 Missing descriptors for photos 1405524160 and 1405524161 Missing descriptors for photos 1405524161 and 1405524162 Missing descriptors for photos 1405524162 and 1405524163 Missing descriptors for photos 1405524163 and 1405524164 0:18:48.998850|OFF:0:00:11.001439|ON:Missing descriptors for photos 1405524197 and 1405524198 Missing descriptors for photos 1405524198 and 1405524205 Missing descriptors for photos 1405524205 and 1405524208 Missing descriptors for photos 1405524208 and 1405524209 Missing descriptors for photos 1405524209 and 1405524210 Missing descriptors for photos 1405524210 and 1405524211 Missing descriptors for photos 1405524211 and 1405524212 Missing descriptors for photos 1405524212 and 1405524213 Missing descriptors for photos 1405524213 and 1405524214 Missing descriptors for photos 1405524214 and 1405524215 Missing descriptors for photos 1405524215 and 1405524216 Missing descriptors for photos 1405524216 and 1405524217 Missing descriptors for photos 1405524217 and 1405524218 Missing descriptors for photos 1405524218 and 1405524222 Missing descriptors for photos 1405524222 and 1405524223 Missing descriptors for photos 1405524223 and 1405524224 Missing descriptors for photos 1405524224 and 1405524225 Missing descriptors for photos 1405524225 and 1405524226 Missing descriptors for photos 1405524226 and 1405524228 Missing descriptors for photos 1405524228 and 1405524229 Missing descriptors for photos 1405524229 and 1405524230 Missing descriptors for photos 1405524230 and 1405524231 Missing descriptors for photos 1405524231 and 1405524232 Missing descriptors for photos 1405524232 and 1405524233 Missing descriptors for photos 1405524233 and 1405524235 Missing descriptors for photos 1405524235 and 1405524237 Missing descriptors for photos 1405524237 and 1405524238 Missing descriptors for photos 1405524238 and 1405524239 Missing descriptors for photos 1405524239 and 1405524240 Missing descriptors for photos 1405524240 and 1405524241 Missing descriptors for photos 1405524250 and 1405524252 Missing descriptors for photos 1405524252 and 1405524253 Missing descriptors for photos 1405524253 and 1405524254 Missing descriptors for photos 1405524254 and 1405524255 Missing descriptors for photos 1405524255 and 1405524256 Missing descriptors for photos 1405524279 and 1405524280 Missing descriptors for photos 1405524280 and 1405524284 Missing descriptors for photos 1405524284 and 1405524285 Missing descriptors for photos 1405524285 and 1405524286 Missing descriptors for photos 1405524286 and 1405524287 Missing descriptors for photos 1405524287 and 1405524288 Missing descriptors for photos 1405524288 and 1405524290 Missing descriptors for photos 1405524290 and 1405524291 Missing descriptors for photos 1405524291 and 1405524292 Missing descriptors for photos 1405524292 and 1405524293 Missing descriptors for photos 1405524293 and 1405524294 Missing descriptors for photos 1405524294 and 1405524295 Missing descriptors for photos 1405524295 and 1405524297 Missing descriptors for photos 1405524297 and 1405524299 Missing descriptors for photos 1405524299 and 1405524300 Missing descriptors for photos 1405524300 and 1405524301 Missing descriptors for photos 1405524301 and 1405524302 Missing descriptors for photos 1405524302 and 1405524303 Missing descriptors for photos 1405524303 and 1405524305 Missing descriptors for photos 1405524305 and 1405524306 Missing descriptors for photos 1405524306 and 1405524307 Missing descriptors for photos 1405524307 and 1405524308 Missing descriptors for photos 1405524308 and 1405524309 Missing descriptors for photos 1405524309 and 1405524310 Missing descriptors for photos 1405524310 and 1405524312 26012026 Removing 7 photos because of the 'same image' condition Total on : 2457.997393 list_time_on Total off : 82.00227500000001 list_time_off dist_desc begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 338 time used for this insertion : 0.09134292602539062 photos_removed : len 7 elapsed_time : remove_photo_duplicate 0.20825958251953125 Creating list_photo_total XXXXXXXWarning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! elapsed_time : count_sum_diff_and_build_graph 0.03106546401977539 Total photos : 338 .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 0 hashtag : 2107760237 photo_id =1405523986 : film_pedb ..........can't find max_score_info .can't find max_score_info ........can't find max_score_info .............can't find max_score_info .can't find max_score_info ..........can't find max_score_info ....can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ..Change port : 42 hashtag : 2107760239 photo_id =1405524099 : pehd_pp ..Change port : 2 hashtag : 495916461 photo_id =1405524101 : jrm .....Change port : 5 hashtag : 2107760239 photo_id =1405524107 : pehd_pp .Change port : 1 hashtag : 616987804 photo_id =1405524109 : emr .........can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 9 hashtag : 2107755846 photo_id =1405524165 : pet_clair ..................can't find max_score_info .......can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 24 hashtag : 2107760239 photo_id =1405524243 : pehd_pp ......can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .......Change port : 12 hashtag : 2107760238 photo_id =1405524265 : flux_dev ......Change port : 6 hashtag : 2107760239 photo_id =1405524276 : pehd_pp ...can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info Total photos : 338 Number of lists : 10 counter photos in port : 104 hashtag : aluminium(493546845) : 0 photos in 0 portfolios ! hashtag : ela(492741797) : 0 photos in 0 portfolios ! hashtag : emr(616987804) : 9 photos in 1 portfolios ! hashtag : film_pedb(2107760237) : 42 photos in 1 portfolios ! hashtag : flux_dev(2107760238) : 6 photos in 1 portfolios ! hashtag : jrm(495916461) : 5 photos in 1 portfolios ! hashtag : pcm(560181804) : 0 photos in 0 portfolios ! hashtag : pcnc(1284539308) : 0 photos in 0 portfolios ! hashtag : pehd_pp(2107760239) : 18 photos in 4 portfolios ! hashtag : pet_clair(2107755846) : 24 photos in 1 portfolios ! hashtag : refus(538914404) : 0 photos in 0 portfolios ! hashtag : tapis_vide(2107748999) : 0 photos in 1 portfolios ! elapsed_time : group_photo_by_moyenne_exp 0.01005244255065918 elapsed_time : compute_and_correct_tag_with_moyenne_mobile 3.0994415283203125e-06 today str has not a value , we define it as the date of the first image todaystr_first : 26012026 attention , prev_timestamp is 0 , we do nothing Unexpected type of data : ({'photo_id': 1405524306, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2026/1/26/4a15742b35cd3d89d2b188bc08f15e26.jpg', 'username': None, 'uploaded_at': 1769407103, 'text': 'image_26012026_06_56_54_9274.jpg', 'time': 1769410614.009274}, 'different') Unexpected type of data : ({'photo_id': 1405524307, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2026/1/26/50ac4bc0e2a577e1df3ccccb664bc084.jpg', 'username': None, 'uploaded_at': 1769407103, 'text': 'image_26012026_06_57_05_10632.jpg', 'time': 1769410625.010632}, 'different') Unexpected type of data : ({'photo_id': 1405524308, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2026/1/26/f1fe09da0ccda927b95b334e05b26c97.jpg', 'username': None, 'uploaded_at': 1769407103, 'text': 'image_26012026_06_57_15_10327.jpg', 'time': 1769410635.010327}, 'different') Unexpected type of data : ({'photo_id': 1405524309, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2026/1/26/6e3f3d3e4a99ad92ab457501fc9ceb64.jpg', 'username': None, 'uploaded_at': 1769407103, 'text': 'image_26012026_06_57_24_9068.jpg', 'time': 1769410644.009068}, 'different') Unexpected type of data : ({'photo_id': 1405524310, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2026/1/26/5c736e63f838fa959f3aa5480a984411.jpg', 'username': None, 'uploaded_at': 1769407103, 'text': 'image_26012026_06_57_35_10322.jpg', 'time': 1769410655.010322}, 'different') Unexpected type of data : ({'photo_id': 1405524312, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2026/1/26/9668164ab81c779f59456749029bf4f3.jpg', 'username': None, 'uploaded_at': 1769407103, 'text': 'image_26012026_06_57_45_10450.jpg', 'time': 1769410665.01045}, 'different') Count Time bigger than 30s : 0 #Number Photos for regression : {'26012026': {493546845: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 492741797: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 616987804: {2107751013: 0, 2107751014: 0, 2107751015: 50.00103998184204, 2107751016: 21.00151801109314, 2107751017: 0}, 2107760237: {2107751013: 0, 2107751014: 10.000507831573486, 2107751015: 490.99941849708557, 2107751016: 0, 2107751017: 0}, 2107760238: {2107751013: 0, 2107751014: 0, 2107751015: 71.00274395942688, 2107751016: 0, 2107751017: 0}, 495916461: {2107751013: 0, 2107751014: 0, 2107751015: 19.999542951583862, 2107751016: 0, 2107751017: 0}, 560181804: {2107751013: 0, 2107751014: 0, 2107751015: 28.997353076934814, 2107751016: 0, 2107751017: 0}, 1284539308: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107760239: {2107751013: 0, 2107751014: 22.00257706642151, 2107751015: 96.99637937545776, 2107751016: 0, 2107751017: 0}, 2107755846: {2107751013: 0, 2107751014: 0, 2107751015: 240.00118589401245, 2107751016: 0, 2107751017: 0}, 538914404: {2107751013: 0, 2107751014: 0, 2107751015: 38.99869728088379, 2107751016: 0, 2107751017: 0}, 2107748999: {2107751013: 0, 2107751014: 0, 2107751015: 2210.9999482631683, 2107751016: 0, 2107751017: 0}}} 26012026|aluminium, 05102018_papier_non_papier_dense:0 26012026|aluminium, 05102018_papier_non_papier_peu_dense:0 26012026|aluminium, 05102018_papier_non_papier_presque_vide:0 26012026|aluminium, 05102018_papier_non_papier_tres_dense:0 26012026|aluminium, 05102018_papier_non_papier_tres_peu_dense:0 26012026|ela, 05102018_papier_non_papier_dense:0 26012026|ela, 05102018_papier_non_papier_peu_dense:0 26012026|ela, 05102018_papier_non_papier_presque_vide:0 26012026|ela, 05102018_papier_non_papier_tres_dense:0 26012026|ela, 05102018_papier_non_papier_tres_peu_dense:0 26012026|emr, 05102018_papier_non_papier_dense:0 26012026|emr, 05102018_papier_non_papier_peu_dense:0 26012026|emr, 05102018_papier_non_papier_presque_vide:50.00103998184204 26012026|emr, 05102018_papier_non_papier_tres_dense:21.00151801109314 26012026|emr, 05102018_papier_non_papier_tres_peu_dense:0 26012026|film_pedb, 05102018_papier_non_papier_dense:0 26012026|film_pedb, 05102018_papier_non_papier_peu_dense:10.000507831573486 26012026|film_pedb, 05102018_papier_non_papier_presque_vide:490.99941849708557 26012026|film_pedb, 05102018_papier_non_papier_tres_dense:0 26012026|film_pedb, 05102018_papier_non_papier_tres_peu_dense:0 26012026|flux_dev, 05102018_papier_non_papier_dense:0 26012026|flux_dev, 05102018_papier_non_papier_peu_dense:0 26012026|flux_dev, 05102018_papier_non_papier_presque_vide:71.00274395942688 26012026|flux_dev, 05102018_papier_non_papier_tres_dense:0 26012026|flux_dev, 05102018_papier_non_papier_tres_peu_dense:0 26012026|jrm, 05102018_papier_non_papier_dense:0 26012026|jrm, 05102018_papier_non_papier_peu_dense:0 26012026|jrm, 05102018_papier_non_papier_presque_vide:19.999542951583862 26012026|jrm, 05102018_papier_non_papier_tres_dense:0 26012026|jrm, 05102018_papier_non_papier_tres_peu_dense:0 26012026|pcm, 05102018_papier_non_papier_dense:0 26012026|pcm, 05102018_papier_non_papier_peu_dense:0 26012026|pcm, 05102018_papier_non_papier_presque_vide:28.997353076934814 26012026|pcm, 05102018_papier_non_papier_tres_dense:0 26012026|pcm, 05102018_papier_non_papier_tres_peu_dense:0 26012026|pcnc, 05102018_papier_non_papier_dense:0 26012026|pcnc, 05102018_papier_non_papier_peu_dense:0 26012026|pcnc, 05102018_papier_non_papier_presque_vide:0 26012026|pcnc, 05102018_papier_non_papier_tres_dense:0 26012026|pcnc, 05102018_papier_non_papier_tres_peu_dense:0 26012026|pehd_pp, 05102018_papier_non_papier_dense:0 26012026|pehd_pp, 05102018_papier_non_papier_peu_dense:22.00257706642151 26012026|pehd_pp, 05102018_papier_non_papier_presque_vide:96.99637937545776 26012026|pehd_pp, 05102018_papier_non_papier_tres_dense:0 26012026|pehd_pp, 05102018_papier_non_papier_tres_peu_dense:0 26012026|pet_clair, 05102018_papier_non_papier_dense:0 26012026|pet_clair, 05102018_papier_non_papier_peu_dense:0 26012026|pet_clair, 05102018_papier_non_papier_presque_vide:240.00118589401245 26012026|pet_clair, 05102018_papier_non_papier_tres_dense:0 26012026|pet_clair, 05102018_papier_non_papier_tres_peu_dense:0 26012026|refus, 05102018_papier_non_papier_dense:0 26012026|refus, 05102018_papier_non_papier_peu_dense:0 26012026|refus, 05102018_papier_non_papier_presque_vide:38.99869728088379 26012026|refus, 05102018_papier_non_papier_tres_dense:0 26012026|refus, 05102018_papier_non_papier_tres_peu_dense:0 26012026|tapis_vide, 05102018_papier_non_papier_dense:0 26012026|tapis_vide, 05102018_papier_non_papier_peu_dense:0 26012026|tapis_vide, 05102018_papier_non_papier_presque_vide:2210.9999482631683 26012026|tapis_vide, 05102018_papier_non_papier_tres_dense:0 26012026|tapis_vide, 05102018_papier_non_papier_tres_peu_dense:0 #Number Photos for regression amount gros magasin papier (time_diff then nb_photo) : We have not displayed the number of photos removed for one material since Rungis_Papier wasn't in the thcl used ! 26012026_time_diff_distrib Number amount portfolio for this type of dechet : aluminium 0 Number amount portfolio for this type of dechet : ela 0 Number amount portfolio for this type of dechet : emr 7 Created to study and clean : 30211948 with name like 26012026_emr_05102018_papier_non_papier_presque_vide Created to study and clean : 30211950 with name like 26012026_emr_05102018_papier_non_papier_tres_dense Number amount portfolio for this type of dechet : film_pedb 47 Created to study and clean : 30211952 with name like 26012026_film_pedb_05102018_papier_non_papier_peu_dense Created to study and clean : 30211954 with name like 26012026_film_pedb_05102018_papier_non_papier_presque_vide Number amount portfolio for this type of dechet : flux_dev 5 Created to study and clean : 30211956 with name like 26012026_flux_dev_05102018_papier_non_papier_presque_vide Number amount portfolio for this type of dechet : jrm 2 Created to study and clean : 30211957 with name like 26012026_jrm_05102018_papier_non_papier_presque_vide Number amount portfolio for this type of dechet : pcm 3 Number amount portfolio for this type of dechet : pcnc 0 Number amount portfolio for this type of dechet : pehd_pp 12 Created to study and clean : 30211959 with name like 26012026_pehd_pp_05102018_papier_non_papier_peu_dense Created to study and clean : 30211961 with name like 26012026_pehd_pp_05102018_papier_non_papier_presque_vide Number amount portfolio for this type of dechet : pet_clair 24 Created to study and clean : 30211963 with name like 26012026_pet_clair_05102018_papier_non_papier_presque_vide Number amount portfolio for this type of dechet : refus 4 Created to study and clean : 30211965 with name like 26012026_refus_05102018_papier_non_papier_presque_vide Number amount portfolio for this type of dechet : tapis_vide 220 Created to study and clean : 30211968 with name like 26012026_tapis_vide_05102018_papier_non_papier_presque_vide NUMBER BATCH : 10 list_ponderation used : [0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001] , list_hashtag_class_create_as_list : ['emr', 'gm', 'jrm', 'ela', 'pet_clair', 'film_pedb', 'pehd_pp', 'flux_dev', 'aluminium', 'tapis_vide', 'refus', 'emr', 'gm'] We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_film_pedb:{'day': '26012026', 'map_nb_amount': {0: 1, 1: 41, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 10.000507831573486, 1: 438.9980981349945, 2: 0, 3: 0, 4: 0}, 'duration': 890.0000150203705, 'nb_balles_papier': 0.448998605966568, 'begin_time_port': 'image_26012026_06_15_34_9141.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.448998605966568 We filter photos on hashtag condition ! We filter photos on hashtag condition ! hashtag non trouvé ! hashtag non trouvé ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_jrm:{'day': '26012026', 'map_nb_amount': {0: 1, 1: 4, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 11.00142216682434, 1: 38.998496770858765, 2: 0, 3: 0, 4: 0}, 'duration': 41.0011100769043, 'nb_balles_papier': 0.0499999189376831, 'begin_time_port': 'image_26012026_06_30_54_9148.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0499999189376831 hashtag non trouvé ! hashtag non trouvé ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_emr:{'day': '26012026', 'map_nb_amount': {0: 1, 1: 6, 2: 2, 3: 0, 4: 0}, 'map_time_amount': {0: 11.001154899597168, 1: 57.99733304977417, 2: 21.00151801109314, 3: 0, 4: 0}, 'duration': 80.00110912322998, 'nb_balles_papier': 0.09000000596046448, 'begin_time_port': 'image_26012026_06_31_55_9163.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.09000000596046448 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! hashtag non trouvé ! hashtag non trouvé ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_emr:{'day': '26012026', 'map_nb_amount': {0: 1, 1: 6, 2: 2, 3: 0, 4: 0}, 'map_time_amount': {0: 11.001154899597168, 1: 57.99733304977417, 2: 21.00151801109314, 3: 0, 4: 0}, 'duration': 80.00110912322998, 'nb_balles_papier': 0.09000000596046448, 'begin_time_port': 'image_26012026_06_31_55_9163.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.09000000596046448 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! hashtag non trouvé ! hashtag non trouvé ! We filter photos on hashtag condition ! result_one_balle_Type_pet_clair:{'day': '26012026', 'map_nb_amount': {0: 0, 1: 24, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 240.00118589401245, 2: 0, 3: 0, 4: 0}, 'duration': 248.9987349510193, 'nb_balles_papier': 0.24000118589401245, 'begin_time_port': 'image_26012026_06_39_15_10361.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.24000118589401245 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! hashtag non trouvé ! hashtag non trouvé ! result_one_balle_Type_pehd_pp:{'day': '26012026', 'map_nb_amount': {0: 0, 1: 12, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 119.99993920326233, 2: 0, 3: 0, 4: 0}, 'duration': 169.99968814849854, 'nb_balles_papier': 0.11999993920326232, 'begin_time_port': 'image_26012026_06_48_45_10588.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.11999993920326232 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_flux_dev:{'day': '26012026', 'map_nb_amount': {0: 0, 1: 6, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 78.99888396263123, 2: 0, 3: 0, 4: 0}, 'duration': 70.00010514259338, 'nb_balles_papier': 0.07899888396263123, 'begin_time_port': 'image_26012026_06_51_44_9055.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.07899888396263123 We filter photos on hashtag condition ! hashtag non trouvé ! hashtag non trouvé ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We have rejected 6 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 7 list_same_port_ids : [] list_same_port_ids : [] list_same_port_ids : [] list_same_port_ids : [30211973] find same portfolio which already exist 30211973 , we will use it list_same_port_ids : [] list_same_port_ids : [] list_same_port_ids : [] # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30211969 AND mptpi.`type`=4461 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30211971 AND mptpi.`type`=3726 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30211973 AND mptpi.`type`=4207 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30211973 AND mptpi.`type`=4207 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30211988 AND mptpi.`type`=3327 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30211989 AND mptpi.`type`=4211 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30211990 AND mptpi.`type`=4200 To do elapsed_time : count_nb_balles_and_create_portfolio 106.86734127998352 # DISPLAY ALL COLLECTED DATA : {'26012026': {'nb_upload': 338, 'nb_taggue_class': 332, 'nb_taggue_densite': 332, 'nb_descriptors': 111, 'number_port': 10, 'count_photo_in_port': 104, 'nb_port_per_class': {'aluminium': {'nb_photos': 0, 'nb_portfolios': 0}, 'ela': {'nb_photos': 0, 'nb_portfolios': 0}, 'emr': {'nb_photos': 9, 'nb_portfolios': 1}, 'film_pedb': {'nb_photos': 42, 'nb_portfolios': 1}, 'flux_dev': {'nb_photos': 6, 'nb_portfolios': 1}, 'jrm': {'nb_photos': 5, 'nb_portfolios': 1}, 'pcm': {'nb_photos': 0, 'nb_portfolios': 0}, 'pcnc': {'nb_photos': 0, 'nb_portfolios': 0}, 'pehd_pp': {'nb_photos': 18, 'nb_portfolios': 4}, 'pet_clair': {'nb_photos': 24, 'nb_portfolios': 1}, 'refus': {'nb_photos': 0, 'nb_portfolios': 0}, 'tapis_vide': {'nb_photos': 0, 'nb_portfolios': 1}}}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1405524312, 1405524310, 1405524309, 1405524308, 1405524307, 1405524306, 1405524305, 1405524303, 1405524302, 1405524301, 1405524300, 1405524299, 1405524297, 1405524295, 1405524294, 1405524293, 1405524292, 1405524291, 1405524290, 1405524288, 1405524287, 1405524286, 1405524285, 1405524284, 1405524280, 1405524279, 1405524278, 1405524277, 1405524276, 1405524275, 1405524274, 1405524273, 1405524272, 1405524270, 1405524265, 1405524263, 1405524262, 1405524261, 1405524260, 1405524259, 1405524258, 1405524256, 1405524255, 1405524254, 1405524253, 1405524252, 1405524250, 1405524248, 1405524247, 1405524246, 1405524245, 1405524244, 1405524243, 1405524241, 1405524240, 1405524239, 1405524238, 1405524237, 1405524235, 1405524233, 1405524232, 1405524231, 1405524230, 1405524229, 1405524228, 1405524226, 1405524225, 1405524224, 1405524223, 1405524222, 1405524218, 1405524217, 1405524216, 1405524215, 1405524214, 1405524213, 1405524212, 1405524211, 1405524210, 1405524209, 1405524208, 1405524205, 1405524198, 1405524197, 1405524196, 1405524195, 1405524194, 1405524193, 1405524191, 1405524190, 1405524189, 1405524188, 1405524187, 1405524185, 1405524183, 1405524182, 1405524181, 1405524180, 1405524179, 1405524178] Looping around the photos to save general results len do output : 1 /30211848Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524312', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524310', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524309', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524308', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524307', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524306', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524305', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524303', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524302', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524301', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524300', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524299', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524297', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524295', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524294', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524293', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524292', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524291', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524290', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524288', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524287', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524286', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524285', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524284', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524280', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524279', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524278', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524277', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524276', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524275', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524274', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524273', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524272', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524270', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524265', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524263', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524262', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524261', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524260', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524259', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524258', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524256', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524255', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524254', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524253', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524252', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524250', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524248', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524247', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524246', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524245', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524244', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524243', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524241', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524240', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524239', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524238', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524237', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524235', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524233', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524232', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524231', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524230', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524229', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524228', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524226', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524225', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524224', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524223', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524222', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524218', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524217', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524216', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524215', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524214', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524213', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524212', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524211', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524210', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524209', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524208', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524205', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524198', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524197', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524196', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524195', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524194', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524193', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524191', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524190', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524189', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524188', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524187', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524185', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524183', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524182', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524181', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524180', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524179', None, None, None, None, None, '4335374') ('4891', None, None, None, None, None, None, None, '4335374') ('4891', '30211848', '1405524178', None, None, None, None, None, '4335374') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.030893802642822266 save_final save missing photos in datou_result : time spend for datou_step_exec : 113.5414400100708 time spend to save output : 0.03455066680908203 total time spend for step 1 : 113.57599067687988 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 1.87user 1.23system 1:58.36elapsed 2%CPU (0avgtext+0avgdata 112432maxresident)k 214568inputs+1152outputs (6034major+64025minor)pagefaults 0swaps