python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4887 -l 20 --fifo' -s datou_current_sts -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3379491 load datou : 4887 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 421>20 please execute split_portfolio.py -i 20665102 -l 20 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4887, datou_cur_ids : ['2598873'] with mtr_portfolio_ids : ['20665102'] and first list_photo_ids : [] new path : /proc/3379491/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.021294832229614258 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Wed Feb 19 09:08:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3890, 'mtr_user_id': 31, 'name': 'learn_MM_generique_10122024', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,emr,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '17736100,17736101,17736102,17736103,17736104,18770747,17736106,17736107,17736108,17736109,17736110,18876169', 'photo_hashtag_type': 4984, 'photo_desc_type': 6091, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,616987804,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('07', 205), ('08', 185), ('09', 31)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 389} 19022025 20665102 Nombre de photos uploadées : 421 / 23040 (1%) 19022025 20665102 Nombre de photos taguées (types de déchets): 389 / 421 (92%) 19022025 20665102 Nombre de photos taguées (volume) : 389 / 421 (92%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 0.00017142295837402344 ???????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.018424510955810547 elapsed_time : insert_dashboard_record_day_entry 0.021932601928710938 Creating list_photo_total elapsed_time : select_descriptors 8.65968132019043 19022025 20665102 Nombre de photos avec descriptors (type 6091) : 179 / 211 (84%) Missing descriptors for photos 0 and 1338483380 0:00:00|ON:Missing descriptors for photos 1338483380 and 1338483377 Missing descriptors for photos 1338483377 and 1338483375 Missing descriptors for photos 1338483375 and 1338483436 Missing descriptors for photos 1338483436 and 1338483422 Missing descriptors for photos 1338483422 and 1338483420 Missing descriptors for photos 1338483420 and 1338483468 Missing descriptors for photos 1338483468 and 1338483464 Missing descriptors for photos 1338483464 and 1338483460 Missing descriptors for photos 1338483460 and 1338483457 Missing descriptors for photos 1338483457 and 1338484519 Missing descriptors for photos 1338484519 and 1338484335 Missing descriptors for photos 1338484335 and 1338484841 Missing descriptors for photos 1338484841 and 1338484804 Missing descriptors for photos 1338484804 and 1338484802 Missing descriptors for photos 1338484802 and 1338486686 Missing descriptors for photos 1338486686 and 1338486608 0:09:24.999076|OFF:0:00:30.001274|ON:Missing descriptors for photos 1338485851 and 1338485849 0:00:47.999014|OFF:0:05:06.000874|ON:Missing descriptors for photos 1338485943 and 1338486513 Missing descriptors for photos 1338486513 and 1338486510 Missing descriptors for photos 1338486510 and 1338486502 Missing descriptors for photos 1338485987 and 1338485984 Missing descriptors for photos 1338485984 and 1338485982 Missing descriptors for photos 1338485977 and 1338486498 Missing descriptors for photos 1338486498 and 1338486496 Missing descriptors for photos 1338486496 and 1338486015 Missing descriptors for photos 1338486015 and 1338486011 Missing descriptors for photos 1338486011 and 1338486009 Missing descriptors for photos 1338486009 and 1338486007 Missing descriptors for photos 1338486007 and 1338486002 Missing descriptors for photos 1338486002 and 1338485998 Missing descriptors for photos 1338485998 and 1338486490 Missing descriptors for photos 1338486490 and 1338486486 Missing descriptors for photos 1338486486 and 1338486482 Missing descriptors for photos 1338486482 and 1338486477 Missing descriptors for photos 1338486477 and 1338486378 Missing descriptors for photos 1338488985 and 1338486422 Missing descriptors for photos 1338486422 and 1338490325 Missing descriptors for photos 1338490325 and 1338488983 Missing descriptors for photos 1338488983 and 1338490321 0:17:47.999996|OFF:0:00:16.999028|ON:0:00:07.001398|OFF:0:00:11.999530|ON:0:00:54.000057|OFF:0:07:05.999986|ON:Missing descriptors for photos 1338491724 and 1338491721 Missing descriptors for photos 1338491721 and 1338491757 Missing descriptors for photos 1338491757 and 1338491753 Missing descriptors for photos 1338491753 and 1338491751 Missing descriptors for photos 1338491751 and 1338491749 Missing descriptors for photos 1338492418 and 1338492365 Missing descriptors for photos 1338492365 and 1338492359 Missing descriptors for photos 1338492359 and 1338493473 Missing descriptors for photos 1338493473 and 1338493470 Missing descriptors for photos 1338493470 and 1338493466 Missing descriptors for photos 1338493466 and 1338493463 Missing descriptors for photos 1338493463 and 1338493930 Missing descriptors for photos 1338493930 and 1338493509 Missing descriptors for photos 1338493509 and 1338493506 Missing descriptors for photos 1338493506 and 1338493502 Missing descriptors for photos 1338493502 and 1338493499 Missing descriptors for photos 1338493499 and 1338493496 Missing descriptors for photos 1338493496 and 1338493493 Missing descriptors for photos 1338493493 and 1338493925 Missing descriptors for photos 1338493925 and 1338493892 Missing descriptors for photos 1338493892 and 1338493796 Missing descriptors for photos 1338493796 and 1338493730 Missing descriptors for photos 1338493730 and 1338493673 Missing descriptors for photos 1338493673 and 1338494112 Missing descriptors for photos 1338494112 and 1338494087 Missing descriptors for photos 1338494087 and 1338494174 Missing descriptors for photos 1338494174 and 1338493937 Missing descriptors for photos 1338493937 and 1338494171 Missing descriptors for photos 1338494171 and 1338494208 0:14:58.998715|OFF:0:00:07.001742|ON:0:00:00|OFF:0:00:05.998332|ON:0:00:00|OFF:0:00:06.001188|ON:0:00:00|OFF:0:00:04.998793|ON:0:00:00|OFF:0:00:07.001155|ON:0:00:00|OFF:0:00:05.999972|ON:Missing descriptors for photos 1338495962 and 1338495960 Missing descriptors for photos 1338495903 and 1338495736 Missing descriptors for photos 1338495563 and 1338495512 Missing descriptors for photos 1338495512 and 1338495509 Missing descriptors for photos 1338495509 and 1338495473 Missing descriptors for photos 1338495473 and 1338496571 Missing descriptors for photos 1338496571 and 1338496567 Missing descriptors for photos 1338496593 and 1338497349 Missing descriptors for photos 1338497349 and 1338497343 Missing descriptors for photos 1338497343 and 1338496640 Missing descriptors for photos 1338497294 and 1338496678 Missing descriptors for photos 1338496664 and 1338497261 Missing descriptors for photos 1338497128 and 1338497125 Missing descriptors for photos 1338497125 and 1338497121 Missing descriptors for photos 1338497121 and 1338497114 Missing descriptors for photos 1338497114 and 1338497038 Missing descriptors for photos 1338497038 and 1338497252 Missing descriptors for photos 1338497252 and 1338497249 Missing descriptors for photos 1338497249 and 1338497292 Missing descriptors for photos 1338497292 and 1338497289 Missing descriptors for photos 1338497289 and 1338497341 Missing descriptors for photos 1338497341 and 1338497340 Missing descriptors for photos 1338497340 and 1338497339 Missing descriptors for photos 1338497339 and 1338497332 Missing descriptors for photos 1338497332 and 1338497376 Missing descriptors for photos 1338497376 and 1338497375 Missing descriptors for photos 1338497375 and 1338497374 Missing descriptors for photos 1338497374 and 1338497372 Missing descriptors for photos 1338497372 and 1338497399 Missing descriptors for photos 1338497399 and 1338497396 Missing descriptors for photos 1338497396 and 1338497393 Missing descriptors for photos 1338497393 and 1338497390 Missing descriptors for photos 1338497390 and 1338497787 Missing descriptors for photos 1338497787 and 1338498167 Missing descriptors for photos 1338498167 and 1338498258 Missing descriptors for photos 1338498258 and 1338498164 Missing descriptors for photos 1338498164 and 1338498248 Missing descriptors for photos 1338498248 and 1338498246 Missing descriptors for photos 1338498246 and 1338498272 Missing descriptors for photos 1338498272 and 1338498335 Missing descriptors for photos 1338498335 and 1338498318 Missing descriptors for photos 1338498318 and 1338498370 Missing descriptors for photos 1338498370 and 1338499137 Missing descriptors for photos 1338499137 and 1338499133 Missing descriptors for photos 1338499133 and 1338500413 Missing descriptors for photos 1338500413 and 1338500311 Missing descriptors for photos 1338500311 and 1338500211 Missing descriptors for photos 1338500211 and 1338500112 Missing descriptors for photos 1338500112 and 1338500014 Missing descriptors for photos 1338500014 and 1338499916 Missing descriptors for photos 1338499916 and 1338500902 Missing descriptors for photos 1338500902 and 1338500728 Missing descriptors for photos 1338500728 and 1338500550 Missing descriptors for photos 1338500550 and 1338500466 Missing descriptors for photos 1338500466 and 1338501375 Missing descriptors for photos 1338501375 and 1338501326 Missing descriptors for photos 1338501326 and 1338501322 Missing descriptors for photos 1338501322 and 1338501306 Missing descriptors for photos 1338501306 and 1338501194 Missing descriptors for photos 1338501194 and 1338501425 Missing descriptors for photos 1338501425 and 1338501423 Missing descriptors for photos 1338501423 and 1338501421 Missing descriptors for photos 1338501421 and 1338501417 Missing descriptors for photos 1338501417 and 1338501445 Missing descriptors for photos 1338501445 and 1338501442 Missing descriptors for photos 1338501442 and 1338501440 Missing descriptors for photos 1338501440 and 1338501502 Missing descriptors for photos 1338501502 and 1338501500 Missing descriptors for photos 1338501500 and 1338501498 Missing descriptors for photos 1338501498 and 1338501495 0:28:00.000038|OFF:0:00:05.999198|ON:0:00:00|OFF:0:00:06.000209|ON:Missing descriptors for photos 1338501617 and 1338501615 Missing descriptors for photos 1338502131 and 1338502129 Missing descriptors for photos 1338502129 and 1338502126 Missing descriptors for photos 1338502126 and 1338502342 Missing descriptors for photos 1338502342 and 1338502339 Missing descriptors for photos 1338502339 and 1338502336 Missing descriptors for photos 1338502336 and 1338502331 Missing descriptors for photos 1338502331 and 1338502368 Missing descriptors for photos 1338502368 and 1338502369 Missing descriptors for photos 1338502369 and 1338502364 Missing descriptors for photos 1338502364 and 1338502365 Missing descriptors for photos 1338502365 and 1338502410 Missing descriptors for photos 1338502410 and 1338502407 Missing descriptors for photos 1338502407 and 1338502405 Missing descriptors for photos 1338502405 and 1338502402 Missing descriptors for photos 1338502402 and 1338502400 Missing descriptors for photos 1338502400 and 1338502396 Missing descriptors for photos 1338502396 and 1338502425 Missing descriptors for photos 1338502425 and 1338502422 Missing descriptors for photos 1338502422 and 1338502419 Missing descriptors for photos 1338502419 and 1338502451 Missing descriptors for photos 1338502451 and 1338502449 Missing descriptors for photos 1338502449 and 1338502447 Missing descriptors for photos 1338502447 and 1338502466 Missing descriptors for photos 1338502466 and 1338502464 Missing descriptors for photos 1338502464 and 1338503856 Missing descriptors for photos 1338503840 and 1338503880 Missing descriptors for photos 1338503880 and 1338503877 Missing descriptors for photos 1338503877 and 1338503917 Missing descriptors for photos 1338503917 and 1338503913 Missing descriptors for photos 1338503913 and 1338503909 Missing descriptors for photos 1338503909 and 1338503905 Missing descriptors for photos 1338503905 and 1338504120 Missing descriptors for photos 1338504120 and 1338504069 Missing descriptors for photos 1338504069 and 1338504581 Missing descriptors for photos 1338504581 and 1338504625 Missing descriptors for photos 1338504625 and 1338504988 Missing descriptors for photos 1338504988 and 1338505116 Missing descriptors for photos 1338505116 and 1338505018 Missing descriptors for photos 1338505018 and 1338505223 Missing descriptors for photos 1338505223 and 1338505347 Missing descriptors for photos 1338505347 and 1338505306 Missing descriptors for photos 1338505306 and 1338505785 Missing descriptors for photos 1338505785 and 1338505782 Missing descriptors for photos 1338505782 and 1338505774 Missing descriptors for photos 1338505774 and 1338505771 Missing descriptors for photos 1338505771 and 1338505767 Missing descriptors for photos 1338505767 and 1338505765 Missing descriptors for photos 1338505765 and 1338505858 Missing descriptors for photos 1338505858 and 1338505856 Missing descriptors for photos 1338505856 and 1338505834 Missing descriptors for photos 1338505834 and 1338505832 Missing descriptors for photos 1338505832 and 1338505830 Missing descriptors for photos 1338505830 and 1338505827 Missing descriptors for photos 1338505827 and 1338505824 Missing descriptors for photos 1338505824 and 1338505821 Missing descriptors for photos 1338505821 and 1338505854 Missing descriptors for photos 1338505854 and 1338505853 Missing descriptors for photos 1338505853 and 1338505851 Missing descriptors for photos 1338505851 and 1338505850 Missing descriptors for photos 1338505850 and 1338505847 Missing descriptors for photos 1338505847 and 1338505845 Missing descriptors for photos 1338505845 and 1338505843 Missing descriptors for photos 1338505843 and 1338505841 Missing descriptors for photos 1338505841 and 1338505838 Missing descriptors for photos 1338505838 and 1338505836 Missing descriptors for photos 1338505836 and 1338505876 Missing descriptors for photos 1338505876 and 1338505874 Missing descriptors for photos 1338505874 and 1338505872 Missing descriptors for photos 1338505872 and 1338505871 Missing descriptors for photos 1338505871 and 1338505870 Missing descriptors for photos 1338505870 and 1338505869 19022025 Removing 31 photos because of the 'same image' condition Total on : 4320.998294 list_time_on Total off : 840.0012810000001 list_time_off dist_desc begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 421 time used for this insertion : 0.0799710750579834 photos_removed : len 31 elapsed_time : remove_photo_duplicate 0.20038414001464844 Creating list_photo_total XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXWarning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! elapsed_time : count_sum_diff_and_build_graph 0.04798388481140137 Total photos : 421 .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 0 hashtag : 538914404 photo_id =1338486554 : refus ...........Change port : 11 hashtag : 2107760238 photo_id =1338485906 : flux_dev .can't find max_score_info .can't find max_score_info .can't find max_score_info ..Change port : 2 hashtag : 2107760237 photo_id =1338485861 : film_pedb ...can't find max_score_info .can't find max_score_info ...can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .....can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ...can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 12 hashtag : 538914404 photo_id =1338486312 : refus ..can't find max_score_info ...can't find max_score_info ...can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .......can't find max_score_info .....Change port : 16 hashtag : 2107760237 photo_id =1338489096 : film_pedb .....can't find max_score_info .can't find max_score_info ..can't find max_score_info .....can't find max_score_info ...Change port : 12 hashtag : 2107760238 photo_id =1338490244 : flux_dev .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 1 hashtag : 538914404 photo_id =1338491650 : refus .......Change port : 7 hashtag : 2107760237 photo_id =1338491696 : film_pedb ......Change port : 6 hashtag : 538914404 photo_id =1338491703 : refus .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 1 hashtag : 2107760237 photo_id =1338491748 : film_pedb ..can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 2 hashtag : 538914404 photo_id =1338494205 : refus ....can't find max_score_info ..can't find max_score_info ..can't find max_score_info ..can't find max_score_info ..can't find max_score_info ..can't find max_score_info ..can't find max_score_info ..can't find max_score_info .can't find max_score_info ....can't find max_score_info .can't find max_score_info ....can't find max_score_info ..can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ......can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 24 hashtag : 2107760238 photo_id =1338496638 : flux_dev .can't find max_score_info ..Change port : 2 hashtag : 538914404 photo_id =1338496629 : refus .can't find max_score_info ....can't find max_score_info .can't find max_score_info ..Change port : 5 hashtag : 2107760237 photo_id =1338496674 : film_pedb .can't find max_score_info ..can't find max_score_info .can't find max_score_info ...can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ....can't find max_score_info ..can't find max_score_info .can't find max_score_info .Change port : 9 hashtag : 538914404 photo_id =1338501702 : refus ..can't find max_score_info .................Change port : 18 hashtag : 2107760237 photo_id =1338501581 : film_pedb .....Change port : 5 hashtag : 538914404 photo_id =1338501629 : refus .Change port : 1 hashtag : 2107760237 photo_id =1338501626 : film_pedb ...can't find max_score_info .can't find max_score_info ..Change port : 4 hashtag : 538914404 photo_id =1338501699 : refus .can't find max_score_info ........can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ...can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info Total photos : 421 Number of lists : 20 counter photos in port : 148 hashtag : aluminium(493546845) : 0 photos in 0 portfolios ! hashtag : ela(492741797) : 0 photos in 0 portfolios ! hashtag : emr(616987804) : 0 photos in 0 portfolios ! hashtag : film_pedb(2107760237) : 50 photos in 7 portfolios ! hashtag : flux_dev(2107760238) : 5 photos in 3 portfolios ! hashtag : jrm(495916461) : 0 photos in 0 portfolios ! hashtag : pcm(560181804) : 0 photos in 0 portfolios ! hashtag : pcnc(1284539308) : 0 photos in 0 portfolios ! hashtag : pehd_pp(2107760239) : 0 photos in 0 portfolios ! hashtag : pet_clair(2107755846) : 0 photos in 0 portfolios ! hashtag : refus(538914404) : 93 photos in 9 portfolios ! hashtag : tapis_vide(2107748999) : 0 photos in 1 portfolios ! elapsed_time : group_photo_by_moyenne_exp 0.01202392578125 elapsed_time : compute_and_correct_tag_with_moyenne_mobile 2.384185791015625e-06 today str has not a value , we define it as the date of the first image todaystr_first : 19022025 attention , prev_timestamp is 0 , we do nothing ****** BIG TIME 150.0004858970642 (112.99903607368469, 3, 0, 0, 0, 0.64024585, 0, 0, 0, 0, 0, 0, 0, 0, 0.06370006830692292, 0.004, 0.0029999429941177367, 2.9, 0.012000491142272949, -0.01166953166325887) on 18 1338485798 2025-02-19 07:15:59.006506 id_data : 49 ** BIG TIME 528.0003170967102 (320.9973783493042, 10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0.22012718, 0, 0.13210003390312194, 0.0085, 0.019199849891662596, 1.9, 0.03000043606758118, -0.06000023325284322) on 30 1338490325 2025-02-19 07:31:11.006917 id_data : 87 ***** BIG TIME 228.0005099773407 (472.9992501735687, 4, 0, 0, 0, 0, 0.5079573, 0, 0, 0, 0, 0, 0, 0, 0.20950002660751343, 0.0118, 0.02099986546039581, 3.9, 0.013001288175582887, -0.010000180006027221) on 53 1338491686 2025-02-19 07:42:11.005795 id_data : 125 ***** BIG TIME 160.99910616874695 (642.0012631416321, 10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0.38544685, 0, 0.2797000179052353, 0.0148, 0.040799740552902225, 1.9, 0.0060000171661376955, -0.0) on 69 1338494205 2025-02-19 07:56:52.005247 id_data : 173 oooooo** BIG TIME 175.0012390613556 (781.0015170574188, 10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0.4061672, 0, 0.35879989590644834, 0.0205, 0.040799740552902225, 1.9, 0.08899900388717652, -0.19833138187726337) on 87 1338496567 2025-02-19 08:03:47.006552 id_data : 210 *************oo**o*o***** BIG TIME 258.0002279281616 (1169.9971537590027, 10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0.43902308, 0, 0.5466999127864838, 0.0346, 0.040799740552902225, 1.9, 0.023998989820480345, -0.03166698654492696) on 144 1338503848 2025-02-19 08:42:17.006697 id_data : 372 ** BIG TIME 220.9997420310974 (1174.9962077140808, 10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0.45308653, 0, 0.6131999026060104, 0.0374, 0.040799740552902225, 1.9, 0.02899758696556091, -0.14000015020370493) on 145 1338504625 2025-02-19 08:48:52.005372 id_data : 384 *** BIG TIME 173.99998307228088 (1174.9962077140808, 10, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0.45308653, 0, 0.6131999026060104, 0.0374, 0.040799740552902225, 1.9, 0.02899758696556091, -0.14000015020370493) on 145 1338505223 2025-02-19 08:55:53.006601 id_data : 388 Unexpected type of data : ({'photo_id': 1338505347, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/780548dd98d234c0ec5c42a4ec94dcaa.jpg', 'username': None, 'uploaded_at': 1739952145, 'text': 'image_19022025_08_59_11_6907.jpg', 'time': 1739955551.006907}, 'different') Unexpected type of data : ({'photo_id': 1338505306, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/925d7fbdd2c967921368a596fcf1e59d.jpg', 'username': None, 'uploaded_at': 1739952145, 'text': 'image_19022025_09_01_40_5351.jpg', 'time': 1739955700.005351}, 'different') Unexpected type of data : ({'photo_id': 1338505785, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/ebb483e5321a973d24be986a111c70b5.jpg', 'username': None, 'uploaded_at': 1739952206, 'text': 'image_19022025_09_02_17_6758.jpg', 'time': 1739955737.006758}, 'different') Unexpected type of data : ({'photo_id': 1338505782, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/fce1142ea70b9b21ceb89790646a503a.jpg', 'username': None, 'uploaded_at': 1739952206, 'text': 'image_19022025_09_02_28_6033.jpg', 'time': 1739955748.006033}, 'different') Unexpected type of data : ({'photo_id': 1338505774, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/3c2e7874f3646b62e219cb67d13d26ef.jpg', 'username': None, 'uploaded_at': 1739952206, 'text': 'image_19022025_09_02_35_6457.jpg', 'time': 1739955755.006457}, 'different') Unexpected type of data : ({'photo_id': 1338505771, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/91959fd154641730e37d834eb0278a7f.jpg', 'username': None, 'uploaded_at': 1739952206, 'text': 'image_19022025_09_02_41_6483.jpg', 'time': 1739955761.006483}, 'different') Unexpected type of data : ({'photo_id': 1338505767, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/620460ace4d1580f4256303f2919f512.jpg', 'username': None, 'uploaded_at': 1739952206, 'text': 'image_19022025_09_02_47_5273.jpg', 'time': 1739955767.005273}, 'different') Unexpected type of data : ({'photo_id': 1338505765, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/a359b4b31a85627bfa033a63d8986c21.jpg', 'username': None, 'uploaded_at': 1739952206, 'text': 'image_19022025_09_02_53_6462.jpg', 'time': 1739955773.006462}, 'different') Unexpected type of data : ({'photo_id': 1338505858, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/a09bc375fbba35567b6bec421676c6ce.jpg', 'username': None, 'uploaded_at': 1739952367, 'text': 'image_19022025_09_03_10_5364.jpg', 'time': 1739955790.005364}, 'different') Unexpected type of data : ({'photo_id': 1338505856, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/e935ba1df2050917531ed118b437a928.jpg', 'username': None, 'uploaded_at': 1739952367, 'text': 'image_19022025_09_03_17_6419.jpg', 'time': 1739955797.006419}, 'different') Unexpected type of data : ({'photo_id': 1338505834, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/545a90afee6a85b5572ea1b7505aa7ad.jpg', 'username': None, 'uploaded_at': 1739952266, 'text': 'image_19022025_09_03_23_6428.jpg', 'time': 1739955803.006428}, 'different') Unexpected type of data : ({'photo_id': 1338505832, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/2f235bc4c74af700a7c7cd71d710d06a.jpg', 'username': None, 'uploaded_at': 1739952266, 'text': 'image_19022025_09_03_28_5152.jpg', 'time': 1739955808.005152}, 'different') Unexpected type of data : ({'photo_id': 1338505830, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/b25f4cfce90e47c2accdd3ab933b74f1.jpg', 'username': None, 'uploaded_at': 1739952266, 'text': 'image_19022025_09_03_35_6405.jpg', 'time': 1739955815.006405}, 'different') Unexpected type of data : ({'photo_id': 1338505827, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/5e9d2f1c9a00a51d2482bd84ed178152.jpg', 'username': None, 'uploaded_at': 1739952266, 'text': 'image_19022025_09_03_41_6381.jpg', 'time': 1739955821.006381}, 'different') Unexpected type of data : ({'photo_id': 1338505824, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/8fe4ecc847a9b4db8b2ea93f1d525c87.jpg', 'username': None, 'uploaded_at': 1739952266, 'text': 'image_19022025_09_03_46_5191.jpg', 'time': 1739955826.005191}, 'different') Unexpected type of data : ({'photo_id': 1338505821, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/c734bf734e40d42d11bb315dd014d2b9.jpg', 'username': None, 'uploaded_at': 1739952266, 'text': 'image_19022025_09_03_53_6391.jpg', 'time': 1739955833.006391}, 'different') Unexpected type of data : ({'photo_id': 1338505854, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/94219532792d6386cc356a7849ece35a.jpg', 'username': None, 'uploaded_at': 1739952367, 'text': 'image_19022025_09_03_59_6411.jpg', 'time': 1739955839.006411}, 'different') Unexpected type of data : ({'photo_id': 1338505853, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/3208c1a6021d29b60e15da7ac29576d5.jpg', 'username': None, 'uploaded_at': 1739952367, 'text': 'image_19022025_09_04_05_5605.jpg', 'time': 1739955845.005605}, 'different') Unexpected type of data : ({'photo_id': 1338505851, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/9adc514376473eefcaa3714651a8f08b.jpg', 'username': None, 'uploaded_at': 1739952367, 'text': 'image_19022025_09_04_10_5663.jpg', 'time': 1739955850.005663}, 'different') Unexpected type of data : ({'photo_id': 1338505850, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/81fd6354e049f98639be8bb06f2341fb.jpg', 'username': None, 'uploaded_at': 1739952367, 'text': 'image_19022025_09_04_17_6592.jpg', 'time': 1739955857.006592}, 'different') Unexpected type of data : ({'photo_id': 1338505847, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/5c25023c1e3f70f4a8c8b4f1a85f94c7.jpg', 'username': None, 'uploaded_at': 1739952327, 'text': 'image_19022025_09_04_24_6422.jpg', 'time': 1739955864.006422}, 'different') Unexpected type of data : ({'photo_id': 1338505845, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/0f9ff644b408f7695615cf72af669f8b.jpg', 'username': None, 'uploaded_at': 1739952327, 'text': 'image_19022025_09_04_28_5106.jpg', 'time': 1739955868.005106}, 'different') Unexpected type of data : ({'photo_id': 1338505843, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/09869252ca812e623fefd4b3751a83db.jpg', 'username': None, 'uploaded_at': 1739952327, 'text': 'image_19022025_09_04_35_6413.jpg', 'time': 1739955875.006413}, 'different') Unexpected type of data : ({'photo_id': 1338505841, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/e832de8760487d39c53dfe506c14f9f3.jpg', 'username': None, 'uploaded_at': 1739952327, 'text': 'image_19022025_09_04_41_6219.jpg', 'time': 1739955881.006219}, 'different') Unexpected type of data : ({'photo_id': 1338505838, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/b18144973306679a254685067a9b88e8.jpg', 'username': None, 'uploaded_at': 1739952327, 'text': 'image_19022025_09_04_46_5206.jpg', 'time': 1739955886.005206}, 'different') Unexpected type of data : ({'photo_id': 1338505836, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/0da50ba6ca6f7b249ba2794013c663c5.jpg', 'username': None, 'uploaded_at': 1739952327, 'text': 'image_19022025_09_04_53_6420.jpg', 'time': 1739955893.00642}, 'different') Unexpected type of data : ({'photo_id': 1338505876, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/d00a2b25649620607b6af4c5b83d8a3a.jpg', 'username': None, 'uploaded_at': 1739952427, 'text': 'image_19022025_09_05_23_6446.jpg', 'time': 1739955923.006446}, 'different') Unexpected type of data : ({'photo_id': 1338505874, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/83beca2b3a654fd0a6ae36f2beb91f5c.jpg', 'username': None, 'uploaded_at': 1739952427, 'text': 'image_19022025_09_05_29_6419.jpg', 'time': 1739955929.006419}, 'different') Unexpected type of data : ({'photo_id': 1338505872, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/f0a8eb422c79e692127c65874e986487.jpg', 'username': None, 'uploaded_at': 1739952427, 'text': 'image_19022025_09_05_35_6207.jpg', 'time': 1739955935.006207}, 'different') Unexpected type of data : ({'photo_id': 1338505871, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/0370855f72d8bda0a6b09cb6623ae941.jpg', 'username': None, 'uploaded_at': 1739952427, 'text': 'image_19022025_09_05_40_5193.jpg', 'time': 1739955940.005193}, 'different') Unexpected type of data : ({'photo_id': 1338505870, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/f1957857231588cfea737788738cbfb8.jpg', 'username': None, 'uploaded_at': 1739952427, 'text': 'image_19022025_09_05_47_6428.jpg', 'time': 1739955947.006428}, 'different') Unexpected type of data : ({'photo_id': 1338505869, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2025/2/19/d5a0aee5c14440fe962ad8b3ef4f3c10.jpg', 'username': None, 'uploaded_at': 1739952427, 'text': 'image_19022025_09_05_53_6421.jpg', 'time': 1739955953.006421}, 'different') Count Time bigger than 30s : 46 #Number Photos for regression : {'19022025': {493546845: {2107751013: 0, 2107751014: 0, 2107751015: 29.999614000320435, 2107751016: 0, 2107751017: 0}, 492741797: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 616987804: {2107751013: 0, 2107751014: 0, 2107751015: 29.99754023551941, 2107751016: 7.001384019851685, 2107751017: 0}, 2107760237: {2107751013: 0, 2107751014: 7.001180171966553, 2107751015: 140.00552558898926, 2107751016: 90.9989664554596, 2107751017: 0}, 2107760238: {2107751013: 0, 2107751014: 9.997450828552246, 2107751015: 41.999444007873535, 2107751016: 149.9990692138672, 2107751017: 6.000108003616333}, 495916461: {2107751013: 0, 2107751014: 0, 2107751015: 16.99906587600708, 2107751016: 14.996363878250122, 2107751017: 0}, 560181804: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 1284539308: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107760239: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107755846: {2107751013: 0, 2107751014: 0, 2107751015: 7.000874996185303, 2107751016: 0, 2107751017: 0}, 538914404: {2107751013: 0, 2107751014: 0, 2107751015: 582.9960527420044, 2107751016: 45.00216484069824, 2107751017: 0}, 2107748999: {2107751013: 0, 2107751014: 0, 2107751015: 3268.0062594413757, 2107751016: 0, 2107751017: 0}}} 19022025|aluminium, 05102018_papier_non_papier_dense:0 19022025|aluminium, 05102018_papier_non_papier_peu_dense:0 19022025|aluminium, 05102018_papier_non_papier_presque_vide:29.999614000320435 19022025|aluminium, 05102018_papier_non_papier_tres_dense:0 19022025|aluminium, 05102018_papier_non_papier_tres_peu_dense:0 19022025|ela, 05102018_papier_non_papier_dense:0 19022025|ela, 05102018_papier_non_papier_peu_dense:0 19022025|ela, 05102018_papier_non_papier_presque_vide:0 19022025|ela, 05102018_papier_non_papier_tres_dense:0 19022025|ela, 05102018_papier_non_papier_tres_peu_dense:0 19022025|emr, 05102018_papier_non_papier_dense:0 19022025|emr, 05102018_papier_non_papier_peu_dense:0 19022025|emr, 05102018_papier_non_papier_presque_vide:29.99754023551941 19022025|emr, 05102018_papier_non_papier_tres_dense:7.001384019851685 19022025|emr, 05102018_papier_non_papier_tres_peu_dense:0 19022025|film_pedb, 05102018_papier_non_papier_dense:0 19022025|film_pedb, 05102018_papier_non_papier_peu_dense:7.001180171966553 19022025|film_pedb, 05102018_papier_non_papier_presque_vide:140.00552558898926 19022025|film_pedb, 05102018_papier_non_papier_tres_dense:90.9989664554596 19022025|film_pedb, 05102018_papier_non_papier_tres_peu_dense:0 19022025|flux_dev, 05102018_papier_non_papier_dense:0 19022025|flux_dev, 05102018_papier_non_papier_peu_dense:9.997450828552246 19022025|flux_dev, 05102018_papier_non_papier_presque_vide:41.999444007873535 19022025|flux_dev, 05102018_papier_non_papier_tres_dense:149.9990692138672 19022025|flux_dev, 05102018_papier_non_papier_tres_peu_dense:6.000108003616333 19022025|jrm, 05102018_papier_non_papier_dense:0 19022025|jrm, 05102018_papier_non_papier_peu_dense:0 19022025|jrm, 05102018_papier_non_papier_presque_vide:16.99906587600708 19022025|jrm, 05102018_papier_non_papier_tres_dense:14.996363878250122 19022025|jrm, 05102018_papier_non_papier_tres_peu_dense:0 19022025|pcm, 05102018_papier_non_papier_dense:0 19022025|pcm, 05102018_papier_non_papier_peu_dense:0 19022025|pcm, 05102018_papier_non_papier_presque_vide:0 19022025|pcm, 05102018_papier_non_papier_tres_dense:0 19022025|pcm, 05102018_papier_non_papier_tres_peu_dense:0 19022025|pcnc, 05102018_papier_non_papier_dense:0 19022025|pcnc, 05102018_papier_non_papier_peu_dense:0 19022025|pcnc, 05102018_papier_non_papier_presque_vide:0 19022025|pcnc, 05102018_papier_non_papier_tres_dense:0 19022025|pcnc, 05102018_papier_non_papier_tres_peu_dense:0 19022025|pehd_pp, 05102018_papier_non_papier_dense:0 19022025|pehd_pp, 05102018_papier_non_papier_peu_dense:0 19022025|pehd_pp, 05102018_papier_non_papier_presque_vide:0 19022025|pehd_pp, 05102018_papier_non_papier_tres_dense:0 19022025|pehd_pp, 05102018_papier_non_papier_tres_peu_dense:0 19022025|pet_clair, 05102018_papier_non_papier_dense:0 19022025|pet_clair, 05102018_papier_non_papier_peu_dense:0 19022025|pet_clair, 05102018_papier_non_papier_presque_vide:7.000874996185303 19022025|pet_clair, 05102018_papier_non_papier_tres_dense:0 19022025|pet_clair, 05102018_papier_non_papier_tres_peu_dense:0 19022025|refus, 05102018_papier_non_papier_dense:0 19022025|refus, 05102018_papier_non_papier_peu_dense:0 19022025|refus, 05102018_papier_non_papier_presque_vide:582.9960527420044 19022025|refus, 05102018_papier_non_papier_tres_dense:45.00216484069824 19022025|refus, 05102018_papier_non_papier_tres_peu_dense:0 19022025|tapis_vide, 05102018_papier_non_papier_dense:0 19022025|tapis_vide, 05102018_papier_non_papier_peu_dense:0 19022025|tapis_vide, 05102018_papier_non_papier_presque_vide:3268.0062594413757 19022025|tapis_vide, 05102018_papier_non_papier_tres_dense:0 19022025|tapis_vide, 05102018_papier_non_papier_tres_peu_dense:0 #Number Photos for regression amount gros magasin papier (time_diff then nb_photo) : We have not displayed the number of photos removed for one material since Rungis_Papier wasn't in the thcl used ! 19022025_time_diff_distrib Number amount portfolio for this type of dechet : aluminium 5 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=19022025_aluminium_05102018_papier_non_papier_presque_vide&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 20669324 with name like 19022025_aluminium_05102018_papier_non_papier_presque_vide Number amount portfolio for this type of dechet : ela 0 Number amount portfolio for this type of dechet : emr 5 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=19022025_emr_05102018_papier_non_papier_presque_vide&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 20669325 with name like 19022025_emr_05102018_papier_non_papier_presque_vide https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=19022025_emr_05102018_papier_non_papier_tres_dense&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 20669326 with name like 19022025_emr_05102018_papier_non_papier_tres_dense Number amount portfolio for this type of dechet : film_pedb 37 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=19022025_film_pedb_05102018_papier_non_papier_peu_dense&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 20669327 with name like 19022025_film_pedb_05102018_papier_non_papier_peu_dense https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=19022025_film_pedb_05102018_papier_non_papier_presque_vide&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 20669328 with name like 19022025_film_pedb_05102018_papier_non_papier_presque_vide https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=19022025_film_pedb_05102018_papier_non_papier_tres_dense&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 20669329 with name like 19022025_film_pedb_05102018_papier_non_papier_tres_dense Number amount portfolio for this type of dechet : flux_dev 11 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=19022025_flux_dev_05102018_papier_non_papier_peu_dense&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 20669330 with name like 19022025_flux_dev_05102018_papier_non_papier_peu_dense https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=19022025_flux_dev_05102018_papier_non_papier_presque_vide&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 20669331 with name like 19022025_flux_dev_05102018_papier_non_papier_presque_vide https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=19022025_flux_dev_05102018_papier_non_papier_tres_dense&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 20669332 with name like 19022025_flux_dev_05102018_papier_non_papier_tres_dense https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=19022025_flux_dev_05102018_papier_non_papier_tres_peu_dense&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 20669333 with name like 19022025_flux_dev_05102018_papier_non_papier_tres_peu_dense Number amount portfolio for this type of dechet : jrm 6 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=19022025_jrm_05102018_papier_non_papier_presque_vide&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 20669334 with name like 19022025_jrm_05102018_papier_non_papier_presque_vide https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=19022025_jrm_05102018_papier_non_papier_tres_dense&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 20669335 with name like 19022025_jrm_05102018_papier_non_papier_tres_dense Number amount portfolio for this type of dechet : pcm 0 Number amount portfolio for this type of dechet : pcnc 0 Number amount portfolio for this type of dechet : pehd_pp 0 Number amount portfolio for this type of dechet : pet_clair 1 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=19022025_pet_clair_05102018_papier_non_papier_presque_vide&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 20669336 with name like 19022025_pet_clair_05102018_papier_non_papier_presque_vide Number amount portfolio for this type of dechet : refus 80 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=19022025_refus_05102018_papier_non_papier_presque_vide&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 20669337 with name like 19022025_refus_05102018_papier_non_papier_presque_vide https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=19022025_refus_05102018_papier_non_papier_tres_dense&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 20669338 with name like 19022025_refus_05102018_papier_non_papier_tres_dense Number amount portfolio for this type of dechet : tapis_vide 204 https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=19022025_tapis_vide_05102018_papier_non_papier_presque_vide&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 Created to study and clean : 20669339 with name like 19022025_tapis_vide_05102018_papier_non_papier_presque_vide begin to remove the low_density images haven't found thcl_volume NUMBER BATCH : 20 list_ponderation used : [0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001] , list_hashtag_class_create_as_list : ['emr', 'pcm', 'pcnc', 'jrm', 'ela', 'pet_clair', 'film_pedb', 'pehd_pp', 'flux_dev', 'aluminium', 'tapis_vide', 'refus'] We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_refus:{'day': '19022025', 'map_nb_amount': {0: 0, 1: 10, 2: 1, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 65.99981689453125, 2: 7.001155138015747, 3: 0, 4: 0}, 'duration': 61.00120306015015, 'nb_balles_papier': 0.07300097203254699, 'begin_time_port': 'image_19022025_07_08_16_5260.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.07300097203254699 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_film_pedb:{'day': '19022025', 'map_nb_amount': {0: 0, 1: 7, 2: 5, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 38.99733018875122, 2: 163.00039505958557, 3: 0, 4: 0}, 'duration': 576.0010859966278, 'nb_balles_papier': 0.20299772524833679, 'begin_time_port': 'image_19022025_07_10_11_5381.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.20299772524833679 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_refus:{'day': '19022025', 'map_nb_amount': {0: 0, 1: 15, 2: 1, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 90.00114917755127, 2: 5.999086141586304, 3: 0, 4: 0}, 'duration': 703.001434803009, 'nb_balles_papier': 0.09600023531913755, 'begin_time_port': 'image_19022025_07_21_28_5237.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.09600023531913755 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_film_pedb:{'day': '19022025', 'map_nb_amount': {0: 0, 1: 5, 2: 7, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 32.00242018699646, 2: 51.997172355651855, 3: 0, 4: 0}, 'duration': 103.00118899345398, 'nb_balles_papier': 0.08399959254264831, 'begin_time_port': 'image_19022025_07_33_16_5237.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.08399959254264831 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_refus:{'day': '19022025', 'map_nb_amount': {0: 0, 1: 22, 2: 2, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 174.99917006492615, 2: 10.998764753341675, 3: 0, 4: 0}, 'duration': 457.00018978118896, 'nb_balles_papier': 0.18699793481826782, 'begin_time_port': 'image_19022025_07_56_52_5247.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.18699793481826782 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_film_pedb:{'day': '19022025', 'map_nb_amount': {0: 1, 1: 6, 2: 2, 3: 0, 4: 0}, 'map_time_amount': {0: 7.001180171966553, 1: 34.99828481674194, 2: 11.999186992645264, 3: 0, 4: 0}, 'duration': 1169.9997310638428, 'nb_balles_papier': 0.05399865198135376, 'begin_time_port': 'image_19022025_08_06_35_5903.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.05399865198135376 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_refus:{'day': '19022025', 'map_nb_amount': {0: 0, 1: 18, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 138.9997751712799, 2: 0, 3: 0, 4: 0}, 'duration': 137.999272108078, 'nb_balles_papier': 0.13899977517127993, 'begin_time_port': 'image_19022025_08_26_17_6717.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.13899977517127993 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_refus:{'day': '19022025', 'map_nb_amount': {0: 0, 1: 10, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 51.9957058429718, 2: 0, 3: 0, 4: 0}, 'duration': 750.0001151561737, 'nb_balles_papier': 0.05299570584297181, 'begin_time_port': 'image_19022025_08_29_52_5179.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.05299570584297181 We have rejected 36 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 8 list_same_port_ids : [] https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=refus_diff_batch__19022025_07_08_16_005260&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 list_same_port_ids : [] https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=film_pedb_diff_batch__19022025_07_10_11_005381&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 list_same_port_ids : [] https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=refus_diff_batch__19022025_07_21_28_005237&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 list_same_port_ids : [] https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=film_pedb_diff_batch__19022025_07_33_16_005237&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 list_same_port_ids : [] https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=refus_diff_batch__19022025_07_56_52_005247&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 list_same_port_ids : [] https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=film_pedb_diff_batch__19022025_08_06_35_005903&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 list_same_port_ids : [] https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=refus_diff_batch__19022025_08_26_17_006717&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 list_same_port_ids : [] https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=refus_diff_batch__19022025_08_29_52_005179&access_token=0fc1cdda0f63f39f777d9cb33b1aa204 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20669340 AND mptpi.`type`=3594 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20669341 AND mptpi.`type`=4461 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20669342 AND mptpi.`type`=3594 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20669343 AND mptpi.`type`=4461 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20669344 AND mptpi.`type`=3594 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20669345 AND mptpi.`type`=4461 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20669346 AND mptpi.`type`=3594 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20669347 AND mptpi.`type`=3594 To do elapsed_time : count_nb_balles_and_create_portfolio 26.86117696762085 # DISPLAY ALL COLLECTED DATA : {'19022025': {'nb_upload': 421, 'nb_taggue_class': 389, 'nb_taggue_densite': 389, 'nb_descriptors': 179, 'number_port': 20, 'count_photo_in_port': 148, 'nb_port_per_class': {'aluminium': {'nb_photos': 0, 'nb_portfolios': 0}, 'ela': {'nb_photos': 0, 'nb_portfolios': 0}, 'emr': {'nb_photos': 0, 'nb_portfolios': 0}, 'film_pedb': {'nb_photos': 50, 'nb_portfolios': 7}, 'flux_dev': {'nb_photos': 5, 'nb_portfolios': 3}, 'jrm': {'nb_photos': 0, 'nb_portfolios': 0}, 'pcm': {'nb_photos': 0, 'nb_portfolios': 0}, 'pcnc': {'nb_photos': 0, 'nb_portfolios': 0}, 'pehd_pp': {'nb_photos': 0, 'nb_portfolios': 0}, 'pet_clair': {'nb_photos': 0, 'nb_portfolios': 0}, 'refus': {'nb_photos': 93, 'nb_portfolios': 9}, 'tapis_vide': {'nb_photos': 0, 'nb_portfolios': 1}}}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1338505876, 1338505874, 1338505872, 1338505871, 1338505870, 1338505869, 1338505858, 1338505856, 1338505854, 1338505853, 1338505851, 1338505850, 1338505847, 1338505845, 1338505843, 1338505841, 1338505838, 1338505836, 1338505834, 1338505832] Looping around the photos to save general results len do output : 1 /20665102Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4887', None, None, None, None, None, None, None, '2598873') ('4887', '20665102', '1338505876', None, None, None, None, None, '2598873') ('4887', None, None, None, None, None, None, None, '2598873') ('4887', '20665102', '1338505874', None, None, None, None, None, '2598873') ('4887', None, None, None, None, None, None, None, '2598873') ('4887', '20665102', '1338505872', None, None, None, None, None, '2598873') ('4887', None, None, None, None, None, None, None, '2598873') ('4887', '20665102', '1338505871', None, None, None, None, None, '2598873') ('4887', None, None, None, None, None, None, None, '2598873') ('4887', '20665102', '1338505870', None, None, None, None, None, '2598873') ('4887', None, None, None, None, None, None, None, '2598873') ('4887', '20665102', '1338505869', None, None, None, None, None, '2598873') ('4887', None, None, None, None, None, None, None, '2598873') ('4887', '20665102', '1338505858', None, None, None, None, None, '2598873') ('4887', None, None, None, None, None, None, None, '2598873') ('4887', '20665102', '1338505856', None, None, None, None, None, '2598873') ('4887', None, None, None, None, None, None, None, '2598873') ('4887', '20665102', '1338505854', None, None, None, None, None, '2598873') ('4887', None, None, None, None, None, None, None, '2598873') ('4887', '20665102', '1338505853', None, None, None, None, None, '2598873') ('4887', None, None, None, None, None, None, None, '2598873') ('4887', '20665102', '1338505851', None, None, None, None, None, '2598873') ('4887', None, None, None, None, None, None, None, '2598873') ('4887', '20665102', '1338505850', None, None, None, None, None, '2598873') ('4887', None, None, None, None, None, None, None, '2598873') ('4887', '20665102', '1338505847', None, None, None, None, None, '2598873') ('4887', None, None, None, None, None, None, None, '2598873') ('4887', '20665102', '1338505845', None, None, None, None, None, '2598873') ('4887', None, None, None, None, None, None, None, '2598873') ('4887', '20665102', '1338505843', None, None, None, None, None, '2598873') ('4887', None, None, None, None, None, None, None, '2598873') ('4887', '20665102', '1338505841', None, None, None, None, None, '2598873') ('4887', None, None, None, None, None, None, None, '2598873') ('4887', '20665102', '1338505838', None, None, None, None, None, '2598873') ('4887', None, None, None, None, None, None, None, '2598873') ('4887', '20665102', '1338505836', None, None, None, None, None, '2598873') ('4887', None, None, None, None, None, None, None, '2598873') ('4887', '20665102', '1338505834', None, None, None, None, None, '2598873') ('4887', None, None, None, None, None, None, None, '2598873') ('4887', '20665102', '1338505832', None, None, None, None, None, '2598873') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.015287399291992188 save_final save missing photos in datou_result : time spend for datou_step_exec : 35.962416648864746 time spend to save output : 0.015603780746459961 total time spend for step 1 : 35.978020429611206 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 2.12user 1.30system 0:38.60elapsed 8%CPU (0avgtext+0avgdata 103352maxresident)k 1528inputs+1736outputs (10major+49650minor)pagefaults 0swaps