elapsed_time : fill_and_build_computed_from_old_data 0.06157422065734863 elapsed_time : insert_dashboard_record_day_entry 0.022154569625854492 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL Creating list_photo_by_hashtags Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None elapsed_time : list_photo_by_hashtags 0.039556026458740234 Creating list_photo_total elapsed_time : select_descriptors 35.35357093811035 04042025 22064633 Nombre de photos avec descriptors (type 5680) : 347 / 359 (96%) ERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 0 vs 1280 photo_id : 1350018596 photo_id_prec : 0 0:00:00|ON:LL0:04:59.990452|OFF:LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL0:10:59.275735|ON:LLL0:29:59.789471|OFF:LLLLLLLLLL0:01:00.821364|ON:LL0:03:59.201814|OFF:0:00:00|ON:LMissing descriptors for photos 1350032529 and 1350032627 LMissing descriptors for photos 1350032627 and 1350032690 LMissing descriptors for photos 1350032690 and 1350033088 LMissing descriptors for photos 1350033088 and 1350033163 LMissing descriptors for photos 1350033163 and 1350033192 LMissing descriptors for photos 1350033192 and 1350033299 LMissing descriptors for photos 1350033299 and 1350033425 LLMissing descriptors for photos 1350033881 and 1350034193 LLLL0:08:00.189707|OFF:L3:00:59.945580|ON:Missing descriptors for photos 1350091701 and 1350091778 LMissing descriptors for photos 1350091778 and 1350091839 LMissing descriptors for photos 1350091839 and 1350091879 LMissing descriptors for photos 1350091879 and 1350091895 LMissing descriptors for photos 1350091895 and 1350092111 LMissing descriptors for photos 1350092111 and 1350092166 LMissing descriptors for photos 1350092166 and 1350092208 LMissing descriptors for photos 1350092208 and 1350092269 LMissing descriptors for photos 1350092269 and 1350092292 LMissing descriptors for photos 1350092292 and 1350092317 LMissing descriptors for photos 1350092317 and 1350092624 LMissing descriptors for photos 1350092624 and 1350092658 LMissing descriptors for photos 1350092658 and 1350092708 LMissing descriptors for photos 1350092708 and 1350092751 LMissing descriptors for photos 1350092751 and 1350092882 LMissing descriptors for photos 1350092882 and 1350093016 LMissing descriptors for photos 1350093016 and 1350093280 LMissing descriptors for photos 1350093280 and 1350093320 LMissing descriptors for photos 1350093320 and 1350093373 LMissing descriptors for photos 1350093373 and 1350093403 LMissing descriptors for photos 1350093403 and 1350093440 LMissing descriptors for photos 1350093440 and 1350093488 LMissing descriptors for photos 1350093488 and 1350093734 LMissing descriptors for photos 1350093734 and 1350093778 LMissing descriptors for photos 1350093778 and 1350093805 LMissing descriptors for photos 1350093805 and 1350093834 LMissing descriptors for photos 1350093834 and 1350093872 LMissing descriptors for photos 1350093872 and 1350093899 LMissing descriptors for photos 1350093899 and 1350093978 LMissing descriptors for photos 1350093978 and 1350094041 LMissing descriptors for photos 1350094041 and 1350094045 LMissing descriptors for photos 1350094045 and 1350094086 LMissing descriptors for photos 1350094086 and 1350094096 LMissing descriptors for photos 1350094096 and 1350094104 LMissing descriptors for photos 1350094104 and 1350094267 LMissing descriptors for photos 1350094267 and 1350094320 LMissing descriptors for photos 1350094320 and 1350094392 LMissing descriptors for photos 1350094392 and 1350094495 LMissing descriptors for photos 1350094495 and 1350094563 LMissing descriptors for photos 1350094563 and 1350094622 LMissing descriptors for photos 1350094622 and 1350094816 LMissing descriptors for photos 1350094816 and 1350094866 LMissing descriptors for photos 1350094866 and 1350094874 LMissing descriptors for photos 1350094874 and 1350094917 LMissing descriptors for photos 1350094917 and 1350094933 LMissing descriptors for photos 1350094933 and 1350094947 LMissing descriptors for photos 1350094947 and 1350095161 LMissing descriptors for photos 1350095161 and 1350095181 LMissing descriptors for photos 1350095181 and 1350095196 LMissing descriptors for photos 1350095196 and 1350095206 LMissing descriptors for photos 1350095206 and 1350095242 LMissing descriptors for photos 1350095242 and 1350095273 LMissing descriptors for photos 1350095273 and 1350095316 LMissing descriptors for photos 1350095316 and 1350095324 LMissing descriptors for photos 1350095324 and 1350095335 LMissing descriptors for photos 1350095335 and 1350095341 LMissing descriptors for photos 1350095341 and 1350095354 LMissing descriptors for photos 1350095354 and 1350095364 LMissing descriptors for photos 1350095364 and 1350095472 LMissing descriptors for photos 1350095472 and 1350095522 LMissing descriptors for photos 1350095522 and 1350095527 LMissing descriptors for photos 1350095527 and 1350095537 LMissing descriptors for photos 1350095537 and 1350095543 LMissing descriptors for photos 1350095543 and 1350095577 LMissing descriptors for photos 1350095577 and 1350095620 LMissing descriptors for photos 1350095620 and 1350095691 LMissing descriptors for photos 1350095691 and 1350095815 LMissing descriptors for photos 1350095815 and 1350095874 LMissing descriptors for photos 1350095874 and 1350095937 LMissing descriptors for photos 1350095937 and 1350095981 LMissing descriptors for photos 1350095981 and 1350096382 LMissing descriptors for photos 1350096382 and 1350096488 LMissing descriptors for photos 1350096488 and 1350096578 LMissing descriptors for photos 1350096578 and 1350096586 LMissing descriptors for photos 1350096586 and 1350096596 LMissing descriptors for photos 1350096596 and 1350096600 LMissing descriptors for photos 1350096600 and 1350096715 LMissing descriptors for photos 1350096715 and 1350096726 LMissing descriptors for photos 1350096726 and 1350096738 LMissing descriptors for photos 1350096738 and 1350096787 LMissing descriptors for photos 1350096787 and 1350096806 LMissing descriptors for photos 1350096806 and 1350096849 LMissing descriptors for photos 1350096849 and 1350097033 LMissing descriptors for photos 1350097033 and 1350097066 LMissing descriptors for photos 1350097066 and 1350097097 LMissing descriptors for photos 1350097097 and 1350097145 LMissing descriptors for photos 1350097145 and 1350097184 LMissing descriptors for photos 1350097184 and 1350097206 LMissing descriptors for photos 1350097206 and 1350097247 LMissing descriptors for photos 1350097247 and 1350097255 LMissing descriptors for photos 1350097255 and 1350097260 LMissing descriptors for photos 1350097260 and 1350097265 LMissing descriptors for photos 1350097265 and 1350097271 LMissing descriptors for photos 1350097271 and 1350097286 LMissing descriptors for photos 1350097286 and 1350097413 LMissing descriptors for photos 1350097413 and 1350097424 LMissing descriptors for photos 1350097424 and 1350097442 LMissing descriptors for photos 1350097442 and 1350097451 LMissing descriptors for photos 1350097451 and 1350097494 LMissing descriptors for photos 1350097494 and 1350097516 LMissing descriptors for photos 1350097516 and 1350097566 LMissing descriptors for photos 1350097566 and 1350097578 LMissing descriptors for photos 1350097578 and 1350097586 LMissing descriptors for photos 1350097586 and 1350097614 LMissing descriptors for photos 1350097614 and 1350097684 LMissing descriptors for photos 1350097684 and 1350097689 LMissing descriptors for photos 1350097689 and 1350097762 LMissing descriptors for photos 1350097762 and 1350097771 LMissing descriptors for photos 1350097771 and 1350097795 LMissing descriptors for photos 1350097795 and 1350097800 LMissing descriptors for photos 1350097800 and 1350097816 LMissing descriptors for photos 1350097816 and 1350097825 LMissing descriptors for photos 1350097825 and 1350097914 LMissing descriptors for photos 1350097914 and 1350097933 LMissing descriptors for photos 1350097933 and 1350097941 LMissing descriptors for photos 1350097941 and 1350097948 LMissing descriptors for photos 1350097948 and 1350097954 LMissing descriptors for photos 1350097954 and 1350097968 LMissing descriptors for photos 1350097968 and 1350098005 LMissing descriptors for photos 1350098005 and 1350098012 LMissing descriptors for photos 1350098012 and 1350098039 LMissing descriptors for photos 1350098039 and 1350098063 LMissing descriptors for photos 1350098063 and 1350098073 LMissing descriptors for photos 1350098073 and 1350098083 LMissing descriptors for photos 1350098083 and 1350098411 LMissing descriptors for photos 1350098411 and 1350098446 LMissing descriptors for photos 1350098446 and 1350098464 LMissing descriptors for photos 1350098464 and 1350098470 LMissing descriptors for photos 1350098470 and 1350098480 LMissing descriptors for photos 1350098480 and 1350098487 LMissing descriptors for photos 1350098487 and 1350098533 LMissing descriptors for photos 1350098533 and 1350098539 LMissing descriptors for photos 1350098539 and 1350098546 LMissing descriptors for photos 1350098546 and 1350098555 LMissing descriptors for photos 1350098555 and 1350098644 LMissing descriptors for photos 1350098644 and 1350098681 LMissing descriptors for photos 1350098681 and 1350098773 LMissing descriptors for photos 1350098773 and 1350098776 LMissing descriptors for photos 1350098776 and 1350098787 LMissing descriptors for photos 1350098787 and 1350098813 LMissing descriptors for photos 1350098813 and 1350098819 LMissing descriptors for photos 1350098819 and 1350098828 LMissing descriptors for photos 1350098828 and 1350098911 LMissing descriptors for photos 1350098911 and 1350098935 LMissing descriptors for photos 1350098935 and 1350098978 LMissing descriptors for photos 1350098978 and 1350099018 LMissing descriptors for photos 1350099018 and 1350099060 LMissing descriptors for photos 1350099060 and 1350099114 LMissing descriptors for photos 1350099114 and 1350099419 LMissing descriptors for photos 1350099419 and 1350099502 LMissing descriptors for photos 1350099502 and 1350099556 LMissing descriptors for photos 1350099556 and 1350099604 LMissing descriptors for photos 1350099604 and 1350099651 LMissing descriptors for photos 1350099651 and 1350099702 L 04042025 Removing 75 photos because of the 'same image' condition Total on : 2819.171444 list_time_on Total off : 11580.042679 list_time_off dist_desc begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 514 time used for this insertion : 0.09600162506103516 photos_removed : len 75 elapsed_time : remove_photo_duplicate 0.15634822845458984 To do, maybe not at the correct place ! ...................................L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L..................................................................L..............................................................................................................L.L.L.L.L.L.........................L..............L.L.L.L.L.L.L.L..L.L..L..........................L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.Lforce hashtag to JRM elapsed_time : CREATE_PORT_BATCH_BY_HOUR 0.020896434783935547 NUMBER BATCH : 5 list_ponderation used : [1e-05, 1e-05, 1e-05, 1e-05, 1e-05] , list_hashtag_class_create_as_list : ['jrm'] result_one_balle_Type_JRM:{'day': '04042025', 'map_nb_amount': {0: 9, 1: 24, 2: 0, 3: 1, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 299.9904520511627, 'nb_balles_papier': 0.00034000000000000024, 'begin_time_port': 'image_04042025_10_00_03_241952m0.jpg 1e-05 for time 1, id_amount 1 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.00034000000000000024 result_one_balle_Type_JRM:{'day': '04042025', 'map_nb_amount': {0: 12, 1: 64, 2: 2, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 779.6991782188416, 'nb_balles_papier': 0.0007800000000000014, 'begin_time_port': 'image_04042025_10_16_02_508139m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0007800000000000014 result_one_balle_Type_JRM:{'day': '04042025', 'map_nb_amount': {0: 10, 1: 78, 2: 0, 3: 2, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 839.7666509151459, 'nb_balles_papier': 0.0009000000000000017, 'begin_time_port': 'image_04042025_10_30_02_935687m0.jpg 1e-05 for time 1, id_amount 1 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0009000000000000017 result_one_balle_Type_JRM:{'day': '04042025', 'map_nb_amount': {0: 9, 1: 60, 2: 0, 3: 1, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 840.0107159614563, 'nb_balles_papier': 0.0007000000000000012, 'begin_time_port': 'image_04042025_10_45_02_499779m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0007000000000000012 LLLLLLLLLLLLLWe filter photos on hashtag condition ! We have rejected 0 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 4 list_same_port_ids : [22065377] find same portfolio which already exist 22065377 , we will use it list_same_port_ids : [22066033] find same portfolio which already exist 22066033 , we will use it list_same_port_ids : [22067422] find same portfolio which already exist 22067422 , we will use it list_same_port_ids : [22070699] find same portfolio which already exist 22070699 , we will use it # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22065377 AND mptpi.`type`=3726 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22066033 AND mptpi.`type`=3726 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22067422 AND mptpi.`type`=3726 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22070699 AND mptpi.`type`=3726 To do elapsed_time : count_nb_balles_and_create_portfolio 2.029062271118164 # DISPLAY ALL COLLECTED DATA : {'04042025': {'nb_upload': 514, 'nb_taggue_class': 502, 'nb_taggue_densite': 502, 'nb_descriptors': 347}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1350099702, 1350099651, 1350099604, 1350099556, 1350099502, 1350099419, 1350099114, 1350099060, 1350099018, 1350098978, 1350098935, 1350098911, 1350098828, 1350098819, 1350098813, 1350098787, 1350098776, 1350098773, 1350098681, 1350098644, 1350098555, 1350098546, 1350098539, 1350098533, 1350098487, 1350098480, 1350098470, 1350098464, 1350098446, 1350098411, 1350098083, 1350098073, 1350098063, 1350098039, 1350098012, 1350098005, 1350097968, 1350097954, 1350097948, 1350097941, 1350097933, 1350097914, 1350097825, 1350097816, 1350097800, 1350097795, 1350097771, 1350097762, 1350097689, 1350097684, 1350097614, 1350097586, 1350097578, 1350097566, 1350097516, 1350097494, 1350097451, 1350097442, 1350097424, 1350097413, 1350097286, 1350097271, 1350097265, 1350097260, 1350097255, 1350097247, 1350097206, 1350097184, 1350097145, 1350097097, 1350097066, 1350097033, 1350096849, 1350096806, 1350096787, 1350096738, 1350096726, 1350096715, 1350096600, 1350096596, 1350096586, 1350096578, 1350096488, 1350096382, 1350095981, 1350095937, 1350095874, 1350095815, 1350095691, 1350095620, 1350095577, 1350095543, 1350095537, 1350095527, 1350095522, 1350095472, 1350095364, 1350095354, 1350095341, 1350095335] Looping around the photos to save general results len do output : 1 /22064633Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350099702', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350099651', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350099604', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350099556', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350099502', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350099419', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350099114', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350099060', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350099018', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098978', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098935', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098911', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098828', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098819', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098813', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098787', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098776', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098773', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098681', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098644', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098555', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098546', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098539', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098533', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098487', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098480', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098470', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098464', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098446', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098411', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098083', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098073', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098063', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098039', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098012', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350098005', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097968', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097954', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097948', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097941', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097933', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097914', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097825', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097816', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097800', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097795', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097771', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097762', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097689', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097684', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097614', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097586', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097578', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097566', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097516', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097494', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097451', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097442', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097424', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097413', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097286', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097271', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097265', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097260', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097255', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097247', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097206', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097184', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097145', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097097', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097066', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350097033', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350096849', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350096806', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350096787', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350096738', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350096726', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350096715', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350096600', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350096596', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350096586', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350096578', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350096488', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350096382', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350095981', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350095937', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350095874', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350095815', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350095691', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350095620', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350095577', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350095543', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350095537', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350095527', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350095522', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350095472', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350095364', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350095354', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350095341', None, None, None, None, None, '2726729') ('4189', None, None, None, None, None, None, None, '2726729') ('4189', '22064633', '1350095335', None, None, None, None, None, '2726729') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.02883315086364746 save_final save missing photos in datou_result : time spend for datou_step_exec : 37.819815158843994 time spend to save output : 0.02993631362915039 total time spend for step 1 : 37.849751472473145 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 2.79user 1.12system 0:40.53elapsed 9%CPU (0avgtext+0avgdata 106472maxresident)k 1464inputs+2904outputs (2major+74400minor)pagefaults 0swaps