python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4252 ' -s datou_consolidate -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3335372 load datou : 4252 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11617 copy_chis is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11618 consolidate_hashtags_from_manual_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11615 rle_unique_nms_with_priority is not consistent : 3 used against 1 in the step definition ! WARNING : number of outputs for step 11615 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11622 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11616 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11619 blur_detection have less inputs used (0) than in the step definition (1) : maybe we manage optionnal inputs ! Step 11620 brightness have less inputs used (0) than in the step definition (1) : maybe we manage optionnal inputs ! Step 11621 send_mail_cod have less inputs used (4) than in the step definition (5) : maybe we manage optionnal inputs ! Step 11623 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11617 have datatype=11 whereas input 0 of step 11615 have datatype=2 WARNING : type of output 1 of step 11618 doesn't seem to be define in the database( WARNING : type of input 3 of step 11616 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11618 doesn't seem to be define in the database( WARNING : type of input 1 of step 11615 doesn't seem to be define in the database( WARNING : output 0 of step 11622 have datatype=10 whereas input 3 of step 11621 have datatype=6 WARNING : type of input 1 of step 11622 doesn't seem to be define in the database( WARNING : output 1 of step 11615 have datatype=7 whereas input 1 of step 11622 have datatype=None WARNING : type of output 1 of step 11622 doesn't seem to be define in the database( WARNING : type of input 4 of step 11616 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11617 doesn't seem to be define in the database( WARNING : type of input 1 of step 11618 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : id de la photo (peut être local ou global) was removed should we ? donnée sous forme de nombre was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Current got : datou_id : 4252, datou_cur_ids : ['2692915'] with mtr_portfolio_ids : ['21164283'] and first list_photo_ids : [] new path : /proc/3335372/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11617 copy_chis is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11618 consolidate_hashtags_from_manual_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11615 rle_unique_nms_with_priority is not consistent : 3 used against 1 in the step definition ! WARNING : number of outputs for step 11615 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11622 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11616 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11619 blur_detection have less inputs used (0) than in the step definition (1) : maybe we manage optionnal inputs ! Step 11620 brightness have less inputs used (0) than in the step definition (1) : maybe we manage optionnal inputs ! Step 11621 send_mail_cod have less inputs used (4) than in the step definition (5) : maybe we manage optionnal inputs ! Step 11623 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11617 have datatype=11 whereas input 0 of step 11615 have datatype=2 WARNING : type of output 1 of step 11618 doesn't seem to be define in the database( WARNING : type of input 3 of step 11616 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11618 doesn't seem to be define in the database( WARNING : type of input 1 of step 11615 doesn't seem to be define in the database( WARNING : output 0 of step 11622 have datatype=10 whereas input 3 of step 11621 have datatype=6 WARNING : type of input 1 of step 11622 doesn't seem to be define in the database( WARNING : output 1 of step 11615 have datatype=7 whereas input 1 of step 11622 have datatype=None WARNING : type of output 1 of step 11622 doesn't seem to be define in the database( WARNING : type of input 4 of step 11616 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11617 doesn't seem to be define in the database( WARNING : type of input 1 of step 11618 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : copy_chis, consolidate_hashtags_from_manual_portfolio, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, send_mail_cod, split_time_score over limit max, limiting to limit_max 100 list_input_json : {} origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 82 ; length of list_pids : 82 ; length of list_args : 82 time to download the photos : 21.778769493103027 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 9 step1:copy_chis Wed Mar 26 15:42:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Begin step datou_step_copy_crop batch 1 Loaded 103 chid ids of type : 4211 batch 1 Loaded 2383 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 18 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : copy_chis we use saveGeneral [1341334675, 1341334259, 1341334255, 1341334248, 1341334195, 1341334179, 1341334174, 1341334074, 1341334070, 1341334065, 1341333828, 1341333824, 1341333805, 1341333796, 1341333787, 1341333775, 1341333771, 1341333723, 1341333266, 1341333260, 1341333256, 1341333252, 1341333247, 1341333242, 1341332985, 1341332878, 1341332857, 1341332853, 1341332848, 1341332843, 1341332810, 1341332806, 1341332801, 1341332795, 1341332789, 1341332783, 1341332762, 1341332757, 1341226649, 1341226638, 1341226634, 1341224791, 1341224771, 1341224730, 1341224658, 1341224617, 1341224425, 1341224372, 1341224318, 1341224287, 1341224263, 1341224254, 1341223756, 1341223734, 1341223731, 1341223025, 1341222817, 1341222544, 1341222515, 1341221914, 1341221867, 1341221856, 1341221846, 1341221842, 1341221775, 1341221773, 1341221768, 1341221763, 1341221757, 1341221751, 1341221683, 1341221674, 1341221668, 1341221664, 1341221660, 1341221656, 1341221641, 1341221636, 1341221630, 1341221625, 1341221621, 1341221615] Looping around the photos to save general results len do output : 82 /1341221615Didn't retrieve data . /1341221621Didn't retrieve data . /1341221625Didn't retrieve data . /1341221630Didn't retrieve data . /1341221636Didn't retrieve data . /1341221641Didn't retrieve data . /1341221656Didn't retrieve data . /1341221660Didn't retrieve data . /1341221664Didn't retrieve data . /1341221668Didn't retrieve data . /1341221674Didn't retrieve data . /1341221683Didn't retrieve data . /1341221751Didn't retrieve data . /1341221757Didn't retrieve data . /1341221763Didn't retrieve data . /1341221768Didn't retrieve data . /1341221773Didn't retrieve data . /1341221775Didn't retrieve data . /1341221842Didn't retrieve data . /1341221846Didn't retrieve data . /1341221856Didn't retrieve data . /1341221867Didn't retrieve data . /1341221914Didn't retrieve data . /1341222515Didn't retrieve data . /1341222544Didn't retrieve data . /1341222817Didn't retrieve data . /1341223025Didn't retrieve data . /1341223731Didn't retrieve data . /1341223734Didn't retrieve data . /1341223756Didn't retrieve data . /1341224254Didn't retrieve data . /1341224263Didn't retrieve data . /1341224287Didn't retrieve data . /1341224318Didn't retrieve data . /1341224372Didn't retrieve data . /1341224425Didn't retrieve data . /1341224617Didn't retrieve data . /1341224658Didn't retrieve data . /1341224730Didn't retrieve data . /1341224771Didn't retrieve data . /1341224791Didn't retrieve data . /1341226634Didn't retrieve data . /1341226638Didn't retrieve data . /1341226649Didn't retrieve data . /1341332757Didn't retrieve data . /1341332762Didn't retrieve data . /1341332783Didn't retrieve data . /1341332789Didn't retrieve data . /1341332795Didn't retrieve data . /1341332801Didn't retrieve data . /1341332806Didn't retrieve data . /1341332810Didn't retrieve data . /1341332843Didn't retrieve data . /1341332848Didn't retrieve data . /1341332853Didn't retrieve data . /1341332857Didn't retrieve data . /1341332878Didn't retrieve data . /1341332985Didn't retrieve data . /1341333242Didn't retrieve data . /1341333247Didn't retrieve data . /1341333252Didn't retrieve data . /1341333256Didn't retrieve data . /1341333260Didn't retrieve data . /1341333266Didn't retrieve data . /1341333723Didn't retrieve data . /1341333771Didn't retrieve data . /1341333775Didn't retrieve data . /1341333787Didn't retrieve data . /1341333796Didn't retrieve data . /1341333805Didn't retrieve data . /1341333824Didn't retrieve data . /1341333828Didn't retrieve data . /1341334065Didn't retrieve data . /1341334070Didn't retrieve data . /1341334074Didn't retrieve data . /1341334174Didn't retrieve data . /1341334179Didn't retrieve data . /1341334195Didn't retrieve data . /1341334248Didn't retrieve data . /1341334255Didn't retrieve data . /1341334259Didn't retrieve data . /1341334675Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334675', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334259', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334255', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334248', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334195', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334179', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334174', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334074', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334070', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334065', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333828', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333824', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333805', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333796', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333787', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333775', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333771', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333723', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333266', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333260', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333256', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333252', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333247', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333242', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332985', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332878', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332857', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332853', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332848', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332843', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332810', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332806', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332801', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332795', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332789', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332783', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332762', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332757', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341226649', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341226638', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341226634', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224791', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224771', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224730', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224658', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224617', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224425', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224372', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224318', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224287', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224263', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224254', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341223756', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341223734', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341223731', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341223025', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341222817', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341222544', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341222515', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221914', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221867', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221856', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221846', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221842', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221775', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221773', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221768', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221763', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221757', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221751', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221683', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221674', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221668', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221664', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221660', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221656', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221641', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221636', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221630', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221625', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221621', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221615', None, None, None, None, None, '2692915') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 164 time used for this insertion : 0.03457069396972656 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.186694860458374 time spend to save output : 0.03658628463745117 total time spend for step 1 : 9.223281145095825 step2:consolidate_hashtags_from_manual_portfolio Wed Mar 26 15:42:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step consolidate_hashtags_from_manual_portfolio Iterating over portfolio : 21164283 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21164283 AND mptpi.`type`=4211 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('barquette_opaque','carton','ela','environnement','etiquette','film_plastique','kraft','metal','papier','pehd','pet_clair','pet_opaque','textiles_sanitaires','pet_fonce','mal_croppe','flou','background')) To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21164283 AND mptpi.`type`=4211 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('barquette_opaque','carton','ela','environnement','etiquette','film_plastique','kraft','metal','papier','pehd','pet_clair','pet_opaque','textiles_sanitaires','pet_fonce','mal_croppe','flou','background')) To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21164283 AND mptpi.`type`=4211 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('barquette_opaque','carton','ela','environnement','etiquette','film_plastique','kraft','metal','papier','pehd','pet_clair','pet_opaque','textiles_sanitaires','pet_fonce','mal_croppe','flou','background')) To do TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21164876 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 1528 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21164877 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 1819 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21164878 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 2055 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21164879 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 1757 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21164880 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 150 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21164881 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 456 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21164883 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 1651 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21164884 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 2081 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21164885 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 1333 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21164886 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 869 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21164887 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 439 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21164888 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21164889 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 2386 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21164891 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 601 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21164892 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 55 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21164893 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 2247 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21731131 AND mpp.hide_status=0 ORDER BY ph.size desc To test ! Use context local managing function ! Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : consolidate_hashtags_from_manual_portfolio we use saveGeneral [1341334675, 1341334259, 1341334255, 1341334248, 1341334195, 1341334179, 1341334174, 1341334074, 1341334070, 1341334065, 1341333828, 1341333824, 1341333805, 1341333796, 1341333787, 1341333775, 1341333771, 1341333723, 1341333266, 1341333260, 1341333256, 1341333252, 1341333247, 1341333242, 1341332985, 1341332878, 1341332857, 1341332853, 1341332848, 1341332843, 1341332810, 1341332806, 1341332801, 1341332795, 1341332789, 1341332783, 1341332762, 1341332757, 1341226649, 1341226638, 1341226634, 1341224791, 1341224771, 1341224730, 1341224658, 1341224617, 1341224425, 1341224372, 1341224318, 1341224287, 1341224263, 1341224254, 1341223756, 1341223734, 1341223731, 1341223025, 1341222817, 1341222544, 1341222515, 1341221914, 1341221867, 1341221856, 1341221846, 1341221842, 1341221775, 1341221773, 1341221768, 1341221763, 1341221757, 1341221751, 1341221683, 1341221674, 1341221668, 1341221664, 1341221660, 1341221656, 1341221641, 1341221636, 1341221630, 1341221625, 1341221621, 1341221615] Looping around the photos to save general results len do output : 6 /Tassign value string error string indices must be integers invalid literal for int() with base 10: 'T' begin to insert list_values into mtr_datou_result : length of list_values in save_final : 82 time used for this insertion : 0.030710935592651367 save_final save missing photos in datou_result : time spend for datou_step_exec : 63.715909004211426 time spend to save output : 0.03097844123840332 total time spend for step 2 : 63.74688744544983 step3:rle_unique_nms_with_priority Wed Mar 26 15:44:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 1933 chid ids of type : 4211 seulement à utiliser dans la step consolidation batch 1 Loaded 6 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.026111602783203125 seulement à utiliser dans la step consolidation batch 1 Loaded 12 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.02988433837890625 seulement à utiliser dans la step consolidation batch 1 Loaded 37 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.02985405921936035 seulement à utiliser dans la step consolidation batch 1 Loaded 24 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.031321048736572266 seulement à utiliser dans la step consolidation batch 1 Loaded 31 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.028809070587158203 seulement à utiliser dans la step consolidation batch 1 Loaded 25 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.02785325050354004 seulement à utiliser dans la step consolidation batch 1 Loaded 36 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.06748270988464355 seulement à utiliser dans la step consolidation batch 1 Loaded 40 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03318667411804199 seulement à utiliser dans la step consolidation batch 1 Loaded 40 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.032015323638916016 seulement à utiliser dans la step consolidation batch 1 Loaded 32 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.02999281883239746 seulement à utiliser dans la step consolidation batch 1 Loaded 30 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.029959440231323242 seulement à utiliser dans la step consolidation batch 1 Loaded 23 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.0294647216796875 seulement à utiliser dans la step consolidation batch 1 Loaded 29 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.09814882278442383 seulement à utiliser dans la step consolidation batch 1 Loaded 35 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030898571014404297 seulement à utiliser dans la step consolidation batch 1 Loaded 31 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.02969646453857422 seulement à utiliser dans la step consolidation batch 1 Loaded 26 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.028519392013549805 seulement à utiliser dans la step consolidation batch 1 Loaded 32 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03071284294128418 seulement à utiliser dans la step consolidation batch 1 Loaded 40 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.15814614295959473 seulement à utiliser dans la step consolidation batch 1 Loaded 34 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030946731567382812 seulement à utiliser dans la step consolidation batch 1 Loaded 38 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03175687789916992 seulement à utiliser dans la step consolidation batch 1 Loaded 31 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.033272504806518555 seulement à utiliser dans la step consolidation batch 1 Loaded 31 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030471086502075195 seulement à utiliser dans la step consolidation batch 1 Loaded 26 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.07467365264892578 seulement à utiliser dans la step consolidation batch 1 Loaded 30 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.029984712600708008 seulement à utiliser dans la step consolidation batch 1 Loaded 33 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.028539419174194336 seulement à utiliser dans la step consolidation batch 1 Loaded 24 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.0298006534576416 seulement à utiliser dans la step consolidation batch 1 Loaded 20 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.029977798461914062 seulement à utiliser dans la step consolidation batch 1 Loaded 22 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030529260635375977 seulement à utiliser dans la step consolidation batch 1 Loaded 8 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.028352022171020508 seulement à utiliser dans la step consolidation batch 1 Loaded 12 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.1134490966796875 seulement à utiliser dans la step consolidation batch 1 Loaded 31 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030511140823364258 seulement à utiliser dans la step consolidation batch 1 Loaded 29 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.029738664627075195 seulement à utiliser dans la step consolidation batch 1 Loaded 36 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.033025503158569336 seulement à utiliser dans la step consolidation batch 1 Loaded 29 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.029912471771240234 seulement à utiliser dans la step consolidation batch 1 Loaded 31 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030254364013671875 seulement à utiliser dans la step consolidation batch 1 Loaded 26 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.029827356338500977 seulement à utiliser dans la step consolidation batch 1 Loaded 31 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.029731035232543945 seulement à utiliser dans la step consolidation batch 1 Loaded 33 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.028932571411132812 seulement à utiliser dans la step consolidation batch 1 Loaded 20 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.0274960994720459 seulement à utiliser dans la step consolidation batch 1 Loaded 30 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.02895522117614746 seulement à utiliser dans la step consolidation batch 1 Loaded 17 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.02994823455810547 seulement à utiliser dans la step consolidation batch 1 Loaded 32 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030303478240966797 seulement à utiliser dans la step consolidation batch 1 Loaded 25 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.02924489974975586 seulement à utiliser dans la step consolidation batch 1 Loaded 26 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.02971172332763672 seulement à utiliser dans la step consolidation batch 1 Loaded 29 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.02884531021118164 seulement à utiliser dans la step consolidation batch 1 Loaded 37 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030491352081298828 seulement à utiliser dans la step consolidation batch 1 Loaded 40 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.07154202461242676 seulement à utiliser dans la step consolidation batch 1 Loaded 44 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 3.4856462478637695 seulement à utiliser dans la step consolidation batch 1 Loaded 31 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.02852487564086914 seulement à utiliser dans la step consolidation batch 1 Loaded 42 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03247213363647461 seulement à utiliser dans la step consolidation batch 1 Loaded 35 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030309200286865234 seulement à utiliser dans la step consolidation batch 1 Loaded 34 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.02865886688232422 seulement à utiliser dans la step consolidation batch 1 Loaded 11 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.026770591735839844 seulement à utiliser dans la step consolidation batch 1 Loaded 35 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03045034408569336 seulement à utiliser dans la step consolidation batch 1 Loaded 36 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.1401045322418213 seulement à utiliser dans la step consolidation batch 1 Loaded 36 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03070545196533203 seulement à utiliser dans la step consolidation batch 1 Loaded 25 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.028319597244262695 seulement à utiliser dans la step consolidation batch 1 Loaded 21 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.028241872787475586 seulement à utiliser dans la step consolidation batch 1 Loaded 7 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.02440643310546875 seulement à utiliser dans la step consolidation batch 1 Loaded 37 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030414104461669922 seulement à utiliser dans la step consolidation batch 1 Loaded 50 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.082977294921875 seulement à utiliser dans la step consolidation batch 1 Loaded 38 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.02984142303466797 seulement à utiliser dans la step consolidation batch 1 Loaded 36 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030304670333862305 seulement à utiliser dans la step consolidation batch 1 Loaded 39 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030268192291259766 seulement à utiliser dans la step consolidation batch 1 Loaded 23 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.028863906860351562 seulement à utiliser dans la step consolidation batch 1 Loaded 19 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.027683258056640625 seulement à utiliser dans la step consolidation batch 1 Loaded 35 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.032521963119506836 seulement à utiliser dans la step consolidation batch 1 Loaded 20 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.027401208877563477 seulement à utiliser dans la step consolidation batch 1 Loaded 20 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.029560327529907227 seulement à utiliser dans la step consolidation batch 1 Loaded 24 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030434846878051758 seulement à utiliser dans la step consolidation batch 1 Loaded 29 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.029024362564086914 seulement à utiliser dans la step consolidation batch 1 Loaded 38 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030287504196166992 seulement à utiliser dans la step consolidation batch 1 Loaded 23 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.028342485427856445 seulement à utiliser dans la step consolidation batch 1 Loaded 39 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.032027482986450195 seulement à utiliser dans la step consolidation batch 1 Loaded 20 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.02787017822265625 seulement à utiliser dans la step consolidation batch 1 Loaded 6 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.026765823364257812 seulement à utiliser dans la step consolidation batch 1 Loaded 41 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030348539352416992 seulement à utiliser dans la step consolidation batch 1 Loaded 40 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.029596328735351562 seulement à utiliser dans la step consolidation batch 1 Loaded 27 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.02985095977783203 seulement à utiliser dans la step consolidation batch 1 Loaded 31 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030020475387573242 seulement à utiliser dans la step consolidation batch 1 Loaded 32 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.031178951263427734 seulement à utiliser dans la step consolidation batch 1 Loaded 37 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030846595764160156 map_output_result : {1341334675: (0.0, 'Should be the crop_list due to order', 0), 1341334259: (0.0, 'Should be the crop_list due to order', 0), 1341334255: (0.0, 'Should be the crop_list due to order', 0), 1341334248: (0.0, 'Should be the crop_list due to order', 0), 1341334195: (0.0, 'Should be the crop_list due to order', 0), 1341334179: (0.0, 'Should be the crop_list due to order', 0), 1341334174: (0.0, 'Should be the crop_list due to order', 0), 1341334074: (0.0, 'Should be the crop_list due to order', 0), 1341334070: (0.0, 'Should be the crop_list due to order', 0), 1341334065: (0.0, 'Should be the crop_list due to order', 0), 1341333828: (0.0, 'Should be the crop_list due to order', 0), 1341333824: (0.0, 'Should be the crop_list due to order', 0), 1341333805: (0.0, 'Should be the crop_list due to order', 0), 1341333796: (0.0, 'Should be the crop_list due to order', 0), 1341333787: (0.0, 'Should be the crop_list due to order', 0), 1341333775: (0.0, 'Should be the crop_list due to order', 0), 1341333771: (0.0, 'Should be the crop_list due to order', 0), 1341333723: (0.0, 'Should be the crop_list due to order', 0), 1341333266: (0.0, 'Should be the crop_list due to order', 0), 1341333260: (0.0, 'Should be the crop_list due to order', 0), 1341333256: (0.0, 'Should be the crop_list due to order', 0), 1341333252: (0.0, 'Should be the crop_list due to order', 0), 1341333247: (0.0, 'Should be the crop_list due to order', 0), 1341333242: (0.0, 'Should be the crop_list due to order', 0), 1341332985: (0.0, 'Should be the crop_list due to order', 0), 1341332878: (0.0, 'Should be the crop_list due to order', 0), 1341332857: (0.0, 'Should be the crop_list due to order', 0), 1341332853: (0.0, 'Should be the crop_list due to order', 0), 1341332848: (0.0, 'Should be the crop_list due to order', 0), 1341332843: (0.0, 'Should be the crop_list due to order', 0), 1341332810: (0.0, 'Should be the crop_list due to order', 0), 1341332806: (0.0, 'Should be the crop_list due to order', 0), 1341332801: (0.0, 'Should be the crop_list due to order', 0), 1341332795: (0.0, 'Should be the crop_list due to order', 0), 1341332789: (0.0, 'Should be the crop_list due to order', 0), 1341332783: (0.0, 'Should be the crop_list due to order', 0), 1341332762: (0.0, 'Should be the crop_list due to order', 0), 1341332757: (0.0, 'Should be the crop_list due to order', 0), 1341226649: (0.0, 'Should be the crop_list due to order', 0), 1341226638: (0.0, 'Should be the crop_list due to order', 0), 1341226634: (0.0, 'Should be the crop_list due to order', 0), 1341224791: (0.0, 'Should be the crop_list due to order', 0), 1341224771: (0.0, 'Should be the crop_list due to order', 0), 1341224730: (0.0, 'Should be the crop_list due to order', 0), 1341224658: (0.0, 'Should be the crop_list due to order', 0), 1341224617: (0.0, 'Should be the crop_list due to order', 0), 1341224425: (0.0, 'Should be the crop_list due to order', 0), 1341224372: (0.0, 'Should be the crop_list due to order', 0), 1341224318: (0.0, 'Should be the crop_list due to order', 0), 1341224287: (0.0, 'Should be the crop_list due to order', 0), 1341224263: (0.0, 'Should be the crop_list due to order', 0), 1341224254: (0.0, 'Should be the crop_list due to order', 0), 1341223756: (0.0, 'Should be the crop_list due to order', 0), 1341223734: (0.0, 'Should be the crop_list due to order', 0), 1341223731: (0.0, 'Should be the crop_list due to order', 0), 1341223025: (0.0, 'Should be the crop_list due to order', 0), 1341222817: (0.0, 'Should be the crop_list due to order', 0), 1341222544: (0.0, 'Should be the crop_list due to order', 0), 1341222515: (0.0, 'Should be the crop_list due to order', 0), 1341221914: (0.0, 'Should be the crop_list due to order', 0), 1341221867: (0.0, 'Should be the crop_list due to order', 0), 1341221856: (0.0, 'Should be the crop_list due to order', 0), 1341221846: (0.0, 'Should be the crop_list due to order', 0), 1341221842: (0.0, 'Should be the crop_list due to order', 0), 1341221775: (0.0, 'Should be the crop_list due to order', 0), 1341221773: (0.0, 'Should be the crop_list due to order', 0), 1341221768: (0.0, 'Should be the crop_list due to order', 0), 1341221763: (0.0, 'Should be the crop_list due to order', 0), 1341221757: (0.0, 'Should be the crop_list due to order', 0), 1341221751: (0.0, 'Should be the crop_list due to order', 0), 1341221683: (0.0, 'Should be the crop_list due to order', 0), 1341221674: (0.0, 'Should be the crop_list due to order', 0), 1341221668: (0.0, 'Should be the crop_list due to order', 0), 1341221664: (0.0, 'Should be the crop_list due to order', 0), 1341221660: (0.0, 'Should be the crop_list due to order', 0), 1341221656: (0.0, 'Should be the crop_list due to order', 0), 1341221641: (0.0, 'Should be the crop_list due to order', 0), 1341221636: (0.0, 'Should be the crop_list due to order', 0), 1341221630: (0.0, 'Should be the crop_list due to order', 0), 1341221625: (0.0, 'Should be the crop_list due to order', 0), 1341221621: (0.0, 'Should be the crop_list due to order', 0), 1341221615: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1341334675, 1341334259, 1341334255, 1341334248, 1341334195, 1341334179, 1341334174, 1341334074, 1341334070, 1341334065, 1341333828, 1341333824, 1341333805, 1341333796, 1341333787, 1341333775, 1341333771, 1341333723, 1341333266, 1341333260, 1341333256, 1341333252, 1341333247, 1341333242, 1341332985, 1341332878, 1341332857, 1341332853, 1341332848, 1341332843, 1341332810, 1341332806, 1341332801, 1341332795, 1341332789, 1341332783, 1341332762, 1341332757, 1341226649, 1341226638, 1341226634, 1341224791, 1341224771, 1341224730, 1341224658, 1341224617, 1341224425, 1341224372, 1341224318, 1341224287, 1341224263, 1341224254, 1341223756, 1341223734, 1341223731, 1341223025, 1341222817, 1341222544, 1341222515, 1341221914, 1341221867, 1341221856, 1341221846, 1341221842, 1341221775, 1341221773, 1341221768, 1341221763, 1341221757, 1341221751, 1341221683, 1341221674, 1341221668, 1341221664, 1341221660, 1341221656, 1341221641, 1341221636, 1341221630, 1341221625, 1341221621, 1341221615] Looping around the photos to save general results len do output : 82 /1341334675.Didn't retrieve data . /1341334259.Didn't retrieve data . /1341334255.Didn't retrieve data . /1341334248.Didn't retrieve data . /1341334195.Didn't retrieve data . /1341334179.Didn't retrieve data . /1341334174.Didn't retrieve data . /1341334074.Didn't retrieve data . /1341334070.Didn't retrieve data . /1341334065.Didn't retrieve data . /1341333828.Didn't retrieve data . /1341333824.Didn't retrieve data . /1341333805.Didn't retrieve data . /1341333796.Didn't retrieve data . /1341333787.Didn't retrieve data . /1341333775.Didn't retrieve data . /1341333771.Didn't retrieve data . /1341333723.Didn't retrieve data . /1341333266.Didn't retrieve data . /1341333260.Didn't retrieve data . /1341333256.Didn't retrieve data . /1341333252.Didn't retrieve data . /1341333247.Didn't retrieve data . /1341333242.Didn't retrieve data . /1341332985.Didn't retrieve data . /1341332878.Didn't retrieve data . /1341332857.Didn't retrieve data . /1341332853.Didn't retrieve data . /1341332848.Didn't retrieve data . /1341332843.Didn't retrieve data . /1341332810.Didn't retrieve data . /1341332806.Didn't retrieve data . /1341332801.Didn't retrieve data . /1341332795.Didn't retrieve data . /1341332789.Didn't retrieve data . /1341332783.Didn't retrieve data . /1341332762.Didn't retrieve data . /1341332757.Didn't retrieve data . /1341226649.Didn't retrieve data . /1341226638.Didn't retrieve data . /1341226634.Didn't retrieve data . /1341224791.Didn't retrieve data . /1341224771.Didn't retrieve data . /1341224730.Didn't retrieve data . /1341224658.Didn't retrieve data . /1341224617.Didn't retrieve data . /1341224425.Didn't retrieve data . /1341224372.Didn't retrieve data . /1341224318.Didn't retrieve data . /1341224287.Didn't retrieve data . /1341224263.Didn't retrieve data . /1341224254.Didn't retrieve data . /1341223756.Didn't retrieve data . /1341223734.Didn't retrieve data . /1341223731.Didn't retrieve data . /1341223025.Didn't retrieve data . /1341222817.Didn't retrieve data . /1341222544.Didn't retrieve data . /1341222515.Didn't retrieve data . /1341221914.Didn't retrieve data . /1341221867.Didn't retrieve data . /1341221856.Didn't retrieve data . /1341221846.Didn't retrieve data . /1341221842.Didn't retrieve data . /1341221775.Didn't retrieve data . /1341221773.Didn't retrieve data . /1341221768.Didn't retrieve data . /1341221763.Didn't retrieve data . /1341221757.Didn't retrieve data . /1341221751.Didn't retrieve data . /1341221683.Didn't retrieve data . /1341221674.Didn't retrieve data . /1341221668.Didn't retrieve data . /1341221664.Didn't retrieve data . /1341221660.Didn't retrieve data . /1341221656.Didn't retrieve data . /1341221641.Didn't retrieve data . /1341221636.Didn't retrieve data . /1341221630.Didn't retrieve data . /1341221625.Didn't retrieve data . /1341221621.Didn't retrieve data . /1341221615.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334675', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334259', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334255', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334248', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334195', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334179', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334174', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334074', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334070', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334065', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333828', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333824', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333805', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333796', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333787', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333775', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333771', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333723', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333266', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333260', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333256', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333252', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333247', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333242', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332985', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332878', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332857', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332853', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332848', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332843', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332810', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332806', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332801', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332795', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332789', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332783', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332762', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332757', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341226649', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341226638', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341226634', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224791', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224771', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224730', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224658', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224617', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224425', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224372', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224318', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224287', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224263', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224254', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341223756', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341223734', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341223731', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341223025', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341222817', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341222544', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341222515', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221914', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221867', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221856', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221846', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221842', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221775', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221773', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221768', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221763', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221757', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221751', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221683', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221674', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221668', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221664', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221660', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221656', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221641', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221636', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221630', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221625', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221621', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221615', None, None, None, None, None, '2692915') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 246 time used for this insertion : 0.5286319255828857 save_final save missing photos in datou_result : time spend for datou_step_exec : 16.87864351272583 time spend to save output : 0.5305263996124268 total time spend for step 3 : 17.409169912338257 step4:ventilate_hashtags_in_portfolio Wed Mar 26 15:44:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 21164283 get user id for portfolio 21164283 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21164283 AND mptpi.`type`=4211 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('barquette_opaque','carton','ela','environnement','etiquette','film_plastique','kraft','metal','papier','pehd','pet_clair','pet_opaque','textiles_sanitaires','pet_fonce','mal_croppe','flou')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21164283 AND mptpi.`type`=4211 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('barquette_opaque','carton','ela','environnement','etiquette','film_plastique','kraft','metal','papier','pehd','pet_clair','pet_opaque','textiles_sanitaires','pet_fonce','mal_croppe','flou')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/21164876,21164877,21164878,21164879,21164880,21164881,21164883,21164884,21164885,21164886,21164887,21164888,21164889,21164891,21164892,21164893?tags=flou,carton,film_plastique,papier,metal,kraft,pet_clair,pehd,etiquette,environnement,ela,textiles_sanitaires,mal_croppe,pet_opaque,pet_fonce,barquette_opaque Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1341334675, 1341334259, 1341334255, 1341334248, 1341334195, 1341334179, 1341334174, 1341334074, 1341334070, 1341334065, 1341333828, 1341333824, 1341333805, 1341333796, 1341333787, 1341333775, 1341333771, 1341333723, 1341333266, 1341333260, 1341333256, 1341333252, 1341333247, 1341333242, 1341332985, 1341332878, 1341332857, 1341332853, 1341332848, 1341332843, 1341332810, 1341332806, 1341332801, 1341332795, 1341332789, 1341332783, 1341332762, 1341332757, 1341226649, 1341226638, 1341226634, 1341224791, 1341224771, 1341224730, 1341224658, 1341224617, 1341224425, 1341224372, 1341224318, 1341224287, 1341224263, 1341224254, 1341223756, 1341223734, 1341223731, 1341223025, 1341222817, 1341222544, 1341222515, 1341221914, 1341221867, 1341221856, 1341221846, 1341221842, 1341221775, 1341221773, 1341221768, 1341221763, 1341221757, 1341221751, 1341221683, 1341221674, 1341221668, 1341221664, 1341221660, 1341221656, 1341221641, 1341221636, 1341221630, 1341221625, 1341221621, 1341221615] Looping around the photos to save general results len do output : 1 /21164283. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334675', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334259', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334255', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334248', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334195', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334179', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334174', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334074', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334070', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334065', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333828', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333824', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333805', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333796', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333787', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333775', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333771', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333723', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333266', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333260', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333256', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333252', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333247', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333242', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332985', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332878', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332857', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332853', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332848', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332843', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332810', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332806', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332801', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332795', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332789', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332783', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332762', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332757', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341226649', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341226638', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341226634', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224791', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224771', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224730', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224658', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224617', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224425', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224372', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224318', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224287', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224263', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224254', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341223756', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341223734', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341223731', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341223025', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341222817', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341222544', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341222515', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221914', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221867', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221856', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221846', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221842', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221775', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221773', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221768', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221763', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221757', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221751', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221683', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221674', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221668', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221664', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221660', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221656', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221641', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221636', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221630', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221625', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221621', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221615', None, None, None, None, None, '2692915') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 83 time used for this insertion : 0.07250642776489258 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.8581283092498779 time spend to save output : 0.07317376136779785 total time spend for step 4 : 0.9313020706176758 step5:final Wed Mar 26 15:44:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1341334675: ('0.10972315289713054',), 1341334259: ('0.10972315289713054',), 1341334255: ('0.10972315289713054',), 1341334248: ('0.10972315289713054',), 1341334195: ('0.10972315289713054',), 1341334179: ('0.10972315289713054',), 1341334174: ('0.10972315289713054',), 1341334074: ('0.10972315289713054',), 1341334070: ('0.10972315289713054',), 1341334065: ('0.10972315289713054',), 1341333828: ('0.10972315289713054',), 1341333824: ('0.10972315289713054',), 1341333805: ('0.10972315289713054',), 1341333796: ('0.10972315289713054',), 1341333787: ('0.10972315289713054',), 1341333775: ('0.10972315289713054',), 1341333771: ('0.10972315289713054',), 1341333723: ('0.10972315289713054',), 1341333266: ('0.10972315289713054',), 1341333260: ('0.10972315289713054',), 1341333256: ('0.10972315289713054',), 1341333252: ('0.10972315289713054',), 1341333247: ('0.10972315289713054',), 1341333242: ('0.10972315289713054',), 1341332985: ('0.10972315289713054',), 1341332878: ('0.10972315289713054',), 1341332857: ('0.10972315289713054',), 1341332853: ('0.10972315289713054',), 1341332848: ('0.10972315289713054',), 1341332843: ('0.10972315289713054',), 1341332810: ('0.10972315289713054',), 1341332806: ('0.10972315289713054',), 1341332801: ('0.10972315289713054',), 1341332795: ('0.10972315289713054',), 1341332789: ('0.10972315289713054',), 1341332783: ('0.10972315289713054',), 1341332762: ('0.10972315289713054',), 1341332757: ('0.10972315289713054',), 1341226649: ('0.10972315289713054',), 1341226638: ('0.10972315289713054',), 1341226634: ('0.10972315289713054',), 1341224791: ('0.10972315289713054',), 1341224771: ('0.10972315289713054',), 1341224730: ('0.10972315289713054',), 1341224658: ('0.10972315289713054',), 1341224617: ('0.10972315289713054',), 1341224425: ('0.10972315289713054',), 1341224372: ('0.10972315289713054',), 1341224318: ('0.10972315289713054',), 1341224287: ('0.10972315289713054',), 1341224263: ('0.10972315289713054',), 1341224254: ('0.10972315289713054',), 1341223756: ('0.10972315289713054',), 1341223734: ('0.10972315289713054',), 1341223731: ('0.10972315289713054',), 1341223025: ('0.10972315289713054',), 1341222817: ('0.10972315289713054',), 1341222544: ('0.10972315289713054',), 1341222515: ('0.10972315289713054',), 1341221914: ('0.10972315289713054',), 1341221867: ('0.10972315289713054',), 1341221856: ('0.10972315289713054',), 1341221846: ('0.10972315289713054',), 1341221842: ('0.10972315289713054',), 1341221775: ('0.10972315289713054',), 1341221773: ('0.10972315289713054',), 1341221768: ('0.10972315289713054',), 1341221763: ('0.10972315289713054',), 1341221757: ('0.10972315289713054',), 1341221751: ('0.10972315289713054',), 1341221683: ('0.10972315289713054',), 1341221674: ('0.10972315289713054',), 1341221668: ('0.10972315289713054',), 1341221664: ('0.10972315289713054',), 1341221660: ('0.10972315289713054',), 1341221656: ('0.10972315289713054',), 1341221641: ('0.10972315289713054',), 1341221636: ('0.10972315289713054',), 1341221630: ('0.10972315289713054',), 1341221625: ('0.10972315289713054',), 1341221621: ('0.10972315289713054',), 1341221615: ('0.10972315289713054',)} new output for save of step final : {1341334675: ('0.10972315289713054',), 1341334259: ('0.10972315289713054',), 1341334255: ('0.10972315289713054',), 1341334248: ('0.10972315289713054',), 1341334195: ('0.10972315289713054',), 1341334179: ('0.10972315289713054',), 1341334174: ('0.10972315289713054',), 1341334074: ('0.10972315289713054',), 1341334070: ('0.10972315289713054',), 1341334065: ('0.10972315289713054',), 1341333828: ('0.10972315289713054',), 1341333824: ('0.10972315289713054',), 1341333805: ('0.10972315289713054',), 1341333796: ('0.10972315289713054',), 1341333787: ('0.10972315289713054',), 1341333775: ('0.10972315289713054',), 1341333771: ('0.10972315289713054',), 1341333723: ('0.10972315289713054',), 1341333266: ('0.10972315289713054',), 1341333260: ('0.10972315289713054',), 1341333256: ('0.10972315289713054',), 1341333252: ('0.10972315289713054',), 1341333247: ('0.10972315289713054',), 1341333242: ('0.10972315289713054',), 1341332985: ('0.10972315289713054',), 1341332878: ('0.10972315289713054',), 1341332857: ('0.10972315289713054',), 1341332853: ('0.10972315289713054',), 1341332848: ('0.10972315289713054',), 1341332843: ('0.10972315289713054',), 1341332810: ('0.10972315289713054',), 1341332806: ('0.10972315289713054',), 1341332801: ('0.10972315289713054',), 1341332795: ('0.10972315289713054',), 1341332789: ('0.10972315289713054',), 1341332783: ('0.10972315289713054',), 1341332762: ('0.10972315289713054',), 1341332757: ('0.10972315289713054',), 1341226649: ('0.10972315289713054',), 1341226638: ('0.10972315289713054',), 1341226634: ('0.10972315289713054',), 1341224791: ('0.10972315289713054',), 1341224771: ('0.10972315289713054',), 1341224730: ('0.10972315289713054',), 1341224658: ('0.10972315289713054',), 1341224617: ('0.10972315289713054',), 1341224425: ('0.10972315289713054',), 1341224372: ('0.10972315289713054',), 1341224318: ('0.10972315289713054',), 1341224287: ('0.10972315289713054',), 1341224263: ('0.10972315289713054',), 1341224254: ('0.10972315289713054',), 1341223756: ('0.10972315289713054',), 1341223734: ('0.10972315289713054',), 1341223731: ('0.10972315289713054',), 1341223025: ('0.10972315289713054',), 1341222817: ('0.10972315289713054',), 1341222544: ('0.10972315289713054',), 1341222515: ('0.10972315289713054',), 1341221914: ('0.10972315289713054',), 1341221867: ('0.10972315289713054',), 1341221856: ('0.10972315289713054',), 1341221846: ('0.10972315289713054',), 1341221842: ('0.10972315289713054',), 1341221775: ('0.10972315289713054',), 1341221773: ('0.10972315289713054',), 1341221768: ('0.10972315289713054',), 1341221763: ('0.10972315289713054',), 1341221757: ('0.10972315289713054',), 1341221751: ('0.10972315289713054',), 1341221683: ('0.10972315289713054',), 1341221674: ('0.10972315289713054',), 1341221668: ('0.10972315289713054',), 1341221664: ('0.10972315289713054',), 1341221660: ('0.10972315289713054',), 1341221656: ('0.10972315289713054',), 1341221641: ('0.10972315289713054',), 1341221636: ('0.10972315289713054',), 1341221630: ('0.10972315289713054',), 1341221625: ('0.10972315289713054',), 1341221621: ('0.10972315289713054',), 1341221615: ('0.10972315289713054',)} [1341334675, 1341334259, 1341334255, 1341334248, 1341334195, 1341334179, 1341334174, 1341334074, 1341334070, 1341334065, 1341333828, 1341333824, 1341333805, 1341333796, 1341333787, 1341333775, 1341333771, 1341333723, 1341333266, 1341333260, 1341333256, 1341333252, 1341333247, 1341333242, 1341332985, 1341332878, 1341332857, 1341332853, 1341332848, 1341332843, 1341332810, 1341332806, 1341332801, 1341332795, 1341332789, 1341332783, 1341332762, 1341332757, 1341226649, 1341226638, 1341226634, 1341224791, 1341224771, 1341224730, 1341224658, 1341224617, 1341224425, 1341224372, 1341224318, 1341224287, 1341224263, 1341224254, 1341223756, 1341223734, 1341223731, 1341223025, 1341222817, 1341222544, 1341222515, 1341221914, 1341221867, 1341221856, 1341221846, 1341221842, 1341221775, 1341221773, 1341221768, 1341221763, 1341221757, 1341221751, 1341221683, 1341221674, 1341221668, 1341221664, 1341221660, 1341221656, 1341221641, 1341221636, 1341221630, 1341221625, 1341221621, 1341221615] Looping around the photos to save general results len do output : 82 /1341334675.Didn't retrieve data . /1341334259.Didn't retrieve data . /1341334255.Didn't retrieve data . /1341334248.Didn't retrieve data . /1341334195.Didn't retrieve data . /1341334179.Didn't retrieve data . /1341334174.Didn't retrieve data . /1341334074.Didn't retrieve data . /1341334070.Didn't retrieve data . /1341334065.Didn't retrieve data . /1341333828.Didn't retrieve data . /1341333824.Didn't retrieve data . /1341333805.Didn't retrieve data . /1341333796.Didn't retrieve data . /1341333787.Didn't retrieve data . /1341333775.Didn't retrieve data . /1341333771.Didn't retrieve data . /1341333723.Didn't retrieve data . /1341333266.Didn't retrieve data . /1341333260.Didn't retrieve data . /1341333256.Didn't retrieve data . /1341333252.Didn't retrieve data . /1341333247.Didn't retrieve data . /1341333242.Didn't retrieve data . /1341332985.Didn't retrieve data . /1341332878.Didn't retrieve data . /1341332857.Didn't retrieve data . /1341332853.Didn't retrieve data . /1341332848.Didn't retrieve data . /1341332843.Didn't retrieve data . /1341332810.Didn't retrieve data . /1341332806.Didn't retrieve data . /1341332801.Didn't retrieve data . /1341332795.Didn't retrieve data . /1341332789.Didn't retrieve data . /1341332783.Didn't retrieve data . /1341332762.Didn't retrieve data . /1341332757.Didn't retrieve data . /1341226649.Didn't retrieve data . /1341226638.Didn't retrieve data . /1341226634.Didn't retrieve data . /1341224791.Didn't retrieve data . /1341224771.Didn't retrieve data . /1341224730.Didn't retrieve data . /1341224658.Didn't retrieve data . /1341224617.Didn't retrieve data . /1341224425.Didn't retrieve data . /1341224372.Didn't retrieve data . /1341224318.Didn't retrieve data . /1341224287.Didn't retrieve data . /1341224263.Didn't retrieve data . /1341224254.Didn't retrieve data . /1341223756.Didn't retrieve data . /1341223734.Didn't retrieve data . /1341223731.Didn't retrieve data . /1341223025.Didn't retrieve data . /1341222817.Didn't retrieve data . /1341222544.Didn't retrieve data . /1341222515.Didn't retrieve data . /1341221914.Didn't retrieve data . /1341221867.Didn't retrieve data . /1341221856.Didn't retrieve data . /1341221846.Didn't retrieve data . /1341221842.Didn't retrieve data . /1341221775.Didn't retrieve data . /1341221773.Didn't retrieve data . /1341221768.Didn't retrieve data . /1341221763.Didn't retrieve data . /1341221757.Didn't retrieve data . /1341221751.Didn't retrieve data . /1341221683.Didn't retrieve data . /1341221674.Didn't retrieve data . /1341221668.Didn't retrieve data . /1341221664.Didn't retrieve data . /1341221660.Didn't retrieve data . /1341221656.Didn't retrieve data . /1341221641.Didn't retrieve data . /1341221636.Didn't retrieve data . /1341221630.Didn't retrieve data . /1341221625.Didn't retrieve data . /1341221621.Didn't retrieve data . /1341221615.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334675', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334259', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334255', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334248', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334195', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334179', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334174', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334074', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334070', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334065', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333828', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333824', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333805', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333796', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333787', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333775', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333771', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333723', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333266', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333260', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333256', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333252', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333247', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333242', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332985', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332878', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332857', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332853', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332848', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332843', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332810', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332806', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332801', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332795', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332789', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332783', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332762', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332757', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341226649', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341226638', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341226634', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224791', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224771', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224730', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224658', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224617', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224425', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224372', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224318', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224287', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224263', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224254', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341223756', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341223734', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341223731', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341223025', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341222817', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341222544', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341222515', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221914', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221867', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221856', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221846', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221842', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221775', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221773', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221768', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221763', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221757', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221751', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221683', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221674', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221668', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221664', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221660', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221656', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221641', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221636', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221630', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221625', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221621', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221615', None, None, None, None, None, '2692915') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 246 time used for this insertion : 0.024665117263793945 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11994767189025879 time spend to save output : 0.026982545852661133 total time spend for step 5 : 0.14693021774291992 step6:blur_detection Wed Mar 26 15:44:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 82 time used for this insertion : 0.013443946838378906 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 82 time used for this insertion : 5.448734760284424 save missing photos in datou_result : time spend for datou_step_exec : 1.737205982208252 time spend to save output : 5.46724009513855 total time spend for step 6 : 7.204446077346802 step7:brightness Wed Mar 26 15:44:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 82 time used for this insertion : 0.023339271545410156 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 82 time used for this insertion : 0.014893293380737305 save missing photos in datou_result : time spend for datou_step_exec : 0.05641794204711914 time spend to save output : 0.04335451126098633 total time spend for step 7 : 0.09977245330810547 step8:send_mail_cod Wed Mar 26 15:44:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_COD_P21164283_26-03-2025_15_44_27.pdf 21164877 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211648771743000267 21164878 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211648781743000270 21164879 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211648791743000272 21164880 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211648801743000275 21164881 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211648811743000276 21164883 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211648831743000278 21164885 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211648851743000281 21164887 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211648871743000283 21164888 imagette211648881743000285 21164891 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211648911743000285 21164892 change filename to text .change filename to text .imagette211648921743000288 21164893 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211648931743000288 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=21164283 and hashtag_type = 4211 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/21164876,21164877,21164878,21164879,21164880,21164881,21164883,21164884,21164885,21164886,21164887,21164888,21164889,21164891,21164892,21164893?tags=flou,carton,film_plastique,papier,metal,kraft,pet_clair,pehd,etiquette,environnement,ela,textiles_sanitaires,mal_croppe,pet_opaque,pet_fonce,barquette_opaque your option no_mail is active, we will not send the real mail to your client args[1341334675] : ((1341334675, -0.4482835304274542, 492688767), (1341334675, -0.16064135169122096, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341334259] : ((1341334259, -0.8195960008512554, 492688767), (1341334259, -0.24133817560772702, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341334255] : ((1341334255, -5.111357379975826, 492609224), (1341334255, -0.03568589285431659, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341334248] : ((1341334248, -3.6049275196229473, 492609224), (1341334248, -0.07525473433109653, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341334195] : ((1341334195, -4.642763368261457, 492609224), (1341334195, -0.06910096011334255, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341334179] : ((1341334179, -3.8143327246894283, 492609224), (1341334179, -0.0499876057704517, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341334174] : ((1341334174, -3.945135079731504, 492609224), (1341334174, -0.1705450873195274, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341334074] : ((1341334074, -4.668562382050527, 492609224), (1341334074, -0.021516919678272062, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341334070] : ((1341334070, -4.036134502334188, 492609224), (1341334070, -0.08362965018841496, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341334065] : ((1341334065, -2.5948447618153883, 492609224), (1341334065, 0.09131480388294447, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341333828] : ((1341333828, -4.182618104126175, 492609224), (1341333828, -0.05195660184753713, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341333824] : ((1341333824, -4.091843547657188, 492609224), (1341333824, 0.022362948787056466, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341333805] : ((1341333805, -3.626390529773642, 492609224), (1341333805, -0.08068581152480639, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341333796] : ((1341333796, -3.609777685189616, 492609224), (1341333796, -0.18846063237831143, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341333787] : ((1341333787, -3.6255421747339827, 492609224), (1341333787, -0.0679302934391234, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341333775] : ((1341333775, -4.043157422773086, 492609224), (1341333775, -0.1397280256768001, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341333771] : ((1341333771, -4.348318899566597, 492609224), (1341333771, -0.00723570635709738, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341333723] : ((1341333723, -3.8381518169785998, 492609224), (1341333723, -0.03703972128922191, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341333266] : ((1341333266, -6.764998327030822, 492609224), (1341333266, -0.07834180984397233, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341333260] : ((1341333260, -4.454508151882769, 492609224), (1341333260, -0.08215573628816018, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341333256] : ((1341333256, -3.984510038430516, 492609224), (1341333256, -0.16483446443114277, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341333252] : ((1341333252, -3.5997193342699223, 492609224), (1341333252, -0.03688494064251033, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341333247] : ((1341333247, -1.9768776840606805, 492688767), (1341333247, 0.08260649878087359, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341333242] : ((1341333242, -3.8472314947815502, 492609224), (1341333242, -0.0343074471372058, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341332985] : ((1341332985, -2.957160454966339, 492609224), (1341332985, -0.15546280207081986, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341332878] : ((1341332878, -3.0853470488623853, 492609224), (1341332878, -0.2283016757130513, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341332857] : ((1341332857, -2.165104231051304, 492609224), (1341332857, -0.2348731440681082, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341332853] : ((1341332853, -2.036443105242382, 492609224), (1341332853, -0.38779441192102343, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341332848] : ((1341332848, -0.9377797521350741, 492688767), (1341332848, -0.1453507476221805, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341332843] : ((1341332843, -1.1548179460878567, 492688767), (1341332843, -0.09473985573491375, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341332810] : ((1341332810, -1.7748251886602429, 492688767), (1341332810, -0.2038922366257935, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341332806] : ((1341332806, -3.758671599024187, 492609224), (1341332806, 0.02395307190663873, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341332801] : ((1341332801, -3.4816337670108632, 492609224), (1341332801, -0.14248935906572013, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341332795] : ((1341332795, -3.6437774158431733, 492609224), (1341332795, 0.01946976353458835, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341332789] : ((1341332789, -2.9719166225942155, 492609224), (1341332789, -0.06490810051776821, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341332783] : ((1341332783, -3.5158326947505008, 492609224), (1341332783, -0.06282022698683809, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341332762] : ((1341332762, -3.8302589054338014, 492609224), (1341332762, 0.048041044710676835, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341332757] : ((1341332757, -3.920723253738623, 492609224), (1341332757, -0.1702681983546811, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341226649] : ((1341226649, -1.7000984717058971, 492688767), (1341226649, -0.1874895249087733, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341226638] : ((1341226638, -3.4767606322438347, 492609224), (1341226638, -0.1847801019806891, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341226634] : ((1341226634, -2.8853393458943355, 492609224), (1341226634, -0.2204235091289388, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341224791] : ((1341224791, -2.904331119396288, 492609224), (1341224791, -0.1769566157977521, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341224771] : ((1341224771, -3.978644997583856, 492609224), (1341224771, -0.12148921763903041, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341224730] : ((1341224730, -3.851199212802958, 492609224), (1341224730, -0.03628436908687365, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341224658] : ((1341224658, -6.106852761675108, 492609224), (1341224658, -0.3017608019826679, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341224617] : ((1341224617, -2.59746775697424, 492609224), (1341224617, -0.2977605984767019, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341224425] : ((1341224425, -0.6321888445829312, 492688767), (1341224425, -0.23092396546198643, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341224372] : ((1341224372, -3.727078803983679, 492609224), (1341224372, -0.11701903416779177, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341224318] : ((1341224318, -3.3770158491212428, 492609224), (1341224318, -0.14833598819610597, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341224287] : ((1341224287, -3.7239361695852655, 492609224), (1341224287, -0.03926565210039574, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341224263] : ((1341224263, -3.2564131388372224, 492609224), (1341224263, -0.13490561501949713, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341224254] : ((1341224254, -2.702796431551475, 492609224), (1341224254, -0.28815226639522035, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341223756] : ((1341223756, -2.274232308756048, 492609224), (1341223756, 0.07067006625095366, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341223734] : ((1341223734, -3.83515765321247, 492609224), (1341223734, -0.09400553783288418, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341223731] : ((1341223731, -4.831851190982399, 492609224), (1341223731, -0.161241518708162, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341223025] : ((1341223025, -3.817002300539396, 492609224), (1341223025, -0.15824001624978393, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341222817] : ((1341222817, -6.279012713396789, 492609224), (1341222817, -0.09078893673515746, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341222544] : ((1341222544, -0.9322987789018119, 492688767), (1341222544, -0.27802319791279045, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341222515] : ((1341222515, 2.4306247433219963, 492688767), (1341222515, -0.08549253372975313, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341221914] : ((1341221914, -4.119146085172849, 492609224), (1341221914, -0.06377640085512225, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341221867] : ((1341221867, -6.2551107870057665, 492609224), (1341221867, -0.21756160138609099, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341221856] : ((1341221856, -2.3992116405923873, 492609224), (1341221856, -0.10600871077728012, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341221846] : ((1341221846, -3.8389205249778535, 492609224), (1341221846, -0.08289297941723986, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341221842] : ((1341221842, -6.273594393743284, 492609224), (1341221842, -0.20368270455125326, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341221775] : ((1341221775, -0.9992600397295573, 492688767), (1341221775, -0.1671900607554374, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341221773] : ((1341221773, -1.015506784727367, 492688767), (1341221773, -0.420087282683884, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341221768] : ((1341221768, -3.285106778283899, 492609224), (1341221768, -0.343896970942983, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341221763] : ((1341221763, -3.6668395338527997, 492609224), (1341221763, -0.28590031148880285, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341221757] : ((1341221757, -0.950424019711554, 492688767), (1341221757, -0.4177081227845191, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341221751] : ((1341221751, -3.5423430897662342, 492609224), (1341221751, -0.11325602501020995, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341221683] : ((1341221683, -2.9270978973612256, 492609224), (1341221683, -0.18948905096685295, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341221674] : ((1341221674, -4.21780182662286, 492609224), (1341221674, -0.06379800826753676, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341221668] : ((1341221668, -2.275059639142915, 492609224), (1341221668, -0.020200464690173225, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341221664] : ((1341221664, -2.761469026662662, 492609224), (1341221664, -0.2756507697308157, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341221660] : ((1341221660, -2.433135449368259, 492609224), (1341221660, -0.2543995730625308, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341221656] : ((1341221656, -0.8149969809386651, 492688767), (1341221656, -0.2543337434704707, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341221641] : ((1341221641, -4.111522065907125, 492609224), (1341221641, -0.10183627858354916, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341221636] : ((1341221636, -4.388508202597065, 492609224), (1341221636, -0.16276853882471398, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341221630] : ((1341221630, -3.6000945165630447, 492609224), (1341221630, 0.02753744623164953, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341221625] : ((1341221625, -3.91326367613473, 492609224), (1341221625, -0.12220550360340086, 496442774), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341221621] : ((1341221621, -3.9712691495322083, 492609224), (1341221621, 0.009434961661677522, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com args[1341221615] : ((1341221615, -3.5333366133611093, 492609224), (1341221615, 0.024934386494259397, 2107752395), '0.10972315289713054') We are sending mail with results at kexin@fotonower.com refus_total : 0.10972315289713054 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21164283 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1341221775,1341221683,1341334248,1341221641,1341332853,1341332857,1341221615,1341334255,1341334074,1341226649,1341221768,1341226634,1341224791,1341224771,1341224658,1341333771,1341223025,1341223731,1341224287,1341224254) Found this number of photos: 20 begin to download photo : 1341221775 begin to download photo : 1341332857 begin to download photo : 1341221768 begin to download photo : 1341333771 download finish for photo 1341221775 begin to download photo : 1341221683 download finish for photo 1341332857 begin to download photo : 1341221615 download finish for photo 1341221768 begin to download photo : 1341226634 download finish for photo 1341221683 begin to download photo : 1341334248 download finish for photo 1341333771 begin to download photo : 1341223025 download finish for photo 1341221615 begin to download photo : 1341334255 download finish for photo 1341226634 begin to download photo : 1341224791 download finish for photo 1341223025 begin to download photo : 1341223731 download finish for photo 1341334255 begin to download photo : 1341334074 download finish for photo 1341224791 begin to download photo : 1341224771 download finish for photo 1341223731 begin to download photo : 1341224287 download finish for photo 1341334248 begin to download photo : 1341221641 download finish for photo 1341224771 begin to download photo : 1341224658 download finish for photo 1341334074 begin to download photo : 1341226649 download finish for photo 1341224287 begin to download photo : 1341224254 download finish for photo 1341221641 begin to download photo : 1341332853 download finish for photo 1341224658 download finish for photo 1341226649 download finish for photo 1341332853 download finish for photo 1341224254 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_COD_P21164283_26-03-2025_15_44_27.pdf results_COD_P21164283_26-03-2025_15_44_27.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_COD_P21164283_26-03-2025_15_44_27.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4252','21164283','results_COD_P21164283_26-03-2025_15_44_27.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_COD_P21164283_26-03-2025_15_44_27.pdf','pdf','','1.5','0.10972315289713054') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1341334675, 1341334259, 1341334255, 1341334248, 1341334195, 1341334179, 1341334174, 1341334074, 1341334070, 1341334065, 1341333828, 1341333824, 1341333805, 1341333796, 1341333787, 1341333775, 1341333771, 1341333723, 1341333266, 1341333260, 1341333256, 1341333252, 1341333247, 1341333242, 1341332985, 1341332878, 1341332857, 1341332853, 1341332848, 1341332843, 1341332810, 1341332806, 1341332801, 1341332795, 1341332789, 1341332783, 1341332762, 1341332757, 1341226649, 1341226638, 1341226634, 1341224791, 1341224771, 1341224730, 1341224658, 1341224617, 1341224425, 1341224372, 1341224318, 1341224287, 1341224263, 1341224254, 1341223756, 1341223734, 1341223731, 1341223025, 1341222817, 1341222544, 1341222515, 1341221914, 1341221867, 1341221856, 1341221846, 1341221842, 1341221775, 1341221773, 1341221768, 1341221763, 1341221757, 1341221751, 1341221683, 1341221674, 1341221668, 1341221664, 1341221660, 1341221656, 1341221641, 1341221636, 1341221630, 1341221625, 1341221621, 1341221615] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334675', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334259', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334255', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334248', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334195', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334179', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334174', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334074', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334070', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334065', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333828', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333824', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333805', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333796', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333787', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333775', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333771', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333723', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333266', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333260', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333256', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333252', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333247', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333242', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332985', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332878', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332857', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332853', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332848', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332843', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332810', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332806', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332801', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332795', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332789', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332783', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332762', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332757', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341226649', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341226638', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341226634', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224791', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224771', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224730', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224658', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224617', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224425', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224372', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224318', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224287', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224263', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224254', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341223756', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341223734', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341223731', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341223025', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341222817', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341222544', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341222515', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221914', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221867', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221856', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221846', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221842', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221775', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221773', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221768', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221763', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221757', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221751', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221683', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221674', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221668', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221664', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221660', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221656', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221641', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221636', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221630', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221625', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221621', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221615', None, None, None, None, None, '2692915') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 82 time used for this insertion : 0.024856090545654297 save_final save missing photos in datou_result : time spend for datou_step_exec : 28.134852170944214 time spend to save output : 0.025699615478515625 total time spend for step 8 : 28.16055178642273 step9:split_time_score Wed Mar 26 15:44:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 82),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 06032025 21164283 Nombre de photos uploadées : 82 / 23040 (0%) 06032025 21164283 Nombre de photos taguées (types de déchets): 0 / 82 (0%) 06032025 21164283 Nombre de photos taguées (volume) : 0 / 82 (0%) elapsed_time : load_data_split_time_score 2.6226043701171875e-06 elapsed_time : order_list_meta_photo_and_scores 7.3909759521484375e-06 ?????????????????????????????????????????????????????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.003984928131103516 elapsed_time : insert_dashboard_record_day_entry 0.024987459182739258 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.20573153740662947 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164242_08-03-2025_03_04_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164242 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21164242 AND mptpi.`type`=3594 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164243_08-03-2025_01_26_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164243 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164244_08-03-2025_03_57_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164244 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164245_08-03-2025_04_13_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164245 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164246_08-03-2025_05_24_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164246 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164247_08-03-2025_02_27_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164247 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164248_08-03-2025_04_05_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164248 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164249_08-03-2025_03_49_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164249 order by id desc limit 1 Qualite : 0.2540632014590348 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164250_08-03-2025_02_33_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164250 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21164250 AND mptpi.`type`=3594 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164251_08-03-2025_03_41_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164251 order by id desc limit 1 Qualite : 0.19687042568763605 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164252_08-03-2025_02_18_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164252 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21164252 AND mptpi.`type`=3594 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164253_08-03-2025_00_20_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164253 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164254_08-03-2025_03_46_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164254 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164255_08-03-2025_03_50_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164255 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164256_08-03-2025_00_31_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164256 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164257_08-03-2025_03_37_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164257 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164258_08-03-2025_03_40_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164258 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164259_08-03-2025_03_29_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164259 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164260_08-03-2025_03_30_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164260 order by id desc limit 1 Qualite : 0.2512697794685003 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164261_08-03-2025_02_00_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164261 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21164261 AND mptpi.`type`=3594 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164262_08-03-2025_03_26_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164262 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164263_08-03-2025_03_40_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164263 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164264_08-03-2025_03_28_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164264 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164279_08-03-2025_03_17_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164279 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164280_08-03-2025_03_15_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164280 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164281_08-03-2025_02_53_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164281 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164282_08-03-2025_02_42_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164282 order by id desc limit 1 Qualite : 0.10972315289713054 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_COD_P21164283_26-03-2025_15_44_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164283 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11617 copy_chis is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11618 consolidate_hashtags_from_manual_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11615 rle_unique_nms_with_priority is not consistent : 3 used against 1 in the step definition ! WARNING : number of outputs for step 11615 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11622 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11616 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11619 blur_detection have less inputs used (0) than in the step definition (1) : maybe we manage optionnal inputs ! Step 11620 brightness have less inputs used (0) than in the step definition (1) : maybe we manage optionnal inputs ! Step 11621 send_mail_cod have less inputs used (4) than in the step definition (5) : maybe we manage optionnal inputs ! Step 11623 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11617 have datatype=11 whereas input 0 of step 11615 have datatype=2 WARNING : type of output 1 of step 11618 doesn't seem to be define in the database( WARNING : type of input 3 of step 11616 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11618 doesn't seem to be define in the database( WARNING : type of input 1 of step 11615 doesn't seem to be define in the database( WARNING : output 0 of step 11622 have datatype=10 whereas input 3 of step 11621 have datatype=6 WARNING : type of input 1 of step 11622 doesn't seem to be define in the database( WARNING : output 1 of step 11615 have datatype=7 whereas input 1 of step 11622 have datatype=None WARNING : type of output 1 of step 11622 doesn't seem to be define in the database( WARNING : type of input 4 of step 11616 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11617 doesn't seem to be define in the database( WARNING : type of input 1 of step 11618 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21164283 AND mptpi.`type`=4211 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21132535_11-03-2025_19_41_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21132535 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164284_08-03-2025_05_22_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164284 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164302_08-03-2025_01_50_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164302 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164303_08-03-2025_03_13_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164303 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164304_08-03-2025_00_31_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164304 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164305_08-03-2025_02_44_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164305 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21131105_11-03-2025_00_29_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21131105 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21131106_07-03-2025_01_05_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21131106 order by id desc limit 1 Qualite : 0.2403201734976397 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21131107_07-03-2025_01_22_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21131107 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21131107 AND mptpi.`type`=3594 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21131108_11-03-2025_21_27_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21131108 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164306_08-03-2025_02_45_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164306 order by id desc limit 1 Qualite : 0.23950699235455492 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21131110_07-03-2025_00_45_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21131110 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21131110 AND mptpi.`type`=3594 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164307_08-03-2025_02_55_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164307 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164315_08-03-2025_02_49_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164315 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164323_08-03-2025_06_22_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164323 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164327_08-03-2025_02_44_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164327 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164328_08-03-2025_02_52_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164328 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164329_08-03-2025_00_31_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164329 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164330_08-03-2025_00_23_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164330 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164337_08-03-2025_00_45_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164337 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164349_08-03-2025_04_20_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164349 order by id desc limit 1 Qualite : 0.24659821273223817 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21131864 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21131864 AND mptpi.`type`=3594 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164350_08-03-2025_00_55_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164350 order by id desc limit 1 Qualite : 0.21941792052469136 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164351_08-03-2025_01_58_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164351 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21164351 AND mptpi.`type`=3594 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164352_08-03-2025_02_21_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164352 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164353_08-03-2025_00_40_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164353 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164370_08-03-2025_00_23_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164370 order by id desc limit 1 Qualite : 0.22215740173384166 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21131114_07-03-2025_00_29_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21131114 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21131114 AND mptpi.`type`=3594 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164371_08-03-2025_00_34_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164371 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164378_08-03-2025_00_36_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164378 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164390_08-03-2025_02_21_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164390 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164391_08-03-2025_02_14_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164391 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164392_08-03-2025_00_37_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164392 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164393_08-03-2025_00_25_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164393 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164394_08-03-2025_00_44_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164394 order by id desc limit 1 Qualite : 0.0 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164395_08-03-2025_01_22_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164395 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21164395 AND mptpi.`type`=3594 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164396_08-03-2025_00_32_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164396 order by id desc limit 1 Qualite : 0.165751626894971 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164397_08-03-2025_00_37_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164397 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21164397 AND mptpi.`type`=3594 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164398_08-03-2025_00_24_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164398 order by id desc limit 1 Qualite : 0.19987734782465166 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164399_08-03-2025_01_39_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164399 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21164399 AND mptpi.`type`=3594 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164400_08-03-2025_00_24_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164400 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164401_08-03-2025_00_22_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164401 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21164402_08-03-2025_00_35_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21164402 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'06032025': {'nb_upload': 82, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1341334675, 1341334259, 1341334255, 1341334248, 1341334195, 1341334179, 1341334174, 1341334074, 1341334070, 1341334065, 1341333828, 1341333824, 1341333805, 1341333796, 1341333787, 1341333775, 1341333771, 1341333723, 1341333266, 1341333260, 1341333256, 1341333252, 1341333247, 1341333242, 1341332985, 1341332878, 1341332857, 1341332853, 1341332848, 1341332843, 1341332810, 1341332806, 1341332801, 1341332795, 1341332789, 1341332783, 1341332762, 1341332757, 1341226649, 1341226638, 1341226634, 1341224791, 1341224771, 1341224730, 1341224658, 1341224617, 1341224425, 1341224372, 1341224318, 1341224287, 1341224263, 1341224254, 1341223756, 1341223734, 1341223731, 1341223025, 1341222817, 1341222544, 1341222515, 1341221914, 1341221867, 1341221856, 1341221846, 1341221842, 1341221775, 1341221773, 1341221768, 1341221763, 1341221757, 1341221751, 1341221683, 1341221674, 1341221668, 1341221664, 1341221660, 1341221656, 1341221641, 1341221636, 1341221630, 1341221625, 1341221621, 1341221615] Looping around the photos to save general results len do output : 1 /21164283Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334675', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334259', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334255', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334248', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334195', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334179', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334174', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334074', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334070', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341334065', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333828', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333824', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333805', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333796', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333787', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333775', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333771', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333723', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333266', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333260', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333256', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333252', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333247', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341333242', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332985', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332878', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332857', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332853', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332848', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332843', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332810', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332806', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332801', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332795', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332789', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332783', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332762', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341332757', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341226649', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341226638', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341226634', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224791', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224771', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224730', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224658', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224617', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224425', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224372', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224318', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224287', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224263', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341224254', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341223756', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341223734', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341223731', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341223025', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341222817', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341222544', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341222515', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221914', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221867', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221856', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221846', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221842', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221775', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221773', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221768', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221763', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221757', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221751', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221683', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221674', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221668', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221664', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221660', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221656', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221641', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221636', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221630', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221625', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221621', None, None, None, None, None, '2692915') ('4252', None, None, None, None, None, None, None, '2692915') ('4252', '21164283', '1341221615', None, None, None, None, None, '2692915') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 83 time used for this insertion : 0.3794856071472168 save_final save missing photos in datou_result : time spend for datou_step_exec : 38.08283543586731 time spend to save output : 0.3799784183502197 total time spend for step 9 : 38.46281385421753 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 82 set_done_treatment 11.31user 2.39system 3:10.02elapsed 7%CPU (0avgtext+0avgdata 164848maxresident)k 1104inputs+236816outputs (1major+114165minor)pagefaults 0swaps