python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4252 ' -s datou_consolidate -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1055250 load datou : 4252 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11617 copy_chis is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11618 consolidate_hashtags_from_manual_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11615 rle_unique_nms_with_priority is not consistent : 3 used against 1 in the step definition ! WARNING : number of outputs for step 11615 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11622 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11616 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11619 blur_detection have less inputs used (0) than in the step definition (1) : maybe we manage optionnal inputs ! Step 11620 brightness have less inputs used (0) than in the step definition (1) : maybe we manage optionnal inputs ! Step 11621 send_mail_cod have less inputs used (4) than in the step definition (5) : maybe we manage optionnal inputs ! Step 11623 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11617 have datatype=11 whereas input 0 of step 11615 have datatype=2 WARNING : type of output 1 of step 11618 doesn't seem to be define in the database( WARNING : type of input 3 of step 11616 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11618 doesn't seem to be define in the database( WARNING : type of input 1 of step 11615 doesn't seem to be define in the database( WARNING : output 0 of step 11622 have datatype=10 whereas input 3 of step 11621 have datatype=6 WARNING : type of input 1 of step 11622 doesn't seem to be define in the database( WARNING : output 1 of step 11615 have datatype=7 whereas input 1 of step 11622 have datatype=None WARNING : type of output 1 of step 11622 doesn't seem to be define in the database( WARNING : type of input 4 of step 11616 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11617 doesn't seem to be define in the database( WARNING : type of input 1 of step 11618 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : id de la photo (peut être local ou global) was removed should we ? donnée sous forme de nombre was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Current got : datou_id : 4252, datou_cur_ids : ['2612839'] with mtr_portfolio_ids : ['20341587'] and first list_photo_ids : [] new path : /proc/1055250/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11617 copy_chis is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11618 consolidate_hashtags_from_manual_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11615 rle_unique_nms_with_priority is not consistent : 3 used against 1 in the step definition ! WARNING : number of outputs for step 11615 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11622 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11616 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11619 blur_detection have less inputs used (0) than in the step definition (1) : maybe we manage optionnal inputs ! Step 11620 brightness have less inputs used (0) than in the step definition (1) : maybe we manage optionnal inputs ! Step 11621 send_mail_cod have less inputs used (4) than in the step definition (5) : maybe we manage optionnal inputs ! Step 11623 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11617 have datatype=11 whereas input 0 of step 11615 have datatype=2 WARNING : type of output 1 of step 11618 doesn't seem to be define in the database( WARNING : type of input 3 of step 11616 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11618 doesn't seem to be define in the database( WARNING : type of input 1 of step 11615 doesn't seem to be define in the database( WARNING : output 0 of step 11622 have datatype=10 whereas input 3 of step 11621 have datatype=6 WARNING : type of input 1 of step 11622 doesn't seem to be define in the database( WARNING : output 1 of step 11615 have datatype=7 whereas input 1 of step 11622 have datatype=None WARNING : type of output 1 of step 11622 doesn't seem to be define in the database( WARNING : type of input 4 of step 11616 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11617 doesn't seem to be define in the database( WARNING : type of input 1 of step 11618 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : copy_chis, consolidate_hashtags_from_manual_portfolio, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, send_mail_cod, split_time_score over limit max, limiting to limit_max 100 list_input_json : {} origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 51 ; length of list_pids : 51 ; length of list_args : 51 time to download the photos : 16.922305822372437 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 9 step1:copy_chis Tue Feb 25 13:36:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Begin step datou_step_copy_crop batch 1 Loaded 60 chid ids of type : 4211 batch 1 Loaded 1679 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : copy_chis we use saveGeneral [1335067147, 1335067144, 1335067139, 1335067121, 1335067117, 1335067115, 1335067103, 1335067101, 1335067098, 1335067088, 1335067085, 1335067076, 1335067033, 1335067012, 1335067009, 1335066999, 1335066849, 1335066793, 1335066591, 1335066541, 1334933135, 1334933119, 1334933066, 1334933061, 1334933056, 1334933033, 1334932863, 1334932826, 1334932819, 1334932814, 1334932535, 1334932489, 1334932464, 1334932462, 1334932460, 1334932441, 1334932438, 1334932431, 1334932372, 1334932369, 1334932366, 1334932363, 1334932360, 1334932356, 1334932186, 1334932110, 1334932107, 1334932104, 1334932101, 1334932098, 1334932006] Looping around the photos to save general results len do output : 51 /1334932006Didn't retrieve data . /1334932098Didn't retrieve data . /1334932101Didn't retrieve data . /1334932104Didn't retrieve data . /1334932107Didn't retrieve data . /1334932110Didn't retrieve data . /1334932186Didn't retrieve data . /1334932356Didn't retrieve data . /1334932360Didn't retrieve data . /1334932363Didn't retrieve data . /1334932366Didn't retrieve data . /1334932369Didn't retrieve data . /1334932372Didn't retrieve data . /1334932431Didn't retrieve data . /1334932438Didn't retrieve data . /1334932441Didn't retrieve data . /1334932460Didn't retrieve data . /1334932462Didn't retrieve data . /1334932464Didn't retrieve data . /1334932489Didn't retrieve data . /1334932535Didn't retrieve data . /1334932814Didn't retrieve data . /1334932819Didn't retrieve data . /1334932826Didn't retrieve data . /1334932863Didn't retrieve data . /1334933033Didn't retrieve data . /1334933056Didn't retrieve data . /1334933061Didn't retrieve data . /1334933066Didn't retrieve data . /1334933119Didn't retrieve data . /1334933135Didn't retrieve data . /1335066541Didn't retrieve data . /1335066591Didn't retrieve data . /1335066793Didn't retrieve data . /1335066849Didn't retrieve data . /1335066999Didn't retrieve data . /1335067009Didn't retrieve data . /1335067012Didn't retrieve data . /1335067033Didn't retrieve data . /1335067076Didn't retrieve data . /1335067085Didn't retrieve data . /1335067088Didn't retrieve data . /1335067098Didn't retrieve data . /1335067101Didn't retrieve data . /1335067103Didn't retrieve data . /1335067115Didn't retrieve data . /1335067117Didn't retrieve data . /1335067121Didn't retrieve data . /1335067139Didn't retrieve data . /1335067144Didn't retrieve data . /1335067147Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067147', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067144', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067139', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067121', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067117', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067115', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067103', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067101', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067098', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067088', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067085', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067076', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067033', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067012', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067009', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066999', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066849', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066793', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066591', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066541', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933135', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933119', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933066', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933061', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933056', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933033', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932863', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932826', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932819', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932814', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932535', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932489', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932464', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932462', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932460', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932441', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932438', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932431', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932372', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932369', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932366', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932363', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932360', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932356', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932186', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932110', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932107', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932104', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932101', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932098', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932006', None, None, None, None, None, '2612839') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 102 time used for this insertion : 0.026378631591796875 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.5012423992156982 time spend to save output : 0.027577877044677734 total time spend for step 1 : 0.528820276260376 step2:consolidate_hashtags_from_manual_portfolio Tue Feb 25 13:36:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step consolidate_hashtags_from_manual_portfolio Iterating over portfolio : 20341587 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20341587 AND mptpi.`type`=4211 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('barquette_opaque','carton','ela','environnement','etiquette','film_plastique','kraft','metal','papier','pehd','pet_clair','pet_opaque','textiles_sanitaires','pet_fonce','mal_croppe','flou','background')) To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20341587 AND mptpi.`type`=4211 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('barquette_opaque','carton','ela','environnement','etiquette','film_plastique','kraft','metal','papier','pehd','pet_clair','pet_opaque','textiles_sanitaires','pet_fonce','mal_croppe','flou','background')) To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20341587 AND mptpi.`type`=4211 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('barquette_opaque','carton','ela','environnement','etiquette','film_plastique','kraft','metal','papier','pehd','pet_clair','pet_opaque','textiles_sanitaires','pet_fonce','mal_croppe','flou','background')) To do TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20343544 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 688 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20343545 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 145 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20343546 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 1207 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20343547 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 642 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20343548 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 434 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20343549 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 894 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20343550 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 1633 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20343551 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 1143 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20343552 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 625 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20343553 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 1383 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20343554 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 1679 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20343555 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 1679 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20343556 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 46 chid ids of type : 4211 begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20343557 AND mpp.hide_status=0 ORDER BY ph.size desc TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20343558 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 449 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20343559 AND mpp.hide_status=0 ORDER BY ph.size desc batch 1 Loaded 1016 chid ids of type : 4211 begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : TODO : # On doit donc construire les chi a partir des informations dans les photos filles query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20803745 AND mpp.hide_status=0 ORDER BY ph.size desc To test ! Use context local managing function ! Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : consolidate_hashtags_from_manual_portfolio we use saveGeneral [1335067147, 1335067144, 1335067139, 1335067121, 1335067117, 1335067115, 1335067103, 1335067101, 1335067098, 1335067088, 1335067085, 1335067076, 1335067033, 1335067012, 1335067009, 1335066999, 1335066849, 1335066793, 1335066591, 1335066541, 1334933135, 1334933119, 1334933066, 1334933061, 1334933056, 1334933033, 1334932863, 1334932826, 1334932819, 1334932814, 1334932535, 1334932489, 1334932464, 1334932462, 1334932460, 1334932441, 1334932438, 1334932431, 1334932372, 1334932369, 1334932366, 1334932363, 1334932360, 1334932356, 1334932186, 1334932110, 1334932107, 1334932104, 1334932101, 1334932098, 1334932006] Looping around the photos to save general results len do output : 6 /Tassign value string error string indices must be integers invalid literal for int() with base 10: 'T' begin to insert list_values into mtr_datou_result : length of list_values in save_final : 51 time used for this insertion : 0.016735315322875977 save_final save missing photos in datou_result : time spend for datou_step_exec : 16.834758043289185 time spend to save output : 0.01696014404296875 total time spend for step 2 : 16.851718187332153 step3:rle_unique_nms_with_priority Tue Feb 25 13:37:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 1315 chid ids of type : 4211 seulement à utiliser dans la step consolidation batch 1 Loaded 29 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03052234649658203 seulement à utiliser dans la step consolidation batch 1 Loaded 35 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03132295608520508 seulement à utiliser dans la step consolidation batch 1 Loaded 31 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.0341944694519043 seulement à utiliser dans la step consolidation batch 1 Loaded 42 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03536844253540039 seulement à utiliser dans la step consolidation batch 1 Loaded 31 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.029633045196533203 seulement à utiliser dans la step consolidation batch 1 Loaded 36 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03162956237792969 seulement à utiliser dans la step consolidation batch 1 Loaded 38 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.035764455795288086 seulement à utiliser dans la step consolidation batch 1 Loaded 35 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03023076057434082 seulement à utiliser dans la step consolidation batch 1 Loaded 31 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.029939889907836914 seulement à utiliser dans la step consolidation batch 1 Loaded 46 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.0330357551574707 seulement à utiliser dans la step consolidation batch 1 Loaded 41 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.035419464111328125 seulement à utiliser dans la step consolidation batch 1 Loaded 33 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03269195556640625 seulement à utiliser dans la step consolidation batch 1 Loaded 29 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.034900665283203125 seulement à utiliser dans la step consolidation batch 1 Loaded 27 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03500652313232422 seulement à utiliser dans la step consolidation batch 1 Loaded 31 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.029456377029418945 seulement à utiliser dans la step consolidation batch 1 Loaded 26 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03121805191040039 seulement à utiliser dans la step consolidation batch 1 Loaded 26 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030194759368896484 seulement à utiliser dans la step consolidation batch 1 Loaded 17 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.029256582260131836 seulement à utiliser dans la step consolidation batch 1 Loaded 19 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.026822566986083984 seulement à utiliser dans la step consolidation batch 1 Loaded 7 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.0261385440826416 seulement à utiliser dans la step consolidation batch 1 Loaded 30 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03012251853942871 seulement à utiliser dans la step consolidation batch 1 Loaded 28 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030175447463989258 seulement à utiliser dans la step consolidation batch 1 Loaded 27 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030451059341430664 seulement à utiliser dans la step consolidation batch 1 Loaded 15 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03324127197265625 seulement à utiliser dans la step consolidation batch 1 Loaded 16 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03387641906738281 seulement à utiliser dans la step consolidation batch 1 Loaded 14 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.034224748611450195 seulement à utiliser dans la step consolidation batch 1 Loaded 25 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.02997875213623047 seulement à utiliser dans la step consolidation batch 1 Loaded 26 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.02774500846862793 seulement à utiliser dans la step consolidation batch 1 Loaded 35 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03413534164428711 seulement à utiliser dans la step consolidation batch 1 Loaded 42 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.031188011169433594 seulement à utiliser dans la step consolidation batch 1 Loaded 43 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.036772966384887695 seulement à utiliser dans la step consolidation batch 1 Loaded 33 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.031143903732299805 seulement à utiliser dans la step consolidation batch 1 Loaded 29 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.029659509658813477 seulement à utiliser dans la step consolidation batch 1 Loaded 28 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.029864788055419922 seulement à utiliser dans la step consolidation batch 1 Loaded 45 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.031078338623046875 seulement à utiliser dans la step consolidation batch 1 Loaded 34 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03066086769104004 seulement à utiliser dans la step consolidation batch 1 Loaded 39 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030034542083740234 seulement à utiliser dans la step consolidation batch 1 Loaded 41 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030910015106201172 seulement à utiliser dans la step consolidation batch 1 Loaded 38 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030544519424438477 seulement à utiliser dans la step consolidation batch 1 Loaded 38 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030501604080200195 seulement à utiliser dans la step consolidation batch 1 Loaded 35 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.029628992080688477 seulement à utiliser dans la step consolidation batch 1 Loaded 51 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03465986251831055 seulement à utiliser dans la step consolidation batch 1 Loaded 40 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03419780731201172 seulement à utiliser dans la step consolidation batch 1 Loaded 39 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03347134590148926 seulement à utiliser dans la step consolidation batch 1 Loaded 34 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03653120994567871 seulement à utiliser dans la step consolidation batch 1 Loaded 43 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03273296356201172 seulement à utiliser dans la step consolidation batch 1 Loaded 42 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.030945777893066406 seulement à utiliser dans la step consolidation batch 1 Loaded 34 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03437328338623047 seulement à utiliser dans la step consolidation batch 1 Loaded 48 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03127694129943848 seulement à utiliser dans la step consolidation batch 1 Loaded 36 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.03257012367248535 seulement à utiliser dans la step consolidation batch 1 Loaded 41 chid ids of type : 4211 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.035772085189819336 map_output_result : {1335067147: (0.0, 'Should be the crop_list due to order', 0), 1335067144: (0.0, 'Should be the crop_list due to order', 0), 1335067139: (0.0, 'Should be the crop_list due to order', 0), 1335067121: (0.0, 'Should be the crop_list due to order', 0), 1335067117: (0.0, 'Should be the crop_list due to order', 0), 1335067115: (0.0, 'Should be the crop_list due to order', 0), 1335067103: (0.0, 'Should be the crop_list due to order', 0), 1335067101: (0.0, 'Should be the crop_list due to order', 0), 1335067098: (0.0, 'Should be the crop_list due to order', 0), 1335067088: (0.0, 'Should be the crop_list due to order', 0), 1335067085: (0.0, 'Should be the crop_list due to order', 0), 1335067076: (0.0, 'Should be the crop_list due to order', 0), 1335067033: (0.0, 'Should be the crop_list due to order', 0), 1335067012: (0.0, 'Should be the crop_list due to order', 0), 1335067009: (0.0, 'Should be the crop_list due to order', 0), 1335066999: (0.0, 'Should be the crop_list due to order', 0), 1335066849: (0.0, 'Should be the crop_list due to order', 0), 1335066793: (0.0, 'Should be the crop_list due to order', 0), 1335066591: (0.0, 'Should be the crop_list due to order', 0), 1335066541: (0.0, 'Should be the crop_list due to order', 0), 1334933135: (0.0, 'Should be the crop_list due to order', 0), 1334933119: (0.0, 'Should be the crop_list due to order', 0), 1334933066: (0.0, 'Should be the crop_list due to order', 0), 1334933061: (0.0, 'Should be the crop_list due to order', 0), 1334933056: (0.0, 'Should be the crop_list due to order', 0), 1334933033: (0.0, 'Should be the crop_list due to order', 0), 1334932863: (0.0, 'Should be the crop_list due to order', 0), 1334932826: (0.0, 'Should be the crop_list due to order', 0), 1334932819: (0.0, 'Should be the crop_list due to order', 0), 1334932814: (0.0, 'Should be the crop_list due to order', 0), 1334932535: (0.0, 'Should be the crop_list due to order', 0), 1334932489: (0.0, 'Should be the crop_list due to order', 0), 1334932464: (0.0, 'Should be the crop_list due to order', 0), 1334932462: (0.0, 'Should be the crop_list due to order', 0), 1334932460: (0.0, 'Should be the crop_list due to order', 0), 1334932441: (0.0, 'Should be the crop_list due to order', 0), 1334932438: (0.0, 'Should be the crop_list due to order', 0), 1334932431: (0.0, 'Should be the crop_list due to order', 0), 1334932372: (0.0, 'Should be the crop_list due to order', 0), 1334932369: (0.0, 'Should be the crop_list due to order', 0), 1334932366: (0.0, 'Should be the crop_list due to order', 0), 1334932363: (0.0, 'Should be the crop_list due to order', 0), 1334932360: (0.0, 'Should be the crop_list due to order', 0), 1334932356: (0.0, 'Should be the crop_list due to order', 0), 1334932186: (0.0, 'Should be the crop_list due to order', 0), 1334932110: (0.0, 'Should be the crop_list due to order', 0), 1334932107: (0.0, 'Should be the crop_list due to order', 0), 1334932104: (0.0, 'Should be the crop_list due to order', 0), 1334932101: (0.0, 'Should be the crop_list due to order', 0), 1334932098: (0.0, 'Should be the crop_list due to order', 0), 1334932006: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1335067147, 1335067144, 1335067139, 1335067121, 1335067117, 1335067115, 1335067103, 1335067101, 1335067098, 1335067088, 1335067085, 1335067076, 1335067033, 1335067012, 1335067009, 1335066999, 1335066849, 1335066793, 1335066591, 1335066541, 1334933135, 1334933119, 1334933066, 1334933061, 1334933056, 1334933033, 1334932863, 1334932826, 1334932819, 1334932814, 1334932535, 1334932489, 1334932464, 1334932462, 1334932460, 1334932441, 1334932438, 1334932431, 1334932372, 1334932369, 1334932366, 1334932363, 1334932360, 1334932356, 1334932186, 1334932110, 1334932107, 1334932104, 1334932101, 1334932098, 1334932006] Looping around the photos to save general results len do output : 51 /1335067147.Didn't retrieve data . /1335067144.Didn't retrieve data . /1335067139.Didn't retrieve data . /1335067121.Didn't retrieve data . /1335067117.Didn't retrieve data . /1335067115.Didn't retrieve data . /1335067103.Didn't retrieve data . /1335067101.Didn't retrieve data . /1335067098.Didn't retrieve data . /1335067088.Didn't retrieve data . /1335067085.Didn't retrieve data . /1335067076.Didn't retrieve data . /1335067033.Didn't retrieve data . /1335067012.Didn't retrieve data . /1335067009.Didn't retrieve data . /1335066999.Didn't retrieve data . /1335066849.Didn't retrieve data . /1335066793.Didn't retrieve data . /1335066591.Didn't retrieve data . /1335066541.Didn't retrieve data . /1334933135.Didn't retrieve data . /1334933119.Didn't retrieve data . /1334933066.Didn't retrieve data . /1334933061.Didn't retrieve data . /1334933056.Didn't retrieve data . /1334933033.Didn't retrieve data . /1334932863.Didn't retrieve data . /1334932826.Didn't retrieve data . /1334932819.Didn't retrieve data . /1334932814.Didn't retrieve data . /1334932535.Didn't retrieve data . /1334932489.Didn't retrieve data . /1334932464.Didn't retrieve data . /1334932462.Didn't retrieve data . /1334932460.Didn't retrieve data . /1334932441.Didn't retrieve data . /1334932438.Didn't retrieve data . /1334932431.Didn't retrieve data . /1334932372.Didn't retrieve data . /1334932369.Didn't retrieve data . /1334932366.Didn't retrieve data . /1334932363.Didn't retrieve data . /1334932360.Didn't retrieve data . /1334932356.Didn't retrieve data . /1334932186.Didn't retrieve data . /1334932110.Didn't retrieve data . /1334932107.Didn't retrieve data . /1334932104.Didn't retrieve data . /1334932101.Didn't retrieve data . /1334932098.Didn't retrieve data . /1334932006.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067147', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067144', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067139', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067121', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067117', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067115', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067103', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067101', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067098', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067088', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067085', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067076', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067033', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067012', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067009', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066999', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066849', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066793', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066591', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066541', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933135', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933119', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933066', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933061', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933056', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933033', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932863', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932826', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932819', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932814', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932535', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932489', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932464', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932462', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932460', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932441', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932438', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932431', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932372', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932369', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932366', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932363', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932360', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932356', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932186', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932110', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932107', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932104', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932101', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932098', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932006', None, None, None, None, None, '2612839') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 153 time used for this insertion : 0.017676115036010742 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.310948848724365 time spend to save output : 0.019066810607910156 total time spend for step 3 : 6.330015659332275 step4:ventilate_hashtags_in_portfolio Tue Feb 25 13:37:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20341587 get user id for portfolio 20341587 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20341587 AND mptpi.`type`=4211 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('barquette_opaque','carton','ela','environnement','etiquette','film_plastique','kraft','metal','papier','pehd','pet_clair','pet_opaque','textiles_sanitaires','pet_fonce','mal_croppe','flou')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20341587 AND mptpi.`type`=4211 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('barquette_opaque','carton','ela','environnement','etiquette','film_plastique','kraft','metal','papier','pehd','pet_clair','pet_opaque','textiles_sanitaires','pet_fonce','mal_croppe','flou')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/20343544,20343545,20343546,20343547,20343548,20343549,20343550,20343551,20343552,20343553,20343554,20343555,20343556,20343557,20343558,20343559?tags=pet_clair,metal,etiquette,carton,ela,pet_opaque,barquette_opaque,flou,environnement,film_plastique,pehd,mal_croppe,pet_fonce,textiles_sanitaires,kraft,papier Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1335067147, 1335067144, 1335067139, 1335067121, 1335067117, 1335067115, 1335067103, 1335067101, 1335067098, 1335067088, 1335067085, 1335067076, 1335067033, 1335067012, 1335067009, 1335066999, 1335066849, 1335066793, 1335066591, 1335066541, 1334933135, 1334933119, 1334933066, 1334933061, 1334933056, 1334933033, 1334932863, 1334932826, 1334932819, 1334932814, 1334932535, 1334932489, 1334932464, 1334932462, 1334932460, 1334932441, 1334932438, 1334932431, 1334932372, 1334932369, 1334932366, 1334932363, 1334932360, 1334932356, 1334932186, 1334932110, 1334932107, 1334932104, 1334932101, 1334932098, 1334932006] Looping around the photos to save general results len do output : 1 /20341587. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067147', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067144', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067139', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067121', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067117', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067115', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067103', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067101', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067098', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067088', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067085', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067076', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067033', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067012', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067009', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066999', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066849', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066793', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066591', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066541', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933135', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933119', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933066', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933061', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933056', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933033', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932863', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932826', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932819', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932814', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932535', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932489', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932464', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932462', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932460', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932441', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932438', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932431', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932372', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932369', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932366', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932363', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932360', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932356', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932186', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932110', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932107', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932104', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932101', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932098', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932006', None, None, None, None, None, '2612839') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 52 time used for this insertion : 0.019560813903808594 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.54899001121521 time spend to save output : 0.020032405853271484 total time spend for step 4 : 0.5690224170684814 step5:final Tue Feb 25 13:37:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1335067147: ('0.32534062693139176',), 1335067144: ('0.32534062693139176',), 1335067139: ('0.32534062693139176',), 1335067121: ('0.32534062693139176',), 1335067117: ('0.32534062693139176',), 1335067115: ('0.32534062693139176',), 1335067103: ('0.32534062693139176',), 1335067101: ('0.32534062693139176',), 1335067098: ('0.32534062693139176',), 1335067088: ('0.32534062693139176',), 1335067085: ('0.32534062693139176',), 1335067076: ('0.32534062693139176',), 1335067033: ('0.32534062693139176',), 1335067012: ('0.32534062693139176',), 1335067009: ('0.32534062693139176',), 1335066999: ('0.32534062693139176',), 1335066849: ('0.32534062693139176',), 1335066793: ('0.32534062693139176',), 1335066591: ('0.32534062693139176',), 1335066541: ('0.32534062693139176',), 1334933135: ('0.32534062693139176',), 1334933119: ('0.32534062693139176',), 1334933066: ('0.32534062693139176',), 1334933061: ('0.32534062693139176',), 1334933056: ('0.32534062693139176',), 1334933033: ('0.32534062693139176',), 1334932863: ('0.32534062693139176',), 1334932826: ('0.32534062693139176',), 1334932819: ('0.32534062693139176',), 1334932814: ('0.32534062693139176',), 1334932535: ('0.32534062693139176',), 1334932489: ('0.32534062693139176',), 1334932464: ('0.32534062693139176',), 1334932462: ('0.32534062693139176',), 1334932460: ('0.32534062693139176',), 1334932441: ('0.32534062693139176',), 1334932438: ('0.32534062693139176',), 1334932431: ('0.32534062693139176',), 1334932372: ('0.32534062693139176',), 1334932369: ('0.32534062693139176',), 1334932366: ('0.32534062693139176',), 1334932363: ('0.32534062693139176',), 1334932360: ('0.32534062693139176',), 1334932356: ('0.32534062693139176',), 1334932186: ('0.32534062693139176',), 1334932110: ('0.32534062693139176',), 1334932107: ('0.32534062693139176',), 1334932104: ('0.32534062693139176',), 1334932101: ('0.32534062693139176',), 1334932098: ('0.32534062693139176',), 1334932006: ('0.32534062693139176',)} new output for save of step final : {1335067147: ('0.32534062693139176',), 1335067144: ('0.32534062693139176',), 1335067139: ('0.32534062693139176',), 1335067121: ('0.32534062693139176',), 1335067117: ('0.32534062693139176',), 1335067115: ('0.32534062693139176',), 1335067103: ('0.32534062693139176',), 1335067101: ('0.32534062693139176',), 1335067098: ('0.32534062693139176',), 1335067088: ('0.32534062693139176',), 1335067085: ('0.32534062693139176',), 1335067076: ('0.32534062693139176',), 1335067033: ('0.32534062693139176',), 1335067012: ('0.32534062693139176',), 1335067009: ('0.32534062693139176',), 1335066999: ('0.32534062693139176',), 1335066849: ('0.32534062693139176',), 1335066793: ('0.32534062693139176',), 1335066591: ('0.32534062693139176',), 1335066541: ('0.32534062693139176',), 1334933135: ('0.32534062693139176',), 1334933119: ('0.32534062693139176',), 1334933066: ('0.32534062693139176',), 1334933061: ('0.32534062693139176',), 1334933056: ('0.32534062693139176',), 1334933033: ('0.32534062693139176',), 1334932863: ('0.32534062693139176',), 1334932826: ('0.32534062693139176',), 1334932819: ('0.32534062693139176',), 1334932814: ('0.32534062693139176',), 1334932535: ('0.32534062693139176',), 1334932489: ('0.32534062693139176',), 1334932464: ('0.32534062693139176',), 1334932462: ('0.32534062693139176',), 1334932460: ('0.32534062693139176',), 1334932441: ('0.32534062693139176',), 1334932438: ('0.32534062693139176',), 1334932431: ('0.32534062693139176',), 1334932372: ('0.32534062693139176',), 1334932369: ('0.32534062693139176',), 1334932366: ('0.32534062693139176',), 1334932363: ('0.32534062693139176',), 1334932360: ('0.32534062693139176',), 1334932356: ('0.32534062693139176',), 1334932186: ('0.32534062693139176',), 1334932110: ('0.32534062693139176',), 1334932107: ('0.32534062693139176',), 1334932104: ('0.32534062693139176',), 1334932101: ('0.32534062693139176',), 1334932098: ('0.32534062693139176',), 1334932006: ('0.32534062693139176',)} [1335067147, 1335067144, 1335067139, 1335067121, 1335067117, 1335067115, 1335067103, 1335067101, 1335067098, 1335067088, 1335067085, 1335067076, 1335067033, 1335067012, 1335067009, 1335066999, 1335066849, 1335066793, 1335066591, 1335066541, 1334933135, 1334933119, 1334933066, 1334933061, 1334933056, 1334933033, 1334932863, 1334932826, 1334932819, 1334932814, 1334932535, 1334932489, 1334932464, 1334932462, 1334932460, 1334932441, 1334932438, 1334932431, 1334932372, 1334932369, 1334932366, 1334932363, 1334932360, 1334932356, 1334932186, 1334932110, 1334932107, 1334932104, 1334932101, 1334932098, 1334932006] Looping around the photos to save general results len do output : 51 /1335067147.Didn't retrieve data . /1335067144.Didn't retrieve data . /1335067139.Didn't retrieve data . /1335067121.Didn't retrieve data . /1335067117.Didn't retrieve data . /1335067115.Didn't retrieve data . /1335067103.Didn't retrieve data . /1335067101.Didn't retrieve data . /1335067098.Didn't retrieve data . /1335067088.Didn't retrieve data . /1335067085.Didn't retrieve data . /1335067076.Didn't retrieve data . /1335067033.Didn't retrieve data . /1335067012.Didn't retrieve data . /1335067009.Didn't retrieve data . /1335066999.Didn't retrieve data . /1335066849.Didn't retrieve data . /1335066793.Didn't retrieve data . /1335066591.Didn't retrieve data . /1335066541.Didn't retrieve data . /1334933135.Didn't retrieve data . /1334933119.Didn't retrieve data . /1334933066.Didn't retrieve data . /1334933061.Didn't retrieve data . /1334933056.Didn't retrieve data . /1334933033.Didn't retrieve data . /1334932863.Didn't retrieve data . /1334932826.Didn't retrieve data . /1334932819.Didn't retrieve data . /1334932814.Didn't retrieve data . /1334932535.Didn't retrieve data . /1334932489.Didn't retrieve data . /1334932464.Didn't retrieve data . /1334932462.Didn't retrieve data . /1334932460.Didn't retrieve data . /1334932441.Didn't retrieve data . /1334932438.Didn't retrieve data . /1334932431.Didn't retrieve data . /1334932372.Didn't retrieve data . /1334932369.Didn't retrieve data . /1334932366.Didn't retrieve data . /1334932363.Didn't retrieve data . /1334932360.Didn't retrieve data . /1334932356.Didn't retrieve data . /1334932186.Didn't retrieve data . /1334932110.Didn't retrieve data . /1334932107.Didn't retrieve data . /1334932104.Didn't retrieve data . /1334932101.Didn't retrieve data . /1334932098.Didn't retrieve data . /1334932006.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067147', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067144', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067139', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067121', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067117', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067115', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067103', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067101', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067098', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067088', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067085', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067076', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067033', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067012', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067009', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066999', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066849', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066793', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066591', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066541', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933135', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933119', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933066', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933061', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933056', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933033', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932863', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932826', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932819', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932814', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932535', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932489', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932464', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932462', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932460', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932441', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932438', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932431', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932372', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932369', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932366', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932363', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932360', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932356', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932186', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932110', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932107', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932104', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932101', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932098', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932006', None, None, None, None, None, '2612839') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 153 time used for this insertion : 0.019625186920166016 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.17835116386413574 time spend to save output : 0.021701574325561523 total time spend for step 5 : 0.20005273818969727 step6:blur_detection Tue Feb 25 13:37:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 51 time used for this insertion : 0.011652469635009766 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 51 time used for this insertion : 0.020983457565307617 save missing photos in datou_result : time spend for datou_step_exec : 0.0292356014251709 time spend to save output : 0.0378880500793457 total time spend for step 6 : 0.0671236515045166 step7:brightness Tue Feb 25 13:37:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 51 time used for this insertion : 0.011384248733520508 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 51 time used for this insertion : 0.013223648071289062 save missing photos in datou_result : time spend for datou_step_exec : 0.02873706817626953 time spend to save output : 0.0293118953704834 total time spend for step 7 : 0.05804896354675293 step8:send_mail_cod Tue Feb 25 13:37:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_COD_P20341587_25-02-2025_13_37_09.pdf 20343544 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203435441740487029 20343545 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203435451740487031 20343546 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203435461740487032 20343547 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203435471740487035 20343548 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203435481740487037 20343549 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203435491740487039 20343550 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203435501740487042 20343553 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203435531740487044 20343556 change filename to text .imagette203435561740487046 20343557 imagette203435571740487047 20343558 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203435581740487047 20343559 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203435591740487049 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20341587 and hashtag_type = 4211 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20343544,20343545,20343546,20343547,20343548,20343549,20343550,20343551,20343552,20343553,20343554,20343555,20343556,20343557,20343558,20343559?tags=pet_clair,metal,etiquette,carton,ela,pet_opaque,barquette_opaque,flou,environnement,film_plastique,pehd,mal_croppe,pet_fonce,textiles_sanitaires,kraft,papier your option no_mail is active, we will not send the real mail to your client args[1335067147] : ((1335067147, -4.3388822906601625, 492609224), (1335067147, 0.010362781613060233, 2107752395), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1335067144] : ((1335067144, -5.0005920799078005, 492609224), (1335067144, -0.09311478256228589, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1335067139] : ((1335067139, -5.020346586272644, 492609224), (1335067139, -0.07469530034575408, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1335067121] : ((1335067121, -4.717977283217605, 492609224), (1335067121, -0.17389389981258743, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1335067117] : ((1335067117, -4.758652589171159, 492609224), (1335067117, -0.09241300689791679, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1335067115] : ((1335067115, -5.2946704862843985, 492609224), (1335067115, -0.08633394296804082, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1335067103] : ((1335067103, -4.486308546924195, 492609224), (1335067103, -0.014967098043031753, 2107752395), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1335067101] : ((1335067101, -4.784782041159397, 492609224), (1335067101, -0.0915538905815773, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1335067098] : ((1335067098, -4.71396962194841, 492609224), (1335067098, -0.05022558482061253, 2107752395), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1335067088] : ((1335067088, -4.329443439651463, 492609224), (1335067088, -0.07801916557498355, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1335067085] : ((1335067085, -5.126065002385374, 492609224), (1335067085, -0.2206707847268802, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1335067076] : ((1335067076, -4.919320357974276, 492609224), (1335067076, -0.053365682995818384, 2107752395), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1335067033] : ((1335067033, -4.979446002367546, 492609224), (1335067033, -0.030222788197168976, 2107752395), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1335067012] : ((1335067012, -4.52358751055021, 492609224), (1335067012, -0.07209605657866126, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1335067009] : ((1335067009, -4.751940537255476, 492609224), (1335067009, -0.05974977732342066, 2107752395), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1335066999] : ((1335066999, -4.8618895230038595, 492609224), (1335066999, -0.016670205190583716, 2107752395), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1335066849] : ((1335066849, -4.820990940947589, 492609224), (1335066849, -0.13873225627416305, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1335066793] : ((1335066793, -4.375923828251975, 492609224), (1335066793, -0.052013526575251864, 2107752395), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1335066591] : ((1335066591, -3.83890899232834, 492609224), (1335066591, -0.38491464584607865, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1335066541] : ((1335066541, -2.643331490119097, 492609224), (1335066541, -0.013850914344820818, 2107752395), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334933135] : ((1334933135, -4.912945760554176, 492609224), (1334933135, -0.13884432491624774, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334933119] : ((1334933119, -5.044431248460466, 492609224), (1334933119, 0.0003886604639634005, 2107752395), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334933066] : ((1334933066, -2.6530232963106513, 492609224), (1334933066, 0.013243318857415587, 2107752395), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334933061] : ((1334933061, -5.78477463572674, 492609224), (1334933061, -0.06302545832403109, 2107752395), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334933056] : ((1334933056, -6.117110768011544, 492609224), (1334933056, -0.09607870962137356, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334933033] : ((1334933033, -3.051268443747475, 492609224), (1334933033, -0.22934511550936446, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932863] : ((1334932863, -3.898946662328812, 492609224), (1334932863, -0.03590188157236951, 2107752395), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932826] : ((1334932826, -4.819934257210462, 492609224), (1334932826, -0.019203354881886677, 2107752395), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932819] : ((1334932819, -4.287725030793717, 492609224), (1334932819, -0.13834249931235568, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932814] : ((1334932814, -6.035232481654239, 492609224), (1334932814, -0.22927264521774454, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932535] : ((1334932535, -4.653879351523518, 492609224), (1334932535, -0.22838409074883742, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932489] : ((1334932489, -4.196135249360903, 492609224), (1334932489, -0.1311307226970922, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932464] : ((1334932464, -4.531009229285659, 492609224), (1334932464, -0.04685895738767489, 2107752395), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932462] : ((1334932462, -4.794319524588586, 492609224), (1334932462, 0.0696573256546846, 2107752395), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932460] : ((1334932460, -3.3746424461854496, 492609224), (1334932460, -0.13471834284349524, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932441] : ((1334932441, -4.636490238473696, 492609224), (1334932441, -0.09978199184854414, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932438] : ((1334932438, -4.931859642758574, 492609224), (1334932438, -0.09516468208643077, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932431] : ((1334932431, -4.661836613731823, 492609224), (1334932431, -0.017123574829315657, 2107752395), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932372] : ((1334932372, -5.200158467361144, 492609224), (1334932372, -0.13422317772985906, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932369] : ((1334932369, -5.411579685231433, 492609224), (1334932369, -0.07160066286120347, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932366] : ((1334932366, -4.327333045896396, 492609224), (1334932366, -0.2077479548774298, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932363] : ((1334932363, -4.853605103673267, 492609224), (1334932363, -0.11753073127742818, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932360] : ((1334932360, -5.5147330962537, 492609224), (1334932360, -0.016574874315499925, 2107752395), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932356] : ((1334932356, -5.034607058692589, 492609224), (1334932356, 0.013296441558395664, 2107752395), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932186] : ((1334932186, -4.8480906814982045, 492609224), (1334932186, -0.11897248406991388, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932110] : ((1334932110, -5.38901597961595, 492609224), (1334932110, 0.021119378089661717, 2107752395), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932107] : ((1334932107, -5.256262904812386, 492609224), (1334932107, -0.07671306605980241, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932104] : ((1334932104, -5.450976818091425, 492609224), (1334932104, -0.08835008266587956, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932101] : ((1334932101, -5.084602940770829, 492609224), (1334932101, -0.0644408954399037, 2107752395), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932098] : ((1334932098, -3.8436263193297133, 492609224), (1334932098, -0.07142813834772077, 496442774), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com args[1334932006] : ((1334932006, -5.122794577490924, 492609224), (1334932006, -0.06767752411785329, 2107752395), '0.32534062693139176') We are sending mail with results at kexin@fotonower.com refus_total : 0.32534062693139176 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20341587 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1335066591,1334932186,1334932363,1334932006,1334932489,1334932535,1334932814,1334932819,1334932863,1334933066,1334932098,1335066793,1335066849,1335067009,1335067012,1335067033,1335067076,1335067088,1335067117,1335067147) Found this number of photos: 20 begin to download photo : 1335066591 begin to download photo : 1334932535 begin to download photo : 1334932098 begin to download photo : 1335067033 download finish for photo 1334932098 begin to download photo : 1335066793 download finish for photo 1335066591 begin to download photo : 1334932186 download finish for photo 1334932535 begin to download photo : 1334932814 download finish for photo 1335067033 begin to download photo : 1335067076 download finish for photo 1334932186 begin to download photo : 1334932363 download finish for photo 1335066793 begin to download photo : 1335066849 download finish for photo 1335067076 begin to download photo : 1335067088 download finish for photo 1334932814 begin to download photo : 1334932819 download finish for photo 1334932363 begin to download photo : 1334932006 download finish for photo 1334932819 begin to download photo : 1334932863 download finish for photo 1335066849 begin to download photo : 1335067009 download finish for photo 1335067088 begin to download photo : 1335067117 download finish for photo 1334932863 begin to download photo : 1334933066 download finish for photo 1334932006 begin to download photo : 1334932489 download finish for photo 1335067117 begin to download photo : 1335067147 download finish for photo 1334933066 download finish for photo 1335067009 begin to download photo : 1335067012 download finish for photo 1335067147 download finish for photo 1334932489 download finish for photo 1335067012 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_COD_P20341587_25-02-2025_13_37_09.pdf results_COD_P20341587_25-02-2025_13_37_09.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_COD_P20341587_25-02-2025_13_37_09.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4252','20341587','results_COD_P20341587_25-02-2025_13_37_09.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_COD_P20341587_25-02-2025_13_37_09.pdf','pdf','','1.41','0.32534062693139176') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1335067147, 1335067144, 1335067139, 1335067121, 1335067117, 1335067115, 1335067103, 1335067101, 1335067098, 1335067088, 1335067085, 1335067076, 1335067033, 1335067012, 1335067009, 1335066999, 1335066849, 1335066793, 1335066591, 1335066541, 1334933135, 1334933119, 1334933066, 1334933061, 1334933056, 1334933033, 1334932863, 1334932826, 1334932819, 1334932814, 1334932535, 1334932489, 1334932464, 1334932462, 1334932460, 1334932441, 1334932438, 1334932431, 1334932372, 1334932369, 1334932366, 1334932363, 1334932360, 1334932356, 1334932186, 1334932110, 1334932107, 1334932104, 1334932101, 1334932098, 1334932006] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067147', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067144', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067139', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067121', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067117', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067115', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067103', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067101', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067098', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067088', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067085', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067076', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067033', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067012', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067009', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066999', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066849', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066793', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066591', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066541', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933135', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933119', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933066', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933061', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933056', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933033', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932863', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932826', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932819', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932814', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932535', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932489', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932464', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932462', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932460', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932441', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932438', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932431', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932372', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932369', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932366', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932363', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932360', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932356', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932186', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932110', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932107', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932104', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932101', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932098', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932006', None, None, None, None, None, '2612839') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 51 time used for this insertion : 0.019392013549804688 save_final save missing photos in datou_result : time spend for datou_step_exec : 27.23553729057312 time spend to save output : 0.01985311508178711 total time spend for step 8 : 27.255390405654907 step9:split_time_score Tue Feb 25 13:37:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('13', 51),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 05022025 20341587 Nombre de photos uploadées : 51 / 23040 (0%) 05022025 20341587 Nombre de photos taguées (types de déchets): 0 / 51 (0%) 05022025 20341587 Nombre de photos taguées (volume) : 0 / 51 (0%) elapsed_time : load_data_split_time_score 3.5762786865234375e-06 elapsed_time : order_list_meta_photo_and_scores 9.5367431640625e-06 ??????????????????????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.003314495086669922 elapsed_time : insert_dashboard_record_day_entry 0.1409010887145996 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20341524_08-02-2025_22_18_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20341524 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20341525_08-02-2025_21_18_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20341525 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20341526_08-02-2025_19_32_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20341526 order by id desc limit 1 Qualite : 0.2241912085385686 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20341527_07-02-2025_17_38_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20341527 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20341527 AND mptpi.`type`=3594 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20277504_07-02-2025_01_04_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277504 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20341528_08-02-2025_18_55_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20341528 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20286197_06-02-2025_17_47_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20286197 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20341529_07-02-2025_21_50_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20341529 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20341530_12-02-2025_05_19_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20341530 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20341531_07-02-2025_18_34_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20341531 order by id desc limit 1 Qualite : 0.21787861122458246 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20286226_06-02-2025_05_57_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20286226 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20286226 AND mptpi.`type`=3594 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20277510_09-02-2025_15_07_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277510 order by id desc limit 1 Qualite : 0.2311395498592955 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20277511_06-02-2025_02_48_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277511 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20277511 AND mptpi.`type`=3594 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20341532_10-02-2025_21_04_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20341532 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20341545_07-02-2025_17_58_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20341545 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20341558_10-02-2025_21_06_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20341558 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20341559_10-02-2025_21_10_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20341559 order by id desc limit 1 Qualite : 0.24958481909835692 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20341560_07-02-2025_18_07_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20341560 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20341560 AND mptpi.`type`=3594 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20341561_12-02-2025_23_34_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20341561 order by id desc limit 1 Qualite : 0.2571360868566177 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20286232 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20286232 AND mptpi.`type`=3594 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20341574_07-02-2025_20_20_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20341574 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20286235_06-02-2025_08_55_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20286235 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20286236_06-02-2025_06_24_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20286236 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20286237_11-02-2025_11_24_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20286237 order by id desc limit 1 Qualite : 0.32534062693139176 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_COD_P20341587_25-02-2025_13_37_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20341587 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11617 copy_chis is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11618 consolidate_hashtags_from_manual_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11615 rle_unique_nms_with_priority is not consistent : 3 used against 1 in the step definition ! WARNING : number of outputs for step 11615 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11622 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11616 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11619 blur_detection have less inputs used (0) than in the step definition (1) : maybe we manage optionnal inputs ! Step 11620 brightness have less inputs used (0) than in the step definition (1) : maybe we manage optionnal inputs ! Step 11621 send_mail_cod have less inputs used (4) than in the step definition (5) : maybe we manage optionnal inputs ! Step 11623 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11617 have datatype=11 whereas input 0 of step 11615 have datatype=2 WARNING : type of output 1 of step 11618 doesn't seem to be define in the database( WARNING : type of input 3 of step 11616 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11618 doesn't seem to be define in the database( WARNING : type of input 1 of step 11615 doesn't seem to be define in the database( WARNING : output 0 of step 11622 have datatype=10 whereas input 3 of step 11621 have datatype=6 WARNING : type of input 1 of step 11622 doesn't seem to be define in the database( WARNING : output 1 of step 11615 have datatype=7 whereas input 1 of step 11622 have datatype=None WARNING : type of output 1 of step 11622 doesn't seem to be define in the database( WARNING : type of input 4 of step 11616 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11617 doesn't seem to be define in the database( WARNING : type of input 1 of step 11618 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20341587 AND mptpi.`type`=4211 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20341588_08-02-2025_12_39_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20341588 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20277522_09-02-2025_15_10_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277522 order by id desc limit 1 Qualite : 0.1770747284253208 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20277523_06-02-2025_01_29_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277523 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20277523 AND mptpi.`type`=3594 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20286240_06-02-2025_13_48_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20286240 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20286241_06-02-2025_05_41_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20286241 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20286242_06-02-2025_12_34_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20286242 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20277526_06-02-2025_02_22_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277526 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20277527_06-02-2025_00_59_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277527 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20277528_11-02-2025_10_30_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277528 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20277529_09-02-2025_15_27_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277529 order by id desc limit 1 Qualite : 0.21480488134682896 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20277530_06-02-2025_01_27_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277530 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20277530 AND mptpi.`type`=3594 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20277531_09-02-2025_15_27_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277531 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20286243_07-02-2025_00_32_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20286243 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20277533_11-02-2025_10_37_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277533 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20277534_11-02-2025_10_39_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277534 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20277535_06-02-2025_03_28_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277535 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20277548_06-02-2025_02_23_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277548 order by id desc limit 1 Qualite : 0.180145604972313 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20277549_06-02-2025_00_58_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277549 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20277549 AND mptpi.`type`=3594 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20277550_06-02-2025_01_20_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277550 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20277551_06-02-2025_02_21_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20277551 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20286244_06-02-2025_06_04_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20286244 order by id desc limit 1 Qualite : 0.2163261936236685 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20286245_06-02-2025_06_47_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20286245 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20286245 AND mptpi.`type`=3594 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20286246_09-02-2025_19_33_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20286246 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'05022025': {'nb_upload': 51, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1335067147, 1335067144, 1335067139, 1335067121, 1335067117, 1335067115, 1335067103, 1335067101, 1335067098, 1335067088, 1335067085, 1335067076, 1335067033, 1335067012, 1335067009, 1335066999, 1335066849, 1335066793, 1335066591, 1335066541, 1334933135, 1334933119, 1334933066, 1334933061, 1334933056, 1334933033, 1334932863, 1334932826, 1334932819, 1334932814, 1334932535, 1334932489, 1334932464, 1334932462, 1334932460, 1334932441, 1334932438, 1334932431, 1334932372, 1334932369, 1334932366, 1334932363, 1334932360, 1334932356, 1334932186, 1334932110, 1334932107, 1334932104, 1334932101, 1334932098, 1334932006] Looping around the photos to save general results len do output : 1 /20341587Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067147', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067144', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067139', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067121', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067117', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067115', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067103', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067101', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067098', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067088', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067085', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067076', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067033', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067012', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335067009', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066999', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066849', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066793', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066591', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1335066541', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933135', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933119', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933066', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933061', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933056', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334933033', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932863', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932826', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932819', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932814', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932535', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932489', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932464', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932462', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932460', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932441', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932438', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932431', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932372', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932369', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932366', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932363', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932360', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932356', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932186', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932110', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932107', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932104', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932101', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932098', None, None, None, None, None, '2612839') ('4252', None, None, None, None, None, None, None, '2612839') ('4252', '20341587', '1334932006', None, None, None, None, None, '2612839') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 52 time used for this insertion : 0.020557880401611328 save_final save missing photos in datou_result : time spend for datou_step_exec : 17.491130113601685 time spend to save output : 0.020901203155517578 total time spend for step 9 : 17.512031316757202 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 51 set_done_treatment 8.45user 2.54system 1:28.58elapsed 12%CPU (0avgtext+0avgdata 185192maxresident)k 640inputs+200984outputs (2major+194709minor)pagefaults 0swaps