python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3763835 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2953425'] with mtr_portfolio_ids : ['23334517'] and first list_photo_ids : [] new path : /proc/3763835/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.096708059310913 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon May 26 13:20:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-26 13:20:33.597094: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-26 13:20:33.623230: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-26 13:20:33.625192: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fc330000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-26 13:20:33.625232: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-26 13:20:33.628870: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-26 13:20:33.918291: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x8d30580 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-26 13:20:33.918337: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-26 13:20:33.919736: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 13:20:33.920106: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 13:20:33.922978: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 13:20:33.925490: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 13:20:33.925961: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 13:20:33.928755: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 13:20:33.929964: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 13:20:33.934716: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 13:20:33.936363: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 13:20:33.936428: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 13:20:33.937175: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-26 13:20:33.937192: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-26 13:20:33.937202: I tensorflow/core/common_runti2025-05-26 13:20:43.997375: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 13:20:44.188620: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 25 Detection mask done ! Trying to reset tf kernel 3764635 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5706 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10998 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0006806850433349609 nb_pixel_total : 25508 time to create 1 rle with old method : 0.030428647994995117 length of segment : 148 time for calcul the mask position with numpy : 0.0027048587799072266 nb_pixel_total : 102383 time to create 1 rle with old method : 0.1365036964416504 length of segment : 520 time for calcul the mask position with numpy : 0.0006303787231445312 nb_pixel_total : 23680 time to create 1 rle with old method : 0.03931903839111328 length of segment : 263 time for calcul the mask position with numpy : 0.0004851818084716797 nb_pixel_total : 20276 time to create 1 rle with old method : 0.02651190757751465 length of segment : 125 time for calcul the mask position with numpy : 0.0032339096069335938 nb_pixel_total : 103591 time to create 1 rle with old method : 0.11941170692443848 length of segment : 602 time for calcul the mask position with numpy : 0.0004532337188720703 nb_pixel_total : 23226 time to create 1 rle with old method : 0.028299331665039062 length of segment : 141 time for calcul the mask position with numpy : 0.0005469322204589844 nb_pixel_total : 30169 time to create 1 rle with old method : 0.03611326217651367 length of segment : 183 time for calcul the mask position with numpy : 0.00036907196044921875 nb_pixel_total : 14511 time to create 1 rle with old method : 0.018032550811767578 length of segment : 185 time for calcul the mask position with numpy : 0.0006971359252929688 nb_pixel_total : 27385 time to create 1 rle with old method : 0.03281593322753906 length of segment : 237 time for calcul the mask position with numpy : 0.0005204677581787109 nb_pixel_total : 28061 time to create 1 rle with old method : 0.034720420837402344 length of segment : 178 time for calcul the mask position with numpy : 0.0009932518005371094 nb_pixel_total : 40477 time to create 1 rle with old method : 0.049126625061035156 length of segment : 531 time for calcul the mask position with numpy : 0.0016345977783203125 nb_pixel_total : 79775 time to create 1 rle with old method : 0.09503388404846191 length of segment : 316 time for calcul the mask position with numpy : 0.0025565624237060547 nb_pixel_total : 117201 time to create 1 rle with old method : 0.13512897491455078 length of segment : 521 time for calcul the mask position with numpy : 0.0010459423065185547 nb_pixel_total : 56740 time to create 1 rle with old method : 0.06720781326293945 length of segment : 325 time for calcul the mask position with numpy : 0.0002951622009277344 nb_pixel_total : 13177 time to create 1 rle with old method : 0.016681671142578125 length of segment : 62 time for calcul the mask position with numpy : 0.0009837150573730469 nb_pixel_total : 47005 time to create 1 rle with old method : 0.07263898849487305 length of segment : 335 time for calcul the mask position with numpy : 0.0021843910217285156 nb_pixel_total : 77443 time to create 1 rle with old method : 0.1325240135192871 length of segment : 532 time for calcul the mask position with numpy : 0.0008549690246582031 nb_pixel_total : 11886 time to create 1 rle with old method : 0.027575254440307617 length of segment : 169 time for calcul the mask position with numpy : 0.0005581378936767578 nb_pixel_total : 19884 time to create 1 rle with old method : 0.03411984443664551 length of segment : 124 time for calcul the mask position with numpy : 0.015975475311279297 nb_pixel_total : 515074 time to create 1 rle with new method : 0.04111790657043457 length of segment : 1143 time for calcul the mask position with numpy : 0.004222393035888672 nb_pixel_total : 69868 time to create 1 rle with old method : 0.09059309959411621 length of segment : 808 time for calcul the mask position with numpy : 0.000606536865234375 nb_pixel_total : 25491 time to create 1 rle with old method : 0.03073740005493164 length of segment : 194 time for calcul the mask position with numpy : 0.002044200897216797 nb_pixel_total : 134393 time to create 1 rle with old method : 0.1756441593170166 length of segment : 306 time for calcul the mask position with numpy : 0.0024347305297851562 nb_pixel_total : 120361 time to create 1 rle with old method : 0.15093088150024414 length of segment : 556 time for calcul the mask position with numpy : 0.0032274723052978516 nb_pixel_total : 96968 time to create 1 rle with old method : 0.13199353218078613 length of segment : 749 time for calcul the mask position with numpy : 0.010365009307861328 nb_pixel_total : 325555 time to create 1 rle with new method : 0.014649152755737305 length of segment : 489 time for calcul the mask position with numpy : 0.00946044921875 nb_pixel_total : 341650 time to create 1 rle with new method : 0.018802881240844727 length of segment : 945 time for calcul the mask position with numpy : 0.004254817962646484 nb_pixel_total : 121739 time to create 1 rle with old method : 0.16943812370300293 length of segment : 506 time for calcul the mask position with numpy : 0.00039124488830566406 nb_pixel_total : 6217 time to create 1 rle with old method : 0.010926008224487305 length of segment : 102 time for calcul the mask position with numpy : 0.0005962848663330078 nb_pixel_total : 9877 time to create 1 rle with old method : 0.017104387283325195 length of segment : 223 time for calcul the mask position with numpy : 0.001939535140991211 nb_pixel_total : 39599 time to create 1 rle with old method : 0.04655051231384277 length of segment : 453 time for calcul the mask position with numpy : 0.0048046112060546875 nb_pixel_total : 140466 time to create 1 rle with old method : 0.17772960662841797 length of segment : 291 time for calcul the mask position with numpy : 0.0058689117431640625 nb_pixel_total : 329870 time to create 1 rle with new method : 0.0191800594329834 length of segment : 941 time for calcul the mask position with numpy : 0.004688739776611328 nb_pixel_total : 66140 time to create 1 rle with old method : 0.09868383407592773 length of segment : 496 time for calcul the mask position with numpy : 0.0028228759765625 nb_pixel_total : 58495 time to create 1 rle with old method : 0.07140207290649414 length of segment : 345 time for calcul the mask position with numpy : 0.0073397159576416016 nb_pixel_total : 236086 time to create 1 rle with new method : 0.014714717864990234 length of segment : 938 time for calcul the mask position with numpy : 0.001710653305053711 nb_pixel_total : 40618 time to create 1 rle with old method : 0.05962705612182617 length of segment : 257 time for calcul the mask position with numpy : 0.0014641284942626953 nb_pixel_total : 22810 time to create 1 rle with old method : 0.040804386138916016 length of segment : 246 time for calcul the mask position with numpy : 0.00040602684020996094 nb_pixel_total : 10665 time to create 1 rle with old method : 0.013076305389404297 length of segment : 86 time for calcul the mask position with numpy : 0.0007758140563964844 nb_pixel_total : 22448 time to create 1 rle with old method : 0.027260303497314453 length of segment : 164 time for calcul the mask position with numpy : 0.0009288787841796875 nb_pixel_total : 24330 time to create 1 rle with old method : 0.029790401458740234 length of segment : 202 time for calcul the mask position with numpy : 0.001590728759765625 nb_pixel_total : 53035 time to create 1 rle with old method : 0.06268548965454102 length of segment : 304 time for calcul the mask position with numpy : 0.0003268718719482422 nb_pixel_total : 7076 time to create 1 rle with old method : 0.008837461471557617 length of segment : 94 time for calcul the mask position with numpy : 0.0027489662170410156 nb_pixel_total : 115960 time to create 1 rle with old method : 0.13570833206176758 length of segment : 567 time for calcul the mask position with numpy : 0.0017380714416503906 nb_pixel_total : 23741 time to create 1 rle with old method : 0.02855539321899414 length of segment : 261 time for calcul the mask position with numpy : 0.0006778240203857422 nb_pixel_total : 37667 time to create 1 rle with old method : 0.044498443603515625 length of segment : 167 time for calcul the mask position with numpy : 0.00043582916259765625 nb_pixel_total : 22023 time to create 1 rle with old method : 0.026562213897705078 length of segment : 210 time for calcul the mask position with numpy : 0.4510817527770996 nb_pixel_total : 1049499 time to create 1 rle with new method : 0.10813188552856445 length of segment : 1461 time for calcul the mask position with numpy : 0.0006871223449707031 nb_pixel_total : 15367 time to create 1 rle with old method : 0.01805281639099121 length of segment : 232 time for calcul the mask position with numpy : 0.0006897449493408203 nb_pixel_total : 36932 time to create 1 rle with old method : 0.04643607139587402 length of segment : 141 time for calcul the mask position with numpy : 0.0008273124694824219 nb_pixel_total : 24448 time to create 1 rle with old method : 0.0390164852142334 length of segment : 182 time for calcul the mask position with numpy : 0.0005400180816650391 nb_pixel_total : 7467 time to create 1 rle with old method : 0.01423025131225586 length of segment : 112 time for calcul the mask position with numpy : 0.0005695819854736328 nb_pixel_total : 13778 time to create 1 rle with old method : 0.025466442108154297 length of segment : 119 time for calcul the mask position with numpy : 0.00045943260192871094 nb_pixel_total : 15973 time to create 1 rle with old method : 0.023009777069091797 length of segment : 154 time for calcul the mask position with numpy : 0.001653909683227539 nb_pixel_total : 56682 time to create 1 rle with old method : 0.0878748893737793 length of segment : 327 time for calcul the mask position with numpy : 0.0005445480346679688 nb_pixel_total : 13695 time to create 1 rle with old method : 0.01664423942565918 length of segment : 205 time for calcul the mask position with numpy : 0.001958131790161133 nb_pixel_total : 134665 time to create 1 rle with old method : 0.1782970428466797 length of segment : 426 time for calcul the mask position with numpy : 0.0026655197143554688 nb_pixel_total : 138142 time to create 1 rle with old method : 0.1613616943359375 length of segment : 307 time for calcul the mask position with numpy : 0.0020666122436523438 nb_pixel_total : 34144 time to create 1 rle with old method : 0.04078531265258789 length of segment : 580 time for calcul the mask position with numpy : 0.00727081298828125 nb_pixel_total : 253637 time to create 1 rle with new method : 0.011712074279785156 length of segment : 1108 time for calcul the mask position with numpy : 0.00043845176696777344 nb_pixel_total : 11577 time to create 1 rle with old method : 0.01408696174621582 length of segment : 122 time for calcul the mask position with numpy : 0.0006489753723144531 nb_pixel_total : 15660 time to create 1 rle with old method : 0.019021987915039062 length of segment : 161 time for calcul the mask position with numpy : 0.0003387928009033203 nb_pixel_total : 5201 time to create 1 rle with old method : 0.006403207778930664 length of segment : 130 time for calcul the mask position with numpy : 0.0011546611785888672 nb_pixel_total : 34510 time to create 1 rle with old method : 0.04132676124572754 length of segment : 193 time for calcul the mask position with numpy : 0.0006008148193359375 nb_pixel_total : 14135 time to create 1 rle with old method : 0.01699090003967285 length of segment : 178 time for calcul the mask position with numpy : 0.0007801055908203125 nb_pixel_total : 16402 time to create 1 rle with old method : 0.027937650680541992 length of segment : 133 time for calcul the mask position with numpy : 0.00083160400390625 nb_pixel_total : 18925 time to create 1 rle with old method : 0.031035184860229492 length of segment : 149 time for calcul the mask position with numpy : 0.002986907958984375 nb_pixel_total : 122809 time to create 1 rle with old method : 0.1447439193725586 length of segment : 465 time for calcul the mask position with numpy : 0.0007989406585693359 nb_pixel_total : 19407 time to create 1 rle with old method : 0.02359938621520996 length of segment : 159 time for calcul the mask position with numpy : 0.00368499755859375 nb_pixel_total : 112697 time to create 1 rle with old method : 0.13183379173278809 length of segment : 590 time for calcul the mask position with numpy : 0.0001621246337890625 nb_pixel_total : 5586 time to create 1 rle with old method : 0.007924079895019531 length of segment : 64 time for calcul the mask position with numpy : 0.0028905868530273438 nb_pixel_total : 102175 time to create 1 rle with old method : 0.12316346168518066 length of segment : 330 time for calcul the mask position with numpy : 0.0002491474151611328 nb_pixel_total : 4648 time to create 1 rle with old method : 0.005736351013183594 length of segment : 76 time for calcul the mask position with numpy : 0.0008537769317626953 nb_pixel_total : 27241 time to create 1 rle with old method : 0.03270125389099121 length of segment : 248 time for calcul the mask position with numpy : 0.00046181678771972656 nb_pixel_total : 11207 time to create 1 rle with old method : 0.015772342681884766 length of segment : 120 time for calcul the mask position with numpy : 0.0011217594146728516 nb_pixel_total : 28871 time to create 1 rle with old method : 0.04851126670837402 length of segment : 200 time for calcul the mask position with numpy : 0.00030875205993652344 nb_pixel_total : 5725 time to create 1 rle with old method : 0.007095813751220703 length of segment : 79 time for calcul the mask position with numpy : 0.0005125999450683594 nb_pixel_total : 13524 time to create 1 rle with old method : 0.016826629638671875 length of segment : 129 time for calcul the mask position with numpy : 0.00022983551025390625 nb_pixel_total : 4150 time to create 1 rle with old method : 0.005326032638549805 length of segment : 64 time for calcul the mask position with numpy : 0.0007021427154541016 nb_pixel_total : 16377 time to create 1 rle with old method : 0.0195772647857666 length of segment : 173 time for calcul the mask position with numpy : 0.001096487045288086 nb_pixel_total : 32384 time to create 1 rle with old method : 0.04026150703430176 length of segment : 294 time for calcul the mask position with numpy : 0.0009739398956298828 nb_pixel_total : 36419 time to create 1 rle with old method : 0.043770551681518555 length of segment : 195 time for calcul the mask position with numpy : 0.0031447410583496094 nb_pixel_total : 81991 time to create 1 rle with old method : 0.09567618370056152 length of segment : 507 time for calcul the mask position with numpy : 0.0029799938201904297 nb_pixel_total : 108031 time to create 1 rle with old method : 0.12618613243103027 length of segment : 481 time for calcul the mask position with numpy : 0.004343986511230469 nb_pixel_total : 185091 time to create 1 rle with new method : 0.007053375244140625 length of segment : 598 time for calcul the mask position with numpy : 0.007558584213256836 nb_pixel_total : 238822 time to create 1 rle with new method : 0.013103246688842773 length of segment : 907 time for calcul the mask position with numpy : 0.0006113052368164062 nb_pixel_total : 17503 time to create 1 rle with old method : 0.02123427391052246 length of segment : 174 time for calcul the mask position with numpy : 0.002972841262817383 nb_pixel_total : 185669 time to create 1 rle with new method : 0.007745504379272461 length of segment : 604 time for calcul the mask position with numpy : 0.0020422935485839844 nb_pixel_total : 84113 time to create 1 rle with old method : 0.0984036922454834 length of segment : 316 time for calcul the mask position with numpy : 0.00034117698669433594 nb_pixel_total : 18174 time to create 1 rle with old method : 0.02215123176574707 length of segment : 167 time for calcul the mask position with numpy : 0.0002932548522949219 nb_pixel_total : 10967 time to create 1 rle with old method : 0.01352381706237793 length of segment : 141 time for calcul the mask position with numpy : 0.0010862350463867188 nb_pixel_total : 34799 time to create 1 rle with old method : 0.045053720474243164 length of segment : 207 time for calcul the mask position with numpy : 0.0006761550903320312 nb_pixel_total : 19976 time to create 1 rle with old method : 0.024373531341552734 length of segment : 137 time for calcul the mask position with numpy : 0.0015120506286621094 nb_pixel_total : 49681 time to create 1 rle with old method : 0.05803489685058594 length of segment : 375 time for calcul the mask position with numpy : 0.0008962154388427734 nb_pixel_total : 21371 time to create 1 rle with old method : 0.025890111923217773 length of segment : 189 time for calcul the mask position with numpy : 0.002897024154663086 nb_pixel_total : 109746 time to create 1 rle with old method : 0.12866854667663574 length of segment : 427 time for calcul the mask position with numpy : 0.0006024837493896484 nb_pixel_total : 11742 time to create 1 rle with old method : 0.01423192024230957 length of segment : 133 time for calcul the mask position with numpy : 0.0004019737243652344 nb_pixel_total : 12917 time to create 1 rle with old method : 0.015853404998779297 length of segment : 175 time for calcul the mask position with numpy : 0.0009946823120117188 nb_pixel_total : 22592 time to create 1 rle with old method : 0.027177810668945312 length of segment : 204 time for calcul the mask position with numpy : 0.0073316097259521484 nb_pixel_total : 259207 time to create 1 rle with new method : 0.010803461074829102 length of segment : 612 time for calcul the mask position with numpy : 0.006182193756103516 nb_pixel_total : 219086 time to create 1 rle with new method : 0.0097808837890625 length of segment : 899 time for calcul the mask position with numpy : 0.0031082630157470703 nb_pixel_total : 84895 time to create 1 rle with old method : 0.10011482238769531 length of segment : 498 time for calcul the mask position with numpy : 0.00048542022705078125 nb_pixel_total : 15811 time to create 1 rle with old method : 0.02140641212463379 length of segment : 141 time for calcul the mask position with numpy : 0.0031571388244628906 nb_pixel_total : 214238 time to create 1 rle with new method : 0.0068819522857666016 length of segment : 445 time for calcul the mask position with numpy : 0.001100778579711914 nb_pixel_total : 28032 time to create 1 rle with old method : 0.03413748741149902 length of segment : 203 time for calcul the mask position with numpy : 0.0005671977996826172 nb_pixel_total : 10776 time to create 1 rle with old method : 0.01834726333618164 length of segment : 140 time for calcul the mask position with numpy : 0.0007519721984863281 nb_pixel_total : 26521 time to create 1 rle with old method : 0.04373288154602051 length of segment : 229 time for calcul the mask position with numpy : 0.000335693359375 nb_pixel_total : 10754 time to create 1 rle with old method : 0.013433218002319336 length of segment : 98 time spent for convertir_results : 11.939054489135742 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 108 chid ids of type : 3594 Number RLEs to save : 36153 save missing photos in datou_result : time spend for datou_step_exec : 64.95558023452759 time spend to save output : 2.195103168487549 total time spend for step 1 : 67.15068340301514 step2:crop_condition Mon May 26 13:21:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 108 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 74 About to insert : list_path_to_insert length 74 new photo from crops ! About to upload 74 photos upload in portfolio : 3736932 init cache_photo without model_param we have 74 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748258519_3763835 we have uploaded 74 photos in the portfolio 3736932 time of upload the photos Elapsed time : 18.49966335296631 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3736932 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748258546_3763835 we have uploaded 15 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.36663031578064 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748258552_3763835 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9539320468902588 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 3736932 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748258564_3763835 we have uploaded 16 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.919096231460571 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748258570_3763835 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5889284610748291 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1361057982, 1361057945, 1361057788, 1361057785, 1361057781, 1361057776, 1361057773, 1361057770] Looping around the photos to save general results len do output : 108 /1361070556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361070759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057982', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057945', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057788', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057785', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057781', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057776', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057773', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057770', None, None, None, None, None, '2953425') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 332 time used for this insertion : 0.02301311492919922 save_final save missing photos in datou_result : time spend for datou_step_exec : 72.98330330848694 time spend to save output : 0.02705979347229004 total time spend for step 2 : 73.01036310195923 step3:rle_unique_nms_with_priority Mon May 26 13:22:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 108 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 11 nb_hashtags : 2 time to prepare the origin masks : 5.169836521148682 time for calcul the mask position with numpy : 1.2894697189331055 nb_pixel_total : 6610973 time to create 1 rle with new method : 0.7489602565765381 time for calcul the mask position with numpy : 0.02512502670288086 nb_pixel_total : 40477 time to create 1 rle with old method : 0.04532265663146973 time for calcul the mask position with numpy : 0.021315813064575195 nb_pixel_total : 28061 time to create 1 rle with old method : 0.03140521049499512 time for calcul the mask position with numpy : 0.021406888961791992 nb_pixel_total : 27385 time to create 1 rle with old method : 0.03088521957397461 time for calcul the mask position with numpy : 0.02140212059020996 nb_pixel_total : 14511 time to create 1 rle with old method : 0.01629495620727539 time for calcul the mask position with numpy : 0.021358013153076172 nb_pixel_total : 30169 time to create 1 rle with old method : 0.033651113510131836 time for calcul the mask position with numpy : 0.020975112915039062 nb_pixel_total : 23226 time to create 1 rle with old method : 0.025602340698242188 time for calcul the mask position with numpy : 0.026053905487060547 nb_pixel_total : 103591 time to create 1 rle with old method : 0.11963057518005371 time for calcul the mask position with numpy : 0.021415233612060547 nb_pixel_total : 20276 time to create 1 rle with old method : 0.02450871467590332 time for calcul the mask position with numpy : 0.021577835083007812 nb_pixel_total : 23680 time to create 1 rle with old method : 0.026892662048339844 time for calcul the mask position with numpy : 0.02281808853149414 nb_pixel_total : 102383 time to create 1 rle with old method : 0.11506128311157227 time for calcul the mask position with numpy : 0.0201418399810791 nb_pixel_total : 25508 time to create 1 rle with old method : 0.027924060821533203 create new chi : 2.812854528427124 time to delete rle : 0.02662968635559082 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 8386 TO DO : save crop sub photo not yet done ! save time : 0.5461878776550293 nb_obj : 22 nb_hashtags : 4 time to prepare the origin masks : 7.662390470504761 time for calcul the mask position with numpy : 0.3319268226623535 nb_pixel_total : 4910905 time to create 1 rle with new method : 0.6149113178253174 time for calcul the mask position with numpy : 0.032956838607788086 nb_pixel_total : 1478 time to create 1 rle with old method : 0.0020546913146972656 time for calcul the mask position with numpy : 0.03325009346008301 nb_pixel_total : 6810 time to create 1 rle with old method : 0.00817728042602539 time for calcul the mask position with numpy : 0.03351998329162598 nb_pixel_total : 39599 time to create 1 rle with old method : 0.0471343994140625 time for calcul the mask position with numpy : 0.03451895713806152 nb_pixel_total : 9877 time to create 1 rle with old method : 0.01117706298828125 time for calcul the mask position with numpy : 0.03251075744628906 nb_pixel_total : 5174 time to create 1 rle with old method : 0.005766391754150391 time for calcul the mask position with numpy : 0.03268146514892578 nb_pixel_total : 24635 time to create 1 rle with old method : 0.02783513069152832 time for calcul the mask position with numpy : 0.036365509033203125 nb_pixel_total : 341450 time to create 1 rle with new method : 0.5444371700286865 time for calcul the mask position with numpy : 0.036658287048339844 nb_pixel_total : 325555 time to create 1 rle with new method : 0.4471242427825928 time for calcul the mask position with numpy : 0.03357338905334473 nb_pixel_total : 96968 time to create 1 rle with old method : 0.10641860961914062 time for calcul the mask position with numpy : 0.033555030822753906 nb_pixel_total : 120345 time to create 1 rle with old method : 0.1420297622680664 time for calcul the mask position with numpy : 0.03733086585998535 nb_pixel_total : 134393 time to create 1 rle with old method : 0.15618252754211426 time for calcul the mask position with numpy : 0.020897388458251953 nb_pixel_total : 25491 time to create 1 rle with old method : 0.030863046646118164 time for calcul the mask position with numpy : 0.021539926528930664 nb_pixel_total : 69868 time to create 1 rle with old method : 0.08209490776062012 time for calcul the mask position with numpy : 0.025469303131103516 nb_pixel_total : 515074 time to create 1 rle with new method : 0.5279090404510498 time for calcul the mask position with numpy : 0.020586729049682617 nb_pixel_total : 19884 time to create 1 rle with old method : 0.021880388259887695 time for calcul the mask position with numpy : 0.020859956741333008 nb_pixel_total : 11393 time to create 1 rle with old method : 0.012700080871582031 time for calcul the mask position with numpy : 0.02105545997619629 nb_pixel_total : 77443 time to create 1 rle with old method : 0.09279227256774902 time for calcul the mask position with numpy : 0.02723550796508789 nb_pixel_total : 47005 time to create 1 rle with old method : 0.05254030227661133 time for calcul the mask position with numpy : 0.02087998390197754 nb_pixel_total : 13177 time to create 1 rle with old method : 0.014600276947021484 time for calcul the mask position with numpy : 0.020609140396118164 nb_pixel_total : 56740 time to create 1 rle with old method : 0.06377410888671875 time for calcul the mask position with numpy : 0.022296667098999023 nb_pixel_total : 117201 time to create 1 rle with old method : 0.13170695304870605 time for calcul the mask position with numpy : 0.021231889724731445 nb_pixel_total : 79775 time to create 1 rle with old method : 0.08589529991149902 create new chi : 4.285464286804199 time to delete rle : 0.0033512115478515625 batch 1 Loaded 45 chid ids of type : 3594 +++++++++++++++++++++++++++++Number RLEs to save : 20029 TO DO : save crop sub photo not yet done ! save time : 1.215505838394165 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 4.420593738555908 time for calcul the mask position with numpy : 0.5999095439910889 nb_pixel_total : 6345784 time to create 1 rle with new method : 0.7872896194458008 time for calcul the mask position with numpy : 0.034624576568603516 nb_pixel_total : 22023 time to create 1 rle with old method : 0.025708913803100586 time for calcul the mask position with numpy : 0.022882461547851562 nb_pixel_total : 1029 time to create 1 rle with old method : 0.0014367103576660156 time for calcul the mask position with numpy : 0.02244091033935547 nb_pixel_total : 23741 time to create 1 rle with old method : 0.02761363983154297 time for calcul the mask position with numpy : 0.02188396453857422 nb_pixel_total : 115960 time to create 1 rle with old method : 0.131514310836792 time for calcul the mask position with numpy : 0.021442651748657227 nb_pixel_total : 7076 time to create 1 rle with old method : 0.007955312728881836 time for calcul the mask position with numpy : 0.021709918975830078 nb_pixel_total : 53035 time to create 1 rle with old method : 0.05973625183105469 time for calcul the mask position with numpy : 0.020992755889892578 nb_pixel_total : 24330 time to create 1 rle with old method : 0.027666330337524414 time for calcul the mask position with numpy : 0.021617889404296875 nb_pixel_total : 22448 time to create 1 rle with old method : 0.02536916732788086 time for calcul the mask position with numpy : 0.021737337112426758 nb_pixel_total : 10665 time to create 1 rle with old method : 0.011996746063232422 time for calcul the mask position with numpy : 0.02138829231262207 nb_pixel_total : 22810 time to create 1 rle with old method : 0.025736093521118164 time for calcul the mask position with numpy : 0.021203994750976562 nb_pixel_total : 40618 time to create 1 rle with old method : 0.06023859977722168 time for calcul the mask position with numpy : 0.0259401798248291 nb_pixel_total : 236086 time to create 1 rle with new method : 0.5515379905700684 time for calcul the mask position with numpy : 0.022005319595336914 nb_pixel_total : 58495 time to create 1 rle with old method : 0.06747102737426758 time for calcul the mask position with numpy : 0.022243976593017578 nb_pixel_total : 66140 time to create 1 rle with old method : 0.07389259338378906 create new chi : 2.8688981533050537 time to delete rle : 0.002373218536376953 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 10551 TO DO : save crop sub photo not yet done ! save time : 0.6582329273223877 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 6.1097540855407715 time for calcul the mask position with numpy : 0.28589725494384766 nb_pixel_total : 5352700 time to create 1 rle with new method : 1.0506763458251953 time for calcul the mask position with numpy : 0.02433943748474121 nb_pixel_total : 253637 time to create 1 rle with new method : 0.7475378513336182 time for calcul the mask position with numpy : 0.02904987335205078 nb_pixel_total : 34144 time to create 1 rle with old method : 0.06304931640625 time for calcul the mask position with numpy : 0.028130769729614258 nb_pixel_total : 138142 time to create 1 rle with old method : 0.2507822513580322 time for calcul the mask position with numpy : 0.03016805648803711 nb_pixel_total : 41896 time to create 1 rle with old method : 0.0573575496673584 time for calcul the mask position with numpy : 0.023813247680664062 nb_pixel_total : 13695 time to create 1 rle with old method : 0.016195058822631836 time for calcul the mask position with numpy : 0.027013778686523438 nb_pixel_total : 56682 time to create 1 rle with old method : 0.06691288948059082 time for calcul the mask position with numpy : 0.023617982864379883 nb_pixel_total : 15973 time to create 1 rle with old method : 0.01876997947692871 time for calcul the mask position with numpy : 0.024816036224365234 nb_pixel_total : 13778 time to create 1 rle with old method : 0.016736268997192383 time for calcul the mask position with numpy : 0.027405738830566406 nb_pixel_total : 7467 time to create 1 rle with old method : 0.009670257568359375 time for calcul the mask position with numpy : 0.024059772491455078 nb_pixel_total : 24448 time to create 1 rle with old method : 0.0291750431060791 time for calcul the mask position with numpy : 0.026829957962036133 nb_pixel_total : 32812 time to create 1 rle with old method : 0.0397794246673584 time for calcul the mask position with numpy : 0.023633241653442383 nb_pixel_total : 15367 time to create 1 rle with old method : 0.01794266700744629 time for calcul the mask position with numpy : 0.03855586051940918 nb_pixel_total : 1049499 time to create 1 rle with new method : 0.6928467750549316 create new chi : 3.814016103744507 time to delete rle : 0.0019505023956298828 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 12263 TO DO : save crop sub photo not yet done ! save time : 0.7774744033813477 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 2.9993555545806885 time for calcul the mask position with numpy : 0.5970139503479004 nb_pixel_total : 6933830 time to create 1 rle with new method : 1.0585343837738037 time for calcul the mask position with numpy : 0.0314943790435791 nb_pixel_total : 18925 time to create 1 rle with old method : 0.02171945571899414 time for calcul the mask position with numpy : 0.03314852714538574 nb_pixel_total : 16402 time to create 1 rle with old method : 0.01856541633605957 time for calcul the mask position with numpy : 0.022127389907836914 nb_pixel_total : 14135 time to create 1 rle with old method : 0.01643848419189453 time for calcul the mask position with numpy : 0.022715330123901367 nb_pixel_total : 34510 time to create 1 rle with old method : 0.039917945861816406 time for calcul the mask position with numpy : 0.021809101104736328 nb_pixel_total : 5201 time to create 1 rle with old method : 0.005954265594482422 time for calcul the mask position with numpy : 0.02188277244567871 nb_pixel_total : 15660 time to create 1 rle with old method : 0.01821589469909668 time for calcul the mask position with numpy : 0.0216829776763916 nb_pixel_total : 11577 time to create 1 rle with old method : 0.01320791244506836 create new chi : 2.0033085346221924 time to delete rle : 0.0007414817810058594 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 4292 TO DO : save crop sub photo not yet done ! save time : 0.2914438247680664 nb_obj : 12 nb_hashtags : 1 time to prepare the origin masks : 3.4539222717285156 time for calcul the mask position with numpy : 0.33118510246276855 nb_pixel_total : 6592200 time to create 1 rle with new method : 0.6554131507873535 time for calcul the mask position with numpy : 0.02051067352294922 nb_pixel_total : 4150 time to create 1 rle with old method : 0.004776954650878906 time for calcul the mask position with numpy : 0.020294189453125 nb_pixel_total : 13524 time to create 1 rle with old method : 0.015574216842651367 time for calcul the mask position with numpy : 0.02060866355895996 nb_pixel_total : 5725 time to create 1 rle with old method : 0.0066950321197509766 time for calcul the mask position with numpy : 0.021895647048950195 nb_pixel_total : 28871 time to create 1 rle with old method : 0.03343081474304199 time for calcul the mask position with numpy : 0.021008014678955078 nb_pixel_total : 11207 time to create 1 rle with old method : 0.013065814971923828 time for calcul the mask position with numpy : 0.02095627784729004 nb_pixel_total : 27241 time to create 1 rle with old method : 0.031260013580322266 time for calcul the mask position with numpy : 0.02176356315612793 nb_pixel_total : 4648 time to create 1 rle with old method : 0.005331277847290039 time for calcul the mask position with numpy : 0.022748470306396484 nb_pixel_total : 102175 time to create 1 rle with old method : 0.11372685432434082 time for calcul the mask position with numpy : 0.020633459091186523 nb_pixel_total : 5586 time to create 1 rle with old method : 0.006490468978881836 time for calcul the mask position with numpy : 0.0220487117767334 nb_pixel_total : 112697 time to create 1 rle with old method : 0.12699007987976074 time for calcul the mask position with numpy : 0.021046161651611328 nb_pixel_total : 19407 time to create 1 rle with old method : 0.021879911422729492 time for calcul the mask position with numpy : 0.021538972854614258 nb_pixel_total : 122809 time to create 1 rle with old method : 0.13953447341918945 create new chi : 1.796638011932373 time to delete rle : 0.0010466575622558594 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7208 TO DO : save crop sub photo not yet done ! save time : 0.5048954486846924 nb_obj : 12 nb_hashtags : 4 time to prepare the origin masks : 3.9159884452819824 time for calcul the mask position with numpy : 0.6398701667785645 nb_pixel_total : 6217378 time to create 1 rle with new method : 0.6181881427764893 time for calcul the mask position with numpy : 0.021285057067871094 nb_pixel_total : 10967 time to create 1 rle with old method : 0.012315988540649414 time for calcul the mask position with numpy : 0.02021503448486328 nb_pixel_total : 17845 time to create 1 rle with old method : 0.019644975662231445 time for calcul the mask position with numpy : 0.021227598190307617 nb_pixel_total : 84113 time to create 1 rle with old method : 0.09413385391235352 time for calcul the mask position with numpy : 0.02101874351501465 nb_pixel_total : 3390 time to create 1 rle with old method : 0.004363536834716797 time for calcul the mask position with numpy : 0.02068042755126953 nb_pixel_total : 17503 time to create 1 rle with old method : 0.019881486892700195 time for calcul the mask position with numpy : 0.022478818893432617 nb_pixel_total : 238822 time to create 1 rle with new method : 0.6609439849853516 time for calcul the mask position with numpy : 0.022731542587280273 nb_pixel_total : 185091 time to create 1 rle with new method : 1.0266973972320557 time for calcul the mask position with numpy : 0.023509502410888672 nb_pixel_total : 107960 time to create 1 rle with old method : 0.1262803077697754 time for calcul the mask position with numpy : 0.021988868713378906 nb_pixel_total : 81991 time to create 1 rle with old method : 0.09249496459960938 time for calcul the mask position with numpy : 0.0222318172454834 nb_pixel_total : 36419 time to create 1 rle with old method : 0.04081010818481445 time for calcul the mask position with numpy : 0.02090620994567871 nb_pixel_total : 32384 time to create 1 rle with old method : 0.036612510681152344 time for calcul the mask position with numpy : 0.020712614059448242 nb_pixel_total : 16377 time to create 1 rle with old method : 0.018764495849609375 create new chi : 3.7540130615234375 time to delete rle : 0.0027713775634765625 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 10648 TO DO : save crop sub photo not yet done ! save time : 0.6443593502044678 nb_obj : 17 nb_hashtags : 4 time to prepare the origin masks : 5.508917331695557 time for calcul the mask position with numpy : 0.4522871971130371 nb_pixel_total : 6111972 time to create 1 rle with new method : 0.593447208404541 time for calcul the mask position with numpy : 0.022008180618286133 nb_pixel_total : 10754 time to create 1 rle with old method : 0.013821125030517578 time for calcul the mask position with numpy : 0.021483182907104492 nb_pixel_total : 26521 time to create 1 rle with old method : 0.02946329116821289 time for calcul the mask position with numpy : 0.0200958251953125 nb_pixel_total : 10776 time to create 1 rle with old method : 0.012150764465332031 time for calcul the mask position with numpy : 0.02062201499938965 nb_pixel_total : 28032 time to create 1 rle with old method : 0.03157854080200195 time for calcul the mask position with numpy : 0.02041316032409668 nb_pixel_total : 362 time to create 1 rle with old method : 0.0008652210235595703 time for calcul the mask position with numpy : 0.021645545959472656 nb_pixel_total : 15811 time to create 1 rle with old method : 0.018079757690429688 time for calcul the mask position with numpy : 0.02124953269958496 nb_pixel_total : 84895 time to create 1 rle with old method : 0.09898233413696289 time for calcul the mask position with numpy : 0.025020837783813477 nb_pixel_total : 219086 time to create 1 rle with new method : 0.614919900894165 time for calcul the mask position with numpy : 0.02379322052001953 nb_pixel_total : 259207 time to create 1 rle with new method : 0.6298403739929199 time for calcul the mask position with numpy : 0.02226877212524414 nb_pixel_total : 22592 time to create 1 rle with old method : 0.02641749382019043 time for calcul the mask position with numpy : 0.022867918014526367 nb_pixel_total : 12917 time to create 1 rle with old method : 0.014910221099853516 time for calcul the mask position with numpy : 0.021289348602294922 nb_pixel_total : 11742 time to create 1 rle with old method : 0.013752222061157227 time for calcul the mask position with numpy : 0.02202892303466797 nb_pixel_total : 109746 time to create 1 rle with old method : 0.12907195091247559 time for calcul the mask position with numpy : 0.023176193237304688 nb_pixel_total : 21371 time to create 1 rle with old method : 0.024976730346679688 time for calcul the mask position with numpy : 0.022716283798217773 nb_pixel_total : 49681 time to create 1 rle with old method : 0.0799095630645752 time for calcul the mask position with numpy : 0.02996516227722168 nb_pixel_total : 19976 time to create 1 rle with old method : 0.03340411186218262 time for calcul the mask position with numpy : 0.04998922348022461 nb_pixel_total : 34799 time to create 1 rle with old method : 0.06394004821777344 create new chi : 3.378152370452881 time to delete rle : 0.0031003952026367188 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 11638 TO DO : save crop sub photo not yet done ! save time : 0.7105562686920166 map_output_result : {1361057982: (0.0, 'Should be the crop_list due to order', 0), 1361057945: (0.0, 'Should be the crop_list due to order', 0), 1361057788: (0.0, 'Should be the crop_list due to order', 0), 1361057785: (0.0, 'Should be the crop_list due to order', 0), 1361057781: (0.0, 'Should be the crop_list due to order', 0), 1361057776: (0.0, 'Should be the crop_list due to order', 0), 1361057773: (0.0, 'Should be the crop_list due to order', 0), 1361057770: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1361057982, 1361057945, 1361057788, 1361057785, 1361057781, 1361057776, 1361057773, 1361057770] Looping around the photos to save general results len do output : 8 /1361057982.Didn't retrieve data . /1361057945.Didn't retrieve data . /1361057788.Didn't retrieve data . /1361057785.Didn't retrieve data . /1361057781.Didn't retrieve data . /1361057776.Didn't retrieve data . /1361057773.Didn't retrieve data . /1361057770.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057982', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057945', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057788', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057785', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057781', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057776', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057773', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057770', None, None, None, None, None, '2953425') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.011925220489501953 save_final save missing photos in datou_result : time spend for datou_step_exec : 70.41347646713257 time spend to save output : 0.012368440628051758 total time spend for step 3 : 70.42584490776062 step4:ventilate_hashtags_in_portfolio Mon May 26 13:24:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23334517 get user id for portfolio 23334517 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23334517 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','autre','metal','pehd','carton','pet_fonce','flou','papier','mal_croppe','pet_clair','environnement')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23334517 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','autre','metal','pehd','carton','pet_fonce','flou','papier','mal_croppe','pet_clair','environnement')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23334517 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','autre','metal','pehd','carton','pet_fonce','flou','papier','mal_croppe','pet_clair','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23334818,23334819,23334820,23334821,23334822,23334823,23334824,23334825,23334826,23334827,23334828?tags=background,autre,metal,pehd,carton,pet_fonce,flou,papier,mal_croppe,pet_clair,environnement Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1361057982, 1361057945, 1361057788, 1361057785, 1361057781, 1361057776, 1361057773, 1361057770] Looping around the photos to save general results len do output : 1 /23334517. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057982', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057945', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057788', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057785', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057781', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057776', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057773', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057770', None, None, None, None, None, '2953425') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.013626337051391602 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.493053913116455 time spend to save output : 0.013882160186767578 total time spend for step 4 : 1.5069360733032227 step5:final Mon May 26 13:24:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1361057982: ('0.1298923511823711',), 1361057945: ('0.1298923511823711',), 1361057788: ('0.1298923511823711',), 1361057785: ('0.1298923511823711',), 1361057781: ('0.1298923511823711',), 1361057776: ('0.1298923511823711',), 1361057773: ('0.1298923511823711',), 1361057770: ('0.1298923511823711',)} new output for save of step final : {1361057982: ('0.1298923511823711',), 1361057945: ('0.1298923511823711',), 1361057788: ('0.1298923511823711',), 1361057785: ('0.1298923511823711',), 1361057781: ('0.1298923511823711',), 1361057776: ('0.1298923511823711',), 1361057773: ('0.1298923511823711',), 1361057770: ('0.1298923511823711',)} [1361057982, 1361057945, 1361057788, 1361057785, 1361057781, 1361057776, 1361057773, 1361057770] Looping around the photos to save general results len do output : 8 /1361057982.Didn't retrieve data . /1361057945.Didn't retrieve data . /1361057788.Didn't retrieve data . /1361057785.Didn't retrieve data . /1361057781.Didn't retrieve data . /1361057776.Didn't retrieve data . /1361057773.Didn't retrieve data . /1361057770.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057982', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057945', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057788', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057785', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057781', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057776', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057773', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057770', None, None, None, None, None, '2953425') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.012752294540405273 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10506200790405273 time spend to save output : 0.013170480728149414 total time spend for step 5 : 0.11823248863220215 step6:blur_detection Mon May 26 13:24:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1748258429_3763835_1361057982_41bcb39b27b3ac12c640f8aed054aeaf.jpg resize: (2160, 3264) 1361057982 -1.4080927322257504 treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2.jpg resize: (2160, 3264) 1361057945 -0.40346097507758794 treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a.jpg resize: (2160, 3264) 1361057788 -0.36638737612842154 treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b.jpg resize: (2160, 3264) 1361057785 1.9806139948853958 treat image : temp/1748258429_3763835_1361057781_43142623d326321fce968d8265421568.jpg resize: (2160, 3264) 1361057781 -1.4522245801357199 treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc.jpg resize: (2160, 3264) 1361057776 -0.6241068756909088 treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04.jpg resize: (2160, 3264) 1361057773 0.745235880781712 treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1.jpg resize: (2160, 3264) 1361057770 0.10784441490913592 treat image : temp/1748258429_3763835_1361057982_41bcb39b27b3ac12c640f8aed054aeaf_rle_crop_3813062429_0.png resize: (148, 223) 1361070556 -0.9093914170250904 treat image : temp/1748258429_3763835_1361057982_41bcb39b27b3ac12c640f8aed054aeaf_rle_crop_3813062430_0.png resize: (520, 265) 1361070557 -0.9496939361538395 treat image : temp/1748258429_3763835_1361057982_41bcb39b27b3ac12c640f8aed054aeaf_rle_crop_3813062431_0.png resize: (263, 153) 1361070558 -1.2348975134221174 treat image : temp/1748258429_3763835_1361057982_41bcb39b27b3ac12c640f8aed054aeaf_rle_crop_3813062432_0.png resize: (118, 251) 1361070559 -0.5684402769121228 treat image : temp/1748258429_3763835_1361057982_41bcb39b27b3ac12c640f8aed054aeaf_rle_crop_3813062433_0.png resize: (601, 328) 1361070560 -0.3682579405645453 treat image : temp/1748258429_3763835_1361057982_41bcb39b27b3ac12c640f8aed054aeaf_rle_crop_3813062435_0.png resize: (183, 231) 1361070561 0.7228362419552473 treat image : temp/1748258429_3763835_1361057982_41bcb39b27b3ac12c640f8aed054aeaf_rle_crop_3813062437_0.png resize: (230, 236) 1361070562 -1.5375896816996415 treat image : temp/1748258429_3763835_1361057982_41bcb39b27b3ac12c640f8aed054aeaf_rle_crop_3813062438_0.png resize: (159, 234) 1361070563 -0.5143589517699405 treat image : temp/1748258429_3763835_1361057982_41bcb39b27b3ac12c640f8aed054aeaf_rle_crop_3813062439_0.png resize: (372, 245) 1361070564 -1.4048442409945263 treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062440_0.png resize: (296, 382) 1361070565 -0.9489683594414232 treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062442_0.png resize: (317, 219) 1361070566 -0.9233621823166502 treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062445_0.png resize: (499, 284) 1361070567 -1.4912731926413576 treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062446_0.png resize: (169, 118) 1361070568 -1.5298920235575928 treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062447_0.png resize: (123, 195) 1361070569 -0.5440641885479293 treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062452_0.png resize: (497, 368) 1361070570 -0.9807283487357472 treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062453_0.png resize: (414, 381) 1361070571 -1.7882023407191474 treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062454_0.png resize: (451, 845) 1361070572 -0.5944890494817922 treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062455_0.png resize: (945, 428) 1361070573 -0.09376512764052249 treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062457_0.png resize: (86, 111) 1361070574 -1.0017002299981628 treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062458_0.png resize: (222, 61) 1361070575 -1.6146554543584335 treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062459_0.png resize: (309, 187) 1361070576 -2.6920130983679167 treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062462_0.png resize: (403, 287) 1361070577 -1.7156758025741259 treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062463_0.png resize: (344, 429) 1361070578 -1.1427128844418417 treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062465_0.png resize: (178, 466) 1361070579 -1.8185519823078964 treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062466_0.png resize: (246, 235) 1361070580 -0.20991883910576117 treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062468_0.png resize: (160, 178) 1361070581 0.7247983555792589 treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062471_0.png resize: (89, 120) 1361070582 -0.46523822337097753 treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062473_0.png resize: (211, 248) 1361070583 -0.9498616256566577 treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062474_0.png resize: (167, 284) 1361070584 -2.2278647568665715 treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062475_0.png resize: (210, 153) 1361070585 -0.6109524385458196 treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062477_0.png resize: (232, 98) 1361070586 -1.5672072922114302 treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062478_0.png resize: (139, 457) 1361070587 -1.1869373742837237 treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062479_0.png resize: (182, 192) 1361070588 1.2319249997975992 treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062480_0.png resize: (112, 116) 1361070589 -0.6058431467339683 treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062481_0.png resize: (119, 154) 1361070590 0.4528511609247524 treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062482_0.png resize: (144, 156) 1361070591 -0.008684100517704308 treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062483_0.png resize: (327, 258) 1361070592 0.04788140450604339 treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062486_0.png resize: (299, 599) 1361070593 -0.13213618129309473 treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062487_0.png resize: (353, 280) 1361070594 -1.4060381215082238 treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062488_0.png resize: (831, 418) 1361070595 -0.9447356403592163 treat image : temp/1748258429_3763835_1361057781_43142623d326321fce968d8265421568_rle_crop_3813062489_0.png resize: (122, 130) 1361070596 -0.9856044137619692 treat image : temp/1748258429_3763835_1361057781_43142623d326321fce968d8265421568_rle_crop_3813062490_0.png resize: (161, 170) 1361070597 -0.9250177611464516 treat image : temp/1748258429_3763835_1361057781_43142623d326321fce968d8265421568_rle_crop_3813062491_0.png resize: (130, 63) 1361070598 -2.287930632637379 treat image : temp/1748258429_3763835_1361057781_43142623d326321fce968d8265421568_rle_crop_3813062494_0.png resize: (123, 172) 1361070599 -0.4584564696053151 treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc_rle_crop_3813062496_0.png resize: (384, 404) 1361070600 -1.517635211244858 treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc_rle_crop_3813062497_0.png resize: (159, 159) 1361070601 0.3376552281611437 treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc_rle_crop_3813062498_0.png resize: (583, 388) 1361070602 -0.8128532469102215 treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc_rle_crop_3813062499_0.png resize: (62, 114) 1361070603 1.8161631841650574 treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc_rle_crop_3813062500_0.png resize: (327, 550) 1361070604 -0.7271834003885284 treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc_rle_crop_3813062501_0.png resize: (76, 88) 1361070605 -1.1776726938474156 treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc_rle_crop_3813062502_0.png resize: (248, 167) 1361070606 -0.8921104963379354 treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc_rle_crop_3813062503_0.png resize: (120, 145) 1361070607 -0.09703821478038079 treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc_rle_crop_3813062504_0.png resize: (185, 239) 1361070608 -1.2246511613838211 treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc_rle_crop_3813062505_0.png resize: (77, 108) 1361070609 1.2895257122941766 treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc_rle_crop_3813062506_0.png resize: (108, 207) 1361070610 -1.3875312223735947 treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc_rle_crop_3813062507_0.png resize: (64, 96) 1361070611 -1.6438419385497505 treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04_rle_crop_3813062508_0.png resize: (173, 154) 1361070612 -1.3774644362145327 treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04_rle_crop_3813062509_0.png resize: (291, 158) 1361070613 -0.6861195862185 treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04_rle_crop_3813062510_0.png resize: (195, 259) 1361070614 -1.0535540582483065 treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04_rle_crop_3813062511_0.png resize: (491, 318) 1361070615 -1.0010247855093748 treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04_rle_crop_3813062512_0.png resize: (424, 432) 1361070616 -1.353261899690949 treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04_rle_crop_3813062514_0.png resize: (526, 992) 1361070617 -1.3199111934625496 treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04_rle_crop_3813062516_0.png resize: (604, 502) 1361070618 -0.5405724643715896 treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04_rle_crop_3813062519_0.png resize: (140, 106) 1361070619 -1.3758910517140561 treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062520_0.png resize: (207, 258) 1361070620 -0.5553697642411173 treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062523_0.png resize: (189, 176) 1361070621 -0.9171103777663938 treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062525_0.png resize: (133, 140) 1361070622 -1.921780785411874 treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062526_0.png resize: (174, 101) 1361070623 -0.27709704379072586 treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062527_0.png resize: (203, 155) 1361070624 -0.6494326119067795 treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062529_0.png resize: (819, 465) 1361070625 0.01696098116505584 treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062530_0.png resize: (421, 344) 1361070626 -1.8942696248637767 treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062533_0.png resize: (194, 236) 1361070627 -0.9659758430121764 treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062534_0.png resize: (132, 98) 1361070628 2.2224442235755033 treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062536_0.png resize: (97, 172) 1361070629 -0.10235200280962806 treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062441_0.png resize: (521, 391) 1361070646 -0.8139645640626825 treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062443_0.png resize: (62, 240) 1361070647 1.6716061126187776 treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062448_0.png resize: (847, 1073) 1361070648 -0.3894603762603098 treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062449_0.png resize: (607, 451) 1361070649 -1.695902111741361 treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062451_0.png resize: (298, 634) 1361070650 -1.0057766347202142 treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062456_0.png resize: (506, 361) 1361070651 0.24632569420969358 treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062461_0.png resize: (941, 423) 1361070652 -0.4698996281244044 treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062469_0.png resize: (202, 171) 1361070653 -0.15651425877159658 treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062484_0.png resize: (156, 125) 1361070654 -1.4590342722542504 treat image : temp/1748258429_3763835_1361057781_43142623d326321fce968d8265421568_rle_crop_3813062492_0.png resize: (192, 261) 1361070655 0.9315621038988776 treat image : temp/1748258429_3763835_1361057781_43142623d326321fce968d8265421568_rle_crop_3813062493_0.png resize: (178, 101) 1361070656 1.343630464742594 treat image : temp/1748258429_3763835_1361057781_43142623d326321fce968d8265421568_rle_crop_3813062495_0.png resize: (131, 182) 1361070657 -0.47164915107982636 treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04_rle_crop_3813062513_0.png resize: (597, 496) 1361070658 -0.6138006940982401 treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062521_0.png resize: (136, 195) 1361070659 0.3397911086132133 treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062522_0.png resize: (375, 199) 1361070660 -0.4668458435736775 treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04_rle_crop_3813062518_0.png resize: (166, 143) 1361070663 -2.232701345404409 treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062532_0.png resize: (443, 575) 1361070664 -0.7335148164910391 treat image : temp/1748258429_3763835_1361057982_41bcb39b27b3ac12c640f8aed054aeaf_rle_crop_3813062434_0.png resize: (116, 242) 1361070723 -0.8124338650367661 treat image : temp/1748258429_3763835_1361057982_41bcb39b27b3ac12c640f8aed054aeaf_rle_crop_3813062436_0.png resize: (165, 193) 1361070724 -1.379769064022061 treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062444_0.png resize: (328, 225) 1361070725 0.24124377093391847 treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062450_0.png resize: (190, 190) 1361070727 -0.7670772456191096 treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062464_0.png resize: (842, 459) 1361070728 -1.4214602428892236 treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062467_0.png resize: (86, 168) 1361070729 -0.3462136580172172 treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062470_0.png resize: (247, 357) 1361070731 -2.4874624588356937 treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062472_0.png resize: (430, 362) 1361070732 -0.052594044102774004 treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062476_0.png resize: (1145, 1342) 1361070733 -0.7571759728718916 treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062485_0.png resize: (399, 410) 1361070734 -0.7570518520001559 treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04_rle_crop_3813062515_0.png resize: (157, 137) 1361070736 -1.575110250058557 treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04_rle_crop_3813062517_0.png resize: (314, 330) 1361070737 -0.00539089129286883 treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062524_0.png resize: (416, 302) 1361070738 -0.6333744577892358 treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062528_0.png resize: (535, 602) 1361070740 -1.150596124747821 treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062531_0.png resize: (141, 141) 1361070741 0.2539054298609189 treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062535_0.png resize: (227, 133) 1361070742 1.9922605115118623 treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062460_0.png resize: (289, 686) 1361070759 -1.311695495494645 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 116 time used for this insertion : 0.018222808837890625 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 116 time used for this insertion : 0.0334324836730957 save missing photos in datou_result : time spend for datou_step_exec : 31.341995239257812 time spend to save output : 0.05631399154663086 total time spend for step 6 : 31.398309230804443 step7:brightness Mon May 26 13:24:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1748258429_3763835_1361057982_41bcb39b27b3ac12c640f8aed054aeaf.jpg treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2.jpg treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a.jpg treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b.jpg treat image : temp/1748258429_3763835_1361057781_43142623d326321fce968d8265421568.jpg treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc.jpg treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04.jpg treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1.jpg treat image : temp/1748258429_3763835_1361057982_41bcb39b27b3ac12c640f8aed054aeaf_rle_crop_3813062429_0.png treat image : temp/1748258429_3763835_1361057982_41bcb39b27b3ac12c640f8aed054aeaf_rle_crop_3813062430_0.png treat image : temp/1748258429_3763835_1361057982_41bcb39b27b3ac12c640f8aed054aeaf_rle_crop_3813062431_0.png treat image : temp/1748258429_3763835_1361057982_41bcb39b27b3ac12c640f8aed054aeaf_rle_crop_3813062432_0.png treat image : temp/1748258429_3763835_1361057982_41bcb39b27b3ac12c640f8aed054aeaf_rle_crop_3813062433_0.png treat image : temp/1748258429_3763835_1361057982_41bcb39b27b3ac12c640f8aed054aeaf_rle_crop_3813062435_0.png treat image : temp/1748258429_3763835_1361057982_41bcb39b27b3ac12c640f8aed054aeaf_rle_crop_3813062437_0.png treat image : temp/1748258429_3763835_1361057982_41bcb39b27b3ac12c640f8aed054aeaf_rle_crop_3813062438_0.png treat image : temp/1748258429_3763835_1361057982_41bcb39b27b3ac12c640f8aed054aeaf_rle_crop_3813062439_0.png treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062440_0.png treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062442_0.png treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062445_0.png treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062446_0.png treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062447_0.png treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062452_0.png treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062453_0.png treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062454_0.png treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062455_0.png treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062457_0.png treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062458_0.png treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062459_0.png treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062462_0.png treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062463_0.png treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062465_0.png treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062466_0.png treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062468_0.png treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062471_0.png treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062473_0.png treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062474_0.png treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062475_0.png treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062477_0.png treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062478_0.png treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062479_0.png treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062480_0.png treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062481_0.png treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062482_0.png treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062483_0.png treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062486_0.png treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062487_0.png treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062488_0.png treat image : temp/1748258429_3763835_1361057781_43142623d326321fce968d8265421568_rle_crop_3813062489_0.png treat image : temp/1748258429_3763835_1361057781_43142623d326321fce968d8265421568_rle_crop_3813062490_0.png treat image : temp/1748258429_3763835_1361057781_43142623d326321fce968d8265421568_rle_crop_3813062491_0.png treat image : temp/1748258429_3763835_1361057781_43142623d326321fce968d8265421568_rle_crop_3813062494_0.png treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc_rle_crop_3813062496_0.png treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc_rle_crop_3813062497_0.png treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc_rle_crop_3813062498_0.png treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc_rle_crop_3813062499_0.png treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc_rle_crop_3813062500_0.png treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc_rle_crop_3813062501_0.png treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc_rle_crop_3813062502_0.png treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc_rle_crop_3813062503_0.png treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc_rle_crop_3813062504_0.png treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc_rle_crop_3813062505_0.png treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc_rle_crop_3813062506_0.png treat image : temp/1748258429_3763835_1361057776_86f24c96bc09e4aea8079cc2d3175bbc_rle_crop_3813062507_0.png treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04_rle_crop_3813062508_0.png treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04_rle_crop_3813062509_0.png treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04_rle_crop_3813062510_0.png treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04_rle_crop_3813062511_0.png treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04_rle_crop_3813062512_0.png treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04_rle_crop_3813062514_0.png treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04_rle_crop_3813062516_0.png treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04_rle_crop_3813062519_0.png treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062520_0.png treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062523_0.png treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062525_0.png treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062526_0.png treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062527_0.png treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062529_0.png treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062530_0.png treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062533_0.png treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062534_0.png treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062536_0.png treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062441_0.png treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062443_0.png treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062448_0.png treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062449_0.png treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062451_0.png treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062456_0.png treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062461_0.png treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062469_0.png treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062484_0.png treat image : temp/1748258429_3763835_1361057781_43142623d326321fce968d8265421568_rle_crop_3813062492_0.png treat image : temp/1748258429_3763835_1361057781_43142623d326321fce968d8265421568_rle_crop_3813062493_0.png treat image : temp/1748258429_3763835_1361057781_43142623d326321fce968d8265421568_rle_crop_3813062495_0.png treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04_rle_crop_3813062513_0.png treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062521_0.png treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062522_0.png treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04_rle_crop_3813062518_0.png treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062532_0.png treat image : temp/1748258429_3763835_1361057982_41bcb39b27b3ac12c640f8aed054aeaf_rle_crop_3813062434_0.png treat image : temp/1748258429_3763835_1361057982_41bcb39b27b3ac12c640f8aed054aeaf_rle_crop_3813062436_0.png treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062444_0.png treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062450_0.png treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062464_0.png treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062467_0.png treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062470_0.png treat image : temp/1748258429_3763835_1361057788_0451c728068d1156116c1d941b3cc89a_rle_crop_3813062472_0.png treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062476_0.png treat image : temp/1748258429_3763835_1361057785_6fe3aabd304194854a44250fda178f1b_rle_crop_3813062485_0.png treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04_rle_crop_3813062515_0.png treat image : temp/1748258429_3763835_1361057773_c2c3bcd00b48099e9c8c10b2b2b05e04_rle_crop_3813062517_0.png treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062524_0.png treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062528_0.png treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062531_0.png treat image : temp/1748258429_3763835_1361057770_4d47cd7494ba699deff55ded093983e1_rle_crop_3813062535_0.png treat image : temp/1748258429_3763835_1361057945_c5b0216dc003b1390d74db9ad36bf4b2_rle_crop_3813062460_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 116 time used for this insertion : 0.01656651496887207 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 116 time used for this insertion : 0.04317140579223633 save missing photos in datou_result : time spend for datou_step_exec : 7.3097124099731445 time spend to save output : 0.06498026847839355 total time spend for step 7 : 7.374692678451538 step8:velours_tree Mon May 26 13:24:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.14768218994140625 time spend to save output : 3.981590270996094e-05 total time spend for step 8 : 0.1477220058441162 step9:send_mail_cod Mon May 26 13:24:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23334517_26-05-2025_13_24_42.pdf 23334818 imagette233348181748258682 23334819 imagette233348191748258682 23334820 change filename to text .change filename to text .imagette233348201748258682 23334821 imagette233348211748258682 23334822 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233348221748258682 23334823 change filename to text .imagette233348231748258684 23334824 imagette233348241748258684 23334825 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233348251748258684 23334826 imagette233348261748258686 23334827 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233348271748258686 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23334517 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23334818,23334819,23334820,23334821,23334822,23334823,23334824,23334825,23334826,23334827,23334828?tags=background,autre,metal,pehd,carton,pet_fonce,flou,papier,mal_croppe,pet_clair,environnement args[1361057982] : ((1361057982, -1.4080927322257504, 492688767), (1361057982, 0.3494227797083339, 2107752395), '0.1298923511823711') We are sending mail with results at report@fotonower.com args[1361057945] : ((1361057945, -0.40346097507758794, 492688767), (1361057945, 0.0948438653848197, 2107752395), '0.1298923511823711') We are sending mail with results at report@fotonower.com args[1361057788] : ((1361057788, -0.36638737612842154, 492688767), (1361057788, 0.37966274318184295, 2107752395), '0.1298923511823711') We are sending mail with results at report@fotonower.com args[1361057785] : ((1361057785, 1.9806139948853958, 492688767), (1361057785, -0.2416227713827249, 496442774), '0.1298923511823711') We are sending mail with results at report@fotonower.com args[1361057781] : ((1361057781, -1.4522245801357199, 492688767), (1361057781, 0.22042990405909696, 2107752395), '0.1298923511823711') We are sending mail with results at report@fotonower.com args[1361057776] : ((1361057776, -0.6241068756909088, 492688767), (1361057776, 0.133433524443028, 2107752395), '0.1298923511823711') We are sending mail with results at report@fotonower.com args[1361057773] : ((1361057773, 0.745235880781712, 492688767), (1361057773, -0.08129564077443485, 496442774), '0.1298923511823711') We are sending mail with results at report@fotonower.com args[1361057770] : ((1361057770, 0.10784441490913592, 492688767), (1361057770, 0.34408749350484713, 2107752395), '0.1298923511823711') We are sending mail with results at report@fotonower.com refus_total : 0.1298923511823711 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23334517 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23334517_26-05-2025_13_24_42.pdf results_Auto_P23334517_26-05-2025_13_24_42.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23334517_26-05-2025_13_24_42.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23334517','results_Auto_P23334517_26-05-2025_13_24_42.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23334517_26-05-2025_13_24_42.pdf','pdf','','0.72','0.1298923511823711') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23334517

https://www.fotonower.com/image?json=false&list_photos_id=1361057982
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361057945
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361057788
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361057785
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.9806139948853958)
https://www.fotonower.com/image?json=false&list_photos_id=1361057781
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361057776
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361057773
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361057770
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 12.99%
Veuillez trouver les photos des contaminants.

exemples de contaminants: metal: https://www.fotonower.com/view/23334820?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23334822?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/23334823?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23334825?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23334827?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23334517_26-05-2025_13_24_42.pdf.

Lien vers velours :https://www.fotonower.com/velours/23334818,23334819,23334820,23334821,23334822,23334823,23334824,23334825,23334826,23334827,23334828?tags=background,autre,metal,pehd,carton,pet_fonce,flou,papier,mal_croppe,pet_clair,environnement.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 26 May 2025 11:24:49 GMT Content-Length: 0 Connection: close X-Message-Id: wiA1d9h0RjOMUlmi9UmU4g Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1361057982, 1361057945, 1361057788, 1361057785, 1361057781, 1361057776, 1361057773, 1361057770] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057982', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057945', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057788', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057785', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057781', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057776', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057773', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057770', None, None, None, None, None, '2953425') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.013681650161743164 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.397122621536255 time spend to save output : 0.013932943344116211 total time spend for step 9 : 7.411055564880371 step10:split_time_score Mon May 26 13:24:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('12', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 26052025 23334517 Nombre de photos uploadées : 8 / 23040 (0%) 26052025 23334517 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 26052025 23334517 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 6.4373016357421875e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0004601478576660156 elapsed_time : insert_dashboard_record_day_entry 0.022283315658569336 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23334478 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23334483 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23334484 order by id desc limit 1 Qualite : 0.1298923511823711 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23334517_26-05-2025_13_24_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23334517 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23334517 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'26052025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1361057982, 1361057945, 1361057788, 1361057785, 1361057781, 1361057776, 1361057773, 1361057770] Looping around the photos to save general results len do output : 1 /23334517Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057982', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057945', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057788', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057785', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057781', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057776', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057773', None, None, None, None, None, '2953425') ('3318', None, None, None, None, None, None, None, '2953425') ('3318', '23334517', '1361057770', None, None, None, None, None, '2953425') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.013120174407958984 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.964463949203491 time spend to save output : 0.01334524154663086 total time spend for step 10 : 2.977809190750122 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 120.33user 103.66system 4:26.71elapsed 83%CPU (0avgtext+0avgdata 4466456maxresident)k 514312inputs+71936outputs (924major+9672369minor)pagefaults 0swaps