python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3610568 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3737031'] with mtr_portfolio_ids : ['26961389'] and first list_photo_ids : [] new path : /proc/3610568/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 11 ; length of list_pids : 11 ; length of list_args : 11 time to download the photos : 2.3306772708892822 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Sep 17 18:40:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10145 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-17 18:40:35.975191: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-17 18:40:36.008612: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-17 18:40:36.011219: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fd0e8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-17 18:40:36.011294: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-17 18:40:36.017479: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-17 18:40:36.191436: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x594a070 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-17 18:40:36.191499: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-17 18:40:36.193652: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-17 18:40:36.195698: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-17 18:40:36.234710: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-17 18:40:36.257615: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-17 18:40:36.262237: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-17 18:40:36.297871: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-17 18:40:36.302834: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-17 18:40:36.362859: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-17 18:40:36.364360: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-17 18:40:36.364798: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-17 18:40:36.366553: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-17 18:40:36.366571: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-17 18:40:36.366580: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-17 18:40:36.368364: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9394 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-17 18:40:36.801136: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-17 18:40:36.801289: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-17 18:40:36.801316: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-17 18:40:36.801342: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-17 18:40:36.801366: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-17 18:40:36.801395: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-17 18:40:36.801417: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-17 18:40:36.801443: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-17 18:40:36.803298: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-17 18:40:36.805452: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-17 18:40:36.805593: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-17 18:40:36.805618: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-17 18:40:36.805638: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-17 18:40:36.805657: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-17 18:40:36.805677: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-17 18:40:36.805696: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-17 18:40:36.805716: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-17 18:40:36.807872: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-17 18:40:36.807951: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-17 18:40:36.807964: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-17 18:40:36.807974: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-17 18:40:36.809912: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9394 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-17 18:40:51.074802: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-17 18:40:51.236420: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-17 18:40:52.976144: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:52.976870: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:54.956237: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:54.956326: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-09-17 18:40:55.034692: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.034764: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-17 18:40:55.035636: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.035656: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-17 18:40:55.042157: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.042181: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-17 18:40:55.042841: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.042857: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-17 18:40:55.077565: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.077658: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 19.91MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-17 18:40:55.077676: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-09-17 18:40:55.079088: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.079116: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-17 18:40:55.080409: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.080434: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-17 18:40:55.088117: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.088174: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-17 18:40:55.089438: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.089468: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-17 18:40:55.090740: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.090771: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-09-17 18:40:55.092146: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.101433: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.102897: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.127312: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.128196: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.129051: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.129894: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.134286: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.135179: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.136016: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.136879: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.138107: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.148329: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.149032: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.158117: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.158792: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.159460: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.160114: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.160854: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-09-17 18:40:55.161531: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 Detection mask done ! Trying to reset tf kernel 3611433 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 8952 tf kernel not reseted sub process len(results) : 11 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 11 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10145 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00324249267578125 nb_pixel_total : 100136 time to create 1 rle with old method : 0.11299490928649902 length of segment : 388 time for calcul the mask position with numpy : 0.0008401870727539062 nb_pixel_total : 47043 time to create 1 rle with old method : 0.05372142791748047 length of segment : 280 time for calcul the mask position with numpy : 0.011029243469238281 nb_pixel_total : 266300 time to create 1 rle with new method : 0.013820409774780273 length of segment : 463 time for calcul the mask position with numpy : 0.002615213394165039 nb_pixel_total : 180014 time to create 1 rle with new method : 0.009310007095336914 length of segment : 587 time for calcul the mask position with numpy : 0.0020716190338134766 nb_pixel_total : 130437 time to create 1 rle with old method : 0.14987921714782715 length of segment : 476 time for calcul the mask position with numpy : 0.0020322799682617188 nb_pixel_total : 142908 time to create 1 rle with old method : 0.16551518440246582 length of segment : 417 time for calcul the mask position with numpy : 0.0002567768096923828 nb_pixel_total : 14076 time to create 1 rle with old method : 0.01632547378540039 length of segment : 122 time for calcul the mask position with numpy : 0.0009028911590576172 nb_pixel_total : 62629 time to create 1 rle with old method : 0.07046699523925781 length of segment : 351 time for calcul the mask position with numpy : 0.0010974407196044922 nb_pixel_total : 79962 time to create 1 rle with old method : 0.09307003021240234 length of segment : 320 time for calcul the mask position with numpy : 0.00034356117248535156 nb_pixel_total : 11802 time to create 1 rle with old method : 0.013921737670898438 length of segment : 132 time for calcul the mask position with numpy : 0.0001900196075439453 nb_pixel_total : 8275 time to create 1 rle with old method : 0.009676456451416016 length of segment : 126 time for calcul the mask position with numpy : 0.00016808509826660156 nb_pixel_total : 8166 time to create 1 rle with old method : 0.01162266731262207 length of segment : 74 time for calcul the mask position with numpy : 0.0010869503021240234 nb_pixel_total : 52827 time to create 1 rle with old method : 0.05955624580383301 length of segment : 261 time for calcul the mask position with numpy : 0.0007698535919189453 nb_pixel_total : 54669 time to create 1 rle with old method : 0.06262731552124023 length of segment : 254 time for calcul the mask position with numpy : 0.0005624294281005859 nb_pixel_total : 26181 time to create 1 rle with old method : 0.031076669692993164 length of segment : 296 time for calcul the mask position with numpy : 0.0003407001495361328 nb_pixel_total : 12063 time to create 1 rle with old method : 0.014032840728759766 length of segment : 177 time for calcul the mask position with numpy : 0.0017282962799072266 nb_pixel_total : 94766 time to create 1 rle with old method : 0.1079103946685791 length of segment : 371 time for calcul the mask position with numpy : 0.0011889934539794922 nb_pixel_total : 44047 time to create 1 rle with old method : 0.04905986785888672 length of segment : 382 time for calcul the mask position with numpy : 0.0011858940124511719 nb_pixel_total : 62558 time to create 1 rle with old method : 0.0693819522857666 length of segment : 213 time for calcul the mask position with numpy : 0.00021314620971679688 nb_pixel_total : 11435 time to create 1 rle with old method : 0.012879610061645508 length of segment : 141 time for calcul the mask position with numpy : 0.0004994869232177734 nb_pixel_total : 19730 time to create 1 rle with old method : 0.03188323974609375 length of segment : 203 time for calcul the mask position with numpy : 0.0019919872283935547 nb_pixel_total : 108405 time to create 1 rle with old method : 0.1206216812133789 length of segment : 530 time for calcul the mask position with numpy : 0.00165557861328125 nb_pixel_total : 56286 time to create 1 rle with old method : 0.0677940845489502 length of segment : 367 time for calcul the mask position with numpy : 0.0010135173797607422 nb_pixel_total : 48827 time to create 1 rle with old method : 0.05535101890563965 length of segment : 318 time for calcul the mask position with numpy : 0.0015978813171386719 nb_pixel_total : 76767 time to create 1 rle with old method : 0.08686232566833496 length of segment : 344 time for calcul the mask position with numpy : 0.0009472370147705078 nb_pixel_total : 54694 time to create 1 rle with old method : 0.06110882759094238 length of segment : 459 time for calcul the mask position with numpy : 0.0003743171691894531 nb_pixel_total : 10195 time to create 1 rle with old method : 0.013069629669189453 length of segment : 215 time for calcul the mask position with numpy : 0.002260446548461914 nb_pixel_total : 142311 time to create 1 rle with old method : 0.1755075454711914 length of segment : 508 time for calcul the mask position with numpy : 0.00019431114196777344 nb_pixel_total : 8714 time to create 1 rle with old method : 0.009595394134521484 length of segment : 108 time for calcul the mask position with numpy : 0.003950595855712891 nb_pixel_total : 184949 time to create 1 rle with new method : 0.01762676239013672 length of segment : 561 time for calcul the mask position with numpy : 0.00018644332885742188 nb_pixel_total : 8012 time to create 1 rle with old method : 0.008787870407104492 length of segment : 113 time for calcul the mask position with numpy : 0.0007913112640380859 nb_pixel_total : 45488 time to create 1 rle with old method : 0.05208277702331543 length of segment : 394 time for calcul the mask position with numpy : 0.0009570121765136719 nb_pixel_total : 40434 time to create 1 rle with old method : 0.05118155479431152 length of segment : 487 time for calcul the mask position with numpy : 0.0007624626159667969 nb_pixel_total : 33959 time to create 1 rle with old method : 0.03933525085449219 length of segment : 314 time for calcul the mask position with numpy : 0.00093841552734375 nb_pixel_total : 37040 time to create 1 rle with old method : 0.043487548828125 length of segment : 250 time for calcul the mask position with numpy : 0.0012013912200927734 nb_pixel_total : 69163 time to create 1 rle with old method : 0.07858657836914062 length of segment : 218 time for calcul the mask position with numpy : 0.0002498626708984375 nb_pixel_total : 11702 time to create 1 rle with old method : 0.016746997833251953 length of segment : 129 time for calcul the mask position with numpy : 0.0016069412231445312 nb_pixel_total : 67901 time to create 1 rle with old method : 0.10066032409667969 length of segment : 703 time for calcul the mask position with numpy : 0.0016715526580810547 nb_pixel_total : 109021 time to create 1 rle with old method : 0.11872410774230957 length of segment : 645 time for calcul the mask position with numpy : 0.0008318424224853516 nb_pixel_total : 49764 time to create 1 rle with old method : 0.05639195442199707 length of segment : 263 time for calcul the mask position with numpy : 0.0013918876647949219 nb_pixel_total : 77673 time to create 1 rle with old method : 0.10008788108825684 length of segment : 389 time for calcul the mask position with numpy : 0.0005276203155517578 nb_pixel_total : 24186 time to create 1 rle with old method : 0.027293682098388672 length of segment : 261 time for calcul the mask position with numpy : 0.0009210109710693359 nb_pixel_total : 63497 time to create 1 rle with old method : 0.0713961124420166 length of segment : 300 time for calcul the mask position with numpy : 0.0003330707550048828 nb_pixel_total : 16365 time to create 1 rle with old method : 0.018392562866210938 length of segment : 141 time for calcul the mask position with numpy : 0.0006833076477050781 nb_pixel_total : 32482 time to create 1 rle with old method : 0.03820395469665527 length of segment : 218 time for calcul the mask position with numpy : 0.0006995201110839844 nb_pixel_total : 36042 time to create 1 rle with old method : 0.040718793869018555 length of segment : 217 time for calcul the mask position with numpy : 0.0004506111145019531 nb_pixel_total : 20264 time to create 1 rle with old method : 0.02779412269592285 length of segment : 122 time for calcul the mask position with numpy : 0.0007343292236328125 nb_pixel_total : 48956 time to create 1 rle with old method : 0.05427861213684082 length of segment : 390 time for calcul the mask position with numpy : 0.0003058910369873047 nb_pixel_total : 16626 time to create 1 rle with old method : 0.019199848175048828 length of segment : 181 time for calcul the mask position with numpy : 0.0011904239654541016 nb_pixel_total : 77466 time to create 1 rle with old method : 0.08777570724487305 length of segment : 325 time for calcul the mask position with numpy : 0.001470804214477539 nb_pixel_total : 103888 time to create 1 rle with old method : 0.1129462718963623 length of segment : 302 time for calcul the mask position with numpy : 0.0013556480407714844 nb_pixel_total : 90141 time to create 1 rle with old method : 0.09900593757629395 length of segment : 353 time for calcul the mask position with numpy : 0.001077890396118164 nb_pixel_total : 64440 time to create 1 rle with old method : 0.07542896270751953 length of segment : 249 time for calcul the mask position with numpy : 0.0008099079132080078 nb_pixel_total : 28179 time to create 1 rle with old method : 0.03199887275695801 length of segment : 274 time for calcul the mask position with numpy : 0.0002980232238769531 nb_pixel_total : 15999 time to create 1 rle with old method : 0.01804494857788086 length of segment : 149 time for calcul the mask position with numpy : 0.005656719207763672 nb_pixel_total : 224830 time to create 1 rle with new method : 0.10957002639770508 length of segment : 1072 time for calcul the mask position with numpy : 0.0015799999237060547 nb_pixel_total : 79660 time to create 1 rle with old method : 0.09098672866821289 length of segment : 429 time for calcul the mask position with numpy : 0.0014820098876953125 nb_pixel_total : 86268 time to create 1 rle with old method : 0.09769678115844727 length of segment : 442 time for calcul the mask position with numpy : 0.0010471343994140625 nb_pixel_total : 61310 time to create 1 rle with old method : 0.06795001029968262 length of segment : 219 time for calcul the mask position with numpy : 0.0009965896606445312 nb_pixel_total : 52113 time to create 1 rle with old method : 0.0599818229675293 length of segment : 310 time for calcul the mask position with numpy : 0.0024394989013671875 nb_pixel_total : 156103 time to create 1 rle with new method : 0.00739741325378418 length of segment : 517 time for calcul the mask position with numpy : 0.0008633136749267578 nb_pixel_total : 41202 time to create 1 rle with old method : 0.047112226486206055 length of segment : 315 time for calcul the mask position with numpy : 0.0011453628540039062 nb_pixel_total : 67118 time to create 1 rle with old method : 0.07707881927490234 length of segment : 344 time for calcul the mask position with numpy : 0.0009133815765380859 nb_pixel_total : 62145 time to create 1 rle with old method : 0.06982231140136719 length of segment : 286 time for calcul the mask position with numpy : 0.0007960796356201172 nb_pixel_total : 41137 time to create 1 rle with old method : 0.051690101623535156 length of segment : 219 time for calcul the mask position with numpy : 0.007681131362915039 nb_pixel_total : 259804 time to create 1 rle with new method : 0.013176202774047852 length of segment : 404 time for calcul the mask position with numpy : 0.002207517623901367 nb_pixel_total : 63676 time to create 1 rle with old method : 0.06933951377868652 length of segment : 304 time for calcul the mask position with numpy : 0.002801179885864258 nb_pixel_total : 128656 time to create 1 rle with old method : 0.1429002285003662 length of segment : 334 time for calcul the mask position with numpy : 0.003343820571899414 nb_pixel_total : 129184 time to create 1 rle with old method : 0.14144587516784668 length of segment : 603 time for calcul the mask position with numpy : 0.005826234817504883 nb_pixel_total : 189461 time to create 1 rle with new method : 0.011995553970336914 length of segment : 429 time for calcul the mask position with numpy : 0.004419565200805664 nb_pixel_total : 178127 time to create 1 rle with new method : 0.007611751556396484 length of segment : 808 time for calcul the mask position with numpy : 0.0014073848724365234 nb_pixel_total : 51826 time to create 1 rle with old method : 0.057120561599731445 length of segment : 303 time for calcul the mask position with numpy : 0.0016031265258789062 nb_pixel_total : 60121 time to create 1 rle with old method : 0.06829023361206055 length of segment : 362 time for calcul the mask position with numpy : 0.00027179718017578125 nb_pixel_total : 4244 time to create 1 rle with old method : 0.004809141159057617 length of segment : 115 time for calcul the mask position with numpy : 0.0007412433624267578 nb_pixel_total : 29868 time to create 1 rle with old method : 0.0336911678314209 length of segment : 244 time for calcul the mask position with numpy : 0.002130270004272461 nb_pixel_total : 69397 time to create 1 rle with old method : 0.07828068733215332 length of segment : 320 time for calcul the mask position with numpy : 0.0013687610626220703 nb_pixel_total : 41736 time to create 1 rle with old method : 0.046074628829956055 length of segment : 433 time for calcul the mask position with numpy : 0.0009872913360595703 nb_pixel_total : 31700 time to create 1 rle with old method : 0.03542661666870117 length of segment : 227 time for calcul the mask position with numpy : 0.002450227737426758 nb_pixel_total : 79801 time to create 1 rle with old method : 0.08640027046203613 length of segment : 289 time for calcul the mask position with numpy : 0.0007758140563964844 nb_pixel_total : 22464 time to create 1 rle with old method : 0.025796175003051758 length of segment : 213 time for calcul the mask position with numpy : 0.0008854866027832031 nb_pixel_total : 19107 time to create 1 rle with old method : 0.020754098892211914 length of segment : 179 time for calcul the mask position with numpy : 0.0015025138854980469 nb_pixel_total : 60571 time to create 1 rle with old method : 0.07776045799255371 length of segment : 205 time for calcul the mask position with numpy : 0.003097057342529297 nb_pixel_total : 87123 time to create 1 rle with old method : 0.10064148902893066 length of segment : 373 time for calcul the mask position with numpy : 0.00312042236328125 nb_pixel_total : 106922 time to create 1 rle with old method : 0.11593174934387207 length of segment : 533 time for calcul the mask position with numpy : 0.002676248550415039 nb_pixel_total : 82270 time to create 1 rle with old method : 0.09122562408447266 length of segment : 494 time for calcul the mask position with numpy : 0.0016565322875976562 nb_pixel_total : 66638 time to create 1 rle with old method : 0.07352828979492188 length of segment : 687 time for calcul the mask position with numpy : 0.0015134811401367188 nb_pixel_total : 62665 time to create 1 rle with old method : 0.06924319267272949 length of segment : 287 time for calcul the mask position with numpy : 0.0022683143615722656 nb_pixel_total : 122821 time to create 1 rle with old method : 0.1405625343322754 length of segment : 315 time for calcul the mask position with numpy : 0.001046895980834961 nb_pixel_total : 37646 time to create 1 rle with old method : 0.04188895225524902 length of segment : 208 time for calcul the mask position with numpy : 0.0006251335144042969 nb_pixel_total : 24117 time to create 1 rle with old method : 0.027263164520263672 length of segment : 184 time for calcul the mask position with numpy : 0.0028634071350097656 nb_pixel_total : 151612 time to create 1 rle with new method : 0.006346940994262695 length of segment : 353 time for calcul the mask position with numpy : 0.003999471664428711 nb_pixel_total : 158090 time to create 1 rle with new method : 0.00677180290222168 length of segment : 685 time for calcul the mask position with numpy : 0.0007522106170654297 nb_pixel_total : 21254 time to create 1 rle with old method : 0.026082754135131836 length of segment : 171 time for calcul the mask position with numpy : 0.0014660358428955078 nb_pixel_total : 58196 time to create 1 rle with old method : 0.06467366218566895 length of segment : 264 time for calcul the mask position with numpy : 0.00047969818115234375 nb_pixel_total : 14759 time to create 1 rle with old method : 0.016533374786376953 length of segment : 128 time for calcul the mask position with numpy : 0.001222848892211914 nb_pixel_total : 38297 time to create 1 rle with old method : 0.043492794036865234 length of segment : 596 time for calcul the mask position with numpy : 0.0010406970977783203 nb_pixel_total : 37145 time to create 1 rle with old method : 0.0438387393951416 length of segment : 291 time for calcul the mask position with numpy : 0.0018582344055175781 nb_pixel_total : 37947 time to create 1 rle with old method : 0.04614424705505371 length of segment : 422 time for calcul the mask position with numpy : 0.002534627914428711 nb_pixel_total : 96476 time to create 1 rle with old method : 0.10893607139587402 length of segment : 421 time for calcul the mask position with numpy : 0.0022470951080322266 nb_pixel_total : 53222 time to create 1 rle with old method : 0.06188011169433594 length of segment : 285 time for calcul the mask position with numpy : 0.0027549266815185547 nb_pixel_total : 42893 time to create 1 rle with old method : 0.04778480529785156 length of segment : 223 time for calcul the mask position with numpy : 0.0015211105346679688 nb_pixel_total : 17739 time to create 1 rle with old method : 0.020760536193847656 length of segment : 192 time for calcul the mask position with numpy : 0.002278566360473633 nb_pixel_total : 42366 time to create 1 rle with old method : 0.047844886779785156 length of segment : 353 time for calcul the mask position with numpy : 0.0011675357818603516 nb_pixel_total : 24826 time to create 1 rle with old method : 0.027834177017211914 length of segment : 366 time for calcul the mask position with numpy : 0.006211042404174805 nb_pixel_total : 125656 time to create 1 rle with old method : 0.13924527168273926 length of segment : 624 time for calcul the mask position with numpy : 0.0012507438659667969 nb_pixel_total : 23616 time to create 1 rle with old method : 0.02646470069885254 length of segment : 267 time for calcul the mask position with numpy : 0.004227399826049805 nb_pixel_total : 131086 time to create 1 rle with old method : 0.14432048797607422 length of segment : 473 time for calcul the mask position with numpy : 0.0020661354064941406 nb_pixel_total : 48472 time to create 1 rle with old method : 0.05326414108276367 length of segment : 298 time for calcul the mask position with numpy : 0.0028057098388671875 nb_pixel_total : 59139 time to create 1 rle with old method : 0.06731462478637695 length of segment : 289 time for calcul the mask position with numpy : 0.003500223159790039 nb_pixel_total : 115803 time to create 1 rle with old method : 0.1288154125213623 length of segment : 287 time for calcul the mask position with numpy : 0.0009396076202392578 nb_pixel_total : 25485 time to create 1 rle with old method : 0.028424501419067383 length of segment : 225 time for calcul the mask position with numpy : 0.00130462646484375 nb_pixel_total : 48544 time to create 1 rle with old method : 0.053682565689086914 length of segment : 391 time for calcul the mask position with numpy : 0.0014920234680175781 nb_pixel_total : 22555 time to create 1 rle with old method : 0.025558948516845703 length of segment : 260 time for calcul the mask position with numpy : 0.0025959014892578125 nb_pixel_total : 65680 time to create 1 rle with old method : 0.07259798049926758 length of segment : 408 time for calcul the mask position with numpy : 0.0037992000579833984 nb_pixel_total : 113038 time to create 1 rle with old method : 0.12327694892883301 length of segment : 400 time for calcul the mask position with numpy : 0.003656148910522461 nb_pixel_total : 72225 time to create 1 rle with old method : 0.07833218574523926 length of segment : 418 time for calcul the mask position with numpy : 0.00042128562927246094 nb_pixel_total : 7569 time to create 1 rle with old method : 0.008573770523071289 length of segment : 154 time for calcul the mask position with numpy : 0.0017788410186767578 nb_pixel_total : 35703 time to create 1 rle with old method : 0.0393829345703125 length of segment : 335 time for calcul the mask position with numpy : 0.0010633468627929688 nb_pixel_total : 29853 time to create 1 rle with old method : 0.033086538314819336 length of segment : 166 time for calcul the mask position with numpy : 0.0008771419525146484 nb_pixel_total : 26013 time to create 1 rle with old method : 0.028854846954345703 length of segment : 179 time for calcul the mask position with numpy : 0.0004448890686035156 nb_pixel_total : 10729 time to create 1 rle with old method : 0.012718915939331055 length of segment : 95 time for calcul the mask position with numpy : 0.0014717578887939453 nb_pixel_total : 26848 time to create 1 rle with old method : 0.030673742294311523 length of segment : 301 time for calcul the mask position with numpy : 0.0015940666198730469 nb_pixel_total : 43106 time to create 1 rle with old method : 0.04847383499145508 length of segment : 263 time for calcul the mask position with numpy : 0.002042055130004883 nb_pixel_total : 56816 time to create 1 rle with old method : 0.06464362144470215 length of segment : 219 time for calcul the mask position with numpy : 0.0023980140686035156 nb_pixel_total : 90765 time to create 1 rle with old method : 0.10017275810241699 length of segment : 283 time for calcul the mask position with numpy : 0.0006289482116699219 nb_pixel_total : 13158 time to create 1 rle with old method : 0.015019655227661133 length of segment : 150 time for calcul the mask position with numpy : 0.00385284423828125 nb_pixel_total : 99269 time to create 1 rle with old method : 0.10957503318786621 length of segment : 555 time for calcul the mask position with numpy : 0.0012946128845214844 nb_pixel_total : 36205 time to create 1 rle with old method : 0.0397188663482666 length of segment : 364 time for calcul the mask position with numpy : 0.001344919204711914 nb_pixel_total : 37703 time to create 1 rle with old method : 0.04167890548706055 length of segment : 203 time for calcul the mask position with numpy : 0.0010743141174316406 nb_pixel_total : 37576 time to create 1 rle with old method : 0.04060697555541992 length of segment : 235 time for calcul the mask position with numpy : 0.0016477108001708984 nb_pixel_total : 36783 time to create 1 rle with old method : 0.040650367736816406 length of segment : 245 time for calcul the mask position with numpy : 0.0029344558715820312 nb_pixel_total : 110462 time to create 1 rle with old method : 0.12169027328491211 length of segment : 276 time for calcul the mask position with numpy : 0.001489400863647461 nb_pixel_total : 43713 time to create 1 rle with old method : 0.04795503616333008 length of segment : 222 time for calcul the mask position with numpy : 0.0017175674438476562 nb_pixel_total : 21940 time to create 1 rle with old method : 0.025058507919311523 length of segment : 333 time for calcul the mask position with numpy : 0.002790212631225586 nb_pixel_total : 54215 time to create 1 rle with old method : 0.06071352958679199 length of segment : 391 time for calcul the mask position with numpy : 0.0005443096160888672 nb_pixel_total : 9011 time to create 1 rle with old method : 0.009913206100463867 length of segment : 145 time for calcul the mask position with numpy : 0.003414630889892578 nb_pixel_total : 126380 time to create 1 rle with old method : 0.13747954368591309 length of segment : 364 time for calcul the mask position with numpy : 0.0005385875701904297 nb_pixel_total : 16024 time to create 1 rle with old method : 0.018072843551635742 length of segment : 108 time for calcul the mask position with numpy : 0.0012521743774414062 nb_pixel_total : 34982 time to create 1 rle with old method : 0.03866767883300781 length of segment : 237 time for calcul the mask position with numpy : 0.004584550857543945 nb_pixel_total : 132506 time to create 1 rle with old method : 0.14567208290100098 length of segment : 579 time for calcul the mask position with numpy : 0.0006453990936279297 nb_pixel_total : 39413 time to create 1 rle with old method : 0.04427313804626465 length of segment : 202 time for calcul the mask position with numpy : 0.002634286880493164 nb_pixel_total : 87053 time to create 1 rle with old method : 0.09541130065917969 length of segment : 561 time for calcul the mask position with numpy : 0.0006895065307617188 nb_pixel_total : 31326 time to create 1 rle with old method : 0.03549051284790039 length of segment : 218 time for calcul the mask position with numpy : 0.0010318756103515625 nb_pixel_total : 27373 time to create 1 rle with old method : 0.03100275993347168 length of segment : 167 time for calcul the mask position with numpy : 0.0011715888977050781 nb_pixel_total : 55139 time to create 1 rle with old method : 0.06193399429321289 length of segment : 343 time for calcul the mask position with numpy : 0.0037696361541748047 nb_pixel_total : 165392 time to create 1 rle with new method : 0.008960723876953125 length of segment : 310 time for calcul the mask position with numpy : 0.0010833740234375 nb_pixel_total : 32906 time to create 1 rle with old method : 0.03715252876281738 length of segment : 203 time for calcul the mask position with numpy : 0.0014150142669677734 nb_pixel_total : 49474 time to create 1 rle with old method : 0.05556130409240723 length of segment : 298 time for calcul the mask position with numpy : 0.003316640853881836 nb_pixel_total : 124098 time to create 1 rle with old method : 0.14885282516479492 length of segment : 408 time for calcul the mask position with numpy : 0.002583742141723633 nb_pixel_total : 85508 time to create 1 rle with old method : 0.09742498397827148 length of segment : 375 time for calcul the mask position with numpy : 0.0006773471832275391 nb_pixel_total : 17353 time to create 1 rle with old method : 0.01959538459777832 length of segment : 136 time for calcul the mask position with numpy : 0.0010461807250976562 nb_pixel_total : 26066 time to create 1 rle with old method : 0.029775381088256836 length of segment : 229 time for calcul the mask position with numpy : 0.0013592243194580078 nb_pixel_total : 43988 time to create 1 rle with old method : 0.04879426956176758 length of segment : 269 time for calcul the mask position with numpy : 0.001613616943359375 nb_pixel_total : 57503 time to create 1 rle with old method : 0.06479573249816895 length of segment : 324 time for calcul the mask position with numpy : 0.0014677047729492188 nb_pixel_total : 50940 time to create 1 rle with old method : 0.05720257759094238 length of segment : 321 time for calcul the mask position with numpy : 0.003167867660522461 nb_pixel_total : 115601 time to create 1 rle with old method : 0.1292710304260254 length of segment : 398 time for calcul the mask position with numpy : 0.0007274150848388672 nb_pixel_total : 17952 time to create 1 rle with old method : 0.020863056182861328 length of segment : 229 time for calcul the mask position with numpy : 0.0017998218536376953 nb_pixel_total : 58882 time to create 1 rle with old method : 0.06679964065551758 length of segment : 343 time for calcul the mask position with numpy : 0.00046515464782714844 nb_pixel_total : 13532 time to create 1 rle with old method : 0.015235185623168945 length of segment : 137 time for calcul the mask position with numpy : 0.0031206607818603516 nb_pixel_total : 156375 time to create 1 rle with new method : 0.006352424621582031 length of segment : 242 time spent for convertir_results : 17.069342374801636 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 160 chid ids of type : 3594 Number RLEs to save : 51042 save missing photos in datou_result : time spend for datou_step_exec : 84.60662579536438 time spend to save output : 3.0949668884277344 total time spend for step 1 : 87.70159268379211 step2:crop_condition Wed Sep 17 18:41:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 11 ! batch 1 Loaded 160 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 113 About to insert : list_path_to_insert length 113 new photo from crops ! About to upload 113 photos upload in portfolio : 3736932 init cache_photo without model_param we have 113 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758127356_3610568 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 113 photos in the portfolio 3736932 time of upload the photos Elapsed time : 31.903294324874878 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3736932 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758127391_3610568 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 10 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.3575127124786377 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 34 About to insert : list_path_to_insert length 34 new photo from crops ! About to upload 34 photos upload in portfolio : 3736932 init cache_photo without model_param we have 34 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758127410_3610568 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 34 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.483450412750244 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758127420_3610568 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6777005195617676 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758127423_3610568 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7874205112457275 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758127426_3610568 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7085044384002686 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1384211230, 1384211128, 1384211085, 1384211019, 1384210774, 1384210679, 1384210615, 1384210338, 1384209572, 1384209540, 1384209503] Looping around the photos to save general results len do output : 160 /1384364545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384364757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384365184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384211230', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384211128', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384211085', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384211019', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384210774', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384210679', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384210615', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384210338', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384209572', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384209540', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384209503', None, None, None, None, None, '3737031') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 491 time used for this insertion : 0.03531217575073242 save_final save missing photos in datou_result : time spend for datou_step_exec : 106.98107576370239 time spend to save output : 0.04404711723327637 total time spend for step 2 : 107.02512288093567 step3:rle_unique_nms_with_priority Wed Sep 17 18:43:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 160 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 14 nb_hashtags : 2 time to prepare the origin masks : 6.845698118209839 time for calcul the mask position with numpy : 0.620690107345581 nb_pixel_total : 7135156 time to create 1 rle with new method : 0.7731928825378418 time for calcul the mask position with numpy : 0.04123187065124512 nb_pixel_total : 54669 time to create 1 rle with old method : 0.060973405838012695 time for calcul the mask position with numpy : 0.04022693634033203 nb_pixel_total : 52827 time to create 1 rle with old method : 0.05946803092956543 time for calcul the mask position with numpy : 0.024868011474609375 nb_pixel_total : 8166 time to create 1 rle with old method : 0.008954048156738281 time for calcul the mask position with numpy : 0.024230003356933594 nb_pixel_total : 8275 time to create 1 rle with old method : 0.009368181228637695 time for calcul the mask position with numpy : 0.024613380432128906 nb_pixel_total : 11802 time to create 1 rle with old method : 0.013425350189208984 time for calcul the mask position with numpy : 0.025037527084350586 nb_pixel_total : 79962 time to create 1 rle with old method : 0.0914163589477539 time for calcul the mask position with numpy : 0.025092124938964844 nb_pixel_total : 62629 time to create 1 rle with old method : 0.07018494606018066 time for calcul the mask position with numpy : 0.02561211585998535 nb_pixel_total : 14076 time to create 1 rle with old method : 0.015965700149536133 time for calcul the mask position with numpy : 0.025960922241210938 nb_pixel_total : 142908 time to create 1 rle with old method : 0.16048598289489746 time for calcul the mask position with numpy : 0.027148723602294922 nb_pixel_total : 130437 time to create 1 rle with old method : 0.1591026782989502 time for calcul the mask position with numpy : 0.025350093841552734 nb_pixel_total : 180014 time to create 1 rle with new method : 0.9558026790618896 time for calcul the mask position with numpy : 0.026437997817993164 nb_pixel_total : 266300 time to create 1 rle with new method : 0.5870304107666016 time for calcul the mask position with numpy : 0.023755788803100586 nb_pixel_total : 47043 time to create 1 rle with old method : 0.05001330375671387 time for calcul the mask position with numpy : 0.023919343948364258 nb_pixel_total : 100136 time to create 1 rle with old method : 0.10616636276245117 create new chi : 4.222764253616333 time to delete rle : 0.020951509475708008 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 10662 TO DO : save crop sub photo not yet done ! save time : 0.6690673828125 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 11.216711282730103 time for calcul the mask position with numpy : 0.5638034343719482 nb_pixel_total : 7278972 time to create 1 rle with new method : 1.266892433166504 time for calcul the mask position with numpy : 0.04155373573303223 nb_pixel_total : 45488 time to create 1 rle with old method : 0.05080842971801758 time for calcul the mask position with numpy : 0.03842663764953613 nb_pixel_total : 8012 time to create 1 rle with old method : 0.009056329727172852 time for calcul the mask position with numpy : 0.04255247116088867 nb_pixel_total : 184949 time to create 1 rle with new method : 0.5385336875915527 time for calcul the mask position with numpy : 0.031935691833496094 nb_pixel_total : 8714 time to create 1 rle with old method : 0.009927988052368164 time for calcul the mask position with numpy : 0.04174661636352539 nb_pixel_total : 142311 time to create 1 rle with old method : 0.1584913730621338 time for calcul the mask position with numpy : 0.03783059120178223 nb_pixel_total : 10195 time to create 1 rle with old method : 0.011666059494018555 time for calcul the mask position with numpy : 0.024575233459472656 nb_pixel_total : 54694 time to create 1 rle with old method : 0.06138420104980469 time for calcul the mask position with numpy : 0.025707721710205078 nb_pixel_total : 76767 time to create 1 rle with old method : 0.08732104301452637 time for calcul the mask position with numpy : 0.02529740333557129 nb_pixel_total : 48827 time to create 1 rle with old method : 0.05507659912109375 time for calcul the mask position with numpy : 0.02529430389404297 nb_pixel_total : 56286 time to create 1 rle with old method : 0.06315326690673828 time for calcul the mask position with numpy : 0.026348114013671875 nb_pixel_total : 108405 time to create 1 rle with old method : 0.1416456699371338 time for calcul the mask position with numpy : 0.025023460388183594 nb_pixel_total : 19730 time to create 1 rle with old method : 0.022603988647460938 time for calcul the mask position with numpy : 0.025357484817504883 nb_pixel_total : 11435 time to create 1 rle with old method : 0.014010190963745117 time for calcul the mask position with numpy : 0.03710675239562988 nb_pixel_total : 62558 time to create 1 rle with old method : 0.07014274597167969 time for calcul the mask position with numpy : 0.04291343688964844 nb_pixel_total : 44047 time to create 1 rle with old method : 0.04936981201171875 time for calcul the mask position with numpy : 0.04319119453430176 nb_pixel_total : 94766 time to create 1 rle with old method : 0.10421466827392578 time for calcul the mask position with numpy : 0.04065299034118652 nb_pixel_total : 12063 time to create 1 rle with old method : 0.013561248779296875 time for calcul the mask position with numpy : 0.03814697265625 nb_pixel_total : 26181 time to create 1 rle with old method : 0.028789758682250977 create new chi : 4.0123450756073 time to delete rle : 0.0020303726196289062 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 13560 TO DO : save crop sub photo not yet done ! save time : 0.8612391948699951 nb_obj : 18 nb_hashtags : 4 time to prepare the origin masks : 9.605429887771606 time for calcul the mask position with numpy : 0.762563943862915 nb_pixel_total : 7462202 time to create 1 rle with new method : 1.2743644714355469 time for calcul the mask position with numpy : 0.0493168830871582 nb_pixel_total : 77466 time to create 1 rle with old method : 0.10323691368103027 time for calcul the mask position with numpy : 0.04867267608642578 nb_pixel_total : 16626 time to create 1 rle with old method : 0.024752140045166016 time for calcul the mask position with numpy : 0.05014348030090332 nb_pixel_total : 48956 time to create 1 rle with old method : 0.06830525398254395 time for calcul the mask position with numpy : 0.04907631874084473 nb_pixel_total : 20264 time to create 1 rle with old method : 0.027510404586791992 time for calcul the mask position with numpy : 0.047145843505859375 nb_pixel_total : 36042 time to create 1 rle with old method : 0.047455549240112305 time for calcul the mask position with numpy : 0.048146963119506836 nb_pixel_total : 32482 time to create 1 rle with old method : 0.04330182075500488 time for calcul the mask position with numpy : 0.056229591369628906 nb_pixel_total : 16365 time to create 1 rle with old method : 0.023243427276611328 time for calcul the mask position with numpy : 0.055014848709106445 nb_pixel_total : 63497 time to create 1 rle with old method : 0.10597753524780273 time for calcul the mask position with numpy : 0.051264286041259766 nb_pixel_total : 24183 time to create 1 rle with old method : 0.03427314758300781 time for calcul the mask position with numpy : 0.046959638595581055 nb_pixel_total : 77333 time to create 1 rle with old method : 0.09892010688781738 time for calcul the mask position with numpy : 0.04112744331359863 nb_pixel_total : 49764 time to create 1 rle with old method : 0.05614304542541504 time for calcul the mask position with numpy : 0.04198861122131348 nb_pixel_total : 109021 time to create 1 rle with old method : 0.12902283668518066 time for calcul the mask position with numpy : 0.04809880256652832 nb_pixel_total : 67901 time to create 1 rle with old method : 0.08593320846557617 time for calcul the mask position with numpy : 0.04727339744567871 nb_pixel_total : 11702 time to create 1 rle with old method : 0.013561010360717773 time for calcul the mask position with numpy : 0.04204297065734863 nb_pixel_total : 69163 time to create 1 rle with old method : 0.09767270088195801 time for calcul the mask position with numpy : 0.050502777099609375 nb_pixel_total : 37040 time to create 1 rle with old method : 0.041951894760131836 time for calcul the mask position with numpy : 0.042498111724853516 nb_pixel_total : 33959 time to create 1 rle with old method : 0.038315534591674805 time for calcul the mask position with numpy : 0.04207658767700195 nb_pixel_total : 40434 time to create 1 rle with old method : 0.045438289642333984 create new chi : 4.056637525558472 time to delete rle : 0.002863645553588867 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 13154 TO DO : save crop sub photo not yet done ! save time : 0.8081908226013184 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 6.776282072067261 time for calcul the mask position with numpy : 0.5185167789459229 nb_pixel_total : 6667731 time to create 1 rle with new method : 0.6037204265594482 time for calcul the mask position with numpy : 0.04408073425292969 nb_pixel_total : 128656 time to create 1 rle with old method : 0.14194154739379883 time for calcul the mask position with numpy : 0.04526114463806152 nb_pixel_total : 63676 time to create 1 rle with old method : 0.08481359481811523 time for calcul the mask position with numpy : 0.04352736473083496 nb_pixel_total : 259804 time to create 1 rle with new method : 0.46359944343566895 time for calcul the mask position with numpy : 0.04854989051818848 nb_pixel_total : 41137 time to create 1 rle with old method : 0.04845070838928223 time for calcul the mask position with numpy : 0.036054372787475586 nb_pixel_total : 62145 time to create 1 rle with old method : 0.06809782981872559 time for calcul the mask position with numpy : 0.03537106513977051 nb_pixel_total : 67118 time to create 1 rle with old method : 0.07397294044494629 time for calcul the mask position with numpy : 0.03927874565124512 nb_pixel_total : 41202 time to create 1 rle with old method : 0.04653286933898926 time for calcul the mask position with numpy : 0.039736270904541016 nb_pixel_total : 156103 time to create 1 rle with new method : 0.7805423736572266 time for calcul the mask position with numpy : 0.04300212860107422 nb_pixel_total : 52113 time to create 1 rle with old method : 0.06336116790771484 time for calcul the mask position with numpy : 0.04599761962890625 nb_pixel_total : 61310 time to create 1 rle with old method : 0.07084965705871582 time for calcul the mask position with numpy : 0.04539155960083008 nb_pixel_total : 86268 time to create 1 rle with old method : 0.09688711166381836 time for calcul the mask position with numpy : 0.03933095932006836 nb_pixel_total : 79660 time to create 1 rle with old method : 0.12573480606079102 time for calcul the mask position with numpy : 0.03144979476928711 nb_pixel_total : 224830 time to create 1 rle with new method : 0.7065179347991943 time for calcul the mask position with numpy : 0.02472662925720215 nb_pixel_total : 15999 time to create 1 rle with old method : 0.018108129501342773 time for calcul the mask position with numpy : 0.02452826499938965 nb_pixel_total : 28179 time to create 1 rle with old method : 0.03170299530029297 time for calcul the mask position with numpy : 0.025146961212158203 nb_pixel_total : 64440 time to create 1 rle with old method : 0.07368063926696777 time for calcul the mask position with numpy : 0.1660456657409668 nb_pixel_total : 90141 time to create 1 rle with old method : 0.10372734069824219 time for calcul the mask position with numpy : 0.02506399154663086 nb_pixel_total : 103888 time to create 1 rle with old method : 0.11440300941467285 create new chi : 5.182600736618042 time to delete rle : 0.003709077835083008 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 15204 TO DO : save crop sub photo not yet done ! save time : 0.9320969581604004 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 5.076166152954102 time for calcul the mask position with numpy : 0.784306526184082 nb_pixel_total : 7390769 time to create 1 rle with new method : 0.9494674205780029 time for calcul the mask position with numpy : 0.04326796531677246 nb_pixel_total : 19107 time to create 1 rle with old method : 0.021917343139648438 time for calcul the mask position with numpy : 0.04390835762023926 nb_pixel_total : 22464 time to create 1 rle with old method : 0.025184154510498047 time for calcul the mask position with numpy : 0.03828883171081543 nb_pixel_total : 79801 time to create 1 rle with old method : 0.09055066108703613 time for calcul the mask position with numpy : 0.030379772186279297 nb_pixel_total : 31700 time to create 1 rle with old method : 0.040521860122680664 time for calcul the mask position with numpy : 0.029557228088378906 nb_pixel_total : 41736 time to create 1 rle with old method : 0.0486140251159668 time for calcul the mask position with numpy : 0.027705907821655273 nb_pixel_total : 69397 time to create 1 rle with old method : 0.08542847633361816 time for calcul the mask position with numpy : 0.029071807861328125 nb_pixel_total : 29868 time to create 1 rle with old method : 0.04148054122924805 time for calcul the mask position with numpy : 0.029455900192260742 nb_pixel_total : 4244 time to create 1 rle with old method : 0.00536656379699707 time for calcul the mask position with numpy : 0.028594970703125 nb_pixel_total : 56716 time to create 1 rle with old method : 0.07024383544921875 time for calcul the mask position with numpy : 0.026816368103027344 nb_pixel_total : 51826 time to create 1 rle with old method : 0.05866694450378418 time for calcul the mask position with numpy : 0.02624201774597168 nb_pixel_total : 178127 time to create 1 rle with new method : 0.35335636138916016 time for calcul the mask position with numpy : 0.02603745460510254 nb_pixel_total : 189461 time to create 1 rle with new method : 0.45773887634277344 time for calcul the mask position with numpy : 0.026639938354492188 nb_pixel_total : 129184 time to create 1 rle with old method : 0.14497160911560059 create new chi : 3.7458627223968506 time to delete rle : 0.0016269683837890625 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 11096 TO DO : save crop sub photo not yet done ! save time : 0.6883230209350586 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 3.418574094772339 time for calcul the mask position with numpy : 0.7082164287567139 nb_pixel_total : 7668210 time to create 1 rle with new method : 0.8655304908752441 time for calcul the mask position with numpy : 0.024270057678222656 nb_pixel_total : 37646 time to create 1 rle with old method : 0.04749131202697754 time for calcul the mask position with numpy : 0.025873899459838867 nb_pixel_total : 122821 time to create 1 rle with old method : 0.1331005096435547 time for calcul the mask position with numpy : 0.024073362350463867 nb_pixel_total : 62665 time to create 1 rle with old method : 0.07760834693908691 time for calcul the mask position with numpy : 0.025882482528686523 nb_pixel_total : 66172 time to create 1 rle with old method : 0.07315754890441895 time for calcul the mask position with numpy : 0.024403810501098633 nb_pixel_total : 82270 time to create 1 rle with old method : 0.1019432544708252 time for calcul the mask position with numpy : 0.027423381805419922 nb_pixel_total : 106922 time to create 1 rle with old method : 0.1395282745361328 time for calcul the mask position with numpy : 0.0291593074798584 nb_pixel_total : 87123 time to create 1 rle with old method : 0.1075587272644043 time for calcul the mask position with numpy : 0.02600264549255371 nb_pixel_total : 60571 time to create 1 rle with old method : 0.06953954696655273 create new chi : 2.5837795734405518 time to delete rle : 0.0013728141784667969 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++Number RLEs to save : 8271 TO DO : save crop sub photo not yet done ! save time : 0.5239343643188477 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 4.888829708099365 time for calcul the mask position with numpy : 1.3351638317108154 nb_pixel_total : 7663337 time to create 1 rle with new method : 1.4836602210998535 time for calcul the mask position with numpy : 0.052581071853637695 nb_pixel_total : 96476 time to create 1 rle with old method : 0.11333751678466797 time for calcul the mask position with numpy : 0.04249882698059082 nb_pixel_total : 35900 time to create 1 rle with old method : 0.03880882263183594 time for calcul the mask position with numpy : 0.03889322280883789 nb_pixel_total : 37145 time to create 1 rle with old method : 0.041336774826049805 time for calcul the mask position with numpy : 0.0413060188293457 nb_pixel_total : 33514 time to create 1 rle with old method : 0.03797483444213867 time for calcul the mask position with numpy : 0.04090261459350586 nb_pixel_total : 14759 time to create 1 rle with old method : 0.016498565673828125 time for calcul the mask position with numpy : 0.04141378402709961 nb_pixel_total : 58196 time to create 1 rle with old method : 0.06659984588623047 time for calcul the mask position with numpy : 0.04218888282775879 nb_pixel_total : 21254 time to create 1 rle with old method : 0.02462291717529297 time for calcul the mask position with numpy : 0.043855905532836914 nb_pixel_total : 158090 time to create 1 rle with new method : 1.1830508708953857 time for calcul the mask position with numpy : 0.04584550857543945 nb_pixel_total : 151612 time to create 1 rle with new method : 1.1431140899658203 time for calcul the mask position with numpy : 0.04163074493408203 nb_pixel_total : 24117 time to create 1 rle with old method : 0.02712416648864746 create new chi : 6.058490753173828 time to delete rle : 0.0023984909057617188 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 8817 TO DO : save crop sub photo not yet done ! save time : 0.5555379390716553 nb_obj : 19 nb_hashtags : 2 time to prepare the origin masks : 8.558021306991577 time for calcul the mask position with numpy : 0.7362656593322754 nb_pixel_total : 7220911 time to create 1 rle with new method : 0.7802050113677979 time for calcul the mask position with numpy : 0.04160046577453613 nb_pixel_total : 35703 time to create 1 rle with old method : 0.04011392593383789 time for calcul the mask position with numpy : 0.04307436943054199 nb_pixel_total : 7569 time to create 1 rle with old method : 0.011697769165039062 time for calcul the mask position with numpy : 0.04096245765686035 nb_pixel_total : 72225 time to create 1 rle with old method : 0.08091974258422852 time for calcul the mask position with numpy : 0.04073667526245117 nb_pixel_total : 113038 time to create 1 rle with old method : 0.1261608600616455 time for calcul the mask position with numpy : 0.04465675354003906 nb_pixel_total : 65680 time to create 1 rle with old method : 0.07862472534179688 time for calcul the mask position with numpy : 0.040746450424194336 nb_pixel_total : 22555 time to create 1 rle with old method : 0.025719642639160156 time for calcul the mask position with numpy : 0.042185068130493164 nb_pixel_total : 48544 time to create 1 rle with old method : 0.06092238426208496 time for calcul the mask position with numpy : 0.0281982421875 nb_pixel_total : 25485 time to create 1 rle with old method : 0.028865575790405273 time for calcul the mask position with numpy : 0.026154756546020508 nb_pixel_total : 114204 time to create 1 rle with old method : 0.1328878402709961 time for calcul the mask position with numpy : 0.025222063064575195 nb_pixel_total : 59139 time to create 1 rle with old method : 0.06849908828735352 time for calcul the mask position with numpy : 0.02512526512145996 nb_pixel_total : 48472 time to create 1 rle with old method : 0.06339216232299805 time for calcul the mask position with numpy : 0.026656389236450195 nb_pixel_total : 130557 time to create 1 rle with old method : 0.1452932357788086 time for calcul the mask position with numpy : 0.025121212005615234 nb_pixel_total : 23616 time to create 1 rle with old method : 0.026661396026611328 time for calcul the mask position with numpy : 0.02562713623046875 nb_pixel_total : 125656 time to create 1 rle with old method : 0.1396949291229248 time for calcul the mask position with numpy : 0.02622509002685547 nb_pixel_total : 24826 time to create 1 rle with old method : 0.027903079986572266 time for calcul the mask position with numpy : 0.02497100830078125 nb_pixel_total : 42366 time to create 1 rle with old method : 0.04792308807373047 time for calcul the mask position with numpy : 0.025930404663085938 nb_pixel_total : 17739 time to create 1 rle with old method : 0.019959449768066406 time for calcul the mask position with numpy : 0.02525019645690918 nb_pixel_total : 42893 time to create 1 rle with old method : 0.04815053939819336 time for calcul the mask position with numpy : 0.02503514289855957 nb_pixel_total : 53222 time to create 1 rle with old method : 0.05985426902770996 create new chi : 3.403106927871704 time to delete rle : 0.002299070358276367 batch 1 Loaded 39 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 14597 TO DO : save crop sub photo not yet done ! save time : 0.8939576148986816 nb_obj : 18 nb_hashtags : 4 time to prepare the origin masks : 8.268273115158081 time for calcul the mask position with numpy : 0.7223708629608154 nb_pixel_total : 7510245 time to create 1 rle with new method : 0.5506126880645752 time for calcul the mask position with numpy : 0.042653799057006836 nb_pixel_total : 9011 time to create 1 rle with old method : 0.010150432586669922 time for calcul the mask position with numpy : 0.04211759567260742 nb_pixel_total : 54215 time to create 1 rle with old method : 0.06947946548461914 time for calcul the mask position with numpy : 0.0416264533996582 nb_pixel_total : 21940 time to create 1 rle with old method : 0.024863243103027344 time for calcul the mask position with numpy : 0.04606151580810547 nb_pixel_total : 43713 time to create 1 rle with old method : 0.048795461654663086 time for calcul the mask position with numpy : 0.04198765754699707 nb_pixel_total : 110452 time to create 1 rle with old method : 0.13082361221313477 time for calcul the mask position with numpy : 0.04139351844787598 nb_pixel_total : 36783 time to create 1 rle with old method : 0.040491342544555664 time for calcul the mask position with numpy : 0.039942264556884766 nb_pixel_total : 37576 time to create 1 rle with old method : 0.04319906234741211 time for calcul the mask position with numpy : 0.04514455795288086 nb_pixel_total : 37703 time to create 1 rle with old method : 0.044821977615356445 time for calcul the mask position with numpy : 0.0455322265625 nb_pixel_total : 36205 time to create 1 rle with old method : 0.041710615158081055 time for calcul the mask position with numpy : 0.04521799087524414 nb_pixel_total : 99269 time to create 1 rle with old method : 0.11242032051086426 time for calcul the mask position with numpy : 0.04132795333862305 nb_pixel_total : 13158 time to create 1 rle with old method : 0.015366554260253906 time for calcul the mask position with numpy : 0.043663978576660156 nb_pixel_total : 90765 time to create 1 rle with old method : 0.10499811172485352 time for calcul the mask position with numpy : 0.040344953536987305 nb_pixel_total : 56816 time to create 1 rle with old method : 0.06641244888305664 time for calcul the mask position with numpy : 0.03399848937988281 nb_pixel_total : 43106 time to create 1 rle with old method : 0.05311179161071777 time for calcul the mask position with numpy : 0.030299901962280273 nb_pixel_total : 26848 time to create 1 rle with old method : 0.03392362594604492 time for calcul the mask position with numpy : 0.029369592666625977 nb_pixel_total : 10729 time to create 1 rle with old method : 0.017891883850097656 time for calcul the mask position with numpy : 0.0291290283203125 nb_pixel_total : 26013 time to create 1 rle with old method : 0.033170461654663086 time for calcul the mask position with numpy : 0.028505325317382812 nb_pixel_total : 29853 time to create 1 rle with old method : 0.036631107330322266 create new chi : 3.0473434925079346 time to delete rle : 0.00354766845703125 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 11408 TO DO : save crop sub photo not yet done ! save time : 1.0435538291931152 nb_obj : 13 nb_hashtags : 2 time to prepare the origin masks : 6.118417263031006 time for calcul the mask position with numpy : 0.634361743927002 nb_pixel_total : 7372622 time to create 1 rle with new method : 1.0186166763305664 time for calcul the mask position with numpy : 0.02640986442565918 nb_pixel_total : 124098 time to create 1 rle with old method : 0.13815093040466309 time for calcul the mask position with numpy : 0.029708385467529297 nb_pixel_total : 49474 time to create 1 rle with old method : 0.055561065673828125 time for calcul the mask position with numpy : 0.026329517364501953 nb_pixel_total : 32906 time to create 1 rle with old method : 0.036910295486450195 time for calcul the mask position with numpy : 0.024524688720703125 nb_pixel_total : 165104 time to create 1 rle with new method : 0.9331107139587402 time for calcul the mask position with numpy : 0.027729034423828125 nb_pixel_total : 55139 time to create 1 rle with old method : 0.061852216720581055 time for calcul the mask position with numpy : 0.02586078643798828 nb_pixel_total : 27373 time to create 1 rle with old method : 0.03038477897644043 time for calcul the mask position with numpy : 0.025664806365966797 nb_pixel_total : 31326 time to create 1 rle with old method : 0.03522014617919922 time for calcul the mask position with numpy : 0.02685999870300293 nb_pixel_total : 87053 time to create 1 rle with old method : 0.09943366050720215 time for calcul the mask position with numpy : 0.030230998992919922 nb_pixel_total : 39413 time to create 1 rle with old method : 0.04397988319396973 time for calcul the mask position with numpy : 0.030330657958984375 nb_pixel_total : 132506 time to create 1 rle with old method : 0.14461231231689453 time for calcul the mask position with numpy : 0.028096675872802734 nb_pixel_total : 34982 time to create 1 rle with old method : 0.03861379623413086 time for calcul the mask position with numpy : 0.03253507614135742 nb_pixel_total : 16024 time to create 1 rle with old method : 0.01790165901184082 time for calcul the mask position with numpy : 0.042644500732421875 nb_pixel_total : 126380 time to create 1 rle with old method : 0.14210724830627441 create new chi : 3.8763930797576904 time to delete rle : 0.0026595592498779297 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 10131 TO DO : save crop sub photo not yet done ! save time : 0.9344894886016846 nb_obj : 11 nb_hashtags : 2 time to prepare the origin masks : 5.2945146560668945 time for calcul the mask position with numpy : 0.9746191501617432 nb_pixel_total : 7652650 time to create 1 rle with new method : 0.656325101852417 time for calcul the mask position with numpy : 0.04248356819152832 nb_pixel_total : 156375 time to create 1 rle with new method : 0.5806000232696533 time for calcul the mask position with numpy : 0.026358366012573242 nb_pixel_total : 13532 time to create 1 rle with old method : 0.015050411224365234 time for calcul the mask position with numpy : 0.027264833450317383 nb_pixel_total : 58882 time to create 1 rle with old method : 0.06496763229370117 time for calcul the mask position with numpy : 0.025358915328979492 nb_pixel_total : 17952 time to create 1 rle with old method : 0.020046472549438477 time for calcul the mask position with numpy : 0.026407480239868164 nb_pixel_total : 113651 time to create 1 rle with old method : 0.12556838989257812 time for calcul the mask position with numpy : 0.02733325958251953 nb_pixel_total : 50940 time to create 1 rle with old method : 0.05621838569641113 time for calcul the mask position with numpy : 0.024788618087768555 nb_pixel_total : 57503 time to create 1 rle with old method : 0.06362676620483398 time for calcul the mask position with numpy : 0.025048017501831055 nb_pixel_total : 43988 time to create 1 rle with old method : 0.04734158515930176 time for calcul the mask position with numpy : 0.02488875389099121 nb_pixel_total : 26066 time to create 1 rle with old method : 0.028721094131469727 time for calcul the mask position with numpy : 0.024898290634155273 nb_pixel_total : 17353 time to create 1 rle with old method : 0.01900315284729004 time for calcul the mask position with numpy : 0.025132179260253906 nb_pixel_total : 85508 time to create 1 rle with old method : 0.0933842658996582 create new chi : 3.115556478500366 time to delete rle : 0.0012183189392089844 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 8055 TO DO : save crop sub photo not yet done ! save time : 0.5293834209442139 map_output_result : {1384211230: (0.0, 'Should be the crop_list due to order', 0), 1384211128: (0.0, 'Should be the crop_list due to order', 0), 1384211085: (0.0, 'Should be the crop_list due to order', 0), 1384211019: (0.0, 'Should be the crop_list due to order', 0), 1384210774: (0.0, 'Should be the crop_list due to order', 0), 1384210679: (0.0, 'Should be the crop_list due to order', 0), 1384210615: (0.0, 'Should be the crop_list due to order', 0), 1384210338: (0.0, 'Should be the crop_list due to order', 0), 1384209572: (0.0, 'Should be the crop_list due to order', 0), 1384209540: (0.0, 'Should be the crop_list due to order', 0), 1384209503: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1384211230, 1384211128, 1384211085, 1384211019, 1384210774, 1384210679, 1384210615, 1384210338, 1384209572, 1384209540, 1384209503] Looping around the photos to save general results len do output : 11 /1384211230.Didn't retrieve data . /1384211128.Didn't retrieve data . /1384211085.Didn't retrieve data . /1384211019.Didn't retrieve data . /1384210774.Didn't retrieve data . /1384210679.Didn't retrieve data . /1384210615.Didn't retrieve data . /1384210338.Didn't retrieve data . /1384209572.Didn't retrieve data . /1384209540.Didn't retrieve data . /1384209503.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384211230', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384211128', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384211085', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384211019', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384210774', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384210679', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384210615', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384210338', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384209572', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384209540', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384209503', None, None, None, None, None, '3737031') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.01918816566467285 save_final save missing photos in datou_result : time spend for datou_step_exec : 129.74164628982544 time spend to save output : 0.04188799858093262 total time spend for step 3 : 129.78353428840637 step4:ventilate_hashtags_in_portfolio Wed Sep 17 18:45:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26961389 get user id for portfolio 26961389 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26961389 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','mal_croppe','background','pehd','pet_fonce','flou','environnement','carton','pet_clair','metal','papier')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26961389 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','mal_croppe','background','pehd','pet_fonce','flou','environnement','carton','pet_clair','metal','papier')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26961389 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','mal_croppe','background','pehd','pet_fonce','flou','environnement','carton','pet_clair','metal','papier')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26961954,26961956,26961957,26961958,26961960,26961961,26961962,26961963,26961965,26961966,26961967?tags=autre,mal_croppe,background,pehd,pet_fonce,flou,environnement,carton,pet_clair,metal,papier Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1384211230, 1384211128, 1384211085, 1384211019, 1384210774, 1384210679, 1384210615, 1384210338, 1384209572, 1384209540, 1384209503] Looping around the photos to save general results len do output : 1 /26961389. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384211230', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384211128', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384211085', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384211019', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384210774', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384210679', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384210615', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384210338', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384209572', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384209540', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384209503', None, None, None, None, None, '3737031') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.01886582374572754 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.8127830028533936 time spend to save output : 0.019297361373901367 total time spend for step 4 : 1.832080364227295 step5:final Wed Sep 17 18:45:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1384211230: ('0.11196595950827723',), 1384211128: ('0.11196595950827723',), 1384211085: ('0.11196595950827723',), 1384211019: ('0.11196595950827723',), 1384210774: ('0.11196595950827723',), 1384210679: ('0.11196595950827723',), 1384210615: ('0.11196595950827723',), 1384210338: ('0.11196595950827723',), 1384209572: ('0.11196595950827723',), 1384209540: ('0.11196595950827723',), 1384209503: ('0.11196595950827723',)} new output for save of step final : {1384211230: ('0.11196595950827723',), 1384211128: ('0.11196595950827723',), 1384211085: ('0.11196595950827723',), 1384211019: ('0.11196595950827723',), 1384210774: ('0.11196595950827723',), 1384210679: ('0.11196595950827723',), 1384210615: ('0.11196595950827723',), 1384210338: ('0.11196595950827723',), 1384209572: ('0.11196595950827723',), 1384209540: ('0.11196595950827723',), 1384209503: ('0.11196595950827723',)} [1384211230, 1384211128, 1384211085, 1384211019, 1384210774, 1384210679, 1384210615, 1384210338, 1384209572, 1384209540, 1384209503] Looping around the photos to save general results len do output : 11 /1384211230.Didn't retrieve data . /1384211128.Didn't retrieve data . /1384211085.Didn't retrieve data . /1384211019.Didn't retrieve data . /1384210774.Didn't retrieve data . /1384210679.Didn't retrieve data . /1384210615.Didn't retrieve data . /1384210338.Didn't retrieve data . /1384209572.Didn't retrieve data . /1384209540.Didn't retrieve data . /1384209503.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384211230', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384211128', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384211085', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384211019', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384210774', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384210679', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384210615', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384210338', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384209572', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384209540', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384209503', None, None, None, None, None, '3737031') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.015868425369262695 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1453542709350586 time spend to save output : 0.01716303825378418 total time spend for step 5 : 0.16251730918884277 step6:blur_detection Wed Sep 17 18:45:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98.jpg resize: (2160, 3840) 1384211230 -5.804143076045978 treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8.jpg resize: (2160, 3840) 1384211128 -6.117089085071655 treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01.jpg resize: (2160, 3840) 1384211085 -6.302199270585653 treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab.jpg resize: (2160, 3840) 1384211019 -6.325641863658037 treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168.jpg resize: (2160, 3840) 1384210774 -5.947814622013265 treat image : temp/1758127229_3610568_1384210679_41444e2f58f538179b79e6ecd4718b9a.jpg resize: (2160, 3840) 1384210679 -6.0787292384057645 treat image : temp/1758127229_3610568_1384210615_042fcf41df606fba19c384e1731ff2be.jpg resize: (2160, 3840) 1384210615 -6.603566345248864 treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a.jpg resize: (2160, 3840) 1384210338 -6.786541463172248 treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e.jpg resize: (2160, 3840) 1384209572 -6.625635436520511 treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e.jpg resize: (2160, 3840) 1384209540 -6.784783738050643 treat image : temp/1758127229_3610568_1384209503_9a5e60114b18817d4828d181dde6cd56.jpg resize: (2160, 3840) 1384209503 -6.732112035423084 treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584309_0.png resize: (384, 437) 1384364545 -4.312253726236775 treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584311_0.png resize: (446, 693) 1384364547 -2.526687150020008 treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584313_0.png resize: (476, 402) 1384364548 -4.986675189159824 treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584315_0.png resize: (111, 170) 1384364550 -4.655793801382641 treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584316_0.png resize: (351, 253) 1384364551 -4.459594267432764 treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584317_0.png resize: (320, 356) 1384364552 -3.763562163141248 treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584318_0.png resize: (132, 134) 1384364554 -3.0382880353824446 treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584319_0.png resize: (123, 89) 1384364555 -4.0702248518849995 treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584320_0.png resize: (74, 143) 1384364556 -3.9262497260905236 treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584323_0.png resize: (296, 160) 1384364557 0.19440604592419083 treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584324_0.png resize: (165, 94) 1384364559 -0.6031520707486442 treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584326_0.png resize: (382, 309) 1384364560 0.4692286775189613 treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584327_0.png resize: (209, 375) 1384364561 -3.9796303305125456 treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584328_0.png resize: (139, 97) 1384364563 -3.7340822314230544 treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584329_0.png resize: (203, 177) 1384364564 -1.4477370104943539 treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584331_0.png resize: (319, 318) 1384364565 -2.4247874178050544 treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584334_0.png resize: (357, 254) 1384364567 -2.40433622247578 treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584335_0.png resize: (180, 132) 1384364568 -3.0243148667001862 treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584336_0.png resize: (501, 394) 1384364569 -0.9608650247276929 treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584337_0.png resize: (107, 123) 1384364570 -3.8483277324691416 treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584338_0.png resize: (517, 687) 1384364572 -2.7648300530727203 treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584339_0.png resize: (113, 95) 1384364573 -2.536612101805709 treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584341_0.png resize: (374, 227) 1384364574 -0.2252855039461887 treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584342_0.png resize: (311, 164) 1384364576 -3.233613477915531 treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584343_0.png resize: (250, 388) 1384364577 -0.482095706787717 treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584345_0.png resize: (129, 122) 1384364578 -3.5510894482550497 treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584346_0.png resize: (468, 281) 1384364580 -3.408291124781884 treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584348_0.png resize: (237, 267) 1384364581 -2.8284511259028324 treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584349_0.png resize: (389, 266) 1384364582 -0.853554887355318 treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584350_0.png resize: (254, 168) 1384364584 -1.974038350445055 treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584353_0.png resize: (218, 269) 1384364585 -1.3177248277094413 treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584354_0.png resize: (217, 265) 1384364586 0.53983422120338 treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584355_0.png resize: (112, 318) 1384364588 -2.160684772252996 treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584359_0.png resize: (275, 472) 1384364589 -3.647021372131409 treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584361_0.png resize: (245, 310) 1384364590 -4.68320731686642 treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584362_0.png resize: (235, 283) 1384364591 -2.688932329923919 treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584364_0.png resize: (829, 661) 1384364593 0.1924894410926866 treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584367_0.png resize: (218, 371) 1384364594 -3.2864306059505615 treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584369_0.png resize: (515, 463) 1384364595 -1.1719698688084499 treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584370_0.png resize: (315, 227) 1384364597 -1.3069135136093852 treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584372_0.png resize: (282, 278) 1384364598 -0.22131418636864908 treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584373_0.png resize: (206, 280) 1384364599 -0.1703988124775114 treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584376_0.png resize: (303, 542) 1384364601 1.2678581716985664 treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584377_0.png resize: (400, 508) 1384364602 -2.268788949210606 treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584378_0.png resize: (425, 653) 1384364603 -1.5727248901163078 treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584379_0.png resize: (719, 284) 1384364605 -1.5199854264291364 treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584380_0.png resize: (298, 262) 1384364606 -3.458262801070991 treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584382_0.png resize: (109, 54) 1384364607 -0.23946805864835913 treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584383_0.png resize: (231, 176) 1384364609 -2.2344566057454647 treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584386_0.png resize: (171, 269) 1384364610 -4.102435570031119 treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584388_0.png resize: (133, 326) 1384364611 -3.3800805445811912 treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584389_0.png resize: (170, 196) 1384364612 -0.3800038651624672 treat image : temp/1758127229_3610568_1384210679_41444e2f58f538179b79e6ecd4718b9a_rle_crop_3962584391_0.png resize: (373, 479) 1384364614 -0.6429567504977374 treat image : temp/1758127229_3610568_1384210679_41444e2f58f538179b79e6ecd4718b9a_rle_crop_3962584392_0.png resize: (513, 392) 1384364615 -2.064146346551056 treat image : temp/1758127229_3610568_1384210679_41444e2f58f538179b79e6ecd4718b9a_rle_crop_3962584393_0.png resize: (486, 270) 1384364616 -3.8159105037508763 treat image : temp/1758127229_3610568_1384210679_41444e2f58f538179b79e6ecd4718b9a_rle_crop_3962584394_0.png resize: (525, 231) 1384364618 -3.540515987227856 treat image : temp/1758127229_3610568_1384210679_41444e2f58f538179b79e6ecd4718b9a_rle_crop_3962584396_0.png resize: (311, 439) 1384364619 -1.8353567440693246 treat image : temp/1758127229_3610568_1384210615_042fcf41df606fba19c384e1731ff2be_rle_crop_3962584398_0.png resize: (184, 149) 1384364620 -1.8438090962900209 treat image : temp/1758127229_3610568_1384210615_042fcf41df606fba19c384e1731ff2be_rle_crop_3962584399_0.png resize: (348, 491) 1384364622 0.24999060503932596 treat image : temp/1758127229_3610568_1384210615_042fcf41df606fba19c384e1731ff2be_rle_crop_3962584400_0.png resize: (606, 404) 1384364623 -1.978483864325516 treat image : temp/1758127229_3610568_1384210615_042fcf41df606fba19c384e1731ff2be_rle_crop_3962584401_0.png resize: (171, 190) 1384364624 5.393193811302069 treat image : temp/1758127229_3610568_1384210615_042fcf41df606fba19c384e1731ff2be_rle_crop_3962584403_0.png resize: (114, 195) 1384364626 -3.2294833354359334 treat image : temp/1758127229_3610568_1384210615_042fcf41df606fba19c384e1731ff2be_rle_crop_3962584404_0.png resize: (340, 219) 1384364627 1.2851955664200663 treat image : temp/1758127229_3610568_1384210615_042fcf41df606fba19c384e1731ff2be_rle_crop_3962584405_0.png resize: (291, 158) 1384364628 -0.6239959688775494 treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584408_0.png resize: (253, 328) 1384364630 -1.9200139809657026 treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584409_0.png resize: (216, 269) 1384364631 -0.578638117367031 treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584410_0.png resize: (192, 155) 1384364632 -2.7728604489097908 treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584411_0.png resize: (314, 197) 1384364633 -4.301866608220666 treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584412_0.png resize: (291, 135) 1384364635 -3.8947606999619313 treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584413_0.png resize: (476, 439) 1384364636 -4.174175716934107 treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584414_0.png resize: (264, 126) 1384364637 -1.378457676200119 treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584415_0.png resize: (472, 426) 1384364639 -3.195957341715768 treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584417_0.png resize: (289, 328) 1384364640 -3.9112564462371546 treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584419_0.png resize: (223, 136) 1384364641 -2.3743604124208586 treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584420_0.png resize: (391, 164) 1384364643 -4.54289012096344 treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584421_0.png resize: (220, 161) 1384364644 0.8278604405964749 treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584422_0.png resize: (407, 216) 1384364645 -3.5393482120146578 treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584423_0.png resize: (377, 424) 1384364647 -3.3865135000307025 treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584425_0.png resize: (154, 66) 1384364648 -3.968246756764769 treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584426_0.png resize: (332, 195) 1384364649 -3.970707501556281 treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584427_0.png resize: (166, 244) 1384364651 -1.241623673584209 treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584428_0.png resize: (178, 200) 1384364652 -0.34459443335937395 treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584429_0.png resize: (94, 131) 1384364653 3.8691586780474188 treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584430_0.png resize: (234, 193) 1384364655 -3.135959928919148 treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584436_0.png resize: (253, 214) 1384364656 -0.9070727931679647 treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584437_0.png resize: (186, 289) 1384364657 -3.431288220033185 treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584438_0.png resize: (219, 221) 1384364659 0.23600483928570432 treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584439_0.png resize: (228, 293) 1384364660 -2.4383597116732783 treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584441_0.png resize: (222, 268) 1384364661 -3.298316844232791 treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584442_0.png resize: (339, 249) 1384364663 0.06935198526384995 treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584443_0.png resize: (233, 528) 1384364664 -3.0418461107540797 treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584444_0.png resize: (145, 84) 1384364665 -3.804314570051728 treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584445_0.png resize: (364, 509) 1384364667 -3.3329337488270516 treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584446_0.png resize: (107, 196) 1384364668 -2.8349447069317346 treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584447_0.png resize: (236, 319) 1384364669 -1.228775514883194 treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584448_0.png resize: (536, 436) 1384364671 -4.926639746326665 treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584449_0.png resize: (195, 260) 1384364672 -0.1893463223826522 treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584450_0.png resize: (335, 434) 1384364673 -3.4847672583414426 treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584451_0.png resize: (217, 209) 1384364675 3.8693824864906756 treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584452_0.png resize: (159, 208) 1384364676 1.4493436450384125 treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584455_0.png resize: (201, 246) 1384364677 -0.6058855786085401 treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584456_0.png resize: (295, 227) 1384364679 -3.9400992381192608 treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584457_0.png resize: (383, 408) 1384364680 -4.841416069178589 treat image : temp/1758127229_3610568_1384209503_9a5e60114b18817d4828d181dde6cd56_rle_crop_3962584458_0.png resize: (330, 395) 1384364681 1.6382119571291385 treat image : temp/1758127229_3610568_1384209503_9a5e60114b18817d4828d181dde6cd56_rle_crop_3962584460_0.png resize: (227, 264) 1384364683 -3.3134897005780934 treat image : temp/1758127229_3610568_1384209503_9a5e60114b18817d4828d181dde6cd56_rle_crop_3962584461_0.png resize: (269, 244) 1384364684 1.7074534972372004 treat image : temp/1758127229_3610568_1384209503_9a5e60114b18817d4828d181dde6cd56_rle_crop_3962584462_0.png resize: (310, 270) 1384364685 -3.8590540268432836 treat image : temp/1758127229_3610568_1384209503_9a5e60114b18817d4828d181dde6cd56_rle_crop_3962584463_0.png resize: (321, 232) 1384364687 -4.370913352538928 treat image : temp/1758127229_3610568_1384209503_9a5e60114b18817d4828d181dde6cd56_rle_crop_3962584464_0.png resize: (334, 560) 1384364688 -4.295650658930494 treat image : temp/1758127229_3610568_1384209503_9a5e60114b18817d4828d181dde6cd56_rle_crop_3962584465_0.png resize: (178, 170) 1384364689 -4.180165591009179 treat image : temp/1758127229_3610568_1384209503_9a5e60114b18817d4828d181dde6cd56_rle_crop_3962584466_0.png resize: (336, 279) 1384364690 -4.281495817094098 treat image : temp/1758127229_3610568_1384209503_9a5e60114b18817d4828d181dde6cd56_rle_crop_3962584467_0.png resize: (137, 119) 1384364692 -1.1137209345977064 treat image : temp/1758127229_3610568_1384209503_9a5e60114b18817d4828d181dde6cd56_rle_crop_3962584468_0.png resize: (239, 883) 1384364693 -4.354000312293736 treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584332_0.png resize: (317, 276) 1384364742 -2.644404221011537 treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584352_0.png resize: (141, 156) 1384364745 -2.43481908660141 treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584358_0.png resize: (313, 342) 1384364746 -4.648655679796715 treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584363_0.png resize: (149, 130) 1384364747 -0.7861040039787829 treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584371_0.png resize: (344, 283) 1384364750 -3.340598246889066 treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584385_0.png resize: (433, 163) 1384364751 -2.470329029330744 treat image : temp/1758127229_3610568_1384210679_41444e2f58f538179b79e6ecd4718b9a_rle_crop_3962584397_0.png resize: (204, 253) 1384364752 -4.439102205591446 treat image : temp/1758127229_3610568_1384210615_042fcf41df606fba19c384e1731ff2be_rle_crop_3962584402_0.png resize: (233, 431) 1384364755 -2.2932662210495907 treat image : temp/1758127229_3610568_1384210615_042fcf41df606fba19c384e1731ff2be_rle_crop_3962584407_0.png resize: (421, 360) 1384364756 -4.129446119259706 treat image : temp/1758127229_3610568_1384209503_9a5e60114b18817d4828d181dde6cd56_rle_crop_3962584459_0.png resize: (132, 178) 1384364757 -3.0446901286518244 treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584310_0.png resize: (280, 245) 1384365015 -3.815358604173895 treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584312_0.png resize: (587, 438) 1384365018 -4.747942966706873 treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584314_0.png resize: (407, 461) 1384365019 -3.129638724117378 treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584321_0.png resize: (254, 328) 1384365021 -5.2279802275196925 treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584322_0.png resize: (254, 298) 1384365023 -4.412539528709635 treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584325_0.png resize: (367, 360) 1384365024 -3.229425155968972 treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584330_0.png resize: (530, 271) 1384365027 -4.356056233895536 treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584333_0.png resize: (340, 373) 1384365029 -2.873541409041241 treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584340_0.png resize: (390, 166) 1384365030 -4.790746980795436 treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584344_0.png resize: (198, 458) 1384365032 -4.076711897171966 treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584347_0.png resize: (645, 203) 1384365034 -4.388560872659635 treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584351_0.png resize: (298, 276) 1384365035 -4.4048987175447305 treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584356_0.png resize: (390, 140) 1384365037 -3.6769046057104267 treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584360_0.png resize: (351, 330) 1384365039 -4.66335114534161 treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584365_0.png resize: (429, 284) 1384365040 -3.5407956602414994 treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584366_0.png resize: (428, 260) 1384365041 -5.53264405573035 treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584368_0.png resize: (310, 217) 1384365044 -3.10832208952956 treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584374_0.png resize: (400, 874) 1384365045 -4.890281393388339 treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584375_0.png resize: (304, 292) 1384365046 -2.164911586301663 treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584381_0.png resize: (309, 272) 1384365049 -3.711785908492373 treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584384_0.png resize: (320, 297) 1384365050 -3.463686206087564 treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584387_0.png resize: (286, 374) 1384365051 -4.110693512201466 treat image : temp/1758127229_3610568_1384210679_41444e2f58f538179b79e6ecd4718b9a_rle_crop_3962584390_0.png resize: (204, 373) 1384365062 -3.776266228412709 treat image : temp/1758127229_3610568_1384210679_41444e2f58f538179b79e6ecd4718b9a_rle_crop_3962584395_0.png resize: (287, 263) 1384365063 -2.22916975364417 treat image : temp/1758127229_3610568_1384210615_042fcf41df606fba19c384e1731ff2be_rle_crop_3962584406_0.png resize: (361, 289) 1384365065 -2.8209405335411706 treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584416_0.png resize: (298, 239) 1384365067 -4.166261342975039 treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584418_0.png resize: (287, 593) 1384365068 -4.562852158655554 treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584424_0.png resize: (403, 324) 1384365070 -2.1906069606825542 treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584431_0.png resize: (252, 236) 1384365073 -4.276826304806656 treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584433_0.png resize: (251, 458) 1384365074 -5.268914958275372 treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584435_0.png resize: (540, 304) 1384365076 -4.7283507968435 treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584440_0.png resize: (257, 556) 1384365079 -3.001507680256634 treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584453_0.png resize: (319, 239) 1384365080 -5.094540712479081 treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584454_0.png resize: (299, 745) 1384365082 -4.624724475494519 treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584434_0.png resize: (138, 143) 1384365115 -3.88589623577098 treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584357_0.png resize: (181, 117) 1384365146 -2.956040086821647 treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584432_0.png resize: (217, 355) 1384365184 -4.637018359254995 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 171 time used for this insertion : 0.021478891372680664 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 171 time used for this insertion : 0.03148674964904785 save missing photos in datou_result : time spend for datou_step_exec : 47.41253066062927 time spend to save output : 0.05887889862060547 total time spend for step 6 : 47.47140955924988 step7:brightness Wed Sep 17 18:46:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98.jpg treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8.jpg treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01.jpg treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab.jpg treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168.jpg treat image : temp/1758127229_3610568_1384210679_41444e2f58f538179b79e6ecd4718b9a.jpg treat image : temp/1758127229_3610568_1384210615_042fcf41df606fba19c384e1731ff2be.jpg treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a.jpg treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e.jpg treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e.jpg treat image : temp/1758127229_3610568_1384209503_9a5e60114b18817d4828d181dde6cd56.jpg treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584309_0.png treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584311_0.png treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584313_0.png treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584315_0.png treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584316_0.png treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584317_0.png treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584318_0.png treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584319_0.png treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584320_0.png treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584323_0.png treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584324_0.png treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584326_0.png treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584327_0.png treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584328_0.png treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584329_0.png treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584331_0.png treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584334_0.png treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584335_0.png treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584336_0.png treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584337_0.png treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584338_0.png treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584339_0.png treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584341_0.png treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584342_0.png treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584343_0.png treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584345_0.png treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584346_0.png treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584348_0.png treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584349_0.png treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584350_0.png treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584353_0.png treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584354_0.png treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584355_0.png treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584359_0.png treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584361_0.png treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584362_0.png treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584364_0.png treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584367_0.png treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584369_0.png treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584370_0.png treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584372_0.png treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584373_0.png treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584376_0.png treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584377_0.png treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584378_0.png treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584379_0.png treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584380_0.png treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584382_0.png treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584383_0.png treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584386_0.png treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584388_0.png treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584389_0.png treat image : temp/1758127229_3610568_1384210679_41444e2f58f538179b79e6ecd4718b9a_rle_crop_3962584391_0.png treat image : temp/1758127229_3610568_1384210679_41444e2f58f538179b79e6ecd4718b9a_rle_crop_3962584392_0.png treat image : temp/1758127229_3610568_1384210679_41444e2f58f538179b79e6ecd4718b9a_rle_crop_3962584393_0.png treat image : temp/1758127229_3610568_1384210679_41444e2f58f538179b79e6ecd4718b9a_rle_crop_3962584394_0.png treat image : temp/1758127229_3610568_1384210679_41444e2f58f538179b79e6ecd4718b9a_rle_crop_3962584396_0.png treat image : temp/1758127229_3610568_1384210615_042fcf41df606fba19c384e1731ff2be_rle_crop_3962584398_0.png treat image : temp/1758127229_3610568_1384210615_042fcf41df606fba19c384e1731ff2be_rle_crop_3962584399_0.png treat image : temp/1758127229_3610568_1384210615_042fcf41df606fba19c384e1731ff2be_rle_crop_3962584400_0.png treat image : temp/1758127229_3610568_1384210615_042fcf41df606fba19c384e1731ff2be_rle_crop_3962584401_0.png treat image : temp/1758127229_3610568_1384210615_042fcf41df606fba19c384e1731ff2be_rle_crop_3962584403_0.png treat image : temp/1758127229_3610568_1384210615_042fcf41df606fba19c384e1731ff2be_rle_crop_3962584404_0.png treat image : temp/1758127229_3610568_1384210615_042fcf41df606fba19c384e1731ff2be_rle_crop_3962584405_0.png treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584408_0.png treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584409_0.png treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584410_0.png treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584411_0.png treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584412_0.png treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584413_0.png treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584414_0.png treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584415_0.png treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584417_0.png treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584419_0.png treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584420_0.png treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584421_0.png treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584422_0.png treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584423_0.png treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584425_0.png treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584426_0.png treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584427_0.png treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584428_0.png treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584429_0.png treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584430_0.png treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584436_0.png treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584437_0.png treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584438_0.png treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584439_0.png treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584441_0.png treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584442_0.png treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584443_0.png treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584444_0.png treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584445_0.png treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584446_0.png treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584447_0.png treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584448_0.png treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584449_0.png treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584450_0.png treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584451_0.png treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584452_0.png treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584455_0.png treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584456_0.png treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584457_0.png treat image : temp/1758127229_3610568_1384209503_9a5e60114b18817d4828d181dde6cd56_rle_crop_3962584458_0.png treat image : temp/1758127229_3610568_1384209503_9a5e60114b18817d4828d181dde6cd56_rle_crop_3962584460_0.png treat image : temp/1758127229_3610568_1384209503_9a5e60114b18817d4828d181dde6cd56_rle_crop_3962584461_0.png treat image : temp/1758127229_3610568_1384209503_9a5e60114b18817d4828d181dde6cd56_rle_crop_3962584462_0.png treat image : temp/1758127229_3610568_1384209503_9a5e60114b18817d4828d181dde6cd56_rle_crop_3962584463_0.png treat image : temp/1758127229_3610568_1384209503_9a5e60114b18817d4828d181dde6cd56_rle_crop_3962584464_0.png treat image : temp/1758127229_3610568_1384209503_9a5e60114b18817d4828d181dde6cd56_rle_crop_3962584465_0.png treat image : temp/1758127229_3610568_1384209503_9a5e60114b18817d4828d181dde6cd56_rle_crop_3962584466_0.png treat image : temp/1758127229_3610568_1384209503_9a5e60114b18817d4828d181dde6cd56_rle_crop_3962584467_0.png treat image : temp/1758127229_3610568_1384209503_9a5e60114b18817d4828d181dde6cd56_rle_crop_3962584468_0.png treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584332_0.png treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584352_0.png treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584358_0.png treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584363_0.png treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584371_0.png treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584385_0.png treat image : temp/1758127229_3610568_1384210679_41444e2f58f538179b79e6ecd4718b9a_rle_crop_3962584397_0.png treat image : temp/1758127229_3610568_1384210615_042fcf41df606fba19c384e1731ff2be_rle_crop_3962584402_0.png treat image : temp/1758127229_3610568_1384210615_042fcf41df606fba19c384e1731ff2be_rle_crop_3962584407_0.png treat image : temp/1758127229_3610568_1384209503_9a5e60114b18817d4828d181dde6cd56_rle_crop_3962584459_0.png treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584310_0.png treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584312_0.png treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584314_0.png treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584321_0.png treat image : temp/1758127229_3610568_1384211230_ee33083598d7b24e3a8d54fcf71b9a98_rle_crop_3962584322_0.png treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584325_0.png treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584330_0.png treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584333_0.png treat image : temp/1758127229_3610568_1384211128_7c53734082198bb4f74d101ac8496db8_rle_crop_3962584340_0.png treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584344_0.png treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584347_0.png treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584351_0.png treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584356_0.png treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584360_0.png treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584365_0.png treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584366_0.png treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584368_0.png treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584374_0.png treat image : temp/1758127229_3610568_1384211019_7e3a2bb201d5df1a456026c85421ebab_rle_crop_3962584375_0.png treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584381_0.png treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584384_0.png treat image : temp/1758127229_3610568_1384210774_669e3f8d47c1c9ffd7c615a7745e9168_rle_crop_3962584387_0.png treat image : temp/1758127229_3610568_1384210679_41444e2f58f538179b79e6ecd4718b9a_rle_crop_3962584390_0.png treat image : temp/1758127229_3610568_1384210679_41444e2f58f538179b79e6ecd4718b9a_rle_crop_3962584395_0.png treat image : temp/1758127229_3610568_1384210615_042fcf41df606fba19c384e1731ff2be_rle_crop_3962584406_0.png treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584416_0.png treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584418_0.png treat image : temp/1758127229_3610568_1384210338_da053dd8984af30001e7fbce01d1c50a_rle_crop_3962584424_0.png treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584431_0.png treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584433_0.png treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584435_0.png treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584440_0.png treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584453_0.png treat image : temp/1758127229_3610568_1384209540_53611817a7c81653bb5e57d5dfa46b9e_rle_crop_3962584454_0.png treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584434_0.png treat image : temp/1758127229_3610568_1384211085_154b91306f708d527252ba4023165d01_rle_crop_3962584357_0.png treat image : temp/1758127229_3610568_1384209572_ca7fdbf3ec38b4824e714b42deea2f9e_rle_crop_3962584432_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 171 time used for this insertion : 0.018530607223510742 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 171 time used for this insertion : 0.02985239028930664 save missing photos in datou_result : time spend for datou_step_exec : 12.794663190841675 time spend to save output : 0.053392887115478516 total time spend for step 7 : 12.848056077957153 step8:velours_tree Wed Sep 17 18:46:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 1.7129201889038086 time spend to save output : 4.315376281738281e-05 total time spend for step 8 : 1.712963342666626 step9:send_mail_cod Wed Sep 17 18:47:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26961389_17-09-2025_18_47_00.pdf 26961954 change filename to text .imagette269619541758127620 26961956 imagette269619561758127620 26961957 imagette269619571758127620 26961958 change filename to text .imagette269619581758127620 26961960 change filename to text .imagette269619601758127620 26961961 imagette269619611758127620 26961963 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette269619631758127620 26961965 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette269619651758127621 26961966 imagette269619661758127623 26961967 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette269619671758127623 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26961389 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26961954,26961956,26961957,26961958,26961960,26961961,26961962,26961963,26961965,26961966,26961967?tags=autre,mal_croppe,background,pehd,pet_fonce,flou,environnement,carton,pet_clair,metal,papier args[1384211230] : ((1384211230, -5.804143076045978, 492609224), (1384211230, 0.9150818714754813, 2107752395), '0.11196595950827723') We are sending mail with results at report@fotonower.com args[1384211128] : ((1384211128, -6.117089085071655, 492609224), (1384211128, 1.280582757188053, 2107752395), '0.11196595950827723') We are sending mail with results at report@fotonower.com args[1384211085] : ((1384211085, -6.302199270585653, 492609224), (1384211085, 1.3812082046983711, 2107752395), '0.11196595950827723') We are sending mail with results at report@fotonower.com args[1384211019] : ((1384211019, -6.325641863658037, 492609224), (1384211019, 1.4462168510297302, 2107752395), '0.11196595950827723') We are sending mail with results at report@fotonower.com args[1384210774] : ((1384210774, -5.947814622013265, 492609224), (1384210774, 1.6833962984328903, 2107752395), '0.11196595950827723') We are sending mail with results at report@fotonower.com args[1384210679] : ((1384210679, -6.0787292384057645, 492609224), (1384210679, 1.5050822474146073, 2107752395), '0.11196595950827723') We are sending mail with results at report@fotonower.com args[1384210615] : ((1384210615, -6.603566345248864, 492609224), (1384210615, 1.628308281147627, 2107752395), '0.11196595950827723') We are sending mail with results at report@fotonower.com args[1384210338] : ((1384210338, -6.786541463172248, 492609224), (1384210338, 1.5074579350385064, 2107752395), '0.11196595950827723') We are sending mail with results at report@fotonower.com args[1384209572] : ((1384209572, -6.625635436520511, 492609224), (1384209572, 1.434279928054, 2107752395), '0.11196595950827723') We are sending mail with results at report@fotonower.com args[1384209540] : ((1384209540, -6.784783738050643, 492609224), (1384209540, 1.5593874502558795, 2107752395), '0.11196595950827723') We are sending mail with results at report@fotonower.com args[1384209503] : ((1384209503, -6.732112035423084, 492609224), (1384209503, 1.5942254304477548, 2107752395), '0.11196595950827723') We are sending mail with results at report@fotonower.com refus_total : 0.11196595950827723 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26961389 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26961389_17-09-2025_18_47_00.pdf results_Auto_P26961389_17-09-2025_18_47_00.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26961389_17-09-2025_18_47_00.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26961389','results_Auto_P26961389_17-09-2025_18_47_00.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26961389_17-09-2025_18_47_00.pdf','pdf','','0.74','0.11196595950827723') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26961389

https://www.fotonower.com/image?json=false&list_photos_id=1384211230
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1384211128
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1384211085
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1384211019
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1384210774
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1384210679
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1384210615
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1384210338
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1384209572
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1384209540
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1384209503
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 11.20%
Veuillez trouver les photos des contaminants.

exemples de contaminants: autre: https://www.fotonower.com/view/26961954?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/26961958?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/26961960?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26961963?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26961965?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26961967?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26961389_17-09-2025_18_47_00.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26961954,26961956,26961957,26961958,26961960,26961961,26961962,26961963,26961965,26961966,26961967?tags=autre,mal_croppe,background,pehd,pet_fonce,flou,environnement,carton,pet_clair,metal,papier.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 17 Sep 2025 16:47:07 GMT Content-Length: 0 Connection: close X-Message-Id: 2RPrnQB1TX6sZ5uGxmo2yA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1384211230, 1384211128, 1384211085, 1384211019, 1384210774, 1384210679, 1384210615, 1384210338, 1384209572, 1384209540, 1384209503] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384211230', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384211128', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384211085', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384211019', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384210774', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384210679', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384210615', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384210338', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384209572', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384209540', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384209503', None, None, None, None, None, '3737031') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.015725374221801758 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.511190414428711 time spend to save output : 0.015987873077392578 total time spend for step 9 : 7.5271782875061035 step10:split_time_score Wed Sep 17 18:47:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('13', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 17092025 26961389 Nombre de photos uploadées : 11 / 23040 (0%) 17092025 26961389 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 17092025 26961389 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 4.5299530029296875e-06 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.0004305839538574219 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2021939754486084 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.043265578029359514 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26927347_17-09-2025_07_17_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26927347 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26927347 AND mptpi.`type`=3726 To do Qualite : 0.12164504008658424 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26930238_17-09-2025_08_03_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26930238 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26930238 AND mptpi.`type`=3726 To do Qualite : 0.02515507938213385 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26934345_17-09-2025_12_37_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26934345 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26934345 AND mptpi.`type`=3726 To do Qualite : 0.09147573750275577 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26939189_17-09-2025_11_18_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26939189 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26939189 AND mptpi.`type`=3594 To do Qualite : 0.04970439884947426 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26943053_17-09-2025_12_22_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26943053 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26943053 AND mptpi.`type`=3726 To do Qualite : 0.11196595950827723 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26961389_17-09-2025_18_47_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26961389 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26961389 AND mptpi.`type`=3594 To do Qualite : 0.09689704663768993 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26955627_17-09-2025_16_37_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26955627 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26955627 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26955630 order by id desc limit 1 Qualite : 0.11496696566358026 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26955635_17-09-2025_17_04_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26955635 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26955635 AND mptpi.`type`=3594 To do Qualite : 0.023372283810127115 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26957152_17-09-2025_17_12_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26957152 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26957152 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26960161 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'17092025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1384211230, 1384211128, 1384211085, 1384211019, 1384210774, 1384210679, 1384210615, 1384210338, 1384209572, 1384209540, 1384209503] Looping around the photos to save general results len do output : 1 /26961389Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384211230', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384211128', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384211085', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384211019', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384210774', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384210679', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384210615', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384210338', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384209572', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384209540', None, None, None, None, None, '3737031') ('3318', None, None, None, None, None, None, None, '3737031') ('3318', '26961389', '1384209503', None, None, None, None, None, '3737031') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.016483545303344727 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.076930284500122 time spend to save output : 0.01672816276550293 total time spend for step 10 : 3.093658447265625 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 178.48user 155.78system 6:46.28elapsed 82%CPU (0avgtext+0avgdata 5317156maxresident)k 2678152inputs+157560outputs (29967major+17168713minor)pagefaults 0swaps