python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 36617 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2954440'] with mtr_portfolio_ids : ['23339075'] and first list_photo_ids : [] new path : /proc/36617/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 13 ; length of list_pids : 13 ; length of list_args : 13 time to download the photos : 2.317221164703369 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon May 26 15:20:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-26 15:20:33.765204: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-26 15:20:33.791071: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-26 15:20:33.793234: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f8408000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-26 15:20:33.793308: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-26 15:20:33.797729: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-26 15:20:34.144675: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x276fd920 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-26 15:20:34.144731: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-26 15:20:34.146491: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 15:20:34.146966: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 15:20:34.150473: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 15:20:34.153638: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 15:20:34.154167: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 15:20:34.157111: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 15:20:34.158262: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 15:20:34.163152: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 15:20:34.164728: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 15:20:34.164824: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 15:20:34.165593: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-26 15:20:34.165608: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-26 15:20:34.165618: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-26 15:20:34.166971: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-26 15:20:34.494767: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 15:20:34.494891: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 15:20:34.494926: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 15:20:34.494944: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 15:20:34.494961: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 15:20:34.494977: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 15:20:34.494993: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 15:20:34.495009: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 15:20:34.496205: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 15:20:34.497406: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 15:20:34.497436: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 15:20:34.497452: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 15:20:34.497466: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 15:20:34.497480: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 15:20:34.497494: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 15:20:34.497508: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 15:20:34.497522: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 15:20:34.498764: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 15:20:34.498797: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-26 15:20:34.498805: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-26 15:20:34.498813: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-26 15:20:34.500058: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-26 15:20:48.530094: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 15:20:48.727777: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 44 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 43 Detection mask done ! Trying to reset tf kernel 37409 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5706 tf kernel not reseted sub process len(results) : 13 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 13 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10774 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0005185604095458984 nb_pixel_total : 8502 time to create 1 rle with old method : 0.013019561767578125 length of segment : 106 time for calcul the mask position with numpy : 0.0015878677368164062 nb_pixel_total : 41146 time to create 1 rle with old method : 0.04807782173156738 length of segment : 295 time for calcul the mask position with numpy : 0.0032138824462890625 nb_pixel_total : 115079 time to create 1 rle with old method : 0.1299152374267578 length of segment : 443 time for calcul the mask position with numpy : 0.000789642333984375 nb_pixel_total : 21316 time to create 1 rle with old method : 0.023383617401123047 length of segment : 233 time for calcul the mask position with numpy : 0.001573324203491211 nb_pixel_total : 86448 time to create 1 rle with old method : 0.10879969596862793 length of segment : 698 time for calcul the mask position with numpy : 0.00043392181396484375 nb_pixel_total : 15008 time to create 1 rle with old method : 0.018543004989624023 length of segment : 129 time for calcul the mask position with numpy : 0.003442525863647461 nb_pixel_total : 99866 time to create 1 rle with old method : 0.11406779289245605 length of segment : 599 time for calcul the mask position with numpy : 0.0006201267242431641 nb_pixel_total : 13094 time to create 1 rle with old method : 0.01508784294128418 length of segment : 141 time for calcul the mask position with numpy : 0.00032329559326171875 nb_pixel_total : 9996 time to create 1 rle with old method : 0.013337135314941406 length of segment : 144 time for calcul the mask position with numpy : 0.0005278587341308594 nb_pixel_total : 24736 time to create 1 rle with old method : 0.02929091453552246 length of segment : 163 time for calcul the mask position with numpy : 0.0010886192321777344 nb_pixel_total : 53394 time to create 1 rle with old method : 0.0651388168334961 length of segment : 370 time for calcul the mask position with numpy : 0.0026404857635498047 nb_pixel_total : 108472 time to create 1 rle with old method : 0.12482333183288574 length of segment : 389 time for calcul the mask position with numpy : 0.0005893707275390625 nb_pixel_total : 33717 time to create 1 rle with old method : 0.04120302200317383 length of segment : 277 time for calcul the mask position with numpy : 0.0007953643798828125 nb_pixel_total : 46566 time to create 1 rle with old method : 0.05174684524536133 length of segment : 302 time for calcul the mask position with numpy : 0.0010952949523925781 nb_pixel_total : 68338 time to create 1 rle with old method : 0.07443428039550781 length of segment : 375 time for calcul the mask position with numpy : 0.0007302761077880859 nb_pixel_total : 44424 time to create 1 rle with old method : 0.04895806312561035 length of segment : 269 time for calcul the mask position with numpy : 0.001997709274291992 nb_pixel_total : 148388 time to create 1 rle with old method : 0.17003464698791504 length of segment : 433 time for calcul the mask position with numpy : 0.0012664794921875 nb_pixel_total : 68730 time to create 1 rle with old method : 0.07898736000061035 length of segment : 378 time for calcul the mask position with numpy : 0.0005414485931396484 nb_pixel_total : 34776 time to create 1 rle with old method : 0.04158902168273926 length of segment : 237 time for calcul the mask position with numpy : 0.001100301742553711 nb_pixel_total : 40402 time to create 1 rle with old method : 0.05273079872131348 length of segment : 290 time for calcul the mask position with numpy : 0.0016713142395019531 nb_pixel_total : 46267 time to create 1 rle with old method : 0.06333732604980469 length of segment : 322 time for calcul the mask position with numpy : 0.0006661415100097656 nb_pixel_total : 22091 time to create 1 rle with old method : 0.02491593360900879 length of segment : 275 time for calcul the mask position with numpy : 0.0002543926239013672 nb_pixel_total : 7514 time to create 1 rle with old method : 0.0086822509765625 length of segment : 134 time for calcul the mask position with numpy : 0.0003476142883300781 nb_pixel_total : 17946 time to create 1 rle with old method : 0.020372390747070312 length of segment : 177 time for calcul the mask position with numpy : 0.0006883144378662109 nb_pixel_total : 38015 time to create 1 rle with old method : 0.04212832450866699 length of segment : 247 time for calcul the mask position with numpy : 0.0010068416595458984 nb_pixel_total : 50086 time to create 1 rle with old method : 0.05453658103942871 length of segment : 458 time for calcul the mask position with numpy : 0.0003693103790283203 nb_pixel_total : 17463 time to create 1 rle with old method : 0.0199739933013916 length of segment : 263 time for calcul the mask position with numpy : 0.0016674995422363281 nb_pixel_total : 107539 time to create 1 rle with old method : 0.1221928596496582 length of segment : 308 time for calcul the mask position with numpy : 0.0004277229309082031 nb_pixel_total : 19457 time to create 1 rle with old method : 0.035753488540649414 length of segment : 248 time for calcul the mask position with numpy : 0.0024771690368652344 nb_pixel_total : 106634 time to create 1 rle with old method : 0.12291264533996582 length of segment : 678 time for calcul the mask position with numpy : 0.0007450580596923828 nb_pixel_total : 53183 time to create 1 rle with old method : 0.062178611755371094 length of segment : 328 time for calcul the mask position with numpy : 0.0005476474761962891 nb_pixel_total : 26340 time to create 1 rle with old method : 0.030666112899780273 length of segment : 257 time for calcul the mask position with numpy : 0.0003724098205566406 nb_pixel_total : 14231 time to create 1 rle with old method : 0.016226768493652344 length of segment : 243 time for calcul the mask position with numpy : 0.0015461444854736328 nb_pixel_total : 105121 time to create 1 rle with old method : 0.11565232276916504 length of segment : 566 time for calcul the mask position with numpy : 0.0004112720489501953 nb_pixel_total : 21875 time to create 1 rle with old method : 0.025028467178344727 length of segment : 166 time for calcul the mask position with numpy : 0.0010094642639160156 nb_pixel_total : 66649 time to create 1 rle with old method : 0.07450675964355469 length of segment : 299 time for calcul the mask position with numpy : 0.0002665519714355469 nb_pixel_total : 15370 time to create 1 rle with old method : 0.01711416244506836 length of segment : 175 time for calcul the mask position with numpy : 0.0013496875762939453 nb_pixel_total : 58512 time to create 1 rle with old method : 0.06647968292236328 length of segment : 886 time for calcul the mask position with numpy : 0.0005409717559814453 nb_pixel_total : 20393 time to create 1 rle with old method : 0.033003807067871094 length of segment : 328 time for calcul the mask position with numpy : 0.0005819797515869141 nb_pixel_total : 37716 time to create 1 rle with old method : 0.045502662658691406 length of segment : 202 time for calcul the mask position with numpy : 0.0030961036682128906 nb_pixel_total : 163288 time to create 1 rle with new method : 0.011783123016357422 length of segment : 699 time for calcul the mask position with numpy : 0.0005986690521240234 nb_pixel_total : 27689 time to create 1 rle with old method : 0.03401303291320801 length of segment : 208 time for calcul the mask position with numpy : 0.0008320808410644531 nb_pixel_total : 35944 time to create 1 rle with old method : 0.04063606262207031 length of segment : 242 time for calcul the mask position with numpy : 0.000194549560546875 nb_pixel_total : 8571 time to create 1 rle with old method : 0.009763479232788086 length of segment : 92 time for calcul the mask position with numpy : 0.0006728172302246094 nb_pixel_total : 41023 time to create 1 rle with old method : 0.04458189010620117 length of segment : 390 time for calcul the mask position with numpy : 0.0005128383636474609 nb_pixel_total : 20392 time to create 1 rle with old method : 0.023217201232910156 length of segment : 192 time for calcul the mask position with numpy : 0.00047135353088378906 nb_pixel_total : 23334 time to create 1 rle with old method : 0.025966882705688477 length of segment : 238 time for calcul the mask position with numpy : 0.0016198158264160156 nb_pixel_total : 102605 time to create 1 rle with old method : 0.11039042472839355 length of segment : 464 time for calcul the mask position with numpy : 0.0007727146148681641 nb_pixel_total : 44250 time to create 1 rle with old method : 0.049785614013671875 length of segment : 211 time for calcul the mask position with numpy : 0.0005283355712890625 nb_pixel_total : 14464 time to create 1 rle with old method : 0.016621828079223633 length of segment : 229 time for calcul the mask position with numpy : 0.0003502368927001953 nb_pixel_total : 13302 time to create 1 rle with old method : 0.015415668487548828 length of segment : 139 time for calcul the mask position with numpy : 0.0022711753845214844 nb_pixel_total : 99867 time to create 1 rle with old method : 0.11220479011535645 length of segment : 673 time for calcul the mask position with numpy : 0.0004112720489501953 nb_pixel_total : 17443 time to create 1 rle with old method : 0.02001166343688965 length of segment : 161 time for calcul the mask position with numpy : 0.00035643577575683594 nb_pixel_total : 9290 time to create 1 rle with old method : 0.01059269905090332 length of segment : 383 time for calcul the mask position with numpy : 0.000606536865234375 nb_pixel_total : 32542 time to create 1 rle with old method : 0.03690528869628906 length of segment : 208 time for calcul the mask position with numpy : 0.0004856586456298828 nb_pixel_total : 18616 time to create 1 rle with old method : 0.021397113800048828 length of segment : 178 time for calcul the mask position with numpy : 0.001661062240600586 nb_pixel_total : 43282 time to create 1 rle with old method : 0.06531810760498047 length of segment : 492 time for calcul the mask position with numpy : 0.0013887882232666016 nb_pixel_total : 68107 time to create 1 rle with old method : 0.08275032043457031 length of segment : 244 time for calcul the mask position with numpy : 0.003044605255126953 nb_pixel_total : 161625 time to create 1 rle with new method : 0.011597394943237305 length of segment : 502 time for calcul the mask position with numpy : 0.0005564689636230469 nb_pixel_total : 27589 time to create 1 rle with old method : 0.030989885330200195 length of segment : 210 time for calcul the mask position with numpy : 0.00047516822814941406 nb_pixel_total : 23596 time to create 1 rle with old method : 0.03141307830810547 length of segment : 257 time for calcul the mask position with numpy : 0.007346391677856445 nb_pixel_total : 247005 time to create 1 rle with new method : 0.01708507537841797 length of segment : 470 time for calcul the mask position with numpy : 0.09072709083557129 nb_pixel_total : 329095 time to create 1 rle with new method : 0.03229832649230957 length of segment : 874 time for calcul the mask position with numpy : 0.00077056884765625 nb_pixel_total : 42872 time to create 1 rle with old method : 0.04782915115356445 length of segment : 349 time for calcul the mask position with numpy : 0.00616908073425293 nb_pixel_total : 288734 time to create 1 rle with new method : 0.03948664665222168 length of segment : 783 time for calcul the mask position with numpy : 0.0011510848999023438 nb_pixel_total : 72095 time to create 1 rle with old method : 0.08282279968261719 length of segment : 269 time for calcul the mask position with numpy : 0.0008063316345214844 nb_pixel_total : 35555 time to create 1 rle with old method : 0.0401613712310791 length of segment : 220 time for calcul the mask position with numpy : 0.0003147125244140625 nb_pixel_total : 17883 time to create 1 rle with old method : 0.02016282081604004 length of segment : 175 time for calcul the mask position with numpy : 0.00019931793212890625 nb_pixel_total : 8982 time to create 1 rle with old method : 0.010247945785522461 length of segment : 287 time for calcul the mask position with numpy : 0.000362396240234375 nb_pixel_total : 18327 time to create 1 rle with old method : 0.021023035049438477 length of segment : 165 time for calcul the mask position with numpy : 0.0023126602172851562 nb_pixel_total : 122351 time to create 1 rle with old method : 0.15518999099731445 length of segment : 493 time for calcul the mask position with numpy : 0.0012402534484863281 nb_pixel_total : 76042 time to create 1 rle with old method : 0.08794617652893066 length of segment : 265 time for calcul the mask position with numpy : 0.0022072792053222656 nb_pixel_total : 131815 time to create 1 rle with old method : 0.14447617530822754 length of segment : 697 time for calcul the mask position with numpy : 0.0006906986236572266 nb_pixel_total : 35791 time to create 1 rle with old method : 0.03992009162902832 length of segment : 219 time for calcul the mask position with numpy : 0.0005636215209960938 nb_pixel_total : 25249 time to create 1 rle with old method : 0.028885841369628906 length of segment : 219 time for calcul the mask position with numpy : 0.0013043880462646484 nb_pixel_total : 84734 time to create 1 rle with old method : 0.09372949600219727 length of segment : 412 time for calcul the mask position with numpy : 0.0013561248779296875 nb_pixel_total : 74780 time to create 1 rle with old method : 0.08307957649230957 length of segment : 484 time for calcul the mask position with numpy : 0.0029478073120117188 nb_pixel_total : 163872 time to create 1 rle with new method : 0.01036214828491211 length of segment : 422 time for calcul the mask position with numpy : 0.00045871734619140625 nb_pixel_total : 18764 time to create 1 rle with old method : 0.021769285202026367 length of segment : 165 time for calcul the mask position with numpy : 0.0011715888977050781 nb_pixel_total : 78442 time to create 1 rle with old method : 0.0881195068359375 length of segment : 266 time for calcul the mask position with numpy : 0.0016274452209472656 nb_pixel_total : 61923 time to create 1 rle with old method : 0.08836174011230469 length of segment : 323 time for calcul the mask position with numpy : 0.001123189926147461 nb_pixel_total : 52934 time to create 1 rle with old method : 0.07599043846130371 length of segment : 175 time for calcul the mask position with numpy : 0.0003445148468017578 nb_pixel_total : 11369 time to create 1 rle with old method : 0.016509532928466797 length of segment : 128 time for calcul the mask position with numpy : 0.0005440711975097656 nb_pixel_total : 30646 time to create 1 rle with old method : 0.03556203842163086 length of segment : 111 time for calcul the mask position with numpy : 0.0006074905395507812 nb_pixel_total : 25382 time to create 1 rle with old method : 0.028723478317260742 length of segment : 262 time for calcul the mask position with numpy : 0.0007679462432861328 nb_pixel_total : 30287 time to create 1 rle with old method : 0.034598588943481445 length of segment : 210 time for calcul the mask position with numpy : 0.0019116401672363281 nb_pixel_total : 119959 time to create 1 rle with old method : 0.12927627563476562 length of segment : 470 time for calcul the mask position with numpy : 0.0008540153503417969 nb_pixel_total : 39983 time to create 1 rle with old method : 0.05722761154174805 length of segment : 196 time for calcul the mask position with numpy : 0.0014886856079101562 nb_pixel_total : 111284 time to create 1 rle with old method : 0.1192772388458252 length of segment : 378 time for calcul the mask position with numpy : 0.0009338855743408203 nb_pixel_total : 50225 time to create 1 rle with old method : 0.05497312545776367 length of segment : 502 time for calcul the mask position with numpy : 0.005110740661621094 nb_pixel_total : 315472 time to create 1 rle with new method : 0.014499664306640625 length of segment : 649 time for calcul the mask position with numpy : 0.001064300537109375 nb_pixel_total : 56896 time to create 1 rle with old method : 0.06123757362365723 length of segment : 353 time for calcul the mask position with numpy : 0.0014009475708007812 nb_pixel_total : 97870 time to create 1 rle with old method : 0.10694050788879395 length of segment : 322 time for calcul the mask position with numpy : 0.0008039474487304688 nb_pixel_total : 46726 time to create 1 rle with old method : 0.05070757865905762 length of segment : 240 time for calcul the mask position with numpy : 0.00083160400390625 nb_pixel_total : 53250 time to create 1 rle with old method : 0.056813716888427734 length of segment : 324 time for calcul the mask position with numpy : 0.005168914794921875 nb_pixel_total : 325101 time to create 1 rle with new method : 0.02782583236694336 length of segment : 939 time for calcul the mask position with numpy : 0.001032114028930664 nb_pixel_total : 58808 time to create 1 rle with old method : 0.06650352478027344 length of segment : 260 time for calcul the mask position with numpy : 0.0019681453704833984 nb_pixel_total : 136579 time to create 1 rle with old method : 0.15568065643310547 length of segment : 431 time for calcul the mask position with numpy : 0.0002777576446533203 nb_pixel_total : 15600 time to create 1 rle with old method : 0.017718076705932617 length of segment : 123 time for calcul the mask position with numpy : 0.0007650852203369141 nb_pixel_total : 51683 time to create 1 rle with old method : 0.05872178077697754 length of segment : 215 time for calcul the mask position with numpy : 0.00039768218994140625 nb_pixel_total : 18444 time to create 1 rle with old method : 0.021259546279907227 length of segment : 178 time for calcul the mask position with numpy : 0.001367807388305664 nb_pixel_total : 88458 time to create 1 rle with old method : 0.09938454627990723 length of segment : 371 time for calcul the mask position with numpy : 0.0009629726409912109 nb_pixel_total : 60900 time to create 1 rle with old method : 0.06705379486083984 length of segment : 300 time for calcul the mask position with numpy : 0.00051116943359375 nb_pixel_total : 29534 time to create 1 rle with old method : 0.03304648399353027 length of segment : 245 time for calcul the mask position with numpy : 0.0005779266357421875 nb_pixel_total : 32747 time to create 1 rle with old method : 0.03699469566345215 length of segment : 176 time for calcul the mask position with numpy : 0.002431631088256836 nb_pixel_total : 108397 time to create 1 rle with old method : 0.12065649032592773 length of segment : 486 time for calcul the mask position with numpy : 0.0014624595642089844 nb_pixel_total : 69334 time to create 1 rle with old method : 0.10696578025817871 length of segment : 221 time for calcul the mask position with numpy : 0.0009427070617675781 nb_pixel_total : 57512 time to create 1 rle with old method : 0.06459546089172363 length of segment : 300 time for calcul the mask position with numpy : 0.0014874935150146484 nb_pixel_total : 88941 time to create 1 rle with old method : 0.09843659400939941 length of segment : 295 time for calcul the mask position with numpy : 0.00022530555725097656 nb_pixel_total : 10888 time to create 1 rle with old method : 0.012423276901245117 length of segment : 102 time for calcul the mask position with numpy : 0.0003352165222167969 nb_pixel_total : 18832 time to create 1 rle with old method : 0.02138829231262207 length of segment : 162 time for calcul the mask position with numpy : 0.00047850608825683594 nb_pixel_total : 36966 time to create 1 rle with old method : 0.04285287857055664 length of segment : 218 time for calcul the mask position with numpy : 0.0008409023284912109 nb_pixel_total : 42379 time to create 1 rle with old method : 0.047898292541503906 length of segment : 224 time for calcul the mask position with numpy : 0.0005805492401123047 nb_pixel_total : 32617 time to create 1 rle with old method : 0.0371241569519043 length of segment : 232 time for calcul the mask position with numpy : 0.002034425735473633 nb_pixel_total : 68631 time to create 1 rle with old method : 0.07747673988342285 length of segment : 672 time for calcul the mask position with numpy : 0.001079559326171875 nb_pixel_total : 62323 time to create 1 rle with old method : 0.0710597038269043 length of segment : 184 time for calcul the mask position with numpy : 0.0035238265991210938 nb_pixel_total : 187194 time to create 1 rle with new method : 0.015095949172973633 length of segment : 588 time for calcul the mask position with numpy : 0.0020232200622558594 nb_pixel_total : 123512 time to create 1 rle with old method : 0.1402733325958252 length of segment : 296 time for calcul the mask position with numpy : 0.00034999847412109375 nb_pixel_total : 18541 time to create 1 rle with old method : 0.020813465118408203 length of segment : 167 time for calcul the mask position with numpy : 0.0009455680847167969 nb_pixel_total : 57632 time to create 1 rle with old method : 0.06474161148071289 length of segment : 242 time for calcul the mask position with numpy : 0.0013508796691894531 nb_pixel_total : 85758 time to create 1 rle with old method : 0.09444499015808105 length of segment : 365 time for calcul the mask position with numpy : 0.00029158592224121094 nb_pixel_total : 16726 time to create 1 rle with old method : 0.01858210563659668 length of segment : 133 time for calcul the mask position with numpy : 0.0003707408905029297 nb_pixel_total : 24151 time to create 1 rle with old method : 0.026943445205688477 length of segment : 215 time for calcul the mask position with numpy : 0.0006382465362548828 nb_pixel_total : 32003 time to create 1 rle with old method : 0.03521561622619629 length of segment : 281 time for calcul the mask position with numpy : 0.002458810806274414 nb_pixel_total : 171391 time to create 1 rle with new method : 0.009298086166381836 length of segment : 556 time for calcul the mask position with numpy : 0.0006539821624755859 nb_pixel_total : 31381 time to create 1 rle with old method : 0.034481048583984375 length of segment : 293 time for calcul the mask position with numpy : 0.002184152603149414 nb_pixel_total : 129696 time to create 1 rle with old method : 0.14005494117736816 length of segment : 462 time for calcul the mask position with numpy : 0.0009944438934326172 nb_pixel_total : 62443 time to create 1 rle with old method : 0.06811785697937012 length of segment : 291 time for calcul the mask position with numpy : 0.0020580291748046875 nb_pixel_total : 92323 time to create 1 rle with old method : 0.1047048568725586 length of segment : 549 time for calcul the mask position with numpy : 0.0005400180816650391 nb_pixel_total : 36569 time to create 1 rle with old method : 0.04002094268798828 length of segment : 177 time for calcul the mask position with numpy : 0.0020029544830322266 nb_pixel_total : 135488 time to create 1 rle with old method : 0.14784002304077148 length of segment : 419 time for calcul the mask position with numpy : 0.0031218528747558594 nb_pixel_total : 206000 time to create 1 rle with new method : 0.011260271072387695 length of segment : 474 time for calcul the mask position with numpy : 0.001651763916015625 nb_pixel_total : 78281 time to create 1 rle with old method : 0.08601570129394531 length of segment : 557 time for calcul the mask position with numpy : 0.0018663406372070312 nb_pixel_total : 83517 time to create 1 rle with old method : 0.09487104415893555 length of segment : 419 time for calcul the mask position with numpy : 0.001537322998046875 nb_pixel_total : 94363 time to create 1 rle with old method : 0.10375690460205078 length of segment : 424 time for calcul the mask position with numpy : 0.0007650852203369141 nb_pixel_total : 45998 time to create 1 rle with old method : 0.05123305320739746 length of segment : 265 time for calcul the mask position with numpy : 0.0005896091461181641 nb_pixel_total : 34847 time to create 1 rle with old method : 0.04033017158508301 length of segment : 271 time for calcul the mask position with numpy : 0.0031876564025878906 nb_pixel_total : 201095 time to create 1 rle with new method : 0.010841608047485352 length of segment : 457 time for calcul the mask position with numpy : 0.0004291534423828125 nb_pixel_total : 14737 time to create 1 rle with old method : 0.01642465591430664 length of segment : 317 time for calcul the mask position with numpy : 0.0003330707550048828 nb_pixel_total : 17129 time to create 1 rle with old method : 0.019708871841430664 length of segment : 179 time for calcul the mask position with numpy : 0.0003192424774169922 nb_pixel_total : 13871 time to create 1 rle with old method : 0.0160219669342041 length of segment : 161 time for calcul the mask position with numpy : 0.0006499290466308594 nb_pixel_total : 29399 time to create 1 rle with old method : 0.03415346145629883 length of segment : 306 time for calcul the mask position with numpy : 0.0009062290191650391 nb_pixel_total : 52099 time to create 1 rle with old method : 0.05879831314086914 length of segment : 278 time for calcul the mask position with numpy : 0.0026602745056152344 nb_pixel_total : 166231 time to create 1 rle with new method : 0.012906074523925781 length of segment : 534 time for calcul the mask position with numpy : 0.0005497932434082031 nb_pixel_total : 23166 time to create 1 rle with old method : 0.026551008224487305 length of segment : 203 time for calcul the mask position with numpy : 0.0010004043579101562 nb_pixel_total : 66687 time to create 1 rle with old method : 0.07548165321350098 length of segment : 254 time for calcul the mask position with numpy : 0.0010421276092529297 nb_pixel_total : 63981 time to create 1 rle with old method : 0.07149100303649902 length of segment : 357 time for calcul the mask position with numpy : 0.0019016265869140625 nb_pixel_total : 85244 time to create 1 rle with old method : 0.09640383720397949 length of segment : 346 time for calcul the mask position with numpy : 0.001466512680053711 nb_pixel_total : 73054 time to create 1 rle with old method : 0.08299016952514648 length of segment : 354 time for calcul the mask position with numpy : 0.0018241405487060547 nb_pixel_total : 88550 time to create 1 rle with old method : 0.10081315040588379 length of segment : 429 time for calcul the mask position with numpy : 0.0004987716674804688 nb_pixel_total : 19332 time to create 1 rle with old method : 0.02237677574157715 length of segment : 207 time for calcul the mask position with numpy : 0.0004870891571044922 nb_pixel_total : 22360 time to create 1 rle with old method : 0.025599002838134766 length of segment : 185 time for calcul the mask position with numpy : 0.0014240741729736328 nb_pixel_total : 6488 time to create 1 rle with old method : 0.008556842803955078 length of segment : 252 time for calcul the mask position with numpy : 0.0004544258117675781 nb_pixel_total : 22849 time to create 1 rle with old method : 0.026569843292236328 length of segment : 263 time for calcul the mask position with numpy : 0.002759695053100586 nb_pixel_total : 153847 time to create 1 rle with new method : 0.011701107025146484 length of segment : 710 time for calcul the mask position with numpy : 0.0008552074432373047 nb_pixel_total : 61840 time to create 1 rle with old method : 0.07099676132202148 length of segment : 199 time for calcul the mask position with numpy : 0.0008323192596435547 nb_pixel_total : 38831 time to create 1 rle with old method : 0.04497957229614258 length of segment : 302 time for calcul the mask position with numpy : 0.005006313323974609 nb_pixel_total : 221805 time to create 1 rle with new method : 0.018181800842285156 length of segment : 605 time for calcul the mask position with numpy : 0.0005774497985839844 nb_pixel_total : 32283 time to create 1 rle with old method : 0.037116289138793945 length of segment : 239 time for calcul the mask position with numpy : 0.0006954669952392578 nb_pixel_total : 20191 time to create 1 rle with old method : 0.023755788803100586 length of segment : 185 time for calcul the mask position with numpy : 0.006821632385253906 nb_pixel_total : 317673 time to create 1 rle with new method : 0.01917719841003418 length of segment : 602 time for calcul the mask position with numpy : 0.004107952117919922 nb_pixel_total : 207050 time to create 1 rle with new method : 0.014549016952514648 length of segment : 491 time for calcul the mask position with numpy : 0.0014798641204833984 nb_pixel_total : 94958 time to create 1 rle with old method : 0.10681033134460449 length of segment : 476 time for calcul the mask position with numpy : 0.0004413127899169922 nb_pixel_total : 25596 time to create 1 rle with old method : 0.029062747955322266 length of segment : 174 time for calcul the mask position with numpy : 0.002068758010864258 nb_pixel_total : 140716 time to create 1 rle with old method : 0.15569305419921875 length of segment : 396 time for calcul the mask position with numpy : 0.00128173828125 nb_pixel_total : 50030 time to create 1 rle with old method : 0.06827259063720703 length of segment : 357 time for calcul the mask position with numpy : 0.004917144775390625 nb_pixel_total : 316232 time to create 1 rle with new method : 0.015184164047241211 length of segment : 757 time for calcul the mask position with numpy : 0.0006897449493408203 nb_pixel_total : 31498 time to create 1 rle with old method : 0.035440683364868164 length of segment : 200 time for calcul the mask position with numpy : 0.0003104209899902344 nb_pixel_total : 18678 time to create 1 rle with old method : 0.0215151309967041 length of segment : 96 time for calcul the mask position with numpy : 0.000392913818359375 nb_pixel_total : 21000 time to create 1 rle with old method : 0.02423381805419922 length of segment : 178 time for calcul the mask position with numpy : 0.0014562606811523438 nb_pixel_total : 82987 time to create 1 rle with old method : 0.12239551544189453 length of segment : 503 time for calcul the mask position with numpy : 0.0008556842803955078 nb_pixel_total : 31284 time to create 1 rle with old method : 0.049294471740722656 length of segment : 328 time for calcul the mask position with numpy : 0.0011944770812988281 nb_pixel_total : 36251 time to create 1 rle with old method : 0.06596255302429199 length of segment : 373 time for calcul the mask position with numpy : 0.0028939247131347656 nb_pixel_total : 123529 time to create 1 rle with old method : 0.22360682487487793 length of segment : 292 time for calcul the mask position with numpy : 0.005017995834350586 nb_pixel_total : 133066 time to create 1 rle with old method : 0.2162613868713379 length of segment : 610 time for calcul the mask position with numpy : 0.0018510818481445312 nb_pixel_total : 58610 time to create 1 rle with old method : 0.08448219299316406 length of segment : 321 time for calcul the mask position with numpy : 0.0005040168762207031 nb_pixel_total : 14341 time to create 1 rle with old method : 0.018164634704589844 length of segment : 227 time for calcul the mask position with numpy : 0.0011663436889648438 nb_pixel_total : 51345 time to create 1 rle with old method : 0.059433698654174805 length of segment : 461 time for calcul the mask position with numpy : 0.005483865737915039 nb_pixel_total : 226954 time to create 1 rle with new method : 0.019739151000976562 length of segment : 731 time for calcul the mask position with numpy : 0.0007736682891845703 nb_pixel_total : 39100 time to create 1 rle with old method : 0.04523944854736328 length of segment : 222 time for calcul the mask position with numpy : 0.0006754398345947266 nb_pixel_total : 23820 time to create 1 rle with old method : 0.028923988342285156 length of segment : 184 time for calcul the mask position with numpy : 0.0017480850219726562 nb_pixel_total : 76799 time to create 1 rle with old method : 0.09301543235778809 length of segment : 313 time for calcul the mask position with numpy : 0.017330169677734375 nb_pixel_total : 374671 time to create 1 rle with new method : 0.03336215019226074 length of segment : 944 time for calcul the mask position with numpy : 0.0012586116790771484 nb_pixel_total : 73566 time to create 1 rle with old method : 0.08459973335266113 length of segment : 356 time for calcul the mask position with numpy : 0.00022530555725097656 nb_pixel_total : 6092 time to create 1 rle with old method : 0.00724029541015625 length of segment : 98 time for calcul the mask position with numpy : 0.0002193450927734375 nb_pixel_total : 8320 time to create 1 rle with old method : 0.009762287139892578 length of segment : 139 time for calcul the mask position with numpy : 0.0002357959747314453 nb_pixel_total : 11205 time to create 1 rle with old method : 0.01338958740234375 length of segment : 123 time for calcul the mask position with numpy : 0.0013616085052490234 nb_pixel_total : 75467 time to create 1 rle with old method : 0.09108543395996094 length of segment : 267 time for calcul the mask position with numpy : 0.00037932395935058594 nb_pixel_total : 13127 time to create 1 rle with old method : 0.015031814575195312 length of segment : 219 time for calcul the mask position with numpy : 0.0007226467132568359 nb_pixel_total : 20121 time to create 1 rle with old method : 0.02781391143798828 length of segment : 183 time for calcul the mask position with numpy : 0.0003857612609863281 nb_pixel_total : 22038 time to create 1 rle with old method : 0.02570366859436035 length of segment : 125 time for calcul the mask position with numpy : 0.0027942657470703125 nb_pixel_total : 85251 time to create 1 rle with old method : 0.10411357879638672 length of segment : 541 time spent for convertir_results : 20.260502576828003 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 192 chid ids of type : 3594 Number RLEs to save : 63507 save missing photos in datou_result : time spend for datou_step_exec : 116.98674774169922 time spend to save output : 3.6471569538116455 total time spend for step 1 : 120.63390469551086 step2:crop_condition Mon May 26 15:22:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 13 ! batch 1 Loaded 192 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 99 About to insert : list_path_to_insert length 99 new photo from crops ! About to upload 99 photos upload in portfolio : 3736932 init cache_photo without model_param we have 99 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748265780_36617 we have uploaded 99 photos in the portfolio 3736932 time of upload the photos Elapsed time : 32.90361428260803 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 17 About to insert : list_path_to_insert length 17 new photo from crops ! About to upload 17 photos upload in portfolio : 3736932 init cache_photo without model_param we have 17 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748265819_36617 we have uploaded 17 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.095422267913818 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748265826_36617 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.8260037899017334 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 63 About to insert : list_path_to_insert length 63 new photo from crops ! About to upload 63 photos upload in portfolio : 3736932 init cache_photo without model_param we have 63 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748265857_36617 we have uploaded 63 photos in the portfolio 3736932 time of upload the photos Elapsed time : 26.697678804397583 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748265888_36617 we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.6413519382476807 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748265893_36617 we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.83475661277771 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1361072275, 1361072116, 1361072081, 1361072043, 1361071977, 1361071943, 1361071924, 1361071917, 1361071907, 1361071905, 1361071902, 1361071896, 1361071794] Looping around the photos to save general results len do output : 192 /1361091378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361091664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361072275', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361072116', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361072081', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361072043', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071977', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071943', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071924', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071917', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071907', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071905', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071902', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071896', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071794', None, None, None, None, None, '2954440') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 589 time used for this insertion : 0.038942575454711914 save_final save missing photos in datou_result : time spend for datou_step_exec : 143.5156180858612 time spend to save output : 0.04302501678466797 total time spend for step 2 : 143.55864310264587 step3:rle_unique_nms_with_priority Mon May 26 15:24:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 192 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 12 nb_hashtags : 4 time to prepare the origin masks : 5.53136134147644 time for calcul the mask position with numpy : 1.725499153137207 nb_pixel_total : 7697343 time to create 1 rle with new method : 0.981830358505249 time for calcul the mask position with numpy : 0.035273075103759766 nb_pixel_total : 108472 time to create 1 rle with old method : 0.1213524341583252 time for calcul the mask position with numpy : 0.024541378021240234 nb_pixel_total : 53394 time to create 1 rle with old method : 0.05881047248840332 time for calcul the mask position with numpy : 0.025782346725463867 nb_pixel_total : 24736 time to create 1 rle with old method : 0.02768731117248535 time for calcul the mask position with numpy : 0.02536606788635254 nb_pixel_total : 9996 time to create 1 rle with old method : 0.011051416397094727 time for calcul the mask position with numpy : 0.02629232406616211 nb_pixel_total : 13094 time to create 1 rle with old method : 0.014741897583007812 time for calcul the mask position with numpy : 0.026877403259277344 nb_pixel_total : 99866 time to create 1 rle with old method : 0.11405086517333984 time for calcul the mask position with numpy : 0.02656698226928711 nb_pixel_total : 15008 time to create 1 rle with old method : 0.016506195068359375 time for calcul the mask position with numpy : 0.025882482528686523 nb_pixel_total : 86448 time to create 1 rle with old method : 0.09348249435424805 time for calcul the mask position with numpy : 0.025076627731323242 nb_pixel_total : 21316 time to create 1 rle with old method : 0.024016380310058594 time for calcul the mask position with numpy : 0.026127338409423828 nb_pixel_total : 115079 time to create 1 rle with old method : 0.15226197242736816 time for calcul the mask position with numpy : 0.025434255599975586 nb_pixel_total : 41146 time to create 1 rle with old method : 0.06132221221923828 time for calcul the mask position with numpy : 0.028774261474609375 nb_pixel_total : 8502 time to create 1 rle with old method : 0.011347532272338867 create new chi : 3.7752649784088135 time to delete rle : 0.019809246063232422 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 9580 TO DO : save crop sub photo not yet done ! save time : 0.5916624069213867 nb_obj : 17 nb_hashtags : 4 time to prepare the origin masks : 8.316783905029297 time for calcul the mask position with numpy : 0.8277568817138672 nb_pixel_total : 7520784 time to create 1 rle with new method : 0.8796195983886719 time for calcul the mask position with numpy : 0.04010963439941406 nb_pixel_total : 19457 time to create 1 rle with old method : 0.02114582061767578 time for calcul the mask position with numpy : 0.03830528259277344 nb_pixel_total : 107539 time to create 1 rle with old method : 0.11607861518859863 time for calcul the mask position with numpy : 0.024094820022583008 nb_pixel_total : 17435 time to create 1 rle with old method : 0.01804184913635254 time for calcul the mask position with numpy : 0.02333688735961914 nb_pixel_total : 50086 time to create 1 rle with old method : 0.06475973129272461 time for calcul the mask position with numpy : 0.02754998207092285 nb_pixel_total : 38015 time to create 1 rle with old method : 0.04634428024291992 time for calcul the mask position with numpy : 0.02465367317199707 nb_pixel_total : 17946 time to create 1 rle with old method : 0.019341468811035156 time for calcul the mask position with numpy : 0.02447056770324707 nb_pixel_total : 7514 time to create 1 rle with old method : 0.008066415786743164 time for calcul the mask position with numpy : 0.02447199821472168 nb_pixel_total : 22091 time to create 1 rle with old method : 0.023524761199951172 time for calcul the mask position with numpy : 0.02475452423095703 nb_pixel_total : 8192 time to create 1 rle with old method : 0.008961200714111328 time for calcul the mask position with numpy : 0.024567365646362305 nb_pixel_total : 40402 time to create 1 rle with old method : 0.044178009033203125 time for calcul the mask position with numpy : 0.025088071823120117 nb_pixel_total : 34776 time to create 1 rle with old method : 0.03793931007385254 time for calcul the mask position with numpy : 0.026029348373413086 nb_pixel_total : 68730 time to create 1 rle with old method : 0.07468247413635254 time for calcul the mask position with numpy : 0.02612757682800293 nb_pixel_total : 148388 time to create 1 rle with old method : 0.16294431686401367 time for calcul the mask position with numpy : 0.024570941925048828 nb_pixel_total : 44424 time to create 1 rle with old method : 0.04900813102722168 time for calcul the mask position with numpy : 0.02437305450439453 nb_pixel_total : 68338 time to create 1 rle with old method : 0.07347249984741211 time for calcul the mask position with numpy : 0.024026155471801758 nb_pixel_total : 46566 time to create 1 rle with old method : 0.04896950721740723 time for calcul the mask position with numpy : 0.02363896369934082 nb_pixel_total : 33717 time to create 1 rle with old method : 0.03674030303955078 create new chi : 3.0552425384521484 time to delete rle : 0.0016815662384033203 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 11890 TO DO : save crop sub photo not yet done ! save time : 0.7270777225494385 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 3.9945731163024902 time for calcul the mask position with numpy : 0.8372530937194824 nb_pixel_total : 7883321 time to create 1 rle with new method : 0.9083895683288574 time for calcul the mask position with numpy : 0.04244518280029297 nb_pixel_total : 1676 time to create 1 rle with old method : 0.0027141571044921875 time for calcul the mask position with numpy : 0.024072885513305664 nb_pixel_total : 15370 time to create 1 rle with old method : 0.016660451889038086 time for calcul the mask position with numpy : 0.027368783950805664 nb_pixel_total : 66649 time to create 1 rle with old method : 0.09042978286743164 time for calcul the mask position with numpy : 0.02497386932373047 nb_pixel_total : 21875 time to create 1 rle with old method : 0.0240170955657959 time for calcul the mask position with numpy : 0.027683734893798828 nb_pixel_total : 105121 time to create 1 rle with old method : 0.13747453689575195 time for calcul the mask position with numpy : 0.025873661041259766 nb_pixel_total : 14231 time to create 1 rle with old method : 0.015905380249023438 time for calcul the mask position with numpy : 0.024030208587646484 nb_pixel_total : 26340 time to create 1 rle with old method : 0.028906822204589844 time for calcul the mask position with numpy : 0.02469491958618164 nb_pixel_total : 53183 time to create 1 rle with old method : 0.05964207649230957 time for calcul the mask position with numpy : 0.026098966598510742 nb_pixel_total : 106634 time to create 1 rle with old method : 0.12597107887268066 create new chi : 2.5416204929351807 time to delete rle : 0.0010404586791992188 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7859 TO DO : save crop sub photo not yet done ! save time : 0.4746241569519043 nb_obj : 23 nb_hashtags : 4 time to prepare the origin masks : 10.553081750869751 time for calcul the mask position with numpy : 0.6556358337402344 nb_pixel_total : 7262370 time to create 1 rle with new method : 1.5756196975708008 time for calcul the mask position with numpy : 0.026554346084594727 nb_pixel_total : 14109 time to create 1 rle with old method : 0.01620626449584961 time for calcul the mask position with numpy : 0.025811433792114258 nb_pixel_total : 27589 time to create 1 rle with old method : 0.03113079071044922 time for calcul the mask position with numpy : 0.02925896644592285 nb_pixel_total : 160543 time to create 1 rle with new method : 0.9400634765625 time for calcul the mask position with numpy : 0.027450084686279297 nb_pixel_total : 68107 time to create 1 rle with old method : 0.07537841796875 time for calcul the mask position with numpy : 0.02576923370361328 nb_pixel_total : 31018 time to create 1 rle with old method : 0.0344243049621582 time for calcul the mask position with numpy : 0.026525497436523438 nb_pixel_total : 18616 time to create 1 rle with old method : 0.02057027816772461 time for calcul the mask position with numpy : 0.025989055633544922 nb_pixel_total : 32477 time to create 1 rle with old method : 0.0358126163482666 time for calcul the mask position with numpy : 0.025896787643432617 nb_pixel_total : 9290 time to create 1 rle with old method : 0.010814905166625977 time for calcul the mask position with numpy : 0.023773670196533203 nb_pixel_total : 17443 time to create 1 rle with old method : 0.019227266311645508 time for calcul the mask position with numpy : 0.025315523147583008 nb_pixel_total : 99867 time to create 1 rle with old method : 0.11076235771179199 time for calcul the mask position with numpy : 0.025483131408691406 nb_pixel_total : 13302 time to create 1 rle with old method : 0.014579296112060547 time for calcul the mask position with numpy : 0.02468109130859375 nb_pixel_total : 14464 time to create 1 rle with old method : 0.015787363052368164 time for calcul the mask position with numpy : 0.02644515037536621 nb_pixel_total : 44250 time to create 1 rle with old method : 0.07148241996765137 time for calcul the mask position with numpy : 0.026052474975585938 nb_pixel_total : 102605 time to create 1 rle with old method : 0.11402416229248047 time for calcul the mask position with numpy : 0.02437591552734375 nb_pixel_total : 23334 time to create 1 rle with old method : 0.026464462280273438 time for calcul the mask position with numpy : 0.02599024772644043 nb_pixel_total : 20392 time to create 1 rle with old method : 0.023061513900756836 time for calcul the mask position with numpy : 0.025745153427124023 nb_pixel_total : 41023 time to create 1 rle with old method : 0.04524111747741699 time for calcul the mask position with numpy : 0.02484416961669922 nb_pixel_total : 8571 time to create 1 rle with old method : 0.009630441665649414 time for calcul the mask position with numpy : 0.02535843849182129 nb_pixel_total : 35944 time to create 1 rle with old method : 0.04042506217956543 time for calcul the mask position with numpy : 0.025846481323242188 nb_pixel_total : 27689 time to create 1 rle with old method : 0.03137660026550293 time for calcul the mask position with numpy : 0.028476476669311523 nb_pixel_total : 163288 time to create 1 rle with new method : 0.9295310974121094 time for calcul the mask position with numpy : 0.026865243911743164 nb_pixel_total : 37716 time to create 1 rle with old method : 0.04285120964050293 time for calcul the mask position with numpy : 0.031122446060180664 nb_pixel_total : 20393 time to create 1 rle with old method : 0.023266077041625977 create new chi : 5.622008800506592 time to delete rle : 0.002765655517578125 batch 1 Loaded 47 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++Number RLEs to save : 15683 TO DO : save crop sub photo not yet done ! save time : 0.9222867488861084 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 7.314154386520386 time for calcul the mask position with numpy : 0.514362096786499 nb_pixel_total : 6909572 time to create 1 rle with new method : 1.079871416091919 time for calcul the mask position with numpy : 0.025481224060058594 nb_pixel_total : 131815 time to create 1 rle with old method : 0.14676380157470703 time for calcul the mask position with numpy : 0.03173398971557617 nb_pixel_total : 76042 time to create 1 rle with old method : 0.08306598663330078 time for calcul the mask position with numpy : 0.027492523193359375 nb_pixel_total : 122351 time to create 1 rle with old method : 0.16249513626098633 time for calcul the mask position with numpy : 0.02551746368408203 nb_pixel_total : 18327 time to create 1 rle with old method : 0.020113468170166016 time for calcul the mask position with numpy : 0.025049209594726562 nb_pixel_total : 3054 time to create 1 rle with old method : 0.0034880638122558594 time for calcul the mask position with numpy : 0.02537083625793457 nb_pixel_total : 17883 time to create 1 rle with old method : 0.01975107192993164 time for calcul the mask position with numpy : 0.02611064910888672 nb_pixel_total : 35555 time to create 1 rle with old method : 0.0391538143157959 time for calcul the mask position with numpy : 0.026195526123046875 nb_pixel_total : 72095 time to create 1 rle with old method : 0.08121371269226074 time for calcul the mask position with numpy : 0.035696983337402344 nb_pixel_total : 288734 time to create 1 rle with new method : 1.0830585956573486 time for calcul the mask position with numpy : 0.0401918888092041 nb_pixel_total : 42872 time to create 1 rle with old method : 0.0482327938079834 time for calcul the mask position with numpy : 0.04628920555114746 nb_pixel_total : 329095 time to create 1 rle with new method : 1.2992289066314697 time for calcul the mask position with numpy : 0.026929140090942383 nb_pixel_total : 247005 time to create 1 rle with new method : 1.8840041160583496 create new chi : 6.958388090133667 time to delete rle : 0.001775503158569336 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 11848 TO DO : save crop sub photo not yet done ! save time : 0.7229177951812744 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 12.051578283309937 time for calcul the mask position with numpy : 2.094637155532837 nb_pixel_total : 7278776 time to create 1 rle with new method : 0.7020139694213867 time for calcul the mask position with numpy : 0.02524709701538086 nb_pixel_total : 50225 time to create 1 rle with old method : 0.05656599998474121 time for calcul the mask position with numpy : 0.02405548095703125 nb_pixel_total : 111284 time to create 1 rle with old method : 0.1210775375366211 time for calcul the mask position with numpy : 0.024017810821533203 nb_pixel_total : 39983 time to create 1 rle with old method : 0.0430910587310791 time for calcul the mask position with numpy : 0.02520751953125 nb_pixel_total : 119959 time to create 1 rle with old method : 0.1308736801147461 time for calcul the mask position with numpy : 0.02617788314819336 nb_pixel_total : 30287 time to create 1 rle with old method : 0.033399343490600586 time for calcul the mask position with numpy : 0.029422283172607422 nb_pixel_total : 25382 time to create 1 rle with old method : 0.028322696685791016 time for calcul the mask position with numpy : 0.027864933013916016 nb_pixel_total : 30646 time to create 1 rle with old method : 0.0340578556060791 time for calcul the mask position with numpy : 0.032006025314331055 nb_pixel_total : 11369 time to create 1 rle with old method : 0.012833356857299805 time for calcul the mask position with numpy : 0.02595043182373047 nb_pixel_total : 52934 time to create 1 rle with old method : 0.059050559997558594 time for calcul the mask position with numpy : 0.025540590286254883 nb_pixel_total : 61923 time to create 1 rle with old method : 0.06852936744689941 time for calcul the mask position with numpy : 0.026644229888916016 nb_pixel_total : 78442 time to create 1 rle with old method : 0.09271812438964844 time for calcul the mask position with numpy : 0.02546381950378418 nb_pixel_total : 18764 time to create 1 rle with old method : 0.02072453498840332 time for calcul the mask position with numpy : 0.026333093643188477 nb_pixel_total : 163872 time to create 1 rle with new method : 0.8263776302337646 time for calcul the mask position with numpy : 0.0295560359954834 nb_pixel_total : 74780 time to create 1 rle with old method : 0.08372116088867188 time for calcul the mask position with numpy : 0.025676488876342773 nb_pixel_total : 84734 time to create 1 rle with old method : 0.09534525871276855 time for calcul the mask position with numpy : 0.027803897857666016 nb_pixel_total : 25249 time to create 1 rle with old method : 0.03024888038635254 time for calcul the mask position with numpy : 0.029149293899536133 nb_pixel_total : 35791 time to create 1 rle with old method : 0.0402066707611084 create new chi : 5.108514070510864 time to delete rle : 0.0018966197967529297 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++++++++++Number RLEs to save : 12044 TO DO : save crop sub photo not yet done ! save time : 0.75215744972229 nb_obj : 11 nb_hashtags : 5 time to prepare the origin masks : 6.438896179199219 time for calcul the mask position with numpy : 0.6785008907318115 nb_pixel_total : 7117971 time to create 1 rle with new method : 1.1831541061401367 time for calcul the mask position with numpy : 0.024979114532470703 nb_pixel_total : 18444 time to create 1 rle with old method : 0.022649765014648438 time for calcul the mask position with numpy : 0.02521347999572754 nb_pixel_total : 51683 time to create 1 rle with old method : 0.058397531509399414 time for calcul the mask position with numpy : 0.02603006362915039 nb_pixel_total : 15600 time to create 1 rle with old method : 0.017420291900634766 time for calcul the mask position with numpy : 0.025176286697387695 nb_pixel_total : 136579 time to create 1 rle with old method : 0.15820908546447754 time for calcul the mask position with numpy : 0.027215957641601562 nb_pixel_total : 58808 time to create 1 rle with old method : 0.0752561092376709 time for calcul the mask position with numpy : 0.02637648582458496 nb_pixel_total : 325101 time to create 1 rle with new method : 0.912153959274292 time for calcul the mask position with numpy : 0.02653193473815918 nb_pixel_total : 53250 time to create 1 rle with old method : 0.06130814552307129 time for calcul the mask position with numpy : 0.02758049964904785 nb_pixel_total : 46726 time to create 1 rle with old method : 0.0544743537902832 time for calcul the mask position with numpy : 0.02827930450439453 nb_pixel_total : 97870 time to create 1 rle with old method : 0.11096549034118652 time for calcul the mask position with numpy : 0.025441408157348633 nb_pixel_total : 56896 time to create 1 rle with old method : 0.06394290924072266 time for calcul the mask position with numpy : 0.028135061264038086 nb_pixel_total : 315472 time to create 1 rle with new method : 1.7650556564331055 create new chi : 5.563489198684692 time to delete rle : 0.0016241073608398438 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 10228 TO DO : save crop sub photo not yet done ! save time : 0.6594953536987305 nb_obj : 11 nb_hashtags : 5 time to prepare the origin masks : 6.914925575256348 time for calcul the mask position with numpy : 0.7803645133972168 nb_pixel_total : 7691894 time to create 1 rle with new method : 0.901130199432373 time for calcul the mask position with numpy : 0.025391340255737305 nb_pixel_total : 36966 time to create 1 rle with old method : 0.04205942153930664 time for calcul the mask position with numpy : 0.025265216827392578 nb_pixel_total : 18832 time to create 1 rle with old method : 0.021287918090820312 time for calcul the mask position with numpy : 0.025768041610717773 nb_pixel_total : 10885 time to create 1 rle with old method : 0.012453079223632812 time for calcul the mask position with numpy : 0.02648162841796875 nb_pixel_total : 88941 time to create 1 rle with old method : 0.10646748542785645 time for calcul the mask position with numpy : 0.025584936141967773 nb_pixel_total : 57512 time to create 1 rle with old method : 0.06774425506591797 time for calcul the mask position with numpy : 0.026352882385253906 nb_pixel_total : 69334 time to create 1 rle with old method : 0.1021111011505127 time for calcul the mask position with numpy : 0.059715986251831055 nb_pixel_total : 108397 time to create 1 rle with old method : 0.18875408172607422 time for calcul the mask position with numpy : 0.026976823806762695 nb_pixel_total : 32747 time to create 1 rle with old method : 0.03882431983947754 time for calcul the mask position with numpy : 0.02683877944946289 nb_pixel_total : 29534 time to create 1 rle with old method : 0.03455090522766113 time for calcul the mask position with numpy : 0.027662277221679688 nb_pixel_total : 60900 time to create 1 rle with old method : 0.09537744522094727 time for calcul the mask position with numpy : 0.02844095230102539 nb_pixel_total : 88458 time to create 1 rle with old method : 0.10489964485168457 create new chi : 2.871800422668457 time to delete rle : 0.0012540817260742188 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++Number RLEs to save : 7908 TO DO : save crop sub photo not yet done ! save time : 0.4672970771789551 nb_obj : 17 nb_hashtags : 4 time to prepare the origin masks : 9.990696907043457 time for calcul the mask position with numpy : 0.8742902278900146 nb_pixel_total : 7055699 time to create 1 rle with new method : 0.7976341247558594 time for calcul the mask position with numpy : 0.039603471755981445 nb_pixel_total : 92323 time to create 1 rle with old method : 0.10055065155029297 time for calcul the mask position with numpy : 0.03972816467285156 nb_pixel_total : 62443 time to create 1 rle with old method : 0.06726384162902832 time for calcul the mask position with numpy : 0.030585289001464844 nb_pixel_total : 129696 time to create 1 rle with old method : 0.14347481727600098 time for calcul the mask position with numpy : 0.03200411796569824 nb_pixel_total : 31381 time to create 1 rle with old method : 0.034252166748046875 time for calcul the mask position with numpy : 0.041123151779174805 nb_pixel_total : 171391 time to create 1 rle with new method : 0.7485663890838623 time for calcul the mask position with numpy : 0.03968310356140137 nb_pixel_total : 32003 time to create 1 rle with old method : 0.03568577766418457 time for calcul the mask position with numpy : 0.04085516929626465 nb_pixel_total : 24151 time to create 1 rle with old method : 0.028768539428710938 time for calcul the mask position with numpy : 0.03942251205444336 nb_pixel_total : 16726 time to create 1 rle with old method : 0.018447399139404297 time for calcul the mask position with numpy : 0.03911280632019043 nb_pixel_total : 85758 time to create 1 rle with old method : 0.09261512756347656 time for calcul the mask position with numpy : 0.03970789909362793 nb_pixel_total : 57632 time to create 1 rle with old method : 0.06278586387634277 time for calcul the mask position with numpy : 0.03890848159790039 nb_pixel_total : 18541 time to create 1 rle with old method : 0.01974773406982422 time for calcul the mask position with numpy : 0.03801536560058594 nb_pixel_total : 123512 time to create 1 rle with old method : 0.15081286430358887 time for calcul the mask position with numpy : 0.038347721099853516 nb_pixel_total : 187194 time to create 1 rle with new method : 0.8550262451171875 time for calcul the mask position with numpy : 0.034760236740112305 nb_pixel_total : 62323 time to create 1 rle with old method : 0.06636905670166016 time for calcul the mask position with numpy : 0.02478504180908203 nb_pixel_total : 68631 time to create 1 rle with old method : 0.07409477233886719 time for calcul the mask position with numpy : 0.024029970169067383 nb_pixel_total : 32617 time to create 1 rle with old method : 0.03455805778503418 time for calcul the mask position with numpy : 0.024295330047607422 nb_pixel_total : 42379 time to create 1 rle with old method : 0.04574704170227051 create new chi : 4.9509875774383545 time to delete rle : 0.0021538734436035156 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 13660 TO DO : save crop sub photo not yet done ! save time : 0.8666107654571533 nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 6.291726350784302 time for calcul the mask position with numpy : 0.5724380016326904 nb_pixel_total : 7545608 time to create 1 rle with new method : 0.6770474910736084 time for calcul the mask position with numpy : 0.04066824913024902 nb_pixel_total : 17129 time to create 1 rle with old method : 0.018848896026611328 time for calcul the mask position with numpy : 0.03815293312072754 nb_pixel_total : 14737 time to create 1 rle with old method : 0.017033100128173828 time for calcul the mask position with numpy : 0.024578332901000977 nb_pixel_total : 1863 time to create 1 rle with old method : 0.0027303695678710938 time for calcul the mask position with numpy : 0.025158405303955078 nb_pixel_total : 34847 time to create 1 rle with old method : 0.03877758979797363 time for calcul the mask position with numpy : 0.02553558349609375 nb_pixel_total : 45998 time to create 1 rle with old method : 0.05150747299194336 time for calcul the mask position with numpy : 0.02502608299255371 nb_pixel_total : 94363 time to create 1 rle with old method : 0.10343575477600098 time for calcul the mask position with numpy : 0.024988412857055664 nb_pixel_total : 83517 time to create 1 rle with old method : 0.09171509742736816 time for calcul the mask position with numpy : 0.02517080307006836 nb_pixel_total : 78281 time to create 1 rle with old method : 0.08543848991394043 time for calcul the mask position with numpy : 0.026339292526245117 nb_pixel_total : 206000 time to create 1 rle with new method : 0.9274570941925049 time for calcul the mask position with numpy : 0.0257875919342041 nb_pixel_total : 135488 time to create 1 rle with old method : 0.14876961708068848 time for calcul the mask position with numpy : 0.025755882263183594 nb_pixel_total : 36569 time to create 1 rle with old method : 0.04079103469848633 create new chi : 3.15212082862854 time to delete rle : 0.0015358924865722656 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 9632 TO DO : save crop sub photo not yet done ! save time : 0.5754990577697754 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 6.852345943450928 time for calcul the mask position with numpy : 0.5819919109344482 nb_pixel_total : 7562972 time to create 1 rle with new method : 0.8846862316131592 time for calcul the mask position with numpy : 0.025209903717041016 nb_pixel_total : 20966 time to create 1 rle with old method : 0.023701906204223633 time for calcul the mask position with numpy : 0.025320768356323242 nb_pixel_total : 6488 time to create 1 rle with old method : 0.00800180435180664 time for calcul the mask position with numpy : 0.025951385498046875 nb_pixel_total : 22360 time to create 1 rle with old method : 0.026613473892211914 time for calcul the mask position with numpy : 0.026547908782958984 nb_pixel_total : 19332 time to create 1 rle with old method : 0.021821022033691406 time for calcul the mask position with numpy : 0.026330232620239258 nb_pixel_total : 88550 time to create 1 rle with old method : 0.1022026538848877 time for calcul the mask position with numpy : 0.027975797653198242 nb_pixel_total : 73054 time to create 1 rle with old method : 0.08216166496276855 time for calcul the mask position with numpy : 0.025782108306884766 nb_pixel_total : 85244 time to create 1 rle with old method : 0.09587240219116211 time for calcul the mask position with numpy : 0.02671527862548828 nb_pixel_total : 63981 time to create 1 rle with old method : 0.07144379615783691 time for calcul the mask position with numpy : 0.025992631912231445 nb_pixel_total : 66687 time to create 1 rle with old method : 0.07468843460083008 time for calcul the mask position with numpy : 0.026270389556884766 nb_pixel_total : 23166 time to create 1 rle with old method : 0.026382923126220703 time for calcul the mask position with numpy : 0.02697920799255371 nb_pixel_total : 166231 time to create 1 rle with new method : 1.0207746028900146 time for calcul the mask position with numpy : 0.028282880783081055 nb_pixel_total : 52099 time to create 1 rle with old method : 0.05872178077697754 time for calcul the mask position with numpy : 0.03528451919555664 nb_pixel_total : 29399 time to create 1 rle with old method : 0.05420327186584473 time for calcul the mask position with numpy : 0.04262566566467285 nb_pixel_total : 13871 time to create 1 rle with old method : 0.015631437301635742 create new chi : 3.624260663986206 time to delete rle : 0.001861572265625 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 10391 TO DO : save crop sub photo not yet done ! save time : 0.6317980289459229 nb_obj : 17 nb_hashtags : 4 time to prepare the origin masks : 9.513716459274292 time for calcul the mask position with numpy : 0.43515467643737793 nb_pixel_total : 6459185 time to create 1 rle with new method : 1.3552119731903076 time for calcul the mask position with numpy : 0.044358253479003906 nb_pixel_total : 82987 time to create 1 rle with old method : 0.11121487617492676 time for calcul the mask position with numpy : 0.03957033157348633 nb_pixel_total : 21000 time to create 1 rle with old method : 0.025925397872924805 time for calcul the mask position with numpy : 0.025342464447021484 nb_pixel_total : 18678 time to create 1 rle with old method : 0.020753145217895508 time for calcul the mask position with numpy : 0.02784895896911621 nb_pixel_total : 31498 time to create 1 rle with old method : 0.03495049476623535 time for calcul the mask position with numpy : 0.028055429458618164 nb_pixel_total : 316232 time to create 1 rle with new method : 1.0149579048156738 time for calcul the mask position with numpy : 0.02786111831665039 nb_pixel_total : 50030 time to create 1 rle with old method : 0.06377220153808594 time for calcul the mask position with numpy : 0.02669668197631836 nb_pixel_total : 140716 time to create 1 rle with old method : 0.20691370964050293 time for calcul the mask position with numpy : 0.027212142944335938 nb_pixel_total : 25596 time to create 1 rle with old method : 0.028748512268066406 time for calcul the mask position with numpy : 0.027417898178100586 nb_pixel_total : 94958 time to create 1 rle with old method : 0.12208127975463867 time for calcul the mask position with numpy : 0.030239343643188477 nb_pixel_total : 207050 time to create 1 rle with new method : 1.0657215118408203 time for calcul the mask position with numpy : 0.02900552749633789 nb_pixel_total : 317673 time to create 1 rle with new method : 0.8577959537506104 time for calcul the mask position with numpy : 0.026160478591918945 nb_pixel_total : 20191 time to create 1 rle with old method : 0.02326798439025879 time for calcul the mask position with numpy : 0.025653600692749023 nb_pixel_total : 32283 time to create 1 rle with old method : 0.03599977493286133 time for calcul the mask position with numpy : 0.027004480361938477 nb_pixel_total : 221805 time to create 1 rle with new method : 0.7673108577728271 time for calcul the mask position with numpy : 0.025661706924438477 nb_pixel_total : 38831 time to create 1 rle with old method : 0.0428159236907959 time for calcul the mask position with numpy : 0.025846242904663086 nb_pixel_total : 61840 time to create 1 rle with old method : 0.06859135627746582 time for calcul the mask position with numpy : 0.028156518936157227 nb_pixel_total : 153847 time to create 1 rle with new method : 0.9625043869018555 create new chi : 7.932962656021118 time to delete rle : 0.0024089813232421875 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 15100 TO DO : save crop sub photo not yet done ! save time : 0.8635942935943604 nb_obj : 21 nb_hashtags : 4 time to prepare the origin masks : 12.12617015838623 time for calcul the mask position with numpy : 1.1259737014770508 nb_pixel_total : 6820697 time to create 1 rle with new method : 2.1469340324401855 time for calcul the mask position with numpy : 0.02672123908996582 nb_pixel_total : 56907 time to create 1 rle with old method : 0.06428980827331543 time for calcul the mask position with numpy : 0.024928808212280273 nb_pixel_total : 19755 time to create 1 rle with old method : 0.0229952335357666 time for calcul the mask position with numpy : 0.031151294708251953 nb_pixel_total : 20121 time to create 1 rle with old method : 0.02324843406677246 time for calcul the mask position with numpy : 0.027785539627075195 nb_pixel_total : 13127 time to create 1 rle with old method : 0.014710187911987305 time for calcul the mask position with numpy : 0.025443553924560547 nb_pixel_total : 75467 time to create 1 rle with old method : 0.08100700378417969 time for calcul the mask position with numpy : 0.030623674392700195 nb_pixel_total : 11205 time to create 1 rle with old method : 0.015227794647216797 time for calcul the mask position with numpy : 0.030527830123901367 nb_pixel_total : 8320 time to create 1 rle with old method : 0.010346412658691406 time for calcul the mask position with numpy : 0.0272066593170166 nb_pixel_total : 6092 time to create 1 rle with old method : 0.0069506168365478516 time for calcul the mask position with numpy : 0.026334285736083984 nb_pixel_total : 73566 time to create 1 rle with old method : 0.09140157699584961 time for calcul the mask position with numpy : 0.03049445152282715 nb_pixel_total : 374671 time to create 1 rle with new method : 0.7600369453430176 time for calcul the mask position with numpy : 0.026583433151245117 nb_pixel_total : 76799 time to create 1 rle with old method : 0.08607339859008789 time for calcul the mask position with numpy : 0.02624034881591797 nb_pixel_total : 23820 time to create 1 rle with old method : 0.027735471725463867 time for calcul the mask position with numpy : 0.024870634078979492 nb_pixel_total : 39100 time to create 1 rle with old method : 0.0498049259185791 time for calcul the mask position with numpy : 0.026524066925048828 nb_pixel_total : 226954 time to create 1 rle with new method : 1.1926734447479248 time for calcul the mask position with numpy : 0.025799036026000977 nb_pixel_total : 51345 time to create 1 rle with old method : 0.056000709533691406 time for calcul the mask position with numpy : 0.02551436424255371 nb_pixel_total : 13714 time to create 1 rle with old method : 0.015318155288696289 time for calcul the mask position with numpy : 0.026241064071655273 nb_pixel_total : 58610 time to create 1 rle with old method : 0.0645754337310791 time for calcul the mask position with numpy : 0.026398897171020508 nb_pixel_total : 133066 time to create 1 rle with old method : 0.14674949645996094 time for calcul the mask position with numpy : 0.028230667114257812 nb_pixel_total : 123529 time to create 1 rle with old method : 0.1354982852935791 time for calcul the mask position with numpy : 0.025658130645751953 nb_pixel_total : 36251 time to create 1 rle with old method : 0.03966712951660156 time for calcul the mask position with numpy : 0.025618791580200195 nb_pixel_total : 31284 time to create 1 rle with old method : 0.03489232063293457 create new chi : 6.892781496047974 time to delete rle : 0.002718687057495117 batch 1 Loaded 43 chid ids of type : 3594 +++++++++++++++++++++++++++++Number RLEs to save : 15674 TO DO : save crop sub photo not yet done ! save time : 0.8809874057769775 map_output_result : {1361072275: (0.0, 'Should be the crop_list due to order', 0), 1361072116: (0.0, 'Should be the crop_list due to order', 0), 1361072081: (0.0, 'Should be the crop_list due to order', 0), 1361072043: (0.0, 'Should be the crop_list due to order', 0), 1361071977: (0.0, 'Should be the crop_list due to order', 0), 1361071943: (0.0, 'Should be the crop_list due to order', 0), 1361071924: (0.0, 'Should be the crop_list due to order', 0), 1361071917: (0.0, 'Should be the crop_list due to order', 0), 1361071907: (0.0, 'Should be the crop_list due to order', 0), 1361071905: (0.0, 'Should be the crop_list due to order', 0), 1361071902: (0.0, 'Should be the crop_list due to order', 0), 1361071896: (0.0, 'Should be the crop_list due to order', 0), 1361071794: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1361072275, 1361072116, 1361072081, 1361072043, 1361071977, 1361071943, 1361071924, 1361071917, 1361071907, 1361071905, 1361071902, 1361071896, 1361071794] Looping around the photos to save general results len do output : 13 /1361072275.Didn't retrieve data . /1361072116.Didn't retrieve data . /1361072081.Didn't retrieve data . /1361072043.Didn't retrieve data . /1361071977.Didn't retrieve data . /1361071943.Didn't retrieve data . /1361071924.Didn't retrieve data . /1361071917.Didn't retrieve data . /1361071907.Didn't retrieve data . /1361071905.Didn't retrieve data . /1361071902.Didn't retrieve data . /1361071896.Didn't retrieve data . /1361071794.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361072275', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361072116', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361072081', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361072043', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071977', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071943', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071924', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071917', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071907', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071905', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071902', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071896', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071794', None, None, None, None, None, '2954440') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 39 time used for this insertion : 0.013647079467773438 save_final save missing photos in datou_result : time spend for datou_step_exec : 179.1347279548645 time spend to save output : 0.01756143569946289 total time spend for step 3 : 179.15228939056396 step4:ventilate_hashtags_in_portfolio Mon May 26 15:27:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23339075 get user id for portfolio 23339075 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23339075 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pet_fonce','background','pet_clair','pehd','papier','autre','flou','carton','mal_croppe','environnement')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23339075 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pet_fonce','background','pet_clair','pehd','papier','autre','flou','carton','mal_croppe','environnement')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23339075 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pet_fonce','background','pet_clair','pehd','papier','autre','flou','carton','mal_croppe','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23340194,23340195,23340196,23340197,23340198,23340199,23340200,23340201,23340202,23340203,23340204?tags=metal,pet_fonce,background,pet_clair,pehd,papier,autre,flou,carton,mal_croppe,environnement Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1361072275, 1361072116, 1361072081, 1361072043, 1361071977, 1361071943, 1361071924, 1361071917, 1361071907, 1361071905, 1361071902, 1361071896, 1361071794] Looping around the photos to save general results len do output : 1 /23339075. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361072275', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361072116', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361072081', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361072043', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071977', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071943', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071924', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071917', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071907', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071905', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071902', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071896', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071794', None, None, None, None, None, '2954440') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.013339042663574219 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5999181270599365 time spend to save output : 0.016987085342407227 total time spend for step 4 : 1.6169052124023438 step5:final Mon May 26 15:27:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1361072275: ('0.12075810185185182',), 1361072116: ('0.12075810185185182',), 1361072081: ('0.12075810185185182',), 1361072043: ('0.12075810185185182',), 1361071977: ('0.12075810185185182',), 1361071943: ('0.12075810185185182',), 1361071924: ('0.12075810185185182',), 1361071917: ('0.12075810185185182',), 1361071907: ('0.12075810185185182',), 1361071905: ('0.12075810185185182',), 1361071902: ('0.12075810185185182',), 1361071896: ('0.12075810185185182',), 1361071794: ('0.12075810185185182',)} new output for save of step final : {1361072275: ('0.12075810185185182',), 1361072116: ('0.12075810185185182',), 1361072081: ('0.12075810185185182',), 1361072043: ('0.12075810185185182',), 1361071977: ('0.12075810185185182',), 1361071943: ('0.12075810185185182',), 1361071924: ('0.12075810185185182',), 1361071917: ('0.12075810185185182',), 1361071907: ('0.12075810185185182',), 1361071905: ('0.12075810185185182',), 1361071902: ('0.12075810185185182',), 1361071896: ('0.12075810185185182',), 1361071794: ('0.12075810185185182',)} [1361072275, 1361072116, 1361072081, 1361072043, 1361071977, 1361071943, 1361071924, 1361071917, 1361071907, 1361071905, 1361071902, 1361071896, 1361071794] Looping around the photos to save general results len do output : 13 /1361072275.Didn't retrieve data . /1361072116.Didn't retrieve data . /1361072081.Didn't retrieve data . /1361072043.Didn't retrieve data . /1361071977.Didn't retrieve data . /1361071943.Didn't retrieve data . /1361071924.Didn't retrieve data . /1361071917.Didn't retrieve data . /1361071907.Didn't retrieve data . /1361071905.Didn't retrieve data . /1361071902.Didn't retrieve data . /1361071896.Didn't retrieve data . /1361071794.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361072275', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361072116', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361072081', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361072043', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071977', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071943', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071924', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071917', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071907', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071905', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071902', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071896', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071794', None, None, None, None, None, '2954440') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 39 time used for this insertion : 0.014216184616088867 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10624074935913086 time spend to save output : 0.015035152435302734 total time spend for step 5 : 0.1212759017944336 step6:blur_detection Mon May 26 15:27:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7.jpg resize: (2160, 3840) 1361072275 -5.967052593572979 treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99.jpg resize: (2160, 3840) 1361072116 -5.660307391824861 treat image : temp/1748265628_36617_1361072081_6a15a33620c56ba29b2208f3a858f5ec.jpg resize: (2160, 3840) 1361072081 -5.837322368507084 treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16.jpg resize: (2160, 3840) 1361072043 -5.750961647806486 treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9.jpg resize: (2160, 3840) 1361071977 -5.6816542553467615 treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819.jpg resize: (2160, 3840) 1361071943 -5.827229197945631 treat image : temp/1748265628_36617_1361071924_91e730a228ddaf9f9552240257fec856.jpg resize: (2160, 3840) 1361071924 -5.721939452445332 treat image : temp/1748265628_36617_1361071917_2640ae46d5b8f231f9cc1fac0f099d04.jpg resize: (2160, 3840) 1361071917 -5.710534665790611 treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434.jpg resize: (2160, 3840) 1361071907 -5.632890325710342 treat image : temp/1748265628_36617_1361071905_63c41baa4d0147fcd0b1dd57219291dc.jpg resize: (2160, 3840) 1361071905 -5.80068389588644 treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512.jpg resize: (2160, 3840) 1361071902 -5.763857680694506 treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855.jpg resize: (2160, 3840) 1361071896 -5.600787730998297 treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e.jpg resize: (2160, 3840) 1361071794 -5.65429937783028 treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7_rle_crop_3813148312_0.png resize: (103, 106) 1361091378 -3.7356441276830923 treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7_rle_crop_3813148313_0.png resize: (269, 237) 1361091379 -4.143848432116039 treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7_rle_crop_3813148316_0.png resize: (672, 184) 1361091380 -3.196963441732843 treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7_rle_crop_3813148317_0.png resize: (123, 176) 1361091381 -0.16041232488455645 treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7_rle_crop_3813148319_0.png resize: (138, 161) 1361091382 -2.3567093966605275 treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7_rle_crop_3813148320_0.png resize: (129, 136) 1361091383 -2.726239276080712 treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148324_0.png resize: (277, 165) 1361091384 -1.4948718939846817 treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148327_0.png resize: (264, 250) 1361091387 1.7679021594163755 treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148331_0.png resize: (290, 271) 1361091388 -3.348989832065431 treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148333_0.png resize: (201, 281) 1361091389 -3.614598369484123 treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148335_0.png resize: (176, 142) 1361091390 -2.7579588377118265 treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148337_0.png resize: (409, 229) 1361091391 -2.3504337525555097 treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148338_0.png resize: (263, 94) 1361091392 -1.9468764212736769 treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148340_0.png resize: (248, 89) 1361091393 -2.304622477185485 treat image : temp/1748265628_36617_1361072081_6a15a33620c56ba29b2208f3a858f5ec_rle_crop_3813148343_0.png resize: (214, 254) 1361091394 -3.5077898993975727 treat image : temp/1748265628_36617_1361072081_6a15a33620c56ba29b2208f3a858f5ec_rle_crop_3813148344_0.png resize: (243, 134) 1361091395 -2.453302223990955 treat image : temp/1748265628_36617_1361072081_6a15a33620c56ba29b2208f3a858f5ec_rle_crop_3813148346_0.png resize: (165, 198) 1361091396 -0.9519851539676576 treat image : temp/1748265628_36617_1361072081_6a15a33620c56ba29b2208f3a858f5ec_rle_crop_3813148347_0.png resize: (299, 376) 1361091397 -3.22088437504536 treat image : temp/1748265628_36617_1361072081_6a15a33620c56ba29b2208f3a858f5ec_rle_crop_3813148349_0.png resize: (553, 272) 1361091398 -3.7703306644310115 treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148350_0.png resize: (303, 92) 1361091399 -3.1498868679058885 treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148351_0.png resize: (175, 266) 1361091400 -0.7571506497866806 treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148352_0.png resize: (613, 422) 1361091401 -3.7616576890635423 treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148353_0.png resize: (208, 206) 1361091402 -3.496767406924162 treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148354_0.png resize: (242, 188) 1361091403 -2.551364962161488 treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148355_0.png resize: (92, 122) 1361091404 -2.2012476136709243 treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148356_0.png resize: (382, 130) 1361091405 -3.2280587362079927 treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148357_0.png resize: (157, 214) 1361091406 -2.771235702410972 treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148358_0.png resize: (168, 189) 1361091407 -0.24307798861228508 treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148361_0.png resize: (226, 204) 1361091408 -3.8879454985355455 treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148362_0.png resize: (139, 144) 1361091409 -1.0917513318143044 treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148364_0.png resize: (160, 161) 1361091410 -1.23301401599027 treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148366_0.png resize: (208, 190) 1361091411 -3.2390616283158242 treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148367_0.png resize: (169, 175) 1361091412 -3.8539710749370637 treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148369_0.png resize: (239, 413) 1361091413 -3.6563016118203726 treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148371_0.png resize: (165, 235) 1361091414 -3.6100239781480132 treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9_rle_crop_3813148373_0.png resize: (455, 766) 1361091415 -4.023021242945745 treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9_rle_crop_3813148374_0.png resize: (729, 760) 1361091416 -2.111571467025393 treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9_rle_crop_3813148376_0.png resize: (783, 616) 1361091418 -3.8232446331578434 treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9_rle_crop_3813148378_0.png resize: (190, 345) 1361091419 -2.4585863615708305 treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9_rle_crop_3813148380_0.png resize: (174, 84) 1361091420 -3.0454062142277385 treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9_rle_crop_3813148381_0.png resize: (165, 195) 1361091421 -2.8357553632760744 treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9_rle_crop_3813148382_0.png resize: (364, 571) 1361091422 -1.7563573501158665 treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148385_0.png resize: (218, 290) 1361091423 -4.015137951477652 treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148386_0.png resize: (219, 206) 1361091424 -2.172228544179538 treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148388_0.png resize: (403, 286) 1361091425 -3.4703253717634923 treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148389_0.png resize: (422, 587) 1361091426 -4.500174326809291 treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148397_0.png resize: (193, 215) 1361091427 -2.853268357360933 treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148401_0.png resize: (362, 238) 1361091428 -3.6381524664262215 treat image : temp/1748265628_36617_1361071924_91e730a228ddaf9f9552240257fec856_rle_crop_3813148403_0.png resize: (348, 247) 1361091429 -1.7942282715582702 treat image : temp/1748265628_36617_1361071924_91e730a228ddaf9f9552240257fec856_rle_crop_3813148404_0.png resize: (321, 423) 1361091430 -0.417315298106937 treat image : temp/1748265628_36617_1361071924_91e730a228ddaf9f9552240257fec856_rle_crop_3813148405_0.png resize: (240, 299) 1361091431 -2.089982671551595 treat image : temp/1748265628_36617_1361071924_91e730a228ddaf9f9552240257fec856_rle_crop_3813148406_0.png resize: (291, 250) 1361091432 -4.716146404855071 treat image : temp/1748265628_36617_1361071924_91e730a228ddaf9f9552240257fec856_rle_crop_3813148410_0.png resize: (123, 146) 1361091433 -1.1162569684355725 treat image : temp/1748265628_36617_1361071917_2640ae46d5b8f231f9cc1fac0f099d04_rle_crop_3813148414_0.png resize: (300, 295) 1361091434 -2.1854741206604196 treat image : temp/1748265628_36617_1361071917_2640ae46d5b8f231f9cc1fac0f099d04_rle_crop_3813148421_0.png resize: (102, 155) 1361091435 -3.4173568185366388 treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148424_0.png resize: (222, 305) 1361091436 -2.535509792386029 treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148425_0.png resize: (232, 226) 1361091437 -2.9517842811667405 treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148426_0.png resize: (524, 342) 1361091438 -0.13251713427023415 treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148428_0.png resize: (588, 578) 1361091439 -3.3523740407887073 treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148430_0.png resize: (167, 149) 1361091440 -1.5007199040148087 treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148433_0.png resize: (123, 185) 1361091441 -0.39509946652775824 treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148435_0.png resize: (280, 171) 1361091442 -2.8712961830782535 treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148440_0.png resize: (532, 226) 1361091443 -3.1378301178398855 treat image : temp/1748265628_36617_1361071905_63c41baa4d0147fcd0b1dd57219291dc_rle_crop_3813148441_0.png resize: (177, 276) 1361091444 -2.702266914658896 treat image : temp/1748265628_36617_1361071905_63c41baa4d0147fcd0b1dd57219291dc_rle_crop_3813148444_0.png resize: (392, 374) 1361091445 -4.564996608170866 treat image : temp/1748265628_36617_1361071905_63c41baa4d0147fcd0b1dd57219291dc_rle_crop_3813148446_0.png resize: (423, 358) 1361091446 -1.1711175433172505 treat image : temp/1748265628_36617_1361071905_63c41baa4d0147fcd0b1dd57219291dc_rle_crop_3813148447_0.png resize: (225, 299) 1361091447 -3.4030147784097253 treat image : temp/1748265628_36617_1361071905_63c41baa4d0147fcd0b1dd57219291dc_rle_crop_3813148450_0.png resize: (240, 126) 1361091448 -3.603743894625457 treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148453_0.png resize: (241, 266) 1361091449 -3.33448958622216 treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148455_0.png resize: (534, 489) 1361091450 -3.453686486732742 treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148456_0.png resize: (203, 206) 1361091451 -4.698179871566138 treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148459_0.png resize: (332, 432) 1361091452 -3.972665847941152 treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148462_0.png resize: (192, 206) 1361091453 -3.7917124261379667 treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148463_0.png resize: (183, 189) 1361091454 -2.7564243124993175 treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148464_0.png resize: (316, 392) 1361091455 -0.5010204205524451 treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148465_0.png resize: (263, 126) 1361091456 -3.3603477969320323 treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148466_0.png resize: (616, 414) 1361091457 -0.9532568252697606 treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148467_0.png resize: (195, 400) 1361091458 -3.690516840110507 treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148468_0.png resize: (299, 226) 1361091459 -2.033611962594882 treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148469_0.png resize: (605, 552) 1361091460 -3.836616543109752 treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148470_0.png resize: (238, 178) 1361091461 -3.6368959901592413 treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148472_0.png resize: (593, 765) 1361091462 -3.55045864059212 treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148474_0.png resize: (451, 316) 1361091463 -4.151208625710339 treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148475_0.png resize: (163, 210) 1361091465 -2.0611898016372585 treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148479_0.png resize: (192, 248) 1361091466 -3.171330980012687 treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148480_0.png resize: (96, 254) 1361091467 -4.22345898190975 treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148481_0.png resize: (166, 167) 1361091468 -4.04693181465234 treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148483_0.png resize: (305, 180) 1361091469 -4.498652136926069 treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148484_0.png resize: (369, 130) 1361091470 -4.416152650833898 treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148486_0.png resize: (536, 522) 1361091471 -2.7431390863928446 treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148487_0.png resize: (300, 382) 1361091472 -0.9624564999032807 treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148488_0.png resize: (183, 140) 1361091473 -4.431465895408953 treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148489_0.png resize: (430, 151) 1361091474 -3.852248049675127 treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148496_0.png resize: (93, 96) 1361091475 -2.17899268616707 treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148497_0.png resize: (139, 77) 1361091476 -3.0382499277531263 treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148498_0.png resize: (123, 127) 1361091478 -2.524291412360067 treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148500_0.png resize: (191, 102) 1361091479 -4.259921500815546 treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148501_0.png resize: (183, 155) 1361091480 -3.384544440298678 treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148502_0.png resize: (125, 264) 1361091481 -4.158996232651544 treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7_rle_crop_3813148315_0.png resize: (197, 161) 1361091486 -3.195632169422892 treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148328_0.png resize: (418, 435) 1361091487 -3.423859252764414 treat image : temp/1748265628_36617_1361072081_6a15a33620c56ba29b2208f3a858f5ec_rle_crop_3813148345_0.png resize: (505, 293) 1361091488 -3.89511995793543 treat image : temp/1748265628_36617_1361072081_6a15a33620c56ba29b2208f3a858f5ec_rle_crop_3813148348_0.png resize: (171, 122) 1361091489 -2.8214137123907546 treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148365_0.png resize: (185, 113) 1361091490 -3.2988364688359058 treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9_rle_crop_3813148375_0.png resize: (341, 177) 1361091492 -4.852461131347977 treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9_rle_crop_3813148379_0.png resize: (153, 176) 1361091493 -3.2775766126128665 treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148390_0.png resize: (164, 199) 1361091494 -4.127966316493984 treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148399_0.png resize: (196, 294) 1361091495 -4.394897611775301 treat image : temp/1748265628_36617_1361071924_91e730a228ddaf9f9552240257fec856_rle_crop_3813148412_0.png resize: (169, 185) 1361091496 -2.496959011407551 treat image : temp/1748265628_36617_1361071917_2640ae46d5b8f231f9cc1fac0f099d04_rle_crop_3813148413_0.png resize: (343, 363) 1361091497 -3.8049019553518515 treat image : temp/1748265628_36617_1361071917_2640ae46d5b8f231f9cc1fac0f099d04_rle_crop_3813148420_0.png resize: (295, 379) 1361091498 -4.1802414705346 treat image : temp/1748265628_36617_1361071917_2640ae46d5b8f231f9cc1fac0f099d04_rle_crop_3813148422_0.png resize: (160, 137) 1361091499 -3.5747918514252937 treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148439_0.png resize: (263, 315) 1361091500 -3.679895400996116 treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148452_0.png resize: (161, 172) 1361091501 -3.6989530186608883 treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148471_0.png resize: (185, 189) 1361091502 -2.318016919780305 treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148499_0.png resize: (237, 449) 1361091503 -2.100179292112064 treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148334_0.png resize: (134, 86) 1361091512 -3.281812138906993 treat image : temp/1748265628_36617_1361071917_2640ae46d5b8f231f9cc1fac0f099d04_rle_crop_3813148416_0.png resize: (159, 354) 1361091513 -3.2043630919383532 treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148477_0.png resize: (323, 231) 1361091514 -3.27468505963896 treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7_rle_crop_3813148318_0.png resize: (597, 220) 1361091584 -3.933272908016373 treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7_rle_crop_3813148323_0.png resize: (386, 369) 1361091585 -2.89982166872676 treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148325_0.png resize: (291, 215) 1361091586 -4.612756612742954 treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148326_0.png resize: (305, 329) 1361091587 -4.678769206154215 treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148329_0.png resize: (330, 345) 1361091588 -3.8926178076389233 treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148330_0.png resize: (237, 169) 1361091589 -4.583519257577247 treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148332_0.png resize: (296, 400) 1361091591 -3.3414186203999967 treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148336_0.png resize: (247, 224) 1361091592 -3.937398501291898 treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148339_0.png resize: (307, 432) 1361091593 -4.225420810387481 treat image : temp/1748265628_36617_1361072081_6a15a33620c56ba29b2208f3a858f5ec_rle_crop_3813148341_0.png resize: (677, 361) 1361091594 -3.491221352051598 treat image : temp/1748265628_36617_1361072081_6a15a33620c56ba29b2208f3a858f5ec_rle_crop_3813148342_0.png resize: (315, 215) 1361091595 -4.900427803016692 treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148359_0.png resize: (461, 301) 1361091596 -3.950143578725232 treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148363_0.png resize: (564, 249) 1361091597 -4.648449436203073 treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148368_0.png resize: (346, 229) 1361091598 -4.240555920306521 treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148370_0.png resize: (479, 487) 1361091599 -3.9364214653816636 treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148372_0.png resize: (218, 161) 1361091600 -3.5650992762386817 treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9_rle_crop_3813148377_0.png resize: (268, 346) 1361091601 -2.6468848993135645 treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9_rle_crop_3813148383_0.png resize: (265, 420) 1361091602 -3.6992602867353157 treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9_rle_crop_3813148384_0.png resize: (688, 259) 1361091603 -3.4929830900840733 treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148387_0.png resize: (394, 279) 1361091604 -4.276231886670508 treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148391_0.png resize: (252, 389) 1361091605 -4.608272391515556 treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148392_0.png resize: (313, 282) 1361091606 -3.7869712984090946 treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148393_0.png resize: (171, 413) 1361091607 -4.175435934920151 treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148394_0.png resize: (100, 191) 1361091608 -3.2423323920446943 treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148395_0.png resize: (114, 347) 1361091609 -3.149078619038004 treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148396_0.png resize: (241, 205) 1361091610 -3.4860810039032004 treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148398_0.png resize: (469, 313) 1361091611 -3.2550584066574864 treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148400_0.png resize: (332, 431) 1361091612 -4.357424768404216 treat image : temp/1748265628_36617_1361071924_91e730a228ddaf9f9552240257fec856_rle_crop_3813148402_0.png resize: (645, 592) 1361091613 -4.999545500018849 treat image : temp/1748265628_36617_1361071924_91e730a228ddaf9f9552240257fec856_rle_crop_3813148407_0.png resize: (745, 615) 1361091614 -4.428994227717342 treat image : temp/1748265628_36617_1361071924_91e730a228ddaf9f9552240257fec856_rle_crop_3813148409_0.png resize: (429, 430) 1361091615 -3.6428709875315928 treat image : temp/1748265628_36617_1361071917_2640ae46d5b8f231f9cc1fac0f099d04_rle_crop_3813148415_0.png resize: (237, 162) 1361091616 -4.23287344939984 treat image : temp/1748265628_36617_1361071917_2640ae46d5b8f231f9cc1fac0f099d04_rle_crop_3813148417_0.png resize: (486, 471) 1361091617 -3.811661272828143 treat image : temp/1748265628_36617_1361071917_2640ae46d5b8f231f9cc1fac0f099d04_rle_crop_3813148418_0.png resize: (221, 466) 1361091618 -4.413081218273705 treat image : temp/1748265628_36617_1361071917_2640ae46d5b8f231f9cc1fac0f099d04_rle_crop_3813148419_0.png resize: (255, 370) 1361091619 -4.456788698941627 treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148427_0.png resize: (183, 424) 1361091620 -3.4512554166320206 treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148429_0.png resize: (290, 490) 1361091621 -4.16397284843319 treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148431_0.png resize: (223, 365) 1361091622 -4.540230331619558 treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148432_0.png resize: (364, 329) 1361091623 -4.250238375080875 treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148436_0.png resize: (556, 426) 1361091624 -3.672609540094694 treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148437_0.png resize: (271, 236) 1361091625 -3.6431667509910324 treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148438_0.png resize: (462, 446) 1361091626 -3.8827507454188654 treat image : temp/1748265628_36617_1361071905_63c41baa4d0147fcd0b1dd57219291dc_rle_crop_3813148442_0.png resize: (411, 445) 1361091627 -4.644323182478193 treat image : temp/1748265628_36617_1361071905_63c41baa4d0147fcd0b1dd57219291dc_rle_crop_3813148443_0.png resize: (474, 585) 1361091628 -4.277640781848259 treat image : temp/1748265628_36617_1361071905_63c41baa4d0147fcd0b1dd57219291dc_rle_crop_3813148445_0.png resize: (372, 340) 1361091629 -3.8527792837581623 treat image : temp/1748265628_36617_1361071905_63c41baa4d0147fcd0b1dd57219291dc_rle_crop_3813148448_0.png resize: (269, 173) 1361091630 -4.362672379117192 treat image : temp/1748265628_36617_1361071905_63c41baa4d0147fcd0b1dd57219291dc_rle_crop_3813148451_0.png resize: (178, 120) 1361091631 -2.2084992705395248 treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148454_0.png resize: (275, 270) 1361091632 -3.6803563520502696 treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148457_0.png resize: (235, 400) 1361091633 -3.6420197715046774 treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148458_0.png resize: (301, 295) 1361091634 -4.326897062548888 treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148460_0.png resize: (348, 278) 1361091636 -3.8883314156351174 treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148461_0.png resize: (389, 337) 1361091637 -4.405008241682601 treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148473_0.png resize: (431, 643) 1361091638 -3.969059292687624 treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148476_0.png resize: (395, 516) 1361091639 -3.614911652388418 treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148478_0.png resize: (628, 677) 1361091640 -4.318317500524987 treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148482_0.png resize: (503, 208) 1361091641 -3.746168443791646 treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148485_0.png resize: (289, 505) 1361091642 -4.49590228880357 treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148490_0.png resize: (698, 444) 1361091643 -4.905877018130067 treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148491_0.png resize: (214, 245) 1361091644 -3.4316364882452897 treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148493_0.png resize: (310, 370) 1361091645 -4.60618266764125 treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148494_0.png resize: (778, 690) 1361091646 -3.703286828063345 treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148495_0.png resize: (353, 254) 1361091647 -4.450851890661696 treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148503_0.png resize: (538, 378) 1361091648 -2.7969687521080115 treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148360_0.png resize: (207, 265) 1361091650 -2.4162798733452573 treat image : temp/1748265628_36617_1361071924_91e730a228ddaf9f9552240257fec856_rle_crop_3813148411_0.png resize: (213, 321) 1361091651 -5.2920045487167915 treat image : temp/1748265628_36617_1361071917_2640ae46d5b8f231f9cc1fac0f099d04_rle_crop_3813148423_0.png resize: (207, 216) 1361091652 -4.001160567620033 treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148492_0.png resize: (174, 230) 1361091653 -3.061056874840022 treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7_rle_crop_3813148314_0.png resize: (441, 349) 1361091658 -5.365085957770753 treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7_rle_crop_3813148321_0.png resize: (163, 201) 1361091659 -2.002350167756685 treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7_rle_crop_3813148322_0.png resize: (370, 179) 1361091660 -3.574511849411219 treat image : temp/1748265628_36617_1361071924_91e730a228ddaf9f9552240257fec856_rle_crop_3813148408_0.png resize: (227, 348) 1361091662 -4.389496731152434 treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148434_0.png resize: (199, 157) 1361091663 -3.8018043938033284 treat image : temp/1748265628_36617_1361071905_63c41baa4d0147fcd0b1dd57219291dc_rle_crop_3813148449_0.png resize: (456, 572) 1361091664 -4.2856333917595455 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 205 time used for this insertion : 0.02239704132080078 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 205 time used for this insertion : 0.04431867599487305 save missing photos in datou_result : time spend for datou_step_exec : 63.88116908073425 time spend to save output : 0.10422635078430176 total time spend for step 6 : 63.985395431518555 step7:brightness Mon May 26 15:29:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7.jpg treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99.jpg treat image : temp/1748265628_36617_1361072081_6a15a33620c56ba29b2208f3a858f5ec.jpg treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16.jpg treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9.jpg treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819.jpg treat image : temp/1748265628_36617_1361071924_91e730a228ddaf9f9552240257fec856.jpg treat image : temp/1748265628_36617_1361071917_2640ae46d5b8f231f9cc1fac0f099d04.jpg treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434.jpg treat image : temp/1748265628_36617_1361071905_63c41baa4d0147fcd0b1dd57219291dc.jpg treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512.jpg treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855.jpg treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e.jpg treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7_rle_crop_3813148312_0.png treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7_rle_crop_3813148313_0.png treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7_rle_crop_3813148316_0.png treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7_rle_crop_3813148317_0.png treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7_rle_crop_3813148319_0.png treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7_rle_crop_3813148320_0.png treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148324_0.png treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148327_0.png treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148331_0.png treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148333_0.png treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148335_0.png treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148337_0.png treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148338_0.png treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148340_0.png treat image : temp/1748265628_36617_1361072081_6a15a33620c56ba29b2208f3a858f5ec_rle_crop_3813148343_0.png treat image : temp/1748265628_36617_1361072081_6a15a33620c56ba29b2208f3a858f5ec_rle_crop_3813148344_0.png treat image : temp/1748265628_36617_1361072081_6a15a33620c56ba29b2208f3a858f5ec_rle_crop_3813148346_0.png treat image : temp/1748265628_36617_1361072081_6a15a33620c56ba29b2208f3a858f5ec_rle_crop_3813148347_0.png treat image : temp/1748265628_36617_1361072081_6a15a33620c56ba29b2208f3a858f5ec_rle_crop_3813148349_0.png treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148350_0.png treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148351_0.png treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148352_0.png treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148353_0.png treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148354_0.png treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148355_0.png treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148356_0.png treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148357_0.png treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148358_0.png treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148361_0.png treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148362_0.png treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148364_0.png treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148366_0.png treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148367_0.png treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148369_0.png treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148371_0.png treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9_rle_crop_3813148373_0.png treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9_rle_crop_3813148374_0.png treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9_rle_crop_3813148376_0.png treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9_rle_crop_3813148378_0.png treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9_rle_crop_3813148380_0.png treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9_rle_crop_3813148381_0.png treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9_rle_crop_3813148382_0.png treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148385_0.png treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148386_0.png treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148388_0.png treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148389_0.png treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148397_0.png treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148401_0.png treat image : temp/1748265628_36617_1361071924_91e730a228ddaf9f9552240257fec856_rle_crop_3813148403_0.png treat image : temp/1748265628_36617_1361071924_91e730a228ddaf9f9552240257fec856_rle_crop_3813148404_0.png treat image : temp/1748265628_36617_1361071924_91e730a228ddaf9f9552240257fec856_rle_crop_3813148405_0.png treat image : temp/1748265628_36617_1361071924_91e730a228ddaf9f9552240257fec856_rle_crop_3813148406_0.png treat image : temp/1748265628_36617_1361071924_91e730a228ddaf9f9552240257fec856_rle_crop_3813148410_0.png treat image : temp/1748265628_36617_1361071917_2640ae46d5b8f231f9cc1fac0f099d04_rle_crop_3813148414_0.png treat image : temp/1748265628_36617_1361071917_2640ae46d5b8f231f9cc1fac0f099d04_rle_crop_3813148421_0.png treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148424_0.png treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148425_0.png treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148426_0.png treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148428_0.png treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148430_0.png treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148433_0.png treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148435_0.png treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148440_0.png treat image : temp/1748265628_36617_1361071905_63c41baa4d0147fcd0b1dd57219291dc_rle_crop_3813148441_0.png treat image : temp/1748265628_36617_1361071905_63c41baa4d0147fcd0b1dd57219291dc_rle_crop_3813148444_0.png treat image : temp/1748265628_36617_1361071905_63c41baa4d0147fcd0b1dd57219291dc_rle_crop_3813148446_0.png treat image : temp/1748265628_36617_1361071905_63c41baa4d0147fcd0b1dd57219291dc_rle_crop_3813148447_0.png treat image : temp/1748265628_36617_1361071905_63c41baa4d0147fcd0b1dd57219291dc_rle_crop_3813148450_0.png treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148453_0.png treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148455_0.png treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148456_0.png treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148459_0.png treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148462_0.png treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148463_0.png treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148464_0.png treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148465_0.png treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148466_0.png treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148467_0.png treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148468_0.png treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148469_0.png treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148470_0.png treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148472_0.png treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148474_0.png treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148475_0.png treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148479_0.png treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148480_0.png treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148481_0.png treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148483_0.png treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148484_0.png treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148486_0.png treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148487_0.png treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148488_0.png treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148489_0.png treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148496_0.png treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148497_0.png treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148498_0.png treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148500_0.png treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148501_0.png treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148502_0.png treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7_rle_crop_3813148315_0.png treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148328_0.png treat image : temp/1748265628_36617_1361072081_6a15a33620c56ba29b2208f3a858f5ec_rle_crop_3813148345_0.png treat image : temp/1748265628_36617_1361072081_6a15a33620c56ba29b2208f3a858f5ec_rle_crop_3813148348_0.png treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148365_0.png treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9_rle_crop_3813148375_0.png treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9_rle_crop_3813148379_0.png treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148390_0.png treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148399_0.png treat image : temp/1748265628_36617_1361071924_91e730a228ddaf9f9552240257fec856_rle_crop_3813148412_0.png treat image : temp/1748265628_36617_1361071917_2640ae46d5b8f231f9cc1fac0f099d04_rle_crop_3813148413_0.png treat image : temp/1748265628_36617_1361071917_2640ae46d5b8f231f9cc1fac0f099d04_rle_crop_3813148420_0.png treat image : temp/1748265628_36617_1361071917_2640ae46d5b8f231f9cc1fac0f099d04_rle_crop_3813148422_0.png treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148439_0.png treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148452_0.png treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148471_0.png treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148499_0.png treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148334_0.png treat image : temp/1748265628_36617_1361071917_2640ae46d5b8f231f9cc1fac0f099d04_rle_crop_3813148416_0.png treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148477_0.png treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7_rle_crop_3813148318_0.png treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7_rle_crop_3813148323_0.png treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148325_0.png treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148326_0.png treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148329_0.png treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148330_0.png treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148332_0.png treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148336_0.png treat image : temp/1748265628_36617_1361072116_a599c87efbe48b13cc361b0de6b48e99_rle_crop_3813148339_0.png treat image : temp/1748265628_36617_1361072081_6a15a33620c56ba29b2208f3a858f5ec_rle_crop_3813148341_0.png treat image : temp/1748265628_36617_1361072081_6a15a33620c56ba29b2208f3a858f5ec_rle_crop_3813148342_0.png treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148359_0.png treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148363_0.png treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148368_0.png treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148370_0.png treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148372_0.png treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9_rle_crop_3813148377_0.png treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9_rle_crop_3813148383_0.png treat image : temp/1748265628_36617_1361071977_f21e27c17fb41047cf2f9d20133ed6f9_rle_crop_3813148384_0.png treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148387_0.png treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148391_0.png treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148392_0.png treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148393_0.png treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148394_0.png treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148395_0.png treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148396_0.png treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148398_0.png treat image : temp/1748265628_36617_1361071943_1a3896e6b2eda1ff8bcf95449641e819_rle_crop_3813148400_0.png treat image : temp/1748265628_36617_1361071924_91e730a228ddaf9f9552240257fec856_rle_crop_3813148402_0.png treat image : temp/1748265628_36617_1361071924_91e730a228ddaf9f9552240257fec856_rle_crop_3813148407_0.png treat image : temp/1748265628_36617_1361071924_91e730a228ddaf9f9552240257fec856_rle_crop_3813148409_0.png treat image : temp/1748265628_36617_1361071917_2640ae46d5b8f231f9cc1fac0f099d04_rle_crop_3813148415_0.png treat image : temp/1748265628_36617_1361071917_2640ae46d5b8f231f9cc1fac0f099d04_rle_crop_3813148417_0.png treat image : temp/1748265628_36617_1361071917_2640ae46d5b8f231f9cc1fac0f099d04_rle_crop_3813148418_0.png treat image : temp/1748265628_36617_1361071917_2640ae46d5b8f231f9cc1fac0f099d04_rle_crop_3813148419_0.png treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148427_0.png treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148429_0.png treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148431_0.png treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148432_0.png treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148436_0.png treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148437_0.png treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148438_0.png treat image : temp/1748265628_36617_1361071905_63c41baa4d0147fcd0b1dd57219291dc_rle_crop_3813148442_0.png treat image : temp/1748265628_36617_1361071905_63c41baa4d0147fcd0b1dd57219291dc_rle_crop_3813148443_0.png treat image : temp/1748265628_36617_1361071905_63c41baa4d0147fcd0b1dd57219291dc_rle_crop_3813148445_0.png treat image : temp/1748265628_36617_1361071905_63c41baa4d0147fcd0b1dd57219291dc_rle_crop_3813148448_0.png treat image : temp/1748265628_36617_1361071905_63c41baa4d0147fcd0b1dd57219291dc_rle_crop_3813148451_0.png treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148454_0.png treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148457_0.png treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148458_0.png treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148460_0.png treat image : temp/1748265628_36617_1361071902_2e71decc640aa1cb593587634a917512_rle_crop_3813148461_0.png treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148473_0.png treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148476_0.png treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148478_0.png treat image : temp/1748265628_36617_1361071896_b9264889ee80cf3eab407655b66ef855_rle_crop_3813148482_0.png treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148485_0.png treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148490_0.png treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148491_0.png treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148493_0.png treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148494_0.png treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148495_0.png treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148503_0.png treat image : temp/1748265628_36617_1361072043_b062a0cdfc0406c9ff17428ec5c08b16_rle_crop_3813148360_0.png treat image : temp/1748265628_36617_1361071924_91e730a228ddaf9f9552240257fec856_rle_crop_3813148411_0.png treat image : temp/1748265628_36617_1361071917_2640ae46d5b8f231f9cc1fac0f099d04_rle_crop_3813148423_0.png treat image : temp/1748265628_36617_1361071794_e1d011e049956de2fe4a4bd14ecd838e_rle_crop_3813148492_0.png treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7_rle_crop_3813148314_0.png treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7_rle_crop_3813148321_0.png treat image : temp/1748265628_36617_1361072275_d7036cfa89090851151f91b53a5fa4f7_rle_crop_3813148322_0.png treat image : temp/1748265628_36617_1361071924_91e730a228ddaf9f9552240257fec856_rle_crop_3813148408_0.png treat image : temp/1748265628_36617_1361071907_ce44cfa99ca155b9eb3fbe22b7272434_rle_crop_3813148434_0.png treat image : temp/1748265628_36617_1361071905_63c41baa4d0147fcd0b1dd57219291dc_rle_crop_3813148449_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 205 time used for this insertion : 0.02036905288696289 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 205 time used for this insertion : 0.044121742248535156 save missing photos in datou_result : time spend for datou_step_exec : 16.927436113357544 time spend to save output : 0.07081890106201172 total time spend for step 7 : 16.998255014419556 step8:velours_tree Mon May 26 15:29:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.8910002708435059 time spend to save output : 3.695487976074219e-05 total time spend for step 8 : 0.8910372257232666 step9:send_mail_cod Mon May 26 15:29:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23339075_26-05-2025_15_29_17.pdf 23340194 change filename to text .change filename to text .change filename to text .imagette233401941748266157 23340195 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233401951748266158 23340196 imagette233401961748266158 23340197 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233401971748266158 23340198 imagette233401981748266162 23340199 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233401991748266162 23340200 change filename to text .change filename to text .change filename to text .change filename to text .imagette233402001748266163 23340201 imagette233402011748266163 23340202 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233402021748266163 23340203 imagette233402031748266165 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23339075 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23340194,23340195,23340196,23340197,23340198,23340199,23340200,23340201,23340202,23340203,23340204?tags=metal,pet_fonce,background,pet_clair,pehd,papier,autre,flou,carton,mal_croppe,environnement args[1361072275] : ((1361072275, -5.967052593572979, 492609224), (1361072275, 0.46783645954391295, 2107752395), '0.12075810185185182') We are sending mail with results at report@fotonower.com args[1361072116] : ((1361072116, -5.660307391824861, 492609224), (1361072116, 0.5338379186398389, 2107752395), '0.12075810185185182') We are sending mail with results at report@fotonower.com args[1361072081] : ((1361072081, -5.837322368507084, 492609224), (1361072081, 0.6211378542760361, 2107752395), '0.12075810185185182') We are sending mail with results at report@fotonower.com args[1361072043] : ((1361072043, -5.750961647806486, 492609224), (1361072043, 0.5756215042157892, 2107752395), '0.12075810185185182') We are sending mail with results at report@fotonower.com args[1361071977] : ((1361071977, -5.6816542553467615, 492609224), (1361071977, 0.6718753542806789, 2107752395), '0.12075810185185182') We are sending mail with results at report@fotonower.com args[1361071943] : ((1361071943, -5.827229197945631, 492609224), (1361071943, 0.4347223086887977, 2107752395), '0.12075810185185182') We are sending mail with results at report@fotonower.com args[1361071924] : ((1361071924, -5.721939452445332, 492609224), (1361071924, 0.5811218507263104, 2107752395), '0.12075810185185182') We are sending mail with results at report@fotonower.com args[1361071917] : ((1361071917, -5.710534665790611, 492609224), (1361071917, 0.5673635851617518, 2107752395), '0.12075810185185182') We are sending mail with results at report@fotonower.com args[1361071907] : ((1361071907, -5.632890325710342, 492609224), (1361071907, 0.5710960891605088, 2107752395), '0.12075810185185182') We are sending mail with results at report@fotonower.com args[1361071905] : ((1361071905, -5.80068389588644, 492609224), (1361071905, 0.5799617282856324, 2107752395), '0.12075810185185182') We are sending mail with results at report@fotonower.com args[1361071902] : ((1361071902, -5.763857680694506, 492609224), (1361071902, 0.5504081174299359, 2107752395), '0.12075810185185182') We are sending mail with results at report@fotonower.com args[1361071896] : ((1361071896, -5.600787730998297, 492609224), (1361071896, 0.6620473500213941, 2107752395), '0.12075810185185182') We are sending mail with results at report@fotonower.com args[1361071794] : ((1361071794, -5.65429937783028, 492609224), (1361071794, 0.4033981408606057, 2107752395), '0.12075810185185182') We are sending mail with results at report@fotonower.com refus_total : 0.12075810185185182 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23339075 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23339075_26-05-2025_15_29_17.pdf results_Auto_P23339075_26-05-2025_15_29_17.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23339075_26-05-2025_15_29_17.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23339075','results_Auto_P23339075_26-05-2025_15_29_17.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23339075_26-05-2025_15_29_17.pdf','pdf','','0.99','0.12075810185185182') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23339075

https://www.fotonower.com/image?json=false&list_photos_id=1361072275
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361072116
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361072081
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361072043
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361071977
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361071943
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361071924
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361071917
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361071907
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361071905
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361071902
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361071896
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361071794
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 12.08%
Veuillez trouver les photos des contaminants.

exemples de contaminants: metal: https://www.fotonower.com/view/23340194?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/23340195?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23340197?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23340199?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23340200?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23340202?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23339075_26-05-2025_15_29_17.pdf.

Lien vers velours :https://www.fotonower.com/velours/23340194,23340195,23340196,23340197,23340198,23340199,23340200,23340201,23340202,23340203,23340204?tags=metal,pet_fonce,background,pet_clair,pehd,papier,autre,flou,carton,mal_croppe,environnement.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 26 May 2025 13:29:28 GMT Content-Length: 0 Connection: close X-Message-Id: _ik-6z7yQliCDXMjfRVpJw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1361072275, 1361072116, 1361072081, 1361072043, 1361071977, 1361071943, 1361071924, 1361071917, 1361071907, 1361071905, 1361071902, 1361071896, 1361071794] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361072275', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361072116', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361072081', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361072043', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071977', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071943', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071924', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071917', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071907', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071905', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071902', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071896', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071794', None, None, None, None, None, '2954440') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.014084100723266602 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.828563690185547 time spend to save output : 0.014464855194091797 total time spend for step 9 : 10.843028545379639 step10:split_time_score Mon May 26 15:29:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('13', 13),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 26052025 23339075 Nombre de photos uploadées : 13 / 23040 (0%) 26052025 23339075 Nombre de photos taguées (types de déchets): 0 / 13 (0%) 26052025 23339075 Nombre de photos taguées (volume) : 0 / 13 (0%) elapsed_time : load_data_split_time_score 3.0994415283203125e-06 elapsed_time : order_list_meta_photo_and_scores 8.58306884765625e-06 ????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0006566047668457031 elapsed_time : insert_dashboard_record_day_entry 0.021976470947265625 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.10631123107156629 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23331064_26-05-2025_13_10_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23331064 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23331064 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23331066 order by id desc limit 1 Qualite : 0.09622099389524323 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23331105_26-05-2025_15_13_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23331105 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23331105 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23328666 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23328671 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339058 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339060 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339062 order by id desc limit 1 Qualite : 0.12075810185185182 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23339075_26-05-2025_15_29_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339075 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23339075 AND mptpi.`type`=3594 To do Qualite : 0.11833079346707819 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23339078_26-05-2025_15_20_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339078 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23339078 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339082 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23339099 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'26052025': {'nb_upload': 13, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1361072275, 1361072116, 1361072081, 1361072043, 1361071977, 1361071943, 1361071924, 1361071917, 1361071907, 1361071905, 1361071902, 1361071896, 1361071794] Looping around the photos to save general results len do output : 1 /23339075Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361072275', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361072116', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361072081', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361072043', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071977', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071943', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071924', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071917', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071907', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071905', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071902', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071896', None, None, None, None, None, '2954440') ('3318', None, None, None, None, None, None, None, '2954440') ('3318', '23339075', '1361071794', None, None, None, None, None, '2954440') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.014976978302001953 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.295237064361572 time spend to save output : 0.015292882919311523 total time spend for step 10 : 7.310529947280884 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 13 set_done_treatment 218.81user 241.88system 9:10.65elapsed 83%CPU (0avgtext+0avgdata 6573728maxresident)k 779280inputs+212200outputs (11865major+21314724minor)pagefaults 0swaps