python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 4025710 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2953284'] with mtr_portfolio_ids : ['23332501'] and first list_photo_ids : [] new path : /proc/4025710/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 1.702730417251587 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon May 26 14:30:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 7218 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-26 14:30:34.653388: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-26 14:30:34.679192: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-26 14:30:34.681345: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f5874000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-26 14:30:34.681413: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-26 14:30:34.685602: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-26 14:30:34.804409: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x13eed640 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-26 14:30:34.804480: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-26 14:30:34.805921: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 14:30:34.806401: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 14:30:34.810124: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 14:30:34.813269: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 14:30:34.813865: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 14:30:34.817051: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 14:30:34.818431: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 14:30:34.824190: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 14:30:34.825465: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 14:30:34.825547: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 14:30:34.826219: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-26 14:30:34.826236: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-26 14:30:34.826245: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-26 14:30:34.827401: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6642 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-26 14:30:35.128769: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 14:30:35.128883: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 14:30:35.128912: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 14:30:35.128937: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 14:30:35.128962: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 14:30:35.128986: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 14:30:35.129009: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 14:30:35.129034: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 14:30:35.130836: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 14:30:35.132506: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 14:30:35.132578: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 14:30:35.132605: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 14:30:35.132629: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 14:30:35.132653: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 14:30:35.132677: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 14:30:35.132701: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 14:30:35.132725: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 14:30:35.134539: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 14:30:35.134585: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-26 14:30:35.134601: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-26 14:30:35.134615: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-26 14:30:35.136452: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6642 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-26 14:30:44.991507: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 14:30:45.254164: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 44 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 13.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 22 Detection mask done ! Trying to reset tf kernel 4026378 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 417 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5706 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0007166862487792969 nb_pixel_total : 17615 time to create 1 rle with old method : 0.028660297393798828 length of segment : 166 time for calcul the mask position with numpy : 0.0018045902252197266 nb_pixel_total : 41459 time to create 1 rle with old method : 0.0659787654876709 length of segment : 273 time for calcul the mask position with numpy : 0.00047397613525390625 nb_pixel_total : 14497 time to create 1 rle with old method : 0.02586650848388672 length of segment : 111 time for calcul the mask position with numpy : 0.00034880638122558594 nb_pixel_total : 8461 time to create 1 rle with old method : 0.011136293411254883 length of segment : 119 time for calcul the mask position with numpy : 0.000640869140625 nb_pixel_total : 32356 time to create 1 rle with old method : 0.03900790214538574 length of segment : 166 time for calcul the mask position with numpy : 0.0005657672882080078 nb_pixel_total : 25448 time to create 1 rle with old method : 0.029651641845703125 length of segment : 199 time for calcul the mask position with numpy : 0.0003955364227294922 nb_pixel_total : 19425 time to create 1 rle with old method : 0.022357702255249023 length of segment : 214 time for calcul the mask position with numpy : 0.0010094642639160156 nb_pixel_total : 51675 time to create 1 rle with old method : 0.059710025787353516 length of segment : 391 time for calcul the mask position with numpy : 0.0011639595031738281 nb_pixel_total : 52926 time to create 1 rle with old method : 0.06055808067321777 length of segment : 460 time for calcul the mask position with numpy : 0.0004353523254394531 nb_pixel_total : 21496 time to create 1 rle with old method : 0.02496194839477539 length of segment : 261 time for calcul the mask position with numpy : 0.045980215072631836 nb_pixel_total : 789170 time to create 1 rle with new method : 0.25649523735046387 length of segment : 1683 time for calcul the mask position with numpy : 0.0017163753509521484 nb_pixel_total : 48185 time to create 1 rle with old method : 0.06747007369995117 length of segment : 301 time for calcul the mask position with numpy : 0.0010221004486083984 nb_pixel_total : 34659 time to create 1 rle with old method : 0.04316997528076172 length of segment : 274 time for calcul the mask position with numpy : 0.0003418922424316406 nb_pixel_total : 16128 time to create 1 rle with old method : 0.019266843795776367 length of segment : 191 time for calcul the mask position with numpy : 0.00025963783264160156 nb_pixel_total : 9779 time to create 1 rle with old method : 0.0166015625 length of segment : 117 time for calcul the mask position with numpy : 0.0005881786346435547 nb_pixel_total : 28504 time to create 1 rle with old method : 0.0325312614440918 length of segment : 230 time for calcul the mask position with numpy : 0.0011429786682128906 nb_pixel_total : 44540 time to create 1 rle with old method : 0.055823326110839844 length of segment : 304 time for calcul the mask position with numpy : 0.0017485618591308594 nb_pixel_total : 78375 time to create 1 rle with old method : 0.09647941589355469 length of segment : 396 time for calcul the mask position with numpy : 0.0004584789276123047 nb_pixel_total : 20242 time to create 1 rle with old method : 0.027820110321044922 length of segment : 131 time for calcul the mask position with numpy : 0.0003898143768310547 nb_pixel_total : 22641 time to create 1 rle with old method : 0.02649855613708496 length of segment : 121 time for calcul the mask position with numpy : 0.0005998611450195312 nb_pixel_total : 42580 time to create 1 rle with old method : 0.04887247085571289 length of segment : 255 time for calcul the mask position with numpy : 0.0003895759582519531 nb_pixel_total : 23282 time to create 1 rle with old method : 0.02978801727294922 length of segment : 358 time for calcul the mask position with numpy : 0.001528024673461914 nb_pixel_total : 94598 time to create 1 rle with old method : 0.1148076057434082 length of segment : 352 time for calcul the mask position with numpy : 0.0015974044799804688 nb_pixel_total : 21691 time to create 1 rle with old method : 0.024561166763305664 length of segment : 189 time for calcul the mask position with numpy : 0.0014162063598632812 nb_pixel_total : 30908 time to create 1 rle with old method : 0.03564023971557617 length of segment : 378 time for calcul the mask position with numpy : 0.0006413459777832031 nb_pixel_total : 17366 time to create 1 rle with old method : 0.028909683227539062 length of segment : 298 time for calcul the mask position with numpy : 0.0007147789001464844 nb_pixel_total : 16497 time to create 1 rle with old method : 0.019237279891967773 length of segment : 119 time for calcul the mask position with numpy : 0.002404928207397461 nb_pixel_total : 63600 time to create 1 rle with old method : 0.0721437931060791 length of segment : 334 time for calcul the mask position with numpy : 0.0007855892181396484 nb_pixel_total : 17310 time to create 1 rle with old method : 0.02033090591430664 length of segment : 167 time for calcul the mask position with numpy : 0.001886606216430664 nb_pixel_total : 42199 time to create 1 rle with old method : 0.05144834518432617 length of segment : 313 time for calcul the mask position with numpy : 0.0014104843139648438 nb_pixel_total : 31613 time to create 1 rle with old method : 0.04116678237915039 length of segment : 192 time for calcul the mask position with numpy : 0.0003337860107421875 nb_pixel_total : 8076 time to create 1 rle with old method : 0.009523630142211914 length of segment : 117 time for calcul the mask position with numpy : 0.0008292198181152344 nb_pixel_total : 18110 time to create 1 rle with old method : 0.020962953567504883 length of segment : 213 time for calcul the mask position with numpy : 0.0009014606475830078 nb_pixel_total : 19140 time to create 1 rle with old method : 0.023395061492919922 length of segment : 226 time for calcul the mask position with numpy : 0.009973764419555664 nb_pixel_total : 287952 time to create 1 rle with new method : 0.01711559295654297 length of segment : 710 time for calcul the mask position with numpy : 0.0012547969818115234 nb_pixel_total : 53993 time to create 1 rle with old method : 0.061810970306396484 length of segment : 201 time for calcul the mask position with numpy : 0.0009937286376953125 nb_pixel_total : 24710 time to create 1 rle with old method : 0.030974626541137695 length of segment : 222 time for calcul the mask position with numpy : 0.0008807182312011719 nb_pixel_total : 20201 time to create 1 rle with old method : 0.023380517959594727 length of segment : 189 time for calcul the mask position with numpy : 0.0021059513092041016 nb_pixel_total : 82801 time to create 1 rle with old method : 0.0950937271118164 length of segment : 383 time for calcul the mask position with numpy : 0.005352020263671875 nb_pixel_total : 175066 time to create 1 rle with new method : 0.010065317153930664 length of segment : 440 time for calcul the mask position with numpy : 0.001979351043701172 nb_pixel_total : 76696 time to create 1 rle with old method : 0.08768343925476074 length of segment : 284 time for calcul the mask position with numpy : 0.0012412071228027344 nb_pixel_total : 42932 time to create 1 rle with old method : 0.04936385154724121 length of segment : 244 time for calcul the mask position with numpy : 0.0013077259063720703 nb_pixel_total : 86954 time to create 1 rle with old method : 0.10347986221313477 length of segment : 226 time for calcul the mask position with numpy : 0.0010085105895996094 nb_pixel_total : 32311 time to create 1 rle with old method : 0.037314653396606445 length of segment : 190 time for calcul the mask position with numpy : 0.00459742546081543 nb_pixel_total : 166732 time to create 1 rle with new method : 0.006590843200683594 length of segment : 730 time for calcul the mask position with numpy : 0.000980377197265625 nb_pixel_total : 31193 time to create 1 rle with old method : 0.03517580032348633 length of segment : 228 time for calcul the mask position with numpy : 0.0011205673217773438 nb_pixel_total : 31632 time to create 1 rle with old method : 0.04474377632141113 length of segment : 175 time for calcul the mask position with numpy : 0.0019712448120117188 nb_pixel_total : 65856 time to create 1 rle with old method : 0.07671642303466797 length of segment : 249 time for calcul the mask position with numpy : 0.002671957015991211 nb_pixel_total : 64026 time to create 1 rle with old method : 0.10036611557006836 length of segment : 367 time for calcul the mask position with numpy : 0.0039577484130859375 nb_pixel_total : 115496 time to create 1 rle with old method : 0.1339735984802246 length of segment : 505 time for calcul the mask position with numpy : 0.0011706352233886719 nb_pixel_total : 19187 time to create 1 rle with old method : 0.023287296295166016 length of segment : 228 time for calcul the mask position with numpy : 0.001378774642944336 nb_pixel_total : 36214 time to create 1 rle with old method : 0.042630910873413086 length of segment : 205 time for calcul the mask position with numpy : 0.001190185546875 nb_pixel_total : 28585 time to create 1 rle with old method : 0.03497171401977539 length of segment : 204 time for calcul the mask position with numpy : 0.0025260448455810547 nb_pixel_total : 58011 time to create 1 rle with old method : 0.068389892578125 length of segment : 278 time for calcul the mask position with numpy : 0.0007772445678710938 nb_pixel_total : 8706 time to create 1 rle with old method : 0.010304927825927734 length of segment : 161 time for calcul the mask position with numpy : 0.0016927719116210938 nb_pixel_total : 34021 time to create 1 rle with old method : 0.06916284561157227 length of segment : 216 time for calcul the mask position with numpy : 0.0010721683502197266 nb_pixel_total : 8603 time to create 1 rle with old method : 0.0101776123046875 length of segment : 251 time for calcul the mask position with numpy : 0.0007460117340087891 nb_pixel_total : 14489 time to create 1 rle with old method : 0.016855716705322266 length of segment : 186 time for calcul the mask position with numpy : 0.0002532005310058594 nb_pixel_total : 5040 time to create 1 rle with old method : 0.006303548812866211 length of segment : 93 time for calcul the mask position with numpy : 0.00356292724609375 nb_pixel_total : 69666 time to create 1 rle with old method : 0.07857680320739746 length of segment : 821 time for calcul the mask position with numpy : 0.0009052753448486328 nb_pixel_total : 19151 time to create 1 rle with old method : 0.02366781234741211 length of segment : 127 time for calcul the mask position with numpy : 0.0032660961151123047 nb_pixel_total : 57029 time to create 1 rle with old method : 0.07004046440124512 length of segment : 264 time for calcul the mask position with numpy : 0.0010411739349365234 nb_pixel_total : 12562 time to create 1 rle with old method : 0.02074909210205078 length of segment : 162 time for calcul the mask position with numpy : 0.0006585121154785156 nb_pixel_total : 12169 time to create 1 rle with old method : 0.014432430267333984 length of segment : 107 time for calcul the mask position with numpy : 0.0008208751678466797 nb_pixel_total : 15698 time to create 1 rle with old method : 0.01828145980834961 length of segment : 143 time for calcul the mask position with numpy : 0.0009195804595947266 nb_pixel_total : 21545 time to create 1 rle with old method : 0.026746273040771484 length of segment : 127 time for calcul the mask position with numpy : 0.0029993057250976562 nb_pixel_total : 86091 time to create 1 rle with old method : 0.10108375549316406 length of segment : 347 time for calcul the mask position with numpy : 0.0011477470397949219 nb_pixel_total : 12464 time to create 1 rle with old method : 0.017257213592529297 length of segment : 122 time for calcul the mask position with numpy : 0.0003724098205566406 nb_pixel_total : 3962 time to create 1 rle with old method : 0.004765510559082031 length of segment : 69 time for calcul the mask position with numpy : 0.0017066001892089844 nb_pixel_total : 27955 time to create 1 rle with old method : 0.03264045715332031 length of segment : 191 time for calcul the mask position with numpy : 0.0008275508880615234 nb_pixel_total : 18109 time to create 1 rle with old method : 0.021190881729125977 length of segment : 151 time for calcul the mask position with numpy : 0.0010731220245361328 nb_pixel_total : 23120 time to create 1 rle with old method : 0.02673029899597168 length of segment : 206 time for calcul the mask position with numpy : 0.004051685333251953 nb_pixel_total : 92816 time to create 1 rle with old method : 0.10580086708068848 length of segment : 568 time for calcul the mask position with numpy : 0.00096893310546875 nb_pixel_total : 15767 time to create 1 rle with old method : 0.02172255516052246 length of segment : 160 time for calcul the mask position with numpy : 0.0011219978332519531 nb_pixel_total : 22070 time to create 1 rle with old method : 0.03602480888366699 length of segment : 159 time for calcul the mask position with numpy : 0.0019009113311767578 nb_pixel_total : 38995 time to create 1 rle with old method : 0.04569411277770996 length of segment : 219 time for calcul the mask position with numpy : 0.0005691051483154297 nb_pixel_total : 11075 time to create 1 rle with old method : 0.013056516647338867 length of segment : 87 time for calcul the mask position with numpy : 0.0017457008361816406 nb_pixel_total : 34284 time to create 1 rle with old method : 0.041457176208496094 length of segment : 200 time for calcul the mask position with numpy : 0.0014929771423339844 nb_pixel_total : 27019 time to create 1 rle with old method : 0.031024456024169922 length of segment : 210 time for calcul the mask position with numpy : 0.0007755756378173828 nb_pixel_total : 11937 time to create 1 rle with old method : 0.014020919799804688 length of segment : 143 time for calcul the mask position with numpy : 0.0039272308349609375 nb_pixel_total : 68418 time to create 1 rle with old method : 0.07995033264160156 length of segment : 344 time for calcul the mask position with numpy : 0.00036215782165527344 nb_pixel_total : 4637 time to create 1 rle with old method : 0.005503177642822266 length of segment : 92 time for calcul the mask position with numpy : 0.0022487640380859375 nb_pixel_total : 45905 time to create 1 rle with old method : 0.05480813980102539 length of segment : 358 time for calcul the mask position with numpy : 0.0012238025665283203 nb_pixel_total : 23684 time to create 1 rle with old method : 0.02774834632873535 length of segment : 160 time for calcul the mask position with numpy : 0.0008914470672607422 nb_pixel_total : 18092 time to create 1 rle with old method : 0.021291255950927734 length of segment : 135 time for calcul the mask position with numpy : 0.0026426315307617188 nb_pixel_total : 58519 time to create 1 rle with old method : 0.06800103187561035 length of segment : 310 time for calcul the mask position with numpy : 0.00142669677734375 nb_pixel_total : 33156 time to create 1 rle with old method : 0.038392066955566406 length of segment : 188 time for calcul the mask position with numpy : 0.0005087852478027344 nb_pixel_total : 9189 time to create 1 rle with old method : 0.011202812194824219 length of segment : 95 time for calcul the mask position with numpy : 0.0010731220245361328 nb_pixel_total : 23281 time to create 1 rle with old method : 0.027358293533325195 length of segment : 188 time for calcul the mask position with numpy : 0.00036716461181640625 nb_pixel_total : 5769 time to create 1 rle with old method : 0.007113456726074219 length of segment : 107 time for calcul the mask position with numpy : 0.0034792423248291016 nb_pixel_total : 72484 time to create 1 rle with old method : 0.082550048828125 length of segment : 327 time for calcul the mask position with numpy : 0.0016722679138183594 nb_pixel_total : 29512 time to create 1 rle with old method : 0.03381180763244629 length of segment : 270 time for calcul the mask position with numpy : 0.0005517005920410156 nb_pixel_total : 14319 time to create 1 rle with old method : 0.016809940338134766 length of segment : 144 time for calcul the mask position with numpy : 0.00025010108947753906 nb_pixel_total : 5168 time to create 1 rle with old method : 0.00628972053527832 length of segment : 83 time for calcul the mask position with numpy : 0.00165557861328125 nb_pixel_total : 49025 time to create 1 rle with old method : 0.056276798248291016 length of segment : 353 time for calcul the mask position with numpy : 0.0006861686706542969 nb_pixel_total : 19031 time to create 1 rle with old method : 0.02202773094177246 length of segment : 182 time for calcul the mask position with numpy : 0.0009424686431884766 nb_pixel_total : 19227 time to create 1 rle with old method : 0.025271177291870117 length of segment : 128 time for calcul the mask position with numpy : 0.0010495185852050781 nb_pixel_total : 26443 time to create 1 rle with old method : 0.03326249122619629 length of segment : 222 time for calcul the mask position with numpy : 0.0006546974182128906 nb_pixel_total : 10125 time to create 1 rle with old method : 0.012072324752807617 length of segment : 164 time for calcul the mask position with numpy : 0.0005266666412353516 nb_pixel_total : 9748 time to create 1 rle with old method : 0.01165628433227539 length of segment : 187 time for calcul the mask position with numpy : 0.004014492034912109 nb_pixel_total : 117537 time to create 1 rle with old method : 0.1348562240600586 length of segment : 487 time for calcul the mask position with numpy : 0.0009441375732421875 nb_pixel_total : 34033 time to create 1 rle with old method : 0.03912854194641113 length of segment : 281 time for calcul the mask position with numpy : 0.0038461685180664062 nb_pixel_total : 106849 time to create 1 rle with old method : 0.12540221214294434 length of segment : 595 time for calcul the mask position with numpy : 0.0036001205444335938 nb_pixel_total : 121636 time to create 1 rle with old method : 0.13555073738098145 length of segment : 502 time for calcul the mask position with numpy : 0.0008065700531005859 nb_pixel_total : 14874 time to create 1 rle with old method : 0.019425153732299805 length of segment : 242 time for calcul the mask position with numpy : 0.0007550716400146484 nb_pixel_total : 14476 time to create 1 rle with old method : 0.017284631729125977 length of segment : 177 time for calcul the mask position with numpy : 0.0019216537475585938 nb_pixel_total : 87216 time to create 1 rle with old method : 0.11633586883544922 length of segment : 402 time for calcul the mask position with numpy : 0.0009999275207519531 nb_pixel_total : 20340 time to create 1 rle with old method : 0.023650169372558594 length of segment : 136 time for calcul the mask position with numpy : 0.0029060840606689453 nb_pixel_total : 77437 time to create 1 rle with old method : 0.1008002758026123 length of segment : 288 time for calcul the mask position with numpy : 0.0018420219421386719 nb_pixel_total : 26200 time to create 1 rle with old method : 0.030317306518554688 length of segment : 317 time for calcul the mask position with numpy : 0.0038139820098876953 nb_pixel_total : 50055 time to create 1 rle with old method : 0.06003761291503906 length of segment : 406 time for calcul the mask position with numpy : 0.001608133316040039 nb_pixel_total : 26276 time to create 1 rle with old method : 0.03174948692321777 length of segment : 325 time for calcul the mask position with numpy : 0.0009236335754394531 nb_pixel_total : 14003 time to create 1 rle with old method : 0.016757726669311523 length of segment : 140 time for calcul the mask position with numpy : 0.002031087875366211 nb_pixel_total : 35768 time to create 1 rle with old method : 0.06440186500549316 length of segment : 169 time for calcul the mask position with numpy : 0.003962993621826172 nb_pixel_total : 91923 time to create 1 rle with old method : 0.11181783676147461 length of segment : 354 time for calcul the mask position with numpy : 0.0011675357818603516 nb_pixel_total : 20597 time to create 1 rle with old method : 0.025275707244873047 length of segment : 277 time for calcul the mask position with numpy : 0.00171661376953125 nb_pixel_total : 29228 time to create 1 rle with old method : 0.035624027252197266 length of segment : 182 time for calcul the mask position with numpy : 0.0008590221405029297 nb_pixel_total : 13182 time to create 1 rle with old method : 0.015474557876586914 length of segment : 153 time for calcul the mask position with numpy : 0.0014739036560058594 nb_pixel_total : 14998 time to create 1 rle with old method : 0.017405986785888672 length of segment : 212 time for calcul the mask position with numpy : 0.003899097442626953 nb_pixel_total : 80966 time to create 1 rle with old method : 0.10305166244506836 length of segment : 307 time for calcul the mask position with numpy : 0.0007920265197753906 nb_pixel_total : 12843 time to create 1 rle with old method : 0.021259784698486328 length of segment : 148 time for calcul the mask position with numpy : 0.0010097026824951172 nb_pixel_total : 13486 time to create 1 rle with old method : 0.022367477416992188 length of segment : 222 time for calcul the mask position with numpy : 0.0035059452056884766 nb_pixel_total : 78272 time to create 1 rle with old method : 0.09234881401062012 length of segment : 331 time for calcul the mask position with numpy : 0.0010759830474853516 nb_pixel_total : 18143 time to create 1 rle with old method : 0.024571657180786133 length of segment : 193 time for calcul the mask position with numpy : 0.0008776187896728516 nb_pixel_total : 11353 time to create 1 rle with old method : 0.014581680297851562 length of segment : 178 time for calcul the mask position with numpy : 0.00133514404296875 nb_pixel_total : 32693 time to create 1 rle with old method : 0.049297332763671875 length of segment : 210 time for calcul the mask position with numpy : 0.0026350021362304688 nb_pixel_total : 30613 time to create 1 rle with old method : 0.04433250427246094 length of segment : 399 time for calcul the mask position with numpy : 0.0022029876708984375 nb_pixel_total : 48262 time to create 1 rle with old method : 0.05448579788208008 length of segment : 446 time for calcul the mask position with numpy : 0.0026099681854248047 nb_pixel_total : 43438 time to create 1 rle with old method : 0.05244612693786621 length of segment : 304 time for calcul the mask position with numpy : 0.00115203857421875 nb_pixel_total : 20022 time to create 1 rle with old method : 0.024751901626586914 length of segment : 125 time for calcul the mask position with numpy : 0.001478433609008789 nb_pixel_total : 24964 time to create 1 rle with old method : 0.03130459785461426 length of segment : 175 time for calcul the mask position with numpy : 0.0013914108276367188 nb_pixel_total : 30780 time to create 1 rle with old method : 0.03509688377380371 length of segment : 405 time for calcul the mask position with numpy : 0.0005931854248046875 nb_pixel_total : 8772 time to create 1 rle with old method : 0.01033926010131836 length of segment : 111 time for calcul the mask position with numpy : 0.0011856555938720703 nb_pixel_total : 18511 time to create 1 rle with old method : 0.021745681762695312 length of segment : 203 time for calcul the mask position with numpy : 0.00165557861328125 nb_pixel_total : 57568 time to create 1 rle with old method : 0.06900668144226074 length of segment : 530 time for calcul the mask position with numpy : 0.001245260238647461 nb_pixel_total : 32796 time to create 1 rle with old method : 0.03726339340209961 length of segment : 219 time for calcul the mask position with numpy : 0.00029540061950683594 nb_pixel_total : 5451 time to create 1 rle with old method : 0.0066471099853515625 length of segment : 66 time for calcul the mask position with numpy : 0.0017991065979003906 nb_pixel_total : 37385 time to create 1 rle with old method : 0.04652571678161621 length of segment : 274 time for calcul the mask position with numpy : 0.001245737075805664 nb_pixel_total : 37198 time to create 1 rle with old method : 0.043363094329833984 length of segment : 213 time for calcul the mask position with numpy : 0.0013060569763183594 nb_pixel_total : 36176 time to create 1 rle with old method : 0.04612898826599121 length of segment : 311 time for calcul the mask position with numpy : 0.0008790493011474609 nb_pixel_total : 20429 time to create 1 rle with old method : 0.024547338485717773 length of segment : 201 time for calcul the mask position with numpy : 0.008066654205322266 nb_pixel_total : 276856 time to create 1 rle with new method : 0.01355886459350586 length of segment : 517 time for calcul the mask position with numpy : 0.0003685951232910156 nb_pixel_total : 6759 time to create 1 rle with old method : 0.008199214935302734 length of segment : 90 time for calcul the mask position with numpy : 0.0008687973022460938 nb_pixel_total : 20791 time to create 1 rle with old method : 0.0336761474609375 length of segment : 228 time for calcul the mask position with numpy : 0.0006856918334960938 nb_pixel_total : 22209 time to create 1 rle with old method : 0.031646728515625 length of segment : 150 time for calcul the mask position with numpy : 0.0003733634948730469 nb_pixel_total : 8289 time to create 1 rle with old method : 0.009724855422973633 length of segment : 99 time for calcul the mask position with numpy : 0.0008399486541748047 nb_pixel_total : 18305 time to create 1 rle with old method : 0.021526098251342773 length of segment : 235 time spent for convertir_results : 12.474833726882935 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 147 chid ids of type : 3594 Number RLEs to save : 37939 save missing photos in datou_result : time spend for datou_step_exec : 79.524005651474 time spend to save output : 2.325221061706543 total time spend for step 1 : 81.84922671318054 step2:crop_condition Mon May 26 14:31:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 147 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 89 About to insert : list_path_to_insert length 89 new photo from crops ! About to upload 89 photos upload in portfolio : 3736932 init cache_photo without model_param we have 89 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748262734_4025710 we have uploaded 89 photos in the portfolio 3736932 time of upload the photos Elapsed time : 30.128414392471313 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 3736932 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748262768_4025710 we have uploaded 21 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.979215383529663 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748262774_4025710 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8569211959838867 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 33 About to insert : list_path_to_insert length 33 new photo from crops ! About to upload 33 photos upload in portfolio : 3736932 init cache_photo without model_param we have 33 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748262788_4025710 we have uploaded 33 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.47456979751587 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748262800_4025710 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6437900066375732 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748262802_4025710 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7762835025787354 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1360848286, 1360848281, 1360848276, 1360848269, 1360848266, 1360848262, 1360848258, 1360848234, 1360848230, 1360848225] Looping around the photos to save general results len do output : 147 /1361078759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361078930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848286', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848281', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848276', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848269', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848266', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848262', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848258', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848234', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848230', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848225', None, None, None, None, None, '2953284') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 451 time used for this insertion : 0.03047943115234375 save_final save missing photos in datou_result : time spend for datou_step_exec : 88.84610486030579 time spend to save output : 0.03508186340332031 total time spend for step 2 : 88.8811867237091 step3:rle_unique_nms_with_priority Mon May 26 14:33:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 147 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 15 nb_hashtags : 2 time to prepare the origin masks : 5.936414003372192 time for calcul the mask position with numpy : 0.36353349685668945 nb_pixel_total : 5868261 time to create 1 rle with new method : 0.9928858280181885 time for calcul the mask position with numpy : 0.0416865348815918 nb_pixel_total : 9779 time to create 1 rle with old method : 0.016022205352783203 time for calcul the mask position with numpy : 0.024068832397460938 nb_pixel_total : 16128 time to create 1 rle with old method : 0.022370100021362305 time for calcul the mask position with numpy : 0.023265361785888672 nb_pixel_total : 34659 time to create 1 rle with old method : 0.039617300033569336 time for calcul the mask position with numpy : 0.02538609504699707 nb_pixel_total : 48185 time to create 1 rle with old method : 0.05382084846496582 time for calcul the mask position with numpy : 0.029079437255859375 nb_pixel_total : 789170 time to create 1 rle with new method : 0.5429708957672119 time for calcul the mask position with numpy : 0.022412538528442383 nb_pixel_total : 21496 time to create 1 rle with old method : 0.024193525314331055 time for calcul the mask position with numpy : 0.022196531295776367 nb_pixel_total : 51626 time to create 1 rle with old method : 0.0579833984375 time for calcul the mask position with numpy : 0.021517515182495117 nb_pixel_total : 51675 time to create 1 rle with old method : 0.05817413330078125 time for calcul the mask position with numpy : 0.0241396427154541 nb_pixel_total : 19425 time to create 1 rle with old method : 0.021860361099243164 time for calcul the mask position with numpy : 0.022098064422607422 nb_pixel_total : 25448 time to create 1 rle with old method : 0.028810739517211914 time for calcul the mask position with numpy : 0.021451950073242188 nb_pixel_total : 32356 time to create 1 rle with old method : 0.037447214126586914 time for calcul the mask position with numpy : 0.022416353225708008 nb_pixel_total : 8461 time to create 1 rle with old method : 0.009453058242797852 time for calcul the mask position with numpy : 0.02189326286315918 nb_pixel_total : 14497 time to create 1 rle with old method : 0.016260147094726562 time for calcul the mask position with numpy : 0.021335124969482422 nb_pixel_total : 41459 time to create 1 rle with old method : 0.048059701919555664 time for calcul the mask position with numpy : 0.021790266036987305 nb_pixel_total : 17615 time to create 1 rle with old method : 0.019705533981323242 create new chi : 2.803840160369873 time to delete rle : 0.017653465270996094 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 11918 TO DO : save crop sub photo not yet done ! save time : 0.7221159934997559 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 4.1426122188568115 time for calcul the mask position with numpy : 0.5271050930023193 nb_pixel_total : 6673787 time to create 1 rle with new method : 0.7482690811157227 time for calcul the mask position with numpy : 0.02359938621520996 nb_pixel_total : 21691 time to create 1 rle with old method : 0.024692773818969727 time for calcul the mask position with numpy : 0.023061275482177734 nb_pixel_total : 94598 time to create 1 rle with old method : 0.10604023933410645 time for calcul the mask position with numpy : 0.02330470085144043 nb_pixel_total : 23282 time to create 1 rle with old method : 0.026174068450927734 time for calcul the mask position with numpy : 0.024545907974243164 nb_pixel_total : 42580 time to create 1 rle with old method : 0.04782247543334961 time for calcul the mask position with numpy : 0.024472713470458984 nb_pixel_total : 22641 time to create 1 rle with old method : 0.02558612823486328 time for calcul the mask position with numpy : 0.021445035934448242 nb_pixel_total : 20242 time to create 1 rle with old method : 0.022831439971923828 time for calcul the mask position with numpy : 0.022142410278320312 nb_pixel_total : 78375 time to create 1 rle with old method : 0.08782410621643066 time for calcul the mask position with numpy : 0.041181087493896484 nb_pixel_total : 44540 time to create 1 rle with old method : 0.06598639488220215 time for calcul the mask position with numpy : 0.03696179389953613 nb_pixel_total : 28504 time to create 1 rle with old method : 0.03370523452758789 create new chi : 2.0072245597839355 time to delete rle : 0.0012695789337158203 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++++Number RLEs to save : 6832 TO DO : save crop sub photo not yet done ! save time : 0.45083069801330566 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 4.324331045150757 time for calcul the mask position with numpy : 0.5923330783843994 nb_pixel_total : 6804561 time to create 1 rle with new method : 0.6326313018798828 time for calcul the mask position with numpy : 0.04053473472595215 nb_pixel_total : 18110 time to create 1 rle with old method : 0.0224459171295166 time for calcul the mask position with numpy : 0.03910350799560547 nb_pixel_total : 8076 time to create 1 rle with old method : 0.009144783020019531 time for calcul the mask position with numpy : 0.03642559051513672 nb_pixel_total : 31613 time to create 1 rle with old method : 0.03708791732788086 time for calcul the mask position with numpy : 0.038460731506347656 nb_pixel_total : 42199 time to create 1 rle with old method : 0.054353952407836914 time for calcul the mask position with numpy : 0.03501248359680176 nb_pixel_total : 17310 time to create 1 rle with old method : 0.0251617431640625 time for calcul the mask position with numpy : 0.024170398712158203 nb_pixel_total : 63600 time to create 1 rle with old method : 0.0719139575958252 time for calcul the mask position with numpy : 0.02203369140625 nb_pixel_total : 16497 time to create 1 rle with old method : 0.019050121307373047 time for calcul the mask position with numpy : 0.022753238677978516 nb_pixel_total : 17366 time to create 1 rle with old method : 0.021956205368041992 time for calcul the mask position with numpy : 0.025995492935180664 nb_pixel_total : 30908 time to create 1 rle with old method : 0.03584766387939453 create new chi : 1.8504793643951416 time to delete rle : 0.0016543865203857422 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 6422 TO DO : save crop sub photo not yet done ! save time : 0.40778350830078125 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 4.2638840675354 time for calcul the mask position with numpy : 0.42171764373779297 nb_pixel_total : 5962265 time to create 1 rle with new method : 0.6285045146942139 time for calcul the mask position with numpy : 0.021669864654541016 nb_pixel_total : 31193 time to create 1 rle with old method : 0.035156965255737305 time for calcul the mask position with numpy : 0.022866249084472656 nb_pixel_total : 166732 time to create 1 rle with new method : 0.6885435581207275 time for calcul the mask position with numpy : 0.022103548049926758 nb_pixel_total : 32311 time to create 1 rle with old method : 0.03606247901916504 time for calcul the mask position with numpy : 0.023309707641601562 nb_pixel_total : 74248 time to create 1 rle with old method : 0.0842733383178711 time for calcul the mask position with numpy : 0.023383140563964844 nb_pixel_total : 42932 time to create 1 rle with old method : 0.04818439483642578 time for calcul the mask position with numpy : 0.021960735321044922 nb_pixel_total : 76696 time to create 1 rle with old method : 0.08592438697814941 time for calcul the mask position with numpy : 0.024992704391479492 nb_pixel_total : 175066 time to create 1 rle with new method : 0.5817275047302246 time for calcul the mask position with numpy : 0.021099328994750977 nb_pixel_total : 82801 time to create 1 rle with old method : 0.09166669845581055 time for calcul the mask position with numpy : 0.040296316146850586 nb_pixel_total : 20201 time to create 1 rle with old method : 0.023438692092895508 time for calcul the mask position with numpy : 0.03582262992858887 nb_pixel_total : 24710 time to create 1 rle with old method : 0.027794837951660156 time for calcul the mask position with numpy : 0.034105539321899414 nb_pixel_total : 53993 time to create 1 rle with old method : 0.061548471450805664 time for calcul the mask position with numpy : 0.036744117736816406 nb_pixel_total : 287952 time to create 1 rle with new method : 0.5580620765686035 time for calcul the mask position with numpy : 0.0248258113861084 nb_pixel_total : 19140 time to create 1 rle with old method : 0.02310800552368164 create new chi : 3.8684256076812744 time to delete rle : 0.0024199485778808594 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++++++++++++Number RLEs to save : 10566 TO DO : save crop sub photo not yet done ! save time : 0.6680855751037598 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 5.273030757904053 time for calcul the mask position with numpy : 1.030721664428711 nb_pixel_total : 6471640 time to create 1 rle with new method : 0.5298175811767578 time for calcul the mask position with numpy : 0.022307634353637695 nb_pixel_total : 19151 time to create 1 rle with old method : 0.021466493606567383 time for calcul the mask position with numpy : 0.024369478225708008 nb_pixel_total : 69666 time to create 1 rle with old method : 0.08003568649291992 time for calcul the mask position with numpy : 0.02415752410888672 nb_pixel_total : 4957 time to create 1 rle with old method : 0.005649566650390625 time for calcul the mask position with numpy : 0.022629499435424805 nb_pixel_total : 14489 time to create 1 rle with old method : 0.016300678253173828 time for calcul the mask position with numpy : 0.022286653518676758 nb_pixel_total : 8603 time to create 1 rle with old method : 0.014256477355957031 time for calcul the mask position with numpy : 0.025267601013183594 nb_pixel_total : 34021 time to create 1 rle with old method : 0.0514376163482666 time for calcul the mask position with numpy : 0.02130889892578125 nb_pixel_total : 8706 time to create 1 rle with old method : 0.010054349899291992 time for calcul the mask position with numpy : 0.02211594581604004 nb_pixel_total : 58011 time to create 1 rle with old method : 0.07105493545532227 time for calcul the mask position with numpy : 0.024056434631347656 nb_pixel_total : 28585 time to create 1 rle with old method : 0.03204679489135742 time for calcul the mask position with numpy : 0.021687984466552734 nb_pixel_total : 36214 time to create 1 rle with old method : 0.04079174995422363 time for calcul the mask position with numpy : 0.03455758094787598 nb_pixel_total : 19187 time to create 1 rle with old method : 0.023551464080810547 time for calcul the mask position with numpy : 0.03676319122314453 nb_pixel_total : 115496 time to create 1 rle with old method : 0.1302051544189453 time for calcul the mask position with numpy : 0.035131216049194336 nb_pixel_total : 64026 time to create 1 rle with old method : 0.07141399383544922 time for calcul the mask position with numpy : 0.03504323959350586 nb_pixel_total : 65856 time to create 1 rle with old method : 0.08108305931091309 time for calcul the mask position with numpy : 0.0248565673828125 nb_pixel_total : 31632 time to create 1 rle with old method : 0.049837589263916016 create new chi : 2.6969783306121826 time to delete rle : 0.0017740726470947266 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 10292 TO DO : save crop sub photo not yet done ! save time : 0.6579017639160156 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 4.756345748901367 time for calcul the mask position with numpy : 0.3641774654388428 nb_pixel_total : 6666724 time to create 1 rle with new method : 0.38330936431884766 time for calcul the mask position with numpy : 0.034464120864868164 nb_pixel_total : 92816 time to create 1 rle with old method : 0.10600471496582031 time for calcul the mask position with numpy : 0.023478984832763672 nb_pixel_total : 23120 time to create 1 rle with old method : 0.0269925594329834 time for calcul the mask position with numpy : 0.02449941635131836 nb_pixel_total : 18109 time to create 1 rle with old method : 0.020757436752319336 time for calcul the mask position with numpy : 0.034813642501831055 nb_pixel_total : 27955 time to create 1 rle with old method : 0.04201197624206543 time for calcul the mask position with numpy : 0.024064302444458008 nb_pixel_total : 3962 time to create 1 rle with old method : 0.00452876091003418 time for calcul the mask position with numpy : 0.025246620178222656 nb_pixel_total : 12464 time to create 1 rle with old method : 0.01432347297668457 time for calcul the mask position with numpy : 0.02575206756591797 nb_pixel_total : 86087 time to create 1 rle with old method : 0.09889507293701172 time for calcul the mask position with numpy : 0.03548002243041992 nb_pixel_total : 21545 time to create 1 rle with old method : 0.025732994079589844 time for calcul the mask position with numpy : 0.038303375244140625 nb_pixel_total : 15698 time to create 1 rle with old method : 0.01849198341369629 time for calcul the mask position with numpy : 0.03589177131652832 nb_pixel_total : 12169 time to create 1 rle with old method : 0.014747858047485352 time for calcul the mask position with numpy : 0.035399675369262695 nb_pixel_total : 12562 time to create 1 rle with old method : 0.014143705368041992 time for calcul the mask position with numpy : 0.03608083724975586 nb_pixel_total : 57029 time to create 1 rle with old method : 0.06832051277160645 create new chi : 1.6169354915618896 time to delete rle : 0.0015037059783935547 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 7072 TO DO : save crop sub photo not yet done ! save time : 0.4778614044189453 nb_obj : 21 nb_hashtags : 4 time to prepare the origin masks : 7.770608425140381 time for calcul the mask position with numpy : 0.42883992195129395 nb_pixel_total : 6476960 time to create 1 rle with new method : 0.7171776294708252 time for calcul the mask position with numpy : 0.03944563865661621 nb_pixel_total : 5168 time to create 1 rle with old method : 0.008535146713256836 time for calcul the mask position with numpy : 0.039193153381347656 nb_pixel_total : 14319 time to create 1 rle with old method : 0.017049789428710938 time for calcul the mask position with numpy : 0.03674006462097168 nb_pixel_total : 29512 time to create 1 rle with old method : 0.032999277114868164 time for calcul the mask position with numpy : 0.036545515060424805 nb_pixel_total : 72484 time to create 1 rle with old method : 0.08379340171813965 time for calcul the mask position with numpy : 0.03796505928039551 nb_pixel_total : 5769 time to create 1 rle with old method : 0.0065310001373291016 time for calcul the mask position with numpy : 0.03760409355163574 nb_pixel_total : 23281 time to create 1 rle with old method : 0.02603888511657715 time for calcul the mask position with numpy : 0.03517460823059082 nb_pixel_total : 9189 time to create 1 rle with old method : 0.010339736938476562 time for calcul the mask position with numpy : 0.0355532169342041 nb_pixel_total : 33156 time to create 1 rle with old method : 0.03655505180358887 time for calcul the mask position with numpy : 0.023812294006347656 nb_pixel_total : 58519 time to create 1 rle with old method : 0.06575536727905273 time for calcul the mask position with numpy : 0.022183656692504883 nb_pixel_total : 18092 time to create 1 rle with old method : 0.020627737045288086 time for calcul the mask position with numpy : 0.02548503875732422 nb_pixel_total : 23684 time to create 1 rle with old method : 0.02663564682006836 time for calcul the mask position with numpy : 0.02238011360168457 nb_pixel_total : 45905 time to create 1 rle with old method : 0.05176591873168945 time for calcul the mask position with numpy : 0.02231574058532715 nb_pixel_total : 4637 time to create 1 rle with old method : 0.005319356918334961 time for calcul the mask position with numpy : 0.024775266647338867 nb_pixel_total : 68418 time to create 1 rle with old method : 0.10079836845397949 time for calcul the mask position with numpy : 0.023281574249267578 nb_pixel_total : 11937 time to create 1 rle with old method : 0.01340484619140625 time for calcul the mask position with numpy : 0.02231001853942871 nb_pixel_total : 27019 time to create 1 rle with old method : 0.03041839599609375 time for calcul the mask position with numpy : 0.022641897201538086 nb_pixel_total : 34284 time to create 1 rle with old method : 0.04247117042541504 time for calcul the mask position with numpy : 0.02579331398010254 nb_pixel_total : 11075 time to create 1 rle with old method : 0.014753103256225586 time for calcul the mask position with numpy : 0.02686476707458496 nb_pixel_total : 38995 time to create 1 rle with old method : 0.04763507843017578 time for calcul the mask position with numpy : 0.022502422332763672 nb_pixel_total : 22070 time to create 1 rle with old method : 0.0248563289642334 time for calcul the mask position with numpy : 0.022960901260375977 nb_pixel_total : 15767 time to create 1 rle with old method : 0.017651796340942383 create new chi : 2.5890085697174072 time to delete rle : 0.0025734901428222656 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 10118 TO DO : save crop sub photo not yet done ! save time : 0.6457901000976562 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 6.6343584060668945 time for calcul the mask position with numpy : 0.591285228729248 nb_pixel_total : 6420020 time to create 1 rle with new method : 0.9423568248748779 time for calcul the mask position with numpy : 0.03908085823059082 nb_pixel_total : 87216 time to create 1 rle with old method : 0.09791088104248047 time for calcul the mask position with numpy : 0.040350914001464844 nb_pixel_total : 14476 time to create 1 rle with old method : 0.01870870590209961 time for calcul the mask position with numpy : 0.0359954833984375 nb_pixel_total : 14874 time to create 1 rle with old method : 0.01686716079711914 time for calcul the mask position with numpy : 0.0420377254486084 nb_pixel_total : 121636 time to create 1 rle with old method : 0.13758563995361328 time for calcul the mask position with numpy : 0.04135704040527344 nb_pixel_total : 106849 time to create 1 rle with old method : 0.12924671173095703 time for calcul the mask position with numpy : 0.03840970993041992 nb_pixel_total : 34033 time to create 1 rle with old method : 0.039919376373291016 time for calcul the mask position with numpy : 0.03919649124145508 nb_pixel_total : 117537 time to create 1 rle with old method : 0.13633942604064941 time for calcul the mask position with numpy : 0.02955913543701172 nb_pixel_total : 9748 time to create 1 rle with old method : 0.011036872863769531 time for calcul the mask position with numpy : 0.03462576866149902 nb_pixel_total : 10125 time to create 1 rle with old method : 0.011563301086425781 time for calcul the mask position with numpy : 0.03239750862121582 nb_pixel_total : 26443 time to create 1 rle with old method : 0.03126955032348633 time for calcul the mask position with numpy : 0.03589129447937012 nb_pixel_total : 19227 time to create 1 rle with old method : 0.031054258346557617 time for calcul the mask position with numpy : 0.026816368103027344 nb_pixel_total : 19031 time to create 1 rle with old method : 0.021382808685302734 time for calcul the mask position with numpy : 0.02359461784362793 nb_pixel_total : 49025 time to create 1 rle with old method : 0.0575258731842041 create new chi : 2.7867674827575684 time to delete rle : 0.002557992935180664 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 10004 TO DO : save crop sub photo not yet done ! save time : 0.6444785594940186 nb_obj : 28 nb_hashtags : 4 time to prepare the origin masks : 3.9872186183929443 time for calcul the mask position with numpy : 0.561880350112915 nb_pixel_total : 6177697 time to create 1 rle with new method : 1.4582774639129639 time for calcul the mask position with numpy : 0.0333402156829834 nb_pixel_total : 26200 time to create 1 rle with old method : 0.029474258422851562 time for calcul the mask position with numpy : 0.029248714447021484 nb_pixel_total : 12843 time to create 1 rle with old method : 0.014478445053100586 time for calcul the mask position with numpy : 0.029501914978027344 nb_pixel_total : 13182 time to create 1 rle with old method : 0.014899730682373047 time for calcul the mask position with numpy : 0.029742717742919922 nb_pixel_total : 14003 time to create 1 rle with old method : 0.015841960906982422 time for calcul the mask position with numpy : 0.030028820037841797 nb_pixel_total : 29228 time to create 1 rle with old method : 0.032755136489868164 time for calcul the mask position with numpy : 0.0294950008392334 nb_pixel_total : 20340 time to create 1 rle with old method : 0.02276325225830078 time for calcul the mask position with numpy : 0.029355764389038086 nb_pixel_total : 861 time to create 1 rle with old method : 0.0012013912200927734 time for calcul the mask position with numpy : 0.029605627059936523 nb_pixel_total : 30613 time to create 1 rle with old method : 0.03832292556762695 time for calcul the mask position with numpy : 0.03376317024230957 nb_pixel_total : 26276 time to create 1 rle with old method : 0.041565656661987305 time for calcul the mask position with numpy : 0.02979254722595215 nb_pixel_total : 32693 time to create 1 rle with old method : 0.03690838813781738 time for calcul the mask position with numpy : 0.029416561126708984 nb_pixel_total : 20597 time to create 1 rle with old method : 0.023218870162963867 time for calcul the mask position with numpy : 0.0293118953704834 nb_pixel_total : 24964 time to create 1 rle with old method : 0.028290271759033203 time for calcul the mask position with numpy : 0.029985427856445312 nb_pixel_total : 43438 time to create 1 rle with old method : 0.04871058464050293 time for calcul the mask position with numpy : 0.02946758270263672 nb_pixel_total : 11353 time to create 1 rle with old method : 0.012857437133789062 time for calcul the mask position with numpy : 0.029607534408569336 nb_pixel_total : 13486 time to create 1 rle with old method : 0.015230655670166016 time for calcul the mask position with numpy : 0.030092239379882812 nb_pixel_total : 77437 time to create 1 rle with old method : 0.08615422248840332 time for calcul the mask position with numpy : 0.02947998046875 nb_pixel_total : 35768 time to create 1 rle with old method : 0.0401463508605957 time for calcul the mask position with numpy : 0.029271841049194336 nb_pixel_total : 18143 time to create 1 rle with old method : 0.020663738250732422 time for calcul the mask position with numpy : 0.02937006950378418 nb_pixel_total : 20022 time to create 1 rle with old method : 0.02249598503112793 time for calcul the mask position with numpy : 0.029601573944091797 nb_pixel_total : 91923 time to create 1 rle with old method : 0.10250973701477051 time for calcul the mask position with numpy : 0.03338050842285156 nb_pixel_total : 50055 time to create 1 rle with old method : 0.05608487129211426 time for calcul the mask position with numpy : 0.029037952423095703 nb_pixel_total : 14998 time to create 1 rle with old method : 0.01682114601135254 time for calcul the mask position with numpy : 0.029044628143310547 nb_pixel_total : 9337 time to create 1 rle with old method : 0.011109352111816406 time for calcul the mask position with numpy : 0.02926468849182129 nb_pixel_total : 48262 time to create 1 rle with old method : 0.06119680404663086 time for calcul the mask position with numpy : 0.029908180236816406 nb_pixel_total : 80966 time to create 1 rle with old method : 0.09074521064758301 time for calcul the mask position with numpy : 0.03081536293029785 nb_pixel_total : 18511 time to create 1 rle with old method : 0.021337032318115234 time for calcul the mask position with numpy : 0.029666900634765625 nb_pixel_total : 78272 time to create 1 rle with old method : 0.08739972114562988 time for calcul the mask position with numpy : 0.029036998748779297 nb_pixel_total : 8772 time to create 1 rle with old method : 0.009935617446899414 create new chi : 3.9121451377868652 time to delete rle : 0.0036492347717285156 batch 1 Loaded 57 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 16020 TO DO : save crop sub photo not yet done ! save time : 0.9725351333618164 nb_obj : 12 nb_hashtags : 5 time to prepare the origin masks : 5.554009199142456 time for calcul the mask position with numpy : 0.5351886749267578 nb_pixel_total : 6527596 time to create 1 rle with new method : 0.45218539237976074 time for calcul the mask position with numpy : 0.0367283821105957 nb_pixel_total : 18305 time to create 1 rle with old method : 0.02117776870727539 time for calcul the mask position with numpy : 0.039809226989746094 nb_pixel_total : 8289 time to create 1 rle with old method : 0.009391546249389648 time for calcul the mask position with numpy : 0.02438521385192871 nb_pixel_total : 22209 time to create 1 rle with old method : 0.032341957092285156 time for calcul the mask position with numpy : 0.028284788131713867 nb_pixel_total : 20791 time to create 1 rle with old method : 0.023375511169433594 time for calcul the mask position with numpy : 0.022951364517211914 nb_pixel_total : 6759 time to create 1 rle with old method : 0.00783395767211914 time for calcul the mask position with numpy : 0.030153989791870117 nb_pixel_total : 276856 time to create 1 rle with new method : 0.7555282115936279 time for calcul the mask position with numpy : 0.02291703224182129 nb_pixel_total : 20429 time to create 1 rle with old method : 0.02299666404724121 time for calcul the mask position with numpy : 0.02315545082092285 nb_pixel_total : 36176 time to create 1 rle with old method : 0.04034757614135742 time for calcul the mask position with numpy : 0.022922992706298828 nb_pixel_total : 37198 time to create 1 rle with old method : 0.059583187103271484 time for calcul the mask position with numpy : 0.02561330795288086 nb_pixel_total : 37385 time to create 1 rle with old method : 0.04555058479309082 time for calcul the mask position with numpy : 0.021586894989013672 nb_pixel_total : 5451 time to create 1 rle with old method : 0.007711648941040039 time for calcul the mask position with numpy : 0.02266526222229004 nb_pixel_total : 32796 time to create 1 rle with old method : 0.03685355186462402 create new chi : 2.4324562549591064 time to delete rle : 0.0017435550689697266 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7366 TO DO : save crop sub photo not yet done ! save time : 0.4950389862060547 map_output_result : {1360848286: (0.0, 'Should be the crop_list due to order', 0), 1360848281: (0.0, 'Should be the crop_list due to order', 0), 1360848276: (0.0, 'Should be the crop_list due to order', 0), 1360848269: (0.0, 'Should be the crop_list due to order', 0), 1360848266: (0.0, 'Should be the crop_list due to order', 0), 1360848262: (0.0, 'Should be the crop_list due to order', 0), 1360848258: (0.0, 'Should be the crop_list due to order', 0), 1360848234: (0.0, 'Should be the crop_list due to order', 0), 1360848230: (0.0, 'Should be the crop_list due to order', 0), 1360848225: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1360848286, 1360848281, 1360848276, 1360848269, 1360848266, 1360848262, 1360848258, 1360848234, 1360848230, 1360848225] Looping around the photos to save general results len do output : 10 /1360848286.Didn't retrieve data . /1360848281.Didn't retrieve data . /1360848276.Didn't retrieve data . /1360848269.Didn't retrieve data . /1360848266.Didn't retrieve data . /1360848262.Didn't retrieve data . /1360848258.Didn't retrieve data . /1360848234.Didn't retrieve data . /1360848230.Didn't retrieve data . /1360848225.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848286', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848281', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848276', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848269', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848266', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848262', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848258', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848234', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848230', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848225', None, None, None, None, None, '2953284') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.017249107360839844 save_final save missing photos in datou_result : time spend for datou_step_exec : 86.69093322753906 time spend to save output : 0.017827749252319336 total time spend for step 3 : 86.70876097679138 step4:ventilate_hashtags_in_portfolio Mon May 26 14:34:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23332501 get user id for portfolio 23332501 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23332501 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','pet_fonce','papier','pet_clair','environnement','metal','carton','pehd','flou','background','autre')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23332501 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','pet_fonce','papier','pet_clair','environnement','metal','carton','pehd','flou','background','autre')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23332501 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','pet_fonce','papier','pet_clair','environnement','metal','carton','pehd','flou','background','autre')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23337710,23337711,23337712,23337713,23337714,23337715,23337716,23337717,23337718,23337719,23337720?tags=mal_croppe,pet_fonce,papier,pet_clair,environnement,metal,carton,pehd,flou,background,autre Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1360848286, 1360848281, 1360848276, 1360848269, 1360848266, 1360848262, 1360848258, 1360848234, 1360848230, 1360848225] Looping around the photos to save general results len do output : 1 /23332501. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848286', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848281', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848276', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848269', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848266', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848262', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848258', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848234', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848230', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848225', None, None, None, None, None, '2953284') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.013596534729003906 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5502698421478271 time spend to save output : 0.01387786865234375 total time spend for step 4 : 1.564147710800171 step5:final Mon May 26 14:34:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1360848286: ('0.09152722460511979',), 1360848281: ('0.09152722460511979',), 1360848276: ('0.09152722460511979',), 1360848269: ('0.09152722460511979',), 1360848266: ('0.09152722460511979',), 1360848262: ('0.09152722460511979',), 1360848258: ('0.09152722460511979',), 1360848234: ('0.09152722460511979',), 1360848230: ('0.09152722460511979',), 1360848225: ('0.09152722460511979',)} new output for save of step final : {1360848286: ('0.09152722460511979',), 1360848281: ('0.09152722460511979',), 1360848276: ('0.09152722460511979',), 1360848269: ('0.09152722460511979',), 1360848266: ('0.09152722460511979',), 1360848262: ('0.09152722460511979',), 1360848258: ('0.09152722460511979',), 1360848234: ('0.09152722460511979',), 1360848230: ('0.09152722460511979',), 1360848225: ('0.09152722460511979',)} [1360848286, 1360848281, 1360848276, 1360848269, 1360848266, 1360848262, 1360848258, 1360848234, 1360848230, 1360848225] Looping around the photos to save general results len do output : 10 /1360848286.Didn't retrieve data . /1360848281.Didn't retrieve data . /1360848276.Didn't retrieve data . /1360848269.Didn't retrieve data . /1360848266.Didn't retrieve data . /1360848262.Didn't retrieve data . /1360848258.Didn't retrieve data . /1360848234.Didn't retrieve data . /1360848230.Didn't retrieve data . /1360848225.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848286', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848281', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848276', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848269', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848266', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848262', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848258', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848234', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848230', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848225', None, None, None, None, None, '2953284') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.013009309768676758 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11153817176818848 time spend to save output : 0.013426780700683594 total time spend for step 5 : 0.12496495246887207 step6:blur_detection Mon May 26 14:34:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2.jpg resize: (2160, 3264) 1360848286 -2.374532296547622 treat image : temp/1748262630_4025710_1360848281_e59c8448de7bcd41d726116ced8295fc.jpg resize: (2160, 3264) 1360848281 -2.3299449347333567 treat image : temp/1748262630_4025710_1360848276_2c1e2515bc01021df1aafcaf7e63993f.jpg resize: (2160, 3264) 1360848276 -3.7220328036133723 treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7.jpg resize: (2160, 3264) 1360848269 -1.490083985194877 treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b.jpg resize: (2160, 3264) 1360848266 -2.3945354533452394 treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4.jpg resize: (2160, 3264) 1360848262 -2.4612195487765938 treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258.jpg resize: (2160, 3264) 1360848258 -0.8762249390710535 treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05.jpg resize: (2160, 3264) 1360848234 -1.423232610547821 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1.jpg resize: (2160, 3264) 1360848230 -1.8871354549267798 treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db.jpg resize: (2160, 3264) 1360848225 0.14139193611716372 treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090231_0.png resize: (166, 159) 1361078759 -1.4637655948480837 treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090232_0.png resize: (273, 275) 1361078760 -0.4276744117788203 treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090233_0.png resize: (111, 213) 1361078761 -1.6874341225546527 treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090234_0.png resize: (106, 168) 1361078762 -1.9107761058741448 treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090235_0.png resize: (166, 253) 1361078763 -3.342094633883439 treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090236_0.png resize: (199, 190) 1361078764 -1.153788761361493 treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090237_0.png resize: (188, 122) 1361078765 -0.8494877301367941 treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090238_0.png resize: (390, 171) 1361078766 -1.2778134542923159 treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090239_0.png resize: (338, 307) 1361078767 -2.2572215842757317 treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090240_0.png resize: (261, 115) 1361078768 -2.1243416120236764 treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090241_0.png resize: (1380, 1025) 1361078770 -0.008437853661734836 treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090242_0.png resize: (251, 304) 1361078771 -1.5307845187159173 treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090245_0.png resize: (117, 112) 1361078772 -1.5103869445180846 treat image : temp/1748262630_4025710_1360848281_e59c8448de7bcd41d726116ced8295fc_rle_crop_3813090248_0.png resize: (396, 335) 1361078773 0.40997986542701415 treat image : temp/1748262630_4025710_1360848281_e59c8448de7bcd41d726116ced8295fc_rle_crop_3813090249_0.png resize: (131, 235) 1361078774 -0.7532086847830657 treat image : temp/1748262630_4025710_1360848281_e59c8448de7bcd41d726116ced8295fc_rle_crop_3813090250_0.png resize: (121, 237) 1361078775 -0.17349465307359258 treat image : temp/1748262630_4025710_1360848281_e59c8448de7bcd41d726116ced8295fc_rle_crop_3813090252_0.png resize: (199, 180) 1361078776 -2.8934509164590185 treat image : temp/1748262630_4025710_1360848276_2c1e2515bc01021df1aafcaf7e63993f_rle_crop_3813090255_0.png resize: (378, 110) 1361078777 -0.9069669333441461 treat image : temp/1748262630_4025710_1360848276_2c1e2515bc01021df1aafcaf7e63993f_rle_crop_3813090256_0.png resize: (236, 104) 1361078778 -1.447331323075808 treat image : temp/1748262630_4025710_1360848276_2c1e2515bc01021df1aafcaf7e63993f_rle_crop_3813090258_0.png resize: (314, 358) 1361078779 -1.848179290275798 treat image : temp/1748262630_4025710_1360848276_2c1e2515bc01021df1aafcaf7e63993f_rle_crop_3813090259_0.png resize: (165, 159) 1361078780 -3.1128996855467768 treat image : temp/1748262630_4025710_1360848276_2c1e2515bc01021df1aafcaf7e63993f_rle_crop_3813090262_0.png resize: (117, 82) 1361078781 1.9822529764651144 treat image : temp/1748262630_4025710_1360848276_2c1e2515bc01021df1aafcaf7e63993f_rle_crop_3813090263_0.png resize: (205, 144) 1361078782 -1.2798960014836311 treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090265_0.png resize: (607, 753) 1361078783 -0.395566107682399 treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090268_0.png resize: (178, 178) 1361078784 -1.176941494116104 treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090273_0.png resize: (218, 561) 1361078785 0.4467103048083513 treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090274_0.png resize: (145, 293) 1361078786 -0.6757078976018249 treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090276_0.png resize: (210, 199) 1361078787 -1.0739093792944454 treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090283_0.png resize: (181, 248) 1361078788 0.7334700237731223 treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090284_0.png resize: (261, 328) 1361078789 -1.1867814438220077 treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090285_0.png resize: (148, 114) 1361078790 -1.7441038057844753 treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090286_0.png resize: (216, 306) 1361078791 -1.1145339020568987 treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090287_0.png resize: (191, 120) 1361078792 -1.7174924787474188 treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090288_0.png resize: (185, 110) 1361078793 -0.8429829266871623 treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090289_0.png resize: (92, 82) 1361078794 -1.5098204188774071 treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4_rle_crop_3813090292_0.png resize: (241, 408) 1361078795 -1.7982629197046798 treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4_rle_crop_3813090293_0.png resize: (162, 161) 1361078796 -1.4856398910657709 treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4_rle_crop_3813090294_0.png resize: (103, 170) 1361078797 -1.4283733089768391 treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4_rle_crop_3813090296_0.png resize: (126, 241) 1361078798 0.27009957208368035 treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4_rle_crop_3813090298_0.png resize: (121, 161) 1361078800 -1.8682483642313608 treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4_rle_crop_3813090300_0.png resize: (173, 331) 1361078801 -1.5897794881916714 treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4_rle_crop_3813090301_0.png resize: (147, 178) 1361078802 -1.0987870398699657 treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090304_0.png resize: (160, 207) 1361078803 -1.1659782476427647 treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090305_0.png resize: (159, 188) 1361078805 0.24617636771156626 treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090306_0.png resize: (219, 259) 1361078806 -0.1264215404636881 treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090307_0.png resize: (87, 192) 1361078807 -2.182070719826753 treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090308_0.png resize: (189, 278) 1361078808 -1.5225603572282067 treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090309_0.png resize: (189, 218) 1361078809 -1.9833200259113026 treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090310_0.png resize: (143, 142) 1361078810 -1.5593084130395234 treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090312_0.png resize: (89, 70) 1361078811 -0.2579939068635919 treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090313_0.png resize: (311, 188) 1361078812 -1.0757806982629499 treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090314_0.png resize: (157, 231) 1361078813 -0.24023514642895819 treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090316_0.png resize: (280, 288) 1361078814 -0.8194290049126592 treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090320_0.png resize: (106, 60) 1361078815 20.0 treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090321_0.png resize: (327, 426) 1361078816 -1.0194694937223205 treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090322_0.png resize: (234, 231) 1361078817 -1.7863602601406516 treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090323_0.png resize: (143, 132) 1361078818 0.4777885512483493 treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090324_0.png resize: (82, 81) 1361078819 0.20133731277707537 treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090325_0.png resize: (346, 222) 1361078820 0.026159036223960288 treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090326_0.png resize: (181, 156) 1361078821 -0.6042343366779175 treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090327_0.png resize: (120, 218) 1361078822 -1.2487240633486847 treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090328_0.png resize: (220, 155) 1361078823 0.11341222808991604 treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090329_0.png resize: (164, 134) 1361078824 -1.648485705534711 treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090330_0.png resize: (175, 73) 1361078825 -0.5580262167968361 treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090334_0.png resize: (487, 326) 1361078826 -2.186712230790423 treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090336_0.png resize: (177, 114) 1361078827 -0.9500704438004158 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090338_0.png resize: (136, 198) 1361078828 -0.5473521111775258 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090339_0.png resize: (288, 411) 1361078829 -0.5299731720884251 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090340_0.png resize: (317, 151) 1361078830 -1.213125220217485 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090341_0.png resize: (401, 236) 1361078831 -0.3251087773867227 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090342_0.png resize: (325, 124) 1361078832 -1.4408872996331377 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090343_0.png resize: (140, 149) 1361078833 -1.1139233893108038 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090344_0.png resize: (169, 295) 1361078834 -1.6612084568616863 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090345_0.png resize: (353, 367) 1361078835 -1.2748757639946053 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090348_0.png resize: (153, 135) 1361078836 -0.45264737419268436 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090352_0.png resize: (213, 93) 1361078837 -0.38187348216002615 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090353_0.png resize: (302, 329) 1361078838 -0.32799703093933036 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090355_0.png resize: (178, 78) 1361078839 0.5803462039437179 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090358_0.png resize: (424, 146) 1361078840 -1.0645949271859616 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090360_0.png resize: (110, 233) 1361078841 -0.908208281211977 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090362_0.png resize: (405, 124) 1361078842 -1.917842741793764 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090363_0.png resize: (111, 131) 1361078843 -0.8875775771727119 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090364_0.png resize: (203, 166) 1361078844 -1.1188184660283478 treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db_rle_crop_3813090366_0.png resize: (219, 250) 1361078845 -1.600798225031782 treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db_rle_crop_3813090368_0.png resize: (268, 252) 1361078846 -0.8861235426640994 treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db_rle_crop_3813090369_0.png resize: (205, 232) 1361078847 0.26518928514833795 treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db_rle_crop_3813090370_0.png resize: (305, 159) 1361078848 -1.4188665393695143 treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db_rle_crop_3813090375_0.png resize: (118, 250) 1361078849 -8.424782616670152e-05 treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db_rle_crop_3813090377_0.png resize: (205, 135) 1361078850 -1.080754324018558 treat image : temp/1748262630_4025710_1360848281_e59c8448de7bcd41d726116ced8295fc_rle_crop_3813090246_0.png resize: (229, 169) 1361078857 -0.5274758490932926 treat image : temp/1748262630_4025710_1360848281_e59c8448de7bcd41d726116ced8295fc_rle_crop_3813090247_0.png resize: (236, 394) 1361078858 -1.5098549843276636 treat image : temp/1748262630_4025710_1360848281_e59c8448de7bcd41d726116ced8295fc_rle_crop_3813090254_0.png resize: (189, 284) 1361078859 -0.6782348126605615 treat image : temp/1748262630_4025710_1360848276_2c1e2515bc01021df1aafcaf7e63993f_rle_crop_3813090257_0.png resize: (116, 191) 1361078860 -0.7376104222755945 treat image : temp/1748262630_4025710_1360848276_2c1e2515bc01021df1aafcaf7e63993f_rle_crop_3813090261_0.png resize: (171, 296) 1361078861 -0.8548942836178101 treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090264_0.png resize: (218, 152) 1361078862 -0.3381421171069902 treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090267_0.png resize: (222, 231) 1361078863 -0.3998821774532834 treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090279_0.png resize: (367, 326) 1361078864 -1.253460958078045 treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090281_0.png resize: (228, 122) 1361078865 -1.7566733725463886 treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090282_0.png resize: (194, 270) 1361078866 -0.5510492609608013 treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4_rle_crop_3813090295_0.png resize: (137, 178) 1361078867 -1.5532912455810095 treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4_rle_crop_3813090299_0.png resize: (68, 80) 1361078868 -1.0574542291041669 treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090318_0.png resize: (89, 130) 1361078869 -0.823646582058991 treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090319_0.png resize: (188, 225) 1361078870 -1.1221416411408809 treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090335_0.png resize: (239, 98) 1361078871 -1.0922771705777083 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090346_0.png resize: (257, 116) 1361078872 -1.0469760177760346 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090349_0.png resize: (212, 88) 1361078873 0.38613229948227146 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090351_0.png resize: (148, 104) 1361078874 0.5885368035857323 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090354_0.png resize: (173, 140) 1361078875 -0.9334710670022608 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090357_0.png resize: (398, 128) 1361078876 -1.9532566783062963 treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db_rle_crop_3813090374_0.png resize: (227, 136) 1361078877 -0.7999795434115808 treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db_rle_crop_3813090376_0.png resize: (99, 95) 1361078879 -1.4695506056840757 treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090243_0.png resize: (274, 168) 1361078891 -2.043122698539742 treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090244_0.png resize: (190, 121) 1361078892 -3.334195307978857 treat image : temp/1748262630_4025710_1360848281_e59c8448de7bcd41d726116ced8295fc_rle_crop_3813090251_0.png resize: (255, 216) 1361078893 -3.5913672655500335 treat image : temp/1748262630_4025710_1360848281_e59c8448de7bcd41d726116ced8295fc_rle_crop_3813090253_0.png resize: (301, 420) 1361078894 -0.8472666747201392 treat image : temp/1748262630_4025710_1360848276_2c1e2515bc01021df1aafcaf7e63993f_rle_crop_3813090260_0.png resize: (213, 296) 1361078895 -2.7253018241500637 treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090266_0.png resize: (185, 395) 1361078896 -0.9325248791871671 treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090269_0.png resize: (371, 268) 1361078897 -2.0405902836325827 treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090270_0.png resize: (289, 941) 1361078898 -1.5373753546312143 treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090271_0.png resize: (263, 363) 1361078899 0.19321883367830572 treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090272_0.png resize: (232, 249) 1361078900 -2.8296780812325064 treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090275_0.png resize: (511, 459) 1361078901 -1.545500087154772 treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090277_0.png resize: (171, 231) 1361078902 -1.6669552828432415 treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090278_0.png resize: (249, 330) 1361078903 -2.313793185614071 treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090280_0.png resize: (467, 311) 1361078904 -2.0462970765460944 treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090290_0.png resize: (777, 114) 1361078905 -2.454857940390579 treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090291_0.png resize: (110, 222) 1361078906 -0.9395896077906847 treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4_rle_crop_3813090297_0.png resize: (307, 368) 1361078907 -2.6780297229105403 treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4_rle_crop_3813090302_0.png resize: (206, 140) 1361078908 -0.31443808121338984 treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4_rle_crop_3813090303_0.png resize: (467, 293) 1361078910 -1.7599767935124762 treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090311_0.png resize: (338, 265) 1361078911 -2.6875265891974567 treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090315_0.png resize: (122, 212) 1361078912 -0.7705807119366466 treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090331_0.png resize: (458, 376) 1361078913 -2.03992249517032 treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090332_0.png resize: (274, 160) 1361078914 -2.228627707278786 treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090333_0.png resize: (491, 355) 1361078915 -1.9973596305583774 treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090337_0.png resize: (368, 333) 1361078916 -1.5041131819068374 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090347_0.png resize: (182, 228) 1361078917 -2.5386278590327698 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090350_0.png resize: (290, 432) 1361078918 -1.4804803220422085 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090356_0.png resize: (207, 188) 1361078920 -2.008004752007288 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090361_0.png resize: (175, 203) 1361078921 -2.4353006042683347 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090365_0.png resize: (496, 152) 1361078922 -1.3467968624656612 treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db_rle_crop_3813090367_0.png resize: (66, 113) 1361078923 -0.4641528092476548 treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db_rle_crop_3813090372_0.png resize: (512, 660) 1361078924 1.3692626207881715 treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db_rle_crop_3813090373_0.png resize: (87, 115) 1361078925 -1.953372471128095 treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090359_0.png resize: (304, 172) 1361078928 -1.7303780017419843 treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090317_0.png resize: (181, 209) 1361078929 -2.1530141630712354 treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db_rle_crop_3813090371_0.png resize: (200, 147) 1361078930 -1.336033524152356 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 157 time used for this insertion : 0.02083277702331543 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 157 time used for this insertion : 0.03191232681274414 save missing photos in datou_result : time spend for datou_step_exec : 38.20741629600525 time spend to save output : 0.059429168701171875 total time spend for step 6 : 38.26684546470642 step7:brightness Mon May 26 14:35:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2.jpg treat image : temp/1748262630_4025710_1360848281_e59c8448de7bcd41d726116ced8295fc.jpg treat image : temp/1748262630_4025710_1360848276_2c1e2515bc01021df1aafcaf7e63993f.jpg treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7.jpg treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b.jpg treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4.jpg treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258.jpg treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05.jpg treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1.jpg treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db.jpg treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090231_0.png treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090232_0.png treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090233_0.png treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090234_0.png treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090235_0.png treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090236_0.png treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090237_0.png treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090238_0.png treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090239_0.png treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090240_0.png treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090241_0.png treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090242_0.png treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090245_0.png treat image : temp/1748262630_4025710_1360848281_e59c8448de7bcd41d726116ced8295fc_rle_crop_3813090248_0.png treat image : temp/1748262630_4025710_1360848281_e59c8448de7bcd41d726116ced8295fc_rle_crop_3813090249_0.png treat image : temp/1748262630_4025710_1360848281_e59c8448de7bcd41d726116ced8295fc_rle_crop_3813090250_0.png treat image : temp/1748262630_4025710_1360848281_e59c8448de7bcd41d726116ced8295fc_rle_crop_3813090252_0.png treat image : temp/1748262630_4025710_1360848276_2c1e2515bc01021df1aafcaf7e63993f_rle_crop_3813090255_0.png treat image : temp/1748262630_4025710_1360848276_2c1e2515bc01021df1aafcaf7e63993f_rle_crop_3813090256_0.png treat image : temp/1748262630_4025710_1360848276_2c1e2515bc01021df1aafcaf7e63993f_rle_crop_3813090258_0.png treat image : temp/1748262630_4025710_1360848276_2c1e2515bc01021df1aafcaf7e63993f_rle_crop_3813090259_0.png treat image : temp/1748262630_4025710_1360848276_2c1e2515bc01021df1aafcaf7e63993f_rle_crop_3813090262_0.png treat image : temp/1748262630_4025710_1360848276_2c1e2515bc01021df1aafcaf7e63993f_rle_crop_3813090263_0.png treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090265_0.png treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090268_0.png treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090273_0.png treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090274_0.png treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090276_0.png treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090283_0.png treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090284_0.png treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090285_0.png treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090286_0.png treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090287_0.png treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090288_0.png treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090289_0.png treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4_rle_crop_3813090292_0.png treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4_rle_crop_3813090293_0.png treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4_rle_crop_3813090294_0.png treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4_rle_crop_3813090296_0.png treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4_rle_crop_3813090298_0.png treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4_rle_crop_3813090300_0.png treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4_rle_crop_3813090301_0.png treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090304_0.png treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090305_0.png treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090306_0.png treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090307_0.png treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090308_0.png treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090309_0.png treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090310_0.png treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090312_0.png treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090313_0.png treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090314_0.png treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090316_0.png treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090320_0.png treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090321_0.png treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090322_0.png treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090323_0.png treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090324_0.png treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090325_0.png treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090326_0.png treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090327_0.png treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090328_0.png treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090329_0.png treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090330_0.png treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090334_0.png treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090336_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090338_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090339_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090340_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090341_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090342_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090343_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090344_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090345_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090348_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090352_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090353_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090355_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090358_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090360_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090362_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090363_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090364_0.png treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db_rle_crop_3813090366_0.png treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db_rle_crop_3813090368_0.png treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db_rle_crop_3813090369_0.png treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db_rle_crop_3813090370_0.png treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db_rle_crop_3813090375_0.png treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db_rle_crop_3813090377_0.png treat image : temp/1748262630_4025710_1360848281_e59c8448de7bcd41d726116ced8295fc_rle_crop_3813090246_0.png treat image : temp/1748262630_4025710_1360848281_e59c8448de7bcd41d726116ced8295fc_rle_crop_3813090247_0.png treat image : temp/1748262630_4025710_1360848281_e59c8448de7bcd41d726116ced8295fc_rle_crop_3813090254_0.png treat image : temp/1748262630_4025710_1360848276_2c1e2515bc01021df1aafcaf7e63993f_rle_crop_3813090257_0.png treat image : temp/1748262630_4025710_1360848276_2c1e2515bc01021df1aafcaf7e63993f_rle_crop_3813090261_0.png treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090264_0.png treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090267_0.png treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090279_0.png treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090281_0.png treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090282_0.png treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4_rle_crop_3813090295_0.png treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4_rle_crop_3813090299_0.png treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090318_0.png treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090319_0.png treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090335_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090346_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090349_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090351_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090354_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090357_0.png treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db_rle_crop_3813090374_0.png treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db_rle_crop_3813090376_0.png treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090243_0.png treat image : temp/1748262630_4025710_1360848286_6aae84312b866176f74b1dda08f312b2_rle_crop_3813090244_0.png treat image : temp/1748262630_4025710_1360848281_e59c8448de7bcd41d726116ced8295fc_rle_crop_3813090251_0.png treat image : temp/1748262630_4025710_1360848281_e59c8448de7bcd41d726116ced8295fc_rle_crop_3813090253_0.png treat image : temp/1748262630_4025710_1360848276_2c1e2515bc01021df1aafcaf7e63993f_rle_crop_3813090260_0.png treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090266_0.png treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090269_0.png treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090270_0.png treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090271_0.png treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090272_0.png treat image : temp/1748262630_4025710_1360848269_5a9a31a854693233485f568dc6f2b1f7_rle_crop_3813090275_0.png treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090277_0.png treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090278_0.png treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090280_0.png treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090290_0.png treat image : temp/1748262630_4025710_1360848266_f33a513275b4cac1af989a6948c90f1b_rle_crop_3813090291_0.png treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4_rle_crop_3813090297_0.png treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4_rle_crop_3813090302_0.png treat image : temp/1748262630_4025710_1360848262_02fec0602cc5e8aa6418238e9c507eb4_rle_crop_3813090303_0.png treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090311_0.png treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090315_0.png treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090331_0.png treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090332_0.png treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090333_0.png treat image : temp/1748262630_4025710_1360848234_a55c43e8ab35194917ba1b49601dad05_rle_crop_3813090337_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090347_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090350_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090356_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090361_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090365_0.png treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db_rle_crop_3813090367_0.png treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db_rle_crop_3813090372_0.png treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db_rle_crop_3813090373_0.png treat image : temp/1748262630_4025710_1360848230_8162088f84991cd6468631195279c8e1_rle_crop_3813090359_0.png treat image : temp/1748262630_4025710_1360848258_c670af18bef15f6aecd7cf1f6aa30258_rle_crop_3813090317_0.png treat image : temp/1748262630_4025710_1360848225_59c57a68d301235b064ff20a6f1cc4db_rle_crop_3813090371_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 157 time used for this insertion : 0.018309831619262695 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 157 time used for this insertion : 0.03242945671081543 save missing photos in datou_result : time spend for datou_step_exec : 10.162314414978027 time spend to save output : 0.05660128593444824 total time spend for step 7 : 10.218915700912476 step8:velours_tree Mon May 26 14:35:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.14970898628234863 time spend to save output : 4.601478576660156e-05 total time spend for step 8 : 0.14975500106811523 step9:send_mail_cod Mon May 26 14:35:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23332501_26-05-2025_14_35_39.pdf 23337710 imagette233377101748262939 23337711 change filename to text .change filename to text .imagette233377111748262939 23337712 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233377121748262939 23337713 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233377131748262941 23337715 change filename to text .imagette233377151748262945 23337716 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233377161748262946 23337717 imagette233377171748262947 23337718 imagette233377181748262947 23337719 imagette233377191748262947 23337720 change filename to text .imagette233377201748262947 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23332501 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23337710,23337711,23337712,23337713,23337714,23337715,23337716,23337717,23337718,23337719,23337720?tags=mal_croppe,pet_fonce,papier,pet_clair,environnement,metal,carton,pehd,flou,background,autre args[1360848286] : ((1360848286, -2.374532296547622, 492609224), (1360848286, -0.01358826604245261, 2107752395), '0.09152722460511979') We are sending mail with results at report@fotonower.com args[1360848281] : ((1360848281, -2.3299449347333567, 492609224), (1360848281, 0.5080222509598252, 2107752395), '0.09152722460511979') We are sending mail with results at report@fotonower.com args[1360848276] : ((1360848276, -3.7220328036133723, 492609224), (1360848276, 0.19300121892533323, 2107752395), '0.09152722460511979') We are sending mail with results at report@fotonower.com args[1360848269] : ((1360848269, -1.490083985194877, 492688767), (1360848269, 0.2453421718998387, 2107752395), '0.09152722460511979') We are sending mail with results at report@fotonower.com args[1360848266] : ((1360848266, -2.3945354533452394, 492609224), (1360848266, 0.20876057982244042, 2107752395), '0.09152722460511979') We are sending mail with results at report@fotonower.com args[1360848262] : ((1360848262, -2.4612195487765938, 492609224), (1360848262, 0.018773865805697423, 2107752395), '0.09152722460511979') We are sending mail with results at report@fotonower.com args[1360848258] : ((1360848258, -0.8762249390710535, 492688767), (1360848258, -0.06537543869516133, 2107752395), '0.09152722460511979') We are sending mail with results at report@fotonower.com args[1360848234] : ((1360848234, -1.423232610547821, 492688767), (1360848234, 0.3411766616891736, 2107752395), '0.09152722460511979') We are sending mail with results at report@fotonower.com args[1360848230] : ((1360848230, -1.8871354549267798, 492688767), (1360848230, 0.11913079520055103, 2107752395), '0.09152722460511979') We are sending mail with results at report@fotonower.com args[1360848225] : ((1360848225, 0.14139193611716372, 492688767), (1360848225, 0.3241748717245543, 2107752395), '0.09152722460511979') We are sending mail with results at report@fotonower.com refus_total : 0.09152722460511979 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23332501 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23332501_26-05-2025_14_35_39.pdf results_Auto_P23332501_26-05-2025_14_35_39.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23332501_26-05-2025_14_35_39.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23332501','results_Auto_P23332501_26-05-2025_14_35_39.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23332501_26-05-2025_14_35_39.pdf','pdf','','0.56','0.09152722460511979') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23332501

https://www.fotonower.com/image?json=false&list_photos_id=1360848286
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360848281
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360848276
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360848269
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360848266
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360848262
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360848258
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360848234
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360848230
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360848225
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 9.15%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_fonce: https://www.fotonower.com/view/23337711?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23337712?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23337713?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/23337715?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23337716?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23337720?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23332501_26-05-2025_14_35_39.pdf.

Lien vers velours :https://www.fotonower.com/velours/23337710,23337711,23337712,23337713,23337714,23337715,23337716,23337717,23337718,23337719,23337720?tags=mal_croppe,pet_fonce,papier,pet_clair,environnement,metal,carton,pehd,flou,background,autre.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 26 May 2025 12:35:50 GMT Content-Length: 0 Connection: close X-Message-Id: mVszmQOBReeI4L-p5ee09A Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1360848286, 1360848281, 1360848276, 1360848269, 1360848266, 1360848262, 1360848258, 1360848234, 1360848230, 1360848225] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848286', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848281', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848276', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848269', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848266', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848262', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848258', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848234', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848230', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848225', None, None, None, None, None, '2953284') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.014340877532958984 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.855241537094116 time spend to save output : 0.014563560485839844 total time spend for step 9 : 10.869805097579956 step10:split_time_score Mon May 26 14:35:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 23052025 23332501 Nombre de photos uploadées : 10 / 23040 (0%) 23052025 23332501 Nombre de photos taguées (types de déchets): 0 / 10 (0%) 23052025 23332501 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 3.0994415283203125e-06 elapsed_time : order_list_meta_photo_and_scores 1.0251998901367188e-05 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.0004899501800537109 elapsed_time : insert_dashboard_record_day_entry 0.023743867874145508 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23332469 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23332472 order by id desc limit 1 Qualite : 0.09152722460511979 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23332501_26-05-2025_14_35_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23332501 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23332501 AND mptpi.`type`=3594 To do Qualite : 0.07191652018551525 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23332518_26-05-2025_13_05_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23332518 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23332518 AND mptpi.`type`=3594 To do Qualite : 0.02933131098982608 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23332520_26-05-2025_12_54_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23332520 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23332520 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'23052025': {'nb_upload': 10, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1360848286, 1360848281, 1360848276, 1360848269, 1360848266, 1360848262, 1360848258, 1360848234, 1360848230, 1360848225] Looping around the photos to save general results len do output : 1 /23332501Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848286', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848281', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848276', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848269', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848266', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848262', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848258', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848234', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848230', None, None, None, None, None, '2953284') ('3318', None, None, None, None, None, None, None, '2953284') ('3318', '23332501', '1360848225', None, None, None, None, None, '2953284') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.014676094055175781 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.1528451442718506 time spend to save output : 0.01493978500366211 total time spend for step 10 : 2.1677849292755127 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 10 set_done_treatment 139.95user 124.40system 5:27.62elapsed 80%CPU (0avgtext+0avgdata 5257200maxresident)k 634248inputs+73440outputs (5042major+13519683minor)pagefaults 0swaps