python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3291772 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2849704'] with mtr_portfolio_ids : ['22967479'] and first list_photo_ids : [] new path : /proc/3291772/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 9 ; length of list_pids : 9 ; length of list_args : 9 time to download the photos : 1.4045424461364746 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed May 14 15:50:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5621 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-14 15:50:33.617778: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-14 15:50:33.659064: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-14 15:50:33.683578: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f46d8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-14 15:50:33.683626: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-14 15:50:33.686775: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-14 15:50:33.818629: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3f672ca0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-14 15:50:33.818670: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-14 15:50:33.819436: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-14 15:50:33.819817: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-14 15:50:33.822343: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-14 15:50:33.824683: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-14 15:50:33.825065: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-14 15:50:33.827496: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-14 15:50:33.828794: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-14 15:50:33.833679: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-14 15:50:33.835088: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-14 15:50:33.835171: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-14 15:50:33.835898: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-14 15:50:33.835917: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-14 15:50:33.835928: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-14 15:50:33.837398: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4997 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-14 15:50:34.244825: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-14 15:50:34.244969: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-14 15:50:34.244990: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-14 15:50:34.245008: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-14 15:50:34.245025: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-14 15:50:34.245042: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-14 15:50:34.245058: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-14 15:50:34.245076: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-14 15:50:34.246064: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-14 15:50:34.247288: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-14 15:50:34.247328: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-14 15:50:34.247344: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-14 15:50:34.247359: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-14 15:50:34.247373: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-14 15:50:34.247386: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-14 15:50:34.247400: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-14 15:50:34.247414: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-14 15:50:34.248373: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-14 15:50:34.248421: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-14 15:50:34.248431: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-14 15:50:34.248439: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-14 15:50:34.249462: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4997 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-14 15:50:48.243209: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-14 15:50:48.470444: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-14 15:50:50.224411: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.225034: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.225563: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.226082: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.226609: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.227163: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.227691: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.227731: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-14 15:50:50.232996: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.233065: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-14 15:50:50.239938: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.240023: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-14 15:50:50.240699: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.240723: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-14 15:50:50.247095: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.247198: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-14 15:50:50.247815: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.247832: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-14 15:50:50.274678: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.274762: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-14 15:50:50.275346: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.275373: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-14 15:50:50.281003: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.281061: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-14 15:50:50.281631: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.281651: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-14 15:50:50.311517: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.312147: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.313879: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.314428: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.352853: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.353491: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.355548: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.356115: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.382364: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.383022: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.384605: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.385170: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.393400: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.394372: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.396635: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.397541: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.406558: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.407573: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.409608: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.410487: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.446324: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.447293: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.448180: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.449073: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.454567: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.455537: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.476621: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.477249: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.477810: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.478361: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.496659: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.497933: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.499089: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.500125: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.509934: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.510723: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.516614: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.517219: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.529702: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.530321: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.534716: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.535381: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.535990: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.536601: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.537487: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.538079: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.549256: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.549909: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.550559: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.551190: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.551793: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.552407: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.553086: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.553726: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.564124: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.564731: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.571368: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.571969: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.664715: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.665304: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.673408: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.673959: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.710231: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.711226: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.712137: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.713025: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.717727: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.718625: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.719502: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.720392: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.723483: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.723524: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-05-14 15:50:50.732314: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.732899: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.742133: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.742791: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.743403: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.743990: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.744545: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-14 15:50:50.745089: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 9 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 44 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 50 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 50 Detection mask done ! Trying to reset tf kernel 3292571 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3323 tf kernel not reseted sub process len(results) : 9 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 9 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1204 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0008943080902099609 nb_pixel_total : 24593 time to create 1 rle with old method : 0.031842947006225586 length of segment : 103 time for calcul the mask position with numpy : 0.0003161430358886719 nb_pixel_total : 16077 time to create 1 rle with old method : 0.022145509719848633 length of segment : 136 time for calcul the mask position with numpy : 0.0012714862823486328 nb_pixel_total : 54269 time to create 1 rle with old method : 0.06241941452026367 length of segment : 358 time for calcul the mask position with numpy : 0.0012257099151611328 nb_pixel_total : 61961 time to create 1 rle with old method : 0.07151055335998535 length of segment : 313 time for calcul the mask position with numpy : 0.00057220458984375 nb_pixel_total : 31661 time to create 1 rle with old method : 0.0371088981628418 length of segment : 169 time for calcul the mask position with numpy : 0.0005311965942382812 nb_pixel_total : 22920 time to create 1 rle with old method : 0.026124000549316406 length of segment : 423 time for calcul the mask position with numpy : 0.0008177757263183594 nb_pixel_total : 41946 time to create 1 rle with old method : 0.04825162887573242 length of segment : 451 time for calcul the mask position with numpy : 0.0014598369598388672 nb_pixel_total : 55461 time to create 1 rle with old method : 0.06326866149902344 length of segment : 429 time for calcul the mask position with numpy : 0.0019528865814208984 nb_pixel_total : 111260 time to create 1 rle with old method : 0.13146209716796875 length of segment : 375 time for calcul the mask position with numpy : 0.001424551010131836 nb_pixel_total : 50593 time to create 1 rle with old method : 0.06069040298461914 length of segment : 250 time for calcul the mask position with numpy : 0.0014739036560058594 nb_pixel_total : 48272 time to create 1 rle with old method : 0.05604887008666992 length of segment : 235 time for calcul the mask position with numpy : 0.0006687641143798828 nb_pixel_total : 23485 time to create 1 rle with old method : 0.028447628021240234 length of segment : 178 time for calcul the mask position with numpy : 0.0008080005645751953 nb_pixel_total : 35669 time to create 1 rle with old method : 0.04141950607299805 length of segment : 150 time for calcul the mask position with numpy : 0.0004203319549560547 nb_pixel_total : 23037 time to create 1 rle with old method : 0.027302026748657227 length of segment : 124 time for calcul the mask position with numpy : 0.0005128383636474609 nb_pixel_total : 16748 time to create 1 rle with old method : 0.021681785583496094 length of segment : 166 time for calcul the mask position with numpy : 0.0036742687225341797 nb_pixel_total : 118251 time to create 1 rle with old method : 0.13579893112182617 length of segment : 500 time for calcul the mask position with numpy : 0.0003342628479003906 nb_pixel_total : 19106 time to create 1 rle with old method : 0.022352933883666992 length of segment : 114 time for calcul the mask position with numpy : 0.0006899833679199219 nb_pixel_total : 25934 time to create 1 rle with old method : 0.03003096580505371 length of segment : 214 time for calcul the mask position with numpy : 0.0008211135864257812 nb_pixel_total : 35920 time to create 1 rle with old method : 0.0408933162689209 length of segment : 268 time for calcul the mask position with numpy : 0.004348278045654297 nb_pixel_total : 170968 time to create 1 rle with new method : 0.011783599853515625 length of segment : 421 time for calcul the mask position with numpy : 0.0008087158203125 nb_pixel_total : 35095 time to create 1 rle with old method : 0.04667520523071289 length of segment : 202 time for calcul the mask position with numpy : 0.0012502670288085938 nb_pixel_total : 41355 time to create 1 rle with old method : 0.04735064506530762 length of segment : 457 time for calcul the mask position with numpy : 0.002428770065307617 nb_pixel_total : 110460 time to create 1 rle with old method : 0.12514948844909668 length of segment : 930 time for calcul the mask position with numpy : 0.0004169940948486328 nb_pixel_total : 19970 time to create 1 rle with old method : 0.023201465606689453 length of segment : 170 time for calcul the mask position with numpy : 0.006888389587402344 nb_pixel_total : 247905 time to create 1 rle with new method : 0.016870737075805664 length of segment : 668 time for calcul the mask position with numpy : 0.0013661384582519531 nb_pixel_total : 82747 time to create 1 rle with old method : 0.09172821044921875 length of segment : 458 time for calcul the mask position with numpy : 0.00020384788513183594 nb_pixel_total : 6658 time to create 1 rle with old method : 0.007839441299438477 length of segment : 138 time for calcul the mask position with numpy : 0.0007023811340332031 nb_pixel_total : 36034 time to create 1 rle with old method : 0.04167532920837402 length of segment : 221 time for calcul the mask position with numpy : 0.0017924308776855469 nb_pixel_total : 75616 time to create 1 rle with old method : 0.08789348602294922 length of segment : 467 time for calcul the mask position with numpy : 0.0019485950469970703 nb_pixel_total : 86704 time to create 1 rle with old method : 0.09839272499084473 length of segment : 457 time for calcul the mask position with numpy : 0.0018184185028076172 nb_pixel_total : 77967 time to create 1 rle with old method : 0.08864355087280273 length of segment : 306 time for calcul the mask position with numpy : 0.002090930938720703 nb_pixel_total : 131913 time to create 1 rle with old method : 0.14992523193359375 length of segment : 348 time for calcul the mask position with numpy : 0.0008075237274169922 nb_pixel_total : 29069 time to create 1 rle with old method : 0.033823251724243164 length of segment : 417 time for calcul the mask position with numpy : 0.0014414787292480469 nb_pixel_total : 64792 time to create 1 rle with old method : 0.07668232917785645 length of segment : 228 time for calcul the mask position with numpy : 0.00032210350036621094 nb_pixel_total : 6086 time to create 1 rle with old method : 0.010097742080688477 length of segment : 153 time for calcul the mask position with numpy : 0.004630327224731445 nb_pixel_total : 224307 time to create 1 rle with new method : 0.01901984214782715 length of segment : 1068 time for calcul the mask position with numpy : 0.002087116241455078 nb_pixel_total : 107307 time to create 1 rle with old method : 0.13388466835021973 length of segment : 394 time for calcul the mask position with numpy : 0.001819610595703125 nb_pixel_total : 115782 time to create 1 rle with old method : 0.13925409317016602 length of segment : 289 time for calcul the mask position with numpy : 0.0013730525970458984 nb_pixel_total : 71974 time to create 1 rle with old method : 0.08482789993286133 length of segment : 526 time for calcul the mask position with numpy : 0.007323741912841797 nb_pixel_total : 278987 time to create 1 rle with new method : 0.05104947090148926 length of segment : 654 time for calcul the mask position with numpy : 0.001589059829711914 nb_pixel_total : 103406 time to create 1 rle with old method : 0.11576199531555176 length of segment : 709 time for calcul the mask position with numpy : 0.0003733634948730469 nb_pixel_total : 15023 time to create 1 rle with old method : 0.017716646194458008 length of segment : 171 time for calcul the mask position with numpy : 0.10619473457336426 nb_pixel_total : 1104432 time to create 1 rle with new method : 0.32145118713378906 length of segment : 1794 time for calcul the mask position with numpy : 0.0008599758148193359 nb_pixel_total : 63927 time to create 1 rle with old method : 0.07271599769592285 length of segment : 237 time for calcul the mask position with numpy : 0.0022118091583251953 nb_pixel_total : 88786 time to create 1 rle with old method : 0.10463881492614746 length of segment : 481 time for calcul the mask position with numpy : 0.0006842613220214844 nb_pixel_total : 31282 time to create 1 rle with old method : 0.03602123260498047 length of segment : 168 time for calcul the mask position with numpy : 0.003201007843017578 nb_pixel_total : 123647 time to create 1 rle with old method : 0.13890719413757324 length of segment : 559 time for calcul the mask position with numpy : 0.001718282699584961 nb_pixel_total : 60940 time to create 1 rle with old method : 0.0693962574005127 length of segment : 204 time for calcul the mask position with numpy : 0.0039052963256835938 nb_pixel_total : 130675 time to create 1 rle with old method : 0.14879059791564941 length of segment : 474 time for calcul the mask position with numpy : 0.0006091594696044922 nb_pixel_total : 15526 time to create 1 rle with old method : 0.017983198165893555 length of segment : 151 time for calcul the mask position with numpy : 0.0026009082794189453 nb_pixel_total : 35491 time to create 1 rle with old method : 0.04141044616699219 length of segment : 454 time for calcul the mask position with numpy : 0.003757953643798828 nb_pixel_total : 120259 time to create 1 rle with old method : 0.1369924545288086 length of segment : 594 time for calcul the mask position with numpy : 0.0038487911224365234 nb_pixel_total : 139984 time to create 1 rle with old method : 0.1583247184753418 length of segment : 414 time for calcul the mask position with numpy : 0.004350185394287109 nb_pixel_total : 186795 time to create 1 rle with new method : 0.00575566291809082 length of segment : 483 time for calcul the mask position with numpy : 0.0007331371307373047 nb_pixel_total : 25566 time to create 1 rle with old method : 0.04033827781677246 length of segment : 210 time for calcul the mask position with numpy : 0.0006978511810302734 nb_pixel_total : 14850 time to create 1 rle with old method : 0.017495393753051758 length of segment : 142 time for calcul the mask position with numpy : 0.0039403438568115234 nb_pixel_total : 94499 time to create 1 rle with old method : 0.10724925994873047 length of segment : 327 time for calcul the mask position with numpy : 0.0046918392181396484 nb_pixel_total : 115527 time to create 1 rle with old method : 0.1320180892944336 length of segment : 381 time for calcul the mask position with numpy : 0.0010800361633300781 nb_pixel_total : 11532 time to create 1 rle with old method : 0.013793706893920898 length of segment : 260 time for calcul the mask position with numpy : 0.0008218288421630859 nb_pixel_total : 9858 time to create 1 rle with old method : 0.026732206344604492 length of segment : 151 time for calcul the mask position with numpy : 0.001844644546508789 nb_pixel_total : 36843 time to create 1 rle with old method : 0.04253649711608887 length of segment : 226 time for calcul the mask position with numpy : 0.0030863285064697266 nb_pixel_total : 80300 time to create 1 rle with old method : 0.09040141105651855 length of segment : 295 time for calcul the mask position with numpy : 0.004153728485107422 nb_pixel_total : 101325 time to create 1 rle with old method : 0.1186981201171875 length of segment : 458 time for calcul the mask position with numpy : 0.0017893314361572266 nb_pixel_total : 32715 time to create 1 rle with old method : 0.03739118576049805 length of segment : 375 time for calcul the mask position with numpy : 0.00144195556640625 nb_pixel_total : 36805 time to create 1 rle with old method : 0.04236865043640137 length of segment : 202 time for calcul the mask position with numpy : 0.00023102760314941406 nb_pixel_total : 4548 time to create 1 rle with old method : 0.005892038345336914 length of segment : 84 time for calcul the mask position with numpy : 0.0031423568725585938 nb_pixel_total : 80900 time to create 1 rle with old method : 0.09433984756469727 length of segment : 331 time for calcul the mask position with numpy : 0.0074503421783447266 nb_pixel_total : 210671 time to create 1 rle with new method : 0.012206077575683594 length of segment : 757 time for calcul the mask position with numpy : 0.005028963088989258 nb_pixel_total : 114221 time to create 1 rle with old method : 0.15079426765441895 length of segment : 449 time for calcul the mask position with numpy : 0.0031435489654541016 nb_pixel_total : 36722 time to create 1 rle with old method : 0.04202604293823242 length of segment : 414 time for calcul the mask position with numpy : 0.004092693328857422 nb_pixel_total : 91707 time to create 1 rle with old method : 0.13153791427612305 length of segment : 692 time for calcul the mask position with numpy : 0.000675201416015625 nb_pixel_total : 12510 time to create 1 rle with old method : 0.014711380004882812 length of segment : 88 time for calcul the mask position with numpy : 0.0003592967987060547 nb_pixel_total : 11353 time to create 1 rle with old method : 0.013461112976074219 length of segment : 129 time for calcul the mask position with numpy : 0.0011930465698242188 nb_pixel_total : 27394 time to create 1 rle with old method : 0.03181290626525879 length of segment : 194 time for calcul the mask position with numpy : 0.002854585647583008 nb_pixel_total : 71368 time to create 1 rle with old method : 0.08167481422424316 length of segment : 469 time for calcul the mask position with numpy : 0.005814075469970703 nb_pixel_total : 100539 time to create 1 rle with old method : 0.13074803352355957 length of segment : 419 time for calcul the mask position with numpy : 0.0028944015502929688 nb_pixel_total : 63240 time to create 1 rle with old method : 0.07225680351257324 length of segment : 421 time for calcul the mask position with numpy : 0.011329174041748047 nb_pixel_total : 222954 time to create 1 rle with new method : 0.015175104141235352 length of segment : 875 time for calcul the mask position with numpy : 0.0009305477142333984 nb_pixel_total : 22147 time to create 1 rle with old method : 0.025356292724609375 length of segment : 220 time for calcul the mask position with numpy : 0.0006499290466308594 nb_pixel_total : 12605 time to create 1 rle with old method : 0.015269994735717773 length of segment : 93 time for calcul the mask position with numpy : 0.0015251636505126953 nb_pixel_total : 33689 time to create 1 rle with old method : 0.038680076599121094 length of segment : 279 time for calcul the mask position with numpy : 0.0020215511322021484 nb_pixel_total : 36735 time to create 1 rle with old method : 0.042539119720458984 length of segment : 256 time for calcul the mask position with numpy : 0.0012357234954833984 nb_pixel_total : 24956 time to create 1 rle with old method : 0.028437137603759766 length of segment : 256 time for calcul the mask position with numpy : 0.0012176036834716797 nb_pixel_total : 35256 time to create 1 rle with old method : 0.04100513458251953 length of segment : 236 time for calcul the mask position with numpy : 0.0013873577117919922 nb_pixel_total : 64797 time to create 1 rle with old method : 0.07489919662475586 length of segment : 549 time for calcul the mask position with numpy : 0.001809835433959961 nb_pixel_total : 15151 time to create 1 rle with old method : 0.018311738967895508 length of segment : 582 time for calcul the mask position with numpy : 0.00926065444946289 nb_pixel_total : 226086 time to create 1 rle with new method : 0.01244211196899414 length of segment : 626 time for calcul the mask position with numpy : 0.00698399543762207 nb_pixel_total : 146050 time to create 1 rle with old method : 0.16920995712280273 length of segment : 541 time for calcul the mask position with numpy : 0.0005517005920410156 nb_pixel_total : 21625 time to create 1 rle with old method : 0.02512812614440918 length of segment : 333 time for calcul the mask position with numpy : 0.0009529590606689453 nb_pixel_total : 13577 time to create 1 rle with old method : 0.016134023666381836 length of segment : 163 time for calcul the mask position with numpy : 0.0005865097045898438 nb_pixel_total : 9221 time to create 1 rle with old method : 0.011184930801391602 length of segment : 207 time for calcul the mask position with numpy : 0.0032427310943603516 nb_pixel_total : 65365 time to create 1 rle with old method : 0.07802414894104004 length of segment : 385 time for calcul the mask position with numpy : 0.004333972930908203 nb_pixel_total : 127199 time to create 1 rle with old method : 0.14266443252563477 length of segment : 408 time for calcul the mask position with numpy : 0.0026209354400634766 nb_pixel_total : 73123 time to create 1 rle with old method : 0.10127449035644531 length of segment : 298 time for calcul the mask position with numpy : 0.0033805370330810547 nb_pixel_total : 123263 time to create 1 rle with old method : 0.14037728309631348 length of segment : 368 time for calcul the mask position with numpy : 0.0024428367614746094 nb_pixel_total : 52126 time to create 1 rle with old method : 0.06395745277404785 length of segment : 345 time for calcul the mask position with numpy : 0.0016632080078125 nb_pixel_total : 39578 time to create 1 rle with old method : 0.0453038215637207 length of segment : 248 time for calcul the mask position with numpy : 0.0015990734100341797 nb_pixel_total : 28672 time to create 1 rle with old method : 0.044144392013549805 length of segment : 234 time for calcul the mask position with numpy : 0.0008747577667236328 nb_pixel_total : 15915 time to create 1 rle with old method : 0.01839303970336914 length of segment : 184 time for calcul the mask position with numpy : 0.0006608963012695312 nb_pixel_total : 14313 time to create 1 rle with old method : 0.01670074462890625 length of segment : 173 time for calcul the mask position with numpy : 0.0004172325134277344 nb_pixel_total : 12054 time to create 1 rle with old method : 0.014492273330688477 length of segment : 169 time for calcul the mask position with numpy : 0.0006458759307861328 nb_pixel_total : 12442 time to create 1 rle with old method : 0.014596939086914062 length of segment : 178 time for calcul the mask position with numpy : 0.0030210018157958984 nb_pixel_total : 100235 time to create 1 rle with old method : 0.1159067153930664 length of segment : 335 time for calcul the mask position with numpy : 0.001645803451538086 nb_pixel_total : 39958 time to create 1 rle with old method : 0.04537224769592285 length of segment : 329 time for calcul the mask position with numpy : 0.0014178752899169922 nb_pixel_total : 31797 time to create 1 rle with old method : 0.03602480888366699 length of segment : 238 time for calcul the mask position with numpy : 0.0010528564453125 nb_pixel_total : 23923 time to create 1 rle with old method : 0.027257919311523438 length of segment : 205 time for calcul the mask position with numpy : 0.0017962455749511719 nb_pixel_total : 46547 time to create 1 rle with old method : 0.05568718910217285 length of segment : 224 time for calcul the mask position with numpy : 0.0030012130737304688 nb_pixel_total : 94481 time to create 1 rle with old method : 0.1069192886352539 length of segment : 279 time for calcul the mask position with numpy : 0.0007276535034179688 nb_pixel_total : 16019 time to create 1 rle with old method : 0.01880788803100586 length of segment : 179 time for calcul the mask position with numpy : 0.005964756011962891 nb_pixel_total : 87862 time to create 1 rle with old method : 0.12977361679077148 length of segment : 389 time for calcul the mask position with numpy : 0.0007810592651367188 nb_pixel_total : 19763 time to create 1 rle with old method : 0.022822856903076172 length of segment : 160 time for calcul the mask position with numpy : 0.001988649368286133 nb_pixel_total : 52416 time to create 1 rle with old method : 0.06011056900024414 length of segment : 416 time for calcul the mask position with numpy : 0.005108833312988281 nb_pixel_total : 144129 time to create 1 rle with old method : 0.16158151626586914 length of segment : 536 time for calcul the mask position with numpy : 0.0005266666412353516 nb_pixel_total : 12674 time to create 1 rle with old method : 0.015014410018920898 length of segment : 116 time for calcul the mask position with numpy : 0.0028502941131591797 nb_pixel_total : 102805 time to create 1 rle with old method : 0.12049198150634766 length of segment : 278 time for calcul the mask position with numpy : 0.0005981922149658203 nb_pixel_total : 13701 time to create 1 rle with old method : 0.015537023544311523 length of segment : 161 time for calcul the mask position with numpy : 0.0013422966003417969 nb_pixel_total : 44024 time to create 1 rle with old method : 0.050394296646118164 length of segment : 226 time for calcul the mask position with numpy : 0.0006201267242431641 nb_pixel_total : 15493 time to create 1 rle with old method : 0.02474236488342285 length of segment : 129 time for calcul the mask position with numpy : 0.0020329952239990234 nb_pixel_total : 31976 time to create 1 rle with old method : 0.04994320869445801 length of segment : 265 time for calcul the mask position with numpy : 0.0031189918518066406 nb_pixel_total : 43188 time to create 1 rle with old method : 0.04944205284118652 length of segment : 329 time for calcul the mask position with numpy : 0.0014834403991699219 nb_pixel_total : 40169 time to create 1 rle with old method : 0.046118736267089844 length of segment : 192 time for calcul the mask position with numpy : 0.0007464885711669922 nb_pixel_total : 19329 time to create 1 rle with old method : 0.022944211959838867 length of segment : 133 time for calcul the mask position with numpy : 0.005222797393798828 nb_pixel_total : 85369 time to create 1 rle with old method : 0.09907269477844238 length of segment : 494 time for calcul the mask position with numpy : 0.0011892318725585938 nb_pixel_total : 16351 time to create 1 rle with old method : 0.02122807502746582 length of segment : 140 time for calcul the mask position with numpy : 0.0009419918060302734 nb_pixel_total : 14036 time to create 1 rle with old method : 0.01790618896484375 length of segment : 145 time for calcul the mask position with numpy : 0.0006482601165771484 nb_pixel_total : 14554 time to create 1 rle with old method : 0.01728677749633789 length of segment : 106 time for calcul the mask position with numpy : 0.0006804466247558594 nb_pixel_total : 16626 time to create 1 rle with old method : 0.01957988739013672 length of segment : 129 time for calcul the mask position with numpy : 0.003210783004760742 nb_pixel_total : 88816 time to create 1 rle with old method : 0.10008859634399414 length of segment : 415 time for calcul the mask position with numpy : 0.0013020038604736328 nb_pixel_total : 21224 time to create 1 rle with old method : 0.024953603744506836 length of segment : 178 time for calcul the mask position with numpy : 0.0036454200744628906 nb_pixel_total : 50999 time to create 1 rle with old method : 0.05852961540222168 length of segment : 330 time for calcul the mask position with numpy : 0.0007412433624267578 nb_pixel_total : 16447 time to create 1 rle with old method : 0.018735885620117188 length of segment : 182 time for calcul the mask position with numpy : 0.0006780624389648438 nb_pixel_total : 20404 time to create 1 rle with old method : 0.02434396743774414 length of segment : 160 time for calcul the mask position with numpy : 0.0005440711975097656 nb_pixel_total : 15046 time to create 1 rle with old method : 0.017660856246948242 length of segment : 143 time for calcul the mask position with numpy : 0.0006344318389892578 nb_pixel_total : 16899 time to create 1 rle with old method : 0.0199432373046875 length of segment : 138 time for calcul the mask position with numpy : 0.0015363693237304688 nb_pixel_total : 32597 time to create 1 rle with old method : 0.03742504119873047 length of segment : 282 time spent for convertir_results : 22.86047387123108 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 135 chid ids of type : 3594 Number RLEs to save : 44462 save missing photos in datou_result : time spend for datou_step_exec : 108.04510474205017 time spend to save output : 2.9350104331970215 total time spend for step 1 : 110.98011517524719 step2:crop_condition Wed May 14 15:52:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 9 ! batch 1 Loaded 135 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 79 About to insert : list_path_to_insert length 79 new photo from crops ! About to upload 79 photos upload in portfolio : 3736932 init cache_photo without model_param we have 79 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747230761_3291772 we have uploaded 79 photos in the portfolio 3736932 time of upload the photos Elapsed time : 26.18324875831604 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747230792_3291772 we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 12.557281970977783 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747230807_3291772 we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.733607292175293 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 38 About to insert : list_path_to_insert length 38 new photo from crops ! About to upload 38 photos upload in portfolio : 3736932 init cache_photo without model_param we have 38 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747230831_3291772 we have uploaded 38 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.630389928817749 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747230844_3291772 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0544025897979736 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1358221375, 1358221328, 1358220924, 1358220892, 1358220860, 1358220826, 1358220791, 1358220604, 1358220569] Looping around the photos to save general results len do output : 135 /1358248816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358248932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1358249225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358221375', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358221328', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220924', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220892', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220860', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220826', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220791', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220604', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220569', None, None, None, None, None, '2849704') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 414 time used for this insertion : 0.04163408279418945 save_final save missing photos in datou_result : time spend for datou_step_exec : 103.72807312011719 time spend to save output : 0.04564023017883301 total time spend for step 2 : 103.77371335029602 step3:rle_unique_nms_with_priority Wed May 14 15:54:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 135 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 5.9939000606536865 time for calcul the mask position with numpy : 1.3493337631225586 nb_pixel_total : 7751902 time to create 1 rle with new method : 1.147707462310791 time for calcul the mask position with numpy : 0.04061126708984375 nb_pixel_total : 23485 time to create 1 rle with old method : 0.026419878005981445 time for calcul the mask position with numpy : 0.03670191764831543 nb_pixel_total : 48272 time to create 1 rle with old method : 0.07765007019042969 time for calcul the mask position with numpy : 0.04698300361633301 nb_pixel_total : 50593 time to create 1 rle with old method : 0.057747840881347656 time for calcul the mask position with numpy : 0.0449671745300293 nb_pixel_total : 111260 time to create 1 rle with old method : 0.12975788116455078 time for calcul the mask position with numpy : 0.044020891189575195 nb_pixel_total : 55461 time to create 1 rle with old method : 0.06390571594238281 time for calcul the mask position with numpy : 0.04193305969238281 nb_pixel_total : 41946 time to create 1 rle with old method : 0.04787468910217285 time for calcul the mask position with numpy : 0.04541659355163574 nb_pixel_total : 22920 time to create 1 rle with old method : 0.02616119384765625 time for calcul the mask position with numpy : 0.040550947189331055 nb_pixel_total : 31661 time to create 1 rle with old method : 0.03580617904663086 time for calcul the mask position with numpy : 0.04215216636657715 nb_pixel_total : 61961 time to create 1 rle with old method : 0.07024002075195312 time for calcul the mask position with numpy : 0.040695905685424805 nb_pixel_total : 54269 time to create 1 rle with old method : 0.07683849334716797 time for calcul the mask position with numpy : 0.04878830909729004 nb_pixel_total : 16077 time to create 1 rle with old method : 0.01963067054748535 time for calcul the mask position with numpy : 0.045343875885009766 nb_pixel_total : 24593 time to create 1 rle with old method : 0.029917240142822266 create new chi : 3.717785120010376 time to delete rle : 0.02564263343811035 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 9000 TO DO : save crop sub photo not yet done ! save time : 0.6020619869232178 nb_obj : 25 nb_hashtags : 4 time to prepare the origin masks : 15.375964164733887 time for calcul the mask position with numpy : 0.8803119659423828 nb_pixel_total : 6466654 time to create 1 rle with new method : 1.1038780212402344 time for calcul the mask position with numpy : 0.026915788650512695 nb_pixel_total : 107307 time to create 1 rle with old method : 0.12325191497802734 time for calcul the mask position with numpy : 0.02982950210571289 nb_pixel_total : 224307 time to create 1 rle with new method : 1.1983239650726318 time for calcul the mask position with numpy : 0.025372982025146484 nb_pixel_total : 6086 time to create 1 rle with old method : 0.0068988800048828125 time for calcul the mask position with numpy : 0.04222607612609863 nb_pixel_total : 64792 time to create 1 rle with old method : 0.07151436805725098 time for calcul the mask position with numpy : 0.040184974670410156 nb_pixel_total : 29069 time to create 1 rle with old method : 0.03268623352050781 time for calcul the mask position with numpy : 0.04070878028869629 nb_pixel_total : 131913 time to create 1 rle with old method : 0.15114593505859375 time for calcul the mask position with numpy : 0.04346203804016113 nb_pixel_total : 77967 time to create 1 rle with old method : 0.09193158149719238 time for calcul the mask position with numpy : 0.042371511459350586 nb_pixel_total : 86704 time to create 1 rle with old method : 0.09891653060913086 time for calcul the mask position with numpy : 0.04260993003845215 nb_pixel_total : 75616 time to create 1 rle with old method : 0.0850229263305664 time for calcul the mask position with numpy : 0.040877580642700195 nb_pixel_total : 36034 time to create 1 rle with old method : 0.0412297248840332 time for calcul the mask position with numpy : 0.04084968566894531 nb_pixel_total : 4786 time to create 1 rle with old method : 0.005484104156494141 time for calcul the mask position with numpy : 0.042391061782836914 nb_pixel_total : 82747 time to create 1 rle with old method : 0.09269237518310547 time for calcul the mask position with numpy : 0.040711164474487305 nb_pixel_total : 247905 time to create 1 rle with new method : 0.685312032699585 time for calcul the mask position with numpy : 0.02606821060180664 nb_pixel_total : 19970 time to create 1 rle with old method : 0.02212810516357422 time for calcul the mask position with numpy : 0.026189088821411133 nb_pixel_total : 110460 time to create 1 rle with old method : 0.15295648574829102 time for calcul the mask position with numpy : 0.02571415901184082 nb_pixel_total : 41355 time to create 1 rle with old method : 0.046538591384887695 time for calcul the mask position with numpy : 0.026750802993774414 nb_pixel_total : 35095 time to create 1 rle with old method : 0.04003405570983887 time for calcul the mask position with numpy : 0.02684473991394043 nb_pixel_total : 170968 time to create 1 rle with new method : 1.0057311058044434 time for calcul the mask position with numpy : 0.028352975845336914 nb_pixel_total : 35920 time to create 1 rle with old method : 0.04120635986328125 time for calcul the mask position with numpy : 0.025156497955322266 nb_pixel_total : 25934 time to create 1 rle with old method : 0.02899622917175293 time for calcul the mask position with numpy : 0.029164791107177734 nb_pixel_total : 19106 time to create 1 rle with old method : 0.02214503288269043 time for calcul the mask position with numpy : 0.03149557113647461 nb_pixel_total : 118251 time to create 1 rle with old method : 0.13597846031188965 time for calcul the mask position with numpy : 0.02848649024963379 nb_pixel_total : 16748 time to create 1 rle with old method : 0.01922011375427246 time for calcul the mask position with numpy : 0.028750896453857422 nb_pixel_total : 23037 time to create 1 rle with old method : 0.026642799377441406 time for calcul the mask position with numpy : 0.026670217514038086 nb_pixel_total : 35669 time to create 1 rle with old method : 0.040367841720581055 create new chi : 7.217946529388428 time to delete rle : 0.004582643508911133 batch 1 Loaded 51 chid ids of type : 3594 +++++++++++++++++++++++++++++Number RLEs to save : 20101 TO DO : save crop sub photo not yet done ! save time : 1.2822895050048828 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 5.500834703445435 time for calcul the mask position with numpy : 0.7096250057220459 nb_pixel_total : 6458844 time to create 1 rle with new method : 0.9776792526245117 time for calcul the mask position with numpy : 0.025336503982543945 nb_pixel_total : 31282 time to create 1 rle with old method : 0.03546857833862305 time for calcul the mask position with numpy : 0.02548384666442871 nb_pixel_total : 83015 time to create 1 rle with old method : 0.09404516220092773 time for calcul the mask position with numpy : 0.025665998458862305 nb_pixel_total : 63927 time to create 1 rle with old method : 0.07234072685241699 time for calcul the mask position with numpy : 0.03749370574951172 nb_pixel_total : 1072160 time to create 1 rle with new method : 0.47971415519714355 time for calcul the mask position with numpy : 0.04190492630004883 nb_pixel_total : 15023 time to create 1 rle with old method : 0.01755976676940918 time for calcul the mask position with numpy : 0.03454899787902832 nb_pixel_total : 103406 time to create 1 rle with old method : 0.1157693862915039 time for calcul the mask position with numpy : 0.03385329246520996 nb_pixel_total : 278987 time to create 1 rle with new method : 0.7287256717681885 time for calcul the mask position with numpy : 0.03216242790222168 nb_pixel_total : 71974 time to create 1 rle with old method : 0.08152461051940918 time for calcul the mask position with numpy : 0.02796649932861328 nb_pixel_total : 115782 time to create 1 rle with old method : 0.1327066421508789 create new chi : 3.8380286693573 time to delete rle : 0.001711130142211914 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++Number RLEs to save : 11916 TO DO : save crop sub photo not yet done ! save time : 0.7713882923126221 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 5.153963327407837 time for calcul the mask position with numpy : 0.7207217216491699 nb_pixel_total : 7455517 time to create 1 rle with new method : 0.7983639240264893 time for calcul the mask position with numpy : 0.03267693519592285 nb_pixel_total : 25566 time to create 1 rle with old method : 0.027704477310180664 time for calcul the mask position with numpy : 0.025323867797851562 nb_pixel_total : 186795 time to create 1 rle with new method : 0.6894218921661377 time for calcul the mask position with numpy : 0.029858827590942383 nb_pixel_total : 139984 time to create 1 rle with old method : 0.15981841087341309 time for calcul the mask position with numpy : 0.027591228485107422 nb_pixel_total : 120259 time to create 1 rle with old method : 0.13190436363220215 time for calcul the mask position with numpy : 0.024936676025390625 nb_pixel_total : 35491 time to create 1 rle with old method : 0.04176521301269531 time for calcul the mask position with numpy : 0.024417400360107422 nb_pixel_total : 15526 time to create 1 rle with old method : 0.017548799514770508 time for calcul the mask position with numpy : 0.02714705467224121 nb_pixel_total : 130675 time to create 1 rle with old method : 0.1455531120300293 time for calcul the mask position with numpy : 0.02582573890686035 nb_pixel_total : 60940 time to create 1 rle with old method : 0.06726360321044922 time for calcul the mask position with numpy : 0.026820898056030273 nb_pixel_total : 123647 time to create 1 rle with old method : 0.13468122482299805 create new chi : 3.2539961338043213 time to delete rle : 0.0012471675872802734 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 9246 TO DO : save crop sub photo not yet done ! save time : 0.6217577457427979 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 7.350822687149048 time for calcul the mask position with numpy : 0.8314929008483887 nb_pixel_total : 7464027 time to create 1 rle with new method : 1.0748624801635742 time for calcul the mask position with numpy : 0.026333093643188477 nb_pixel_total : 210671 time to create 1 rle with new method : 1.1887798309326172 time for calcul the mask position with numpy : 0.026044845581054688 nb_pixel_total : 80900 time to create 1 rle with old method : 0.0954132080078125 time for calcul the mask position with numpy : 0.026788711547851562 nb_pixel_total : 4548 time to create 1 rle with old method : 0.0053119659423828125 time for calcul the mask position with numpy : 0.028212547302246094 nb_pixel_total : 36805 time to create 1 rle with old method : 0.0418088436126709 time for calcul the mask position with numpy : 0.0275418758392334 nb_pixel_total : 32715 time to create 1 rle with old method : 0.041727542877197266 time for calcul the mask position with numpy : 0.02680373191833496 nb_pixel_total : 101325 time to create 1 rle with old method : 0.11468839645385742 time for calcul the mask position with numpy : 0.025295734405517578 nb_pixel_total : 80300 time to create 1 rle with old method : 0.0892186164855957 time for calcul the mask position with numpy : 0.027788162231445312 nb_pixel_total : 36843 time to create 1 rle with old method : 0.041169166564941406 time for calcul the mask position with numpy : 0.02525472640991211 nb_pixel_total : 9858 time to create 1 rle with old method : 0.011575460433959961 time for calcul the mask position with numpy : 0.02654409408569336 nb_pixel_total : 11532 time to create 1 rle with old method : 0.01337575912475586 time for calcul the mask position with numpy : 0.027240991592407227 nb_pixel_total : 115527 time to create 1 rle with old method : 0.1309504508972168 time for calcul the mask position with numpy : 0.02802586555480957 nb_pixel_total : 94499 time to create 1 rle with old method : 0.10726499557495117 time for calcul the mask position with numpy : 0.026874065399169922 nb_pixel_total : 14850 time to create 1 rle with old method : 0.017253398895263672 create new chi : 4.232873439788818 time to delete rle : 0.0017731189727783203 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 10138 TO DO : save crop sub photo not yet done ! save time : 0.6690096855163574 nb_obj : 23 nb_hashtags : 2 time to prepare the origin masks : 13.471946477890015 time for calcul the mask position with numpy : 0.9598972797393799 nb_pixel_total : 6911805 time to create 1 rle with new method : 0.9897551536560059 time for calcul the mask position with numpy : 0.02553391456604004 nb_pixel_total : 8196 time to create 1 rle with old method : 0.009440422058105469 time for calcul the mask position with numpy : 0.026632070541381836 nb_pixel_total : 325 time to create 1 rle with old method : 0.0005102157592773438 time for calcul the mask position with numpy : 0.028839111328125 nb_pixel_total : 13114 time to create 1 rle with old method : 0.01526021957397461 time for calcul the mask position with numpy : 0.028376102447509766 nb_pixel_total : 146050 time to create 1 rle with old method : 0.1652085781097412 time for calcul the mask position with numpy : 0.02876424789428711 nb_pixel_total : 226086 time to create 1 rle with new method : 1.1141064167022705 time for calcul the mask position with numpy : 0.02746105194091797 nb_pixel_total : 13348 time to create 1 rle with old method : 0.01572728157043457 time for calcul the mask position with numpy : 0.027364730834960938 nb_pixel_total : 64783 time to create 1 rle with old method : 0.09835672378540039 time for calcul the mask position with numpy : 0.0455472469329834 nb_pixel_total : 35256 time to create 1 rle with old method : 0.03995370864868164 time for calcul the mask position with numpy : 0.04324054718017578 nb_pixel_total : 24956 time to create 1 rle with old method : 0.02853107452392578 time for calcul the mask position with numpy : 0.05600428581237793 nb_pixel_total : 36735 time to create 1 rle with old method : 0.06595873832702637 time for calcul the mask position with numpy : 0.05314326286315918 nb_pixel_total : 33689 time to create 1 rle with old method : 0.05463743209838867 time for calcul the mask position with numpy : 0.05274033546447754 nb_pixel_total : 12605 time to create 1 rle with old method : 0.019895315170288086 time for calcul the mask position with numpy : 0.0318906307220459 nb_pixel_total : 22147 time to create 1 rle with old method : 0.04090166091918945 time for calcul the mask position with numpy : 0.03159523010253906 nb_pixel_total : 216356 time to create 1 rle with new method : 0.8150713443756104 time for calcul the mask position with numpy : 0.029819250106811523 nb_pixel_total : 63240 time to create 1 rle with old method : 0.07660174369812012 time for calcul the mask position with numpy : 0.03165769577026367 nb_pixel_total : 100539 time to create 1 rle with old method : 0.12969207763671875 time for calcul the mask position with numpy : 0.03147411346435547 nb_pixel_total : 71368 time to create 1 rle with old method : 0.08332610130310059 time for calcul the mask position with numpy : 0.03366661071777344 nb_pixel_total : 27394 time to create 1 rle with old method : 0.040070533752441406 time for calcul the mask position with numpy : 0.031038761138916016 nb_pixel_total : 11248 time to create 1 rle with old method : 0.012894868850708008 time for calcul the mask position with numpy : 0.03159976005554199 nb_pixel_total : 12510 time to create 1 rle with old method : 0.014292240142822266 time for calcul the mask position with numpy : 0.03355240821838379 nb_pixel_total : 91707 time to create 1 rle with old method : 0.1290738582611084 time for calcul the mask position with numpy : 0.04310131072998047 nb_pixel_total : 36722 time to create 1 rle with old method : 0.04997372627258301 time for calcul the mask position with numpy : 0.04814743995666504 nb_pixel_total : 114221 time to create 1 rle with old method : 0.13175320625305176 create new chi : 6.163878440856934 time to delete rle : 0.004737138748168945 batch 1 Loaded 47 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 17868 TO DO : save crop sub photo not yet done ! save time : 1.287747859954834 nb_obj : 13 nb_hashtags : 2 time to prepare the origin masks : 7.419865131378174 time for calcul the mask position with numpy : 0.43688035011291504 nb_pixel_total : 7590157 time to create 1 rle with new method : 0.9983608722686768 time for calcul the mask position with numpy : 0.041802406311035156 nb_pixel_total : 39958 time to create 1 rle with old method : 0.04684615135192871 time for calcul the mask position with numpy : 0.04279041290283203 nb_pixel_total : 100235 time to create 1 rle with old method : 0.11065864562988281 time for calcul the mask position with numpy : 0.04082918167114258 nb_pixel_total : 12442 time to create 1 rle with old method : 0.01404881477355957 time for calcul the mask position with numpy : 0.03998923301696777 nb_pixel_total : 12054 time to create 1 rle with old method : 0.013692617416381836 time for calcul the mask position with numpy : 0.04372239112854004 nb_pixel_total : 14313 time to create 1 rle with old method : 0.0231020450592041 time for calcul the mask position with numpy : 0.04671430587768555 nb_pixel_total : 15915 time to create 1 rle with old method : 0.018096446990966797 time for calcul the mask position with numpy : 0.03713679313659668 nb_pixel_total : 28672 time to create 1 rle with old method : 0.032242774963378906 time for calcul the mask position with numpy : 0.027016162872314453 nb_pixel_total : 39578 time to create 1 rle with old method : 0.0449371337890625 time for calcul the mask position with numpy : 0.02704334259033203 nb_pixel_total : 52126 time to create 1 rle with old method : 0.05851268768310547 time for calcul the mask position with numpy : 0.02622509002685547 nb_pixel_total : 123263 time to create 1 rle with old method : 0.14109349250793457 time for calcul the mask position with numpy : 0.028926372528076172 nb_pixel_total : 73123 time to create 1 rle with old method : 0.08315205574035645 time for calcul the mask position with numpy : 0.029927492141723633 nb_pixel_total : 127199 time to create 1 rle with old method : 0.14294171333312988 time for calcul the mask position with numpy : 0.025897741317749023 nb_pixel_total : 65365 time to create 1 rle with old method : 0.07312202453613281 create new chi : 2.7439560890197754 time to delete rle : 0.0014200210571289062 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 9468 TO DO : save crop sub photo not yet done ! save time : 0.7803378105163574 nb_obj : 13 nb_hashtags : 5 time to prepare the origin masks : 9.441333532333374 time for calcul the mask position with numpy : 0.9839458465576172 nb_pixel_total : 7610188 time to create 1 rle with new method : 1.6502060890197754 time for calcul the mask position with numpy : 0.044936418533325195 nb_pixel_total : 44024 time to create 1 rle with old method : 0.05516767501831055 time for calcul the mask position with numpy : 0.04542064666748047 nb_pixel_total : 13701 time to create 1 rle with old method : 0.015679359436035156 time for calcul the mask position with numpy : 0.04162931442260742 nb_pixel_total : 102805 time to create 1 rle with old method : 0.11655712127685547 time for calcul the mask position with numpy : 0.04165530204772949 nb_pixel_total : 12674 time to create 1 rle with old method : 0.01436305046081543 time for calcul the mask position with numpy : 0.04502272605895996 nb_pixel_total : 144066 time to create 1 rle with old method : 0.16231226921081543 time for calcul the mask position with numpy : 0.04883599281311035 nb_pixel_total : 46644 time to create 1 rle with old method : 0.05310344696044922 time for calcul the mask position with numpy : 0.04358673095703125 nb_pixel_total : 19763 time to create 1 rle with old method : 0.022464513778686523 time for calcul the mask position with numpy : 0.04403543472290039 nb_pixel_total : 87768 time to create 1 rle with old method : 0.1033029556274414 time for calcul the mask position with numpy : 0.04576230049133301 nb_pixel_total : 16019 time to create 1 rle with old method : 0.01848912239074707 time for calcul the mask position with numpy : 0.045819759368896484 nb_pixel_total : 94481 time to create 1 rle with old method : 0.10566329956054688 time for calcul the mask position with numpy : 0.04236197471618652 nb_pixel_total : 46547 time to create 1 rle with old method : 0.054183244705200195 time for calcul the mask position with numpy : 0.04732060432434082 nb_pixel_total : 23923 time to create 1 rle with old method : 0.03899550437927246 time for calcul the mask position with numpy : 0.041559696197509766 nb_pixel_total : 31797 time to create 1 rle with old method : 0.034960031509399414 create new chi : 4.0554420948028564 time to delete rle : 0.0024118423461914062 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 8725 TO DO : save crop sub photo not yet done ! save time : 0.6128215789794922 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 10.00873851776123 time for calcul the mask position with numpy : 1.1050050258636475 nb_pixel_total : 7734877 time to create 1 rle with new method : 0.9055271148681641 time for calcul the mask position with numpy : 0.04243779182434082 nb_pixel_total : 32597 time to create 1 rle with old method : 0.037071943283081055 time for calcul the mask position with numpy : 0.041161537170410156 nb_pixel_total : 16899 time to create 1 rle with old method : 0.026174068450927734 time for calcul the mask position with numpy : 0.04601335525512695 nb_pixel_total : 15046 time to create 1 rle with old method : 0.020224809646606445 time for calcul the mask position with numpy : 0.028910398483276367 nb_pixel_total : 20404 time to create 1 rle with old method : 0.025578975677490234 time for calcul the mask position with numpy : 0.026690244674682617 nb_pixel_total : 16447 time to create 1 rle with old method : 0.024660110473632812 time for calcul the mask position with numpy : 0.03852725028991699 nb_pixel_total : 50999 time to create 1 rle with old method : 0.07126808166503906 time for calcul the mask position with numpy : 0.04870033264160156 nb_pixel_total : 21224 time to create 1 rle with old method : 0.03447079658508301 time for calcul the mask position with numpy : 0.05309796333312988 nb_pixel_total : 88816 time to create 1 rle with old method : 0.11719846725463867 time for calcul the mask position with numpy : 0.0456850528717041 nb_pixel_total : 16626 time to create 1 rle with old method : 0.019730329513549805 time for calcul the mask position with numpy : 0.046456098556518555 nb_pixel_total : 14554 time to create 1 rle with old method : 0.021127939224243164 time for calcul the mask position with numpy : 0.04656982421875 nb_pixel_total : 14036 time to create 1 rle with old method : 0.016362905502319336 time for calcul the mask position with numpy : 0.04888582229614258 nb_pixel_total : 16351 time to create 1 rle with old method : 0.01886725425720215 time for calcul the mask position with numpy : 0.027704477310180664 nb_pixel_total : 85369 time to create 1 rle with old method : 0.09918451309204102 time for calcul the mask position with numpy : 0.028041601181030273 nb_pixel_total : 19329 time to create 1 rle with old method : 0.0243682861328125 time for calcul the mask position with numpy : 0.028382062911987305 nb_pixel_total : 40169 time to create 1 rle with old method : 0.05472826957702637 time for calcul the mask position with numpy : 0.032227516174316406 nb_pixel_total : 43188 time to create 1 rle with old method : 0.06830024719238281 time for calcul the mask position with numpy : 0.0291903018951416 nb_pixel_total : 31976 time to create 1 rle with old method : 0.03635549545288086 time for calcul the mask position with numpy : 0.02583479881286621 nb_pixel_total : 15493 time to create 1 rle with old method : 0.017639875411987305 create new chi : 3.4926564693450928 time to delete rle : 0.0017161369323730469 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 9940 TO DO : save crop sub photo not yet done ! save time : 0.6572484970092773 map_output_result : {1358221375: (0.0, 'Should be the crop_list due to order', 0), 1358221328: (0.0, 'Should be the crop_list due to order', 0), 1358220924: (0.0, 'Should be the crop_list due to order', 0), 1358220892: (0.0, 'Should be the crop_list due to order', 0), 1358220860: (0.0, 'Should be the crop_list due to order', 0), 1358220826: (0.0, 'Should be the crop_list due to order', 0), 1358220791: (0.0, 'Should be the crop_list due to order', 0), 1358220604: (0.0, 'Should be the crop_list due to order', 0), 1358220569: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1358221375, 1358221328, 1358220924, 1358220892, 1358220860, 1358220826, 1358220791, 1358220604, 1358220569] Looping around the photos to save general results len do output : 9 /1358221375.Didn't retrieve data . /1358221328.Didn't retrieve data . /1358220924.Didn't retrieve data . /1358220892.Didn't retrieve data . /1358220860.Didn't retrieve data . /1358220826.Didn't retrieve data . /1358220791.Didn't retrieve data . /1358220604.Didn't retrieve data . /1358220569.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358221375', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358221328', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220924', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220892', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220860', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220826', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220791', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220604', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220569', None, None, None, None, None, '2849704') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.02514171600341797 save_final save missing photos in datou_result : time spend for datou_step_exec : 127.24725222587585 time spend to save output : 0.026679277420043945 total time spend for step 3 : 127.2739315032959 step4:ventilate_hashtags_in_portfolio Wed May 14 15:56:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22967479 get user id for portfolio 22967479 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22967479 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','carton','mal_croppe','flou','pet_fonce','pehd','pet_clair','autre','papier','metal','environnement')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22967479 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','carton','mal_croppe','flou','pet_fonce','pehd','pet_clair','autre','papier','metal','environnement')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22967479 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','carton','mal_croppe','flou','pet_fonce','pehd','pet_clair','autre','papier','metal','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22968650,22968651,22968652,22968653,22968654,22968655,22968656,22968657,22968658,22968659,22968660?tags=background,carton,mal_croppe,flou,pet_fonce,pehd,pet_clair,autre,papier,metal,environnement Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1358221375, 1358221328, 1358220924, 1358220892, 1358220860, 1358220826, 1358220791, 1358220604, 1358220569] Looping around the photos to save general results len do output : 1 /22967479. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358221375', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358221328', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220924', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220892', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220860', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220826', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220791', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220604', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220569', None, None, None, None, None, '2849704') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.01735520362854004 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.714189052581787 time spend to save output : 0.01799178123474121 total time spend for step 4 : 1.7321808338165283 step5:final Wed May 14 15:56:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1358221375: ('0.12331786104681071',), 1358221328: ('0.12331786104681071',), 1358220924: ('0.12331786104681071',), 1358220892: ('0.12331786104681071',), 1358220860: ('0.12331786104681071',), 1358220826: ('0.12331786104681071',), 1358220791: ('0.12331786104681071',), 1358220604: ('0.12331786104681071',), 1358220569: ('0.12331786104681071',)} new output for save of step final : {1358221375: ('0.12331786104681071',), 1358221328: ('0.12331786104681071',), 1358220924: ('0.12331786104681071',), 1358220892: ('0.12331786104681071',), 1358220860: ('0.12331786104681071',), 1358220826: ('0.12331786104681071',), 1358220791: ('0.12331786104681071',), 1358220604: ('0.12331786104681071',), 1358220569: ('0.12331786104681071',)} [1358221375, 1358221328, 1358220924, 1358220892, 1358220860, 1358220826, 1358220791, 1358220604, 1358220569] Looping around the photos to save general results len do output : 9 /1358221375.Didn't retrieve data . /1358221328.Didn't retrieve data . /1358220924.Didn't retrieve data . /1358220892.Didn't retrieve data . /1358220860.Didn't retrieve data . /1358220826.Didn't retrieve data . /1358220791.Didn't retrieve data . /1358220604.Didn't retrieve data . /1358220569.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358221375', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358221328', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220924', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220892', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220860', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220826', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220791', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220604', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220569', None, None, None, None, None, '2849704') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.014467954635620117 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11761188507080078 time spend to save output : 0.01535487174987793 total time spend for step 5 : 0.1329667568206787 step6:blur_detection Wed May 14 15:56:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df.jpg resize: (2160, 3840) 1358221375 -6.50075311675284 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9.jpg resize: (2160, 3840) 1358221328 -6.388685246214852 treat image : temp/1747230629_3291772_1358220924_29e29a77d84b83beeed71b114531d14b.jpg resize: (2160, 3840) 1358220924 -5.340135191312917 treat image : temp/1747230629_3291772_1358220892_e9ff2c4acc884daadb395cb27bc3d3bc.jpg resize: (2160, 3840) 1358220892 -5.694301790676793 treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77.jpg resize: (2160, 3840) 1358220860 -5.650882861771145 treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834.jpg resize: (2160, 3840) 1358220826 -6.383471836883609 treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c.jpg resize: (2160, 3840) 1358220791 -6.499292336733569 treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60.jpg resize: (2160, 3840) 1358220604 -5.930602352720259 treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb.jpg resize: (2160, 3840) 1358220569 -5.983232146531604 treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df_rle_crop_3797430383_0.png resize: (368, 433) 1358248816 -4.03714388254329 treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df_rle_crop_3797430378_0.png resize: (310, 373) 1358248818 -0.9457641419388857 treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df_rle_crop_3797430379_0.png resize: (161, 228) 1358248819 -4.196695133501598 treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df_rle_crop_3797430384_0.png resize: (225, 328) 1358248820 -3.653124729748293 treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df_rle_crop_3797430386_0.png resize: (178, 194) 1358248822 -3.673817273018651 treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df_rle_crop_3797430382_0.png resize: (352, 390) 1358248824 -2.7120755989516954 treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df_rle_crop_3797430376_0.png resize: (131, 201) 1358248827 -3.9480652181906004 treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df_rle_crop_3797430380_0.png resize: (277, 131) 1358248828 -4.621294330436839 treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df_rle_crop_3797430381_0.png resize: (366, 169) 1358248829 -3.4907877071109805 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430393_0.png resize: (262, 190) 1358248831 -3.1838888204356652 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430387_0.png resize: (150, 286) 1358248832 -0.3625529821445082 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430403_0.png resize: (365, 325) 1358248834 -1.4974085638248198 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430388_0.png resize: (121, 215) 1358248835 0.056038049595503306 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430407_0.png resize: (313, 169) 1358248837 -3.9314733955384416 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430409_0.png resize: (147, 74) 1358248838 -2.2820411396891545 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430392_0.png resize: (214, 223) 1358248839 -2.5947006043668415 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430398_0.png resize: (156, 159) 1358248841 -2.372327510712862 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430397_0.png resize: (628, 286) 1358248842 -4.4661834582768485 treat image : temp/1747230629_3291772_1358220924_29e29a77d84b83beeed71b114531d14b_rle_crop_3797430413_0.png resize: (508, 219) 1358248844 -3.46068711885347 treat image : temp/1747230629_3291772_1358220924_29e29a77d84b83beeed71b114531d14b_rle_crop_3797430418_0.png resize: (236, 306) 1358248845 -4.588497355511866 treat image : temp/1747230629_3291772_1358220924_29e29a77d84b83beeed71b114531d14b_rle_crop_3797430412_0.png resize: (225, 659) 1358248847 -3.6258298192907685 treat image : temp/1747230629_3291772_1358220892_e9ff2c4acc884daadb395cb27bc3d3bc_rle_crop_3797430425_0.png resize: (391, 354) 1358248848 -3.2966763768546348 treat image : temp/1747230629_3291772_1358220892_e9ff2c4acc884daadb395cb27bc3d3bc_rle_crop_3797430429_0.png resize: (210, 178) 1358248851 -2.1970938379364156 treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430433_0.png resize: (258, 102) 1358248854 -4.261493473969272 treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430430_0.png resize: (141, 137) 1358248856 -2.9799862684271377 treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430440_0.png resize: (60, 166) 1358248859 -0.9467396007302731 treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430435_0.png resize: (225, 274) 1358248860 -2.348143187509527 treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430438_0.png resize: (374, 147) 1358248862 -3.5845109281778234 treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430434_0.png resize: (133, 136) 1358248865 -3.213391257848573 treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430463_0.png resize: (273, 124) 1358248866 -3.4554566462270873 treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430461_0.png resize: (624, 591) 1358248867 -4.082641417012096 treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430458_0.png resize: (250, 201) 1358248869 -4.289894746885825 treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430455_0.png resize: (264, 171) 1358248870 -3.714572049815645 treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430448_0.png resize: (174, 232) 1358248871 -1.1807149402874573 treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430454_0.png resize: (89, 203) 1358248873 -3.357599564179956 treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430462_0.png resize: (541, 473) 1358248874 -2.7296950430667715 treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430460_0.png resize: (337, 215) 1358248875 -3.5740168958613845 treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430456_0.png resize: (256, 256) 1358248877 -0.9068217015468947 treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430457_0.png resize: (248, 128) 1358248878 -3.8997163587159074 treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430450_0.png resize: (400, 409) 1358248879 -4.558934934872161 treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430465_0.png resize: (118, 153) 1358248881 -3.593239417021693 treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430446_0.png resize: (84, 224) 1358248882 -2.61303053845805 treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430445_0.png resize: (542, 315) 1358248883 -3.309526832991985 treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430453_0.png resize: (220, 118) 1358248885 -2.784187631090707 treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430444_0.png resize: (414, 221) 1358248886 -3.8429519067540467 treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430464_0.png resize: (163, 139) 1358248887 -3.593025148159798 treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430447_0.png resize: (129, 118) 1358248889 -4.1360394176513235 treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430443_0.png resize: (449, 428) 1358248890 -0.98116234482599 treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430470_0.png resize: (328, 200) 1358248891 -2.8787086798552237 treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430475_0.png resize: (159, 85) 1358248893 -0.7355504628573606 treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430473_0.png resize: (164, 117) 1358248894 -3.780779586234067 treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430474_0.png resize: (172, 108) 1358248895 -4.003962902234684 treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430478_0.png resize: (255, 231) 1358248897 -3.529498936425855 treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430468_0.png resize: (288, 357) 1358248899 -4.446240972692559 treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430467_0.png resize: (408, 467) 1358248900 -4.117752056539153 treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430476_0.png resize: (178, 103) 1358248902 -3.783394010980606 treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430472_0.png resize: (230, 226) 1358248903 -3.5996358724638493 treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430477_0.png resize: (333, 383) 1358248904 -3.0983900371973623 treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430479_0.png resize: (220, 252) 1358248906 -1.9710698026157725 treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430486_0.png resize: (355, 315) 1358248907 -3.9269044474807946 treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430488_0.png resize: (116, 149) 1358248908 -2.135281079570821 treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430487_0.png resize: (536, 389) 1358248910 -5.761247038873438 treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430490_0.png resize: (161, 107) 1358248911 -4.13435013010872 treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430493_0.png resize: (265, 222) 1358248912 -3.121581529061322 treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430505_0.png resize: (173, 124) 1358248914 -4.068327782523938 treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430507_0.png resize: (143, 136) 1358248915 -3.1929247444229225 treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430492_0.png resize: (128, 137) 1358248916 -2.47478694112267 treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430496_0.png resize: (132, 174) 1358248918 -3.882831234607766 treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430497_0.png resize: (362, 440) 1358248919 -4.39251190072593 treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430500_0.png resize: (104, 154) 1358248920 -2.3811112599898165 treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430494_0.png resize: (329, 314) 1358248921 -2.698874765223788 treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430508_0.png resize: (138, 160) 1358248923 -2.405349443906555 treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430504_0.png resize: (285, 254) 1358248924 -3.9901273442669414 treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430503_0.png resize: (176, 192) 1358248925 -2.9289964303347236 treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430501_0.png resize: (128, 160) 1358248927 -4.2638782343858965 treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430506_0.png resize: (160, 166) 1358248928 -4.296462053543151 treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430498_0.png resize: (137, 182) 1358248929 -4.537232092666984 treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430495_0.png resize: (191, 268) 1358248931 -3.2546142357397114 treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430499_0.png resize: (145, 135) 1358248932 -4.6476955924645145 treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df_rle_crop_3797430375_0.png resize: (103, 300) 1358249076 -1.529959246357602 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430389_0.png resize: (166, 176) 1358249077 -3.6879814043645527 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430411_0.png resize: (372, 369) 1358249079 -2.2002980732193445 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430396_0.png resize: (430, 164) 1358249080 -2.775759808913439 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430401_0.png resize: (135, 64) 1358249081 -4.2322168246985825 treat image : temp/1747230629_3291772_1358220924_29e29a77d84b83beeed71b114531d14b_rle_crop_3797430416_0.png resize: (169, 114) 1358249083 -2.626406232891382 treat image : temp/1747230629_3291772_1358220892_e9ff2c4acc884daadb395cb27bc3d3bc_rle_crop_3797430423_0.png resize: (427, 464) 1358249084 -3.0290786365905156 treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430442_0.png resize: (756, 381) 1358249085 -3.9685877397753124 treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430480_0.png resize: (205, 188) 1358249087 -4.354696426274655 treat image : temp/1747230629_3291772_1358220924_29e29a77d84b83beeed71b114531d14b_rle_crop_3797430420_0.png resize: (166, 216) 1358249101 -4.14459434364201 treat image : temp/1747230629_3291772_1358220892_e9ff2c4acc884daadb395cb27bc3d3bc_rle_crop_3797430424_0.png resize: (134, 163) 1358249102 -4.053038684368052 treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430485_0.png resize: (160, 155) 1358249103 -4.944984571367684 treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430481_0.png resize: (224, 338) 1358249104 -4.9131279270314 treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430483_0.png resize: (178, 107) 1358249105 -4.333438739335114 treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430509_0.png resize: (276, 178) 1358249106 -3.9000288057538297 treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df_rle_crop_3797430377_0.png resize: (353, 181) 1358249170 -3.6275055912714698 treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df_rle_crop_3797430385_0.png resize: (233, 318) 1358249171 -3.28404991858759 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430400_0.png resize: (433, 255) 1358249172 -5.101839136640639 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430399_0.png resize: (630, 568) 1358249173 -4.05038442839993 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430394_0.png resize: (378, 625) 1358249174 -4.359506843691097 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430402_0.png resize: (210, 211) 1358249175 -4.163441060873521 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430408_0.png resize: (204, 473) 1358249176 -3.8269985721028728 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430405_0.png resize: (306, 388) 1358249177 -3.655071523315475 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430395_0.png resize: (185, 291) 1358249178 -3.3417374230031482 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430390_0.png resize: (427, 465) 1358249179 -4.117269711161502 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430391_0.png resize: (114, 181) 1358249180 -0.2442298806413059 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430410_0.png resize: (773, 351) 1358249182 -3.0795320050015835 treat image : temp/1747230629_3291772_1358220924_29e29a77d84b83beeed71b114531d14b_rle_crop_3797430417_0.png resize: (1181, 1827) 1358249183 -4.4523699557514655 treat image : temp/1747230629_3291772_1358220924_29e29a77d84b83beeed71b114531d14b_rle_crop_3797430415_0.png resize: (619, 234) 1358249184 -4.386300623084749 treat image : temp/1747230629_3291772_1358220924_29e29a77d84b83beeed71b114531d14b_rle_crop_3797430419_0.png resize: (481, 239) 1358249185 -4.179065028083844 treat image : temp/1747230629_3291772_1358220924_29e29a77d84b83beeed71b114531d14b_rle_crop_3797430414_0.png resize: (639, 764) 1358249187 -4.221365332486194 treat image : temp/1747230629_3291772_1358220892_e9ff2c4acc884daadb395cb27bc3d3bc_rle_crop_3797430427_0.png resize: (401, 553) 1358249188 -3.0716330925537347 treat image : temp/1747230629_3291772_1358220892_e9ff2c4acc884daadb395cb27bc3d3bc_rle_crop_3797430421_0.png resize: (376, 430) 1358249189 -5.14565150633514 treat image : temp/1747230629_3291772_1358220892_e9ff2c4acc884daadb395cb27bc3d3bc_rle_crop_3797430422_0.png resize: (197, 393) 1358249191 -3.2524449745001736 treat image : temp/1747230629_3291772_1358220892_e9ff2c4acc884daadb395cb27bc3d3bc_rle_crop_3797430426_0.png resize: (469, 412) 1358249192 -4.2168839219807515 treat image : temp/1747230629_3291772_1358220892_e9ff2c4acc884daadb395cb27bc3d3bc_rle_crop_3797430428_0.png resize: (476, 492) 1358249193 -3.5994462539892185 treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430437_0.png resize: (356, 445) 1358249195 -4.264376796756732 treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430431_0.png resize: (304, 517) 1358249196 -4.114064430882056 treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430436_0.png resize: (232, 521) 1358249197 -4.0203453960140765 treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430441_0.png resize: (331, 346) 1358249199 -3.037149135979848 treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430432_0.png resize: (376, 482) 1358249200 -2.76141165159953 treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430439_0.png resize: (195, 268) 1358249201 -3.347155287362262 treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430449_0.png resize: (458, 200) 1358249203 -4.955446803209235 treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430452_0.png resize: (722, 524) 1358249204 -4.91032284245278 treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430459_0.png resize: (249, 411) 1358249205 -4.880061042892643 treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430451_0.png resize: (421, 220) 1358249206 -4.200638966062897 treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430471_0.png resize: (242, 212) 1358249207 -4.1811351019352765 treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430469_0.png resize: (367, 447) 1358249208 -4.199187078815861 treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430466_0.png resize: (384, 251) 1358249209 -3.407390123287356 treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430484_0.png resize: (429, 631) 1358249210 -3.042396942149306 treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430489_0.png resize: (272, 445) 1358249211 -5.274563383150668 treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430482_0.png resize: (275, 445) 1358249212 -4.6646379604512065 treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430502_0.png resize: (386, 281) 1358249213 -4.653045069311459 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430406_0.png resize: (338, 459) 1358249223 -4.189072806471513 treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430404_0.png resize: (456, 297) 1358249224 -3.8304778681452913 treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430491_0.png resize: (199, 325) 1358249225 -5.118604658489972 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 144 time used for this insertion : 0.019161462783813477 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 144 time used for this insertion : 0.030778169631958008 save missing photos in datou_result : time spend for datou_step_exec : 45.673115253448486 time spend to save output : 0.05668067932128906 total time spend for step 6 : 45.729795932769775 step7:brightness Wed May 14 15:57:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df.jpg treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9.jpg treat image : temp/1747230629_3291772_1358220924_29e29a77d84b83beeed71b114531d14b.jpg treat image : temp/1747230629_3291772_1358220892_e9ff2c4acc884daadb395cb27bc3d3bc.jpg treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77.jpg treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834.jpg treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c.jpg treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60.jpg treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb.jpg treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df_rle_crop_3797430383_0.png treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df_rle_crop_3797430378_0.png treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df_rle_crop_3797430379_0.png treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df_rle_crop_3797430384_0.png treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df_rle_crop_3797430386_0.png treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df_rle_crop_3797430382_0.png treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df_rle_crop_3797430376_0.png treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df_rle_crop_3797430380_0.png treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df_rle_crop_3797430381_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430393_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430387_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430403_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430388_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430407_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430409_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430392_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430398_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430397_0.png treat image : temp/1747230629_3291772_1358220924_29e29a77d84b83beeed71b114531d14b_rle_crop_3797430413_0.png treat image : temp/1747230629_3291772_1358220924_29e29a77d84b83beeed71b114531d14b_rle_crop_3797430418_0.png treat image : temp/1747230629_3291772_1358220924_29e29a77d84b83beeed71b114531d14b_rle_crop_3797430412_0.png treat image : temp/1747230629_3291772_1358220892_e9ff2c4acc884daadb395cb27bc3d3bc_rle_crop_3797430425_0.png treat image : temp/1747230629_3291772_1358220892_e9ff2c4acc884daadb395cb27bc3d3bc_rle_crop_3797430429_0.png treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430433_0.png treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430430_0.png treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430440_0.png treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430435_0.png treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430438_0.png treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430434_0.png treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430463_0.png treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430461_0.png treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430458_0.png treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430455_0.png treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430448_0.png treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430454_0.png treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430462_0.png treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430460_0.png treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430456_0.png treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430457_0.png treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430450_0.png treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430465_0.png treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430446_0.png treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430445_0.png treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430453_0.png treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430444_0.png treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430464_0.png treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430447_0.png treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430443_0.png treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430470_0.png treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430475_0.png treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430473_0.png treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430474_0.png treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430478_0.png treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430468_0.png treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430467_0.png treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430476_0.png treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430472_0.png treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430477_0.png treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430479_0.png treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430486_0.png treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430488_0.png treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430487_0.png treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430490_0.png treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430493_0.png treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430505_0.png treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430507_0.png treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430492_0.png treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430496_0.png treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430497_0.png treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430500_0.png treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430494_0.png treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430508_0.png treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430504_0.png treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430503_0.png treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430501_0.png treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430506_0.png treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430498_0.png treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430495_0.png treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430499_0.png treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df_rle_crop_3797430375_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430389_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430411_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430396_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430401_0.png treat image : temp/1747230629_3291772_1358220924_29e29a77d84b83beeed71b114531d14b_rle_crop_3797430416_0.png treat image : temp/1747230629_3291772_1358220892_e9ff2c4acc884daadb395cb27bc3d3bc_rle_crop_3797430423_0.png treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430442_0.png treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430480_0.png treat image : temp/1747230629_3291772_1358220924_29e29a77d84b83beeed71b114531d14b_rle_crop_3797430420_0.png treat image : temp/1747230629_3291772_1358220892_e9ff2c4acc884daadb395cb27bc3d3bc_rle_crop_3797430424_0.png treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430485_0.png treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430481_0.png treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430483_0.png treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430509_0.png treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df_rle_crop_3797430377_0.png treat image : temp/1747230629_3291772_1358221375_953799d7f79f2b9dbe2cefffeb0451df_rle_crop_3797430385_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430400_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430399_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430394_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430402_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430408_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430405_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430395_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430390_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430391_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430410_0.png treat image : temp/1747230629_3291772_1358220924_29e29a77d84b83beeed71b114531d14b_rle_crop_3797430417_0.png treat image : temp/1747230629_3291772_1358220924_29e29a77d84b83beeed71b114531d14b_rle_crop_3797430415_0.png treat image : temp/1747230629_3291772_1358220924_29e29a77d84b83beeed71b114531d14b_rle_crop_3797430419_0.png treat image : temp/1747230629_3291772_1358220924_29e29a77d84b83beeed71b114531d14b_rle_crop_3797430414_0.png treat image : temp/1747230629_3291772_1358220892_e9ff2c4acc884daadb395cb27bc3d3bc_rle_crop_3797430427_0.png treat image : temp/1747230629_3291772_1358220892_e9ff2c4acc884daadb395cb27bc3d3bc_rle_crop_3797430421_0.png treat image : temp/1747230629_3291772_1358220892_e9ff2c4acc884daadb395cb27bc3d3bc_rle_crop_3797430422_0.png treat image : temp/1747230629_3291772_1358220892_e9ff2c4acc884daadb395cb27bc3d3bc_rle_crop_3797430426_0.png treat image : temp/1747230629_3291772_1358220892_e9ff2c4acc884daadb395cb27bc3d3bc_rle_crop_3797430428_0.png treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430437_0.png treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430431_0.png treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430436_0.png treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430441_0.png treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430432_0.png treat image : temp/1747230629_3291772_1358220860_cb854b13c5e674fd758c4415b992eb77_rle_crop_3797430439_0.png treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430449_0.png treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430452_0.png treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430459_0.png treat image : temp/1747230629_3291772_1358220826_d2b27cb689098dd3fafdbd4b59aaa834_rle_crop_3797430451_0.png treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430471_0.png treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430469_0.png treat image : temp/1747230629_3291772_1358220791_3678ff2b84b09fbb4cd8b451e780140c_rle_crop_3797430466_0.png treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430484_0.png treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430489_0.png treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430482_0.png treat image : temp/1747230629_3291772_1358220569_01300671fd3fc10fbfdcb72456dac7fb_rle_crop_3797430502_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430406_0.png treat image : temp/1747230629_3291772_1358221328_413a208b58399a5caa2a4f70a21266d9_rle_crop_3797430404_0.png treat image : temp/1747230629_3291772_1358220604_2a0f9335bf83b144845235801726de60_rle_crop_3797430491_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 144 time used for this insertion : 0.022377729415893555 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 144 time used for this insertion : 0.03702425956726074 save missing photos in datou_result : time spend for datou_step_exec : 10.062780857086182 time spend to save output : 0.06507372856140137 total time spend for step 7 : 10.127854585647583 step8:velours_tree Wed May 14 15:57:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.3216438293457031 time spend to save output : 4.887580871582031e-05 total time spend for step 8 : 0.32169270515441895 step9:send_mail_cod Wed May 14 15:57:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22967479_14-05-2025_15_57_11.pdf 22968650 imagette229686501747231031 22968651 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229686511747231031 22968652 imagette229686521747231032 22968653 imagette229686531747231032 22968654 change filename to text .change filename to text .change filename to text .imagette229686541747231032 22968655 imagette229686551747231032 22968656 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229686561747231032 22968657 imagette229686571747231034 22968658 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229686581747231034 22968659 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229686591747231035 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22967479 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22968650,22968651,22968652,22968653,22968654,22968655,22968656,22968657,22968658,22968659,22968660?tags=background,carton,mal_croppe,flou,pet_fonce,pehd,pet_clair,autre,papier,metal,environnement args[1358221375] : ((1358221375, -6.50075311675284, 492609224), (1358221375, 0.5842625519961607, 2107752395), '0.12331786104681071') We are sending mail with results at report@fotonower.com args[1358221328] : ((1358221328, -6.388685246214852, 492609224), (1358221328, 0.6384690550873292, 2107752395), '0.12331786104681071') We are sending mail with results at report@fotonower.com args[1358220924] : ((1358220924, -5.340135191312917, 492609224), (1358220924, -0.2524682737734204, 496442774), '0.12331786104681071') We are sending mail with results at report@fotonower.com args[1358220892] : ((1358220892, -5.694301790676793, 492609224), (1358220892, 0.28844580527752417, 2107752395), '0.12331786104681071') We are sending mail with results at report@fotonower.com args[1358220860] : ((1358220860, -5.650882861771145, 492609224), (1358220860, 0.3778200418782753, 2107752395), '0.12331786104681071') We are sending mail with results at report@fotonower.com args[1358220826] : ((1358220826, -6.383471836883609, 492609224), (1358220826, 0.5462374192893852, 2107752395), '0.12331786104681071') We are sending mail with results at report@fotonower.com args[1358220791] : ((1358220791, -6.499292336733569, 492609224), (1358220791, 0.5300385633837685, 2107752395), '0.12331786104681071') We are sending mail with results at report@fotonower.com args[1358220604] : ((1358220604, -5.930602352720259, 492609224), (1358220604, 0.005685165013369362, 2107752395), '0.12331786104681071') We are sending mail with results at report@fotonower.com args[1358220569] : ((1358220569, -5.983232146531604, 492609224), (1358220569, 0.0753976742897591, 2107752395), '0.12331786104681071') We are sending mail with results at report@fotonower.com refus_total : 0.12331786104681071 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22967479 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22967479_14-05-2025_15_57_11.pdf results_Auto_P22967479_14-05-2025_15_57_11.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22967479_14-05-2025_15_57_11.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22967479','results_Auto_P22967479_14-05-2025_15_57_11.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22967479_14-05-2025_15_57_11.pdf','pdf','','0.79','0.12331786104681071') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22967479

https://www.fotonower.com/image?json=false&list_photos_id=1358221375
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358221328
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358220924
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358220892
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358220860
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358220826
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358220791
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358220604
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1358220569
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 12.33%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/22968651?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/22968654?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22968656?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22968658?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/22968659?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22967479_14-05-2025_15_57_11.pdf.

Lien vers velours :https://www.fotonower.com/velours/22968650,22968651,22968652,22968653,22968654,22968655,22968656,22968657,22968658,22968659,22968660?tags=background,carton,mal_croppe,flou,pet_fonce,pehd,pet_clair,autre,papier,metal,environnement.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 14 May 2025 13:57:19 GMT Content-Length: 0 Connection: close X-Message-Id: dCxkgLgXRGqIbLxuqgHp4w Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1358221375, 1358221328, 1358220924, 1358220892, 1358220860, 1358220826, 1358220791, 1358220604, 1358220569] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358221375', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358221328', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220924', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220892', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220860', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220826', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220791', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220604', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220569', None, None, None, None, None, '2849704') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.01596379280090332 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.395421504974365 time spend to save output : 0.016216754913330078 total time spend for step 9 : 8.411638259887695 step10:split_time_score Wed May 14 15:57:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('14', 9),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 14052025 22967479 Nombre de photos uploadées : 9 / 23040 (0%) 14052025 22967479 Nombre de photos taguées (types de déchets): 0 / 9 (0%) 14052025 22967479 Nombre de photos taguées (volume) : 0 / 9 (0%) elapsed_time : load_data_split_time_score 2.384185791015625e-06 elapsed_time : order_list_meta_photo_and_scores 7.867813110351562e-06 ????????? elapsed_time : fill_and_build_computed_from_old_data 0.0006098747253417969 elapsed_time : insert_dashboard_record_day_entry 0.02451610565185547 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.15093270158179015 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22948162_14-05-2025_07_47_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22948162 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22948162 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22948165 order by id desc limit 1 Qualite : 0.09967562451774692 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22949538_14-05-2025_08_24_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22949538 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22949538 AND mptpi.`type`=3594 To do Qualite : 0.19506076388888893 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22953035_14-05-2025_10_24_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22953035 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22953035 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22955733 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22958945 order by id desc limit 1 Qualite : 0.16447810169110086 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22960477_14-05-2025_13_05_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22960477 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22960477 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22967472 order by id desc limit 1 Qualite : 0.12331786104681071 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22967479_14-05-2025_15_57_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22967479 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22967479 AND mptpi.`type`=3594 To do Qualite : 0.20919277722663138 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22967499_14-05-2025_15_46_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22967499 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22967499 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'14052025': {'nb_upload': 9, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1358221375, 1358221328, 1358220924, 1358220892, 1358220860, 1358220826, 1358220791, 1358220604, 1358220569] Looping around the photos to save general results len do output : 1 /22967479Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358221375', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358221328', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220924', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220892', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220860', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220826', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220791', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220604', None, None, None, None, None, '2849704') ('3318', None, None, None, None, None, None, None, '2849704') ('3318', '22967479', '1358220569', None, None, None, None, None, '2849704') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.013852834701538086 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.0868000984191895 time spend to save output : 0.014151573181152344 total time spend for step 10 : 4.100951671600342 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 9 set_done_treatment 165.97user 179.13system 6:58.20elapsed 82%CPU (0avgtext+0avgdata 5254900maxresident)k 1166560inputs+152264outputs (29509major+16482820minor)pagefaults 0swaps