python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 69623 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2766711'] with mtr_portfolio_ids : ['22477720'] and first list_photo_ids : [] new path : /proc/69623/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 9 ; length of list_pids : 9 ; length of list_args : 9 time to download the photos : 1.5753469467163086 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Apr 29 00:20:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3185 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-04-29 00:20:34.121148: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-04-29 00:20:34.159218: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-04-29 00:20:34.161598: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f3dc8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-04-29 00:20:34.161670: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-04-29 00:20:34.167549: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-04-29 00:20:34.449131: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2fb56a40 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-04-29 00:20:34.449185: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-04-29 00:20:34.450179: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-29 00:20:34.452471: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-29 00:20:34.491307: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-29 00:20:34.513748: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-29 00:20:34.519248: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-29 00:20:34.557141: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-29 00:20:34.563733: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-29 00:20:34.618240: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-29 00:20:34.619783: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-29 00:20:34.620260: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-29 00:20:34.621306: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-29 00:20:34.621329: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-29 00:20:34.621341: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-29 00:20:34.623305: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2733 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-04-29 00:20:34.977000: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-29 00:20:34.977116: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-29 00:20:34.977134: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-29 00:20:34.977150: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-29 00:20:34.977165: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-29 00:20:34.977180: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-29 00:20:34.977194: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-29 00:20:34.977209: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-29 00:20:34.978068: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-29 00:20:34.979066: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-29 00:20:34.979103: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-29 00:20:34.979121: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-29 00:20:34.979141: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-29 00:20:34.979156: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-29 00:20:34.979172: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-29 00:20:34.979187: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-29 00:20:34.979203: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-29 00:20:34.980011: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-29 00:20:34.980046: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-29 00:20:34.980055: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-29 00:20:34.980063: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-29 00:20:34.980930: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2733 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-04-29 00:20:47.433521: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-29 00:20:48.199631: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-29 00:20:51.168214: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.168306: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-29 00:20:51.168946: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.168969: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-29 00:20:51.176517: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.176557: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-29 00:20:51.177173: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.177189: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-29 00:20:51.184111: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.184148: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-29 00:20:51.184758: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.184777: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-29 00:20:51.231743: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.231810: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-29 00:20:51.232885: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.232915: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-29 00:20:51.239694: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.239744: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-29 00:20:51.240638: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.240655: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-29 00:20:51.275849: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.276476: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.278325: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.278880: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.319045: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.319690: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.321684: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.322276: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.347687: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.348324: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.349886: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.350479: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.355888: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.356480: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.358330: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.358888: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.364473: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.365049: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.366558: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.367129: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.406281: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.407382: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.408456: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.409540: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.413503: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.414061: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.429388: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.429943: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.430487: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.431054: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.443526: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.444097: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.444645: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.445190: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.449425: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.450042: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.454559: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.455152: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.467089: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.467646: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.471688: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.472235: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.472778: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.473320: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.474028: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.474576: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.485342: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.485890: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.486447: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.487009: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.487556: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.488098: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.502751: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.503344: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.550665: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.551333: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.559601: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.560220: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.585387: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.586057: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.586645: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.587220: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.591480: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.592074: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.592662: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.593246: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.594303: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.594319: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-04-29 00:20:51.604854: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.605458: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.614463: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.615045: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.615648: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.616235: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.616797: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-29 00:20:51.617346: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.17G (2330853376 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 9 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 11.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 56 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 47 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 40 Detection mask done ! Trying to reset tf kernel 70185 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 799 tf kernel not reseted sub process len(results) : 9 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 9 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1992 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0010137557983398438 nb_pixel_total : 12397 time to create 1 rle with old method : 0.021767377853393555 length of segment : 115 time for calcul the mask position with numpy : 0.0009348392486572266 nb_pixel_total : 19007 time to create 1 rle with old method : 0.022759675979614258 length of segment : 195 time for calcul the mask position with numpy : 0.0007505416870117188 nb_pixel_total : 15972 time to create 1 rle with old method : 0.02001190185546875 length of segment : 108 time for calcul the mask position with numpy : 0.0018534660339355469 nb_pixel_total : 40502 time to create 1 rle with old method : 0.04579329490661621 length of segment : 322 time for calcul the mask position with numpy : 0.0030944347381591797 nb_pixel_total : 106105 time to create 1 rle with old method : 0.12373089790344238 length of segment : 456 time for calcul the mask position with numpy : 0.0007536411285400391 nb_pixel_total : 18316 time to create 1 rle with old method : 0.021070003509521484 length of segment : 123 time for calcul the mask position with numpy : 0.0023043155670166016 nb_pixel_total : 39289 time to create 1 rle with old method : 0.0486299991607666 length of segment : 317 time for calcul the mask position with numpy : 0.0012347698211669922 nb_pixel_total : 27489 time to create 1 rle with old method : 0.030421018600463867 length of segment : 267 time for calcul the mask position with numpy : 0.0017201900482177734 nb_pixel_total : 54437 time to create 1 rle with old method : 0.061385393142700195 length of segment : 225 time for calcul the mask position with numpy : 0.0010747909545898438 nb_pixel_total : 24489 time to create 1 rle with old method : 0.028566837310791016 length of segment : 164 time for calcul the mask position with numpy : 0.0008671283721923828 nb_pixel_total : 15931 time to create 1 rle with old method : 0.020190715789794922 length of segment : 196 time for calcul the mask position with numpy : 0.001814126968383789 nb_pixel_total : 44902 time to create 1 rle with old method : 0.05385947227478027 length of segment : 221 time for calcul the mask position with numpy : 0.002969503402709961 nb_pixel_total : 61727 time to create 1 rle with old method : 0.08231782913208008 length of segment : 236 time for calcul the mask position with numpy : 0.0017428398132324219 nb_pixel_total : 33569 time to create 1 rle with old method : 0.038466453552246094 length of segment : 326 time for calcul the mask position with numpy : 0.0020971298217773438 nb_pixel_total : 50744 time to create 1 rle with old method : 0.05727720260620117 length of segment : 268 time for calcul the mask position with numpy : 0.0018610954284667969 nb_pixel_total : 34831 time to create 1 rle with old method : 0.04018998146057129 length of segment : 297 time for calcul the mask position with numpy : 0.0010447502136230469 nb_pixel_total : 20796 time to create 1 rle with old method : 0.031783342361450195 length of segment : 158 time for calcul the mask position with numpy : 0.006671428680419922 nb_pixel_total : 128159 time to create 1 rle with old method : 0.14393234252929688 length of segment : 532 time for calcul the mask position with numpy : 0.003709077835083008 nb_pixel_total : 138019 time to create 1 rle with old method : 0.15443086624145508 length of segment : 470 time for calcul the mask position with numpy : 0.0010046958923339844 nb_pixel_total : 41658 time to create 1 rle with old method : 0.055489540100097656 length of segment : 536 time for calcul the mask position with numpy : 0.0025811195373535156 nb_pixel_total : 130571 time to create 1 rle with old method : 0.15559697151184082 length of segment : 408 time for calcul the mask position with numpy : 0.00023651123046875 nb_pixel_total : 8537 time to create 1 rle with old method : 0.010138511657714844 length of segment : 95 time for calcul the mask position with numpy : 0.0015845298767089844 nb_pixel_total : 60267 time to create 1 rle with old method : 0.07393908500671387 length of segment : 545 time for calcul the mask position with numpy : 0.0014688968658447266 nb_pixel_total : 54016 time to create 1 rle with old method : 0.06179404258728027 length of segment : 237 time for calcul the mask position with numpy : 0.0051457881927490234 nb_pixel_total : 175169 time to create 1 rle with new method : 0.01604938507080078 length of segment : 587 time for calcul the mask position with numpy : 0.0006387233734130859 nb_pixel_total : 27405 time to create 1 rle with old method : 0.036760568618774414 length of segment : 165 time for calcul the mask position with numpy : 0.0007393360137939453 nb_pixel_total : 32853 time to create 1 rle with old method : 0.03848671913146973 length of segment : 188 time for calcul the mask position with numpy : 0.0019233226776123047 nb_pixel_total : 79525 time to create 1 rle with old method : 0.0900876522064209 length of segment : 412 time for calcul the mask position with numpy : 0.0006811618804931641 nb_pixel_total : 19451 time to create 1 rle with old method : 0.022706985473632812 length of segment : 205 time for calcul the mask position with numpy : 0.0015687942504882812 nb_pixel_total : 82303 time to create 1 rle with old method : 0.09735774993896484 length of segment : 533 time for calcul the mask position with numpy : 0.0027594566345214844 nb_pixel_total : 53811 time to create 1 rle with old method : 0.06136322021484375 length of segment : 342 time for calcul the mask position with numpy : 0.001993417739868164 nb_pixel_total : 39000 time to create 1 rle with old method : 0.04599618911743164 length of segment : 176 time for calcul the mask position with numpy : 0.001123666763305664 nb_pixel_total : 17774 time to create 1 rle with old method : 0.020873069763183594 length of segment : 145 time for calcul the mask position with numpy : 0.00039315223693847656 nb_pixel_total : 8175 time to create 1 rle with old method : 0.009949207305908203 length of segment : 153 time for calcul the mask position with numpy : 0.000997781753540039 nb_pixel_total : 18638 time to create 1 rle with old method : 0.021965503692626953 length of segment : 155 time for calcul the mask position with numpy : 0.0009729862213134766 nb_pixel_total : 23226 time to create 1 rle with old method : 0.02770233154296875 length of segment : 88 time for calcul the mask position with numpy : 0.009343862533569336 nb_pixel_total : 181814 time to create 1 rle with new method : 0.015294790267944336 length of segment : 642 time for calcul the mask position with numpy : 0.0019512176513671875 nb_pixel_total : 28089 time to create 1 rle with old method : 0.032449960708618164 length of segment : 311 time for calcul the mask position with numpy : 0.00173187255859375 nb_pixel_total : 38962 time to create 1 rle with old method : 0.04549360275268555 length of segment : 215 time for calcul the mask position with numpy : 0.0039365291595458984 nb_pixel_total : 66111 time to create 1 rle with old method : 0.0751185417175293 length of segment : 289 time for calcul the mask position with numpy : 0.0005214214324951172 nb_pixel_total : 12374 time to create 1 rle with old method : 0.02066493034362793 length of segment : 98 time for calcul the mask position with numpy : 0.001630544662475586 nb_pixel_total : 33034 time to create 1 rle with old method : 0.03764176368713379 length of segment : 278 time for calcul the mask position with numpy : 0.00033211708068847656 nb_pixel_total : 16119 time to create 1 rle with old method : 0.018538475036621094 length of segment : 129 time for calcul the mask position with numpy : 0.0010933876037597656 nb_pixel_total : 17271 time to create 1 rle with old method : 0.0197145938873291 length of segment : 391 time for calcul the mask position with numpy : 0.0007202625274658203 nb_pixel_total : 11137 time to create 1 rle with old method : 0.013094663619995117 length of segment : 201 time for calcul the mask position with numpy : 0.0011196136474609375 nb_pixel_total : 28548 time to create 1 rle with old method : 0.03362774848937988 length of segment : 154 time for calcul the mask position with numpy : 0.0007534027099609375 nb_pixel_total : 16366 time to create 1 rle with old method : 0.01898646354675293 length of segment : 137 time for calcul the mask position with numpy : 0.004830837249755859 nb_pixel_total : 76771 time to create 1 rle with old method : 0.08752942085266113 length of segment : 361 time for calcul the mask position with numpy : 0.0011019706726074219 nb_pixel_total : 23241 time to create 1 rle with old method : 0.025603294372558594 length of segment : 209 time for calcul the mask position with numpy : 0.002099752426147461 nb_pixel_total : 54491 time to create 1 rle with old method : 0.06001019477844238 length of segment : 428 time for calcul the mask position with numpy : 0.0036127567291259766 nb_pixel_total : 98010 time to create 1 rle with old method : 0.10889697074890137 length of segment : 547 time for calcul the mask position with numpy : 0.0010390281677246094 nb_pixel_total : 34179 time to create 1 rle with old method : 0.039275169372558594 length of segment : 152 time for calcul the mask position with numpy : 0.0040857791900634766 nb_pixel_total : 89795 time to create 1 rle with old method : 0.09753608703613281 length of segment : 700 time for calcul the mask position with numpy : 0.0007410049438476562 nb_pixel_total : 10580 time to create 1 rle with old method : 0.012327194213867188 length of segment : 164 time for calcul the mask position with numpy : 0.0012896060943603516 nb_pixel_total : 28153 time to create 1 rle with old method : 0.03279423713684082 length of segment : 203 time for calcul the mask position with numpy : 0.0038483142852783203 nb_pixel_total : 106652 time to create 1 rle with old method : 0.11929512023925781 length of segment : 619 time for calcul the mask position with numpy : 0.0005595684051513672 nb_pixel_total : 7992 time to create 1 rle with old method : 0.009871721267700195 length of segment : 81 time for calcul the mask position with numpy : 0.05319619178771973 nb_pixel_total : 326357 time to create 1 rle with new method : 0.05690169334411621 length of segment : 678 time for calcul the mask position with numpy : 0.0007572174072265625 nb_pixel_total : 15948 time to create 1 rle with old method : 0.018454313278198242 length of segment : 155 time for calcul the mask position with numpy : 0.002188444137573242 nb_pixel_total : 100259 time to create 1 rle with old method : 0.11293625831604004 length of segment : 579 time for calcul the mask position with numpy : 0.0008759498596191406 nb_pixel_total : 14049 time to create 1 rle with old method : 0.016475677490234375 length of segment : 128 time for calcul the mask position with numpy : 0.002389669418334961 nb_pixel_total : 61869 time to create 1 rle with old method : 0.0752406120300293 length of segment : 330 time for calcul the mask position with numpy : 0.0020875930786132812 nb_pixel_total : 52238 time to create 1 rle with old method : 0.05948996543884277 length of segment : 387 time for calcul the mask position with numpy : 0.0009882450103759766 nb_pixel_total : 18972 time to create 1 rle with old method : 0.022179841995239258 length of segment : 192 time for calcul the mask position with numpy : 0.0007998943328857422 nb_pixel_total : 18859 time to create 1 rle with old method : 0.02173471450805664 length of segment : 164 time for calcul the mask position with numpy : 0.0004343986511230469 nb_pixel_total : 19532 time to create 1 rle with old method : 0.022780179977416992 length of segment : 237 time for calcul the mask position with numpy : 0.0009655952453613281 nb_pixel_total : 25241 time to create 1 rle with old method : 0.029259681701660156 length of segment : 212 time for calcul the mask position with numpy : 0.0035736560821533203 nb_pixel_total : 84650 time to create 1 rle with old method : 0.09543490409851074 length of segment : 694 time for calcul the mask position with numpy : 0.0007777214050292969 nb_pixel_total : 17565 time to create 1 rle with old method : 0.01967620849609375 length of segment : 183 time for calcul the mask position with numpy : 0.0007781982421875 nb_pixel_total : 14549 time to create 1 rle with old method : 0.02408432960510254 length of segment : 174 time for calcul the mask position with numpy : 0.0009665489196777344 nb_pixel_total : 22474 time to create 1 rle with old method : 0.0314180850982666 length of segment : 148 time for calcul the mask position with numpy : 0.0018622875213623047 nb_pixel_total : 25783 time to create 1 rle with old method : 0.03148841857910156 length of segment : 324 time for calcul the mask position with numpy : 0.00196075439453125 nb_pixel_total : 60275 time to create 1 rle with old method : 0.0699772834777832 length of segment : 345 time for calcul the mask position with numpy : 0.008079767227172852 nb_pixel_total : 188202 time to create 1 rle with new method : 0.012959480285644531 length of segment : 751 time for calcul the mask position with numpy : 0.026861906051635742 nb_pixel_total : 639151 time to create 1 rle with new method : 0.08399558067321777 length of segment : 998 time for calcul the mask position with numpy : 0.0035140514373779297 nb_pixel_total : 102859 time to create 1 rle with old method : 0.11388540267944336 length of segment : 468 time for calcul the mask position with numpy : 0.0008513927459716797 nb_pixel_total : 24113 time to create 1 rle with old method : 0.026653766632080078 length of segment : 155 time for calcul the mask position with numpy : 0.00035071372985839844 nb_pixel_total : 6368 time to create 1 rle with old method : 0.0075838565826416016 length of segment : 80 time for calcul the mask position with numpy : 0.0007562637329101562 nb_pixel_total : 21530 time to create 1 rle with old method : 0.02491283416748047 length of segment : 177 time for calcul the mask position with numpy : 0.002636432647705078 nb_pixel_total : 86780 time to create 1 rle with old method : 0.0986170768737793 length of segment : 440 time for calcul the mask position with numpy : 0.0014071464538574219 nb_pixel_total : 53869 time to create 1 rle with old method : 0.06011509895324707 length of segment : 207 time for calcul the mask position with numpy : 0.0008490085601806641 nb_pixel_total : 6237 time to create 1 rle with old method : 0.007863521575927734 length of segment : 212 time for calcul the mask position with numpy : 0.0016210079193115234 nb_pixel_total : 60260 time to create 1 rle with old method : 0.06917834281921387 length of segment : 217 time for calcul the mask position with numpy : 0.010743379592895508 nb_pixel_total : 296231 time to create 1 rle with new method : 0.05054831504821777 length of segment : 706 time for calcul the mask position with numpy : 0.00047516822814941406 nb_pixel_total : 8813 time to create 1 rle with old method : 0.010246753692626953 length of segment : 126 time for calcul the mask position with numpy : 0.0019164085388183594 nb_pixel_total : 42264 time to create 1 rle with old method : 0.04797220230102539 length of segment : 352 time for calcul the mask position with numpy : 0.005784273147583008 nb_pixel_total : 178431 time to create 1 rle with new method : 0.011555671691894531 length of segment : 641 time for calcul the mask position with numpy : 0.002351522445678711 nb_pixel_total : 66035 time to create 1 rle with old method : 0.07405328750610352 length of segment : 540 time for calcul the mask position with numpy : 0.0006148815155029297 nb_pixel_total : 16731 time to create 1 rle with old method : 0.018313884735107422 length of segment : 257 time for calcul the mask position with numpy : 0.00027179718017578125 nb_pixel_total : 4917 time to create 1 rle with old method : 0.005502462387084961 length of segment : 73 time for calcul the mask position with numpy : 0.0004088878631591797 nb_pixel_total : 12483 time to create 1 rle with old method : 0.014436960220336914 length of segment : 89 time for calcul the mask position with numpy : 0.0007877349853515625 nb_pixel_total : 25949 time to create 1 rle with old method : 0.029773235321044922 length of segment : 212 time for calcul the mask position with numpy : 0.0003905296325683594 nb_pixel_total : 26682 time to create 1 rle with old method : 0.030818700790405273 length of segment : 209 time for calcul the mask position with numpy : 0.005929470062255859 nb_pixel_total : 281286 time to create 1 rle with new method : 0.04424786567687988 length of segment : 704 time for calcul the mask position with numpy : 0.0005114078521728516 nb_pixel_total : 18581 time to create 1 rle with old method : 0.02137899398803711 length of segment : 179 time for calcul the mask position with numpy : 0.0005235671997070312 nb_pixel_total : 20642 time to create 1 rle with old method : 0.024163484573364258 length of segment : 204 time for calcul the mask position with numpy : 0.00035262107849121094 nb_pixel_total : 18177 time to create 1 rle with old method : 0.020999670028686523 length of segment : 284 time for calcul the mask position with numpy : 0.0012698173522949219 nb_pixel_total : 26953 time to create 1 rle with old method : 0.03081035614013672 length of segment : 252 time for calcul the mask position with numpy : 0.003579854965209961 nb_pixel_total : 103894 time to create 1 rle with old method : 0.11923623085021973 length of segment : 776 time for calcul the mask position with numpy : 0.0013165473937988281 nb_pixel_total : 18543 time to create 1 rle with old method : 0.03348588943481445 length of segment : 228 time for calcul the mask position with numpy : 0.005222320556640625 nb_pixel_total : 99620 time to create 1 rle with old method : 0.169297456741333 length of segment : 473 time for calcul the mask position with numpy : 0.008284807205200195 nb_pixel_total : 228499 time to create 1 rle with new method : 0.016111135482788086 length of segment : 713 time for calcul the mask position with numpy : 0.008934974670410156 nb_pixel_total : 336044 time to create 1 rle with new method : 0.013650655746459961 length of segment : 580 time for calcul the mask position with numpy : 0.0019774436950683594 nb_pixel_total : 72775 time to create 1 rle with old method : 0.08385944366455078 length of segment : 271 time for calcul the mask position with numpy : 0.0009441375732421875 nb_pixel_total : 29152 time to create 1 rle with old method : 0.04456043243408203 length of segment : 105 time for calcul the mask position with numpy : 0.0004115104675292969 nb_pixel_total : 11029 time to create 1 rle with old method : 0.012976646423339844 length of segment : 89 time for calcul the mask position with numpy : 0.011559724807739258 nb_pixel_total : 276104 time to create 1 rle with new method : 0.5528535842895508 length of segment : 1219 time for calcul the mask position with numpy : 0.0009260177612304688 nb_pixel_total : 15256 time to create 1 rle with old method : 0.018802881240844727 length of segment : 129 time for calcul the mask position with numpy : 0.0006051063537597656 nb_pixel_total : 13744 time to create 1 rle with old method : 0.018779754638671875 length of segment : 130 time for calcul the mask position with numpy : 0.00044226646423339844 nb_pixel_total : 13845 time to create 1 rle with old method : 0.016779661178588867 length of segment : 141 time for calcul the mask position with numpy : 0.0014526844024658203 nb_pixel_total : 41899 time to create 1 rle with old method : 0.04793119430541992 length of segment : 187 time for calcul the mask position with numpy : 0.004423856735229492 nb_pixel_total : 94372 time to create 1 rle with old method : 0.11328697204589844 length of segment : 291 time for calcul the mask position with numpy : 0.0024847984313964844 nb_pixel_total : 47926 time to create 1 rle with old method : 0.06096959114074707 length of segment : 226 time for calcul the mask position with numpy : 0.002246379852294922 nb_pixel_total : 51659 time to create 1 rle with old method : 0.05880618095397949 length of segment : 306 time for calcul the mask position with numpy : 0.005587100982666016 nb_pixel_total : 69369 time to create 1 rle with old method : 0.10169172286987305 length of segment : 296 time for calcul the mask position with numpy : 1.2368676662445068 nb_pixel_total : 1051411 time to create 1 rle with new method : 0.07222962379455566 length of segment : 1124 time for calcul the mask position with numpy : 0.0021209716796875 nb_pixel_total : 60740 time to create 1 rle with old method : 0.06815838813781738 length of segment : 304 time for calcul the mask position with numpy : 0.0012097358703613281 nb_pixel_total : 31320 time to create 1 rle with old method : 0.036187171936035156 length of segment : 198 time for calcul the mask position with numpy : 0.0005693435668945312 nb_pixel_total : 9785 time to create 1 rle with old method : 0.011371612548828125 length of segment : 144 time for calcul the mask position with numpy : 0.0020186901092529297 nb_pixel_total : 42464 time to create 1 rle with old method : 0.05756044387817383 length of segment : 227 time for calcul the mask position with numpy : 0.006669044494628906 nb_pixel_total : 182495 time to create 1 rle with new method : 0.008632183074951172 length of segment : 388 time for calcul the mask position with numpy : 0.0011501312255859375 nb_pixel_total : 21987 time to create 1 rle with old method : 0.024812936782836914 length of segment : 269 time for calcul the mask position with numpy : 0.0028142929077148438 nb_pixel_total : 87557 time to create 1 rle with old method : 0.10116934776306152 length of segment : 200 time for calcul the mask position with numpy : 0.0006711483001708984 nb_pixel_total : 13966 time to create 1 rle with old method : 0.0160830020904541 length of segment : 139 time for calcul the mask position with numpy : 0.0027370452880859375 nb_pixel_total : 52145 time to create 1 rle with old method : 0.05952000617980957 length of segment : 287 time for calcul the mask position with numpy : 0.0018856525421142578 nb_pixel_total : 38101 time to create 1 rle with old method : 0.0440828800201416 length of segment : 226 time for calcul the mask position with numpy : 0.0007882118225097656 nb_pixel_total : 10452 time to create 1 rle with old method : 0.012433052062988281 length of segment : 124 time for calcul the mask position with numpy : 0.0013403892517089844 nb_pixel_total : 23977 time to create 1 rle with old method : 0.0272519588470459 length of segment : 183 time for calcul the mask position with numpy : 0.002330303192138672 nb_pixel_total : 39208 time to create 1 rle with old method : 0.05549883842468262 length of segment : 319 time for calcul the mask position with numpy : 0.0015132427215576172 nb_pixel_total : 38728 time to create 1 rle with old method : 0.043604373931884766 length of segment : 280 time for calcul the mask position with numpy : 0.0010294914245605469 nb_pixel_total : 25174 time to create 1 rle with old method : 0.02892899513244629 length of segment : 196 time for calcul the mask position with numpy : 0.0008795261383056641 nb_pixel_total : 38358 time to create 1 rle with old method : 0.044945716857910156 length of segment : 273 time for calcul the mask position with numpy : 0.0024352073669433594 nb_pixel_total : 49007 time to create 1 rle with old method : 0.07969927787780762 length of segment : 281 time for calcul the mask position with numpy : 0.001672983169555664 nb_pixel_total : 35854 time to create 1 rle with old method : 0.04244637489318848 length of segment : 223 time for calcul the mask position with numpy : 0.0006012916564941406 nb_pixel_total : 10326 time to create 1 rle with old method : 0.015392780303955078 length of segment : 142 time for calcul the mask position with numpy : 0.0019431114196777344 nb_pixel_total : 43631 time to create 1 rle with old method : 0.05226540565490723 length of segment : 283 time for calcul the mask position with numpy : 0.0017535686492919922 nb_pixel_total : 34704 time to create 1 rle with old method : 0.03992509841918945 length of segment : 190 time for calcul the mask position with numpy : 0.0017778873443603516 nb_pixel_total : 47781 time to create 1 rle with old method : 0.05661511421203613 length of segment : 211 time for calcul the mask position with numpy : 0.0014903545379638672 nb_pixel_total : 36355 time to create 1 rle with old method : 0.05751538276672363 length of segment : 208 time for calcul the mask position with numpy : 0.0009446144104003906 nb_pixel_total : 14417 time to create 1 rle with old method : 0.016683578491210938 length of segment : 178 time for calcul the mask position with numpy : 0.0010828971862792969 nb_pixel_total : 27952 time to create 1 rle with old method : 0.0321042537689209 length of segment : 317 time for calcul the mask position with numpy : 0.0019998550415039062 nb_pixel_total : 46983 time to create 1 rle with old method : 0.05338597297668457 length of segment : 245 time for calcul the mask position with numpy : 0.0011050701141357422 nb_pixel_total : 22150 time to create 1 rle with old method : 0.025418758392333984 length of segment : 223 time for calcul the mask position with numpy : 0.0006654262542724609 nb_pixel_total : 11120 time to create 1 rle with old method : 0.01271200180053711 length of segment : 142 time for calcul the mask position with numpy : 0.0027129650115966797 nb_pixel_total : 62637 time to create 1 rle with old method : 0.07892537117004395 length of segment : 256 time for calcul the mask position with numpy : 0.0036444664001464844 nb_pixel_total : 43016 time to create 1 rle with old method : 0.048693180084228516 length of segment : 424 time for calcul the mask position with numpy : 0.0005967617034912109 nb_pixel_total : 11267 time to create 1 rle with old method : 0.013180971145629883 length of segment : 91 time for calcul the mask position with numpy : 0.0017197132110595703 nb_pixel_total : 32342 time to create 1 rle with old method : 0.04235553741455078 length of segment : 295 time for calcul the mask position with numpy : 0.0012898445129394531 nb_pixel_total : 18190 time to create 1 rle with old method : 0.022198915481567383 length of segment : 222 time for calcul the mask position with numpy : 0.0013246536254882812 nb_pixel_total : 28363 time to create 1 rle with old method : 0.03223848342895508 length of segment : 214 time for calcul the mask position with numpy : 0.0007226467132568359 nb_pixel_total : 12946 time to create 1 rle with old method : 0.015483856201171875 length of segment : 129 time for calcul the mask position with numpy : 0.0009765625 nb_pixel_total : 19179 time to create 1 rle with old method : 0.023766756057739258 length of segment : 217 time for calcul the mask position with numpy : 0.0003771781921386719 nb_pixel_total : 5795 time to create 1 rle with old method : 0.006848573684692383 length of segment : 97 time for calcul the mask position with numpy : 0.00601649284362793 nb_pixel_total : 93742 time to create 1 rle with old method : 0.10820508003234863 length of segment : 469 time for calcul the mask position with numpy : 0.0009140968322753906 nb_pixel_total : 30759 time to create 1 rle with old method : 0.03500795364379883 length of segment : 225 time for calcul the mask position with numpy : 0.0007193088531494141 nb_pixel_total : 12989 time to create 1 rle with old method : 0.01521754264831543 length of segment : 122 time for calcul the mask position with numpy : 0.00106048583984375 nb_pixel_total : 24663 time to create 1 rle with old method : 0.027826547622680664 length of segment : 229 time for calcul the mask position with numpy : 0.0002522468566894531 nb_pixel_total : 11858 time to create 1 rle with old method : 0.013936042785644531 length of segment : 76 time for calcul the mask position with numpy : 0.0022270679473876953 nb_pixel_total : 51126 time to create 1 rle with old method : 0.05840468406677246 length of segment : 391 time for calcul the mask position with numpy : 0.0017745494842529297 nb_pixel_total : 42929 time to create 1 rle with old method : 0.0530245304107666 length of segment : 185 time for calcul the mask position with numpy : 0.0016374588012695312 nb_pixel_total : 15714 time to create 1 rle with old method : 0.03992581367492676 length of segment : 130 time for calcul the mask position with numpy : 0.001558065414428711 nb_pixel_total : 27106 time to create 1 rle with old method : 0.042168378829956055 length of segment : 188 time for calcul the mask position with numpy : 0.001046895980834961 nb_pixel_total : 9581 time to create 1 rle with old method : 0.01580214500427246 length of segment : 197 time for calcul the mask position with numpy : 0.001157522201538086 nb_pixel_total : 23561 time to create 1 rle with old method : 0.027013063430786133 length of segment : 250 time for calcul the mask position with numpy : 0.0014760494232177734 nb_pixel_total : 19276 time to create 1 rle with old method : 0.022352933883666992 length of segment : 236 time for calcul the mask position with numpy : 0.0017893314361572266 nb_pixel_total : 52085 time to create 1 rle with old method : 0.07126736640930176 length of segment : 231 time for calcul the mask position with numpy : 0.003596067428588867 nb_pixel_total : 48900 time to create 1 rle with old method : 0.05817890167236328 length of segment : 470 time for calcul the mask position with numpy : 0.0018978118896484375 nb_pixel_total : 14778 time to create 1 rle with old method : 0.018710851669311523 length of segment : 418 time for calcul the mask position with numpy : 0.0007500648498535156 nb_pixel_total : 13598 time to create 1 rle with old method : 0.017476797103881836 length of segment : 114 time for calcul the mask position with numpy : 0.0019800662994384766 nb_pixel_total : 56657 time to create 1 rle with old method : 0.0641634464263916 length of segment : 511 time spent for convertir_results : 18.073464393615723 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 170 chid ids of type : 3594 Number RLEs to save : 49809 save missing photos in datou_result : time spend for datou_step_exec : 100.13119125366211 time spend to save output : 11.726791143417358 total time spend for step 1 : 111.85798239707947 step2:crop_condition Tue Apr 29 00:22:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 9 ! batch 1 Loaded 170 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 114 About to insert : list_path_to_insert length 114 new photo from crops ! About to upload 114 photos upload in portfolio : 3736932 init cache_photo without model_param we have 114 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745878972_69623 we have uploaded 114 photos in the portfolio 3736932 time of upload the photos Elapsed time : 34.491177797317505 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 22 About to insert : list_path_to_insert length 22 new photo from crops ! About to upload 22 photos upload in portfolio : 3736932 init cache_photo without model_param we have 22 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745879011_69623 we have uploaded 22 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.59107756614685 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 26 About to insert : list_path_to_insert length 26 new photo from crops ! About to upload 26 photos upload in portfolio : 3736932 init cache_photo without model_param we have 26 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745879040_69623 we have uploaded 26 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.654469966888428 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745879049_69623 we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.2145864963531494 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745879053_69623 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6367247104644775 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745879056_69623 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.638481855392456 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1354026995, 1354026990, 1354026956, 1354026953, 1354026936, 1353972393, 1353972389, 1353972374, 1353972369] Looping around the photos to save general results len do output : 170 /1354068404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1354068629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026995', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026990', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026956', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026953', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026936', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1353972393', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1353972389', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1353972374', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1353972369', None, None, None, None, None, '2766711') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 519 time used for this insertion : 0.10593509674072266 save_final save missing photos in datou_result : time spend for datou_step_exec : 114.6130678653717 time spend to save output : 0.14041638374328613 total time spend for step 2 : 114.75348424911499 step3:rle_unique_nms_with_priority Tue Apr 29 00:24:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 170 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 18 nb_hashtags : 4 time to prepare the origin masks : 22.396042108535767 time for calcul the mask position with numpy : 1.1929750442504883 nb_pixel_total : 6301578 time to create 1 rle with new method : 0.6285483837127686 time for calcul the mask position with numpy : 0.03840947151184082 nb_pixel_total : 128159 time to create 1 rle with old method : 0.14713382720947266 time for calcul the mask position with numpy : 0.034026145935058594 nb_pixel_total : 20796 time to create 1 rle with old method : 0.023083209991455078 time for calcul the mask position with numpy : 0.04500412940979004 nb_pixel_total : 34831 time to create 1 rle with old method : 0.04479217529296875 time for calcul the mask position with numpy : 0.03612375259399414 nb_pixel_total : 50744 time to create 1 rle with old method : 0.05621695518493652 time for calcul the mask position with numpy : 0.03405022621154785 nb_pixel_total : 33569 time to create 1 rle with old method : 0.03705573081970215 time for calcul the mask position with numpy : 0.03435826301574707 nb_pixel_total : 61727 time to create 1 rle with old method : 0.09327101707458496 time for calcul the mask position with numpy : 0.0210874080657959 nb_pixel_total : 44902 time to create 1 rle with old method : 0.0484161376953125 time for calcul the mask position with numpy : 0.020492076873779297 nb_pixel_total : 15931 time to create 1 rle with old method : 0.01681661605834961 time for calcul the mask position with numpy : 0.021532535552978516 nb_pixel_total : 24489 time to create 1 rle with old method : 0.026050329208374023 time for calcul the mask position with numpy : 0.022649288177490234 nb_pixel_total : 54437 time to create 1 rle with old method : 0.06366801261901855 time for calcul the mask position with numpy : 0.03445887565612793 nb_pixel_total : 27489 time to create 1 rle with old method : 0.02992534637451172 time for calcul the mask position with numpy : 0.03444862365722656 nb_pixel_total : 39289 time to create 1 rle with old method : 0.04332423210144043 time for calcul the mask position with numpy : 0.03500008583068848 nb_pixel_total : 18316 time to create 1 rle with old method : 0.020091533660888672 time for calcul the mask position with numpy : 0.03397226333618164 nb_pixel_total : 106105 time to create 1 rle with old method : 0.14395952224731445 time for calcul the mask position with numpy : 0.034744977951049805 nb_pixel_total : 40502 time to create 1 rle with old method : 0.04446983337402344 time for calcul the mask position with numpy : 0.03422880172729492 nb_pixel_total : 15972 time to create 1 rle with old method : 0.018262386322021484 time for calcul the mask position with numpy : 0.02521347999572754 nb_pixel_total : 19007 time to create 1 rle with old method : 0.026894569396972656 time for calcul the mask position with numpy : 0.023073911666870117 nb_pixel_total : 12397 time to create 1 rle with old method : 0.013611555099487305 create new chi : 3.3220725059509277 time to delete rle : 0.019635677337646484 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 11212 TO DO : save crop sub photo not yet done ! save time : 1.1878132820129395 nb_obj : 31 nb_hashtags : 5 time to prepare the origin masks : 4.377422094345093 time for calcul the mask position with numpy : 2.1633245944976807 nb_pixel_total : 5499585 time to create 1 rle with new method : 1.424748420715332 time for calcul the mask position with numpy : 0.027010440826416016 nb_pixel_total : 12374 time to create 1 rle with old method : 0.013761043548583984 time for calcul the mask position with numpy : 0.02988719940185547 nb_pixel_total : 181814 time to create 1 rle with new method : 1.9443316459655762 time for calcul the mask position with numpy : 0.02759075164794922 nb_pixel_total : 18509 time to create 1 rle with old method : 0.01987147331237793 time for calcul the mask position with numpy : 0.028450965881347656 nb_pixel_total : 60267 time to create 1 rle with old method : 0.06601452827453613 time for calcul the mask position with numpy : 0.028343677520751953 nb_pixel_total : 17774 time to create 1 rle with old method : 0.019098758697509766 time for calcul the mask position with numpy : 0.027615070343017578 nb_pixel_total : 38962 time to create 1 rle with old method : 0.0419316291809082 time for calcul the mask position with numpy : 0.028553009033203125 nb_pixel_total : 23241 time to create 1 rle with old method : 0.02604055404663086 time for calcul the mask position with numpy : 0.02902674674987793 nb_pixel_total : 17271 time to create 1 rle with old method : 0.0196688175201416 time for calcul the mask position with numpy : 0.029314041137695312 nb_pixel_total : 33034 time to create 1 rle with old method : 0.03753542900085449 time for calcul the mask position with numpy : 0.028437376022338867 nb_pixel_total : 41658 time to create 1 rle with old method : 0.046440839767456055 time for calcul the mask position with numpy : 0.028778791427612305 nb_pixel_total : 76771 time to create 1 rle with old method : 0.08231496810913086 time for calcul the mask position with numpy : 0.0287628173828125 nb_pixel_total : 130571 time to create 1 rle with old method : 0.1437208652496338 time for calcul the mask position with numpy : 0.028056621551513672 nb_pixel_total : 32853 time to create 1 rle with old method : 0.038092851638793945 time for calcul the mask position with numpy : 0.031482696533203125 nb_pixel_total : 138019 time to create 1 rle with old method : 0.15726423263549805 time for calcul the mask position with numpy : 0.028168201446533203 nb_pixel_total : 28089 time to create 1 rle with old method : 0.03056192398071289 time for calcul the mask position with numpy : 0.028550386428833008 nb_pixel_total : 66111 time to create 1 rle with old method : 0.07242584228515625 time for calcul the mask position with numpy : 0.029385089874267578 nb_pixel_total : 27405 time to create 1 rle with old method : 0.044161319732666016 time for calcul the mask position with numpy : 0.03375983238220215 nb_pixel_total : 175169 time to create 1 rle with new method : 2.192033529281616 time for calcul the mask position with numpy : 0.028914928436279297 nb_pixel_total : 8537 time to create 1 rle with old method : 0.009606122970581055 time for calcul the mask position with numpy : 0.029047250747680664 nb_pixel_total : 82303 time to create 1 rle with old method : 0.09127235412597656 time for calcul the mask position with numpy : 0.027892351150512695 nb_pixel_total : 19451 time to create 1 rle with old method : 0.02153635025024414 time for calcul the mask position with numpy : 0.028619050979614258 nb_pixel_total : 39000 time to create 1 rle with old method : 0.04333305358886719 time for calcul the mask position with numpy : 0.02939629554748535 nb_pixel_total : 79525 time to create 1 rle with old method : 0.08894896507263184 time for calcul the mask position with numpy : 0.028055667877197266 nb_pixel_total : 8175 time to create 1 rle with old method : 0.008935689926147461 time for calcul the mask position with numpy : 0.028395652770996094 nb_pixel_total : 53811 time to create 1 rle with old method : 0.0632481575012207 time for calcul the mask position with numpy : 0.029333829879760742 nb_pixel_total : 54016 time to create 1 rle with old method : 0.06033635139465332 time for calcul the mask position with numpy : 0.028985023498535156 nb_pixel_total : 11116 time to create 1 rle with old method : 0.012520074844360352 time for calcul the mask position with numpy : 0.028914213180541992 nb_pixel_total : 16271 time to create 1 rle with old method : 0.01841902732849121 time for calcul the mask position with numpy : 0.029140949249267578 nb_pixel_total : 6784 time to create 1 rle with old method : 0.007780790328979492 time for calcul the mask position with numpy : 0.029651880264282227 nb_pixel_total : 28548 time to create 1 rle with old method : 0.03201150894165039 time for calcul the mask position with numpy : 0.028191328048706055 nb_pixel_total : 23226 time to create 1 rle with old method : 0.024766921997070312 create new chi : 10.046331405639648 time to delete rle : 0.0024695396423339844 batch 1 Loaded 63 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 19670 TO DO : save crop sub photo not yet done ! save time : 4.477351665496826 nb_obj : 19 nb_hashtags : 2 time to prepare the origin masks : 20.699580430984497 time for calcul the mask position with numpy : 1.2271780967712402 nb_pixel_total : 5929071 time to create 1 rle with new method : 1.668914556503296 time for calcul the mask position with numpy : 0.029387712478637695 nb_pixel_total : 39657 time to create 1 rle with old method : 0.044776201248168945 time for calcul the mask position with numpy : 0.020642995834350586 nb_pixel_total : 25241 time to create 1 rle with old method : 0.028295278549194336 time for calcul the mask position with numpy : 0.022742509841918945 nb_pixel_total : 19532 time to create 1 rle with old method : 0.02289438247680664 time for calcul the mask position with numpy : 0.02419900894165039 nb_pixel_total : 18859 time to create 1 rle with old method : 0.03127694129943848 time for calcul the mask position with numpy : 0.024523258209228516 nb_pixel_total : 18972 time to create 1 rle with old method : 0.021712541580200195 time for calcul the mask position with numpy : 0.023415565490722656 nb_pixel_total : 52238 time to create 1 rle with old method : 0.058066606521606445 time for calcul the mask position with numpy : 0.02340245246887207 nb_pixel_total : 60719 time to create 1 rle with old method : 0.06761527061462402 time for calcul the mask position with numpy : 0.02357935905456543 nb_pixel_total : 14049 time to create 1 rle with old method : 0.015742778778076172 time for calcul the mask position with numpy : 0.02386307716369629 nb_pixel_total : 99745 time to create 1 rle with old method : 0.11108255386352539 time for calcul the mask position with numpy : 0.021603107452392578 nb_pixel_total : 15948 time to create 1 rle with old method : 0.017755508422851562 time for calcul the mask position with numpy : 0.026353836059570312 nb_pixel_total : 326357 time to create 1 rle with new method : 1.1066067218780518 time for calcul the mask position with numpy : 0.02481222152709961 nb_pixel_total : 7992 time to create 1 rle with old method : 0.01188206672668457 time for calcul the mask position with numpy : 0.026220321655273438 nb_pixel_total : 106652 time to create 1 rle with old method : 0.12420821189880371 time for calcul the mask position with numpy : 0.02095627784729004 nb_pixel_total : 28153 time to create 1 rle with old method : 0.03138017654418945 time for calcul the mask position with numpy : 0.02118682861328125 nb_pixel_total : 10580 time to create 1 rle with old method : 0.011760473251342773 time for calcul the mask position with numpy : 0.021718978881835938 nb_pixel_total : 89795 time to create 1 rle with old method : 0.10469985008239746 time for calcul the mask position with numpy : 0.024684667587280273 nb_pixel_total : 34179 time to create 1 rle with old method : 0.03893566131591797 time for calcul the mask position with numpy : 0.022716760635375977 nb_pixel_total : 98010 time to create 1 rle with old method : 0.1090383529663086 time for calcul the mask position with numpy : 0.02387094497680664 nb_pixel_total : 54491 time to create 1 rle with old method : 0.06041550636291504 create new chi : 5.428710699081421 time to delete rle : 0.0036699771881103516 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 14856 TO DO : save crop sub photo not yet done ! save time : 5.218541860580444 nb_obj : 10 nb_hashtags : 2 time to prepare the origin masks : 15.182358980178833 time for calcul the mask position with numpy : 0.8502604961395264 nb_pixel_total : 5948901 time to create 1 rle with new method : 1.0095140933990479 time for calcul the mask position with numpy : 0.0233914852142334 nb_pixel_total : 6368 time to create 1 rle with old method : 0.01024317741394043 time for calcul the mask position with numpy : 0.024106264114379883 nb_pixel_total : 24113 time to create 1 rle with old method : 0.02696371078491211 time for calcul the mask position with numpy : 0.023057937622070312 nb_pixel_total : 102859 time to create 1 rle with old method : 0.11618995666503906 time for calcul the mask position with numpy : 0.029552221298217773 nb_pixel_total : 639151 time to create 1 rle with new method : 1.7399733066558838 time for calcul the mask position with numpy : 0.026824474334716797 nb_pixel_total : 188202 time to create 1 rle with new method : 1.216048240661621 time for calcul the mask position with numpy : 0.037067413330078125 nb_pixel_total : 60275 time to create 1 rle with old method : 0.07036924362182617 time for calcul the mask position with numpy : 0.039157867431640625 nb_pixel_total : 25783 time to create 1 rle with old method : 0.04421401023864746 time for calcul the mask position with numpy : 0.038016319274902344 nb_pixel_total : 22474 time to create 1 rle with old method : 0.02511882781982422 time for calcul the mask position with numpy : 0.037047624588012695 nb_pixel_total : 14549 time to create 1 rle with old method : 0.01627373695373535 time for calcul the mask position with numpy : 0.03689265251159668 nb_pixel_total : 17565 time to create 1 rle with old method : 0.019768714904785156 create new chi : 5.5612266063690186 time to delete rle : 0.001608133316040039 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++Number RLEs to save : 9412 TO DO : save crop sub photo not yet done ! save time : 1.0135841369628906 nb_obj : 19 nb_hashtags : 2 time to prepare the origin masks : 9.790758848190308 time for calcul the mask position with numpy : 0.38258934020996094 nb_pixel_total : 6091011 time to create 1 rle with new method : 1.7751832008361816 time for calcul the mask position with numpy : 0.049111127853393555 nb_pixel_total : 11217 time to create 1 rle with old method : 0.012862205505371094 time for calcul the mask position with numpy : 0.045823097229003906 nb_pixel_total : 20642 time to create 1 rle with old method : 0.08964347839355469 time for calcul the mask position with numpy : 0.054151058197021484 nb_pixel_total : 18581 time to create 1 rle with old method : 0.029705286026000977 time for calcul the mask position with numpy : 0.050900936126708984 nb_pixel_total : 1577 time to create 1 rle with old method : 0.002577543258666992 time for calcul the mask position with numpy : 0.04796338081359863 nb_pixel_total : 26682 time to create 1 rle with old method : 0.033640384674072266 time for calcul the mask position with numpy : 0.04489541053771973 nb_pixel_total : 25949 time to create 1 rle with old method : 0.037288665771484375 time for calcul the mask position with numpy : 0.038770437240600586 nb_pixel_total : 12483 time to create 1 rle with old method : 0.020275115966796875 time for calcul the mask position with numpy : 0.0240325927734375 nb_pixel_total : 4917 time to create 1 rle with old method : 0.008058309555053711 time for calcul the mask position with numpy : 0.023663759231567383 nb_pixel_total : 16731 time to create 1 rle with old method : 0.019481658935546875 time for calcul the mask position with numpy : 0.024663209915161133 nb_pixel_total : 66035 time to create 1 rle with old method : 0.07348084449768066 time for calcul the mask position with numpy : 0.024196386337280273 nb_pixel_total : 178431 time to create 1 rle with new method : 1.241180658340454 time for calcul the mask position with numpy : 0.02473306655883789 nb_pixel_total : 42264 time to create 1 rle with old method : 0.04775857925415039 time for calcul the mask position with numpy : 0.02422618865966797 nb_pixel_total : 8813 time to create 1 rle with old method : 0.010096073150634766 time for calcul the mask position with numpy : 0.026381254196166992 nb_pixel_total : 296231 time to create 1 rle with new method : 1.5283777713775635 time for calcul the mask position with numpy : 0.03508949279785156 nb_pixel_total : 60260 time to create 1 rle with old method : 0.07268500328063965 time for calcul the mask position with numpy : 0.03580212593078613 nb_pixel_total : 6237 time to create 1 rle with old method : 0.007133960723876953 time for calcul the mask position with numpy : 0.03631329536437988 nb_pixel_total : 53869 time to create 1 rle with old method : 0.061155080795288086 time for calcul the mask position with numpy : 0.03719615936279297 nb_pixel_total : 86780 time to create 1 rle with old method : 0.0964510440826416 time for calcul the mask position with numpy : 0.0351254940032959 nb_pixel_total : 21530 time to create 1 rle with old method : 0.034722089767456055 create new chi : 6.379973411560059 time to delete rle : 0.002413034439086914 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 12466 TO DO : save crop sub photo not yet done ! save time : 2.709646224975586 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 9.293184041976929 time for calcul the mask position with numpy : 0.9684417247772217 nb_pixel_total : 5804782 time to create 1 rle with new method : 0.5964751243591309 time for calcul the mask position with numpy : 0.039894819259643555 nb_pixel_total : 13845 time to create 1 rle with old method : 0.015686988830566406 time for calcul the mask position with numpy : 0.03662919998168945 nb_pixel_total : 13744 time to create 1 rle with old method : 0.017189741134643555 time for calcul the mask position with numpy : 0.039452552795410156 nb_pixel_total : 15256 time to create 1 rle with old method : 0.0175628662109375 time for calcul the mask position with numpy : 0.04291200637817383 nb_pixel_total : 276104 time to create 1 rle with new method : 0.6220822334289551 time for calcul the mask position with numpy : 0.037982940673828125 nb_pixel_total : 11029 time to create 1 rle with old method : 0.012219429016113281 time for calcul the mask position with numpy : 0.037053823471069336 nb_pixel_total : 29152 time to create 1 rle with old method : 0.036142587661743164 time for calcul the mask position with numpy : 0.031149625778198242 nb_pixel_total : 72775 time to create 1 rle with old method : 0.09366774559020996 time for calcul the mask position with numpy : 0.03436851501464844 nb_pixel_total : 336044 time to create 1 rle with new method : 0.5311830043792725 time for calcul the mask position with numpy : 0.03193163871765137 nb_pixel_total : 228499 time to create 1 rle with new method : 1.655137538909912 time for calcul the mask position with numpy : 0.037275075912475586 nb_pixel_total : 99620 time to create 1 rle with old method : 0.11077761650085449 time for calcul the mask position with numpy : 0.03620409965515137 nb_pixel_total : 18543 time to create 1 rle with old method : 0.020615577697753906 time for calcul the mask position with numpy : 0.03191399574279785 nb_pixel_total : 103894 time to create 1 rle with old method : 0.11628270149230957 time for calcul the mask position with numpy : 0.031051158905029297 nb_pixel_total : 26953 time to create 1 rle with old method : 0.030225276947021484 create new chi : 5.4412548542022705 time to delete rle : 0.0020592212677001953 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 12372 TO DO : save crop sub photo not yet done ! save time : 2.7486658096313477 nb_obj : 22 nb_hashtags : 4 time to prepare the origin masks : 13.313023567199707 time for calcul the mask position with numpy : 0.33953332901000977 nb_pixel_total : 5050227 time to create 1 rle with new method : 1.5203652381896973 time for calcul the mask position with numpy : 0.02122211456298828 nb_pixel_total : 824 time to create 1 rle with old method : 0.0011916160583496094 time for calcul the mask position with numpy : 0.0228269100189209 nb_pixel_total : 25174 time to create 1 rle with old method : 0.028203248977661133 time for calcul the mask position with numpy : 0.022319793701171875 nb_pixel_total : 38728 time to create 1 rle with old method : 0.046045780181884766 time for calcul the mask position with numpy : 0.02236771583557129 nb_pixel_total : 39208 time to create 1 rle with old method : 0.04627251625061035 time for calcul the mask position with numpy : 0.02111530303955078 nb_pixel_total : 23977 time to create 1 rle with old method : 0.026941776275634766 time for calcul the mask position with numpy : 0.02245616912841797 nb_pixel_total : 10452 time to create 1 rle with old method : 0.011740446090698242 time for calcul the mask position with numpy : 0.021918296813964844 nb_pixel_total : 38101 time to create 1 rle with old method : 0.042424917221069336 time for calcul the mask position with numpy : 0.022060394287109375 nb_pixel_total : 52145 time to create 1 rle with old method : 0.058686017990112305 time for calcul the mask position with numpy : 0.021154165267944336 nb_pixel_total : 13966 time to create 1 rle with old method : 0.015873193740844727 time for calcul the mask position with numpy : 0.022832393646240234 nb_pixel_total : 87557 time to create 1 rle with old method : 0.10294842720031738 time for calcul the mask position with numpy : 0.02246713638305664 nb_pixel_total : 21987 time to create 1 rle with old method : 0.024815082550048828 time for calcul the mask position with numpy : 0.023754596710205078 nb_pixel_total : 182495 time to create 1 rle with new method : 1.1446428298950195 time for calcul the mask position with numpy : 0.02985548973083496 nb_pixel_total : 42464 time to create 1 rle with old method : 0.047271013259887695 time for calcul the mask position with numpy : 0.03390359878540039 nb_pixel_total : 9785 time to create 1 rle with old method : 0.01105046272277832 time for calcul the mask position with numpy : 0.035044193267822266 nb_pixel_total : 31320 time to create 1 rle with old method : 0.035280466079711914 time for calcul the mask position with numpy : 0.03511452674865723 nb_pixel_total : 60740 time to create 1 rle with old method : 0.06984305381774902 time for calcul the mask position with numpy : 0.05353116989135742 nb_pixel_total : 1015865 time to create 1 rle with new method : 0.5942537784576416 time for calcul the mask position with numpy : 0.036596059799194336 nb_pixel_total : 69369 time to create 1 rle with old method : 0.07738018035888672 time for calcul the mask position with numpy : 0.03360795974731445 nb_pixel_total : 51659 time to create 1 rle with old method : 0.05770707130432129 time for calcul the mask position with numpy : 0.02378368377685547 nb_pixel_total : 47926 time to create 1 rle with old method : 0.05359673500061035 time for calcul the mask position with numpy : 0.0216217041015625 nb_pixel_total : 94372 time to create 1 rle with old method : 0.10944843292236328 time for calcul the mask position with numpy : 0.022670269012451172 nb_pixel_total : 41899 time to create 1 rle with old method : 0.04942035675048828 create new chi : 5.195749998092651 time to delete rle : 0.0022852420806884766 batch 1 Loaded 45 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 13873 TO DO : save crop sub photo not yet done ! save time : 2.7421233654022217 nb_obj : 21 nb_hashtags : 2 time to prepare the origin masks : 7.952542543411255 time for calcul the mask position with numpy : 1.3610906600952148 nb_pixel_total : 6437234 time to create 1 rle with new method : 0.29492712020874023 time for calcul the mask position with numpy : 0.021044492721557617 nb_pixel_total : 5795 time to create 1 rle with old method : 0.00644683837890625 time for calcul the mask position with numpy : 0.022345781326293945 nb_pixel_total : 19179 time to create 1 rle with old method : 0.02138972282409668 time for calcul the mask position with numpy : 0.020886898040771484 nb_pixel_total : 12946 time to create 1 rle with old method : 0.014556884765625 time for calcul the mask position with numpy : 0.020774126052856445 nb_pixel_total : 28363 time to create 1 rle with old method : 0.03141522407531738 time for calcul the mask position with numpy : 0.020833253860473633 nb_pixel_total : 18190 time to create 1 rle with old method : 0.020387649536132812 time for calcul the mask position with numpy : 0.021445751190185547 nb_pixel_total : 32342 time to create 1 rle with old method : 0.03618359565734863 time for calcul the mask position with numpy : 0.021488666534423828 nb_pixel_total : 11267 time to create 1 rle with old method : 0.012566089630126953 time for calcul the mask position with numpy : 0.023128271102905273 nb_pixel_total : 42007 time to create 1 rle with old method : 0.0461885929107666 time for calcul the mask position with numpy : 0.02071523666381836 nb_pixel_total : 62637 time to create 1 rle with old method : 0.06982803344726562 time for calcul the mask position with numpy : 0.02139115333557129 nb_pixel_total : 11120 time to create 1 rle with old method : 0.012411117553710938 time for calcul the mask position with numpy : 0.021930694580078125 nb_pixel_total : 22150 time to create 1 rle with old method : 0.024852275848388672 time for calcul the mask position with numpy : 0.02328944206237793 nb_pixel_total : 46983 time to create 1 rle with old method : 0.052202701568603516 time for calcul the mask position with numpy : 0.021733999252319336 nb_pixel_total : 27952 time to create 1 rle with old method : 0.031181812286376953 time for calcul the mask position with numpy : 0.024874210357666016 nb_pixel_total : 14417 time to create 1 rle with old method : 0.016248464584350586 time for calcul the mask position with numpy : 0.023691654205322266 nb_pixel_total : 36355 time to create 1 rle with old method : 0.04042625427246094 time for calcul the mask position with numpy : 0.02692890167236328 nb_pixel_total : 47781 time to create 1 rle with old method : 0.07172226905822754 time for calcul the mask position with numpy : 0.02338266372680664 nb_pixel_total : 34704 time to create 1 rle with old method : 0.04071331024169922 time for calcul the mask position with numpy : 0.02661275863647461 nb_pixel_total : 43631 time to create 1 rle with old method : 0.05782151222229004 time for calcul the mask position with numpy : 0.02836465835571289 nb_pixel_total : 10326 time to create 1 rle with old method : 0.011709213256835938 time for calcul the mask position with numpy : 0.025360822677612305 nb_pixel_total : 35854 time to create 1 rle with old method : 0.04751992225646973 time for calcul the mask position with numpy : 0.028286457061767578 nb_pixel_total : 49007 time to create 1 rle with old method : 0.06635355949401855 create new chi : 2.919046401977539 time to delete rle : 0.0018842220306396484 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++++++++Number RLEs to save : 11308 TO DO : save crop sub photo not yet done ! save time : 1.4787731170654297 nb_obj : 17 nb_hashtags : 4 time to prepare the origin masks : 7.500758171081543 time for calcul the mask position with numpy : 1.1767337322235107 nb_pixel_total : 6548721 time to create 1 rle with new method : 0.9130303859710693 time for calcul the mask position with numpy : 0.02261519432067871 nb_pixel_total : 8854 time to create 1 rle with old method : 0.01040339469909668 time for calcul the mask position with numpy : 0.023797035217285156 nb_pixel_total : 13598 time to create 1 rle with old method : 0.015227079391479492 time for calcul the mask position with numpy : 0.022739887237548828 nb_pixel_total : 14778 time to create 1 rle with old method : 0.01682114601135254 time for calcul the mask position with numpy : 0.023135662078857422 nb_pixel_total : 48900 time to create 1 rle with old method : 0.05463719367980957 time for calcul the mask position with numpy : 0.02215719223022461 nb_pixel_total : 52085 time to create 1 rle with old method : 0.05848574638366699 time for calcul the mask position with numpy : 0.021703481674194336 nb_pixel_total : 19276 time to create 1 rle with old method : 0.02167963981628418 time for calcul the mask position with numpy : 0.021765947341918945 nb_pixel_total : 23561 time to create 1 rle with old method : 0.026233673095703125 time for calcul the mask position with numpy : 0.027106761932373047 nb_pixel_total : 9581 time to create 1 rle with old method : 0.01073455810546875 time for calcul the mask position with numpy : 0.023643970489501953 nb_pixel_total : 27106 time to create 1 rle with old method : 0.03029918670654297 time for calcul the mask position with numpy : 0.02208113670349121 nb_pixel_total : 15714 time to create 1 rle with old method : 0.017688274383544922 time for calcul the mask position with numpy : 0.024426698684692383 nb_pixel_total : 42929 time to create 1 rle with old method : 0.048406124114990234 time for calcul the mask position with numpy : 0.026489973068237305 nb_pixel_total : 51126 time to create 1 rle with old method : 0.07976388931274414 time for calcul the mask position with numpy : 0.023651838302612305 nb_pixel_total : 11858 time to create 1 rle with old method : 0.013444185256958008 time for calcul the mask position with numpy : 0.023454666137695312 nb_pixel_total : 24663 time to create 1 rle with old method : 0.027642250061035156 time for calcul the mask position with numpy : 0.02469801902770996 nb_pixel_total : 12989 time to create 1 rle with old method : 0.014589309692382812 time for calcul the mask position with numpy : 0.022812366485595703 nb_pixel_total : 30759 time to create 1 rle with old method : 0.03430509567260742 time for calcul the mask position with numpy : 0.024358272552490234 nb_pixel_total : 93742 time to create 1 rle with old method : 0.10513901710510254 create new chi : 3.1185953617095947 time to delete rle : 0.001641988754272461 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 10760 TO DO : save crop sub photo not yet done ! save time : 1.342867136001587 map_output_result : {1354026995: (0.0, 'Should be the crop_list due to order', 0), 1354026990: (0.0, 'Should be the crop_list due to order', 0), 1354026956: (0.0, 'Should be the crop_list due to order', 0), 1354026953: (0.0, 'Should be the crop_list due to order', 0), 1354026936: (0.0, 'Should be the crop_list due to order', 0), 1353972393: (0.0, 'Should be the crop_list due to order', 0), 1353972389: (0.0, 'Should be the crop_list due to order', 0), 1353972374: (0.0, 'Should be the crop_list due to order', 0), 1353972369: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1354026995, 1354026990, 1354026956, 1354026953, 1354026936, 1353972393, 1353972389, 1353972374, 1353972369] Looping around the photos to save general results len do output : 9 /1354026995.Didn't retrieve data . /1354026990.Didn't retrieve data . /1354026956.Didn't retrieve data . /1354026953.Didn't retrieve data . /1354026936.Didn't retrieve data . /1353972393.Didn't retrieve data . /1353972389.Didn't retrieve data . /1353972374.Didn't retrieve data . /1353972369.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026995', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026990', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026956', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026953', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026936', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1353972393', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1353972389', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1353972374', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1353972369', None, None, None, None, None, '2766711') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.12786078453063965 save_final save missing photos in datou_result : time spend for datou_step_exec : 182.2044575214386 time spend to save output : 0.12834835052490234 total time spend for step 3 : 182.3328058719635 step4:ventilate_hashtags_in_portfolio Tue Apr 29 00:27:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22477720 get user id for portfolio 22477720 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22477720 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','metal','carton','pet_fonce','mal_croppe','pet_clair','pehd','papier','background','autre','environnement')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22477720 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','metal','carton','pet_fonce','mal_croppe','pet_clair','pehd','papier','background','autre','environnement')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22477720 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','metal','carton','pet_fonce','mal_croppe','pet_clair','pehd','papier','background','autre','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22478308,22478309,22478310,22478311,22478312,22478313,22478314,22478315,22478316,22478317,22478318?tags=flou,metal,carton,pet_fonce,mal_croppe,pet_clair,pehd,papier,background,autre,environnement Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1354026995, 1354026990, 1354026956, 1354026953, 1354026936, 1353972393, 1353972389, 1353972374, 1353972369] Looping around the photos to save general results len do output : 1 /22477720. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026995', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026990', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026956', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026953', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026936', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1353972393', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1353972389', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1353972374', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1353972369', None, None, None, None, None, '2766711') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.017621517181396484 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.0866270065307617 time spend to save output : 0.017943859100341797 total time spend for step 4 : 2.1045708656311035 step5:final Tue Apr 29 00:27:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1354026995: ('0.1550940109840232',), 1354026990: ('0.1550940109840232',), 1354026956: ('0.1550940109840232',), 1354026953: ('0.1550940109840232',), 1354026936: ('0.1550940109840232',), 1353972393: ('0.1550940109840232',), 1353972389: ('0.1550940109840232',), 1353972374: ('0.1550940109840232',), 1353972369: ('0.1550940109840232',)} new output for save of step final : {1354026995: ('0.1550940109840232',), 1354026990: ('0.1550940109840232',), 1354026956: ('0.1550940109840232',), 1354026953: ('0.1550940109840232',), 1354026936: ('0.1550940109840232',), 1353972393: ('0.1550940109840232',), 1353972389: ('0.1550940109840232',), 1353972374: ('0.1550940109840232',), 1353972369: ('0.1550940109840232',)} [1354026995, 1354026990, 1354026956, 1354026953, 1354026936, 1353972393, 1353972389, 1353972374, 1353972369] Looping around the photos to save general results len do output : 9 /1354026995.Didn't retrieve data . /1354026990.Didn't retrieve data . /1354026956.Didn't retrieve data . /1354026953.Didn't retrieve data . /1354026936.Didn't retrieve data . /1353972393.Didn't retrieve data . /1353972389.Didn't retrieve data . /1353972374.Didn't retrieve data . /1353972369.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026995', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026990', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026956', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026953', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026936', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1353972393', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1353972389', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1353972374', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1353972369', None, None, None, None, None, '2766711') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.019101858139038086 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11550712585449219 time spend to save output : 0.019598007202148438 total time spend for step 5 : 0.13510513305664062 step6:blur_detection Tue Apr 29 00:27:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c.jpg resize: (2160, 3264) 1354026995 -0.858169816981535 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252.jpg resize: (2160, 3264) 1354026990 -5.417238118100347 treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781.jpg resize: (2160, 3264) 1354026956 -1.1545148779035583 treat image : temp/1745878828_69623_1354026953_c270e9956bf7fa7c1764a8d079913481.jpg resize: (2160, 3264) 1354026953 -0.7340229329208547 treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664.jpg resize: (2160, 3264) 1354026936 -0.5950041748605848 treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e.jpg resize: (2160, 3264) 1353972393 -2.6680005841455476 treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849.jpg resize: (2160, 3264) 1353972389 -2.384042576873541 treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949.jpg resize: (2160, 3264) 1353972374 -3.652242114668897 treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040.jpg resize: (2160, 3264) 1353972369 -2.992846853258296 treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879645_0.png resize: (121, 207) 1354068404 -1.7109731525329863 treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879649_0.png resize: (163, 216) 1354068405 -1.7307357692695504 treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879652_0.png resize: (235, 448) 1354068406 0.16993033230299426 treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879654_0.png resize: (266, 315) 1354068407 0.05878158786345114 treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879653_0.png resize: (202, 341) 1354068408 -2.460028084550824 treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879646_0.png resize: (231, 387) 1354068409 -0.37050318186671966 treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879647_0.png resize: (267, 178) 1354068410 -0.07923769407685605 treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879640_0.png resize: (112, 141) 1354068411 -0.24244462378902285 treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879650_0.png resize: (196, 109) 1354068412 -0.27472089830937113 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879674_0.png resize: (150, 167) 1354068413 -1.7140512218717776 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879662_0.png resize: (375, 319) 1354068414 -2.7492441203140663 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879663_0.png resize: (222, 355) 1354068415 -1.9693985743713551 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879671_0.png resize: (167, 317) 1354068416 -2.5024366381638266 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879672_0.png resize: (144, 182) 1354068417 -1.8553221656861387 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879683_0.png resize: (193, 185) 1354068418 -4.198670137449678 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879661_0.png resize: (94, 133) 1354068419 -2.0486490035815716 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879669_0.png resize: (397, 289) 1354068420 -2.7158997509660554 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879676_0.png resize: (606, 491) 1354068421 -4.099175837945134 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879684_0.png resize: (189, 167) 1354068422 -2.4339238990210883 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879679_0.png resize: (324, 375) 1354068423 -3.707795805872065 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879682_0.png resize: (117, 169) 1354068424 -3.5421894498235096 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879670_0.png resize: (248, 327) 1354068425 -3.736361067482027 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879673_0.png resize: (152, 128) 1354068426 -3.97669235017677 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879667_0.png resize: (412, 339) 1354068427 -3.511620317137569 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879677_0.png resize: (243, 209) 1354068428 -3.220510919283416 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879666_0.png resize: (188, 199) 1354068430 -5.641982315699759 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879659_0.png resize: (320, 243) 1354068431 -1.9713006913781645 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879660_0.png resize: (401, 485) 1354068432 -4.383552213442964 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879658_0.png resize: (470, 469) 1354068433 -5.0939624812021735 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879664_0.png resize: (584, 538) 1354068434 -0.7407046301922338 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879668_0.png resize: (205, 186) 1354068435 -1.0852846609554423 treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879690_0.png resize: (536, 319) 1354068436 -0.7211615188319412 treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879697_0.png resize: (640, 762) 1354068437 -0.4453271455899784 treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879692_0.png resize: (666, 193) 1354068438 -1.97281476873305 treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879699_0.png resize: (579, 248) 1354068439 -1.5632893473434377 treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879694_0.png resize: (203, 209) 1354068440 -1.3703044500073465 treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879701_0.png resize: (247, 424) 1354068441 -1.6293387793888305 treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879705_0.png resize: (230, 123) 1354068442 -1.4372408792053564 treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879696_0.png resize: (81, 148) 1354068443 -1.633037407488482 treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879700_0.png resize: (126, 159) 1354068445 -2.1768779510856233 treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879689_0.png resize: (427, 185) 1354068446 -0.977343811660211 treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879702_0.png resize: (277, 273) 1354068447 -0.9197701961606958 treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879698_0.png resize: (116, 213) 1354068448 -1.3245324815145847 treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879693_0.png resize: (164, 126) 1354068449 -1.8785587636891257 treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879703_0.png resize: (192, 154) 1354068450 -0.531784549635112 treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879706_0.png resize: (196, 197) 1354068451 -0.46156187551352007 treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879704_0.png resize: (164, 164) 1354068452 -1.2089389395456267 treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879691_0.png resize: (152, 266) 1354068453 -2.413964687918801 treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879695_0.png resize: (514, 306) 1354068454 -2.0277813581667834 treat image : temp/1745878828_69623_1354026953_c270e9956bf7fa7c1764a8d079913481_rle_crop_3771879713_0.png resize: (657, 465) 1354068455 -1.658741968651197 treat image : temp/1745878828_69623_1354026953_c270e9956bf7fa7c1764a8d079913481_rle_crop_3771879708_0.png resize: (183, 140) 1354068456 -1.2540515425217782 treat image : temp/1745878828_69623_1354026953_c270e9956bf7fa7c1764a8d079913481_rle_crop_3771879710_0.png resize: (148, 184) 1354068458 -0.6441035713688772 treat image : temp/1745878828_69623_1354026953_c270e9956bf7fa7c1764a8d079913481_rle_crop_3771879717_0.png resize: (80, 126) 1354068459 -1.3524298287513623 treat image : temp/1745878828_69623_1354026953_c270e9956bf7fa7c1764a8d079913481_rle_crop_3771879716_0.png resize: (155, 207) 1354068460 -0.06879269574671733 treat image : temp/1745878828_69623_1354026953_c270e9956bf7fa7c1764a8d079913481_rle_crop_3771879709_0.png resize: (165, 121) 1354068461 -1.256156783922924 treat image : temp/1745878828_69623_1354026953_c270e9956bf7fa7c1764a8d079913481_rle_crop_3771879711_0.png resize: (321, 190) 1354068462 -1.5907639247716587 treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879719_0.png resize: (440, 265) 1354068464 -0.32526138056610016 treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879728_0.png resize: (257, 110) 1354068465 -1.892986152171405 treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879727_0.png resize: (423, 229) 1354068466 -1.6274237449390352 treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879726_0.png resize: (532, 485) 1354068467 -1.2900048006409421 treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879722_0.png resize: (217, 388) 1354068468 -0.44827410842310794 treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879736_0.png resize: (186, 183) 1354068469 -2.660656721959045 treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879724_0.png resize: (126, 128) 1354068470 -1.696002589246621 treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879718_0.png resize: (141, 237) 1354068471 -0.9107080935794436 treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879725_0.png resize: (277, 231) 1354068472 -1.0143989783622092 treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879721_0.png resize: (176, 136) 1354068473 -1.6003627603589539 treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879735_0.png resize: (164, 180) 1354068474 -0.37604967067290973 treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879729_0.png resize: (71, 86) 1354068475 2.136466719686902 treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879730_0.png resize: (87, 185) 1354068476 0.17336619212151713 treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879734_0.png resize: (171, 148) 1354068477 -0.7003618343699601 treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879731_0.png resize: (210, 205) 1354068478 -1.0925969953282424 treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879723_0.png resize: (706, 811) 1354068479 0.2657852864539125 treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879738_0.png resize: (765, 158) 1354068480 0.4453577923859638 treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879741_0.png resize: (712, 596) 1354068481 -0.37141380730506335 treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879737_0.png resize: (246, 213) 1354068482 -2.4875211816978053 treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879746_0.png resize: (1132, 487) 1354068483 -1.2673396392332403 treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879749_0.png resize: (139, 127) 1354068484 -0.6550372715473869 treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879748_0.png resize: (127, 165) 1354068485 -2.161073554083619 treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879739_0.png resize: (228, 148) 1354068486 -1.2212629003194857 treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879745_0.png resize: (89, 175) 1354068487 -3.1649549103514225 treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879765_0.png resize: (221, 277) 1354068488 -1.9744376920092839 treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879763_0.png resize: (139, 140) 1354068489 -0.5901003643850332 treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879752_0.png resize: (226, 314) 1354068490 -1.1432189313421444 treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879766_0.png resize: (124, 145) 1354068491 -1.7190294302190041 treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879759_0.png resize: (223, 318) 1354068492 -2.2079787677316864 treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879758_0.png resize: (144, 83) 1354068493 2.4529031933263976 treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879769_0.png resize: (279, 219) 1354068494 -0.8767557721655889 treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879764_0.png resize: (287, 348) 1354068495 -0.40992649419463195 treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879757_0.png resize: (178, 241) 1354068496 -1.2108750741305192 treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879760_0.png resize: (379, 581) 1354068497 -2.01098078864306 treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879775_0.png resize: (235, 252) 1354068498 -1.5045857282138795 treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879779_0.png resize: (178, 118) 1354068499 -1.950428085351376 treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879772_0.png resize: (232, 351) 1354068500 -1.3002222680408815 treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879780_0.png resize: (234, 186) 1354068501 -2.8542077470382825 treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879778_0.png resize: (208, 264) 1354068502 -1.2516067054616622 treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879774_0.png resize: (142, 104) 1354068503 -1.2428899281424364 treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879784_0.png resize: (228, 392) 1354068504 -2.7152152068643156 treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879773_0.png resize: (187, 278) 1354068505 -2.346936632283576 treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879785_0.png resize: (376, 320) 1354068506 -2.133401424173001 treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879790_0.png resize: (112, 197) 1354068507 -2.479421646666863 treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879788_0.png resize: (191, 159) 1354068508 -0.8694758586717801 treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879781_0.png resize: (196, 318) 1354068509 -1.3105109440574692 treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879792_0.png resize: (97, 88) 1354068510 -2.21544121885975 treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879777_0.png resize: (211, 309) 1354068511 -1.3370528281537675 treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879791_0.png resize: (210, 105) 1354068513 -1.1663070743801087 treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879800_0.png resize: (128, 192) 1354068514 -1.5478040033943627 treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879796_0.png resize: (229, 150) 1354068515 -0.6714275520567885 treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879804_0.png resize: (203, 265) 1354068516 -1.4032378539510646 treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879797_0.png resize: (71, 229) 1354068517 -1.79794442772959 treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879806_0.png resize: (470, 340) 1354068518 -1.4300761607730692 treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879802_0.png resize: (197, 104) 1354068519 -1.990414636716134 treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879799_0.png resize: (182, 342) 1354068520 -1.2759343998977342 treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879798_0.png resize: (334, 247) 1354068522 -0.20483810530922955 treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879807_0.png resize: (373, 177) 1354068523 -1.2711894155400385 treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879642_0.png resize: (99, 217) 1354068544 -0.7069122285393408 treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879641_0.png resize: (195, 123) 1354068545 0.14961737993123334 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879685_0.png resize: (154, 243) 1354068546 -1.1689721374840358 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879665_0.png resize: (165, 221) 1354068547 -1.658720748476419 treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879707_0.png resize: (555, 348) 1354068548 -0.5402393064791378 treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879747_0.png resize: (129, 257) 1354068549 -2.413274106713321 treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879761_0.png resize: (189, 183) 1354068551 -1.1403896023319047 treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879771_0.png resize: (273, 239) 1354068552 -0.9941230690819881 treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879768_0.png resize: (220, 336) 1354068553 -1.6805170704581458 treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879753_0.png resize: (232, 292) 1354068554 -1.1722131824720885 treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879770_0.png resize: (196, 157) 1354068555 0.016774884616392406 treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879787_0.png resize: (268, 227) 1354068556 -1.8031334854433811 treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879786_0.png resize: (91, 178) 1354068557 -1.3486960996714683 treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879776_0.png resize: (185, 282) 1354068558 -1.3461691997226992 treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879782_0.png resize: (220, 125) 1354068559 -0.9935152145659498 treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879783_0.png resize: (137, 110) 1354068560 -0.19563192993237563 treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879789_0.png resize: (213, 200) 1354068561 -1.9097260594219674 treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879795_0.png resize: (119, 176) 1354068562 -0.9389099300594939 treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879808_0.png resize: (114, 181) 1354068563 -1.3940342423038363 treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879801_0.png resize: (188, 198) 1354068564 -0.3506694911542525 treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879803_0.png resize: (206, 186) 1354068565 -1.685506588398954 treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879805_0.png resize: (215, 274) 1354068566 -2.085752100071041 treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879643_0.png resize: (310, 182) 1354068591 -1.8916384338903878 treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879651_0.png resize: (220, 316) 1354068592 -1.3994314792464506 treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879657_0.png resize: (473, 409) 1354068593 -0.41610667574031296 treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879648_0.png resize: (214, 398) 1354068594 -1.100752984643598 treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879644_0.png resize: (455, 311) 1354068595 -0.32765960305482505 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879680_0.png resize: (85, 200) 1354068596 -1.6246276259338726 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879687_0.png resize: (342, 402) 1354068597 -2.7761295338049283 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879681_0.png resize: (261, 184) 1354068598 -2.8647708154205307 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879688_0.png resize: (208, 169) 1354068599 -1.259159170631772 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879678_0.png resize: (211, 293) 1354068600 -3.928361492963822 treat image : temp/1745878828_69623_1354026953_c270e9956bf7fa7c1764a8d079913481_rle_crop_3771879712_0.png resize: (345, 225) 1354068601 -0.9553016077916207 treat image : temp/1745878828_69623_1354026953_c270e9956bf7fa7c1764a8d079913481_rle_crop_3771879714_0.png resize: (774, 1416) 1354068602 -0.34606031457732506 treat image : temp/1745878828_69623_1354026953_c270e9956bf7fa7c1764a8d079913481_rle_crop_3771879715_0.png resize: (461, 291) 1354068603 -1.4740637589948071 treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879733_0.png resize: (704, 777) 1354068604 0.36880997991381803 treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879720_0.png resize: (191, 344) 1354068605 -1.1039652730208227 treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879732_0.png resize: (209, 157) 1354068606 -1.3560356145957355 treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879743_0.png resize: (265, 341) 1354068607 -2.32266394563594 treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879740_0.png resize: (471, 340) 1354068608 -1.0433712434519644 treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879744_0.png resize: (99, 359) 1354068609 -2.842621653149799 treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879742_0.png resize: (551, 894) 1354068610 -1.601653147421787 treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879750_0.png resize: (187, 294) 1354068611 -1.30697448582789 treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879762_0.png resize: (181, 708) 1354068612 -0.6604596217265795 treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879755_0.png resize: (1036, 1268) 1354068613 -3.100180968385259 treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879756_0.png resize: (297, 255) 1354068614 -2.9886141125141625 treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879793_0.png resize: (268, 938) 1354068615 -2.789285213931445 treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879809_0.png resize: (497, 328) 1354068616 -1.4783702258438378 treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879656_0.png resize: (158, 173) 1354068618 -1.0032772862278656 treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879655_0.png resize: (297, 256) 1354068620 -1.525143677186828 treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879767_0.png resize: (181, 213) 1354068621 -0.879123517000881 treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879754_0.png resize: (200, 684) 1354068622 -2.075854746692942 treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879751_0.png resize: (211, 708) 1354068623 -2.360143268044226 treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879794_0.png resize: (222, 184) 1354068624 -0.907299210665874 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879686_0.png resize: (126, 161) 1354068626 -0.5375691756827693 treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879675_0.png resize: (88, 358) 1354068629 -1.9458738135879312 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 179 time used for this insertion : 0.025684833526611328 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 179 time used for this insertion : 0.3824949264526367 save missing photos in datou_result : time spend for datou_step_exec : 41.34392833709717 time spend to save output : 0.4160573482513428 total time spend for step 6 : 41.75998568534851 step7:brightness Tue Apr 29 00:28:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c.jpg treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252.jpg treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781.jpg treat image : temp/1745878828_69623_1354026953_c270e9956bf7fa7c1764a8d079913481.jpg treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664.jpg treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e.jpg treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849.jpg treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949.jpg treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040.jpg treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879645_0.png treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879649_0.png treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879652_0.png treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879654_0.png treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879653_0.png treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879646_0.png treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879647_0.png treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879640_0.png treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879650_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879674_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879662_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879663_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879671_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879672_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879683_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879661_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879669_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879676_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879684_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879679_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879682_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879670_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879673_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879667_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879677_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879666_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879659_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879660_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879658_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879664_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879668_0.png treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879690_0.png treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879697_0.png treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879692_0.png treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879699_0.png treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879694_0.png treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879701_0.png treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879705_0.png treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879696_0.png treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879700_0.png treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879689_0.png treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879702_0.png treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879698_0.png treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879693_0.png treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879703_0.png treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879706_0.png treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879704_0.png treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879691_0.png treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879695_0.png treat image : temp/1745878828_69623_1354026953_c270e9956bf7fa7c1764a8d079913481_rle_crop_3771879713_0.png treat image : temp/1745878828_69623_1354026953_c270e9956bf7fa7c1764a8d079913481_rle_crop_3771879708_0.png treat image : temp/1745878828_69623_1354026953_c270e9956bf7fa7c1764a8d079913481_rle_crop_3771879710_0.png treat image : temp/1745878828_69623_1354026953_c270e9956bf7fa7c1764a8d079913481_rle_crop_3771879717_0.png treat image : temp/1745878828_69623_1354026953_c270e9956bf7fa7c1764a8d079913481_rle_crop_3771879716_0.png treat image : temp/1745878828_69623_1354026953_c270e9956bf7fa7c1764a8d079913481_rle_crop_3771879709_0.png treat image : temp/1745878828_69623_1354026953_c270e9956bf7fa7c1764a8d079913481_rle_crop_3771879711_0.png treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879719_0.png treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879728_0.png treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879727_0.png treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879726_0.png treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879722_0.png treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879736_0.png treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879724_0.png treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879718_0.png treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879725_0.png treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879721_0.png treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879735_0.png treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879729_0.png treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879730_0.png treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879734_0.png treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879731_0.png treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879723_0.png treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879738_0.png treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879741_0.png treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879737_0.png treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879746_0.png treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879749_0.png treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879748_0.png treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879739_0.png treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879745_0.png treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879765_0.png treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879763_0.png treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879752_0.png treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879766_0.png treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879759_0.png treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879758_0.png treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879769_0.png treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879764_0.png treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879757_0.png treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879760_0.png treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879775_0.png treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879779_0.png treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879772_0.png treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879780_0.png treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879778_0.png treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879774_0.png treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879784_0.png treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879773_0.png treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879785_0.png treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879790_0.png treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879788_0.png treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879781_0.png treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879792_0.png treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879777_0.png treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879791_0.png treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879800_0.png treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879796_0.png treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879804_0.png treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879797_0.png treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879806_0.png treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879802_0.png treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879799_0.png treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879798_0.png treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879807_0.png treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879642_0.png treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879641_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879685_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879665_0.png treat image : temp/1745878828_69623_1354026956_e840ab5829923e8dba3f8c6bd4f72781_rle_crop_3771879707_0.png treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879747_0.png treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879761_0.png treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879771_0.png treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879768_0.png treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879753_0.png treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879770_0.png treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879787_0.png treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879786_0.png treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879776_0.png treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879782_0.png treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879783_0.png treat image : temp/1745878828_69623_1353972374_fade959a47021dc84f96db1b9d08b949_rle_crop_3771879789_0.png treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879795_0.png treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879808_0.png treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879801_0.png treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879803_0.png treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879805_0.png treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879643_0.png treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879651_0.png treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879657_0.png treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879648_0.png treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879644_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879680_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879687_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879681_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879688_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879678_0.png treat image : temp/1745878828_69623_1354026953_c270e9956bf7fa7c1764a8d079913481_rle_crop_3771879712_0.png treat image : temp/1745878828_69623_1354026953_c270e9956bf7fa7c1764a8d079913481_rle_crop_3771879714_0.png treat image : temp/1745878828_69623_1354026953_c270e9956bf7fa7c1764a8d079913481_rle_crop_3771879715_0.png treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879733_0.png treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879720_0.png treat image : temp/1745878828_69623_1354026936_538654e7a5b6f0c0ac26faad8f8c0664_rle_crop_3771879732_0.png treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879743_0.png treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879740_0.png treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879744_0.png treat image : temp/1745878828_69623_1353972393_f75484d7a62d89584e0fe613b97b186e_rle_crop_3771879742_0.png treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879750_0.png treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879762_0.png treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879755_0.png treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879756_0.png treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879793_0.png treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879809_0.png treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879656_0.png treat image : temp/1745878828_69623_1354026995_55e090a5f4cbed59dfd3ac5620b68f0c_rle_crop_3771879655_0.png treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879767_0.png treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879754_0.png treat image : temp/1745878828_69623_1353972389_77e09fecfdd59285d88cf581b4283849_rle_crop_3771879751_0.png treat image : temp/1745878828_69623_1353972369_11405af9a2981828328e3fccc24da040_rle_crop_3771879794_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879686_0.png treat image : temp/1745878828_69623_1354026990_53775174613eaa96d8a113ed1a273252_rle_crop_3771879675_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 179 time used for this insertion : 0.02780890464782715 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 179 time used for this insertion : 0.35343265533447266 save missing photos in datou_result : time spend for datou_step_exec : 8.743432760238647 time spend to save output : 0.3898913860321045 total time spend for step 7 : 9.133324146270752 step8:velours_tree Tue Apr 29 00:28:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 1.5106201171875 time spend to save output : 6.890296936035156e-05 total time spend for step 8 : 1.5106890201568604 step9:send_mail_cod Tue Apr 29 00:28:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22477720_29-04-2025_00_28_13.pdf 22478308 imagette224783081745879293 22478309 imagette224783091745879293 22478310 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette224783101745879293 22478311 change filename to text .imagette224783111745879295 22478312 imagette224783121745879295 22478313 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette224783131745879295 22478314 change filename to text .imagette224783141745879296 22478315 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette224783151745879296 22478316 imagette224783161745879298 22478317 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette224783171745879298 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22477720 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22478308,22478309,22478310,22478311,22478312,22478313,22478314,22478315,22478316,22478317,22478318?tags=flou,metal,carton,pet_fonce,mal_croppe,pet_clair,pehd,papier,background,autre,environnement args[1354026995] : ((1354026995, -0.858169816981535, 492688767), (1354026995, 0.18347004908913894, 2107752395), '0.1550940109840232') We are sending mail with results at report@fotonower.com args[1354026990] : ((1354026990, -5.417238118100347, 492609224), (1354026990, 0.028302381220160218, 2107752395), '0.1550940109840232') We are sending mail with results at report@fotonower.com args[1354026956] : ((1354026956, -1.1545148779035583, 492688767), (1354026956, 0.09201219937690916, 2107752395), '0.1550940109840232') We are sending mail with results at report@fotonower.com args[1354026953] : ((1354026953, -0.7340229329208547, 492688767), (1354026953, 0.07662573526786656, 2107752395), '0.1550940109840232') We are sending mail with results at report@fotonower.com args[1354026936] : ((1354026936, -0.5950041748605848, 492688767), (1354026936, -0.09777765088182727, 496442774), '0.1550940109840232') We are sending mail with results at report@fotonower.com args[1353972393] : ((1353972393, -2.6680005841455476, 492609224), (1353972393, 0.06355257591703026, 2107752395), '0.1550940109840232') We are sending mail with results at report@fotonower.com args[1353972389] : ((1353972389, -2.384042576873541, 492609224), (1353972389, 0.1849456995564179, 2107752395), '0.1550940109840232') We are sending mail with results at report@fotonower.com args[1353972374] : ((1353972374, -3.652242114668897, 492609224), (1353972374, 0.036374582147990504, 2107752395), '0.1550940109840232') We are sending mail with results at report@fotonower.com args[1353972369] : ((1353972369, -2.992846853258296, 492609224), (1353972369, -0.023592467168623545, 2107752395), '0.1550940109840232') We are sending mail with results at report@fotonower.com refus_total : 0.1550940109840232 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22477720 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22477720_29-04-2025_00_28_13.pdf results_Auto_P22477720_29-04-2025_00_28_13.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22477720_29-04-2025_00_28_13.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22477720','results_Auto_P22477720_29-04-2025_00_28_13.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22477720_29-04-2025_00_28_13.pdf','pdf','','0.85','0.1550940109840232') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22477720

https://www.fotonower.com/image?json=false&list_photos_id=1354026995
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1354026990
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1354026956
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1354026953
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1354026936
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353972393
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353972389
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353972374
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353972369
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 15.51%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/22478310?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/22478311?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22478313?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/22478314?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22478315?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22478317?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22477720_29-04-2025_00_28_13.pdf.

Lien vers velours :https://www.fotonower.com/velours/22478308,22478309,22478310,22478311,22478312,22478313,22478314,22478315,22478316,22478317,22478318?tags=flou,metal,carton,pet_fonce,mal_croppe,pet_clair,pehd,papier,background,autre,environnement.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 28 Apr 2025 22:28:21 GMT Content-Length: 0 Connection: close X-Message-Id: JsMEnf8ERSeAT9qfoJ4SLg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1354026995, 1354026990, 1354026956, 1354026953, 1354026936, 1353972393, 1353972389, 1353972374, 1353972369] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026995', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026990', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026956', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026953', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026936', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1353972393', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1353972389', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1353972374', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1353972369', None, None, None, None, None, '2766711') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.14208269119262695 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.5250818729400635 time spend to save output : 0.14229893684387207 total time spend for step 9 : 7.6673808097839355 step10:split_time_score Tue Apr 29 00:28:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 9),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 28042025 22477720 Nombre de photos uploadées : 9 / 23040 (0%) 28042025 22477720 Nombre de photos taguées (types de déchets): 0 / 9 (0%) 28042025 22477720 Nombre de photos taguées (volume) : 0 / 9 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ????????? elapsed_time : fill_and_build_computed_from_old_data 0.0004749298095703125 elapsed_time : insert_dashboard_record_day_entry 0.023230552673339844 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22477677 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22477681 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22477709 order by id desc limit 1 Qualite : 0.02492546166814284 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22477710_29-04-2025_00_25_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22477710 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22477710 AND mptpi.`type`=3726 To do Qualite : 0.1550940109840232 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22477720_29-04-2025_00_28_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22477720 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22477720 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'28042025': {'nb_upload': 9, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1354026995, 1354026990, 1354026956, 1354026953, 1354026936, 1353972393, 1353972389, 1353972374, 1353972369] Looping around the photos to save general results len do output : 1 /22477720Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026995', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026990', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026956', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026953', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1354026936', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1353972393', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1353972389', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1353972374', None, None, None, None, None, '2766711') ('3318', None, None, None, None, None, None, None, '2766711') ('3318', '22477720', '1353972369', None, None, None, None, None, '2766711') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.08797121047973633 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.941722869873047 time spend to save output : 0.08819913864135742 total time spend for step 10 : 3.0299220085144043 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 9 set_done_treatment 161.70user 219.30system 7:59.39elapsed 79%CPU (0avgtext+0avgdata 5741148maxresident)k 2124736inputs+109904outputs (23365major+14982937minor)pagefaults 0swaps