python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1623641 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2763921'] with mtr_portfolio_ids : ['22448524'] and first list_photo_ids : [] new path : /proc/1623641/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.5090773105621338 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Apr 28 11:50:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6595 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-04-28 11:50:34.059346: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-04-28 11:50:34.087173: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-04-28 11:50:34.089504: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f4694000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-04-28 11:50:34.089534: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-04-28 11:50:34.093971: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-04-28 11:50:34.226038: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3fba66f0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-04-28 11:50:34.226083: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-04-28 11:50:34.226786: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-28 11:50:34.227168: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-28 11:50:34.230152: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-28 11:50:34.233401: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-28 11:50:34.233981: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-28 11:50:34.237685: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-28 11:50:34.239734: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-28 11:50:34.244543: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-28 11:50:34.245850: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-28 11:50:34.245947: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-28 11:50:34.246636: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-28 11:50:34.246657: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-28 11:50:34.246669: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-28 11:50:34.248196: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5913 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-04-28 11:50:34.596638: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-28 11:50:34.596770: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-28 11:50:34.596798: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-28 11:50:34.596821: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-28 11:50:34.596843: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-28 11:50:34.596865: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-28 11:50:34.596886: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-28 11:50:34.596909: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-28 11:50:34.598217: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-28 11:50:34.599686: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-28 11:50:34.599805: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-28 11:50:34.599829: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-28 11:50:34.599850: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-28 11:50:34.599870: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-28 11:50:34.599890: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-28 11:50:34.599910: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-28 11:50:34.599931: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-28 11:50:34.601292: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-28 11:50:34.601351: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-28 11:50:34.601363: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-28 11:50:34.601374: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-28 11:50:34.610693: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5913 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-04-28 11:50:46.566275: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-28 11:50:46.858265: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-28 11:50:48.977167: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.051658: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.052243: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.052765: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.053296: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.053817: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.054356: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.054405: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-28 11:50:49.055044: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.055066: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-28 11:50:49.061979: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.062018: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-28 11:50:49.062547: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.062563: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-28 11:50:49.068504: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.068555: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-28 11:50:49.069089: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.069107: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-28 11:50:49.095629: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.095688: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-28 11:50:49.100127: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.100175: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-28 11:50:49.105743: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.105783: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-28 11:50:49.106313: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.106329: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-28 11:50:49.134695: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.135273: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.136946: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.137497: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.174065: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.174657: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.176645: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.177192: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.203038: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.203651: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.205297: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.205879: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.211892: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.212548: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.214309: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.214884: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.222569: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.223279: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.225074: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.225670: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.255503: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.256105: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.256647: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.257181: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.260948: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.261515: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.278992: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.279651: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.280198: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.280738: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.296594: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.297241: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.297793: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.298337: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.303360: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.303989: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.309437: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.310070: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.323358: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.323976: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.328443: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.329029: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.329573: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.330114: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.331160: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.331750: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.342381: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.342982: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.343554: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.344089: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.344648: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.345192: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.345733: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.346305: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.356022: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.356682: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.363328: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.363908: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.421969: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.422107: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-04-28 11:50:49.422757: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.423461: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.431676: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.432389: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.433030: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.433631: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.442664: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.443480: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.463347: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.464026: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.464587: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.465120: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.469464: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.470027: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.470577: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.471116: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.472493: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.483020: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.483603: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.493911: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.494493: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.495107: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.495723: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.496273: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-28 11:50:49.496811: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.85000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.35000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.60000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 63 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.85000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 45 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.85000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.85000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 45 Detection mask done ! Trying to reset tf kernel 1624373 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4209 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6945 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0025615692138671875 nb_pixel_total : 42277 time to create 1 rle with old method : 0.051340579986572266 length of segment : 234 time for calcul the mask position with numpy : 0.0007746219635009766 nb_pixel_total : 26309 time to create 1 rle with old method : 0.030496597290039062 length of segment : 167 time for calcul the mask position with numpy : 0.00046515464782714844 nb_pixel_total : 11240 time to create 1 rle with old method : 0.013134002685546875 length of segment : 142 time for calcul the mask position with numpy : 0.0008544921875 nb_pixel_total : 30505 time to create 1 rle with old method : 0.037239789962768555 length of segment : 186 time for calcul the mask position with numpy : 0.008659839630126953 nb_pixel_total : 251258 time to create 1 rle with new method : 0.015575885772705078 length of segment : 842 time for calcul the mask position with numpy : 0.0028100013732910156 nb_pixel_total : 70513 time to create 1 rle with old method : 0.08933830261230469 length of segment : 436 time for calcul the mask position with numpy : 0.0009698867797851562 nb_pixel_total : 19671 time to create 1 rle with old method : 0.026476621627807617 length of segment : 177 time for calcul the mask position with numpy : 0.03305244445800781 nb_pixel_total : 452632 time to create 1 rle with new method : 0.2211301326751709 length of segment : 801 time for calcul the mask position with numpy : 0.0013966560363769531 nb_pixel_total : 61919 time to create 1 rle with old method : 0.0773627758026123 length of segment : 293 time for calcul the mask position with numpy : 0.0005733966827392578 nb_pixel_total : 24459 time to create 1 rle with old method : 0.029478073120117188 length of segment : 199 time for calcul the mask position with numpy : 0.00045371055603027344 nb_pixel_total : 9269 time to create 1 rle with old method : 0.012360572814941406 length of segment : 104 time for calcul the mask position with numpy : 0.002386808395385742 nb_pixel_total : 88056 time to create 1 rle with old method : 0.12047314643859863 length of segment : 512 time for calcul the mask position with numpy : 0.00039458274841308594 nb_pixel_total : 6199 time to create 1 rle with old method : 0.007326841354370117 length of segment : 101 time for calcul the mask position with numpy : 0.0011539459228515625 nb_pixel_total : 23340 time to create 1 rle with old method : 0.027777910232543945 length of segment : 192 time for calcul the mask position with numpy : 0.0007936954498291016 nb_pixel_total : 16689 time to create 1 rle with old method : 0.02266716957092285 length of segment : 149 time for calcul the mask position with numpy : 0.0005640983581542969 nb_pixel_total : 10964 time to create 1 rle with old method : 0.012784481048583984 length of segment : 160 time for calcul the mask position with numpy : 0.0005793571472167969 nb_pixel_total : 13738 time to create 1 rle with old method : 0.016150236129760742 length of segment : 129 time for calcul the mask position with numpy : 0.0005464553833007812 nb_pixel_total : 9360 time to create 1 rle with old method : 0.011370658874511719 length of segment : 125 time for calcul the mask position with numpy : 0.001483917236328125 nb_pixel_total : 40758 time to create 1 rle with old method : 0.047148942947387695 length of segment : 263 time for calcul the mask position with numpy : 0.0006976127624511719 nb_pixel_total : 11092 time to create 1 rle with old method : 0.013214349746704102 length of segment : 123 time for calcul the mask position with numpy : 0.0019109249114990234 nb_pixel_total : 61947 time to create 1 rle with old method : 0.07082796096801758 length of segment : 300 time for calcul the mask position with numpy : 0.0004956722259521484 nb_pixel_total : 10677 time to create 1 rle with old method : 0.013055086135864258 length of segment : 148 time for calcul the mask position with numpy : 0.0034880638122558594 nb_pixel_total : 132895 time to create 1 rle with old method : 0.16886544227600098 length of segment : 460 time for calcul the mask position with numpy : 0.0005245208740234375 nb_pixel_total : 18213 time to create 1 rle with old method : 0.020842313766479492 length of segment : 221 time for calcul the mask position with numpy : 0.0019214153289794922 nb_pixel_total : 56266 time to create 1 rle with old method : 0.06401991844177246 length of segment : 257 time for calcul the mask position with numpy : 0.001558065414428711 nb_pixel_total : 34580 time to create 1 rle with old method : 0.03917407989501953 length of segment : 339 time for calcul the mask position with numpy : 0.0009489059448242188 nb_pixel_total : 28390 time to create 1 rle with old method : 0.03265500068664551 length of segment : 191 time for calcul the mask position with numpy : 0.0021581649780273438 nb_pixel_total : 37218 time to create 1 rle with old method : 0.042818307876586914 length of segment : 458 time for calcul the mask position with numpy : 0.0006349086761474609 nb_pixel_total : 10927 time to create 1 rle with old method : 0.013397932052612305 length of segment : 231 time for calcul the mask position with numpy : 0.0011131763458251953 nb_pixel_total : 33788 time to create 1 rle with old method : 0.04323315620422363 length of segment : 202 time for calcul the mask position with numpy : 0.0003695487976074219 nb_pixel_total : 17723 time to create 1 rle with old method : 0.02092885971069336 length of segment : 101 time for calcul the mask position with numpy : 0.0005176067352294922 nb_pixel_total : 17782 time to create 1 rle with old method : 0.020281314849853516 length of segment : 242 time for calcul the mask position with numpy : 0.0006818771362304688 nb_pixel_total : 31581 time to create 1 rle with old method : 0.035886526107788086 length of segment : 204 time for calcul the mask position with numpy : 0.0026421546936035156 nb_pixel_total : 115804 time to create 1 rle with old method : 0.12993669509887695 length of segment : 373 time for calcul the mask position with numpy : 0.000993967056274414 nb_pixel_total : 54921 time to create 1 rle with old method : 0.06321048736572266 length of segment : 307 time for calcul the mask position with numpy : 0.0035877227783203125 nb_pixel_total : 147066 time to create 1 rle with old method : 0.16463136672973633 length of segment : 676 time for calcul the mask position with numpy : 0.0005254745483398438 nb_pixel_total : 21128 time to create 1 rle with old method : 0.024657487869262695 length of segment : 219 time for calcul the mask position with numpy : 0.0017998218536376953 nb_pixel_total : 83770 time to create 1 rle with old method : 0.09630012512207031 length of segment : 505 time for calcul the mask position with numpy : 0.00021028518676757812 nb_pixel_total : 6806 time to create 1 rle with old method : 0.007957220077514648 length of segment : 141 time for calcul the mask position with numpy : 0.0006108283996582031 nb_pixel_total : 12934 time to create 1 rle with old method : 0.01514434814453125 length of segment : 170 time for calcul the mask position with numpy : 0.0010738372802734375 nb_pixel_total : 69472 time to create 1 rle with old method : 0.07954955101013184 length of segment : 227 time for calcul the mask position with numpy : 0.0005061626434326172 nb_pixel_total : 13647 time to create 1 rle with old method : 0.016934871673583984 length of segment : 273 time for calcul the mask position with numpy : 0.000244140625 nb_pixel_total : 10862 time to create 1 rle with old method : 0.01339864730834961 length of segment : 128 time for calcul the mask position with numpy : 0.000621795654296875 nb_pixel_total : 29954 time to create 1 rle with old method : 0.03461050987243652 length of segment : 321 time for calcul the mask position with numpy : 0.0006155967712402344 nb_pixel_total : 31053 time to create 1 rle with old method : 0.035308122634887695 length of segment : 235 time for calcul the mask position with numpy : 0.0002276897430419922 nb_pixel_total : 9900 time to create 1 rle with old method : 0.011736631393432617 length of segment : 149 time for calcul the mask position with numpy : 0.0012118816375732422 nb_pixel_total : 60685 time to create 1 rle with old method : 0.06920623779296875 length of segment : 437 time for calcul the mask position with numpy : 0.00019097328186035156 nb_pixel_total : 8180 time to create 1 rle with old method : 0.009601593017578125 length of segment : 115 time for calcul the mask position with numpy : 0.029161691665649414 nb_pixel_total : 677213 time to create 1 rle with new method : 0.05520129203796387 length of segment : 1182 time for calcul the mask position with numpy : 0.0004429817199707031 nb_pixel_total : 16621 time to create 1 rle with old method : 0.026709556579589844 length of segment : 193 time for calcul the mask position with numpy : 0.0008969306945800781 nb_pixel_total : 43024 time to create 1 rle with old method : 0.05861926078796387 length of segment : 298 time for calcul the mask position with numpy : 0.0001621246337890625 nb_pixel_total : 4662 time to create 1 rle with old method : 0.005524396896362305 length of segment : 127 time for calcul the mask position with numpy : 0.0006551742553710938 nb_pixel_total : 33110 time to create 1 rle with old method : 0.03811812400817871 length of segment : 228 time for calcul the mask position with numpy : 0.0013263225555419922 nb_pixel_total : 43349 time to create 1 rle with old method : 0.05040907859802246 length of segment : 269 time for calcul the mask position with numpy : 0.0007884502410888672 nb_pixel_total : 35991 time to create 1 rle with old method : 0.045964717864990234 length of segment : 189 time for calcul the mask position with numpy : 0.0002853870391845703 nb_pixel_total : 9688 time to create 1 rle with old method : 0.011437416076660156 length of segment : 158 time for calcul the mask position with numpy : 0.0012967586517333984 nb_pixel_total : 61649 time to create 1 rle with old method : 0.07192206382751465 length of segment : 245 time for calcul the mask position with numpy : 0.0007340908050537109 nb_pixel_total : 31352 time to create 1 rle with old method : 0.036595821380615234 length of segment : 233 time for calcul the mask position with numpy : 0.0017011165618896484 nb_pixel_total : 18643 time to create 1 rle with old method : 0.03017425537109375 length of segment : 277 time for calcul the mask position with numpy : 0.0003733634948730469 nb_pixel_total : 6231 time to create 1 rle with old method : 0.008367061614990234 length of segment : 109 time for calcul the mask position with numpy : 0.0002510547637939453 nb_pixel_total : 7534 time to create 1 rle with old method : 0.009360790252685547 length of segment : 92 time for calcul the mask position with numpy : 0.0006170272827148438 nb_pixel_total : 15495 time to create 1 rle with old method : 0.01784062385559082 length of segment : 161 time for calcul the mask position with numpy : 0.0005233287811279297 nb_pixel_total : 8722 time to create 1 rle with old method : 0.010202169418334961 length of segment : 163 time for calcul the mask position with numpy : 0.0026967525482177734 nb_pixel_total : 93209 time to create 1 rle with old method : 0.10984110832214355 length of segment : 283 time for calcul the mask position with numpy : 0.002457857131958008 nb_pixel_total : 84932 time to create 1 rle with old method : 0.1037130355834961 length of segment : 366 time for calcul the mask position with numpy : 0.0005385875701904297 nb_pixel_total : 16807 time to create 1 rle with old method : 0.019443273544311523 length of segment : 143 time for calcul the mask position with numpy : 0.0010066032409667969 nb_pixel_total : 34515 time to create 1 rle with old method : 0.03953433036804199 length of segment : 238 time for calcul the mask position with numpy : 0.0008766651153564453 nb_pixel_total : 30890 time to create 1 rle with old method : 0.03558516502380371 length of segment : 257 time for calcul the mask position with numpy : 0.0009212493896484375 nb_pixel_total : 40103 time to create 1 rle with old method : 0.045510053634643555 length of segment : 253 time for calcul the mask position with numpy : 0.0008628368377685547 nb_pixel_total : 32215 time to create 1 rle with old method : 0.0370488166809082 length of segment : 454 time for calcul the mask position with numpy : 0.0004012584686279297 nb_pixel_total : 15860 time to create 1 rle with old method : 0.018432140350341797 length of segment : 186 time for calcul the mask position with numpy : 0.0005090236663818359 nb_pixel_total : 10846 time to create 1 rle with old method : 0.012611627578735352 length of segment : 99 time for calcul the mask position with numpy : 0.00047707557678222656 nb_pixel_total : 16521 time to create 1 rle with old method : 0.01907634735107422 length of segment : 175 time for calcul the mask position with numpy : 0.00014901161193847656 nb_pixel_total : 4600 time to create 1 rle with old method : 0.005459785461425781 length of segment : 73 time for calcul the mask position with numpy : 0.0005197525024414062 nb_pixel_total : 18834 time to create 1 rle with old method : 0.022014617919921875 length of segment : 170 time for calcul the mask position with numpy : 0.00025177001953125 nb_pixel_total : 9205 time to create 1 rle with old method : 0.01089167594909668 length of segment : 125 time for calcul the mask position with numpy : 0.0011572837829589844 nb_pixel_total : 8063 time to create 1 rle with old method : 0.013523578643798828 length of segment : 348 time for calcul the mask position with numpy : 0.0010037422180175781 nb_pixel_total : 30246 time to create 1 rle with old method : 0.03929924964904785 length of segment : 345 time for calcul the mask position with numpy : 0.0012102127075195312 nb_pixel_total : 40247 time to create 1 rle with old method : 0.045537710189819336 length of segment : 278 time for calcul the mask position with numpy : 0.0004990100860595703 nb_pixel_total : 21389 time to create 1 rle with old method : 0.024593591690063477 length of segment : 218 time for calcul the mask position with numpy : 0.0004296302795410156 nb_pixel_total : 13693 time to create 1 rle with old method : 0.015932559967041016 length of segment : 146 time for calcul the mask position with numpy : 0.000514984130859375 nb_pixel_total : 14226 time to create 1 rle with old method : 0.016756057739257812 length of segment : 157 time for calcul the mask position with numpy : 0.0007977485656738281 nb_pixel_total : 32100 time to create 1 rle with old method : 0.036904335021972656 length of segment : 188 time for calcul the mask position with numpy : 0.0007104873657226562 nb_pixel_total : 13078 time to create 1 rle with old method : 0.015341997146606445 length of segment : 343 time for calcul the mask position with numpy : 0.0007886886596679688 nb_pixel_total : 15318 time to create 1 rle with old method : 0.017648935317993164 length of segment : 257 time for calcul the mask position with numpy : 0.0003211498260498047 nb_pixel_total : 17926 time to create 1 rle with old method : 0.02093029022216797 length of segment : 114 time for calcul the mask position with numpy : 0.0004832744598388672 nb_pixel_total : 27185 time to create 1 rle with old method : 0.03155183792114258 length of segment : 186 time for calcul the mask position with numpy : 0.001786947250366211 nb_pixel_total : 77182 time to create 1 rle with old method : 0.08690977096557617 length of segment : 422 time for calcul the mask position with numpy : 0.0005702972412109375 nb_pixel_total : 19643 time to create 1 rle with old method : 0.022581815719604492 length of segment : 206 time for calcul the mask position with numpy : 0.0004181861877441406 nb_pixel_total : 19428 time to create 1 rle with old method : 0.022344350814819336 length of segment : 150 time for calcul the mask position with numpy : 0.001028299331665039 nb_pixel_total : 19460 time to create 1 rle with old method : 0.022627830505371094 length of segment : 231 time for calcul the mask position with numpy : 0.0008759498596191406 nb_pixel_total : 31033 time to create 1 rle with old method : 0.03618431091308594 length of segment : 324 time for calcul the mask position with numpy : 0.0011551380157470703 nb_pixel_total : 21523 time to create 1 rle with old method : 0.024667024612426758 length of segment : 201 time for calcul the mask position with numpy : 0.0012803077697753906 nb_pixel_total : 35774 time to create 1 rle with old method : 0.04246711730957031 length of segment : 333 time for calcul the mask position with numpy : 0.0015397071838378906 nb_pixel_total : 22865 time to create 1 rle with old method : 0.03742671012878418 length of segment : 152 time for calcul the mask position with numpy : 0.008620262145996094 nb_pixel_total : 245792 time to create 1 rle with new method : 0.028725624084472656 length of segment : 795 time for calcul the mask position with numpy : 0.00027298927307128906 nb_pixel_total : 10974 time to create 1 rle with old method : 0.01269984245300293 length of segment : 149 time for calcul the mask position with numpy : 0.0006921291351318359 nb_pixel_total : 19611 time to create 1 rle with old method : 0.03158378601074219 length of segment : 174 time for calcul the mask position with numpy : 0.001992464065551758 nb_pixel_total : 32913 time to create 1 rle with old method : 0.04033327102661133 length of segment : 298 time for calcul the mask position with numpy : 0.005204916000366211 nb_pixel_total : 86977 time to create 1 rle with old method : 0.10016012191772461 length of segment : 472 time for calcul the mask position with numpy : 0.0022814273834228516 nb_pixel_total : 59692 time to create 1 rle with old method : 0.06989550590515137 length of segment : 262 time for calcul the mask position with numpy : 0.0007369518280029297 nb_pixel_total : 10064 time to create 1 rle with old method : 0.012149333953857422 length of segment : 224 time for calcul the mask position with numpy : 0.001218557357788086 nb_pixel_total : 36686 time to create 1 rle with old method : 0.044712066650390625 length of segment : 216 time for calcul the mask position with numpy : 0.003401517868041992 nb_pixel_total : 71579 time to create 1 rle with old method : 0.08720707893371582 length of segment : 444 time for calcul the mask position with numpy : 0.0011031627655029297 nb_pixel_total : 25368 time to create 1 rle with old method : 0.030733346939086914 length of segment : 165 time for calcul the mask position with numpy : 0.0016102790832519531 nb_pixel_total : 43602 time to create 1 rle with old method : 0.057390689849853516 length of segment : 329 time for calcul the mask position with numpy : 0.0006482601165771484 nb_pixel_total : 17688 time to create 1 rle with old method : 0.022910118103027344 length of segment : 118 time for calcul the mask position with numpy : 0.0010457038879394531 nb_pixel_total : 24565 time to create 1 rle with old method : 0.02986288070678711 length of segment : 221 time for calcul the mask position with numpy : 0.0024335384368896484 nb_pixel_total : 76161 time to create 1 rle with old method : 0.11094522476196289 length of segment : 458 time for calcul the mask position with numpy : 0.0027518272399902344 nb_pixel_total : 49805 time to create 1 rle with old method : 0.060875892639160156 length of segment : 310 time for calcul the mask position with numpy : 0.0013883113861083984 nb_pixel_total : 29833 time to create 1 rle with old method : 0.041290998458862305 length of segment : 196 time for calcul the mask position with numpy : 0.0015892982482910156 nb_pixel_total : 38722 time to create 1 rle with old method : 0.04735064506530762 length of segment : 234 time for calcul the mask position with numpy : 0.002315998077392578 nb_pixel_total : 60935 time to create 1 rle with old method : 0.07308602333068848 length of segment : 388 time for calcul the mask position with numpy : 0.0021865367889404297 nb_pixel_total : 65996 time to create 1 rle with old method : 0.08482646942138672 length of segment : 271 time for calcul the mask position with numpy : 0.0002899169921875 nb_pixel_total : 11213 time to create 1 rle with old method : 0.012961387634277344 length of segment : 162 time for calcul the mask position with numpy : 0.0008456707000732422 nb_pixel_total : 25951 time to create 1 rle with old method : 0.031017303466796875 length of segment : 299 time for calcul the mask position with numpy : 0.0016911029815673828 nb_pixel_total : 42446 time to create 1 rle with old method : 0.05086016654968262 length of segment : 300 time for calcul the mask position with numpy : 0.0009515285491943359 nb_pixel_total : 14289 time to create 1 rle with old method : 0.016587495803833008 length of segment : 141 time for calcul the mask position with numpy : 0.0005877017974853516 nb_pixel_total : 10986 time to create 1 rle with old method : 0.013160943984985352 length of segment : 129 time for calcul the mask position with numpy : 0.00045228004455566406 nb_pixel_total : 9453 time to create 1 rle with old method : 0.012619972229003906 length of segment : 132 time for calcul the mask position with numpy : 0.0007445812225341797 nb_pixel_total : 17363 time to create 1 rle with old method : 0.02133965492248535 length of segment : 145 time for calcul the mask position with numpy : 0.0010976791381835938 nb_pixel_total : 28742 time to create 1 rle with old method : 0.04567241668701172 length of segment : 252 time for calcul the mask position with numpy : 0.0012080669403076172 nb_pixel_total : 21166 time to create 1 rle with old method : 0.03402233123779297 length of segment : 159 time for calcul the mask position with numpy : 0.0007145404815673828 nb_pixel_total : 15962 time to create 1 rle with old method : 0.01844620704650879 length of segment : 161 time for calcul the mask position with numpy : 0.0014488697052001953 nb_pixel_total : 44678 time to create 1 rle with old method : 0.05472135543823242 length of segment : 252 time for calcul the mask position with numpy : 0.0006773471832275391 nb_pixel_total : 16217 time to create 1 rle with old method : 0.01997518539428711 length of segment : 140 time for calcul the mask position with numpy : 0.002000093460083008 nb_pixel_total : 38040 time to create 1 rle with old method : 0.04587841033935547 length of segment : 218 time for calcul the mask position with numpy : 0.0008563995361328125 nb_pixel_total : 27436 time to create 1 rle with old method : 0.032456398010253906 length of segment : 245 time for calcul the mask position with numpy : 0.0018534660339355469 nb_pixel_total : 25298 time to create 1 rle with old method : 0.029540538787841797 length of segment : 575 time for calcul the mask position with numpy : 0.0010259151458740234 nb_pixel_total : 22788 time to create 1 rle with old method : 0.02644801139831543 length of segment : 128 time for calcul the mask position with numpy : 0.0009415149688720703 nb_pixel_total : 26432 time to create 1 rle with old method : 0.0311434268951416 length of segment : 180 time for calcul the mask position with numpy : 0.001088857650756836 nb_pixel_total : 18181 time to create 1 rle with old method : 0.021592378616333008 length of segment : 176 time for calcul the mask position with numpy : 0.0013480186462402344 nb_pixel_total : 25173 time to create 1 rle with old method : 0.03200936317443848 length of segment : 228 time for calcul the mask position with numpy : 0.005454540252685547 nb_pixel_total : 135564 time to create 1 rle with old method : 0.15433168411254883 length of segment : 321 time for calcul the mask position with numpy : 0.001741170883178711 nb_pixel_total : 36800 time to create 1 rle with old method : 0.042540550231933594 length of segment : 282 time for calcul the mask position with numpy : 0.0004508495330810547 nb_pixel_total : 14829 time to create 1 rle with old method : 0.0173642635345459 length of segment : 110 time for calcul the mask position with numpy : 0.003026723861694336 nb_pixel_total : 69482 time to create 1 rle with old method : 0.08056139945983887 length of segment : 260 time for calcul the mask position with numpy : 0.0004673004150390625 nb_pixel_total : 17187 time to create 1 rle with old method : 0.0329432487487793 length of segment : 116 time for calcul the mask position with numpy : 0.0035881996154785156 nb_pixel_total : 50668 time to create 1 rle with old method : 0.07049155235290527 length of segment : 559 time for calcul the mask position with numpy : 0.0019190311431884766 nb_pixel_total : 134035 time to create 1 rle with old method : 0.15578556060791016 length of segment : 321 time for calcul the mask position with numpy : 0.005594491958618164 nb_pixel_total : 141238 time to create 1 rle with old method : 0.22750592231750488 length of segment : 536 time for calcul the mask position with numpy : 0.005970001220703125 nb_pixel_total : 155191 time to create 1 rle with new method : 0.011220932006835938 length of segment : 463 time for calcul the mask position with numpy : 0.0011680126190185547 nb_pixel_total : 26324 time to create 1 rle with old method : 0.030470609664916992 length of segment : 173 time for calcul the mask position with numpy : 0.0008413791656494141 nb_pixel_total : 16132 time to create 1 rle with old method : 0.019875049591064453 length of segment : 219 time for calcul the mask position with numpy : 0.0011377334594726562 nb_pixel_total : 21784 time to create 1 rle with old method : 0.025107622146606445 length of segment : 230 time for calcul the mask position with numpy : 0.004108905792236328 nb_pixel_total : 86370 time to create 1 rle with old method : 0.1065981388092041 length of segment : 373 time for calcul the mask position with numpy : 0.001775503158569336 nb_pixel_total : 24092 time to create 1 rle with old method : 0.03170347213745117 length of segment : 221 time for calcul the mask position with numpy : 0.0012195110321044922 nb_pixel_total : 32446 time to create 1 rle with old method : 0.03856372833251953 length of segment : 175 time for calcul the mask position with numpy : 0.002096414566040039 nb_pixel_total : 43877 time to create 1 rle with old method : 0.05991411209106445 length of segment : 197 time for calcul the mask position with numpy : 0.0011446475982666016 nb_pixel_total : 15994 time to create 1 rle with old method : 0.027370452880859375 length of segment : 200 time for calcul the mask position with numpy : 0.0003535747528076172 nb_pixel_total : 4625 time to create 1 rle with old method : 0.010900020599365234 length of segment : 85 time for calcul the mask position with numpy : 0.0004520416259765625 nb_pixel_total : 8518 time to create 1 rle with old method : 0.014766454696655273 length of segment : 85 time for calcul the mask position with numpy : 0.0011832714080810547 nb_pixel_total : 21493 time to create 1 rle with old method : 0.02564072608947754 length of segment : 228 time for calcul the mask position with numpy : 0.0005135536193847656 nb_pixel_total : 7881 time to create 1 rle with old method : 0.00964975357055664 length of segment : 102 time for calcul the mask position with numpy : 0.000980377197265625 nb_pixel_total : 20327 time to create 1 rle with old method : 0.024042367935180664 length of segment : 162 time for calcul the mask position with numpy : 0.0004019737243652344 nb_pixel_total : 6652 time to create 1 rle with old method : 0.008086919784545898 length of segment : 111 time for calcul the mask position with numpy : 0.0006947517395019531 nb_pixel_total : 8776 time to create 1 rle with old method : 0.01097869873046875 length of segment : 269 time for calcul the mask position with numpy : 0.0013058185577392578 nb_pixel_total : 26915 time to create 1 rle with old method : 0.03390622138977051 length of segment : 186 time for calcul the mask position with numpy : 0.0010075569152832031 nb_pixel_total : 16417 time to create 1 rle with old method : 0.02036595344543457 length of segment : 202 time for calcul the mask position with numpy : 0.0009438991546630859 nb_pixel_total : 18905 time to create 1 rle with old method : 0.02419900894165039 length of segment : 172 time for calcul the mask position with numpy : 0.0004487037658691406 nb_pixel_total : 7137 time to create 1 rle with old method : 0.008354902267456055 length of segment : 87 time for calcul the mask position with numpy : 0.0004506111145019531 nb_pixel_total : 5990 time to create 1 rle with old method : 0.010034799575805664 length of segment : 87 time for calcul the mask position with numpy : 0.0028867721557617188 nb_pixel_total : 42323 time to create 1 rle with old method : 0.06824016571044922 length of segment : 307 time for calcul the mask position with numpy : 0.0007150173187255859 nb_pixel_total : 10580 time to create 1 rle with old method : 0.01749873161315918 length of segment : 163 time spent for convertir_results : 13.727600812911987 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 164 chid ids of type : 3594 Number RLEs to save : 41058 save missing photos in datou_result : time spend for datou_step_exec : 99.14721608161926 time spend to save output : 2.4421584606170654 total time spend for step 1 : 101.58937454223633 step2:crop_condition Mon Apr 28 11:52:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 164 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 128 About to insert : list_path_to_insert length 128 new photo from crops ! About to upload 128 photos upload in portfolio : 3736932 init cache_photo without model_param we have 128 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745833961_1623641 we have uploaded 128 photos in the portfolio 3736932 time of upload the photos Elapsed time : 28.56088161468506 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 3736932 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745833994_1623641 we have uploaded 16 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.5098423957824707 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745834000_1623641 we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.107459545135498 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745834006_1623641 we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.197798252105713 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745834011_1623641 we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.4159355163574219 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1745834015_1623641 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8284270763397217 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1353839403, 1353839264, 1353839231, 1353839196, 1353839164, 1353839130, 1353839095, 1353839015] Looping around the photos to save general results len do output : 164 /1353875904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353875999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1353876136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839403', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839264', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839231', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839196', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839164', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839130', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839095', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839015', None, None, None, None, None, '2763921') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 500 time used for this insertion : 0.048809051513671875 save_final save missing photos in datou_result : time spend for datou_step_exec : 83.42585921287537 time spend to save output : 0.05467104911804199 total time spend for step 2 : 83.48053026199341 step3:rle_unique_nms_with_priority Mon Apr 28 11:53:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 164 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 13 nb_hashtags : 2 time to prepare the origin masks : 6.852749347686768 time for calcul the mask position with numpy : 0.9527273178100586 nb_pixel_total : 7233487 time to create 1 rle with new method : 0.9790544509887695 time for calcul the mask position with numpy : 0.029120206832885742 nb_pixel_total : 6199 time to create 1 rle with old method : 0.0070154666900634766 time for calcul the mask position with numpy : 0.028847455978393555 nb_pixel_total : 88056 time to create 1 rle with old method : 0.09848618507385254 time for calcul the mask position with numpy : 0.026894330978393555 nb_pixel_total : 9269 time to create 1 rle with old method : 0.01047372817993164 time for calcul the mask position with numpy : 0.030231237411499023 nb_pixel_total : 24459 time to create 1 rle with old method : 0.02744317054748535 time for calcul the mask position with numpy : 0.031675100326538086 nb_pixel_total : 61919 time to create 1 rle with old method : 0.07253360748291016 time for calcul the mask position with numpy : 0.03279709815979004 nb_pixel_total : 452632 time to create 1 rle with new method : 1.124180555343628 time for calcul the mask position with numpy : 0.027687788009643555 nb_pixel_total : 19671 time to create 1 rle with old method : 0.022677898406982422 time for calcul the mask position with numpy : 0.03120136260986328 nb_pixel_total : 70513 time to create 1 rle with old method : 0.0972144603729248 time for calcul the mask position with numpy : 0.02971959114074707 nb_pixel_total : 217864 time to create 1 rle with new method : 0.9734342098236084 time for calcul the mask position with numpy : 0.027898311614990234 nb_pixel_total : 30505 time to create 1 rle with old method : 0.03426170349121094 time for calcul the mask position with numpy : 0.029509544372558594 nb_pixel_total : 11240 time to create 1 rle with old method : 0.02698206901550293 time for calcul the mask position with numpy : 0.037737369537353516 nb_pixel_total : 26309 time to create 1 rle with old method : 0.0388798713684082 time for calcul the mask position with numpy : 0.03189659118652344 nb_pixel_total : 42277 time to create 1 rle with old method : 0.04714250564575195 create new chi : 5.0113091468811035 time to delete rle : 0.020824193954467773 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 10199 TO DO : save crop sub photo not yet done ! save time : 0.6564857959747314 nb_obj : 16 nb_hashtags : 4 time to prepare the origin masks : 8.7275710105896 time for calcul the mask position with numpy : 0.5794107913970947 nb_pixel_total : 7777598 time to create 1 rle with new method : 1.335420846939087 time for calcul the mask position with numpy : 0.042669057846069336 nb_pixel_total : 10927 time to create 1 rle with old method : 0.014243841171264648 time for calcul the mask position with numpy : 0.037651777267456055 nb_pixel_total : 36966 time to create 1 rle with old method : 0.04122519493103027 time for calcul the mask position with numpy : 0.027890682220458984 nb_pixel_total : 28390 time to create 1 rle with old method : 0.0313420295715332 time for calcul the mask position with numpy : 0.025844335556030273 nb_pixel_total : 34580 time to create 1 rle with old method : 0.03843498229980469 time for calcul the mask position with numpy : 0.026157855987548828 nb_pixel_total : 56266 time to create 1 rle with old method : 0.06256890296936035 time for calcul the mask position with numpy : 0.02664351463317871 nb_pixel_total : 18213 time to create 1 rle with old method : 0.020315170288085938 time for calcul the mask position with numpy : 0.027228593826293945 nb_pixel_total : 132895 time to create 1 rle with old method : 0.1481633186340332 time for calcul the mask position with numpy : 0.028102636337280273 nb_pixel_total : 10677 time to create 1 rle with old method : 0.012120246887207031 time for calcul the mask position with numpy : 0.02579212188720703 nb_pixel_total : 61947 time to create 1 rle with old method : 0.07093572616577148 time for calcul the mask position with numpy : 0.025541305541992188 nb_pixel_total : 11092 time to create 1 rle with old method : 0.012471199035644531 time for calcul the mask position with numpy : 0.02581930160522461 nb_pixel_total : 40758 time to create 1 rle with old method : 0.04452371597290039 time for calcul the mask position with numpy : 0.02654290199279785 nb_pixel_total : 9360 time to create 1 rle with old method : 0.010413408279418945 time for calcul the mask position with numpy : 0.028728723526000977 nb_pixel_total : 13738 time to create 1 rle with old method : 0.015244722366333008 time for calcul the mask position with numpy : 0.027057170867919922 nb_pixel_total : 10964 time to create 1 rle with old method : 0.012006759643554688 time for calcul the mask position with numpy : 0.025713443756103516 nb_pixel_total : 16689 time to create 1 rle with old method : 0.01835799217224121 time for calcul the mask position with numpy : 0.026707172393798828 nb_pixel_total : 23340 time to create 1 rle with old method : 0.02536320686340332 create new chi : 2.9954771995544434 time to delete rle : 0.0013275146484375 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 9635 TO DO : save crop sub photo not yet done ! save time : 0.5894527435302734 nb_obj : 23 nb_hashtags : 3 time to prepare the origin masks : 12.540972232818604 time for calcul the mask position with numpy : 0.847996711730957 nb_pixel_total : 7033613 time to create 1 rle with new method : 0.9672255516052246 time for calcul the mask position with numpy : 0.042565107345581055 nb_pixel_total : 4662 time to create 1 rle with old method : 0.005633354187011719 time for calcul the mask position with numpy : 0.046125173568725586 nb_pixel_total : 43024 time to create 1 rle with old method : 0.055998802185058594 time for calcul the mask position with numpy : 0.04244661331176758 nb_pixel_total : 16621 time to create 1 rle with old method : 0.018700599670410156 time for calcul the mask position with numpy : 0.048148393630981445 nb_pixel_total : 422294 time to create 1 rle with new method : 1.1557185649871826 time for calcul the mask position with numpy : 0.044112443923950195 nb_pixel_total : 8180 time to create 1 rle with old method : 0.009332656860351562 time for calcul the mask position with numpy : 0.04196500778198242 nb_pixel_total : 59835 time to create 1 rle with old method : 0.06660795211791992 time for calcul the mask position with numpy : 0.0432286262512207 nb_pixel_total : 9900 time to create 1 rle with old method : 0.011805534362792969 time for calcul the mask position with numpy : 0.045717716217041016 nb_pixel_total : 31053 time to create 1 rle with old method : 0.035687923431396484 time for calcul the mask position with numpy : 0.043243408203125 nb_pixel_total : 29954 time to create 1 rle with old method : 0.03344249725341797 time for calcul the mask position with numpy : 0.04074501991271973 nb_pixel_total : 10862 time to create 1 rle with old method : 0.0176694393157959 time for calcul the mask position with numpy : 0.04175853729248047 nb_pixel_total : 13647 time to create 1 rle with old method : 0.015332937240600586 time for calcul the mask position with numpy : 0.025893688201904297 nb_pixel_total : 69472 time to create 1 rle with old method : 0.08168435096740723 time for calcul the mask position with numpy : 0.027479171752929688 nb_pixel_total : 12934 time to create 1 rle with old method : 0.014606237411499023 time for calcul the mask position with numpy : 0.04461979866027832 nb_pixel_total : 6806 time to create 1 rle with old method : 0.009297370910644531 time for calcul the mask position with numpy : 0.05111837387084961 nb_pixel_total : 81750 time to create 1 rle with old method : 0.11285853385925293 time for calcul the mask position with numpy : 0.04806375503540039 nb_pixel_total : 21128 time to create 1 rle with old method : 0.03744816780090332 time for calcul the mask position with numpy : 0.05136442184448242 nb_pixel_total : 147066 time to create 1 rle with old method : 0.16735363006591797 time for calcul the mask position with numpy : 0.042394161224365234 nb_pixel_total : 54921 time to create 1 rle with old method : 0.06020832061767578 time for calcul the mask position with numpy : 0.04278063774108887 nb_pixel_total : 115804 time to create 1 rle with old method : 0.12667202949523926 time for calcul the mask position with numpy : 0.04247546195983887 nb_pixel_total : 31581 time to create 1 rle with old method : 0.03545188903808594 time for calcul the mask position with numpy : 0.0441744327545166 nb_pixel_total : 17782 time to create 1 rle with old method : 0.019464969635009766 time for calcul the mask position with numpy : 0.0355374813079834 nb_pixel_total : 17723 time to create 1 rle with old method : 0.01940441131591797 time for calcul the mask position with numpy : 0.027943849563598633 nb_pixel_total : 33788 time to create 1 rle with old method : 0.03746604919433594 create new chi : 5.0123982429504395 time to delete rle : 0.004266500473022461 batch 1 Loaded 47 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 14644 TO DO : save crop sub photo not yet done ! save time : 0.8848013877868652 nb_obj : 32 nb_hashtags : 5 time to prepare the origin masks : 4.521234035491943 time for calcul the mask position with numpy : 0.6607165336608887 nb_pixel_total : 7441057 time to create 1 rle with new method : 2.437044382095337 time for calcul the mask position with numpy : 0.039466142654418945 nb_pixel_total : 15495 time to create 1 rle with old method : 0.017338275909423828 time for calcul the mask position with numpy : 0.034303903579711914 nb_pixel_total : 30890 time to create 1 rle with old method : 0.0348355770111084 time for calcul the mask position with numpy : 0.034525156021118164 nb_pixel_total : 9688 time to create 1 rle with old method : 0.010862588882446289 time for calcul the mask position with numpy : 0.03751730918884277 nb_pixel_total : 40247 time to create 1 rle with old method : 0.04772830009460449 time for calcul the mask position with numpy : 0.03911733627319336 nb_pixel_total : 9205 time to create 1 rle with old method : 0.011066913604736328 time for calcul the mask position with numpy : 0.03662371635437012 nb_pixel_total : 8722 time to create 1 rle with old method : 0.010423421859741211 time for calcul the mask position with numpy : 0.035989999771118164 nb_pixel_total : 35991 time to create 1 rle with old method : 0.04139256477355957 time for calcul the mask position with numpy : 0.03937983512878418 nb_pixel_total : 6231 time to create 1 rle with old method : 0.010591983795166016 time for calcul the mask position with numpy : 0.03944730758666992 nb_pixel_total : 84932 time to create 1 rle with old method : 0.13428473472595215 time for calcul the mask position with numpy : 0.04612898826599121 nb_pixel_total : 13078 time to create 1 rle with old method : 0.026864290237426758 time for calcul the mask position with numpy : 0.04460000991821289 nb_pixel_total : 40103 time to create 1 rle with old method : 0.07294678688049316 time for calcul the mask position with numpy : 0.04374432563781738 nb_pixel_total : 15860 time to create 1 rle with old method : 0.02872323989868164 time for calcul the mask position with numpy : 0.037305355072021484 nb_pixel_total : 14226 time to create 1 rle with old method : 0.016101837158203125 time for calcul the mask position with numpy : 0.034392595291137695 nb_pixel_total : 32215 time to create 1 rle with old method : 0.03720355033874512 time for calcul the mask position with numpy : 0.03509235382080078 nb_pixel_total : 34515 time to create 1 rle with old method : 0.04438614845275879 time for calcul the mask position with numpy : 0.038908958435058594 nb_pixel_total : 8063 time to create 1 rle with old method : 0.013440370559692383 time for calcul the mask position with numpy : 0.03626298904418945 nb_pixel_total : 43349 time to create 1 rle with old method : 0.04834294319152832 time for calcul the mask position with numpy : 0.03437662124633789 nb_pixel_total : 61649 time to create 1 rle with old method : 0.06846213340759277 time for calcul the mask position with numpy : 0.03499650955200195 nb_pixel_total : 16521 time to create 1 rle with old method : 0.019274473190307617 time for calcul the mask position with numpy : 0.03652143478393555 nb_pixel_total : 13693 time to create 1 rle with old method : 0.01627492904663086 time for calcul the mask position with numpy : 0.0363461971282959 nb_pixel_total : 32100 time to create 1 rle with old method : 0.0376439094543457 time for calcul the mask position with numpy : 0.04007554054260254 nb_pixel_total : 18834 time to create 1 rle with old method : 0.029862403869628906 time for calcul the mask position with numpy : 0.0424954891204834 nb_pixel_total : 18643 time to create 1 rle with old method : 0.029412031173706055 time for calcul the mask position with numpy : 0.0447230339050293 nb_pixel_total : 16807 time to create 1 rle with old method : 0.027235031127929688 time for calcul the mask position with numpy : 0.046106576919555664 nb_pixel_total : 21389 time to create 1 rle with old method : 0.024372577667236328 time for calcul the mask position with numpy : 0.03563356399536133 nb_pixel_total : 33110 time to create 1 rle with old method : 0.03748130798339844 time for calcul the mask position with numpy : 0.03561067581176758 nb_pixel_total : 93209 time to create 1 rle with old method : 0.1302957534790039 time for calcul the mask position with numpy : 0.04765152931213379 nb_pixel_total : 31352 time to create 1 rle with old method : 0.03609490394592285 time for calcul the mask position with numpy : 0.03802776336669922 nb_pixel_total : 30246 time to create 1 rle with old method : 0.040787696838378906 time for calcul the mask position with numpy : 0.044675588607788086 nb_pixel_total : 10846 time to create 1 rle with old method : 0.01711130142211914 time for calcul the mask position with numpy : 0.044422149658203125 nb_pixel_total : 7534 time to create 1 rle with old method : 0.011737346649169922 time for calcul the mask position with numpy : 0.04063820838928223 nb_pixel_total : 4600 time to create 1 rle with old method : 0.005606651306152344 create new chi : 5.551471471786499 time to delete rle : 0.0032591819763183594 batch 1 Loaded 65 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 16098 TO DO : save crop sub photo not yet done ! save time : 0.9753777980804443 nb_obj : 18 nb_hashtags : 2 time to prepare the origin masks : 7.775193929672241 time for calcul the mask position with numpy : 0.8291797637939453 nb_pixel_total : 7615745 time to create 1 rle with new method : 1.2424366474151611 time for calcul the mask position with numpy : 0.042679786682128906 nb_pixel_total : 10064 time to create 1 rle with old method : 0.011320352554321289 time for calcul the mask position with numpy : 0.04187369346618652 nb_pixel_total : 59692 time to create 1 rle with old method : 0.06749534606933594 time for calcul the mask position with numpy : 0.041469573974609375 nb_pixel_total : 10922 time to create 1 rle with old method : 0.012498855590820312 time for calcul the mask position with numpy : 0.04038882255554199 nb_pixel_total : 32913 time to create 1 rle with old method : 0.05151820182800293 time for calcul the mask position with numpy : 0.0400547981262207 nb_pixel_total : 19507 time to create 1 rle with old method : 0.021724700927734375 time for calcul the mask position with numpy : 0.02611684799194336 nb_pixel_total : 10974 time to create 1 rle with old method : 0.012375831604003906 time for calcul the mask position with numpy : 0.029317617416381836 nb_pixel_total : 245713 time to create 1 rle with new method : 1.481311321258545 time for calcul the mask position with numpy : 0.02857518196105957 nb_pixel_total : 22865 time to create 1 rle with old method : 0.025934457778930664 time for calcul the mask position with numpy : 0.033075809478759766 nb_pixel_total : 17307 time to create 1 rle with old method : 0.019453048706054688 time for calcul the mask position with numpy : 0.028083324432373047 nb_pixel_total : 21523 time to create 1 rle with old method : 0.0354611873626709 time for calcul the mask position with numpy : 0.02658367156982422 nb_pixel_total : 31033 time to create 1 rle with old method : 0.03684401512145996 time for calcul the mask position with numpy : 0.030858755111694336 nb_pixel_total : 19460 time to create 1 rle with old method : 0.03219437599182129 time for calcul the mask position with numpy : 0.029452800750732422 nb_pixel_total : 19428 time to create 1 rle with old method : 0.026802778244018555 time for calcul the mask position with numpy : 0.02835845947265625 nb_pixel_total : 19643 time to create 1 rle with old method : 0.022332429885864258 time for calcul the mask position with numpy : 0.029315710067749023 nb_pixel_total : 77182 time to create 1 rle with old method : 0.0854644775390625 time for calcul the mask position with numpy : 0.02647876739501953 nb_pixel_total : 27185 time to create 1 rle with old method : 0.03242063522338867 time for calcul the mask position with numpy : 0.03152966499328613 nb_pixel_total : 17926 time to create 1 rle with old method : 0.02027416229248047 time for calcul the mask position with numpy : 0.02979588508605957 nb_pixel_total : 15318 time to create 1 rle with old method : 0.017066478729248047 create new chi : 4.740419387817383 time to delete rle : 0.0018768310546875 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++++++++++Number RLEs to save : 11401 TO DO : save crop sub photo not yet done ! save time : 0.6223716735839844 nb_obj : 17 nb_hashtags : 4 time to prepare the origin masks : 9.382710456848145 time for calcul the mask position with numpy : 1.1914763450622559 nb_pixel_total : 7657794 time to create 1 rle with new method : 0.6924238204956055 time for calcul the mask position with numpy : 0.04752039909362793 nb_pixel_total : 10986 time to create 1 rle with old method : 0.013883829116821289 time for calcul the mask position with numpy : 0.04541325569152832 nb_pixel_total : 14289 time to create 1 rle with old method : 0.023372411727905273 time for calcul the mask position with numpy : 0.040787696838378906 nb_pixel_total : 42446 time to create 1 rle with old method : 0.05319833755493164 time for calcul the mask position with numpy : 0.04986739158630371 nb_pixel_total : 16732 time to create 1 rle with old method : 0.02608966827392578 time for calcul the mask position with numpy : 0.04224371910095215 nb_pixel_total : 11213 time to create 1 rle with old method : 0.012481212615966797 time for calcul the mask position with numpy : 0.04274749755859375 nb_pixel_total : 65996 time to create 1 rle with old method : 0.07374382019042969 time for calcul the mask position with numpy : 0.04106330871582031 nb_pixel_total : 60935 time to create 1 rle with old method : 0.06782054901123047 time for calcul the mask position with numpy : 0.041290998458862305 nb_pixel_total : 38722 time to create 1 rle with old method : 0.04290437698364258 time for calcul the mask position with numpy : 0.041033267974853516 nb_pixel_total : 29833 time to create 1 rle with old method : 0.032901763916015625 time for calcul the mask position with numpy : 0.04335832595825195 nb_pixel_total : 49805 time to create 1 rle with old method : 0.05460381507873535 time for calcul the mask position with numpy : 0.04053759574890137 nb_pixel_total : 76161 time to create 1 rle with old method : 0.08369684219360352 time for calcul the mask position with numpy : 0.040747880935668945 nb_pixel_total : 24565 time to create 1 rle with old method : 0.0269315242767334 time for calcul the mask position with numpy : 0.04120779037475586 nb_pixel_total : 17688 time to create 1 rle with old method : 0.019635915756225586 time for calcul the mask position with numpy : 0.04466986656188965 nb_pixel_total : 43602 time to create 1 rle with old method : 0.05341672897338867 time for calcul the mask position with numpy : 0.04107093811035156 nb_pixel_total : 25368 time to create 1 rle with old method : 0.0283660888671875 time for calcul the mask position with numpy : 0.04577898979187012 nb_pixel_total : 71579 time to create 1 rle with old method : 0.0831303596496582 time for calcul the mask position with numpy : 0.042540788650512695 nb_pixel_total : 36686 time to create 1 rle with old method : 0.04088306427001953 create new chi : 3.407013177871704 time to delete rle : 0.001684427261352539 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 10787 TO DO : save crop sub photo not yet done ! save time : 0.6573817729949951 nb_obj : 22 nb_hashtags : 4 time to prepare the origin masks : 12.063749074935913 time for calcul the mask position with numpy : 0.865048885345459 nb_pixel_total : 7507183 time to create 1 rle with new method : 0.9552137851715088 time for calcul the mask position with numpy : 0.04187798500061035 nb_pixel_total : 141238 time to create 1 rle with old method : 0.15045833587646484 time for calcul the mask position with numpy : 0.03918099403381348 nb_pixel_total : 912 time to create 1 rle with old method : 0.0014138221740722656 time for calcul the mask position with numpy : 0.0391843318939209 nb_pixel_total : 50668 time to create 1 rle with old method : 0.054537057876586914 time for calcul the mask position with numpy : 0.03950309753417969 nb_pixel_total : 795 time to create 1 rle with old method : 0.0010235309600830078 time for calcul the mask position with numpy : 0.039290428161621094 nb_pixel_total : 69482 time to create 1 rle with old method : 0.07480335235595703 time for calcul the mask position with numpy : 0.040212154388427734 nb_pixel_total : 14829 time to create 1 rle with old method : 0.01613140106201172 time for calcul the mask position with numpy : 0.04035663604736328 nb_pixel_total : 36800 time to create 1 rle with old method : 0.05218505859375 time for calcul the mask position with numpy : 0.051156044006347656 nb_pixel_total : 135564 time to create 1 rle with old method : 0.149611234664917 time for calcul the mask position with numpy : 0.03937196731567383 nb_pixel_total : 25173 time to create 1 rle with old method : 0.026446104049682617 time for calcul the mask position with numpy : 0.04337620735168457 nb_pixel_total : 18181 time to create 1 rle with old method : 0.019883155822753906 time for calcul the mask position with numpy : 0.04077553749084473 nb_pixel_total : 26432 time to create 1 rle with old method : 0.02971649169921875 time for calcul the mask position with numpy : 0.039548635482788086 nb_pixel_total : 22788 time to create 1 rle with old method : 0.024431943893432617 time for calcul the mask position with numpy : 0.04187655448913574 nb_pixel_total : 25298 time to create 1 rle with old method : 0.02747178077697754 time for calcul the mask position with numpy : 0.038417816162109375 nb_pixel_total : 27436 time to create 1 rle with old method : 0.02887272834777832 time for calcul the mask position with numpy : 0.03990435600280762 nb_pixel_total : 38040 time to create 1 rle with old method : 0.04073953628540039 time for calcul the mask position with numpy : 0.030550241470336914 nb_pixel_total : 16217 time to create 1 rle with old method : 0.017641305923461914 time for calcul the mask position with numpy : 0.03808450698852539 nb_pixel_total : 44678 time to create 1 rle with old method : 0.046369314193725586 time for calcul the mask position with numpy : 0.038936614990234375 nb_pixel_total : 15962 time to create 1 rle with old method : 0.01665949821472168 time for calcul the mask position with numpy : 0.039363861083984375 nb_pixel_total : 21166 time to create 1 rle with old method : 0.02246880531311035 time for calcul the mask position with numpy : 0.03856849670410156 nb_pixel_total : 28742 time to create 1 rle with old method : 0.031037330627441406 time for calcul the mask position with numpy : 0.034214019775390625 nb_pixel_total : 17363 time to create 1 rle with old method : 0.018738746643066406 time for calcul the mask position with numpy : 0.03282308578491211 nb_pixel_total : 9453 time to create 1 rle with old method : 0.010123252868652344 create new chi : 3.5964407920837402 time to delete rle : 0.0019347667694091797 batch 1 Loaded 45 chid ids of type : 3594 +++++++++++++++++++++++++++++Number RLEs to save : 12525 TO DO : save crop sub photo not yet done ! save time : 0.7772216796875 nb_obj : 23 nb_hashtags : 2 time to prepare the origin masks : 9.43501353263855 time for calcul the mask position with numpy : 0.6849892139434814 nb_pixel_total : 7665651 time to create 1 rle with new method : 1.6580960750579834 time for calcul the mask position with numpy : 0.03300309181213379 nb_pixel_total : 10580 time to create 1 rle with old method : 0.01208353042602539 time for calcul the mask position with numpy : 0.029102563858032227 nb_pixel_total : 42323 time to create 1 rle with old method : 0.04778861999511719 time for calcul the mask position with numpy : 0.0248262882232666 nb_pixel_total : 5990 time to create 1 rle with old method : 0.006768226623535156 time for calcul the mask position with numpy : 0.03380274772644043 nb_pixel_total : 7137 time to create 1 rle with old method : 0.008045196533203125 time for calcul the mask position with numpy : 0.04533243179321289 nb_pixel_total : 18905 time to create 1 rle with old method : 0.02115941047668457 time for calcul the mask position with numpy : 0.0417475700378418 nb_pixel_total : 16417 time to create 1 rle with old method : 0.018530845642089844 time for calcul the mask position with numpy : 0.04640460014343262 nb_pixel_total : 26915 time to create 1 rle with old method : 0.02890920639038086 time for calcul the mask position with numpy : 0.04183530807495117 nb_pixel_total : 8776 time to create 1 rle with old method : 0.014369487762451172 time for calcul the mask position with numpy : 0.04679989814758301 nb_pixel_total : 6652 time to create 1 rle with old method : 0.009907960891723633 time for calcul the mask position with numpy : 0.043839216232299805 nb_pixel_total : 20327 time to create 1 rle with old method : 0.0229949951171875 time for calcul the mask position with numpy : 0.04152035713195801 nb_pixel_total : 7881 time to create 1 rle with old method : 0.00896143913269043 time for calcul the mask position with numpy : 0.04088950157165527 nb_pixel_total : 21493 time to create 1 rle with old method : 0.025658845901489258 time for calcul the mask position with numpy : 0.04958629608154297 nb_pixel_total : 8518 time to create 1 rle with old method : 0.009625911712646484 time for calcul the mask position with numpy : 0.04993605613708496 nb_pixel_total : 4625 time to create 1 rle with old method : 0.0055294036865234375 time for calcul the mask position with numpy : 0.044072866439819336 nb_pixel_total : 15994 time to create 1 rle with old method : 0.017958402633666992 time for calcul the mask position with numpy : 0.02978372573852539 nb_pixel_total : 43877 time to create 1 rle with old method : 0.048810720443725586 time for calcul the mask position with numpy : 0.028227567672729492 nb_pixel_total : 32446 time to create 1 rle with old method : 0.03818678855895996 time for calcul the mask position with numpy : 0.03166460990905762 nb_pixel_total : 24092 time to create 1 rle with old method : 0.03449606895446777 time for calcul the mask position with numpy : 0.05867195129394531 nb_pixel_total : 86370 time to create 1 rle with old method : 0.11096835136413574 time for calcul the mask position with numpy : 0.04327964782714844 nb_pixel_total : 21784 time to create 1 rle with old method : 0.023940563201904297 time for calcul the mask position with numpy : 0.04821205139160156 nb_pixel_total : 16132 time to create 1 rle with old method : 0.017842769622802734 time for calcul the mask position with numpy : 0.04240703582763672 nb_pixel_total : 26324 time to create 1 rle with old method : 0.029461383819580078 time for calcul the mask position with numpy : 0.04670977592468262 nb_pixel_total : 155191 time to create 1 rle with new method : 0.8202886581420898 create new chi : 4.746823310852051 time to delete rle : 0.003070354461669922 batch 1 Loaded 47 chid ids of type : 3594 ++++++++++++++++++++++++++Number RLEs to save : 11154 TO DO : save crop sub photo not yet done ! save time : 0.6691493988037109 map_output_result : {1353839403: (0.0, 'Should be the crop_list due to order', 0), 1353839264: (0.0, 'Should be the crop_list due to order', 0), 1353839231: (0.0, 'Should be the crop_list due to order', 0), 1353839196: (0.0, 'Should be the crop_list due to order', 0), 1353839164: (0.0, 'Should be the crop_list due to order', 0), 1353839130: (0.0, 'Should be the crop_list due to order', 0), 1353839095: (0.0, 'Should be the crop_list due to order', 0), 1353839015: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1353839403, 1353839264, 1353839231, 1353839196, 1353839164, 1353839130, 1353839095, 1353839015] Looping around the photos to save general results len do output : 8 /1353839403.Didn't retrieve data . /1353839264.Didn't retrieve data . /1353839231.Didn't retrieve data . /1353839196.Didn't retrieve data . /1353839164.Didn't retrieve data . /1353839130.Didn't retrieve data . /1353839095.Didn't retrieve data . /1353839015.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839403', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839264', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839231', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839196', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839164', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839130', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839095', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839015', None, None, None, None, None, '2763921') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.014062881469726562 save_final save missing photos in datou_result : time spend for datou_step_exec : 113.8525128364563 time spend to save output : 0.014837503433227539 total time spend for step 3 : 113.86735033988953 step4:ventilate_hashtags_in_portfolio Mon Apr 28 11:55:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22448524 get user id for portfolio 22448524 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22448524 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pet_clair','autre','papier','carton','pehd','pet_fonce','metal','background','mal_croppe','environnement')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22448524 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pet_clair','autre','papier','carton','pehd','pet_fonce','metal','background','mal_croppe','environnement')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22448524 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pet_clair','autre','papier','carton','pehd','pet_fonce','metal','background','mal_croppe','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22448922,22448923,22448924,22448925,22448926,22448927,22448928,22448929,22448930,22448931,22448932?tags=flou,pet_clair,autre,papier,carton,pehd,pet_fonce,metal,background,mal_croppe,environnement Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1353839403, 1353839264, 1353839231, 1353839196, 1353839164, 1353839130, 1353839095, 1353839015] Looping around the photos to save general results len do output : 1 /22448524. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839403', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839264', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839231', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839196', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839164', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839130', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839095', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839015', None, None, None, None, None, '2763921') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.01525425910949707 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5782592296600342 time spend to save output : 0.01555013656616211 total time spend for step 4 : 1.5938093662261963 step5:final Mon Apr 28 11:55:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1353839403: ('0.09679832175925925',), 1353839264: ('0.09679832175925925',), 1353839231: ('0.09679832175925925',), 1353839196: ('0.09679832175925925',), 1353839164: ('0.09679832175925925',), 1353839130: ('0.09679832175925925',), 1353839095: ('0.09679832175925925',), 1353839015: ('0.09679832175925925',)} new output for save of step final : {1353839403: ('0.09679832175925925',), 1353839264: ('0.09679832175925925',), 1353839231: ('0.09679832175925925',), 1353839196: ('0.09679832175925925',), 1353839164: ('0.09679832175925925',), 1353839130: ('0.09679832175925925',), 1353839095: ('0.09679832175925925',), 1353839015: ('0.09679832175925925',)} [1353839403, 1353839264, 1353839231, 1353839196, 1353839164, 1353839130, 1353839095, 1353839015] Looping around the photos to save general results len do output : 8 /1353839403.Didn't retrieve data . /1353839264.Didn't retrieve data . /1353839231.Didn't retrieve data . /1353839196.Didn't retrieve data . /1353839164.Didn't retrieve data . /1353839130.Didn't retrieve data . /1353839095.Didn't retrieve data . /1353839015.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839403', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839264', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839231', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839196', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839164', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839130', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839095', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839015', None, None, None, None, None, '2763921') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.012986898422241211 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13773846626281738 time spend to save output : 0.013497114181518555 total time spend for step 5 : 0.15123558044433594 step6:blur_detection Mon Apr 28 11:55:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78.jpg resize: (2160, 3840) 1353839403 -5.412051757285842 treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608.jpg resize: (2160, 3840) 1353839264 -6.070404823679 treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a.jpg resize: (2160, 3840) 1353839231 -6.187339967026295 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673.jpg resize: (2160, 3840) 1353839196 -6.153307614270344 treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544.jpg resize: (2160, 3840) 1353839164 -5.980420345991092 treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d.jpg resize: (2160, 3840) 1353839130 -6.223433144752452 treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69.jpg resize: (2160, 3840) 1353839095 -6.219561264041357 treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf.jpg resize: (2160, 3840) 1353839015 -6.2097910712742275 treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742328_0.png resize: (234, 272) 1353875904 -2.706996927959818 treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742329_0.png resize: (166, 206) 1353875906 -3.8389838628343105 treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742330_0.png resize: (133, 119) 1353875907 -3.529713306641437 treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742332_0.png resize: (545, 550) 1353875908 -5.5420301164899906 treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742333_0.png resize: (413, 224) 1353875910 -4.324802665797113 treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742334_0.png resize: (177, 196) 1353875911 -4.329076508344235 treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742335_0.png resize: (797, 654) 1353875912 -5.900903546267781 treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742336_0.png resize: (246, 425) 1353875913 -2.7993042200665825 treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742337_0.png resize: (199, 184) 1353875915 -4.121125602194281 treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742339_0.png resize: (489, 239) 1353875916 -3.863991717448223 treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742340_0.png resize: (101, 74) 1353875918 -2.995789656184453 treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742341_0.png resize: (191, 218) 1353875919 -2.3671258863140734 treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742342_0.png resize: (143, 166) 1353875920 -3.1787785117967347 treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742345_0.png resize: (113, 130) 1353875921 -3.356989892164141 treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742348_0.png resize: (276, 293) 1353875922 -4.3747087209162085 treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742349_0.png resize: (123, 157) 1353875923 -3.6153933745012994 treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742350_0.png resize: (442, 400) 1353875924 -3.0927174604401646 treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742351_0.png resize: (221, 117) 1353875926 -3.5793101760043307 treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742353_0.png resize: (328, 160) 1353875927 -3.800552284204125 treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742355_0.png resize: (264, 257) 1353875928 -4.3131730987833095 treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742356_0.png resize: (145, 137) 1353875929 -4.340083085176657 treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742357_0.png resize: (191, 278) 1353875930 -2.8666015988129767 treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742358_0.png resize: (99, 246) 1353875932 -1.4696874087277174 treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742359_0.png resize: (242, 180) 1353875933 -1.8450673454496127 treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742361_0.png resize: (306, 532) 1353875934 -4.160395227167276 treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742362_0.png resize: (282, 280) 1353875935 -3.4125136000508025 treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742363_0.png resize: (621, 432) 1353875937 -3.6863682940181945 treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742364_0.png resize: (219, 182) 1353875938 -3.4105719610114527 treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742365_0.png resize: (413, 354) 1353875939 -2.7880876576874436 treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742366_0.png resize: (140, 77) 1353875940 -3.304440212285392 treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742367_0.png resize: (170, 170) 1353875941 -3.7790553508883455 treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742368_0.png resize: (211, 417) 1353875942 -2.6862066135400378 treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742370_0.png resize: (121, 100) 1353875943 1.0598832128824809 treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742372_0.png resize: (235, 154) 1353875944 -3.9150236741544533 treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742373_0.png resize: (149, 88) 1353875945 -2.3238111996245894 treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742375_0.png resize: (113, 95) 1353875946 -0.823162789746465 treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742376_0.png resize: (872, 1030) 1353875947 -5.041011102150038 treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742377_0.png resize: (151, 165) 1353875948 -2.663724606946373 treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742378_0.png resize: (232, 282) 1353875949 -4.1862387551273725 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742380_0.png resize: (221, 189) 1353875950 -2.661019215702111 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742381_0.png resize: (262, 279) 1353875951 -1.6295915612033165 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742383_0.png resize: (156, 79) 1353875952 -3.1091273299497812 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742384_0.png resize: (242, 318) 1353875953 -4.089274918845441 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742385_0.png resize: (232, 218) 1353875954 -3.4986150769381883 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742386_0.png resize: (322, 320) 1353875955 -2.48214545450441 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742387_0.png resize: (109, 92) 1353875956 -2.5082866580960785 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742388_0.png resize: (92, 109) 1353875957 -3.8797923149974607 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742390_0.png resize: (162, 84) 1353875959 -3.692810287134913 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742392_0.png resize: (324, 332) 1353875960 -3.232687264831998 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742393_0.png resize: (140, 158) 1353875961 -4.35287706572817 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742394_0.png resize: (235, 195) 1353875962 -2.4975433087720966 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742395_0.png resize: (257, 191) 1353875963 -2.3703151682730788 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742396_0.png resize: (249, 202) 1353875964 -2.1720098343931036 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742397_0.png resize: (327, 138) 1353875965 -2.7747090543084894 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742398_0.png resize: (169, 123) 1353875966 -2.944904783207561 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742399_0.png resize: (99, 159) 1353875967 -3.2690223082477115 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742400_0.png resize: (155, 152) 1353875968 -4.143140473016122 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742401_0.png resize: (71, 82) 1353875969 -2.4098522209068984 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742403_0.png resize: (123, 99) 1353875970 -3.7420053488057623 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742404_0.png resize: (231, 141) 1353875971 -2.804229822296084 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742405_0.png resize: (186, 285) 1353875972 -4.25876666605421 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742406_0.png resize: (230, 227) 1353875973 -3.915958395256545 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742408_0.png resize: (142, 154) 1353875974 -3.7978087406596757 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742409_0.png resize: (154, 168) 1353875975 -3.056855074099068 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742411_0.png resize: (215, 132) 1353875976 -3.2614156883081717 treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742412_0.png resize: (257, 133) 1353875977 -2.810411465865219 treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742413_0.png resize: (114, 189) 1353875978 -3.225280729230299 treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742414_0.png resize: (186, 168) 1353875979 -3.1901276605313207 treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742415_0.png resize: (406, 281) 1353875980 -1.3703479097980413 treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742416_0.png resize: (198, 142) 1353875981 -2.489384962306689 treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742417_0.png resize: (150, 162) 1353875982 -0.5227913166655381 treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742418_0.png resize: (228, 121) 1353875983 -3.7966174991069264 treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742419_0.png resize: (203, 231) 1353875984 -4.145587360896817 treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742420_0.png resize: (201, 163) 1353875985 -2.8339188096090626 treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742421_0.png resize: (263, 291) 1353875986 -3.237487843603155 treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742422_0.png resize: (150, 246) 1353875987 -2.089954924704681 treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742423_0.png resize: (610, 678) 1353875988 -4.109437778615443 treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742424_0.png resize: (148, 91) 1353875989 -3.2066851351704266 treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742425_0.png resize: (117, 223) 1353875990 -3.9675648666148025 treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742428_0.png resize: (259, 330) 1353875991 -4.1894454484466 treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742429_0.png resize: (149, 132) 1353875992 -4.0272537488319795 treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742430_0.png resize: (189, 230) 1353875993 -3.184405757041156 treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742431_0.png resize: (430, 299) 1353875994 -3.8050294378219616 treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742432_0.png resize: (157, 217) 1353875995 -3.5308995595262176 treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742433_0.png resize: (278, 217) 1353875996 -3.901753292369787 treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742435_0.png resize: (220, 173) 1353875997 -2.316974889732582 treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742436_0.png resize: (454, 200) 1353875998 -2.509376530882707 treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742438_0.png resize: (186, 187) 1353875999 -3.0826389515547845 treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742439_0.png resize: (234, 240) 1353876000 -3.3377561651883134 treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742442_0.png resize: (161, 95) 1353876001 -3.656478812989182 treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742443_0.png resize: (297, 119) 1353876002 -3.5282141042917754 treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742446_0.png resize: (129, 129) 1353876003 -3.775937337260112 treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742447_0.png resize: (129, 88) 1353876004 -2.047456407639091 treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742448_0.png resize: (145, 150) 1353876005 -3.7368477561149662 treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742449_0.png resize: (245, 155) 1353876007 -2.51805437549262 treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742451_0.png resize: (161, 142) 1353876008 -3.7601295341174934 treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742452_0.png resize: (252, 204) 1353876009 -2.4265639030806567 treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742453_0.png resize: (139, 160) 1353876010 -4.568370174628946 treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742454_0.png resize: (205, 301) 1353876011 -4.154216477672935 treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742455_0.png resize: (216, 156) 1353876012 -4.462415872687441 treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742456_0.png resize: (366, 142) 1353876013 -3.374064190335425 treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742457_0.png resize: (123, 296) 1353876014 -4.47541695801221 treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742458_0.png resize: (180, 189) 1353876015 -3.0028205403112533 treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742460_0.png resize: (218, 215) 1353876016 -2.466465638932718 treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742462_0.png resize: (281, 216) 1353876017 -4.194780411680921 treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742463_0.png resize: (110, 178) 1353876018 -3.198626647164162 treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742466_0.png resize: (431, 390) 1353876019 -4.176644669729563 treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742467_0.png resize: (314, 531) 1353876020 -3.2680071727275606 treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742469_0.png resize: (463, 458) 1353876021 -3.8831814810799696 treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742470_0.png resize: (165, 209) 1353876022 -2.829473636431472 treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742471_0.png resize: (219, 89) 1353876023 0.9705931125187057 treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742472_0.png resize: (230, 149) 1353876025 -2.2035659459901304 treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742473_0.png resize: (344, 444) 1353876027 -4.460338059770218 treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742474_0.png resize: (221, 199) 1353876028 -4.292563900822027 treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742475_0.png resize: (175, 219) 1353876029 -2.3957990617368656 treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742476_0.png resize: (197, 284) 1353876031 -3.745046480437417 treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742477_0.png resize: (188, 159) 1353876032 -2.955831920254513 treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742479_0.png resize: (77, 147) 1353876033 -2.4572704286491986 treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742480_0.png resize: (228, 124) 1353876034 -2.6002158568308174 treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742481_0.png resize: (93, 133) 1353876035 -1.6542565146644272 treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742482_0.png resize: (162, 154) 1353876036 -3.758146989157674 treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742483_0.png resize: (107, 102) 1353876037 -3.6248393316878427 treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742484_0.png resize: (148, 93) 1353876038 -4.0901786216693825 treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742485_0.png resize: (185, 195) 1353876039 -2.6290642103774564 treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742486_0.png resize: (202, 100) 1353876040 -2.498342663985059 treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742489_0.png resize: (84, 102) 1353876041 -3.200855627791438 treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742490_0.png resize: (307, 232) 1353876042 -3.6215791920265605 treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742491_0.png resize: (137, 135) 1353876043 -3.642760759326931 treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742331_0.png resize: (167, 215) 1353876050 -3.8828284056983704 treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742338_0.png resize: (104, 115) 1353876051 -3.380904762714704 treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742343_0.png resize: (160, 97) 1353876052 -2.6429558925390433 treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742344_0.png resize: (128, 136) 1353876053 -2.530330217170218 treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742346_0.png resize: (200, 292) 1353876054 -4.003301518188728 treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742347_0.png resize: (123, 163) 1353876055 -3.5036781524602767 treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742360_0.png resize: (204, 204) 1353876056 -3.1033949756682095 treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742369_0.png resize: (267, 81) 1353876057 -2.184232730185569 treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742379_0.png resize: (126, 50) 1353876059 -2.289316211309291 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742382_0.png resize: (178, 269) 1353876060 -2.3585982735408098 treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742434_0.png resize: (118, 189) 1353876061 -3.9444222046405337 treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742437_0.png resize: (303, 251) 1353876062 -2.46824404264089 treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742440_0.png resize: (346, 274) 1353876063 -4.163620604212147 treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742441_0.png resize: (268, 332) 1353876064 -4.0590827288583675 treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742450_0.png resize: (158, 166) 1353876065 -3.5582541726796837 treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742459_0.png resize: (162, 181) 1353876066 -3.297311998647322 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742389_0.png resize: (161, 128) 1353876075 -4.075774780539083 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742402_0.png resize: (170, 180) 1353876076 -4.417878108113375 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742410_0.png resize: (180, 243) 1353876077 -4.605515455978608 treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742445_0.png resize: (138, 130) 1353876078 -3.828665931919987 treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742352_0.png resize: (251, 310) 1353876092 -4.28708941705264 treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742371_0.png resize: (321, 140) 1353876093 -4.3217099485516846 treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742374_0.png resize: (436, 205) 1353876094 -4.291678024134347 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742391_0.png resize: (275, 428) 1353876095 -4.650602245383955 treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742426_0.png resize: (228, 203) 1353876096 -2.9408908822277025 treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742427_0.png resize: (467, 294) 1353876097 -1.744839901554872 treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742461_0.png resize: (316, 544) 1353876098 -3.334567247278176 treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742464_0.png resize: (252, 440) 1353876099 -3.773083054173114 treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742465_0.png resize: (116, 212) 1353876100 -2.851197355616445 treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742354_0.png resize: (191, 206) 1353876103 -3.619752302270308 treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742444_0.png resize: (300, 211) 1353876104 -3.8458350675902446 treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742478_0.png resize: (77, 85) 1353876105 -1.5801769719960232 treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742487_0.png resize: (171, 148) 1353876106 -3.6307485208436234 treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742488_0.png resize: (81, 111) 1353876107 -3.0244163843688585 treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742407_0.png resize: (217, 137) 1353876135 -4.3925308934956915 treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742468_0.png resize: (457, 446) 1353876136 -4.94506190530336 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 172 time used for this insertion : 0.021874189376831055 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 172 time used for this insertion : 0.03152585029602051 save missing photos in datou_result : time spend for datou_step_exec : 39.12155890464783 time spend to save output : 0.05938553810119629 total time spend for step 6 : 39.18094444274902 step7:brightness Mon Apr 28 11:56:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78.jpg treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608.jpg treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a.jpg treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673.jpg treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544.jpg treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d.jpg treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69.jpg treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf.jpg treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742328_0.png treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742329_0.png treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742330_0.png treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742332_0.png treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742333_0.png treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742334_0.png treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742335_0.png treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742336_0.png treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742337_0.png treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742339_0.png treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742340_0.png treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742341_0.png treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742342_0.png treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742345_0.png treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742348_0.png treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742349_0.png treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742350_0.png treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742351_0.png treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742353_0.png treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742355_0.png treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742356_0.png treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742357_0.png treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742358_0.png treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742359_0.png treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742361_0.png treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742362_0.png treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742363_0.png treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742364_0.png treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742365_0.png treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742366_0.png treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742367_0.png treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742368_0.png treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742370_0.png treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742372_0.png treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742373_0.png treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742375_0.png treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742376_0.png treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742377_0.png treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742378_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742380_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742381_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742383_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742384_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742385_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742386_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742387_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742388_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742390_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742392_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742393_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742394_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742395_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742396_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742397_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742398_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742399_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742400_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742401_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742403_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742404_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742405_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742406_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742408_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742409_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742411_0.png treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742412_0.png treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742413_0.png treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742414_0.png treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742415_0.png treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742416_0.png treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742417_0.png treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742418_0.png treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742419_0.png treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742420_0.png treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742421_0.png treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742422_0.png treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742423_0.png treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742424_0.png treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742425_0.png treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742428_0.png treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742429_0.png treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742430_0.png treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742431_0.png treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742432_0.png treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742433_0.png treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742435_0.png treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742436_0.png treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742438_0.png treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742439_0.png treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742442_0.png treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742443_0.png treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742446_0.png treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742447_0.png treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742448_0.png treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742449_0.png treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742451_0.png treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742452_0.png treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742453_0.png treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742454_0.png treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742455_0.png treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742456_0.png treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742457_0.png treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742458_0.png treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742460_0.png treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742462_0.png treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742463_0.png treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742466_0.png treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742467_0.png treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742469_0.png treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742470_0.png treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742471_0.png treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742472_0.png treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742473_0.png treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742474_0.png treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742475_0.png treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742476_0.png treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742477_0.png treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742479_0.png treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742480_0.png treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742481_0.png treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742482_0.png treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742483_0.png treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742484_0.png treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742485_0.png treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742486_0.png treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742489_0.png treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742490_0.png treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742491_0.png treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742331_0.png treat image : temp/1745833829_1623641_1353839403_1e3b8246c28e05f845b8a870c5e06a78_rle_crop_3770742338_0.png treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742343_0.png treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742344_0.png treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742346_0.png treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742347_0.png treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742360_0.png treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742369_0.png treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742379_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742382_0.png treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742434_0.png treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742437_0.png treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742440_0.png treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742441_0.png treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742450_0.png treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742459_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742389_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742402_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742410_0.png treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742445_0.png treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742352_0.png treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742371_0.png treat image : temp/1745833829_1623641_1353839231_1cd3553880be510059fc78b5b542d29a_rle_crop_3770742374_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742391_0.png treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742426_0.png treat image : temp/1745833829_1623641_1353839164_bcacdda19a6091d9fa6a564503dfa544_rle_crop_3770742427_0.png treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742461_0.png treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742464_0.png treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742465_0.png treat image : temp/1745833829_1623641_1353839264_a44f26d4ff776589ec8be4c4795dc608_rle_crop_3770742354_0.png treat image : temp/1745833829_1623641_1353839130_5b2143c47696855a9331d947e4281e1d_rle_crop_3770742444_0.png treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742478_0.png treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742487_0.png treat image : temp/1745833829_1623641_1353839015_ee99594da9aaa5a6708684cab9618fbf_rle_crop_3770742488_0.png treat image : temp/1745833829_1623641_1353839196_39313df1c670f96ce1b57baaf8ecb673_rle_crop_3770742407_0.png treat image : temp/1745833829_1623641_1353839095_c47c60c13a1160cbe7bbaade767b0c69_rle_crop_3770742468_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 172 time used for this insertion : 0.022335052490234375 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 172 time used for this insertion : 0.033710479736328125 save missing photos in datou_result : time spend for datou_step_exec : 11.03722882270813 time spend to save output : 0.062444210052490234 total time spend for step 7 : 11.09967303276062 step8:velours_tree Mon Apr 28 11:56:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.36441588401794434 time spend to save output : 8.678436279296875e-05 total time spend for step 8 : 0.3645026683807373 step9:send_mail_cod Mon Apr 28 11:56:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22448524_28-04-2025_11_56_22.pdf Dont find os.environ['TEMPS'] 22448922 imagette224489221745834182 22448923 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette224489231745834182 22448924 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette224489241745834183 22448925 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette224489251745834183 22448926 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette224489261745834184 22448927 imagette224489271745834185 22448928 change filename to text .change filename to text .imagette224489281745834185 22448929 change filename to text .change filename to text .change filename to text .change filename to text .imagette224489291745834185 22448930 imagette224489301745834186 22448931 imagette224489311745834186 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22448524 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22448922,22448923,22448924,22448925,22448926,22448927,22448928,22448929,22448930,22448931,22448932?tags=flou,pet_clair,autre,papier,carton,pehd,pet_fonce,metal,background,mal_croppe,environnement Dont find os.environ['TEMPS'] args[1353839403] : ((1353839403, -5.412051757285842, 492609224), (1353839403, -0.7709736667605832, 501862349), '0.09679832175925925') We are sending mail with results at report@fotonower.com args[1353839264] : ((1353839264, -6.070404823679, 492609224), (1353839264, 0.021494737397818122, 2107752395), '0.09679832175925925') We are sending mail with results at report@fotonower.com args[1353839231] : ((1353839231, -6.187339967026295, 492609224), (1353839231, 0.02631977022159636, 2107752395), '0.09679832175925925') We are sending mail with results at report@fotonower.com args[1353839196] : ((1353839196, -6.153307614270344, 492609224), (1353839196, 0.019079930803545413, 2107752395), '0.09679832175925925') We are sending mail with results at report@fotonower.com args[1353839164] : ((1353839164, -5.980420345991092, 492609224), (1353839164, -0.01561626106185901, 2107752395), '0.09679832175925925') We are sending mail with results at report@fotonower.com args[1353839130] : ((1353839130, -6.223433144752452, 492609224), (1353839130, -0.05961484287961458, 2107752395), '0.09679832175925925') We are sending mail with results at report@fotonower.com args[1353839095] : ((1353839095, -6.219561264041357, 492609224), (1353839095, -0.05286839392774322, 2107752395), '0.09679832175925925') We are sending mail with results at report@fotonower.com args[1353839015] : ((1353839015, -6.2097910712742275, 492609224), (1353839015, -0.1861720034087252, 496442774), '0.09679832175925925') We are sending mail with results at report@fotonower.com refus_total : 0.09679832175925925 2022-04-13 10:29:59 0 Dont find os.environ['TEMPS'] SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22448524 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22448524_28-04-2025_11_56_22.pdf results_Auto_P22448524_28-04-2025_11_56_22.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22448524_28-04-2025_11_56_22.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22448524','results_Auto_P22448524_28-04-2025_11_56_22.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22448524_28-04-2025_11_56_22.pdf','pdf','','0.7','0.09679832175925925') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22448524

https://www.fotonower.com/image?json=false&list_photos_id=1353839403
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353839264
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353839231
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353839196
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353839164
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353839130
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353839095
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1353839015
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 9.68%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/22448923?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22448924?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22448925?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22448926?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/22448928?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/22448929?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22448524_28-04-2025_11_56_22.pdf.

Lien vers velours :https://www.fotonower.com/velours/22448922,22448923,22448924,22448925,22448926,22448927,22448928,22448929,22448930,22448931,22448932?tags=flou,pet_clair,autre,papier,carton,pehd,pet_fonce,metal,background,mal_croppe,environnement.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 28 Apr 2025 09:56:29 GMT Content-Length: 0 Connection: close X-Message-Id: jZb8woUTSrWVM4WAmmz3gw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1353839403, 1353839264, 1353839231, 1353839196, 1353839164, 1353839130, 1353839095, 1353839015] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839403', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839264', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839231', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839196', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839164', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839130', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839095', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839015', None, None, None, None, None, '2763921') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.013785362243652344 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.519608736038208 time spend to save output : 0.01409459114074707 total time spend for step 9 : 7.533703327178955 step10:split_time_score Mon Apr 28 11:56:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('17', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 25042025 22448524 Nombre de photos uploadées : 8 / 23040 (0%) 25042025 22448524 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 25042025 22448524 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 3.5762786865234375e-06 elapsed_time : order_list_meta_photo_and_scores 9.298324584960938e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0004630088806152344 elapsed_time : insert_dashboard_record_day_entry 0.02436685562133789 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.05526753741436943 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22433048_25-04-2025_13_51_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22433048 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22433048 AND mptpi.`type`=3726 To do Qualite : 0.029464662268574707 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22448523_28-04-2025_11_53_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22448523 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22448523 AND mptpi.`type`=3726 To do Qualite : 0.03206858747914848 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22440751_25-04-2025_16_54_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22440751 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22440751 AND mptpi.`type`=3726 To do Qualite : 0.026824880052725635 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22436849_25-04-2025_15_24_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22436849 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22436849 AND mptpi.`type`=3726 To do Qualite : 0.09679832175925925 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22448524_28-04-2025_11_56_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22448524 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22448524 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'25042025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1353839403, 1353839264, 1353839231, 1353839196, 1353839164, 1353839130, 1353839095, 1353839015] Looping around the photos to save general results len do output : 1 /22448524Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839403', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839264', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839231', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839196', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839164', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839130', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839095', None, None, None, None, None, '2763921') ('3318', None, None, None, None, None, None, None, '2763921') ('3318', '22448524', '1353839015', None, None, None, None, None, '2763921') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.012926816940307617 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.5342590808868408 time spend to save output : 0.013247966766357422 total time spend for step 10 : 0.5475070476531982 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 154.70user 160.07system 6:06.19elapsed 85%CPU (0avgtext+0avgdata 4978792maxresident)k 908368inputs+126456outputs (20631major+16474778minor)pagefaults 0swaps