python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 555626 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3273388'] with mtr_portfolio_ids : ['24858050'] and first list_photo_ids : [] new path : /proc/555626/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 7 ; length of list_pids : 7 ; length of list_args : 7 time to download the photos : 1.161167860031128 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Jul 11 22:40:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5665 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-07-11 22:40:32.947471: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-07-11 22:40:32.955782: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-07-11 22:40:32.957297: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7ff064000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-07-11 22:40:32.957353: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-07-11 22:40:32.960098: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-07-11 22:40:33.074529: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2db878d0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-07-11 22:40:33.074586: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-07-11 22:40:33.075581: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-11 22:40:33.076042: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-11 22:40:33.079147: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-11 22:40:33.082122: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-11 22:40:33.082625: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-11 22:40:33.085337: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-11 22:40:33.086426: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-11 22:40:33.091123: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-11 22:40:33.092380: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-11 22:40:33.092467: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-11 22:40:33.093098: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-11 22:40:33.093115: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-11 22:40:33.093124: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-11 22:40:33.094201: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4895 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-07-11 22:40:33.423774: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-11 22:40:33.423904: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-11 22:40:33.423921: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-11 22:40:33.423936: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-11 22:40:33.423950: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-11 22:40:33.423964: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-11 22:40:33.423977: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-11 22:40:33.423992: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-11 22:40:33.424885: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-11 22:40:33.425856: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-11 22:40:33.425888: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-11 22:40:33.425903: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-11 22:40:33.425917: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-11 22:40:33.425931: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-11 22:40:33.425944: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-11 22:40:33.425958: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-11 22:40:33.425972: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-11 22:40:33.426920: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-11 22:40:33.426954: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-11 22:40:33.426962: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-11 22:40:33.426970: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-11 22:40:33.427971: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4895 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-07-11 22:40:45.811258: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-11 22:40:45.999751: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-11 22:40:47.393255: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.393795: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.394277: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.394754: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.395306: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.395832: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.396345: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.396384: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-11 22:40:47.396916: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.396931: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-11 22:40:47.404234: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.404283: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-11 22:40:47.404796: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.404812: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-11 22:40:47.411490: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.411553: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-11 22:40:47.412082: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.412099: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-11 22:40:47.443252: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.443308: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-11 22:40:47.443836: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.443852: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-11 22:40:47.449639: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.449661: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-11 22:40:47.450161: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.450177: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-11 22:40:47.483910: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.484416: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.486197: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.486690: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.530428: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.530967: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.533106: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.533605: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.563687: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.564181: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.565783: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.566271: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.572576: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.573068: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.574867: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.575366: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.585642: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.586136: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.587794: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.588301: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.619525: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.620039: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.620562: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.621083: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.625025: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.625517: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.642092: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.642589: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.643079: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.643575: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.656007: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.656515: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.657028: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.657549: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.661755: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.662247: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.666752: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.667280: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.679516: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.680054: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.684178: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.684714: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.685237: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.685758: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.686446: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.686973: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.697778: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.698306: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.698848: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.699381: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.699908: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.700429: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.700951: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.701455: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.710595: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.711121: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.717206: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.717727: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.748458: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.748521: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-07-11 22:40:47.749506: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.750447: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.757592: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.758326: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.759066: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.759770: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.767690: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.768217: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.787220: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.788227: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.788805: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.789455: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.793803: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.794355: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.794848: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.795384: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.796512: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.806875: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.807807: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.817523: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.818430: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.819344: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.820215: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.821092: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-11 22:40:47.821956: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 35 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 52 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 Detection mask done ! Trying to reset tf kernel 556356 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4472 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5446 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.005536794662475586 nb_pixel_total : 188723 time to create 1 rle with new method : 0.015674829483032227 length of segment : 738 time for calcul the mask position with numpy : 0.0007731914520263672 nb_pixel_total : 43128 time to create 1 rle with old method : 0.04707765579223633 length of segment : 208 time for calcul the mask position with numpy : 0.00022411346435546875 nb_pixel_total : 9567 time to create 1 rle with old method : 0.010468482971191406 length of segment : 129 time for calcul the mask position with numpy : 0.0010569095611572266 nb_pixel_total : 18216 time to create 1 rle with old method : 0.01982426643371582 length of segment : 590 time for calcul the mask position with numpy : 0.0008397102355957031 nb_pixel_total : 41972 time to create 1 rle with old method : 0.04473567008972168 length of segment : 346 time for calcul the mask position with numpy : 0.0014641284942626953 nb_pixel_total : 88506 time to create 1 rle with old method : 0.09543418884277344 length of segment : 349 time for calcul the mask position with numpy : 0.0011546611785888672 nb_pixel_total : 63270 time to create 1 rle with old method : 0.06967759132385254 length of segment : 319 time for calcul the mask position with numpy : 0.0005757808685302734 nb_pixel_total : 22845 time to create 1 rle with old method : 0.025328636169433594 length of segment : 248 time for calcul the mask position with numpy : 0.0005965232849121094 nb_pixel_total : 27808 time to create 1 rle with old method : 0.030918359756469727 length of segment : 158 time for calcul the mask position with numpy : 0.00025653839111328125 nb_pixel_total : 10005 time to create 1 rle with old method : 0.011809587478637695 length of segment : 102 time for calcul the mask position with numpy : 0.0005693435668945312 nb_pixel_total : 27646 time to create 1 rle with old method : 0.03214693069458008 length of segment : 255 time for calcul the mask position with numpy : 0.0016238689422607422 nb_pixel_total : 82303 time to create 1 rle with old method : 0.09198188781738281 length of segment : 414 time for calcul the mask position with numpy : 0.0006737709045410156 nb_pixel_total : 29985 time to create 1 rle with old method : 0.0343019962310791 length of segment : 276 time for calcul the mask position with numpy : 0.0007252693176269531 nb_pixel_total : 31580 time to create 1 rle with old method : 0.03560352325439453 length of segment : 294 time for calcul the mask position with numpy : 0.001176595687866211 nb_pixel_total : 65572 time to create 1 rle with old method : 0.07590103149414062 length of segment : 439 time for calcul the mask position with numpy : 0.004946708679199219 nb_pixel_total : 178845 time to create 1 rle with new method : 0.015923738479614258 length of segment : 476 time for calcul the mask position with numpy : 0.0008158683776855469 nb_pixel_total : 37502 time to create 1 rle with old method : 0.04350709915161133 length of segment : 355 time for calcul the mask position with numpy : 0.00034880638122558594 nb_pixel_total : 15853 time to create 1 rle with old method : 0.018575668334960938 length of segment : 198 time for calcul the mask position with numpy : 0.00041747093200683594 nb_pixel_total : 13607 time to create 1 rle with old method : 0.01625370979309082 length of segment : 190 time for calcul the mask position with numpy : 0.0007603168487548828 nb_pixel_total : 45485 time to create 1 rle with old method : 0.05321931838989258 length of segment : 213 time for calcul the mask position with numpy : 0.0017635822296142578 nb_pixel_total : 86907 time to create 1 rle with old method : 0.09409213066101074 length of segment : 385 time for calcul the mask position with numpy : 0.0027103424072265625 nb_pixel_total : 143225 time to create 1 rle with old method : 0.15494322776794434 length of segment : 544 time for calcul the mask position with numpy : 0.00033283233642578125 nb_pixel_total : 10512 time to create 1 rle with old method : 0.011641502380371094 length of segment : 136 time for calcul the mask position with numpy : 0.0003037452697753906 nb_pixel_total : 14144 time to create 1 rle with old method : 0.016055583953857422 length of segment : 151 time for calcul the mask position with numpy : 0.000213623046875 nb_pixel_total : 12929 time to create 1 rle with old method : 0.014490365982055664 length of segment : 190 time for calcul the mask position with numpy : 0.0005965232849121094 nb_pixel_total : 16867 time to create 1 rle with old method : 0.01906275749206543 length of segment : 176 time for calcul the mask position with numpy : 0.001375436782836914 nb_pixel_total : 64899 time to create 1 rle with old method : 0.07582688331604004 length of segment : 594 time for calcul the mask position with numpy : 0.001062631607055664 nb_pixel_total : 54813 time to create 1 rle with old method : 0.0610196590423584 length of segment : 235 time for calcul the mask position with numpy : 0.0004107952117919922 nb_pixel_total : 13183 time to create 1 rle with old method : 0.017807483673095703 length of segment : 143 time for calcul the mask position with numpy : 0.0010721683502197266 nb_pixel_total : 25240 time to create 1 rle with old method : 0.035054683685302734 length of segment : 314 time for calcul the mask position with numpy : 0.0007822513580322266 nb_pixel_total : 26675 time to create 1 rle with old method : 0.036583662033081055 length of segment : 214 time for calcul the mask position with numpy : 0.0009617805480957031 nb_pixel_total : 35734 time to create 1 rle with old method : 0.04759645462036133 length of segment : 219 time for calcul the mask position with numpy : 0.0007433891296386719 nb_pixel_total : 18126 time to create 1 rle with old method : 0.03182721138000488 length of segment : 313 time for calcul the mask position with numpy : 0.001367807388305664 nb_pixel_total : 30436 time to create 1 rle with old method : 0.037873029708862305 length of segment : 127 time for calcul the mask position with numpy : 0.0010318756103515625 nb_pixel_total : 41192 time to create 1 rle with old method : 0.050116539001464844 length of segment : 309 time for calcul the mask position with numpy : 0.0019030570983886719 nb_pixel_total : 69605 time to create 1 rle with old method : 0.08477473258972168 length of segment : 501 time for calcul the mask position with numpy : 0.004034280776977539 nb_pixel_total : 130173 time to create 1 rle with old method : 0.18158197402954102 length of segment : 436 time for calcul the mask position with numpy : 0.0010685920715332031 nb_pixel_total : 47412 time to create 1 rle with old method : 0.058225393295288086 length of segment : 289 time for calcul the mask position with numpy : 0.0006744861602783203 nb_pixel_total : 27107 time to create 1 rle with old method : 0.03265810012817383 length of segment : 218 time for calcul the mask position with numpy : 0.0009429454803466797 nb_pixel_total : 42424 time to create 1 rle with old method : 0.05030703544616699 length of segment : 280 time for calcul the mask position with numpy : 0.0004181861877441406 nb_pixel_total : 14883 time to create 1 rle with old method : 0.016677141189575195 length of segment : 182 time for calcul the mask position with numpy : 0.0016562938690185547 nb_pixel_total : 73665 time to create 1 rle with old method : 0.08138608932495117 length of segment : 555 time for calcul the mask position with numpy : 0.0008578300476074219 nb_pixel_total : 51523 time to create 1 rle with old method : 0.05836057662963867 length of segment : 268 time for calcul the mask position with numpy : 0.0006053447723388672 nb_pixel_total : 24226 time to create 1 rle with old method : 0.026510238647460938 length of segment : 333 time for calcul the mask position with numpy : 0.0006582736968994141 nb_pixel_total : 42997 time to create 1 rle with old method : 0.0468292236328125 length of segment : 203 time for calcul the mask position with numpy : 0.00029850006103515625 nb_pixel_total : 13810 time to create 1 rle with old method : 0.015407800674438477 length of segment : 109 time for calcul the mask position with numpy : 0.00115966796875 nb_pixel_total : 51526 time to create 1 rle with old method : 0.056067466735839844 length of segment : 405 time for calcul the mask position with numpy : 0.0047948360443115234 nb_pixel_total : 216218 time to create 1 rle with new method : 0.026684284210205078 length of segment : 745 time for calcul the mask position with numpy : 0.0012698173522949219 nb_pixel_total : 36166 time to create 1 rle with old method : 0.04202985763549805 length of segment : 210 time for calcul the mask position with numpy : 0.0009949207305908203 nb_pixel_total : 36687 time to create 1 rle with old method : 0.04141592979431152 length of segment : 211 time for calcul the mask position with numpy : 0.0008137226104736328 nb_pixel_total : 26795 time to create 1 rle with old method : 0.0300445556640625 length of segment : 252 time for calcul the mask position with numpy : 0.0052411556243896484 nb_pixel_total : 164073 time to create 1 rle with new method : 0.009430885314941406 length of segment : 441 time for calcul the mask position with numpy : 0.0038230419158935547 nb_pixel_total : 145937 time to create 1 rle with old method : 0.1658189296722412 length of segment : 285 time for calcul the mask position with numpy : 0.0047109127044677734 nb_pixel_total : 176680 time to create 1 rle with new method : 0.010627269744873047 length of segment : 602 time for calcul the mask position with numpy : 0.0008685588836669922 nb_pixel_total : 18855 time to create 1 rle with old method : 0.021800518035888672 length of segment : 172 time for calcul the mask position with numpy : 0.00577855110168457 nb_pixel_total : 125761 time to create 1 rle with old method : 0.14719176292419434 length of segment : 564 time for calcul the mask position with numpy : 0.0008971691131591797 nb_pixel_total : 20078 time to create 1 rle with old method : 0.023163318634033203 length of segment : 240 time for calcul the mask position with numpy : 0.0009658336639404297 nb_pixel_total : 41437 time to create 1 rle with old method : 0.04815220832824707 length of segment : 317 time for calcul the mask position with numpy : 0.003501415252685547 nb_pixel_total : 91798 time to create 1 rle with old method : 0.10494399070739746 length of segment : 496 time for calcul the mask position with numpy : 0.0017120838165283203 nb_pixel_total : 45781 time to create 1 rle with old method : 0.05424070358276367 length of segment : 353 time for calcul the mask position with numpy : 0.004263877868652344 nb_pixel_total : 110001 time to create 1 rle with old method : 0.1269536018371582 length of segment : 406 time for calcul the mask position with numpy : 0.002192258834838867 nb_pixel_total : 67285 time to create 1 rle with old method : 0.07553505897521973 length of segment : 505 time for calcul the mask position with numpy : 0.0031769275665283203 nb_pixel_total : 56896 time to create 1 rle with old method : 0.08806061744689941 length of segment : 284 time for calcul the mask position with numpy : 0.0021338462829589844 nb_pixel_total : 41126 time to create 1 rle with old method : 0.04712080955505371 length of segment : 425 time for calcul the mask position with numpy : 0.001722097396850586 nb_pixel_total : 40370 time to create 1 rle with old method : 0.045752763748168945 length of segment : 272 time for calcul the mask position with numpy : 0.0004413127899169922 nb_pixel_total : 8692 time to create 1 rle with old method : 0.010300397872924805 length of segment : 95 time for calcul the mask position with numpy : 0.00045943260192871094 nb_pixel_total : 10128 time to create 1 rle with old method : 0.011736392974853516 length of segment : 104 time for calcul the mask position with numpy : 0.0014395713806152344 nb_pixel_total : 47632 time to create 1 rle with old method : 0.05327582359313965 length of segment : 298 time for calcul the mask position with numpy : 0.0008754730224609375 nb_pixel_total : 19166 time to create 1 rle with old method : 0.023453712463378906 length of segment : 158 time for calcul the mask position with numpy : 0.0004634857177734375 nb_pixel_total : 8835 time to create 1 rle with old method : 0.01043391227722168 length of segment : 114 time for calcul the mask position with numpy : 0.000993490219116211 nb_pixel_total : 20389 time to create 1 rle with old method : 0.022822141647338867 length of segment : 197 time for calcul the mask position with numpy : 0.00040793418884277344 nb_pixel_total : 9364 time to create 1 rle with old method : 0.01620769500732422 length of segment : 82 time for calcul the mask position with numpy : 0.0013396739959716797 nb_pixel_total : 24258 time to create 1 rle with old method : 0.039600372314453125 length of segment : 200 time for calcul the mask position with numpy : 0.002635955810546875 nb_pixel_total : 69574 time to create 1 rle with old method : 0.08036351203918457 length of segment : 360 time for calcul the mask position with numpy : 0.0006499290466308594 nb_pixel_total : 13631 time to create 1 rle with old method : 0.01592111587524414 length of segment : 133 time for calcul the mask position with numpy : 0.0010814666748046875 nb_pixel_total : 22013 time to create 1 rle with old method : 0.02507495880126953 length of segment : 271 time for calcul the mask position with numpy : 0.0007798671722412109 nb_pixel_total : 11374 time to create 1 rle with old method : 0.01376032829284668 length of segment : 143 time for calcul the mask position with numpy : 0.001787424087524414 nb_pixel_total : 39727 time to create 1 rle with old method : 0.045984506607055664 length of segment : 316 time for calcul the mask position with numpy : 0.0007688999176025391 nb_pixel_total : 18742 time to create 1 rle with old method : 0.031516313552856445 length of segment : 118 time for calcul the mask position with numpy : 0.0023026466369628906 nb_pixel_total : 38228 time to create 1 rle with old method : 0.05100679397583008 length of segment : 247 time for calcul the mask position with numpy : 0.0013782978057861328 nb_pixel_total : 37486 time to create 1 rle with old method : 0.04314565658569336 length of segment : 260 time for calcul the mask position with numpy : 0.005555391311645508 nb_pixel_total : 85694 time to create 1 rle with old method : 0.10085511207580566 length of segment : 1056 time for calcul the mask position with numpy : 0.0017180442810058594 nb_pixel_total : 39028 time to create 1 rle with old method : 0.04638671875 length of segment : 166 time for calcul the mask position with numpy : 0.003114461898803711 nb_pixel_total : 72322 time to create 1 rle with old method : 0.0811614990234375 length of segment : 380 time for calcul the mask position with numpy : 0.0009379386901855469 nb_pixel_total : 14934 time to create 1 rle with old method : 0.017591476440429688 length of segment : 173 time for calcul the mask position with numpy : 0.0015969276428222656 nb_pixel_total : 35395 time to create 1 rle with old method : 0.04046988487243652 length of segment : 294 time for calcul the mask position with numpy : 0.003638029098510742 nb_pixel_total : 77516 time to create 1 rle with old method : 0.08779668807983398 length of segment : 351 time for calcul the mask position with numpy : 0.0010895729064941406 nb_pixel_total : 20154 time to create 1 rle with old method : 0.02328038215637207 length of segment : 172 time for calcul the mask position with numpy : 0.0016813278198242188 nb_pixel_total : 34736 time to create 1 rle with old method : 0.043816566467285156 length of segment : 268 time for calcul the mask position with numpy : 0.005626678466796875 nb_pixel_total : 119069 time to create 1 rle with old method : 0.13658642768859863 length of segment : 650 time for calcul the mask position with numpy : 0.0030601024627685547 nb_pixel_total : 33804 time to create 1 rle with old method : 0.03927969932556152 length of segment : 478 time for calcul the mask position with numpy : 0.0010371208190917969 nb_pixel_total : 19443 time to create 1 rle with old method : 0.022253036499023438 length of segment : 192 time for calcul the mask position with numpy : 0.009734392166137695 nb_pixel_total : 246714 time to create 1 rle with new method : 0.019838809967041016 length of segment : 715 time for calcul the mask position with numpy : 0.0009431838989257812 nb_pixel_total : 16770 time to create 1 rle with old method : 0.020722627639770508 length of segment : 130 time for calcul the mask position with numpy : 0.0008859634399414062 nb_pixel_total : 19226 time to create 1 rle with old method : 0.023671865463256836 length of segment : 105 time for calcul the mask position with numpy : 0.0009558200836181641 nb_pixel_total : 18596 time to create 1 rle with old method : 0.02337336540222168 length of segment : 120 time for calcul the mask position with numpy : 0.0006017684936523438 nb_pixel_total : 12263 time to create 1 rle with old method : 0.01472783088684082 length of segment : 148 time for calcul the mask position with numpy : 0.001522064208984375 nb_pixel_total : 30037 time to create 1 rle with old method : 0.03845095634460449 length of segment : 164 time for calcul the mask position with numpy : 0.0016856193542480469 nb_pixel_total : 34767 time to create 1 rle with old method : 0.04244184494018555 length of segment : 218 time for calcul the mask position with numpy : 0.0009226799011230469 nb_pixel_total : 15481 time to create 1 rle with old method : 0.01852250099182129 length of segment : 118 time for calcul the mask position with numpy : 0.0011224746704101562 nb_pixel_total : 21502 time to create 1 rle with old method : 0.02517247200012207 length of segment : 184 time for calcul the mask position with numpy : 0.002865314483642578 nb_pixel_total : 66525 time to create 1 rle with old method : 0.07622289657592773 length of segment : 469 time for calcul the mask position with numpy : 0.0031549930572509766 nb_pixel_total : 80471 time to create 1 rle with old method : 0.09079384803771973 length of segment : 478 time for calcul the mask position with numpy : 0.0018246173858642578 nb_pixel_total : 36172 time to create 1 rle with old method : 0.0466005802154541 length of segment : 670 time for calcul the mask position with numpy : 0.002235889434814453 nb_pixel_total : 43688 time to create 1 rle with old method : 0.05135154724121094 length of segment : 382 time for calcul the mask position with numpy : 0.0007195472717285156 nb_pixel_total : 13718 time to create 1 rle with old method : 0.01569080352783203 length of segment : 179 time for calcul the mask position with numpy : 0.0039942264556884766 nb_pixel_total : 72765 time to create 1 rle with old method : 0.0844411849975586 length of segment : 282 time for calcul the mask position with numpy : 0.0077097415924072266 nb_pixel_total : 237572 time to create 1 rle with new method : 0.016002655029296875 length of segment : 513 time for calcul the mask position with numpy : 0.001209259033203125 nb_pixel_total : 35416 time to create 1 rle with old method : 0.05222749710083008 length of segment : 255 time for calcul the mask position with numpy : 0.0011248588562011719 nb_pixel_total : 30108 time to create 1 rle with old method : 0.03809642791748047 length of segment : 131 time for calcul the mask position with numpy : 0.0011484622955322266 nb_pixel_total : 21540 time to create 1 rle with old method : 0.02493762969970703 length of segment : 171 time for calcul the mask position with numpy : 0.001739501953125 nb_pixel_total : 72502 time to create 1 rle with old method : 0.08905243873596191 length of segment : 437 time for calcul the mask position with numpy : 0.0025610923767089844 nb_pixel_total : 79171 time to create 1 rle with old method : 0.10296988487243652 length of segment : 326 time for calcul the mask position with numpy : 0.0012679100036621094 nb_pixel_total : 49977 time to create 1 rle with old method : 0.0569005012512207 length of segment : 190 time for calcul the mask position with numpy : 0.0008344650268554688 nb_pixel_total : 25973 time to create 1 rle with old method : 0.029407501220703125 length of segment : 271 time for calcul the mask position with numpy : 0.0053331851959228516 nb_pixel_total : 224864 time to create 1 rle with new method : 0.013458728790283203 length of segment : 527 time for calcul the mask position with numpy : 0.0014081001281738281 nb_pixel_total : 61204 time to create 1 rle with old method : 0.06915950775146484 length of segment : 333 time for calcul the mask position with numpy : 0.0019986629486083984 nb_pixel_total : 84825 time to create 1 rle with old method : 0.09432554244995117 length of segment : 405 time for calcul the mask position with numpy : 0.0014615058898925781 nb_pixel_total : 65770 time to create 1 rle with old method : 0.07201480865478516 length of segment : 459 time for calcul the mask position with numpy : 0.0010433197021484375 nb_pixel_total : 28463 time to create 1 rle with old method : 0.030829668045043945 length of segment : 237 time for calcul the mask position with numpy : 0.0003898143768310547 nb_pixel_total : 7530 time to create 1 rle with old method : 0.008684396743774414 length of segment : 122 time for calcul the mask position with numpy : 0.00035190582275390625 nb_pixel_total : 7889 time to create 1 rle with old method : 0.009341955184936523 length of segment : 114 time for calcul the mask position with numpy : 0.002402782440185547 nb_pixel_total : 72161 time to create 1 rle with old method : 0.07894134521484375 length of segment : 517 time for calcul the mask position with numpy : 0.0026900768280029297 nb_pixel_total : 98117 time to create 1 rle with old method : 0.10872960090637207 length of segment : 255 time for calcul the mask position with numpy : 0.0009191036224365234 nb_pixel_total : 25195 time to create 1 rle with old method : 0.0285184383392334 length of segment : 290 time for calcul the mask position with numpy : 0.006791591644287109 nb_pixel_total : 260141 time to create 1 rle with new method : 0.01539754867553711 length of segment : 850 time for calcul the mask position with numpy : 0.0011034011840820312 nb_pixel_total : 31389 time to create 1 rle with old method : 0.035537004470825195 length of segment : 273 time spent for convertir_results : 12.043245077133179 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 127 chid ids of type : 3594 Number RLEs to save : 39220 save missing photos in datou_result : time spend for datou_step_exec : 73.49361300468445 time spend to save output : 2.4143571853637695 total time spend for step 1 : 75.90797019004822 step2:crop_condition Fri Jul 11 22:41:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 7 ! batch 1 Loaded 127 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 107 About to insert : list_path_to_insert length 107 new photo from crops ! About to upload 107 photos upload in portfolio : 3736932 init cache_photo without model_param we have 107 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1752266534_555626 we have uploaded 107 photos in the portfolio 3736932 time of upload the photos Elapsed time : 25.238259315490723 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 18 About to insert : list_path_to_insert length 18 new photo from crops ! About to upload 18 photos upload in portfolio : 3736932 init cache_photo without model_param we have 18 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1752266565_555626 we have uploaded 18 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.497529983520508 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1752266571_555626 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8440310955047607 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1371674778, 1371674767, 1371674757, 1371674742, 1371674738, 1371674734, 1371674731] Looping around the photos to save general results len do output : 127 /1371703275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1371703513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674778', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674767', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674757', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674742', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674738', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674734', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674731', None, None, None, None, None, '3273388') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 388 time used for this insertion : 0.04302501678466797 save_final save missing photos in datou_result : time spend for datou_step_exec : 65.73113131523132 time spend to save output : 0.046623945236206055 total time spend for step 2 : 65.77775526046753 step3:rle_unique_nms_with_priority Fri Jul 11 22:42:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 127 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 6.047471523284912 time for calcul the mask position with numpy : 0.6640231609344482 nb_pixel_total : 7752714 time to create 1 rle with new method : 0.6270101070404053 time for calcul the mask position with numpy : 0.041028499603271484 nb_pixel_total : 27646 time to create 1 rle with old method : 0.031061172485351562 time for calcul the mask position with numpy : 0.038457632064819336 nb_pixel_total : 10005 time to create 1 rle with old method : 0.01133584976196289 time for calcul the mask position with numpy : 0.02675938606262207 nb_pixel_total : 27808 time to create 1 rle with old method : 0.03415083885192871 time for calcul the mask position with numpy : 0.02539515495300293 nb_pixel_total : 22845 time to create 1 rle with old method : 0.0251619815826416 time for calcul the mask position with numpy : 0.024932384490966797 nb_pixel_total : 63270 time to create 1 rle with old method : 0.06897878646850586 time for calcul the mask position with numpy : 0.025336503982543945 nb_pixel_total : 88506 time to create 1 rle with old method : 0.09844470024108887 time for calcul the mask position with numpy : 0.029737472534179688 nb_pixel_total : 41972 time to create 1 rle with old method : 0.06234431266784668 time for calcul the mask position with numpy : 0.027426958084106445 nb_pixel_total : 18216 time to create 1 rle with old method : 0.020334243774414062 time for calcul the mask position with numpy : 0.026377439498901367 nb_pixel_total : 9567 time to create 1 rle with old method : 0.010731220245361328 time for calcul the mask position with numpy : 0.024966955184936523 nb_pixel_total : 43128 time to create 1 rle with old method : 0.04807758331298828 time for calcul the mask position with numpy : 0.029369592666625977 nb_pixel_total : 188723 time to create 1 rle with new method : 0.9495806694030762 create new chi : 3.0370771884918213 time to delete rle : 0.03022623062133789 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 9044 TO DO : save crop sub photo not yet done ! save time : 0.5790560245513916 nb_obj : 17 nb_hashtags : 2 time to prepare the origin masks : 9.073956966400146 time for calcul the mask position with numpy : 0.814875602722168 nb_pixel_total : 7405517 time to create 1 rle with new method : 0.7684884071350098 time for calcul the mask position with numpy : 0.025836944580078125 nb_pixel_total : 54813 time to create 1 rle with old method : 0.058194637298583984 time for calcul the mask position with numpy : 0.0240933895111084 nb_pixel_total : 61013 time to create 1 rle with old method : 0.06416845321655273 time for calcul the mask position with numpy : 0.023112773895263672 nb_pixel_total : 16867 time to create 1 rle with old method : 0.01813220977783203 time for calcul the mask position with numpy : 0.023581981658935547 nb_pixel_total : 670 time to create 1 rle with old method : 0.0007851123809814453 time for calcul the mask position with numpy : 0.024848222732543945 nb_pixel_total : 14144 time to create 1 rle with old method : 0.01495361328125 time for calcul the mask position with numpy : 0.023883342742919922 nb_pixel_total : 10512 time to create 1 rle with old method : 0.011383056640625 time for calcul the mask position with numpy : 0.024372577667236328 nb_pixel_total : 143225 time to create 1 rle with old method : 0.1517038345336914 time for calcul the mask position with numpy : 0.02347421646118164 nb_pixel_total : 86907 time to create 1 rle with old method : 0.08960509300231934 time for calcul the mask position with numpy : 0.025116920471191406 nb_pixel_total : 45485 time to create 1 rle with old method : 0.047774553298950195 time for calcul the mask position with numpy : 0.023974895477294922 nb_pixel_total : 13607 time to create 1 rle with old method : 0.014272451400756836 time for calcul the mask position with numpy : 0.023065567016601562 nb_pixel_total : 15853 time to create 1 rle with old method : 0.016468524932861328 time for calcul the mask position with numpy : 0.023509979248046875 nb_pixel_total : 37502 time to create 1 rle with old method : 0.0390470027923584 time for calcul the mask position with numpy : 0.025310993194580078 nb_pixel_total : 178845 time to create 1 rle with new method : 1.5270557403564453 time for calcul the mask position with numpy : 0.024173736572265625 nb_pixel_total : 65572 time to create 1 rle with old method : 0.06761431694030762 time for calcul the mask position with numpy : 0.029978513717651367 nb_pixel_total : 31580 time to create 1 rle with old method : 0.03277325630187988 time for calcul the mask position with numpy : 0.034104347229003906 nb_pixel_total : 29985 time to create 1 rle with old method : 0.030942440032958984 time for calcul the mask position with numpy : 0.034769535064697266 nb_pixel_total : 82303 time to create 1 rle with old method : 0.08671808242797852 create new chi : 4.363694190979004 time to delete rle : 0.0017423629760742188 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++++++++++Number RLEs to save : 12235 TO DO : save crop sub photo not yet done ! save time : 0.7155399322509766 nb_obj : 14 nb_hashtags : 2 time to prepare the origin masks : 7.194762945175171 time for calcul the mask position with numpy : 0.7164156436920166 nb_pixel_total : 7698545 time to create 1 rle with new method : 0.8540432453155518 time for calcul the mask position with numpy : 0.039269208908081055 nb_pixel_total : 73665 time to create 1 rle with old method : 0.0800323486328125 time for calcul the mask position with numpy : 0.03985452651977539 nb_pixel_total : 14883 time to create 1 rle with old method : 0.01601123809814453 time for calcul the mask position with numpy : 0.024378299713134766 nb_pixel_total : 42424 time to create 1 rle with old method : 0.050354719161987305 time for calcul the mask position with numpy : 0.03142285346984863 nb_pixel_total : 27107 time to create 1 rle with old method : 0.030843019485473633 time for calcul the mask position with numpy : 0.02485942840576172 nb_pixel_total : 47412 time to create 1 rle with old method : 0.051682233810424805 time for calcul the mask position with numpy : 0.02551579475402832 nb_pixel_total : 130173 time to create 1 rle with old method : 0.14020919799804688 time for calcul the mask position with numpy : 0.026291847229003906 nb_pixel_total : 69605 time to create 1 rle with old method : 0.07573628425598145 time for calcul the mask position with numpy : 0.02528214454650879 nb_pixel_total : 41192 time to create 1 rle with old method : 0.04468989372253418 time for calcul the mask position with numpy : 0.024199247360229492 nb_pixel_total : 30436 time to create 1 rle with old method : 0.032724618911743164 time for calcul the mask position with numpy : 0.02458953857421875 nb_pixel_total : 18126 time to create 1 rle with old method : 0.019812822341918945 time for calcul the mask position with numpy : 0.025556564331054688 nb_pixel_total : 35734 time to create 1 rle with old method : 0.03845095634460449 time for calcul the mask position with numpy : 0.026749372482299805 nb_pixel_total : 26675 time to create 1 rle with old method : 0.03096914291381836 time for calcul the mask position with numpy : 0.02588057518005371 nb_pixel_total : 25240 time to create 1 rle with old method : 0.03170919418334961 time for calcul the mask position with numpy : 0.030503034591674805 nb_pixel_total : 13183 time to create 1 rle with old method : 0.025193452835083008 create new chi : 2.6764605045318604 time to delete rle : 0.0020051002502441406 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 10360 TO DO : save crop sub photo not yet done ! save time : 0.6396975517272949 nb_obj : 16 nb_hashtags : 2 time to prepare the origin masks : 7.558823585510254 time for calcul the mask position with numpy : 0.8708398342132568 nb_pixel_total : 7101753 time to create 1 rle with new method : 0.950951099395752 time for calcul the mask position with numpy : 0.024721860885620117 nb_pixel_total : 41315 time to create 1 rle with old method : 0.044938087463378906 time for calcul the mask position with numpy : 0.02267146110534668 nb_pixel_total : 20078 time to create 1 rle with old method : 0.020806074142456055 time for calcul the mask position with numpy : 0.02348947525024414 nb_pixel_total : 125761 time to create 1 rle with old method : 0.13069987297058105 time for calcul the mask position with numpy : 0.024339675903320312 nb_pixel_total : 18855 time to create 1 rle with old method : 0.019609928131103516 time for calcul the mask position with numpy : 0.02492976188659668 nb_pixel_total : 176680 time to create 1 rle with new method : 1.1235394477844238 time for calcul the mask position with numpy : 0.02605724334716797 nb_pixel_total : 145937 time to create 1 rle with old method : 0.1870555877685547 time for calcul the mask position with numpy : 0.027185440063476562 nb_pixel_total : 164073 time to create 1 rle with new method : 1.0098991394042969 time for calcul the mask position with numpy : 0.025171756744384766 nb_pixel_total : 26795 time to create 1 rle with old method : 0.029367685317993164 time for calcul the mask position with numpy : 0.025027990341186523 nb_pixel_total : 36687 time to create 1 rle with old method : 0.040808916091918945 time for calcul the mask position with numpy : 0.02748394012451172 nb_pixel_total : 36166 time to create 1 rle with old method : 0.040114402770996094 time for calcul the mask position with numpy : 0.026158571243286133 nb_pixel_total : 216218 time to create 1 rle with new method : 0.6940348148345947 time for calcul the mask position with numpy : 0.025832653045654297 nb_pixel_total : 51526 time to create 1 rle with old method : 0.057153940200805664 time for calcul the mask position with numpy : 0.02443861961364746 nb_pixel_total : 13810 time to create 1 rle with old method : 0.015021085739135742 time for calcul the mask position with numpy : 0.025084257125854492 nb_pixel_total : 42997 time to create 1 rle with old method : 0.04603242874145508 time for calcul the mask position with numpy : 0.024276018142700195 nb_pixel_total : 24226 time to create 1 rle with old method : 0.02649664878845215 time for calcul the mask position with numpy : 0.02502751350402832 nb_pixel_total : 51523 time to create 1 rle with old method : 0.05510973930358887 create new chi : 5.885714530944824 time to delete rle : 0.0029718875885009766 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 12862 TO DO : save crop sub photo not yet done ! save time : 0.808424711227417 nb_obj : 24 nb_hashtags : 2 time to prepare the origin masks : 10.929096460342407 time for calcul the mask position with numpy : 0.7985303401947021 nb_pixel_total : 7356222 time to create 1 rle with new method : 0.8327481746673584 time for calcul the mask position with numpy : 0.024324417114257812 nb_pixel_total : 85682 time to create 1 rle with old method : 0.09154295921325684 time for calcul the mask position with numpy : 0.023255348205566406 nb_pixel_total : 37486 time to create 1 rle with old method : 0.03930068016052246 time for calcul the mask position with numpy : 0.02422356605529785 nb_pixel_total : 38228 time to create 1 rle with old method : 0.04101991653442383 time for calcul the mask position with numpy : 0.024190425872802734 nb_pixel_total : 18742 time to create 1 rle with old method : 0.02041316032409668 time for calcul the mask position with numpy : 0.023820161819458008 nb_pixel_total : 39727 time to create 1 rle with old method : 0.042130231857299805 time for calcul the mask position with numpy : 0.024640321731567383 nb_pixel_total : 11374 time to create 1 rle with old method : 0.012544631958007812 time for calcul the mask position with numpy : 0.024697303771972656 nb_pixel_total : 22013 time to create 1 rle with old method : 0.02355051040649414 time for calcul the mask position with numpy : 0.024426698684692383 nb_pixel_total : 13631 time to create 1 rle with old method : 0.015158891677856445 time for calcul the mask position with numpy : 0.028771400451660156 nb_pixel_total : 69574 time to create 1 rle with old method : 0.09411215782165527 time for calcul the mask position with numpy : 0.02586531639099121 nb_pixel_total : 24258 time to create 1 rle with old method : 0.027318716049194336 time for calcul the mask position with numpy : 0.025013446807861328 nb_pixel_total : 9364 time to create 1 rle with old method : 0.010516881942749023 time for calcul the mask position with numpy : 0.024074316024780273 nb_pixel_total : 20389 time to create 1 rle with old method : 0.021948814392089844 time for calcul the mask position with numpy : 0.02397441864013672 nb_pixel_total : 8835 time to create 1 rle with old method : 0.009380578994750977 time for calcul the mask position with numpy : 0.024143457412719727 nb_pixel_total : 19166 time to create 1 rle with old method : 0.02043604850769043 time for calcul the mask position with numpy : 0.02453017234802246 nb_pixel_total : 47632 time to create 1 rle with old method : 0.051970481872558594 time for calcul the mask position with numpy : 0.024983644485473633 nb_pixel_total : 10128 time to create 1 rle with old method : 0.011003971099853516 time for calcul the mask position with numpy : 0.024573802947998047 nb_pixel_total : 8692 time to create 1 rle with old method : 0.00923299789428711 time for calcul the mask position with numpy : 0.024910926818847656 nb_pixel_total : 40370 time to create 1 rle with old method : 0.0428464412689209 time for calcul the mask position with numpy : 0.023676633834838867 nb_pixel_total : 41126 time to create 1 rle with old method : 0.0435335636138916 time for calcul the mask position with numpy : 0.02470684051513672 nb_pixel_total : 56896 time to create 1 rle with old method : 0.06015896797180176 time for calcul the mask position with numpy : 0.02434229850769043 nb_pixel_total : 67285 time to create 1 rle with old method : 0.06915903091430664 time for calcul the mask position with numpy : 0.023761749267578125 nb_pixel_total : 110001 time to create 1 rle with old method : 0.1154170036315918 time for calcul the mask position with numpy : 0.02442169189453125 nb_pixel_total : 45781 time to create 1 rle with old method : 0.048989295959472656 time for calcul the mask position with numpy : 0.024788379669189453 nb_pixel_total : 91798 time to create 1 rle with old method : 0.09971451759338379 create new chi : 3.285844564437866 time to delete rle : 0.002114534378051758 batch 1 Loaded 49 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++Number RLEs to save : 15931 TO DO : save crop sub photo not yet done ! save time : 0.9384784698486328 nb_obj : 29 nb_hashtags : 3 time to prepare the origin masks : 4.458986520767212 time for calcul the mask position with numpy : 0.8131814002990723 nb_pixel_total : 6844559 time to create 1 rle with new method : 1.7580044269561768 time for calcul the mask position with numpy : 0.03536796569824219 nb_pixel_total : 19443 time to create 1 rle with old method : 0.023004770278930664 time for calcul the mask position with numpy : 0.035504817962646484 nb_pixel_total : 34736 time to create 1 rle with old method : 0.04312443733215332 time for calcul the mask position with numpy : 0.0364232063293457 nb_pixel_total : 20154 time to create 1 rle with old method : 0.023835182189941406 time for calcul the mask position with numpy : 0.039656877517700195 nb_pixel_total : 72765 time to create 1 rle with old method : 0.09118437767028809 time for calcul the mask position with numpy : 0.03612256050109863 nb_pixel_total : 43688 time to create 1 rle with old method : 0.06815719604492188 time for calcul the mask position with numpy : 0.03437376022338867 nb_pixel_total : 34767 time to create 1 rle with old method : 0.039026737213134766 time for calcul the mask position with numpy : 0.03399014472961426 nb_pixel_total : 35395 time to create 1 rle with old method : 0.03855133056640625 time for calcul the mask position with numpy : 0.034018754959106445 nb_pixel_total : 119069 time to create 1 rle with old method : 0.13116979598999023 time for calcul the mask position with numpy : 0.03365778923034668 nb_pixel_total : 39028 time to create 1 rle with old method : 0.04268598556518555 time for calcul the mask position with numpy : 0.033615827560424805 nb_pixel_total : 15481 time to create 1 rle with old method : 0.017157793045043945 time for calcul the mask position with numpy : 0.033319950103759766 nb_pixel_total : 21540 time to create 1 rle with old method : 0.03385281562805176 time for calcul the mask position with numpy : 0.03861832618713379 nb_pixel_total : 54063 time to create 1 rle with old method : 0.0647580623626709 time for calcul the mask position with numpy : 0.03809928894042969 nb_pixel_total : 13718 time to create 1 rle with old method : 0.015414237976074219 time for calcul the mask position with numpy : 0.035181283950805664 nb_pixel_total : 207409 time to create 1 rle with new method : 0.9150712490081787 time for calcul the mask position with numpy : 0.03413510322570801 nb_pixel_total : 77516 time to create 1 rle with old method : 0.08595633506774902 time for calcul the mask position with numpy : 0.03396153450012207 nb_pixel_total : 21502 time to create 1 rle with old method : 0.023972749710083008 time for calcul the mask position with numpy : 0.03388619422912598 nb_pixel_total : 35416 time to create 1 rle with old method : 0.038781166076660156 time for calcul the mask position with numpy : 0.03439068794250488 nb_pixel_total : 30037 time to create 1 rle with old method : 0.03306388854980469 time for calcul the mask position with numpy : 0.03487229347229004 nb_pixel_total : 18596 time to create 1 rle with old method : 0.029705047607421875 time for calcul the mask position with numpy : 0.03844046592712402 nb_pixel_total : 33804 time to create 1 rle with old method : 0.03801894187927246 time for calcul the mask position with numpy : 0.03439021110534668 nb_pixel_total : 14934 time to create 1 rle with old method : 0.018523454666137695 time for calcul the mask position with numpy : 0.03426241874694824 nb_pixel_total : 12263 time to create 1 rle with old method : 0.013899803161621094 time for calcul the mask position with numpy : 0.03451895713806152 nb_pixel_total : 62347 time to create 1 rle with old method : 0.07033061981201172 time for calcul the mask position with numpy : 0.034310340881347656 nb_pixel_total : 36172 time to create 1 rle with old method : 0.04046177864074707 time for calcul the mask position with numpy : 0.033861637115478516 nb_pixel_total : 19226 time to create 1 rle with old method : 0.021680593490600586 time for calcul the mask position with numpy : 0.03471207618713379 nb_pixel_total : 237572 time to create 1 rle with new method : 0.9905614852905273 time for calcul the mask position with numpy : 0.03547930717468262 nb_pixel_total : 72322 time to create 1 rle with old method : 0.07822751998901367 time for calcul the mask position with numpy : 0.033777713775634766 nb_pixel_total : 16770 time to create 1 rle with old method : 0.018114089965820312 time for calcul the mask position with numpy : 0.0336146354675293 nb_pixel_total : 30108 time to create 1 rle with old method : 0.033130645751953125 create new chi : 6.760239601135254 time to delete rle : 0.002526521682739258 batch 1 Loaded 59 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 18382 TO DO : save crop sub photo not yet done ! save time : 1.1363272666931152 nb_obj : 16 nb_hashtags : 1 time to prepare the origin masks : 7.7716920375823975 time for calcul the mask position with numpy : 0.6559844017028809 nb_pixel_total : 7099229 time to create 1 rle with new method : 0.8649539947509766 time for calcul the mask position with numpy : 0.04152393341064453 nb_pixel_total : 31389 time to create 1 rle with old method : 0.03461933135986328 time for calcul the mask position with numpy : 0.042311668395996094 nb_pixel_total : 260141 time to create 1 rle with new method : 0.8961687088012695 time for calcul the mask position with numpy : 0.040351152420043945 nb_pixel_total : 25195 time to create 1 rle with old method : 0.02748394012451172 time for calcul the mask position with numpy : 0.04058074951171875 nb_pixel_total : 98117 time to create 1 rle with old method : 0.13442540168762207 time for calcul the mask position with numpy : 0.04107308387756348 nb_pixel_total : 72161 time to create 1 rle with old method : 0.08238697052001953 time for calcul the mask position with numpy : 0.0412752628326416 nb_pixel_total : 7889 time to create 1 rle with old method : 0.00897979736328125 time for calcul the mask position with numpy : 0.04136943817138672 nb_pixel_total : 7530 time to create 1 rle with old method : 0.008519887924194336 time for calcul the mask position with numpy : 0.04134821891784668 nb_pixel_total : 28463 time to create 1 rle with old method : 0.03187680244445801 time for calcul the mask position with numpy : 0.04084920883178711 nb_pixel_total : 65770 time to create 1 rle with old method : 0.0713200569152832 time for calcul the mask position with numpy : 0.04171895980834961 nb_pixel_total : 84825 time to create 1 rle with old method : 0.0926198959350586 time for calcul the mask position with numpy : 0.03974103927612305 nb_pixel_total : 61204 time to create 1 rle with old method : 0.06622862815856934 time for calcul the mask position with numpy : 0.04087543487548828 nb_pixel_total : 224864 time to create 1 rle with new method : 0.550816535949707 time for calcul the mask position with numpy : 0.040582895278930664 nb_pixel_total : 25973 time to create 1 rle with old method : 0.0282745361328125 time for calcul the mask position with numpy : 0.03905034065246582 nb_pixel_total : 49977 time to create 1 rle with old method : 0.05396246910095215 time for calcul the mask position with numpy : 0.03961062431335449 nb_pixel_total : 79171 time to create 1 rle with old method : 0.0840291976928711 time for calcul the mask position with numpy : 0.03968548774719238 nb_pixel_total : 72502 time to create 1 rle with old method : 0.07721161842346191 create new chi : 4.519571304321289 time to delete rle : 0.0030739307403564453 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 13372 TO DO : save crop sub photo not yet done ! save time : 0.8682403564453125 map_output_result : {1371674778: (0.0, 'Should be the crop_list due to order', 0), 1371674767: (0.0, 'Should be the crop_list due to order', 0), 1371674757: (0.0, 'Should be the crop_list due to order', 0), 1371674742: (0.0, 'Should be the crop_list due to order', 0), 1371674738: (0.0, 'Should be the crop_list due to order', 0), 1371674734: (0.0, 'Should be the crop_list due to order', 0), 1371674731: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1371674778, 1371674767, 1371674757, 1371674742, 1371674738, 1371674734, 1371674731] Looping around the photos to save general results len do output : 7 /1371674778.Didn't retrieve data . /1371674767.Didn't retrieve data . /1371674757.Didn't retrieve data . /1371674742.Didn't retrieve data . /1371674738.Didn't retrieve data . /1371674734.Didn't retrieve data . /1371674731.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674778', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674767', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674757', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674742', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674738', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674734', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674731', None, None, None, None, None, '3273388') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.016654014587402344 save_final save missing photos in datou_result : time spend for datou_step_exec : 90.44960522651672 time spend to save output : 0.0169980525970459 total time spend for step 3 : 90.46660327911377 step4:ventilate_hashtags_in_portfolio Fri Jul 11 22:44:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 24858050 get user id for portfolio 24858050 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24858050 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','pet_fonce','background','pehd','metal','pet_clair','autre','papier','environnement','mal_croppe','flou')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24858050 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','pet_fonce','background','pehd','metal','pet_clair','autre','papier','environnement','mal_croppe','flou')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24858050 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','pet_fonce','background','pehd','metal','pet_clair','autre','papier','environnement','mal_croppe','flou')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/24858774,24858775,24858776,24858777,24858778,24858779,24858780,24858781,24858782,24858783,24858784?tags=carton,pet_fonce,background,pehd,metal,pet_clair,autre,papier,environnement,mal_croppe,flou Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1371674778, 1371674767, 1371674757, 1371674742, 1371674738, 1371674734, 1371674731] Looping around the photos to save general results len do output : 1 /24858050. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674778', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674767', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674757', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674742', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674738', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674734', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674731', None, None, None, None, None, '3273388') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.012740373611450195 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.742156744003296 time spend to save output : 0.012993097305297852 total time spend for step 4 : 1.7551498413085938 step5:final Fri Jul 11 22:44:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1371674778: ('0.11715754863866847',), 1371674767: ('0.11715754863866847',), 1371674757: ('0.11715754863866847',), 1371674742: ('0.11715754863866847',), 1371674738: ('0.11715754863866847',), 1371674734: ('0.11715754863866847',), 1371674731: ('0.11715754863866847',)} new output for save of step final : {1371674778: ('0.11715754863866847',), 1371674767: ('0.11715754863866847',), 1371674757: ('0.11715754863866847',), 1371674742: ('0.11715754863866847',), 1371674738: ('0.11715754863866847',), 1371674734: ('0.11715754863866847',), 1371674731: ('0.11715754863866847',)} [1371674778, 1371674767, 1371674757, 1371674742, 1371674738, 1371674734, 1371674731] Looping around the photos to save general results len do output : 7 /1371674778.Didn't retrieve data . /1371674767.Didn't retrieve data . /1371674757.Didn't retrieve data . /1371674742.Didn't retrieve data . /1371674738.Didn't retrieve data . /1371674734.Didn't retrieve data . /1371674731.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674778', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674767', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674757', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674742', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674738', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674734', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674731', None, None, None, None, None, '3273388') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.013947725296020508 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.14703083038330078 time spend to save output : 0.014395713806152344 total time spend for step 5 : 0.16142654418945312 step6:blur_detection Fri Jul 11 22:44:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1752266429_555626_1371674778_ea3b6d9a80d4c07eb4242bd534df6c0b.jpg resize: (2160, 3840) 1371674778 -7.261359238065953 treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e.jpg resize: (2160, 3840) 1371674767 -7.169835542637288 treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930.jpg resize: (2160, 3840) 1371674757 -7.265769304720511 treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5.jpg resize: (2160, 3840) 1371674742 -7.162313052229592 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657.jpg resize: (2160, 3840) 1371674738 -7.19260514103357 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96.jpg resize: (2160, 3840) 1371674734 -7.251914383756612 treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5.jpg resize: (2160, 3840) 1371674731 -7.215612025256307 treat image : temp/1752266429_555626_1371674778_ea3b6d9a80d4c07eb4242bd534df6c0b_rle_crop_3880424149_0.png resize: (541, 580) 1371703275 -4.6563438761458205 treat image : temp/1752266429_555626_1371674778_ea3b6d9a80d4c07eb4242bd534df6c0b_rle_crop_3880424150_0.png resize: (207, 291) 1371703276 -0.8697497369005721 treat image : temp/1752266429_555626_1371674778_ea3b6d9a80d4c07eb4242bd534df6c0b_rle_crop_3880424151_0.png resize: (127, 105) 1371703277 -2.176193932276582 treat image : temp/1752266429_555626_1371674778_ea3b6d9a80d4c07eb4242bd534df6c0b_rle_crop_3880424152_0.png resize: (532, 135) 1371703278 -2.161310417518784 treat image : temp/1752266429_555626_1371674778_ea3b6d9a80d4c07eb4242bd534df6c0b_rle_crop_3880424155_0.png resize: (288, 332) 1371703279 -3.151322949243275 treat image : temp/1752266429_555626_1371674778_ea3b6d9a80d4c07eb4242bd534df6c0b_rle_crop_3880424156_0.png resize: (243, 122) 1371703281 -4.906912108479942 treat image : temp/1752266429_555626_1371674778_ea3b6d9a80d4c07eb4242bd534df6c0b_rle_crop_3880424158_0.png resize: (101, 146) 1371703282 -1.2373681783357937 treat image : temp/1752266429_555626_1371674778_ea3b6d9a80d4c07eb4242bd534df6c0b_rle_crop_3880424159_0.png resize: (161, 280) 1371703283 -4.316371797955256 treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424160_0.png resize: (413, 324) 1371703284 -3.2799270456458527 treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424161_0.png resize: (245, 169) 1371703285 0.12197403114736764 treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424162_0.png resize: (280, 154) 1371703286 -0.5774718641460104 treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424163_0.png resize: (437, 197) 1371703287 -4.466603430856086 treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424164_0.png resize: (317, 839) 1371703288 -5.427945984618824 treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424167_0.png resize: (190, 117) 1371703289 -4.481497955124468 treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424168_0.png resize: (190, 321) 1371703290 -0.37005914587176536 treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424169_0.png resize: (372, 306) 1371703291 -0.13962436292097888 treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424170_0.png resize: (474, 481) 1371703292 -2.3686062972241855 treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424171_0.png resize: (134, 102) 1371703293 -3.43557979157872 treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424173_0.png resize: (125, 143) 1371703294 -5.16666737379737 treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424174_0.png resize: (171, 245) 1371703295 -1.5286522647610987 treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424175_0.png resize: (318, 322) 1371703296 0.5999385579263218 treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424176_0.png resize: (225, 363) 1371703297 3.440040926173733 treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424177_0.png resize: (133, 128) 1371703298 -4.133884466548857 treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424178_0.png resize: (289, 171) 1371703299 -3.8597163550514546 treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424180_0.png resize: (211, 263) 1371703300 -3.201572748199333 treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424181_0.png resize: (311, 112) 1371703301 -4.007297108183125 treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424182_0.png resize: (122, 353) 1371703302 -3.580794278152797 treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424184_0.png resize: (307, 377) 1371703303 -5.128272987461488 treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424188_0.png resize: (256, 264) 1371703304 1.4244052082267247 treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424189_0.png resize: (180, 109) 1371703305 0.015813555857656574 treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424190_0.png resize: (538, 197) 1371703306 -1.906666594454252 treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424192_0.png resize: (297, 109) 1371703307 -2.298087066396179 treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424193_0.png resize: (200, 275) 1371703308 -4.1568812799726595 treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424194_0.png resize: (109, 203) 1371703309 -1.9679385396777895 treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424195_0.png resize: (273, 354) 1371703310 -3.3681277113818577 treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424196_0.png resize: (654, 585) 1371703311 -3.8605969398151836 treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424198_0.png resize: (198, 210) 1371703312 -3.689596080570366 treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424199_0.png resize: (246, 130) 1371703313 -4.510596776212601 treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424200_0.png resize: (396, 571) 1371703314 -4.8909172637361875 treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424201_0.png resize: (269, 676) 1371703315 -1.6718338860269961 treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424202_0.png resize: (566, 461) 1371703316 -2.937986864615842 treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424203_0.png resize: (172, 203) 1371703317 0.34749448483512235 treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424204_0.png resize: (552, 551) 1371703318 -0.9280720628850534 treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424206_0.png resize: (229, 381) 1371703319 -4.353639587117843 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424207_0.png resize: (462, 324) 1371703320 -1.812239130903952 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424208_0.png resize: (275, 239) 1371703321 -2.67005771490325 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424209_0.png resize: (400, 455) 1371703322 1.6344267358103752 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424210_0.png resize: (362, 332) 1371703323 -4.144063445983745 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424211_0.png resize: (283, 329) 1371703324 3.495039670244484 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424213_0.png resize: (272, 273) 1371703325 -0.31778231130246354 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424214_0.png resize: (95, 150) 1371703326 -4.131392886640384 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424215_0.png resize: (94, 126) 1371703327 -3.585896466241149 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424216_0.png resize: (298, 246) 1371703328 -2.9002753104635133 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424217_0.png resize: (153, 191) 1371703329 -3.357841006979116 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424218_0.png resize: (110, 134) 1371703330 -4.833529673381071 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424219_0.png resize: (197, 155) 1371703331 -3.969273407409483 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424220_0.png resize: (75, 145) 1371703332 -3.186444852848078 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424221_0.png resize: (200, 204) 1371703333 -3.593548699891768 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424222_0.png resize: (359, 281) 1371703334 -2.1549462796802286 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424223_0.png resize: (109, 177) 1371703335 -4.020247747300534 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424224_0.png resize: (269, 95) 1371703336 -1.315026002966619 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424225_0.png resize: (129, 207) 1371703337 -4.161201373692005 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424226_0.png resize: (229, 288) 1371703338 -3.999236199706195 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424227_0.png resize: (118, 236) 1371703339 -3.3376709003707608 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424228_0.png resize: (216, 271) 1371703340 -4.835123656229534 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424229_0.png resize: (254, 241) 1371703341 -1.9337594751726834 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424230_0.png resize: (473, 451) 1371703342 -3.4011960834200954 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424232_0.png resize: (378, 293) 1371703343 -1.5818507289346713 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424233_0.png resize: (173, 127) 1371703344 -2.3265621117168744 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424234_0.png resize: (294, 175) 1371703345 -1.9447062977009857 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424235_0.png resize: (351, 338) 1371703347 0.9833420367206039 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424236_0.png resize: (170, 163) 1371703348 -2.6428365442953776 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424237_0.png resize: (250, 226) 1371703349 -3.542135681950746 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424238_0.png resize: (637, 277) 1371703350 -3.526365134641948 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424239_0.png resize: (458, 110) 1371703351 -3.7739978828521252 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424240_0.png resize: (191, 172) 1371703352 -2.5711996559124795 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424242_0.png resize: (117, 195) 1371703353 -4.116513741538232 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424243_0.png resize: (105, 255) 1371703354 -3.4948418273586825 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424244_0.png resize: (118, 213) 1371703355 -1.1017377312533754 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424245_0.png resize: (108, 153) 1371703356 -2.9301699717233753 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424246_0.png resize: (153, 321) 1371703357 -3.8353806662302197 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424247_0.png resize: (218, 278) 1371703358 0.18741878296149242 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424248_0.png resize: (111, 231) 1371703359 -3.2479077274971377 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424249_0.png resize: (183, 173) 1371703361 -3.9196608279337366 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424250_0.png resize: (425, 310) 1371703362 -2.608155539543238 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424251_0.png resize: (417, 274) 1371703363 -1.822152034533403 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424252_0.png resize: (359, 176) 1371703365 -2.1808680517547545 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424253_0.png resize: (363, 206) 1371703366 -2.472225632933582 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424256_0.png resize: (492, 706) 1371703367 2.1706027528634673 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424258_0.png resize: (118, 357) 1371703368 -3.293956393369506 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424259_0.png resize: (162, 193) 1371703370 -4.506728839473869 treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424260_0.png resize: (389, 310) 1371703371 -2.932803618783406 treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424261_0.png resize: (255, 461) 1371703372 -3.8639538261192263 treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424262_0.png resize: (190, 365) 1371703374 -1.7735730743088514 treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424263_0.png resize: (258, 186) 1371703375 -2.997312426359998 treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424264_0.png resize: (447, 736) 1371703376 -3.905595160913814 treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424265_0.png resize: (327, 316) 1371703378 -3.4263001571670513 treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424266_0.png resize: (405, 291) 1371703379 3.721610384744079 treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424267_0.png resize: (456, 258) 1371703380 -5.173429792742993 treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424268_0.png resize: (237, 195) 1371703382 -4.3289569968621215 treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424269_0.png resize: (122, 93) 1371703383 -1.5659976774680744 treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424270_0.png resize: (107, 103) 1371703384 -1.1393734382380194 treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424271_0.png resize: (466, 202) 1371703386 -4.498740645235057 treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424272_0.png resize: (254, 551) 1371703387 -4.510392159084131 treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424273_0.png resize: (236, 128) 1371703388 -4.5227493464286335 treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424274_0.png resize: (646, 639) 1371703389 -1.2314497095583026 treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424275_0.png resize: (273, 178) 1371703391 -1.7949871772275863 treat image : temp/1752266429_555626_1371674778_ea3b6d9a80d4c07eb4242bd534df6c0b_rle_crop_3880424153_0.png resize: (305, 177) 1371703469 -5.296507593314107 treat image : temp/1752266429_555626_1371674778_ea3b6d9a80d4c07eb4242bd534df6c0b_rle_crop_3880424157_0.png resize: (150, 241) 1371703470 -3.864479377114042 treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424165_0.png resize: (353, 156) 1371703471 -4.5948611683247185 treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424166_0.png resize: (198, 101) 1371703473 -3.732071465018631 treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424172_0.png resize: (123, 148) 1371703474 -4.9396147154248755 treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424179_0.png resize: (214, 205) 1371703475 -4.239934114864667 treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424183_0.png resize: (250, 239) 1371703477 -4.618414624264671 treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424185_0.png resize: (436, 597) 1371703478 -3.2833898162827624 treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424186_0.png resize: (218, 328) 1371703479 -4.690144475885252 treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424187_0.png resize: (207, 217) 1371703481 -3.7341148363539522 treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424191_0.png resize: (265, 254) 1371703483 -4.677600526320481 treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424197_0.png resize: (189, 273) 1371703484 -4.170163804381133 treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424205_0.png resize: (240, 116) 1371703486 -2.230684329853521 treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424212_0.png resize: (415, 161) 1371703488 -5.108097112522747 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424231_0.png resize: (166, 294) 1371703489 -3.857486711338838 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424241_0.png resize: (582, 669) 1371703490 -3.534828725708605 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424254_0.png resize: (178, 102) 1371703492 -2.2474692563705787 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424257_0.png resize: (255, 191) 1371703493 -4.663434771075102 treat image : temp/1752266429_555626_1371674778_ea3b6d9a80d4c07eb4242bd534df6c0b_rle_crop_3880424154_0.png resize: (349, 307) 1371703511 -5.214064912451707 treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424255_0.png resize: (258, 472) 1371703513 -4.330055371054128 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 134 time used for this insertion : 0.015886783599853516 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 134 time used for this insertion : 0.029412269592285156 save missing photos in datou_result : time spend for datou_step_exec : 32.98021674156189 time spend to save output : 0.05043292045593262 total time spend for step 6 : 33.03064966201782 step7:brightness Fri Jul 11 22:44:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1752266429_555626_1371674778_ea3b6d9a80d4c07eb4242bd534df6c0b.jpg treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e.jpg treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930.jpg treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5.jpg treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657.jpg treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96.jpg treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5.jpg treat image : temp/1752266429_555626_1371674778_ea3b6d9a80d4c07eb4242bd534df6c0b_rle_crop_3880424149_0.png treat image : temp/1752266429_555626_1371674778_ea3b6d9a80d4c07eb4242bd534df6c0b_rle_crop_3880424150_0.png treat image : temp/1752266429_555626_1371674778_ea3b6d9a80d4c07eb4242bd534df6c0b_rle_crop_3880424151_0.png treat image : temp/1752266429_555626_1371674778_ea3b6d9a80d4c07eb4242bd534df6c0b_rle_crop_3880424152_0.png treat image : temp/1752266429_555626_1371674778_ea3b6d9a80d4c07eb4242bd534df6c0b_rle_crop_3880424155_0.png treat image : temp/1752266429_555626_1371674778_ea3b6d9a80d4c07eb4242bd534df6c0b_rle_crop_3880424156_0.png treat image : temp/1752266429_555626_1371674778_ea3b6d9a80d4c07eb4242bd534df6c0b_rle_crop_3880424158_0.png treat image : temp/1752266429_555626_1371674778_ea3b6d9a80d4c07eb4242bd534df6c0b_rle_crop_3880424159_0.png treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424160_0.png treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424161_0.png treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424162_0.png treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424163_0.png treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424164_0.png treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424167_0.png treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424168_0.png treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424169_0.png treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424170_0.png treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424171_0.png treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424173_0.png treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424174_0.png treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424175_0.png treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424176_0.png treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424177_0.png treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424178_0.png treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424180_0.png treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424181_0.png treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424182_0.png treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424184_0.png treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424188_0.png treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424189_0.png treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424190_0.png treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424192_0.png treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424193_0.png treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424194_0.png treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424195_0.png treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424196_0.png treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424198_0.png treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424199_0.png treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424200_0.png treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424201_0.png treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424202_0.png treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424203_0.png treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424204_0.png treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424206_0.png treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424207_0.png treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424208_0.png treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424209_0.png treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424210_0.png treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424211_0.png treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424213_0.png treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424214_0.png treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424215_0.png treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424216_0.png treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424217_0.png treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424218_0.png treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424219_0.png treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424220_0.png treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424221_0.png treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424222_0.png treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424223_0.png treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424224_0.png treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424225_0.png treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424226_0.png treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424227_0.png treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424228_0.png treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424229_0.png treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424230_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424232_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424233_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424234_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424235_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424236_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424237_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424238_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424239_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424240_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424242_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424243_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424244_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424245_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424246_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424247_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424248_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424249_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424250_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424251_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424252_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424253_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424256_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424258_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424259_0.png treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424260_0.png treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424261_0.png treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424262_0.png treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424263_0.png treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424264_0.png treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424265_0.png treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424266_0.png treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424267_0.png treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424268_0.png treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424269_0.png treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424270_0.png treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424271_0.png treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424272_0.png treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424273_0.png treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424274_0.png treat image : temp/1752266429_555626_1371674731_84abf59cbe6e745d7587d7acdca2bec5_rle_crop_3880424275_0.png treat image : temp/1752266429_555626_1371674778_ea3b6d9a80d4c07eb4242bd534df6c0b_rle_crop_3880424153_0.png treat image : temp/1752266429_555626_1371674778_ea3b6d9a80d4c07eb4242bd534df6c0b_rle_crop_3880424157_0.png treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424165_0.png treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424166_0.png treat image : temp/1752266429_555626_1371674767_e9f48e9da0004c0a72b37a428cc6f33e_rle_crop_3880424172_0.png treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424179_0.png treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424183_0.png treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424185_0.png treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424186_0.png treat image : temp/1752266429_555626_1371674757_cc58cd79c6176620c779bcd997aa5930_rle_crop_3880424187_0.png treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424191_0.png treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424197_0.png treat image : temp/1752266429_555626_1371674742_a4de50e4af6b8e4f749f2c633ef20aa5_rle_crop_3880424205_0.png treat image : temp/1752266429_555626_1371674738_637bda4f76c1b16966211ffe3c458657_rle_crop_3880424212_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424231_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424241_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424254_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424257_0.png treat image : temp/1752266429_555626_1371674778_ea3b6d9a80d4c07eb4242bd534df6c0b_rle_crop_3880424154_0.png treat image : temp/1752266429_555626_1371674734_a8ae68b53837275e7ed79503a1873d96_rle_crop_3880424255_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 134 time used for this insertion : 0.018595457077026367 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 134 time used for this insertion : 0.031014680862426758 save missing photos in datou_result : time spend for datou_step_exec : 8.524003744125366 time spend to save output : 0.05460000038146973 total time spend for step 7 : 8.578603744506836 step8:velours_tree Fri Jul 11 22:45:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09203457832336426 time spend to save output : 4.57763671875e-05 total time spend for step 8 : 0.09208035469055176 step9:send_mail_cod Fri Jul 11 22:45:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P24858050_11-07-2025_22_45_05.pdf 24858774 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette248587741752266705 24858775 imagette248587751752266707 24858776 imagette248587761752266707 24858777 imagette248587771752266707 24858778 imagette248587781752266707 24858779 change filename to text .change filename to text .imagette248587791752266707 24858780 imagette248587801752266707 24858781 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette248587811752266707 24858783 imagette248587831752266708 24858784 imagette248587841752266708 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=24858050 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/24858774,24858775,24858776,24858777,24858778,24858779,24858780,24858781,24858782,24858783,24858784?tags=carton,pet_fonce,background,pehd,metal,pet_clair,autre,papier,environnement,mal_croppe,flou args[1371674778] : ((1371674778, -7.261359238065953, 492609224), (1371674778, 1.3895979952205229, 2107752395), '0.11715754863866847') We are sending mail with results at report@fotonower.com args[1371674767] : ((1371674767, -7.169835542637288, 492609224), (1371674767, 1.4521887753732534, 2107752395), '0.11715754863866847') We are sending mail with results at report@fotonower.com args[1371674757] : ((1371674757, -7.265769304720511, 492609224), (1371674757, 1.269515281966979, 2107752395), '0.11715754863866847') We are sending mail with results at report@fotonower.com args[1371674742] : ((1371674742, -7.162313052229592, 492609224), (1371674742, 1.786972049289914, 2107752395), '0.11715754863866847') We are sending mail with results at report@fotonower.com args[1371674738] : ((1371674738, -7.19260514103357, 492609224), (1371674738, 1.6817119662521323, 2107752395), '0.11715754863866847') We are sending mail with results at report@fotonower.com args[1371674734] : ((1371674734, -7.251914383756612, 492609224), (1371674734, 1.5182076772720488, 2107752395), '0.11715754863866847') We are sending mail with results at report@fotonower.com args[1371674731] : ((1371674731, -7.215612025256307, 492609224), (1371674731, 1.1519920785322995, 2107752395), '0.11715754863866847') We are sending mail with results at report@fotonower.com refus_total : 0.11715754863866847 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=24858050 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24858050_11-07-2025_22_45_05.pdf results_Auto_P24858050_11-07-2025_22_45_05.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24858050_11-07-2025_22_45_05.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','24858050','results_Auto_P24858050_11-07-2025_22_45_05.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24858050_11-07-2025_22_45_05.pdf','pdf','','0.51','0.11715754863866847') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/24858050

https://www.fotonower.com/image?json=false&list_photos_id=1371674778
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1371674767
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1371674757
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1371674742
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1371674738
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1371674734
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1371674731
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 11.72%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/24858774?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/24858779?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/24858781?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24858050_11-07-2025_22_45_05.pdf.

Lien vers velours :https://www.fotonower.com/velours/24858774,24858775,24858776,24858777,24858778,24858779,24858780,24858781,24858782,24858783,24858784?tags=carton,pet_fonce,background,pehd,metal,pet_clair,autre,papier,environnement,mal_croppe,flou.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 11 Jul 2025 20:45:11 GMT Content-Length: 0 Connection: close X-Message-Id: oqwxWN6xRiWySm0Ov-Kn8g Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1371674778, 1371674767, 1371674757, 1371674742, 1371674738, 1371674734, 1371674731] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674778', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674767', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674757', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674742', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674738', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674734', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674731', None, None, None, None, None, '3273388') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.015005826950073242 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.765127897262573 time spend to save output : 0.015157222747802734 total time spend for step 9 : 5.780285120010376 step10:split_time_score Fri Jul 11 22:45:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('14', 7),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 11072025 24858050 Nombre de photos uploadées : 7 / 23040 (0%) 11072025 24858050 Nombre de photos taguées (types de déchets): 0 / 7 (0%) 11072025 24858050 Nombre de photos taguées (volume) : 0 / 7 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 4.76837158203125e-06 ??????? elapsed_time : fill_and_build_computed_from_old_data 0.00038814544677734375 elapsed_time : insert_dashboard_record_day_entry 0.02358388900756836 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.08246149543117659 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24846971_11-07-2025_18_11_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24846971 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24846971 AND mptpi.`type`=3726 To do Qualite : 0.037840879617694834 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24851563_11-07-2025_20_13_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24851563 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24851563 AND mptpi.`type`=3726 To do Qualite : 0.025590217689852927 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24851595_11-07-2025_20_22_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24851595 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24851595 AND mptpi.`type`=3726 To do Qualite : 0.03369315183910076 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24854815_11-07-2025_21_42_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24854815 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24854815 AND mptpi.`type`=3726 To do Qualite : 0.15770577739197536 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24854816_11-07-2025_21_54_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24854816 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24854816 AND mptpi.`type`=3594 To do Qualite : 0.11715754863866847 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P24858050_11-07-2025_22_45_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 24858050 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24858050 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'11072025': {'nb_upload': 7, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1371674778, 1371674767, 1371674757, 1371674742, 1371674738, 1371674734, 1371674731] Looping around the photos to save general results len do output : 1 /24858050Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674778', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674767', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674757', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674742', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674738', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674734', None, None, None, None, None, '3273388') ('3318', None, None, None, None, None, None, None, '3273388') ('3318', '24858050', '1371674731', None, None, None, None, None, '3273388') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.015066146850585938 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.5400094985961914 time spend to save output : 0.015310049057006836 total time spend for step 10 : 0.5553195476531982 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 7 set_done_treatment 123.91user 121.93system 4:47.09elapsed 85%CPU (0avgtext+0avgdata 5062096maxresident)k 369672inputs+95920outputs (3062major+12203905minor)pagefaults 0swaps