python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1088271 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3629933'] with mtr_portfolio_ids : ['26310895'] and first list_photo_ids : [] new path : /proc/1088271/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 29 ; length of list_pids : 29 ; length of list_args : 29 time to download the photos : 6.336468935012817 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Aug 29 00:40:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10605 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-29 00:40:36.105216: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-29 00:40:36.132502: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-29 00:40:36.134423: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f9408000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-29 00:40:36.134453: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-29 00:40:36.138403: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-29 00:40:36.244071: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1a51d7a0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-29 00:40:36.244128: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-29 00:40:36.245404: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-29 00:40:36.245846: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-29 00:40:36.248978: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-29 00:40:36.251879: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-29 00:40:36.252433: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-29 00:40:36.254868: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-29 00:40:36.255861: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-29 00:40:36.260065: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-29 00:40:36.261585: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-29 00:40:36.261659: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-29 00:40:36.262400: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-29 00:40:36.262415: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-29 00:40:36.262423: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-29 00:40:36.263717: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9535 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-29 00:40:36.519116: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-29 00:40:36.519278: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-29 00:40:36.519309: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-29 00:40:36.519337: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-29 00:40:36.519364: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-29 00:40:36.519390: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-29 00:40:36.519416: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-29 00:40:36.519443: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-29 00:40:36.521264: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-29 00:40:36.522696: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-29 00:40:36.522737: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-29 00:40:36.522755: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-29 00:40:36.522773: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-29 00:40:36.522790: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-29 00:40:36.522806: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-29 00:40:36.522821: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-29 00:40:36.522836: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-29 00:40:36.523980: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-29 00:40:36.524015: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-29 00:40:36.524023: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-29 00:40:36.524030: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-29 00:40:36.525300: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9535 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-29 00:40:46.121785: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-29 00:40:46.356644: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-29 00:40:48.101094: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.101702: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.102248: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.102760: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.103271: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.103783: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.104300: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.104333: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-29 00:40:48.104911: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.104927: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-29 00:40:48.116633: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.116663: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-29 00:40:48.117221: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.117237: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-29 00:40:48.127591: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.127646: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-29 00:40:48.128170: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.128185: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-29 00:40:48.163708: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.163750: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-29 00:40:48.164277: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.164293: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-29 00:40:48.173030: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.173053: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-29 00:40:48.173610: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.173626: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-08-29 00:40:48.211411: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.212053: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.218626: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.219261: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.255995: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.256648: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.258623: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.259203: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.290716: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.291335: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.292875: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.293443: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.298946: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.299521: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.301206: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.301779: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.307598: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.308192: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.309814: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.310384: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.338035: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.338643: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.339208: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.339773: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.343442: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.344028: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.366472: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.367074: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.367628: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.368179: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.382941: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.383546: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.384096: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.384660: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.391459: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.392054: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.396992: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.397574: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.411583: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.412171: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.422476: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.423079: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.423631: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.424180: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.425099: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.425657: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.436646: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.437255: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.437875: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.438447: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.439018: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.439573: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.440147: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.440731: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.450302: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.450904: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.457367: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.457948: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.516190: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.516814: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.525007: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.525573: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.542718: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.543615: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.544504: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.545420: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.550129: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.551055: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.551972: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.552903: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.554760: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.554788: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-08-29 00:40:48.567559: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.568620: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.580277: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.580872: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.581455: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.581997: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.582524: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-08-29 00:40:48.583036: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 29 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 13.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 Detection mask done ! Trying to reset tf kernel 1089162 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 662 tf kernel not reseted sub process len(results) : 29 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 29 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3048 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0021708011627197266 nb_pixel_total : 93410 time to create 1 rle with old method : 0.10051417350769043 length of segment : 535 time for calcul the mask position with numpy : 0.014708280563354492 nb_pixel_total : 745649 time to create 1 rle with new method : 0.29109930992126465 length of segment : 934 time for calcul the mask position with numpy : 0.00018978118896484375 nb_pixel_total : 8043 time to create 1 rle with old method : 0.009008407592773438 length of segment : 135 time for calcul the mask position with numpy : 9.179115295410156e-05 nb_pixel_total : 1945 time to create 1 rle with old method : 0.0023725032806396484 length of segment : 61 time for calcul the mask position with numpy : 0.0003025531768798828 nb_pixel_total : 17968 time to create 1 rle with old method : 0.020340919494628906 length of segment : 146 time for calcul the mask position with numpy : 9.036064147949219e-05 nb_pixel_total : 3104 time to create 1 rle with old method : 0.003641843795776367 length of segment : 84 time for calcul the mask position with numpy : 0.0013871192932128906 nb_pixel_total : 105022 time to create 1 rle with old method : 0.11696600914001465 length of segment : 510 time for calcul the mask position with numpy : 0.0014290809631347656 nb_pixel_total : 103574 time to create 1 rle with old method : 0.11191272735595703 length of segment : 520 time for calcul the mask position with numpy : 0.00016570091247558594 nb_pixel_total : 7319 time to create 1 rle with old method : 0.008378028869628906 length of segment : 150 time for calcul the mask position with numpy : 0.0002319812774658203 nb_pixel_total : 11217 time to create 1 rle with old method : 0.01214456558227539 length of segment : 185 time for calcul the mask position with numpy : 0.0013074874877929688 nb_pixel_total : 98354 time to create 1 rle with old method : 0.10584425926208496 length of segment : 520 time for calcul the mask position with numpy : 0.0006551742553710938 nb_pixel_total : 44109 time to create 1 rle with old method : 0.04745650291442871 length of segment : 403 time for calcul the mask position with numpy : 0.0015017986297607422 nb_pixel_total : 112516 time to create 1 rle with old method : 0.12019753456115723 length of segment : 540 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1330 time to create 1 rle with old method : 0.0016601085662841797 length of segment : 31 time for calcul the mask position with numpy : 0.0001838207244873047 nb_pixel_total : 13810 time to create 1 rle with old method : 0.015117168426513672 length of segment : 141 time for calcul the mask position with numpy : 0.00020432472229003906 nb_pixel_total : 11551 time to create 1 rle with old method : 0.01233530044555664 length of segment : 184 time for calcul the mask position with numpy : 0.008177995681762695 nb_pixel_total : 650541 time to create 1 rle with new method : 0.014975547790527344 length of segment : 1245 time for calcul the mask position with numpy : 0.0001475811004638672 nb_pixel_total : 9007 time to create 1 rle with old method : 0.009517192840576172 length of segment : 184 time for calcul the mask position with numpy : 0.0005044937133789062 nb_pixel_total : 26075 time to create 1 rle with old method : 0.03367137908935547 length of segment : 314 time for calcul the mask position with numpy : 0.0002002716064453125 nb_pixel_total : 5534 time to create 1 rle with old method : 0.006391286849975586 length of segment : 64 time for calcul the mask position with numpy : 0.00014519691467285156 nb_pixel_total : 3533 time to create 1 rle with old method : 0.00393223762512207 length of segment : 63 time for calcul the mask position with numpy : 0.0021681785583496094 nb_pixel_total : 85107 time to create 1 rle with old method : 0.09049582481384277 length of segment : 750 time for calcul the mask position with numpy : 0.017200946807861328 nb_pixel_total : 1364836 time to create 1 rle with new method : 0.060907840728759766 length of segment : 1619 time for calcul the mask position with numpy : 0.00013637542724609375 nb_pixel_total : 2875 time to create 1 rle with old method : 0.0034570693969726562 length of segment : 40 time for calcul the mask position with numpy : 0.002111196517944336 nb_pixel_total : 71731 time to create 1 rle with old method : 0.07973432540893555 length of segment : 475 time for calcul the mask position with numpy : 0.0007302761077880859 nb_pixel_total : 39638 time to create 1 rle with old method : 0.04345226287841797 length of segment : 172 time for calcul the mask position with numpy : 0.00037980079650878906 nb_pixel_total : 11332 time to create 1 rle with old method : 0.012974023818969727 length of segment : 173 time for calcul the mask position with numpy : 0.0008573532104492188 nb_pixel_total : 33960 time to create 1 rle with old method : 0.036958932876586914 length of segment : 344 time for calcul the mask position with numpy : 9.322166442871094e-05 nb_pixel_total : 1510 time to create 1 rle with old method : 0.001728057861328125 length of segment : 38 time for calcul the mask position with numpy : 0.0022592544555664062 nb_pixel_total : 106363 time to create 1 rle with old method : 0.11358761787414551 length of segment : 556 time for calcul the mask position with numpy : 0.0005598068237304688 nb_pixel_total : 14790 time to create 1 rle with old method : 0.016490936279296875 length of segment : 218 time for calcul the mask position with numpy : 0.002532482147216797 nb_pixel_total : 43368 time to create 1 rle with old method : 0.04775738716125488 length of segment : 600 time for calcul the mask position with numpy : 0.0005373954772949219 nb_pixel_total : 20425 time to create 1 rle with old method : 0.022301197052001953 length of segment : 199 time for calcul the mask position with numpy : 0.00011301040649414062 nb_pixel_total : 3819 time to create 1 rle with old method : 0.0043299198150634766 length of segment : 53 time for calcul the mask position with numpy : 0.0023009777069091797 nb_pixel_total : 98048 time to create 1 rle with old method : 0.10481953620910645 length of segment : 509 time for calcul the mask position with numpy : 0.00034308433532714844 nb_pixel_total : 9843 time to create 1 rle with old method : 0.01107025146484375 length of segment : 163 time for calcul the mask position with numpy : 0.0006756782531738281 nb_pixel_total : 17972 time to create 1 rle with old method : 0.01937699317932129 length of segment : 322 time for calcul the mask position with numpy : 0.000286102294921875 nb_pixel_total : 15374 time to create 1 rle with old method : 0.016901731491088867 length of segment : 184 time for calcul the mask position with numpy : 0.00011658668518066406 nb_pixel_total : 2194 time to create 1 rle with old method : 0.0026400089263916016 length of segment : 56 time for calcul the mask position with numpy : 0.0002970695495605469 nb_pixel_total : 13294 time to create 1 rle with old method : 0.015314579010009766 length of segment : 92 time for calcul the mask position with numpy : 0.0004100799560546875 nb_pixel_total : 10107 time to create 1 rle with old method : 0.01124262809753418 length of segment : 179 time for calcul the mask position with numpy : 0.0001971721649169922 nb_pixel_total : 5318 time to create 1 rle with old method : 0.006015300750732422 length of segment : 92 time for calcul the mask position with numpy : 0.0022068023681640625 nb_pixel_total : 106080 time to create 1 rle with old method : 0.11446356773376465 length of segment : 581 time for calcul the mask position with numpy : 0.00015592575073242188 nb_pixel_total : 2437 time to create 1 rle with old method : 0.002792835235595703 length of segment : 58 time for calcul the mask position with numpy : 0.0005612373352050781 nb_pixel_total : 25461 time to create 1 rle with old method : 0.027947187423706055 length of segment : 194 time for calcul the mask position with numpy : 0.0018842220306396484 nb_pixel_total : 99521 time to create 1 rle with old method : 0.10669207572937012 length of segment : 492 time for calcul the mask position with numpy : 0.00028061866760253906 nb_pixel_total : 11267 time to create 1 rle with old method : 0.012476444244384766 length of segment : 180 time for calcul the mask position with numpy : 0.000141143798828125 nb_pixel_total : 2308 time to create 1 rle with old method : 0.0026819705963134766 length of segment : 55 time for calcul the mask position with numpy : 0.00028252601623535156 nb_pixel_total : 11401 time to create 1 rle with old method : 0.012341022491455078 length of segment : 183 time for calcul the mask position with numpy : 0.0001232624053955078 nb_pixel_total : 3055 time to create 1 rle with old method : 0.0035762786865234375 length of segment : 46 time for calcul the mask position with numpy : 0.0005991458892822266 nb_pixel_total : 26036 time to create 1 rle with old method : 0.03044915199279785 length of segment : 124 time for calcul the mask position with numpy : 0.014766693115234375 nb_pixel_total : 768162 time to create 1 rle with new method : 0.1333022117614746 length of segment : 976 time for calcul the mask position with numpy : 0.002103567123413086 nb_pixel_total : 106498 time to create 1 rle with old method : 0.11383414268493652 length of segment : 517 time for calcul the mask position with numpy : 0.00013208389282226562 nb_pixel_total : 1900 time to create 1 rle with old method : 0.0021142959594726562 length of segment : 51 time for calcul the mask position with numpy : 0.0017399787902832031 nb_pixel_total : 91053 time to create 1 rle with old method : 0.09877967834472656 length of segment : 498 time for calcul the mask position with numpy : 0.00025177001953125 nb_pixel_total : 11681 time to create 1 rle with old method : 0.013192892074584961 length of segment : 185 time for calcul the mask position with numpy : 0.010049104690551758 nb_pixel_total : 750933 time to create 1 rle with new method : 0.03885459899902344 length of segment : 937 time for calcul the mask position with numpy : 0.0017561912536621094 nb_pixel_total : 50114 time to create 1 rle with old method : 0.05494046211242676 length of segment : 663 time for calcul the mask position with numpy : 0.0003058910369873047 nb_pixel_total : 11139 time to create 1 rle with old method : 0.012444496154785156 length of segment : 185 time for calcul the mask position with numpy : 0.0021522045135498047 nb_pixel_total : 105196 time to create 1 rle with old method : 0.11631512641906738 length of segment : 537 time for calcul the mask position with numpy : 0.000118255615234375 nb_pixel_total : 1985 time to create 1 rle with old method : 0.002422809600830078 length of segment : 48 time for calcul the mask position with numpy : 0.0002739429473876953 nb_pixel_total : 9440 time to create 1 rle with old method : 0.010996341705322266 length of segment : 171 time for calcul the mask position with numpy : 0.016626596450805664 nb_pixel_total : 1263247 time to create 1 rle with new method : 0.048111677169799805 length of segment : 1291 time for calcul the mask position with numpy : 0.00029349327087402344 nb_pixel_total : 9081 time to create 1 rle with old method : 0.00998830795288086 length of segment : 116 time for calcul the mask position with numpy : 0.0002155303955078125 nb_pixel_total : 6354 time to create 1 rle with old method : 0.007153987884521484 length of segment : 99 time for calcul the mask position with numpy : 0.0007498264312744141 nb_pixel_total : 25970 time to create 1 rle with old method : 0.028741836547851562 length of segment : 325 time for calcul the mask position with numpy : 0.010578155517578125 nb_pixel_total : 662201 time to create 1 rle with new method : 0.16215157508850098 length of segment : 1059 time for calcul the mask position with numpy : 0.001895904541015625 nb_pixel_total : 102350 time to create 1 rle with old method : 0.11238265037536621 length of segment : 506 time for calcul the mask position with numpy : 0.0001304149627685547 nb_pixel_total : 2030 time to create 1 rle with old method : 0.0025854110717773438 length of segment : 49 time for calcul the mask position with numpy : 0.01851344108581543 nb_pixel_total : 1510458 time to create 1 rle with new method : 0.05853104591369629 length of segment : 1052 time for calcul the mask position with numpy : 0.0021097660064697266 nb_pixel_total : 109826 time to create 1 rle with old method : 0.12047243118286133 length of segment : 539 time for calcul the mask position with numpy : 0.0005235671997070312 nb_pixel_total : 20176 time to create 1 rle with old method : 0.022483348846435547 length of segment : 152 time for calcul the mask position with numpy : 0.00040268898010253906 nb_pixel_total : 9900 time to create 1 rle with old method : 0.011071443557739258 length of segment : 178 time for calcul the mask position with numpy : 0.0003693103790283203 nb_pixel_total : 14085 time to create 1 rle with old method : 0.015349149703979492 length of segment : 166 time for calcul the mask position with numpy : 0.010339021682739258 nb_pixel_total : 722901 time to create 1 rle with new method : 0.15695643424987793 length of segment : 951 time spent for convertir_results : 7.814330339431763 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 75 chid ids of type : 3594 Number RLEs to save : 26947 save missing photos in datou_result : time spend for datou_step_exec : 40.745782136917114 time spend to save output : 2.939436674118042 total time spend for step 1 : 43.685218811035156 step2:crop_condition Fri Aug 29 00:41:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 29 ! batch 1 Loaded 75 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 20 About to insert : list_path_to_insert length 20 new photo from crops ! About to upload 20 photos upload in portfolio : 3736932 init cache_photo without model_param we have 20 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756420878_1088271 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 20 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.688732862472534 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756420886_1088271 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.876378059387207 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756420888_1088271 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.1547701358795166 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 46 About to insert : list_path_to_insert length 46 new photo from crops ! About to upload 46 photos upload in portfolio : 3736932 init cache_photo without model_param we have 46 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756420928_1088271 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 46 photos in the portfolio 3736932 time of upload the photos Elapsed time : 11.896727800369263 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756420941_1088271 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2252392768859863 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1377708134, 1377708131, 1377708076, 1377708072, 1377708069, 1377708066, 1377708061, 1377708041, 1377708005, 1377708004, 1377707998, 1377707995, 1377707986, 1377707985, 1377707984, 1377707982, 1377707980, 1377707977, 1377707958, 1377707952, 1377707951, 1377707949, 1377707947, 1377707936, 1377707931, 1377707927, 1377707923, 1377707919, 1377707916] Looping around the photos to save general results len do output : 75 /1380006672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380006767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708134', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708131', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708076', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708072', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708069', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708066', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708061', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708041', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708005', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708004', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707998', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707995', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707986', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707985', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707984', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707982', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707980', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707977', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707958', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707952', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707951', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707949', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707947', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707936', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707931', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707927', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707923', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707919', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707916', None, None, None, None, None, '3629933') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 254 time used for this insertion : 0.22964215278625488 save_final save missing photos in datou_result : time spend for datou_step_exec : 65.3926420211792 time spend to save output : 0.2327558994293213 total time spend for step 2 : 65.62539792060852 step3:rle_unique_nms_with_priority Fri Aug 29 00:42:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 75 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.42394089698791504 time for calcul the mask position with numpy : 0.03615546226501465 nb_pixel_total : 1224553 time to create 1 rle with new method : 0.2123260498046875 time for calcul the mask position with numpy : 0.007033348083496094 nb_pixel_total : 1945 time to create 1 rle with old method : 0.0023238658905029297 time for calcul the mask position with numpy : 0.0069119930267333984 nb_pixel_total : 8043 time to create 1 rle with old method : 0.008576393127441406 time for calcul the mask position with numpy : 0.011100292205810547 nb_pixel_total : 745649 time to create 1 rle with new method : 0.16115307807922363 time for calcul the mask position with numpy : 0.0069828033447265625 nb_pixel_total : 93410 time to create 1 rle with old method : 0.1001119613647461 create new chi : 0.571770429611206 time to delete rle : 0.021425724029541016 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 4410 TO DO : save crop sub photo not yet done ! save time : 0.3355529308319092 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.039009809494018555 time for calcul the mask position with numpy : 0.023532390594482422 nb_pixel_total : 2055632 time to create 1 rle with new method : 0.07488083839416504 time for calcul the mask position with numpy : 0.007246971130371094 nb_pixel_total : 17968 time to create 1 rle with old method : 0.02514362335205078 create new chi : 0.1310560703277588 time to delete rle : 0.0002689361572265625 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1372 TO DO : save crop sub photo not yet done ! save time : 0.407153844833374 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.06052279472351074 time for calcul the mask position with numpy : 0.5278005599975586 nb_pixel_total : 1965474 time to create 1 rle with new method : 1.1659183502197266 time for calcul the mask position with numpy : 0.007910728454589844 nb_pixel_total : 105022 time to create 1 rle with old method : 0.12793898582458496 time for calcul the mask position with numpy : 0.005772829055786133 nb_pixel_total : 3104 time to create 1 rle with old method : 0.003418445587158203 create new chi : 1.8428955078125 time to delete rle : 0.0003714561462402344 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2268 TO DO : save crop sub photo not yet done ! save time : 0.20202136039733887 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.041611433029174805 time for calcul the mask position with numpy : 0.020270347595214844 nb_pixel_total : 1970026 time to create 1 rle with new method : 0.08034276962280273 time for calcul the mask position with numpy : 0.006612300872802734 nb_pixel_total : 103574 time to create 1 rle with old method : 0.11263751983642578 create new chi : 0.22716784477233887 time to delete rle : 0.00031948089599609375 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2120 TO DO : save crop sub photo not yet done ! save time : 0.3730626106262207 No data in photo_id : 1377708069 No data in photo_id : 1377708066 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.4010293483734131 time for calcul the mask position with numpy : 0.1774604320526123 nb_pixel_total : 2066281 time to create 1 rle with new method : 0.07599496841430664 time for calcul the mask position with numpy : 0.006102085113525391 nb_pixel_total : 7319 time to create 1 rle with old method : 0.008002996444702148 create new chi : 0.2785341739654541 time to delete rle : 0.00025916099548339844 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1380 TO DO : save crop sub photo not yet done ! save time : 0.6077396869659424 No data in photo_id : 1377708041 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.2259082794189453 time for calcul the mask position with numpy : 0.11056137084960938 nb_pixel_total : 1919920 time to create 1 rle with new method : 0.3712623119354248 time for calcul the mask position with numpy : 0.008538007736206055 nb_pixel_total : 44109 time to create 1 rle with old method : 0.05013632774353027 time for calcul the mask position with numpy : 0.007059812545776367 nb_pixel_total : 98354 time to create 1 rle with old method : 0.11125445365905762 time for calcul the mask position with numpy : 0.00784921646118164 nb_pixel_total : 11217 time to create 1 rle with old method : 0.0214688777923584 create new chi : 0.7019999027252197 time to delete rle : 0.0007193088531494141 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 3296 TO DO : save crop sub photo not yet done ! save time : 0.2850008010864258 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.085479736328125 time for calcul the mask position with numpy : 0.12944245338439941 nb_pixel_total : 1934393 time to create 1 rle with new method : 0.08144497871398926 time for calcul the mask position with numpy : 0.006132841110229492 nb_pixel_total : 11551 time to create 1 rle with old method : 0.012437820434570312 time for calcul the mask position with numpy : 0.005940437316894531 nb_pixel_total : 13810 time to create 1 rle with old method : 0.015435218811035156 time for calcul the mask position with numpy : 0.0065190792083740234 nb_pixel_total : 1330 time to create 1 rle with old method : 0.0021584033966064453 time for calcul the mask position with numpy : 0.007136106491088867 nb_pixel_total : 112516 time to create 1 rle with old method : 0.12815570831298828 create new chi : 0.406111478805542 time to delete rle : 0.0004987716674804688 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2872 TO DO : save crop sub photo not yet done ! save time : 0.28835225105285645 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04034090042114258 time for calcul the mask position with numpy : 0.01804494857788086 nb_pixel_total : 1423059 time to create 1 rle with new method : 0.18890786170959473 time for calcul the mask position with numpy : 0.013568878173828125 nb_pixel_total : 650541 time to create 1 rle with new method : 0.04629206657409668 create new chi : 0.26735758781433105 time to delete rle : 0.0004634857177734375 batch 1 Loaded 3 chid ids of type : 3594 ++++Number RLEs to save : 3570 TO DO : save crop sub photo not yet done ! save time : 0.6041009426116943 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.34252190589904785 time for calcul the mask position with numpy : 0.014923572540283203 nb_pixel_total : 621042 time to create 1 rle with new method : 0.20548343658447266 time for calcul the mask position with numpy : 0.03700065612792969 nb_pixel_total : 1323302 time to create 1 rle with new method : 0.20186853408813477 time for calcul the mask position with numpy : 0.0066547393798828125 nb_pixel_total : 85107 time to create 1 rle with old method : 0.09477710723876953 time for calcul the mask position with numpy : 0.006666660308837891 nb_pixel_total : 3533 time to create 1 rle with old method : 0.003985881805419922 time for calcul the mask position with numpy : 0.0059087276458740234 nb_pixel_total : 5534 time to create 1 rle with old method : 0.006217002868652344 time for calcul the mask position with numpy : 0.006184816360473633 nb_pixel_total : 26075 time to create 1 rle with old method : 0.028044462203979492 time for calcul the mask position with numpy : 0.0062639713287353516 nb_pixel_total : 9007 time to create 1 rle with old method : 0.01005101203918457 create new chi : 0.6484816074371338 time to delete rle : 0.00118255615234375 batch 1 Loaded 13 chid ids of type : 3594 ++++++++Number RLEs to save : 6812 TO DO : save crop sub photo not yet done ! save time : 0.9396469593048096 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.07141590118408203 time for calcul the mask position with numpy : 0.23820257186889648 nb_pixel_total : 1914064 time to create 1 rle with new method : 0.08032560348510742 time for calcul the mask position with numpy : 0.006577968597412109 nb_pixel_total : 33960 time to create 1 rle with old method : 0.03966069221496582 time for calcul the mask position with numpy : 0.006531715393066406 nb_pixel_total : 11332 time to create 1 rle with old method : 0.012848377227783203 time for calcul the mask position with numpy : 0.006391286849975586 nb_pixel_total : 39638 time to create 1 rle with old method : 0.04336714744567871 time for calcul the mask position with numpy : 0.006975889205932617 nb_pixel_total : 71731 time to create 1 rle with old method : 0.082275390625 time for calcul the mask position with numpy : 0.006267547607421875 nb_pixel_total : 2875 time to create 1 rle with old method : 0.0032799243927001953 create new chi : 0.544583797454834 time to delete rle : 0.0005843639373779297 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 3488 TO DO : save crop sub photo not yet done ! save time : 0.45502734184265137 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.055187225341796875 time for calcul the mask position with numpy : 0.019321918487548828 nb_pixel_total : 1950937 time to create 1 rle with new method : 0.09940314292907715 time for calcul the mask position with numpy : 0.0067517757415771484 nb_pixel_total : 14790 time to create 1 rle with old method : 0.017874717712402344 time for calcul the mask position with numpy : 0.006586313247680664 nb_pixel_total : 106363 time to create 1 rle with old method : 0.12391495704650879 time for calcul the mask position with numpy : 0.006346702575683594 nb_pixel_total : 1510 time to create 1 rle with old method : 0.00197601318359375 create new chi : 0.2827315330505371 time to delete rle : 0.0002758502960205078 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 2704 TO DO : save crop sub photo not yet done ! save time : 0.5599431991577148 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.346848726272583 time for calcul the mask position with numpy : 0.05632352828979492 nb_pixel_total : 2005988 time to create 1 rle with new method : 0.2027890682220459 time for calcul the mask position with numpy : 0.0060977935791015625 nb_pixel_total : 3819 time to create 1 rle with old method : 0.004386425018310547 time for calcul the mask position with numpy : 0.00649571418762207 nb_pixel_total : 20425 time to create 1 rle with old method : 0.02219080924987793 time for calcul the mask position with numpy : 0.006571054458618164 nb_pixel_total : 43368 time to create 1 rle with old method : 0.04747891426086426 create new chi : 0.3625810146331787 time to delete rle : 0.0002646446228027344 batch 1 Loaded 7 chid ids of type : 3594 +++++++Number RLEs to save : 2784 TO DO : save crop sub photo not yet done ! save time : 0.36680078506469727 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.07941007614135742 time for calcul the mask position with numpy : 0.17244386672973633 nb_pixel_total : 1942008 time to create 1 rle with new method : 0.2720670700073242 time for calcul the mask position with numpy : 0.006172657012939453 nb_pixel_total : 5729 time to create 1 rle with old method : 0.006289958953857422 time for calcul the mask position with numpy : 0.006472349166870117 nb_pixel_total : 17972 time to create 1 rle with old method : 0.019484519958496094 time for calcul the mask position with numpy : 0.00663447380065918 nb_pixel_total : 9843 time to create 1 rle with old method : 0.011415719985961914 time for calcul the mask position with numpy : 0.007322549819946289 nb_pixel_total : 98048 time to create 1 rle with old method : 0.10791945457458496 create new chi : 0.6256489753723145 time to delete rle : 0.0005788803100585938 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3298 TO DO : save crop sub photo not yet done ! save time : 0.283907413482666 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.033334970474243164 time for calcul the mask position with numpy : 0.019430875778198242 nb_pixel_total : 2071406 time to create 1 rle with new method : 0.06559967994689941 time for calcul the mask position with numpy : 0.0063304901123046875 nb_pixel_total : 2194 time to create 1 rle with old method : 0.002430438995361328 create new chi : 0.09399819374084473 time to delete rle : 0.00027060508728027344 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1192 TO DO : save crop sub photo not yet done ! save time : 0.12872052192687988 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.3460237979888916 time for calcul the mask position with numpy : 0.171705961227417 nb_pixel_total : 2044881 time to create 1 rle with new method : 0.07485485076904297 time for calcul the mask position with numpy : 0.005902528762817383 nb_pixel_total : 5318 time to create 1 rle with old method : 0.00568079948425293 time for calcul the mask position with numpy : 0.005875349044799805 nb_pixel_total : 10107 time to create 1 rle with old method : 0.010855674743652344 time for calcul the mask position with numpy : 0.0060138702392578125 nb_pixel_total : 13294 time to create 1 rle with old method : 0.014804363250732422 create new chi : 0.30573129653930664 time to delete rle : 0.0003266334533691406 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1806 TO DO : save crop sub photo not yet done ! save time : 0.17694735527038574 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.04952406883239746 time for calcul the mask position with numpy : 0.12688636779785156 nb_pixel_total : 1939622 time to create 1 rle with new method : 0.18880939483642578 time for calcul the mask position with numpy : 0.006310224533081055 nb_pixel_total : 25461 time to create 1 rle with old method : 0.027490854263305664 time for calcul the mask position with numpy : 0.006043434143066406 nb_pixel_total : 2437 time to create 1 rle with old method : 0.00274658203125 time for calcul the mask position with numpy : 0.0069200992584228516 nb_pixel_total : 106080 time to create 1 rle with old method : 0.1150965690612793 create new chi : 0.4910252094268799 time to delete rle : 0.0002913475036621094 batch 1 Loaded 7 chid ids of type : 3594 ++++++Number RLEs to save : 2738 TO DO : save crop sub photo not yet done ! save time : 0.23867321014404297 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.08349967002868652 time for calcul the mask position with numpy : 0.217634916305542 nb_pixel_total : 1949103 time to create 1 rle with new method : 0.07660031318664551 time for calcul the mask position with numpy : 0.0062100887298583984 nb_pixel_total : 11401 time to create 1 rle with old method : 0.01272892951965332 time for calcul the mask position with numpy : 0.006129264831542969 nb_pixel_total : 2308 time to create 1 rle with old method : 0.0026366710662841797 time for calcul the mask position with numpy : 0.006386518478393555 nb_pixel_total : 11267 time to create 1 rle with old method : 0.012048482894897461 time for calcul the mask position with numpy : 0.0066072940826416016 nb_pixel_total : 99521 time to create 1 rle with old method : 0.10801148414611816 create new chi : 0.4655632972717285 time to delete rle : 0.0003571510314941406 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2883 TO DO : save crop sub photo not yet done ! save time : 0.38054704666137695 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.054254770278930664 time for calcul the mask position with numpy : 0.13004040718078613 nb_pixel_total : 1276347 time to create 1 rle with new method : 0.19719195365905762 time for calcul the mask position with numpy : 0.013378620147705078 nb_pixel_total : 768162 time to create 1 rle with new method : 0.06711530685424805 time for calcul the mask position with numpy : 0.00621485710144043 nb_pixel_total : 26036 time to create 1 rle with old method : 0.02796316146850586 time for calcul the mask position with numpy : 0.006501436233520508 nb_pixel_total : 3055 time to create 1 rle with old method : 0.003506183624267578 create new chi : 0.4588503837585449 time to delete rle : 0.0006337165832519531 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3372 TO DO : save crop sub photo not yet done ! save time : 0.5747926235198975 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.05115866661071777 time for calcul the mask position with numpy : 0.14654183387756348 nb_pixel_total : 1965202 time to create 1 rle with new method : 0.15654420852661133 time for calcul the mask position with numpy : 0.00616765022277832 nb_pixel_total : 1900 time to create 1 rle with old method : 0.0020956993103027344 time for calcul the mask position with numpy : 0.006288051605224609 nb_pixel_total : 106498 time to create 1 rle with old method : 0.11201000213623047 create new chi : 0.43927836418151855 time to delete rle : 0.0003464221954345703 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2187 TO DO : save crop sub photo not yet done ! save time : 0.3267397880554199 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.06666135787963867 time for calcul the mask position with numpy : 0.0358424186706543 nb_pixel_total : 1220946 time to create 1 rle with new method : 0.14981770515441895 time for calcul the mask position with numpy : 0.010632038116455078 nb_pixel_total : 749920 time to create 1 rle with new method : 0.1378018856048584 time for calcul the mask position with numpy : 0.005697965621948242 nb_pixel_total : 11681 time to create 1 rle with old method : 0.012053728103637695 time for calcul the mask position with numpy : 0.0062732696533203125 nb_pixel_total : 91053 time to create 1 rle with old method : 0.09738397598266602 create new chi : 0.46454668045043945 time to delete rle : 0.0007104873657226562 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 4259 TO DO : save crop sub photo not yet done ! save time : 0.6909704208374023 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.03809547424316406 time for calcul the mask position with numpy : 0.018250226974487305 nb_pixel_total : 2012347 time to create 1 rle with new method : 0.06332969665527344 time for calcul the mask position with numpy : 0.006013154983520508 nb_pixel_total : 11139 time to create 1 rle with old method : 0.012257099151611328 time for calcul the mask position with numpy : 0.006830930709838867 nb_pixel_total : 50114 time to create 1 rle with old method : 0.055020809173583984 create new chi : 0.170379638671875 time to delete rle : 0.00039577484130859375 batch 1 Loaded 5 chid ids of type : 3594 ++++Number RLEs to save : 2776 TO DO : save crop sub photo not yet done ! save time : 0.5378565788269043 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.14957880973815918 time for calcul the mask position with numpy : 0.010853290557861328 nb_pixel_total : 693732 time to create 1 rle with new method : 0.07706403732299805 time for calcul the mask position with numpy : 0.09224677085876465 nb_pixel_total : 1263247 time to create 1 rle with new method : 0.06882596015930176 time for calcul the mask position with numpy : 0.005847454071044922 nb_pixel_total : 9440 time to create 1 rle with old method : 0.01037287712097168 time for calcul the mask position with numpy : 0.00623774528503418 nb_pixel_total : 1985 time to create 1 rle with old method : 0.002103090286254883 time for calcul the mask position with numpy : 0.006456851959228516 nb_pixel_total : 105196 time to create 1 rle with old method : 0.11702442169189453 create new chi : 0.41176748275756836 time to delete rle : 0.001544952392578125 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 5163 TO DO : save crop sub photo not yet done ! save time : 0.6642718315124512 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.09334135055541992 time for calcul the mask position with numpy : 0.08731532096862793 nb_pixel_total : 1369994 time to create 1 rle with new method : 0.0730745792388916 time for calcul the mask position with numpy : 0.010018348693847656 nb_pixel_total : 662201 time to create 1 rle with new method : 0.14432907104492188 time for calcul the mask position with numpy : 0.0060117244720458984 nb_pixel_total : 25970 time to create 1 rle with old method : 0.0279693603515625 time for calcul the mask position with numpy : 0.005903959274291992 nb_pixel_total : 6354 time to create 1 rle with old method : 0.006959438323974609 time for calcul the mask position with numpy : 0.006078004837036133 nb_pixel_total : 9081 time to create 1 rle with old method : 0.010140180587768555 create new chi : 0.39391136169433594 time to delete rle : 0.0007517337799072266 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 4278 TO DO : save crop sub photo not yet done ! save time : 0.45763301849365234 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05728960037231445 time for calcul the mask position with numpy : 0.008663654327392578 nb_pixel_total : 458762 time to create 1 rle with new method : 0.16106534004211426 time for calcul the mask position with numpy : 0.018021583557128906 nb_pixel_total : 1510458 time to create 1 rle with new method : 0.027833938598632812 time for calcul the mask position with numpy : 0.0057713985443115234 nb_pixel_total : 2030 time to create 1 rle with old method : 0.002145051956176758 time for calcul the mask position with numpy : 0.006115913391113281 nb_pixel_total : 102350 time to create 1 rle with old method : 0.10883069038391113 create new chi : 0.3390681743621826 time to delete rle : 0.0006849765777587891 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 4289 TO DO : save crop sub photo not yet done ! save time : 0.5027880668640137 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.038494110107421875 time for calcul the mask position with numpy : 0.01766681671142578 nb_pixel_total : 1963774 time to create 1 rle with new method : 0.06577277183532715 time for calcul the mask position with numpy : 0.0061185359954833984 nb_pixel_total : 109826 time to create 1 rle with old method : 0.11409783363342285 create new chi : 0.20395803451538086 time to delete rle : 0.00034236907958984375 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 2158 TO DO : save crop sub photo not yet done ! save time : 0.6620297431945801 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.3396482467651367 time for calcul the mask position with numpy : 0.03636527061462402 nb_pixel_total : 1308164 time to create 1 rle with new method : 0.16161108016967773 time for calcul the mask position with numpy : 0.01049041748046875 nb_pixel_total : 721275 time to create 1 rle with new method : 0.15604472160339355 time for calcul the mask position with numpy : 0.005807161331176758 nb_pixel_total : 14085 time to create 1 rle with old method : 0.014683008193969727 time for calcul the mask position with numpy : 0.005745649337768555 nb_pixel_total : 9900 time to create 1 rle with old method : 0.010762691497802734 time for calcul the mask position with numpy : 0.006415605545043945 nb_pixel_total : 20176 time to create 1 rle with old method : 0.021244525909423828 create new chi : 0.4386625289916992 time to delete rle : 0.0006427764892578125 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3889 TO DO : save crop sub photo not yet done ! save time : 0.30312561988830566 map_output_result : {1377708134: (0.0, 'Should be the crop_list due to order', 0), 1377708131: (0.0, 'Should be the crop_list due to order', 0), 1377708076: (0.0, 'Should be the crop_list due to order', 0), 1377708072: (0.0, 'Should be the crop_list due to order', 0), 1377708069: (0.0, 'Should be the crop_list due to order', 0.0), 1377708066: (0.0, 'Should be the crop_list due to order', 0.0), 1377708061: (0.0, 'Should be the crop_list due to order', 0), 1377708041: (0.0, 'Should be the crop_list due to order', 0.0), 1377708005: (0.0, 'Should be the crop_list due to order', 0), 1377708004: (0.0, 'Should be the crop_list due to order', 0), 1377707998: (0.0, 'Should be the crop_list due to order', 0), 1377707995: (0.0, 'Should be the crop_list due to order', 0), 1377707986: (0.0, 'Should be the crop_list due to order', 0), 1377707985: (0.0, 'Should be the crop_list due to order', 0), 1377707984: (0.0, 'Should be the crop_list due to order', 0), 1377707982: (0.0, 'Should be the crop_list due to order', 0), 1377707980: (0.0, 'Should be the crop_list due to order', 0), 1377707977: (0.0, 'Should be the crop_list due to order', 0), 1377707958: (0.0, 'Should be the crop_list due to order', 0), 1377707952: (0.0, 'Should be the crop_list due to order', 0), 1377707951: (0.0, 'Should be the crop_list due to order', 0), 1377707949: (0.0, 'Should be the crop_list due to order', 0), 1377707947: (0.0, 'Should be the crop_list due to order', 0), 1377707936: (0.0, 'Should be the crop_list due to order', 0), 1377707931: (0.0, 'Should be the crop_list due to order', 0), 1377707927: (0.0, 'Should be the crop_list due to order', 0), 1377707923: (0.0, 'Should be the crop_list due to order', 0), 1377707919: (0.0, 'Should be the crop_list due to order', 0), 1377707916: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1377708134, 1377708131, 1377708076, 1377708072, 1377708069, 1377708066, 1377708061, 1377708041, 1377708005, 1377708004, 1377707998, 1377707995, 1377707986, 1377707985, 1377707984, 1377707982, 1377707980, 1377707977, 1377707958, 1377707952, 1377707951, 1377707949, 1377707947, 1377707936, 1377707931, 1377707927, 1377707923, 1377707919, 1377707916] Looping around the photos to save general results len do output : 29 /1377708134.Didn't retrieve data . /1377708131.Didn't retrieve data . /1377708076.Didn't retrieve data . /1377708072.Didn't retrieve data . /1377708069.Didn't retrieve data . /1377708066.Didn't retrieve data . /1377708061.Didn't retrieve data . /1377708041.Didn't retrieve data . /1377708005.Didn't retrieve data . /1377708004.Didn't retrieve data . /1377707998.Didn't retrieve data . /1377707995.Didn't retrieve data . /1377707986.Didn't retrieve data . /1377707985.Didn't retrieve data . /1377707984.Didn't retrieve data . /1377707982.Didn't retrieve data . /1377707980.Didn't retrieve data . /1377707977.Didn't retrieve data . /1377707958.Didn't retrieve data . /1377707952.Didn't retrieve data . /1377707951.Didn't retrieve data . /1377707949.Didn't retrieve data . /1377707947.Didn't retrieve data . /1377707936.Didn't retrieve data . /1377707931.Didn't retrieve data . /1377707927.Didn't retrieve data . /1377707923.Didn't retrieve data . /1377707919.Didn't retrieve data . /1377707916.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708134', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708131', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708076', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708072', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708069', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708066', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708061', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708041', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708005', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708004', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707998', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707995', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707986', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707985', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707984', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707982', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707980', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707977', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707958', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707952', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707951', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707949', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707947', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707936', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707931', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707927', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707923', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707919', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707916', None, None, None, None, None, '3629933') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 87 time used for this insertion : 0.018082857131958008 save_final save missing photos in datou_result : time spend for datou_step_exec : 27.420475721359253 time spend to save output : 0.01892709732055664 total time spend for step 3 : 27.43940281867981 step4:ventilate_hashtags_in_portfolio Fri Aug 29 00:42:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26310895 get user id for portfolio 26310895 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26310895 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','carton','mal_croppe','flou','environnement','pehd','papier','background','pet_clair','autre','metal')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26310895 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','carton','mal_croppe','flou','environnement','pehd','papier','background','pet_clair','autre','metal')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26310895 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','carton','mal_croppe','flou','environnement','pehd','papier','background','pet_clair','autre','metal')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/26311507,26311508,26311509,26311510,26311511,26311512,26311513,26311514,26311515,26311516,26311517?tags=pet_fonce,carton,mal_croppe,flou,environnement,pehd,papier,background,pet_clair,autre,metal Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1377708134, 1377708131, 1377708076, 1377708072, 1377708069, 1377708066, 1377708061, 1377708041, 1377708005, 1377708004, 1377707998, 1377707995, 1377707986, 1377707985, 1377707984, 1377707982, 1377707980, 1377707977, 1377707958, 1377707952, 1377707951, 1377707949, 1377707947, 1377707936, 1377707931, 1377707927, 1377707923, 1377707919, 1377707916] Looping around the photos to save general results len do output : 1 /26310895. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708134', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708131', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708076', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708072', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708069', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708066', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708061', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708041', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708005', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708004', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707998', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707995', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707986', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707985', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707984', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707982', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707980', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707977', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707958', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707952', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707951', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707949', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707947', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707936', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707931', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707927', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707923', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707919', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707916', None, None, None, None, None, '3629933') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.02144646644592285 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.188602924346924 time spend to save output : 0.021805524826049805 total time spend for step 4 : 2.2104084491729736 step5:final Fri Aug 29 00:42:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1377708134: ('0.17703582308961255',), 1377708131: ('0.17703582308961255',), 1377708076: ('0.17703582308961255',), 1377708072: ('0.17703582308961255',), 1377708069: ('0.17703582308961255',), 1377708066: ('0.17703582308961255',), 1377708061: ('0.17703582308961255',), 1377708041: ('0.17703582308961255',), 1377708005: ('0.17703582308961255',), 1377708004: ('0.17703582308961255',), 1377707998: ('0.17703582308961255',), 1377707995: ('0.17703582308961255',), 1377707986: ('0.17703582308961255',), 1377707985: ('0.17703582308961255',), 1377707984: ('0.17703582308961255',), 1377707982: ('0.17703582308961255',), 1377707980: ('0.17703582308961255',), 1377707977: ('0.17703582308961255',), 1377707958: ('0.17703582308961255',), 1377707952: ('0.17703582308961255',), 1377707951: ('0.17703582308961255',), 1377707949: ('0.17703582308961255',), 1377707947: ('0.17703582308961255',), 1377707936: ('0.17703582308961255',), 1377707931: ('0.17703582308961255',), 1377707927: ('0.17703582308961255',), 1377707923: ('0.17703582308961255',), 1377707919: ('0.17703582308961255',), 1377707916: ('0.17703582308961255',)} new output for save of step final : {1377708134: ('0.17703582308961255',), 1377708131: ('0.17703582308961255',), 1377708076: ('0.17703582308961255',), 1377708072: ('0.17703582308961255',), 1377708069: ('0.17703582308961255',), 1377708066: ('0.17703582308961255',), 1377708061: ('0.17703582308961255',), 1377708041: ('0.17703582308961255',), 1377708005: ('0.17703582308961255',), 1377708004: ('0.17703582308961255',), 1377707998: ('0.17703582308961255',), 1377707995: ('0.17703582308961255',), 1377707986: ('0.17703582308961255',), 1377707985: ('0.17703582308961255',), 1377707984: ('0.17703582308961255',), 1377707982: ('0.17703582308961255',), 1377707980: ('0.17703582308961255',), 1377707977: ('0.17703582308961255',), 1377707958: ('0.17703582308961255',), 1377707952: ('0.17703582308961255',), 1377707951: ('0.17703582308961255',), 1377707949: ('0.17703582308961255',), 1377707947: ('0.17703582308961255',), 1377707936: ('0.17703582308961255',), 1377707931: ('0.17703582308961255',), 1377707927: ('0.17703582308961255',), 1377707923: ('0.17703582308961255',), 1377707919: ('0.17703582308961255',), 1377707916: ('0.17703582308961255',)} [1377708134, 1377708131, 1377708076, 1377708072, 1377708069, 1377708066, 1377708061, 1377708041, 1377708005, 1377708004, 1377707998, 1377707995, 1377707986, 1377707985, 1377707984, 1377707982, 1377707980, 1377707977, 1377707958, 1377707952, 1377707951, 1377707949, 1377707947, 1377707936, 1377707931, 1377707927, 1377707923, 1377707919, 1377707916] Looping around the photos to save general results len do output : 29 /1377708134.Didn't retrieve data . /1377708131.Didn't retrieve data . /1377708076.Didn't retrieve data . /1377708072.Didn't retrieve data . /1377708069.Didn't retrieve data . /1377708066.Didn't retrieve data . /1377708061.Didn't retrieve data . /1377708041.Didn't retrieve data . /1377708005.Didn't retrieve data . /1377708004.Didn't retrieve data . /1377707998.Didn't retrieve data . /1377707995.Didn't retrieve data . /1377707986.Didn't retrieve data . /1377707985.Didn't retrieve data . /1377707984.Didn't retrieve data . /1377707982.Didn't retrieve data . /1377707980.Didn't retrieve data . /1377707977.Didn't retrieve data . /1377707958.Didn't retrieve data . /1377707952.Didn't retrieve data . /1377707951.Didn't retrieve data . /1377707949.Didn't retrieve data . /1377707947.Didn't retrieve data . /1377707936.Didn't retrieve data . /1377707931.Didn't retrieve data . /1377707927.Didn't retrieve data . /1377707923.Didn't retrieve data . /1377707919.Didn't retrieve data . /1377707916.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708134', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708131', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708076', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708072', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708069', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708066', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708061', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708041', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708005', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708004', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707998', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707995', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707986', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707985', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707984', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707982', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707980', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707977', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707958', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707952', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707951', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707949', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707947', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707936', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707931', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707927', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707923', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707919', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707916', None, None, None, None, None, '3629933') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 87 time used for this insertion : 0.12022018432617188 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.15072274208068848 time spend to save output : 0.12142467498779297 total time spend for step 5 : 0.27214741706848145 step6:blur_detection Fri Aug 29 00:42:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1756420826_1088271_1377708134_e60fd87abdf3852571f8ea9abeca05e4.jpg resize: (1080, 1920) 1377708134 -2.2660148447646744 treat image : temp/1756420826_1088271_1377708131_1a8c4fe7c2369c3c4ee510106d9b9875.jpg resize: (1080, 1920) 1377708131 -2.611956291199049 treat image : temp/1756420826_1088271_1377708076_20ded815f9941a754b7b3d9e449ad73f.jpg resize: (1080, 1920) 1377708076 -2.4282897047822805 treat image : temp/1756420826_1088271_1377708072_948cc70ce38c2644f32a097176fc5bee.jpg resize: (1080, 1920) 1377708072 -0.4316452315896747 treat image : temp/1756420826_1088271_1377708069_e17fd8ff6e47f43824db2a9e1881a009.jpg resize: (1080, 1920) 1377708069 -2.022056253905477 treat image : temp/1756420826_1088271_1377708066_03cdc58da47b0a8edc22f119f7c7d99f.jpg resize: (1080, 1920) 1377708066 -0.22042092807561353 treat image : temp/1756420826_1088271_1377708061_9989af883616103f63dde34cd71db52e.jpg resize: (1080, 1920) 1377708061 -1.7628602952966084 treat image : temp/1756420826_1088271_1377708041_3ab0cc0f2eea0c6dccb356708d979bf0.jpg resize: (1080, 1920) 1377708041 -2.523400795226436 treat image : temp/1756420826_1088271_1377708005_69779d7e9b8f6af527834c9816fa8de7.jpg resize: (1080, 1920) 1377708005 -1.919248437443477 treat image : temp/1756420826_1088271_1377708004_79e4f19411971151d2175d86e7429f4f.jpg resize: (1080, 1920) 1377708004 -4.571757207357783 treat image : temp/1756420826_1088271_1377707998_2d5bab6b96f53416bdbbb23e8e42d6bb.jpg resize: (1080, 1920) 1377707998 -3.387280017586429 treat image : temp/1756420826_1088271_1377707995_0412ef8b5809378d7f02a51e0bb10f12.jpg resize: (1080, 1920) 1377707995 -2.4263013091536765 treat image : temp/1756420826_1088271_1377707986_3299b25ac2b08e5d46e8bd975c36ecf2.jpg resize: (1080, 1920) 1377707986 -1.8161704182331109 treat image : temp/1756420826_1088271_1377707985_7a02d9565db3d17e1e1c226c3d18a070.jpg resize: (1080, 1920) 1377707985 -2.4181146928241257 treat image : temp/1756420826_1088271_1377707984_52c858896113399d1c0f2eb07c40cf32.jpg resize: (1080, 1920) 1377707984 -2.4987913221068387 treat image : temp/1756420826_1088271_1377707982_84d36afe5ecda792df7aecf61a711cd3.jpg resize: (1080, 1920) 1377707982 -1.775634109017045 treat image : temp/1756420826_1088271_1377707980_3f29ab04b036640989ebbb4ce10af59d.jpg resize: (1080, 1920) 1377707980 -1.6198001912420439 treat image : temp/1756420826_1088271_1377707977_266fb6246555f083c1132eb3381bc87d.jpg resize: (1080, 1920) 1377707977 -1.0904327635605962 treat image : temp/1756420826_1088271_1377707958_654894bb3b4ae34fd13b8d689118995f.jpg resize: (1080, 1920) 1377707958 -4.267654555979737 treat image : temp/1756420826_1088271_1377707952_c3fde691db7601f3b3e84358f8d46526.jpg resize: (1080, 1920) 1377707952 -2.808070133610467 treat image : temp/1756420826_1088271_1377707951_defa9e14a85123018d8c7040b62c9278.jpg resize: (1080, 1920) 1377707951 -3.3091313703883367 treat image : temp/1756420826_1088271_1377707949_42d48b65e7eb007fbdb630e65c4cb7c0.jpg resize: (1080, 1920) 1377707949 -2.4921358329118473 treat image : temp/1756420826_1088271_1377707947_36561763ba05b84d04521335844415ab.jpg resize: (1080, 1920) 1377707947 -1.3889165899245126 treat image : temp/1756420826_1088271_1377707936_025ffe000b99d953036eb0d0812db60a.jpg resize: (1080, 1920) 1377707936 -2.1639785732889107 treat image : temp/1756420826_1088271_1377707931_f0c3d6bf7d6d376d1dc69ebe69453b61.jpg resize: (1080, 1920) 1377707931 -3.7257962989600957 treat image : temp/1756420826_1088271_1377707927_21156b4f6c5c02daf0b281327fcfbe8f.jpg resize: (1080, 1920) 1377707927 -2.9763811181914988 treat image : temp/1756420826_1088271_1377707923_7080fadd66c1f8859043186a730659a3.jpg resize: (1080, 1920) 1377707923 -4.116575254236795 treat image : temp/1756420826_1088271_1377707919_56879d39780b054a84799661806fa349.jpg resize: (1080, 1920) 1377707919 -2.6335467382809736 treat image : temp/1756420826_1088271_1377707916_9ebd542d18909f67dc866e88355147ad.jpg resize: (1080, 1920) 1377707916 -2.013887011561861 treat image : temp/1756420826_1088271_1377708134_e60fd87abdf3852571f8ea9abeca05e4_rle_crop_3934843229_0.png resize: (55, 60) 1380006672 -2.556556619812883 treat image : temp/1756420826_1088271_1377708005_69779d7e9b8f6af527834c9816fa8de7_rle_crop_3934843235_0.png resize: (185, 111) 1380006673 -0.47479302285614294 treat image : temp/1756420826_1088271_1377708004_79e4f19411971151d2175d86e7429f4f_rle_crop_3934843239_0.png resize: (30, 55) 1380006674 0.8753499609869863 treat image : temp/1756420826_1088271_1377708004_79e4f19411971151d2175d86e7429f4f_rle_crop_3934843241_0.png resize: (183, 113) 1380006675 -0.6200223505261683 treat image : temp/1756420826_1088271_1377707995_0412ef8b5809378d7f02a51e0bb10f12_rle_crop_3934843243_0.png resize: (183, 61) 1380006676 -1.2322394813572841 treat image : temp/1756420826_1088271_1377707995_0412ef8b5809378d7f02a51e0bb10f12_rle_crop_3934843245_0.png resize: (64, 130) 1380006677 -0.4628868280247727 treat image : temp/1756420826_1088271_1377707985_7a02d9565db3d17e1e1c226c3d18a070_rle_crop_3934843254_0.png resize: (36, 56) 1380006678 1.5594745847027816 treat image : temp/1756420826_1088271_1377707985_7a02d9565db3d17e1e1c226c3d18a070_rle_crop_3934843256_0.png resize: (215, 111) 1380006679 -3.776094313652336 treat image : temp/1756420826_1088271_1377707977_266fb6246555f083c1132eb3381bc87d_rle_crop_3934843266_0.png resize: (179, 117) 1380006680 -1.408642323937749 treat image : temp/1756420826_1088271_1377707977_266fb6246555f083c1132eb3381bc87d_rle_crop_3934843267_0.png resize: (92, 79) 1380006681 -0.6084257756063832 treat image : temp/1756420826_1088271_1377707958_654894bb3b4ae34fd13b8d689118995f_rle_crop_3934843269_0.png resize: (56, 69) 1380006682 -2.6494568644136844 treat image : temp/1756420826_1088271_1377707952_c3fde691db7601f3b3e84358f8d46526_rle_crop_3934843273_0.png resize: (53, 67) 1380006683 -2.431710414025828 treat image : temp/1756420826_1088271_1377707952_c3fde691db7601f3b3e84358f8d46526_rle_crop_3934843274_0.png resize: (183, 116) 1380006684 -0.6385122707645468 treat image : temp/1756420826_1088271_1377707949_42d48b65e7eb007fbdb630e65c4cb7c0_rle_crop_3934843279_0.png resize: (50, 58) 1380006685 -2.2452214094672684 treat image : temp/1756420826_1088271_1377707947_36561763ba05b84d04521335844415ab_rle_crop_3934843281_0.png resize: (185, 113) 1380006686 -0.49653973147112074 treat image : temp/1756420826_1088271_1377707936_025ffe000b99d953036eb0d0812db60a_rle_crop_3934843284_0.png resize: (185, 115) 1380006687 -0.6014373793218737 treat image : temp/1756420826_1088271_1377707931_f0c3d6bf7d6d376d1dc69ebe69453b61_rle_crop_3934843286_0.png resize: (48, 63) 1380006688 -2.619218220331741 treat image : temp/1756420826_1088271_1377707931_f0c3d6bf7d6d376d1dc69ebe69453b61_rle_crop_3934843287_0.png resize: (171, 106) 1380006689 -0.6943985595562726 treat image : temp/1756420826_1088271_1377707923_7080fadd66c1f8859043186a730659a3_rle_crop_3934843294_0.png resize: (49, 62) 1380006691 -2.5261027817921713 treat image : temp/1756420826_1088271_1377707916_9ebd542d18909f67dc866e88355147ad_rle_crop_3934843298_0.png resize: (178, 105) 1380006692 -0.590575189785092 treat image : temp/1756420826_1088271_1377707927_21156b4f6c5c02daf0b281327fcfbe8f_rle_crop_3934843290_0.png resize: (99, 85) 1380006694 -1.0689929247139027 treat image : temp/1756420826_1088271_1377707927_21156b4f6c5c02daf0b281327fcfbe8f_rle_crop_3934843292_0.png resize: (958, 944) 1380006695 -0.5575988648911961 treat image : temp/1756420826_1088271_1377707986_3299b25ac2b08e5d46e8bd975c36ecf2_rle_crop_3934843249_0.png resize: (38, 107) 1380006701 -4.356297148837789 treat image : temp/1756420826_1088271_1377707984_52c858896113399d1c0f2eb07c40cf32_rle_crop_3934843259_0.png resize: (49, 103) 1380006702 -3.425197545211694 treat image : temp/1756420826_1088271_1377707951_defa9e14a85123018d8c7040b62c9278_rle_crop_3934843275_0.png resize: (46, 89) 1380006703 -3.9658498813662355 treat image : temp/1756420826_1088271_1377708134_e60fd87abdf3852571f8ea9abeca05e4_rle_crop_3934843226_0.png resize: (508, 328) 1380006717 -0.5136726467820907 treat image : temp/1756420826_1088271_1377708134_e60fd87abdf3852571f8ea9abeca05e4_rle_crop_3934843227_0.png resize: (931, 1039) 1380006718 0.2373977401717043 treat image : temp/1756420826_1088271_1377708134_e60fd87abdf3852571f8ea9abeca05e4_rle_crop_3934843228_0.png resize: (135, 91) 1380006719 -2.117254688321288 treat image : temp/1756420826_1088271_1377708131_1a8c4fe7c2369c3c4ee510106d9b9875_rle_crop_3934843230_0.png resize: (146, 200) 1380006720 -5.159022037012863 treat image : temp/1756420826_1088271_1377708076_20ded815f9941a754b7b3d9e449ad73f_rle_crop_3934843232_0.png resize: (503, 343) 1380006721 0.20470337702617816 treat image : temp/1756420826_1088271_1377708072_948cc70ce38c2644f32a097176fc5bee_rle_crop_3934843233_0.png resize: (518, 340) 1380006722 0.2597352015250827 treat image : temp/1756420826_1088271_1377708061_9989af883616103f63dde34cd71db52e_rle_crop_3934843234_0.png resize: (148, 93) 1380006723 -4.657636305390566 treat image : temp/1756420826_1088271_1377708005_69779d7e9b8f6af527834c9816fa8de7_rle_crop_3934843236_0.png resize: (481, 336) 1380006724 -0.27037311208778575 treat image : temp/1756420826_1088271_1377708005_69779d7e9b8f6af527834c9816fa8de7_rle_crop_3934843237_0.png resize: (389, 194) 1380006725 -2.095025800326222 treat image : temp/1756420826_1088271_1377708004_79e4f19411971151d2175d86e7429f4f_rle_crop_3934843238_0.png resize: (537, 341) 1380006726 -0.007523253779649324 treat image : temp/1756420826_1088271_1377708004_79e4f19411971151d2175d86e7429f4f_rle_crop_3934843240_0.png resize: (141, 110) 1380006727 -3.4850454255462275 treat image : temp/1756420826_1088271_1377707998_2d5bab6b96f53416bdbbb23e8e42d6bb_rle_crop_3934843242_0.png resize: (907, 921) 1380006728 -0.05442732992866333 treat image : temp/1756420826_1088271_1377707995_0412ef8b5809378d7f02a51e0bb10f12_rle_crop_3934843244_0.png resize: (232, 272) 1380006729 -3.3550929444201403 treat image : temp/1756420826_1088271_1377707995_0412ef8b5809378d7f02a51e0bb10f12_rle_crop_3934843246_0.png resize: (63, 63) 1380006730 -2.4670462644353104 treat image : temp/1756420826_1088271_1377707995_0412ef8b5809378d7f02a51e0bb10f12_rle_crop_3934843247_0.png resize: (592, 332) 1380006731 -1.578860059231108 treat image : temp/1756420826_1088271_1377707995_0412ef8b5809378d7f02a51e0bb10f12_rle_crop_3934843248_0.png resize: (960, 1728) 1380006732 -2.074779684735938 treat image : temp/1756420826_1088271_1377707986_3299b25ac2b08e5d46e8bd975c36ecf2_rle_crop_3934843250_0.png resize: (464, 356) 1380006733 -0.6623855388339264 treat image : temp/1756420826_1088271_1377707986_3299b25ac2b08e5d46e8bd975c36ecf2_rle_crop_3934843251_0.png resize: (171, 281) 1380006734 -3.7916615137867673 treat image : temp/1756420826_1088271_1377707986_3299b25ac2b08e5d46e8bd975c36ecf2_rle_crop_3934843252_0.png resize: (131, 124) 1380006735 -3.1570910604728346 treat image : temp/1756420826_1088271_1377707985_7a02d9565db3d17e1e1c226c3d18a070_rle_crop_3934843255_0.png resize: (534, 362) 1380006736 -0.22832439382261369 treat image : temp/1756420826_1088271_1377707984_52c858896113399d1c0f2eb07c40cf32_rle_crop_3934843257_0.png resize: (520, 448) 1380006737 -1.3205529854333218 treat image : temp/1756420826_1088271_1377707984_52c858896113399d1c0f2eb07c40cf32_rle_crop_3934843258_0.png resize: (155, 172) 1380006738 -2.208273839313716 treat image : temp/1756420826_1088271_1377707982_84d36afe5ecda792df7aecf61a711cd3_rle_crop_3934843260_0.png resize: (505, 334) 1380006739 -0.19610415428113614 treat image : temp/1756420826_1088271_1377707982_84d36afe5ecda792df7aecf61a711cd3_rle_crop_3934843261_0.png resize: (159, 80) 1380006740 -0.47045594516275074 treat image : temp/1756420826_1088271_1377707982_84d36afe5ecda792df7aecf61a711cd3_rle_crop_3934843262_0.png resize: (309, 102) 1380006741 -4.547150166662847 treat image : temp/1756420826_1088271_1377707977_266fb6246555f083c1132eb3381bc87d_rle_crop_3934843265_0.png resize: (90, 176) 1380006742 -1.9894394511536386 treat image : temp/1756420826_1088271_1377707958_654894bb3b4ae34fd13b8d689118995f_rle_crop_3934843268_0.png resize: (511, 340) 1380006743 -0.6998324869566168 treat image : temp/1756420826_1088271_1377707958_654894bb3b4ae34fd13b8d689118995f_rle_crop_3934843270_0.png resize: (138, 229) 1380006744 -4.719861413284609 treat image : temp/1756420826_1088271_1377707952_c3fde691db7601f3b3e84358f8d46526_rle_crop_3934843271_0.png resize: (491, 322) 1380006745 0.3006365662698271 treat image : temp/1756420826_1088271_1377707952_c3fde691db7601f3b3e84358f8d46526_rle_crop_3934843272_0.png resize: (180, 123) 1380006746 -3.6666117271170036 treat image : temp/1756420826_1088271_1377707951_defa9e14a85123018d8c7040b62c9278_rle_crop_3934843276_0.png resize: (120, 275) 1380006747 -4.897283096438832 treat image : temp/1756420826_1088271_1377707951_defa9e14a85123018d8c7040b62c9278_rle_crop_3934843277_0.png resize: (973, 1042) 1380006748 -0.23076298037420975 treat image : temp/1756420826_1088271_1377707949_42d48b65e7eb007fbdb630e65c4cb7c0_rle_crop_3934843278_0.png resize: (514, 354) 1380006749 -0.020803203146783404 treat image : temp/1756420826_1088271_1377707947_36561763ba05b84d04521335844415ab_rle_crop_3934843280_0.png resize: (478, 320) 1380006750 -0.45440154297265245 treat image : temp/1756420826_1088271_1377707947_36561763ba05b84d04521335844415ab_rle_crop_3934843282_0.png resize: (935, 1048) 1380006751 0.352754459195799 treat image : temp/1756420826_1088271_1377707936_025ffe000b99d953036eb0d0812db60a_rle_crop_3934843283_0.png resize: (494, 333) 1380006752 -1.7513158272574958 treat image : temp/1756420826_1088271_1377707931_f0c3d6bf7d6d376d1dc69ebe69453b61_rle_crop_3934843285_0.png resize: (530, 325) 1380006753 -0.063925626882295 treat image : temp/1756420826_1088271_1377707931_f0c3d6bf7d6d376d1dc69ebe69453b61_rle_crop_3934843288_0.png resize: (1000, 1369) 1380006754 -3.63438783074619 treat image : temp/1756420826_1088271_1377707927_21156b4f6c5c02daf0b281327fcfbe8f_rle_crop_3934843289_0.png resize: (111, 103) 1380006755 -2.364750169571731 treat image : temp/1756420826_1088271_1377707927_21156b4f6c5c02daf0b281327fcfbe8f_rle_crop_3934843291_0.png resize: (325, 160) 1380006756 -1.8957771723888115 treat image : temp/1756420826_1088271_1377707923_7080fadd66c1f8859043186a730659a3_rle_crop_3934843293_0.png resize: (505, 349) 1380006757 0.0688601434307433 treat image : temp/1756420826_1088271_1377707923_7080fadd66c1f8859043186a730659a3_rle_crop_3934843295_0.png resize: (951, 1714) 1380006759 -4.10302618057428 treat image : temp/1756420826_1088271_1377707919_56879d39780b054a84799661806fa349_rle_crop_3934843296_0.png resize: (528, 343) 1380006760 -0.05909574256446291 treat image : temp/1756420826_1088271_1377707916_9ebd542d18909f67dc866e88355147ad_rle_crop_3934843297_0.png resize: (151, 212) 1380006761 -1.0032083286723612 treat image : temp/1756420826_1088271_1377707916_9ebd542d18909f67dc866e88355147ad_rle_crop_3934843299_0.png resize: (166, 115) 1380006762 -1.4505056391741982 treat image : temp/1756420826_1088271_1377707916_9ebd542d18909f67dc866e88355147ad_rle_crop_3934843300_0.png resize: (941, 984) 1380006763 0.0850897848087087 treat image : temp/1756420826_1088271_1377708076_20ded815f9941a754b7b3d9e449ad73f_rle_crop_3934843231_0.png resize: (84, 49) 1380006764 0.6854591240012855 treat image : temp/1756420826_1088271_1377707986_3299b25ac2b08e5d46e8bd975c36ecf2_rle_crop_3934843253_0.png resize: (295, 143) 1380006765 -1.1195819562846268 treat image : temp/1756420826_1088271_1377707982_84d36afe5ecda792df7aecf61a711cd3_rle_crop_3934843263_0.png resize: (180, 120) 1380006766 -0.8291233387579783 treat image : temp/1756420826_1088271_1377707980_3f29ab04b036640989ebbb4ce10af59d_rle_crop_3934843264_0.png resize: (55, 52) 1380006767 -0.8409895076487326 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 104 time used for this insertion : 0.01985335350036621 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 104 time used for this insertion : 0.17295241355895996 save missing photos in datou_result : time spend for datou_step_exec : 27.965278387069702 time spend to save output : 0.19797420501708984 total time spend for step 6 : 28.163252592086792 step7:brightness Fri Aug 29 00:43:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1756420826_1088271_1377708134_e60fd87abdf3852571f8ea9abeca05e4.jpg treat image : temp/1756420826_1088271_1377708131_1a8c4fe7c2369c3c4ee510106d9b9875.jpg treat image : temp/1756420826_1088271_1377708076_20ded815f9941a754b7b3d9e449ad73f.jpg treat image : temp/1756420826_1088271_1377708072_948cc70ce38c2644f32a097176fc5bee.jpg treat image : temp/1756420826_1088271_1377708069_e17fd8ff6e47f43824db2a9e1881a009.jpg treat image : temp/1756420826_1088271_1377708066_03cdc58da47b0a8edc22f119f7c7d99f.jpg treat image : temp/1756420826_1088271_1377708061_9989af883616103f63dde34cd71db52e.jpg treat image : temp/1756420826_1088271_1377708041_3ab0cc0f2eea0c6dccb356708d979bf0.jpg treat image : temp/1756420826_1088271_1377708005_69779d7e9b8f6af527834c9816fa8de7.jpg treat image : temp/1756420826_1088271_1377708004_79e4f19411971151d2175d86e7429f4f.jpg treat image : temp/1756420826_1088271_1377707998_2d5bab6b96f53416bdbbb23e8e42d6bb.jpg treat image : temp/1756420826_1088271_1377707995_0412ef8b5809378d7f02a51e0bb10f12.jpg treat image : temp/1756420826_1088271_1377707986_3299b25ac2b08e5d46e8bd975c36ecf2.jpg treat image : temp/1756420826_1088271_1377707985_7a02d9565db3d17e1e1c226c3d18a070.jpg treat image : temp/1756420826_1088271_1377707984_52c858896113399d1c0f2eb07c40cf32.jpg treat image : temp/1756420826_1088271_1377707982_84d36afe5ecda792df7aecf61a711cd3.jpg treat image : temp/1756420826_1088271_1377707980_3f29ab04b036640989ebbb4ce10af59d.jpg treat image : temp/1756420826_1088271_1377707977_266fb6246555f083c1132eb3381bc87d.jpg treat image : temp/1756420826_1088271_1377707958_654894bb3b4ae34fd13b8d689118995f.jpg treat image : temp/1756420826_1088271_1377707952_c3fde691db7601f3b3e84358f8d46526.jpg treat image : temp/1756420826_1088271_1377707951_defa9e14a85123018d8c7040b62c9278.jpg treat image : temp/1756420826_1088271_1377707949_42d48b65e7eb007fbdb630e65c4cb7c0.jpg treat image : temp/1756420826_1088271_1377707947_36561763ba05b84d04521335844415ab.jpg treat image : temp/1756420826_1088271_1377707936_025ffe000b99d953036eb0d0812db60a.jpg treat image : temp/1756420826_1088271_1377707931_f0c3d6bf7d6d376d1dc69ebe69453b61.jpg treat image : temp/1756420826_1088271_1377707927_21156b4f6c5c02daf0b281327fcfbe8f.jpg treat image : temp/1756420826_1088271_1377707923_7080fadd66c1f8859043186a730659a3.jpg treat image : temp/1756420826_1088271_1377707919_56879d39780b054a84799661806fa349.jpg treat image : temp/1756420826_1088271_1377707916_9ebd542d18909f67dc866e88355147ad.jpg treat image : temp/1756420826_1088271_1377708134_e60fd87abdf3852571f8ea9abeca05e4_rle_crop_3934843229_0.png treat image : temp/1756420826_1088271_1377708005_69779d7e9b8f6af527834c9816fa8de7_rle_crop_3934843235_0.png treat image : temp/1756420826_1088271_1377708004_79e4f19411971151d2175d86e7429f4f_rle_crop_3934843239_0.png treat image : temp/1756420826_1088271_1377708004_79e4f19411971151d2175d86e7429f4f_rle_crop_3934843241_0.png treat image : temp/1756420826_1088271_1377707995_0412ef8b5809378d7f02a51e0bb10f12_rle_crop_3934843243_0.png treat image : temp/1756420826_1088271_1377707995_0412ef8b5809378d7f02a51e0bb10f12_rle_crop_3934843245_0.png treat image : temp/1756420826_1088271_1377707985_7a02d9565db3d17e1e1c226c3d18a070_rle_crop_3934843254_0.png treat image : temp/1756420826_1088271_1377707985_7a02d9565db3d17e1e1c226c3d18a070_rle_crop_3934843256_0.png treat image : temp/1756420826_1088271_1377707977_266fb6246555f083c1132eb3381bc87d_rle_crop_3934843266_0.png treat image : temp/1756420826_1088271_1377707977_266fb6246555f083c1132eb3381bc87d_rle_crop_3934843267_0.png treat image : temp/1756420826_1088271_1377707958_654894bb3b4ae34fd13b8d689118995f_rle_crop_3934843269_0.png treat image : temp/1756420826_1088271_1377707952_c3fde691db7601f3b3e84358f8d46526_rle_crop_3934843273_0.png treat image : temp/1756420826_1088271_1377707952_c3fde691db7601f3b3e84358f8d46526_rle_crop_3934843274_0.png treat image : temp/1756420826_1088271_1377707949_42d48b65e7eb007fbdb630e65c4cb7c0_rle_crop_3934843279_0.png treat image : temp/1756420826_1088271_1377707947_36561763ba05b84d04521335844415ab_rle_crop_3934843281_0.png treat image : temp/1756420826_1088271_1377707936_025ffe000b99d953036eb0d0812db60a_rle_crop_3934843284_0.png treat image : temp/1756420826_1088271_1377707931_f0c3d6bf7d6d376d1dc69ebe69453b61_rle_crop_3934843286_0.png treat image : temp/1756420826_1088271_1377707931_f0c3d6bf7d6d376d1dc69ebe69453b61_rle_crop_3934843287_0.png treat image : temp/1756420826_1088271_1377707923_7080fadd66c1f8859043186a730659a3_rle_crop_3934843294_0.png treat image : temp/1756420826_1088271_1377707916_9ebd542d18909f67dc866e88355147ad_rle_crop_3934843298_0.png treat image : temp/1756420826_1088271_1377707927_21156b4f6c5c02daf0b281327fcfbe8f_rle_crop_3934843290_0.png treat image : temp/1756420826_1088271_1377707927_21156b4f6c5c02daf0b281327fcfbe8f_rle_crop_3934843292_0.png treat image : temp/1756420826_1088271_1377707986_3299b25ac2b08e5d46e8bd975c36ecf2_rle_crop_3934843249_0.png treat image : temp/1756420826_1088271_1377707984_52c858896113399d1c0f2eb07c40cf32_rle_crop_3934843259_0.png treat image : temp/1756420826_1088271_1377707951_defa9e14a85123018d8c7040b62c9278_rle_crop_3934843275_0.png treat image : temp/1756420826_1088271_1377708134_e60fd87abdf3852571f8ea9abeca05e4_rle_crop_3934843226_0.png treat image : temp/1756420826_1088271_1377708134_e60fd87abdf3852571f8ea9abeca05e4_rle_crop_3934843227_0.png treat image : temp/1756420826_1088271_1377708134_e60fd87abdf3852571f8ea9abeca05e4_rle_crop_3934843228_0.png treat image : temp/1756420826_1088271_1377708131_1a8c4fe7c2369c3c4ee510106d9b9875_rle_crop_3934843230_0.png treat image : temp/1756420826_1088271_1377708076_20ded815f9941a754b7b3d9e449ad73f_rle_crop_3934843232_0.png treat image : temp/1756420826_1088271_1377708072_948cc70ce38c2644f32a097176fc5bee_rle_crop_3934843233_0.png treat image : temp/1756420826_1088271_1377708061_9989af883616103f63dde34cd71db52e_rle_crop_3934843234_0.png treat image : temp/1756420826_1088271_1377708005_69779d7e9b8f6af527834c9816fa8de7_rle_crop_3934843236_0.png treat image : temp/1756420826_1088271_1377708005_69779d7e9b8f6af527834c9816fa8de7_rle_crop_3934843237_0.png treat image : temp/1756420826_1088271_1377708004_79e4f19411971151d2175d86e7429f4f_rle_crop_3934843238_0.png treat image : temp/1756420826_1088271_1377708004_79e4f19411971151d2175d86e7429f4f_rle_crop_3934843240_0.png treat image : temp/1756420826_1088271_1377707998_2d5bab6b96f53416bdbbb23e8e42d6bb_rle_crop_3934843242_0.png treat image : temp/1756420826_1088271_1377707995_0412ef8b5809378d7f02a51e0bb10f12_rle_crop_3934843244_0.png treat image : temp/1756420826_1088271_1377707995_0412ef8b5809378d7f02a51e0bb10f12_rle_crop_3934843246_0.png treat image : temp/1756420826_1088271_1377707995_0412ef8b5809378d7f02a51e0bb10f12_rle_crop_3934843247_0.png treat image : temp/1756420826_1088271_1377707995_0412ef8b5809378d7f02a51e0bb10f12_rle_crop_3934843248_0.png treat image : temp/1756420826_1088271_1377707986_3299b25ac2b08e5d46e8bd975c36ecf2_rle_crop_3934843250_0.png treat image : temp/1756420826_1088271_1377707986_3299b25ac2b08e5d46e8bd975c36ecf2_rle_crop_3934843251_0.png treat image : temp/1756420826_1088271_1377707986_3299b25ac2b08e5d46e8bd975c36ecf2_rle_crop_3934843252_0.png treat image : temp/1756420826_1088271_1377707985_7a02d9565db3d17e1e1c226c3d18a070_rle_crop_3934843255_0.png treat image : temp/1756420826_1088271_1377707984_52c858896113399d1c0f2eb07c40cf32_rle_crop_3934843257_0.png treat image : temp/1756420826_1088271_1377707984_52c858896113399d1c0f2eb07c40cf32_rle_crop_3934843258_0.png treat image : temp/1756420826_1088271_1377707982_84d36afe5ecda792df7aecf61a711cd3_rle_crop_3934843260_0.png treat image : temp/1756420826_1088271_1377707982_84d36afe5ecda792df7aecf61a711cd3_rle_crop_3934843261_0.png treat image : temp/1756420826_1088271_1377707982_84d36afe5ecda792df7aecf61a711cd3_rle_crop_3934843262_0.png treat image : temp/1756420826_1088271_1377707977_266fb6246555f083c1132eb3381bc87d_rle_crop_3934843265_0.png treat image : temp/1756420826_1088271_1377707958_654894bb3b4ae34fd13b8d689118995f_rle_crop_3934843268_0.png treat image : temp/1756420826_1088271_1377707958_654894bb3b4ae34fd13b8d689118995f_rle_crop_3934843270_0.png treat image : temp/1756420826_1088271_1377707952_c3fde691db7601f3b3e84358f8d46526_rle_crop_3934843271_0.png treat image : temp/1756420826_1088271_1377707952_c3fde691db7601f3b3e84358f8d46526_rle_crop_3934843272_0.png treat image : temp/1756420826_1088271_1377707951_defa9e14a85123018d8c7040b62c9278_rle_crop_3934843276_0.png treat image : temp/1756420826_1088271_1377707951_defa9e14a85123018d8c7040b62c9278_rle_crop_3934843277_0.png treat image : temp/1756420826_1088271_1377707949_42d48b65e7eb007fbdb630e65c4cb7c0_rle_crop_3934843278_0.png treat image : temp/1756420826_1088271_1377707947_36561763ba05b84d04521335844415ab_rle_crop_3934843280_0.png treat image : temp/1756420826_1088271_1377707947_36561763ba05b84d04521335844415ab_rle_crop_3934843282_0.png treat image : temp/1756420826_1088271_1377707936_025ffe000b99d953036eb0d0812db60a_rle_crop_3934843283_0.png treat image : temp/1756420826_1088271_1377707931_f0c3d6bf7d6d376d1dc69ebe69453b61_rle_crop_3934843285_0.png treat image : temp/1756420826_1088271_1377707931_f0c3d6bf7d6d376d1dc69ebe69453b61_rle_crop_3934843288_0.png treat image : temp/1756420826_1088271_1377707927_21156b4f6c5c02daf0b281327fcfbe8f_rle_crop_3934843289_0.png treat image : temp/1756420826_1088271_1377707927_21156b4f6c5c02daf0b281327fcfbe8f_rle_crop_3934843291_0.png treat image : temp/1756420826_1088271_1377707923_7080fadd66c1f8859043186a730659a3_rle_crop_3934843293_0.png treat image : temp/1756420826_1088271_1377707923_7080fadd66c1f8859043186a730659a3_rle_crop_3934843295_0.png treat image : temp/1756420826_1088271_1377707919_56879d39780b054a84799661806fa349_rle_crop_3934843296_0.png treat image : temp/1756420826_1088271_1377707916_9ebd542d18909f67dc866e88355147ad_rle_crop_3934843297_0.png treat image : temp/1756420826_1088271_1377707916_9ebd542d18909f67dc866e88355147ad_rle_crop_3934843299_0.png treat image : temp/1756420826_1088271_1377707916_9ebd542d18909f67dc866e88355147ad_rle_crop_3934843300_0.png treat image : temp/1756420826_1088271_1377708076_20ded815f9941a754b7b3d9e449ad73f_rle_crop_3934843231_0.png treat image : temp/1756420826_1088271_1377707986_3299b25ac2b08e5d46e8bd975c36ecf2_rle_crop_3934843253_0.png treat image : temp/1756420826_1088271_1377707982_84d36afe5ecda792df7aecf61a711cd3_rle_crop_3934843263_0.png treat image : temp/1756420826_1088271_1377707980_3f29ab04b036640989ebbb4ce10af59d_rle_crop_3934843264_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 104 time used for this insertion : 0.016105175018310547 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 104 time used for this insertion : 0.029430866241455078 save missing photos in datou_result : time spend for datou_step_exec : 8.076045989990234 time spend to save output : 0.05110979080200195 total time spend for step 7 : 8.127155780792236 step8:velours_tree Fri Aug 29 00:43:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09154510498046875 time spend to save output : 5.030632019042969e-05 total time spend for step 8 : 0.09159541130065918 step9:send_mail_cod Fri Aug 29 00:43:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26310895_29-08-2025_00_43_28.pdf 26311507 imagette263115071756421008 26311508 change filename to text .change filename to text .imagette263115081756421008 26311509 imagette263115091756421009 26311510 imagette263115101756421009 26311512 imagette263115121756421009 26311513 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette263115131756421009 26311514 imagette263115141756421010 26311515 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette263115151756421010 26311516 change filename to text .change filename to text .change filename to text .change filename to text .imagette263115161756421011 26311517 change filename to text .change filename to text .change filename to text .imagette263115171756421012 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26310895 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/26311507,26311508,26311509,26311510,26311511,26311512,26311513,26311514,26311515,26311516,26311517?tags=pet_fonce,carton,mal_croppe,flou,environnement,pehd,papier,background,pet_clair,autre,metal args[1377708134] : ((1377708134, -2.2660148447646744, 492609224), (1377708134, 0.5683040772161363, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377708131] : ((1377708131, -2.611956291199049, 492609224), (1377708131, 0.6230213386540195, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377708076] : ((1377708076, -2.4282897047822805, 492609224), (1377708076, 0.3063738579917422, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377708072] : ((1377708072, -0.4316452315896747, 492688767), (1377708072, 0.5612472293074363, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377708069] : ((1377708069, -2.022056253905477, 492609224), (1377708069, 0.598139227574744, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377708066] : ((1377708066, -0.22042092807561353, 492688767), (1377708066, 0.6400839549810905, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377708061] : ((1377708061, -1.7628602952966084, 492688767), (1377708061, 0.3873061984161255, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377708041] : ((1377708041, -2.523400795226436, 492609224), (1377708041, 0.5504912572455221, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377708005] : ((1377708005, -1.919248437443477, 492688767), (1377708005, 0.5500250225939451, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377708004] : ((1377708004, -4.571757207357783, 492609224), (1377708004, 0.43287671703523894, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377707998] : ((1377707998, -3.387280017586429, 492609224), (1377707998, 0.5796786129729734, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377707995] : ((1377707995, -2.4263013091536765, 492609224), (1377707995, 0.37271160341106896, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377707986] : ((1377707986, -1.8161704182331109, 492688767), (1377707986, 0.8087740034256627, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377707985] : ((1377707985, -2.4181146928241257, 492609224), (1377707985, 0.46857963748190895, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377707984] : ((1377707984, -2.4987913221068387, 492609224), (1377707984, 0.5914010535260448, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377707982] : ((1377707982, -1.775634109017045, 492688767), (1377707982, 0.48894024876519554, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377707980] : ((1377707980, -1.6198001912420439, 492688767), (1377707980, 0.48867596869117436, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377707977] : ((1377707977, -1.0904327635605962, 492688767), (1377707977, 0.5753597029523088, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377707958] : ((1377707958, -4.267654555979737, 492609224), (1377707958, 0.38036529924651347, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377707952] : ((1377707952, -2.808070133610467, 492609224), (1377707952, 0.29070678842292685, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377707951] : ((1377707951, -3.3091313703883367, 492609224), (1377707951, 0.4863018117510954, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377707949] : ((1377707949, -2.4921358329118473, 492609224), (1377707949, 0.4977230173871201, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377707947] : ((1377707947, -1.3889165899245126, 492688767), (1377707947, 0.6743325937536326, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377707936] : ((1377707936, -2.1639785732889107, 492609224), (1377707936, 0.5004986101442421, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377707931] : ((1377707931, -3.7257962989600957, 492609224), (1377707931, 0.43580744333932003, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377707927] : ((1377707927, -2.9763811181914988, 492609224), (1377707927, 0.5080685111561674, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377707923] : ((1377707923, -4.116575254236795, 492609224), (1377707923, 0.42932128363167127, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377707919] : ((1377707919, -2.6335467382809736, 492609224), (1377707919, 0.5875879960490707, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com args[1377707916] : ((1377707916, -2.013887011561861, 492609224), (1377707916, 0.4870789352612122, 2107752395), '0.17703582308961255') We are sending mail with results at report@fotonower.com refus_total : 0.17703582308961255 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26310895 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26310895_29-08-2025_00_43_28.pdf results_Auto_P26310895_29-08-2025_00_43_28.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26310895_29-08-2025_00_43_28.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26310895','results_Auto_P26310895_29-08-2025_00_43_28.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26310895_29-08-2025_00_43_28.pdf','pdf','','0.8','0.17703582308961255') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26310895

https://www.fotonower.com/image?json=false&list_photos_id=1377708134
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377708131
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377708076
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377708072
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377708069
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377708066
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377708061
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377708041
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377708005
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377708004
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707998
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707995
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707986
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707985
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707984
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707982
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707980
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707977
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707958
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707952
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707951
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707949
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707947
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707936
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707931
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707927
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707923
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707919
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377707916
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 17.70%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/26311508?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26311513?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26311515?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/26311516?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/26311517?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26310895_29-08-2025_00_43_28.pdf.

Lien vers velours :https://www.fotonower.com/velours/26311507,26311508,26311509,26311510,26311511,26311512,26311513,26311514,26311515,26311516,26311517?tags=pet_fonce,carton,mal_croppe,flou,environnement,pehd,papier,background,pet_clair,autre,metal.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 28 Aug 2025 22:43:35 GMT Content-Length: 0 Connection: close X-Message-Id: IKRA_xIFQ1e4maQxViWJhQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1377708134, 1377708131, 1377708076, 1377708072, 1377708069, 1377708066, 1377708061, 1377708041, 1377708005, 1377708004, 1377707998, 1377707995, 1377707986, 1377707985, 1377707984, 1377707982, 1377707980, 1377707977, 1377707958, 1377707952, 1377707951, 1377707949, 1377707947, 1377707936, 1377707931, 1377707927, 1377707923, 1377707919, 1377707916] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708134', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708131', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708076', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708072', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708069', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708066', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708061', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708041', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708005', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708004', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707998', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707995', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707986', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707985', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707984', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707982', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707980', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707977', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707958', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707952', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707951', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707949', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707947', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707936', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707931', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707927', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707923', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707919', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707916', None, None, None, None, None, '3629933') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 29 time used for this insertion : 0.34807872772216797 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.403737545013428 time spend to save output : 0.34851813316345215 total time spend for step 9 : 6.75225567817688 step10:split_time_score Fri Aug 29 00:43:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 29),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 18082025 26310895 Nombre de photos uploadées : 29 / 23040 (0%) 18082025 26310895 Nombre de photos taguées (types de déchets): 0 / 29 (0%) 18082025 26310895 Nombre de photos taguées (volume) : 0 / 29 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 7.867813110351562e-06 ????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0008974075317382812 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2834787368774414 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310847 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310850 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310854 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310857 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310862 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310866 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310868 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310871 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310873 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310881 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310883 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310890 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310894 order by id desc limit 1 Qualite : 0.17703582308961255 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26310895_29-08-2025_00_43_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310895 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26310895 AND mptpi.`type`=3594 To do Qualite : 0.3151915147569445 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26310908_29-08-2025_00_32_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26310908 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26310908 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'18082025': {'nb_upload': 29, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1377708134, 1377708131, 1377708076, 1377708072, 1377708069, 1377708066, 1377708061, 1377708041, 1377708005, 1377708004, 1377707998, 1377707995, 1377707986, 1377707985, 1377707984, 1377707982, 1377707980, 1377707977, 1377707958, 1377707952, 1377707951, 1377707949, 1377707947, 1377707936, 1377707931, 1377707927, 1377707923, 1377707919, 1377707916] Looping around the photos to save general results len do output : 1 /26310895Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708134', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708131', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708076', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708072', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708069', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708066', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708061', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708041', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708005', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377708004', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707998', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707995', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707986', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707985', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707984', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707982', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707980', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707977', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707958', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707952', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707951', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707949', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707947', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707936', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707931', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707927', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707923', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707919', None, None, None, None, None, '3629933') ('3318', None, None, None, None, None, None, None, '3629933') ('3318', '26310895', '1377707916', None, None, None, None, None, '3629933') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.01837444305419922 save_final save missing photos in datou_result : time spend for datou_step_exec : 12.565690279006958 time spend to save output : 0.0187530517578125 total time spend for step 10 : 12.58444333076477 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 29 set_done_treatment 115.43user 38.18system 3:23.40elapsed 75%CPU (0avgtext+0avgdata 2857580maxresident)k 599448inputs+77896outputs (6250major+2718350minor)pagefaults 0swaps