python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2127457 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2794465'] with mtr_portfolio_ids : ['22693112'] and first list_photo_ids : [] new path : /proc/2127457/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 9 ; length of list_pids : 9 ; length of list_args : 9 time to download the photos : 1.3355274200439453 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon May 5 20:10:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 7035 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-05 20:10:34.390538: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-05 20:10:34.419077: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-05 20:10:34.421419: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f22e4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-05 20:10:34.421466: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-05 20:10:34.426138: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-05 20:10:34.584354: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x29db6e00 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-05 20:10:34.584452: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-05 20:10:34.586068: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-05 20:10:34.586708: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-05 20:10:34.590328: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-05 20:10:34.593425: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-05 20:10:34.594001: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-05 20:10:34.597306: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-05 20:10:34.599026: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-05 20:10:34.606590: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-05 20:10:34.608619: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-05 20:10:34.608761: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-05 20:10:34.609603: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-05 20:10:34.609625: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-05 20:10:34.609636: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-05 20:10:34.611558: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6327 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-05 20:10:34.968723: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-05 20:10:34.968805: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-05 20:10:34.968825: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-05 20:10:34.968844: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-05 20:10:34.968862: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-05 20:10:34.968879: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-05 20:10:34.968899: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-05 20:10:34.968922: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-05 20:10:34.970255: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-05 20:10:34.971791: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-05 20:10:34.971853: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-05 20:10:34.971874: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-05 20:10:34.971893: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-05 20:10:34.971909: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-05 20:10:34.971927: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-05 20:10:34.971942: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-05 20:10:34.971957: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-05 20:10:34.973017: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-05 20:10:34.973051: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-05 20:10:34.973060: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-05 20:10:34.973068: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-05 20:10:34.974186: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6327 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-05 20:10:46.455496: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-05 20:10:46.733702: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-05 20:10:48.333553: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.334215: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.334797: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.335345: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.335929: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.336511: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2536134912 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.337044: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2282521344 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.337072: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-05 20:10:48.337760: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.337784: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-05 20:10:48.344491: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.344530: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-05 20:10:48.345238: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.345265: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-05 20:10:48.351586: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.351653: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-05 20:10:48.352387: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.352414: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-05 20:10:48.380736: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.380851: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-05 20:10:48.381537: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.381573: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-05 20:10:48.388053: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.388172: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-05 20:10:48.389110: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.389152: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-05 20:10:48.420526: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.421153: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.423002: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.423639: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.464567: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.465263: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.467516: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.468105: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.500110: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.500700: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.502362: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.502949: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.510778: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.511427: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.513165: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.513743: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.520791: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.521407: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.523047: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.523613: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.575365: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.575949: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.576482: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.577041: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.580788: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.581364: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.597295: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.597876: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.598399: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.598941: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.611660: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.612305: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.612885: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.613457: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.617949: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.618492: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.623527: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.624095: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.636453: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.637038: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.641274: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.641856: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.642400: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.642946: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.643674: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.644249: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.655131: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.655676: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.656235: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.656764: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.657326: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.657905: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.658482: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.659078: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.668412: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.668981: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.675350: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.675964: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.746456: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.746522: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-05-05 20:10:48.747617: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.748653: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.756274: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.756895: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.757529: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.758129: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.766416: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.767041: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.787345: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.788168: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.788924: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.789646: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.794232: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.794879: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.795472: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.796067: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.797477: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.807888: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.808582: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.818216: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.818878: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.819506: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.820131: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.820736: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-05 20:10:48.821309: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 9 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 69 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 48 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 10.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 43 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 11.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 27 Detection mask done ! Trying to reset tf kernel 2128209 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4430 tf kernel not reseted sub process len(results) : 9 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 9 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5621 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0014939308166503906 nb_pixel_total : 45419 time to create 1 rle with old method : 0.07828950881958008 length of segment : 322 time for calcul the mask position with numpy : 0.003490924835205078 nb_pixel_total : 85295 time to create 1 rle with old method : 0.11980843544006348 length of segment : 495 time for calcul the mask position with numpy : 0.0017282962799072266 nb_pixel_total : 83206 time to create 1 rle with old method : 0.0975191593170166 length of segment : 443 time for calcul the mask position with numpy : 0.00034046173095703125 nb_pixel_total : 15153 time to create 1 rle with old method : 0.018362760543823242 length of segment : 138 time for calcul the mask position with numpy : 0.00202178955078125 nb_pixel_total : 114355 time to create 1 rle with old method : 0.15011000633239746 length of segment : 294 time for calcul the mask position with numpy : 0.5725853443145752 nb_pixel_total : 1448008 time to create 1 rle with new method : 0.12687015533447266 length of segment : 1498 time for calcul the mask position with numpy : 0.00525665283203125 nb_pixel_total : 201811 time to create 1 rle with new method : 0.0165560245513916 length of segment : 1137 time for calcul the mask position with numpy : 0.0006101131439208984 nb_pixel_total : 25284 time to create 1 rle with old method : 0.03150057792663574 length of segment : 258 time for calcul the mask position with numpy : 0.0014548301696777344 nb_pixel_total : 77407 time to create 1 rle with old method : 0.11027359962463379 length of segment : 375 time for calcul the mask position with numpy : 0.0037670135498046875 nb_pixel_total : 251205 time to create 1 rle with new method : 0.009240388870239258 length of segment : 549 time for calcul the mask position with numpy : 0.01470327377319336 nb_pixel_total : 810334 time to create 1 rle with new method : 0.10240435600280762 length of segment : 1492 time for calcul the mask position with numpy : 0.0006456375122070312 nb_pixel_total : 21295 time to create 1 rle with old method : 0.025669574737548828 length of segment : 252 time for calcul the mask position with numpy : 0.001978635787963867 nb_pixel_total : 121033 time to create 1 rle with old method : 0.14235234260559082 length of segment : 483 time for calcul the mask position with numpy : 0.0006642341613769531 nb_pixel_total : 32324 time to create 1 rle with old method : 0.044155120849609375 length of segment : 133 time for calcul the mask position with numpy : 0.0021805763244628906 nb_pixel_total : 91525 time to create 1 rle with old method : 0.11432766914367676 length of segment : 510 time for calcul the mask position with numpy : 0.002057313919067383 nb_pixel_total : 81838 time to create 1 rle with old method : 0.10394477844238281 length of segment : 286 time for calcul the mask position with numpy : 0.0013325214385986328 nb_pixel_total : 48781 time to create 1 rle with old method : 0.0670616626739502 length of segment : 443 time for calcul the mask position with numpy : 0.0029947757720947266 nb_pixel_total : 96467 time to create 1 rle with old method : 0.12406301498413086 length of segment : 492 time for calcul the mask position with numpy : 0.003572225570678711 nb_pixel_total : 143975 time to create 1 rle with old method : 0.18747377395629883 length of segment : 533 time for calcul the mask position with numpy : 0.0010297298431396484 nb_pixel_total : 31926 time to create 1 rle with old method : 0.055512189865112305 length of segment : 246 time for calcul the mask position with numpy : 0.012489080429077148 nb_pixel_total : 437421 time to create 1 rle with new method : 0.26259422302246094 length of segment : 891 time for calcul the mask position with numpy : 0.002592325210571289 nb_pixel_total : 132675 time to create 1 rle with old method : 0.1780257225036621 length of segment : 555 time for calcul the mask position with numpy : 0.0024302005767822266 nb_pixel_total : 126184 time to create 1 rle with old method : 0.1541128158569336 length of segment : 534 time for calcul the mask position with numpy : 0.003812551498413086 nb_pixel_total : 141781 time to create 1 rle with old method : 0.16394686698913574 length of segment : 723 time for calcul the mask position with numpy : 0.0006320476531982422 nb_pixel_total : 24357 time to create 1 rle with old method : 0.029135942459106445 length of segment : 201 time for calcul the mask position with numpy : 0.002104043960571289 nb_pixel_total : 96756 time to create 1 rle with old method : 0.11367368698120117 length of segment : 417 time for calcul the mask position with numpy : 0.0013561248779296875 nb_pixel_total : 72166 time to create 1 rle with old method : 0.08886075019836426 length of segment : 276 time for calcul the mask position with numpy : 0.0008161067962646484 nb_pixel_total : 10671 time to create 1 rle with old method : 0.013151884078979492 length of segment : 136 time for calcul the mask position with numpy : 0.0009975433349609375 nb_pixel_total : 9965 time to create 1 rle with old method : 0.012365579605102539 length of segment : 138 time for calcul the mask position with numpy : 0.003506898880004883 nb_pixel_total : 49309 time to create 1 rle with old method : 0.05846118927001953 length of segment : 368 time for calcul the mask position with numpy : 0.002886533737182617 nb_pixel_total : 38922 time to create 1 rle with old method : 0.08316564559936523 length of segment : 325 time for calcul the mask position with numpy : 0.0031707286834716797 nb_pixel_total : 52259 time to create 1 rle with old method : 0.06124424934387207 length of segment : 299 time for calcul the mask position with numpy : 0.002510547637939453 nb_pixel_total : 36854 time to create 1 rle with old method : 0.0440211296081543 length of segment : 299 time for calcul the mask position with numpy : 0.0016741752624511719 nb_pixel_total : 24208 time to create 1 rle with old method : 0.029094696044921875 length of segment : 268 time for calcul the mask position with numpy : 0.007784366607666016 nb_pixel_total : 110248 time to create 1 rle with old method : 0.13027572631835938 length of segment : 494 time for calcul the mask position with numpy : 0.0007290840148925781 nb_pixel_total : 11553 time to create 1 rle with old method : 0.013906240463256836 length of segment : 123 time for calcul the mask position with numpy : 0.006121158599853516 nb_pixel_total : 103535 time to create 1 rle with old method : 0.12798023223876953 length of segment : 280 time for calcul the mask position with numpy : 0.0011966228485107422 nb_pixel_total : 20207 time to create 1 rle with old method : 0.023844242095947266 length of segment : 196 time for calcul the mask position with numpy : 0.00206756591796875 nb_pixel_total : 38299 time to create 1 rle with old method : 0.04968571662902832 length of segment : 387 time for calcul the mask position with numpy : 0.0003554821014404297 nb_pixel_total : 11199 time to create 1 rle with old method : 0.013686656951904297 length of segment : 124 time for calcul the mask position with numpy : 0.0009810924530029297 nb_pixel_total : 19571 time to create 1 rle with old method : 0.031337738037109375 length of segment : 146 time for calcul the mask position with numpy : 0.0011715888977050781 nb_pixel_total : 26953 time to create 1 rle with old method : 0.03654026985168457 length of segment : 133 time for calcul the mask position with numpy : 0.0005486011505126953 nb_pixel_total : 10533 time to create 1 rle with old method : 0.01275324821472168 length of segment : 143 time for calcul the mask position with numpy : 0.006170511245727539 nb_pixel_total : 89627 time to create 1 rle with old method : 0.12438702583312988 length of segment : 321 time for calcul the mask position with numpy : 0.0012812614440917969 nb_pixel_total : 20774 time to create 1 rle with old method : 0.026639699935913086 length of segment : 220 time for calcul the mask position with numpy : 0.011044502258300781 nb_pixel_total : 276561 time to create 1 rle with new method : 0.012806177139282227 length of segment : 367 time for calcul the mask position with numpy : 0.0019788742065429688 nb_pixel_total : 37215 time to create 1 rle with old method : 0.04726386070251465 length of segment : 281 time for calcul the mask position with numpy : 0.0011217594146728516 nb_pixel_total : 11002 time to create 1 rle with old method : 0.013595104217529297 length of segment : 172 time for calcul the mask position with numpy : 0.0008356571197509766 nb_pixel_total : 14118 time to create 1 rle with old method : 0.017151832580566406 length of segment : 169 time for calcul the mask position with numpy : 0.003574848175048828 nb_pixel_total : 47549 time to create 1 rle with old method : 0.05663037300109863 length of segment : 667 time for calcul the mask position with numpy : 0.0040378570556640625 nb_pixel_total : 58718 time to create 1 rle with old method : 0.06900262832641602 length of segment : 385 time for calcul the mask position with numpy : 0.00032973289489746094 nb_pixel_total : 6499 time to create 1 rle with old method : 0.007986783981323242 length of segment : 104 time for calcul the mask position with numpy : 0.0010752677917480469 nb_pixel_total : 7253 time to create 1 rle with old method : 0.009122133255004883 length of segment : 161 time for calcul the mask position with numpy : 0.003473997116088867 nb_pixel_total : 57995 time to create 1 rle with old method : 0.0712895393371582 length of segment : 317 time for calcul the mask position with numpy : 0.0014696121215820312 nb_pixel_total : 28334 time to create 1 rle with old method : 0.03432655334472656 length of segment : 162 time for calcul the mask position with numpy : 0.0006806850433349609 nb_pixel_total : 10421 time to create 1 rle with old method : 0.012735843658447266 length of segment : 160 time for calcul the mask position with numpy : 0.0008795261383056641 nb_pixel_total : 15133 time to create 1 rle with old method : 0.01889801025390625 length of segment : 130 time for calcul the mask position with numpy : 0.0006000995635986328 nb_pixel_total : 7414 time to create 1 rle with old method : 0.009102344512939453 length of segment : 113 time for calcul the mask position with numpy : 0.0006349086761474609 nb_pixel_total : 13579 time to create 1 rle with old method : 0.016322612762451172 length of segment : 186 time for calcul the mask position with numpy : 0.0005567073822021484 nb_pixel_total : 19248 time to create 1 rle with old method : 0.02321314811706543 length of segment : 165 time for calcul the mask position with numpy : 0.0030090808868408203 nb_pixel_total : 47249 time to create 1 rle with old method : 0.05998563766479492 length of segment : 289 time for calcul the mask position with numpy : 0.0010712146759033203 nb_pixel_total : 22685 time to create 1 rle with old method : 0.02764606475830078 length of segment : 155 time for calcul the mask position with numpy : 0.004536628723144531 nb_pixel_total : 89294 time to create 1 rle with old method : 0.10395383834838867 length of segment : 474 time for calcul the mask position with numpy : 0.0009121894836425781 nb_pixel_total : 13344 time to create 1 rle with old method : 0.01643991470336914 length of segment : 148 time for calcul the mask position with numpy : 0.0012850761413574219 nb_pixel_total : 44158 time to create 1 rle with old method : 0.05172586441040039 length of segment : 332 time for calcul the mask position with numpy : 0.0012826919555664062 nb_pixel_total : 23960 time to create 1 rle with old method : 0.028749465942382812 length of segment : 200 time for calcul the mask position with numpy : 0.0012974739074707031 nb_pixel_total : 17090 time to create 1 rle with old method : 0.020464420318603516 length of segment : 229 time for calcul the mask position with numpy : 0.0023686885833740234 nb_pixel_total : 49529 time to create 1 rle with old method : 0.060547828674316406 length of segment : 323 time for calcul the mask position with numpy : 0.0006327629089355469 nb_pixel_total : 9380 time to create 1 rle with old method : 0.011531591415405273 length of segment : 126 time for calcul the mask position with numpy : 0.0013058185577392578 nb_pixel_total : 20449 time to create 1 rle with old method : 0.026728153228759766 length of segment : 138 time for calcul the mask position with numpy : 0.0027604103088378906 nb_pixel_total : 44369 time to create 1 rle with old method : 0.06952595710754395 length of segment : 316 time for calcul the mask position with numpy : 0.0012652873992919922 nb_pixel_total : 13708 time to create 1 rle with old method : 0.02034759521484375 length of segment : 297 time for calcul the mask position with numpy : 0.003987312316894531 nb_pixel_total : 52242 time to create 1 rle with old method : 0.07712459564208984 length of segment : 476 time for calcul the mask position with numpy : 0.00244903564453125 nb_pixel_total : 33414 time to create 1 rle with old method : 0.03955531120300293 length of segment : 321 time for calcul the mask position with numpy : 0.004183769226074219 nb_pixel_total : 80937 time to create 1 rle with old method : 0.12201356887817383 length of segment : 444 time for calcul the mask position with numpy : 0.0030782222747802734 nb_pixel_total : 54206 time to create 1 rle with old method : 0.06295609474182129 length of segment : 246 time for calcul the mask position with numpy : 0.0022466182708740234 nb_pixel_total : 38757 time to create 1 rle with old method : 0.04628252983093262 length of segment : 267 time for calcul the mask position with numpy : 0.0015749931335449219 nb_pixel_total : 35293 time to create 1 rle with old method : 0.042090415954589844 length of segment : 188 time for calcul the mask position with numpy : 0.0023508071899414062 nb_pixel_total : 44256 time to create 1 rle with old method : 0.05167651176452637 length of segment : 310 time for calcul the mask position with numpy : 0.0009088516235351562 nb_pixel_total : 10039 time to create 1 rle with old method : 0.013667821884155273 length of segment : 149 time for calcul the mask position with numpy : 0.0018072128295898438 nb_pixel_total : 32277 time to create 1 rle with old method : 0.038336753845214844 length of segment : 271 time for calcul the mask position with numpy : 0.0021326541900634766 nb_pixel_total : 51323 time to create 1 rle with old method : 0.06281137466430664 length of segment : 310 time for calcul the mask position with numpy : 0.0005128383636474609 nb_pixel_total : 7228 time to create 1 rle with old method : 0.008706808090209961 length of segment : 95 time for calcul the mask position with numpy : 0.0003521442413330078 nb_pixel_total : 5015 time to create 1 rle with old method : 0.006364107131958008 length of segment : 72 time for calcul the mask position with numpy : 0.0009500980377197266 nb_pixel_total : 12718 time to create 1 rle with old method : 0.01523590087890625 length of segment : 265 time for calcul the mask position with numpy : 0.0007264614105224609 nb_pixel_total : 18779 time to create 1 rle with old method : 0.02213120460510254 length of segment : 146 time for calcul the mask position with numpy : 0.026579618453979492 nb_pixel_total : 657892 time to create 1 rle with new method : 0.05253195762634277 length of segment : 1241 time for calcul the mask position with numpy : 0.0011646747589111328 nb_pixel_total : 14045 time to create 1 rle with old method : 0.01706695556640625 length of segment : 184 time for calcul the mask position with numpy : 0.0007071495056152344 nb_pixel_total : 21426 time to create 1 rle with old method : 0.02603626251220703 length of segment : 166 time for calcul the mask position with numpy : 0.0002193450927734375 nb_pixel_total : 1918 time to create 1 rle with old method : 0.0024421215057373047 length of segment : 94 time for calcul the mask position with numpy : 0.0009717941284179688 nb_pixel_total : 18830 time to create 1 rle with old method : 0.022548437118530273 length of segment : 149 time for calcul the mask position with numpy : 0.0006418228149414062 nb_pixel_total : 10559 time to create 1 rle with old method : 0.012689590454101562 length of segment : 213 time for calcul the mask position with numpy : 0.004197835922241211 nb_pixel_total : 95259 time to create 1 rle with old method : 0.12002849578857422 length of segment : 338 time for calcul the mask position with numpy : 0.0007507801055908203 nb_pixel_total : 12739 time to create 1 rle with old method : 0.015321969985961914 length of segment : 156 time for calcul the mask position with numpy : 0.0011744499206542969 nb_pixel_total : 21284 time to create 1 rle with old method : 0.026760101318359375 length of segment : 156 time for calcul the mask position with numpy : 0.0037539005279541016 nb_pixel_total : 75689 time to create 1 rle with old method : 0.08934307098388672 length of segment : 432 time for calcul the mask position with numpy : 0.0004744529724121094 nb_pixel_total : 7306 time to create 1 rle with old method : 0.008942842483520508 length of segment : 82 time for calcul the mask position with numpy : 0.0015597343444824219 nb_pixel_total : 28716 time to create 1 rle with old method : 0.034154653549194336 length of segment : 281 time for calcul the mask position with numpy : 0.001394033432006836 nb_pixel_total : 23946 time to create 1 rle with old method : 0.02838921546936035 length of segment : 260 time for calcul the mask position with numpy : 0.0011034011840820312 nb_pixel_total : 26143 time to create 1 rle with old method : 0.03158164024353027 length of segment : 162 time for calcul the mask position with numpy : 0.0012257099151611328 nb_pixel_total : 29504 time to create 1 rle with old method : 0.03485393524169922 length of segment : 179 time for calcul the mask position with numpy : 0.0019142627716064453 nb_pixel_total : 50298 time to create 1 rle with old method : 0.06681704521179199 length of segment : 148 time for calcul the mask position with numpy : 0.0010173320770263672 nb_pixel_total : 15533 time to create 1 rle with old method : 0.018858909606933594 length of segment : 137 time for calcul the mask position with numpy : 0.0009412765502929688 nb_pixel_total : 15737 time to create 1 rle with old method : 0.018846750259399414 length of segment : 142 time for calcul the mask position with numpy : 0.0019252300262451172 nb_pixel_total : 40937 time to create 1 rle with old method : 0.04791760444641113 length of segment : 321 time for calcul the mask position with numpy : 0.003113985061645508 nb_pixel_total : 99309 time to create 1 rle with old method : 0.11464238166809082 length of segment : 548 time for calcul the mask position with numpy : 0.0002727508544921875 nb_pixel_total : 3847 time to create 1 rle with old method : 0.004664421081542969 length of segment : 80 time for calcul the mask position with numpy : 0.0041811466217041016 nb_pixel_total : 83264 time to create 1 rle with old method : 0.09879016876220703 length of segment : 311 time for calcul the mask position with numpy : 0.004187107086181641 nb_pixel_total : 113510 time to create 1 rle with old method : 0.1349039077758789 length of segment : 434 time for calcul the mask position with numpy : 0.0008673667907714844 nb_pixel_total : 12731 time to create 1 rle with old method : 0.01499629020690918 length of segment : 193 time for calcul the mask position with numpy : 0.0005276203155517578 nb_pixel_total : 7528 time to create 1 rle with old method : 0.009014368057250977 length of segment : 152 time for calcul the mask position with numpy : 0.0034706592559814453 nb_pixel_total : 83554 time to create 1 rle with old method : 0.11459589004516602 length of segment : 551 time for calcul the mask position with numpy : 0.002469778060913086 nb_pixel_total : 70520 time to create 1 rle with old method : 0.08178591728210449 length of segment : 415 time for calcul the mask position with numpy : 0.0005676746368408203 nb_pixel_total : 11372 time to create 1 rle with old method : 0.01355290412902832 length of segment : 113 time for calcul the mask position with numpy : 0.0004928112030029297 nb_pixel_total : 9975 time to create 1 rle with old method : 0.013708114624023438 length of segment : 110 time for calcul the mask position with numpy : 0.0008137226104736328 nb_pixel_total : 20916 time to create 1 rle with old method : 0.02379012107849121 length of segment : 197 time for calcul the mask position with numpy : 0.0006577968597412109 nb_pixel_total : 20501 time to create 1 rle with old method : 0.02470684051513672 length of segment : 160 time for calcul the mask position with numpy : 0.0014750957489013672 nb_pixel_total : 30284 time to create 1 rle with old method : 0.03569197654724121 length of segment : 213 time for calcul the mask position with numpy : 0.0008485317230224609 nb_pixel_total : 18310 time to create 1 rle with old method : 0.0232088565826416 length of segment : 199 time for calcul the mask position with numpy : 0.0008425712585449219 nb_pixel_total : 10322 time to create 1 rle with old method : 0.012293815612792969 length of segment : 169 time for calcul the mask position with numpy : 0.0011453628540039062 nb_pixel_total : 23413 time to create 1 rle with old method : 0.03397822380065918 length of segment : 163 time for calcul the mask position with numpy : 0.0010170936584472656 nb_pixel_total : 25279 time to create 1 rle with old method : 0.030002593994140625 length of segment : 164 time for calcul the mask position with numpy : 0.0013175010681152344 nb_pixel_total : 13594 time to create 1 rle with old method : 0.016571998596191406 length of segment : 174 time for calcul the mask position with numpy : 0.00043511390686035156 nb_pixel_total : 6189 time to create 1 rle with old method : 0.007374763488769531 length of segment : 159 time for calcul the mask position with numpy : 0.0016694068908691406 nb_pixel_total : 49955 time to create 1 rle with old method : 0.058205604553222656 length of segment : 370 time for calcul the mask position with numpy : 0.0008301734924316406 nb_pixel_total : 14272 time to create 1 rle with old method : 0.017074108123779297 length of segment : 175 time for calcul the mask position with numpy : 0.0007624626159667969 nb_pixel_total : 17587 time to create 1 rle with old method : 0.021072864532470703 length of segment : 172 time for calcul the mask position with numpy : 0.003901958465576172 nb_pixel_total : 78071 time to create 1 rle with old method : 0.0915212631225586 length of segment : 746 time for calcul the mask position with numpy : 0.0005364418029785156 nb_pixel_total : 15751 time to create 1 rle with old method : 0.01889204978942871 length of segment : 153 time for calcul the mask position with numpy : 0.005544185638427734 nb_pixel_total : 168935 time to create 1 rle with new method : 0.012995481491088867 length of segment : 853 time for calcul the mask position with numpy : 0.000644683837890625 nb_pixel_total : 25059 time to create 1 rle with old method : 0.029367923736572266 length of segment : 332 time for calcul the mask position with numpy : 0.0024352073669433594 nb_pixel_total : 115607 time to create 1 rle with old method : 0.13587403297424316 length of segment : 414 time for calcul the mask position with numpy : 0.0007059574127197266 nb_pixel_total : 20375 time to create 1 rle with old method : 0.024288415908813477 length of segment : 209 time for calcul the mask position with numpy : 0.007529735565185547 nb_pixel_total : 367724 time to create 1 rle with new method : 0.015036582946777344 length of segment : 759 time for calcul the mask position with numpy : 0.0013310909271240234 nb_pixel_total : 35528 time to create 1 rle with old method : 0.04276108741760254 length of segment : 274 time for calcul the mask position with numpy : 0.010313987731933594 nb_pixel_total : 556246 time to create 1 rle with new method : 0.03231215476989746 length of segment : 817 time for calcul the mask position with numpy : 0.0038759708404541016 nb_pixel_total : 192077 time to create 1 rle with new method : 0.008433818817138672 length of segment : 410 time for calcul the mask position with numpy : 0.0005369186401367188 nb_pixel_total : 13799 time to create 1 rle with old method : 0.016383886337280273 length of segment : 113 time for calcul the mask position with numpy : 0.0005402565002441406 nb_pixel_total : 15745 time to create 1 rle with old method : 0.01896834373474121 length of segment : 135 time for calcul the mask position with numpy : 0.011855363845825195 nb_pixel_total : 421446 time to create 1 rle with new method : 0.015770673751831055 length of segment : 999 time for calcul the mask position with numpy : 0.0005738735198974609 nb_pixel_total : 12384 time to create 1 rle with old method : 0.015035152435302734 length of segment : 143 time for calcul the mask position with numpy : 0.0012760162353515625 nb_pixel_total : 33465 time to create 1 rle with old method : 0.041104793548583984 length of segment : 219 time for calcul the mask position with numpy : 0.001768350601196289 nb_pixel_total : 56604 time to create 1 rle with old method : 0.0748136043548584 length of segment : 271 time for calcul the mask position with numpy : 0.0005550384521484375 nb_pixel_total : 14991 time to create 1 rle with old method : 0.01848459243774414 length of segment : 152 time for calcul the mask position with numpy : 0.0008440017700195312 nb_pixel_total : 9674 time to create 1 rle with old method : 0.018032312393188477 length of segment : 131 time for calcul the mask position with numpy : 0.0023801326751708984 nb_pixel_total : 31400 time to create 1 rle with old method : 0.06589674949645996 length of segment : 289 time for calcul the mask position with numpy : 0.0006868839263916016 nb_pixel_total : 15635 time to create 1 rle with old method : 0.01873779296875 length of segment : 163 time for calcul the mask position with numpy : 0.0006957054138183594 nb_pixel_total : 12165 time to create 1 rle with old method : 0.01645946502685547 length of segment : 181 time for calcul the mask position with numpy : 0.000728607177734375 nb_pixel_total : 17273 time to create 1 rle with old method : 0.021184921264648438 length of segment : 154 time for calcul the mask position with numpy : 0.00064849853515625 nb_pixel_total : 19113 time to create 1 rle with old method : 0.025279998779296875 length of segment : 245 time for calcul the mask position with numpy : 0.0006639957427978516 nb_pixel_total : 20649 time to create 1 rle with old method : 0.024703025817871094 length of segment : 161 time for calcul the mask position with numpy : 0.0015251636505126953 nb_pixel_total : 30222 time to create 1 rle with old method : 0.03846621513366699 length of segment : 314 time for calcul the mask position with numpy : 0.0009703636169433594 nb_pixel_total : 23862 time to create 1 rle with old method : 0.028484106063842773 length of segment : 170 time for calcul the mask position with numpy : 0.0006132125854492188 nb_pixel_total : 12839 time to create 1 rle with old method : 0.015497446060180664 length of segment : 123 time for calcul the mask position with numpy : 0.001965045928955078 nb_pixel_total : 62674 time to create 1 rle with old method : 0.07269930839538574 length of segment : 372 time for calcul the mask position with numpy : 0.002093076705932617 nb_pixel_total : 48252 time to create 1 rle with old method : 0.05838775634765625 length of segment : 382 time for calcul the mask position with numpy : 0.010020732879638672 nb_pixel_total : 381393 time to create 1 rle with new method : 0.014081954956054688 length of segment : 879 time for calcul the mask position with numpy : 0.00394892692565918 nb_pixel_total : 143833 time to create 1 rle with old method : 0.16744661331176758 length of segment : 518 time for calcul the mask position with numpy : 0.0003108978271484375 nb_pixel_total : 5933 time to create 1 rle with old method : 0.007268667221069336 length of segment : 88 time for calcul the mask position with numpy : 0.0007259845733642578 nb_pixel_total : 18372 time to create 1 rle with old method : 0.022145986557006836 length of segment : 175 time for calcul the mask position with numpy : 0.0005800724029541016 nb_pixel_total : 13426 time to create 1 rle with old method : 0.016242504119873047 length of segment : 150 time for calcul the mask position with numpy : 0.003356456756591797 nb_pixel_total : 117305 time to create 1 rle with old method : 0.1360607147216797 length of segment : 292 time for calcul the mask position with numpy : 0.0010743141174316406 nb_pixel_total : 25853 time to create 1 rle with old method : 0.030706405639648438 length of segment : 238 time for calcul the mask position with numpy : 0.0006024837493896484 nb_pixel_total : 16613 time to create 1 rle with old method : 0.019926071166992188 length of segment : 161 time for calcul the mask position with numpy : 0.0006809234619140625 nb_pixel_total : 19988 time to create 1 rle with old method : 0.024029016494750977 length of segment : 226 time spent for convertir_results : 17.899422645568848 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 165 chid ids of type : 3594 Number RLEs to save : 50976 save missing photos in datou_result : time spend for datou_step_exec : 91.20728611946106 time spend to save output : 3.4238533973693848 total time spend for step 1 : 94.63113951683044 step2:crop_condition Mon May 5 20:12:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 9 ! batch 1 Loaded 165 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 109 About to insert : list_path_to_insert length 109 new photo from crops ! About to upload 109 photos upload in portfolio : 3736932 init cache_photo without model_param we have 109 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746468758_2127457 we have uploaded 109 photos in the portfolio 3736932 time of upload the photos Elapsed time : 28.05665111541748 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 17 About to insert : list_path_to_insert length 17 new photo from crops ! About to upload 17 photos upload in portfolio : 3736932 init cache_photo without model_param we have 17 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746468798_2127457 we have uploaded 17 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.120228052139282 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746468804_2127457 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.634685754776001 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 34 About to insert : list_path_to_insert length 34 new photo from crops ! About to upload 34 photos upload in portfolio : 3736932 init cache_photo without model_param we have 34 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746468821_2127457 we have uploaded 34 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.970481634140015 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746468831_2127457 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0056467056274414 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746468834_2127457 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7273063659667969 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1356156889, 1356156774, 1356156750, 1356156746, 1356156189, 1356156167, 1356156155, 1356156137, 1356156111] Looping around the photos to save general results len do output : 165 /1356188045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1356188962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156889', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156774', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156750', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156746', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156189', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156167', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156155', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156137', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156111', None, None, None, None, None, '2794465') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 504 time used for this insertion : 0.03070664405822754 save_final save missing photos in datou_result : time spend for datou_step_exec : 108.6668267250061 time spend to save output : 0.035581111907958984 total time spend for step 2 : 108.70240783691406 step3:rle_unique_nms_with_priority Mon May 5 20:13:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 165 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 12 nb_hashtags : 4 time to prepare the origin masks : 5.5889787673950195 time for calcul the mask position with numpy : 0.48406028747558594 nb_pixel_total : 3874045 time to create 1 rle with new method : 0.9465451240539551 time for calcul the mask position with numpy : 0.04350614547729492 nb_pixel_total : 19967 time to create 1 rle with old method : 0.02399587631225586 time for calcul the mask position with numpy : 0.05046200752258301 nb_pixel_total : 810334 time to create 1 rle with new method : 0.9961295127868652 time for calcul the mask position with numpy : 0.025048255920410156 nb_pixel_total : 251205 time to create 1 rle with new method : 0.6914277076721191 time for calcul the mask position with numpy : 0.025309085845947266 nb_pixel_total : 77407 time to create 1 rle with old method : 0.09393024444580078 time for calcul the mask position with numpy : 0.02582836151123047 nb_pixel_total : 25284 time to create 1 rle with old method : 0.029770374298095703 time for calcul the mask position with numpy : 0.024193286895751953 nb_pixel_total : 201811 time to create 1 rle with new method : 1.0060651302337646 time for calcul the mask position with numpy : 0.07967209815979004 nb_pixel_total : 1446822 time to create 1 rle with new method : 0.746924638748169 time for calcul the mask position with numpy : 0.02619338035583496 nb_pixel_total : 114292 time to create 1 rle with old method : 0.15302634239196777 time for calcul the mask position with numpy : 0.027318954467773438 nb_pixel_total : 15153 time to create 1 rle with old method : 0.0181272029876709 time for calcul the mask position with numpy : 0.024393320083618164 nb_pixel_total : 83206 time to create 1 rle with old method : 0.09818458557128906 time for calcul the mask position with numpy : 0.025252580642700195 nb_pixel_total : 85295 time to create 1 rle with old method : 0.10148859024047852 time for calcul the mask position with numpy : 0.02459096908569336 nb_pixel_total : 45419 time to create 1 rle with old method : 0.0574336051940918 create new chi : 6.003946542739868 time to delete rle : 0.019509553909301758 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 16563 TO DO : save crop sub photo not yet done ! save time : 1.095667839050293 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 7.772373199462891 time for calcul the mask position with numpy : 0.34028005599975586 nb_pixel_total : 5371077 time to create 1 rle with new method : 0.65006422996521 time for calcul the mask position with numpy : 0.022239208221435547 nb_pixel_total : 72166 time to create 1 rle with old method : 0.08306002616882324 time for calcul the mask position with numpy : 0.02379012107849121 nb_pixel_total : 96756 time to create 1 rle with old method : 0.11435079574584961 time for calcul the mask position with numpy : 0.026956558227539062 nb_pixel_total : 24357 time to create 1 rle with old method : 0.028692960739135742 time for calcul the mask position with numpy : 0.02318739891052246 nb_pixel_total : 141781 time to create 1 rle with old method : 0.17910408973693848 time for calcul the mask position with numpy : 0.026024818420410156 nb_pixel_total : 126184 time to create 1 rle with old method : 0.1500413417816162 time for calcul the mask position with numpy : 0.0250699520111084 nb_pixel_total : 132675 time to create 1 rle with old method : 0.15433645248413086 time for calcul the mask position with numpy : 0.025141477584838867 nb_pixel_total : 437421 time to create 1 rle with new method : 1.1894826889038086 time for calcul the mask position with numpy : 0.027399778366088867 nb_pixel_total : 31926 time to create 1 rle with old method : 0.03713035583496094 time for calcul the mask position with numpy : 0.028922080993652344 nb_pixel_total : 143975 time to create 1 rle with old method : 0.17189383506774902 time for calcul the mask position with numpy : 0.027346134185791016 nb_pixel_total : 96421 time to create 1 rle with old method : 0.11515235900878906 time for calcul the mask position with numpy : 0.024521589279174805 nb_pixel_total : 48781 time to create 1 rle with old method : 0.05665755271911621 time for calcul the mask position with numpy : 0.023814916610717773 nb_pixel_total : 81838 time to create 1 rle with old method : 0.09491586685180664 time for calcul the mask position with numpy : 0.023488283157348633 nb_pixel_total : 91525 time to create 1 rle with old method : 0.11115860939025879 time for calcul the mask position with numpy : 0.027724266052246094 nb_pixel_total : 32324 time to create 1 rle with old method : 0.04050874710083008 time for calcul the mask position with numpy : 0.02365565299987793 nb_pixel_total : 121033 time to create 1 rle with old method : 0.13988137245178223 create new chi : 4.104081630706787 time to delete rle : 0.002447366714477539 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 15601 TO DO : save crop sub photo not yet done ! save time : 1.0162267684936523 nb_obj : 34 nb_hashtags : 5 time to prepare the origin masks : 4.408504009246826 time for calcul the mask position with numpy : 0.3904125690460205 nb_pixel_total : 5720411 time to create 1 rle with new method : 1.0703845024108887 time for calcul the mask position with numpy : 0.03181767463684082 nb_pixel_total : 26953 time to create 1 rle with old method : 0.031177282333374023 time for calcul the mask position with numpy : 0.0319514274597168 nb_pixel_total : 52259 time to create 1 rle with old method : 0.06139492988586426 time for calcul the mask position with numpy : 0.031213998794555664 nb_pixel_total : 20207 time to create 1 rle with old method : 0.024478435516357422 time for calcul the mask position with numpy : 0.030495405197143555 nb_pixel_total : 10671 time to create 1 rle with old method : 0.01245737075805664 time for calcul the mask position with numpy : 0.032393693923950195 nb_pixel_total : 89627 time to create 1 rle with old method : 0.11631369590759277 time for calcul the mask position with numpy : 0.0317535400390625 nb_pixel_total : 11002 time to create 1 rle with old method : 0.015153646469116211 time for calcul the mask position with numpy : 0.0308535099029541 nb_pixel_total : 14118 time to create 1 rle with old method : 0.016762495040893555 time for calcul the mask position with numpy : 0.03754830360412598 nb_pixel_total : 19571 time to create 1 rle with old method : 0.023134231567382812 time for calcul the mask position with numpy : 0.03027200698852539 nb_pixel_total : 38922 time to create 1 rle with old method : 0.045880794525146484 time for calcul the mask position with numpy : 0.030138731002807617 nb_pixel_total : 28334 time to create 1 rle with old method : 0.04015994071960449 time for calcul the mask position with numpy : 0.030378341674804688 nb_pixel_total : 24208 time to create 1 rle with old method : 0.04390835762023926 time for calcul the mask position with numpy : 0.042366981506347656 nb_pixel_total : 9950 time to create 1 rle with old method : 0.015355825424194336 time for calcul the mask position with numpy : 0.030151844024658203 nb_pixel_total : 20774 time to create 1 rle with old method : 0.025312185287475586 time for calcul the mask position with numpy : 0.033773183822631836 nb_pixel_total : 103535 time to create 1 rle with old method : 0.1215059757232666 time for calcul the mask position with numpy : 0.03141283988952637 nb_pixel_total : 49309 time to create 1 rle with old method : 0.05868649482727051 time for calcul the mask position with numpy : 0.030246257781982422 nb_pixel_total : 11143 time to create 1 rle with old method : 0.013441801071166992 time for calcul the mask position with numpy : 0.03040027618408203 nb_pixel_total : 18719 time to create 1 rle with old method : 0.022545576095581055 time for calcul the mask position with numpy : 0.0312652587890625 nb_pixel_total : 37215 time to create 1 rle with old method : 0.06306219100952148 time for calcul the mask position with numpy : 0.03551197052001953 nb_pixel_total : 39188 time to create 1 rle with old method : 0.049874067306518555 time for calcul the mask position with numpy : 0.029862642288208008 nb_pixel_total : 3239 time to create 1 rle with old method : 0.0038063526153564453 time for calcul the mask position with numpy : 0.02964043617248535 nb_pixel_total : 36854 time to create 1 rle with old method : 0.042913198471069336 time for calcul the mask position with numpy : 0.029639244079589844 nb_pixel_total : 47249 time to create 1 rle with old method : 0.0574185848236084 time for calcul the mask position with numpy : 0.03046393394470215 nb_pixel_total : 58718 time to create 1 rle with old method : 0.06912875175476074 time for calcul the mask position with numpy : 0.030964374542236328 nb_pixel_total : 7414 time to create 1 rle with old method : 0.008811712265014648 time for calcul the mask position with numpy : 0.03824210166931152 nb_pixel_total : 15133 time to create 1 rle with old method : 0.048162221908569336 time for calcul the mask position with numpy : 0.05534052848815918 nb_pixel_total : 110248 time to create 1 rle with old method : 0.12821173667907715 time for calcul the mask position with numpy : 0.029666900634765625 nb_pixel_total : 7253 time to create 1 rle with old method : 0.008616924285888672 time for calcul the mask position with numpy : 0.0296475887298584 nb_pixel_total : 38299 time to create 1 rle with old method : 0.044292449951171875 time for calcul the mask position with numpy : 0.029683828353881836 nb_pixel_total : 13222 time to create 1 rle with old method : 0.015337467193603516 time for calcul the mask position with numpy : 0.031764984130859375 nb_pixel_total : 276561 time to create 1 rle with new method : 0.5408239364624023 time for calcul the mask position with numpy : 0.0307619571685791 nb_pixel_total : 57995 time to create 1 rle with old method : 0.07414603233337402 time for calcul the mask position with numpy : 0.03027510643005371 nb_pixel_total : 11553 time to create 1 rle with old method : 0.01804065704345703 time for calcul the mask position with numpy : 0.0614471435546875 nb_pixel_total : 9965 time to create 1 rle with old method : 0.025017976760864258 time for calcul the mask position with numpy : 0.034337759017944336 nb_pixel_total : 10421 time to create 1 rle with old method : 0.01218867301940918 create new chi : 4.568619012832642 time to delete rle : 0.0050241947174072266 batch 1 Loaded 69 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 17952 TO DO : save crop sub photo not yet done ! save time : 1.1996066570281982 nb_obj : 29 nb_hashtags : 4 time to prepare the origin masks : 4.24323582649231 time for calcul the mask position with numpy : 0.3323235511779785 nb_pixel_total : 5560387 time to create 1 rle with new method : 0.6638038158416748 time for calcul the mask position with numpy : 0.029796361923217773 nb_pixel_total : 5015 time to create 1 rle with old method : 0.006036281585693359 time for calcul the mask position with numpy : 0.03129076957702637 nb_pixel_total : 12718 time to create 1 rle with old method : 0.015090465545654297 time for calcul the mask position with numpy : 0.029414653778076172 nb_pixel_total : 17090 time to create 1 rle with old method : 0.020256519317626953 time for calcul the mask position with numpy : 0.029747724533081055 nb_pixel_total : 7228 time to create 1 rle with old method : 0.00854182243347168 time for calcul the mask position with numpy : 0.02988123893737793 nb_pixel_total : 13344 time to create 1 rle with old method : 0.016013145446777344 time for calcul the mask position with numpy : 0.03181719779968262 nb_pixel_total : 13708 time to create 1 rle with old method : 0.016101837158203125 time for calcul the mask position with numpy : 0.029368162155151367 nb_pixel_total : 23960 time to create 1 rle with old method : 0.02890777587890625 time for calcul the mask position with numpy : 0.030443668365478516 nb_pixel_total : 89294 time to create 1 rle with old method : 0.10467290878295898 time for calcul the mask position with numpy : 0.02950763702392578 nb_pixel_total : 44158 time to create 1 rle with old method : 0.05089163780212402 time for calcul the mask position with numpy : 0.029542207717895508 nb_pixel_total : 52242 time to create 1 rle with old method : 0.06018805503845215 time for calcul the mask position with numpy : 0.03324294090270996 nb_pixel_total : 14045 time to create 1 rle with old method : 0.016414880752563477 time for calcul the mask position with numpy : 0.02993154525756836 nb_pixel_total : 9380 time to create 1 rle with old method : 0.01093435287475586 time for calcul the mask position with numpy : 0.029498815536499023 nb_pixel_total : 33414 time to create 1 rle with old method : 0.038907527923583984 time for calcul the mask position with numpy : 0.02945876121520996 nb_pixel_total : 22685 time to create 1 rle with old method : 0.038651227951049805 time for calcul the mask position with numpy : 0.03353452682495117 nb_pixel_total : 32277 time to create 1 rle with old method : 0.04010581970214844 time for calcul the mask position with numpy : 0.029195308685302734 nb_pixel_total : 18779 time to create 1 rle with old method : 0.021837711334228516 time for calcul the mask position with numpy : 0.03455615043640137 nb_pixel_total : 628014 time to create 1 rle with new method : 0.5341846942901611 time for calcul the mask position with numpy : 0.02965521812438965 nb_pixel_total : 38757 time to create 1 rle with old method : 0.04496002197265625 time for calcul the mask position with numpy : 0.032627105712890625 nb_pixel_total : 20449 time to create 1 rle with old method : 0.03513669967651367 time for calcul the mask position with numpy : 0.032250165939331055 nb_pixel_total : 44256 time to create 1 rle with old method : 0.050917863845825195 time for calcul the mask position with numpy : 0.02974390983581543 nb_pixel_total : 54206 time to create 1 rle with old method : 0.06293368339538574 time for calcul the mask position with numpy : 0.029443025588989258 nb_pixel_total : 51323 time to create 1 rle with old method : 0.05926084518432617 time for calcul the mask position with numpy : 0.029464006423950195 nb_pixel_total : 10039 time to create 1 rle with old method : 0.011622905731201172 time for calcul the mask position with numpy : 0.029811620712280273 nb_pixel_total : 44369 time to create 1 rle with old method : 0.05162358283996582 time for calcul the mask position with numpy : 0.030133962631225586 nb_pixel_total : 80937 time to create 1 rle with old method : 0.09373760223388672 time for calcul the mask position with numpy : 0.029352664947509766 nb_pixel_total : 1918 time to create 1 rle with old method : 0.002274036407470703 time for calcul the mask position with numpy : 0.029981136322021484 nb_pixel_total : 49529 time to create 1 rle with old method : 0.05768084526062012 time for calcul the mask position with numpy : 0.029757976531982422 nb_pixel_total : 35293 time to create 1 rle with old method : 0.04042315483093262 time for calcul the mask position with numpy : 0.02951788902282715 nb_pixel_total : 21426 time to create 1 rle with old method : 0.02481555938720703 create new chi : 3.5045676231384277 time to delete rle : 0.0027146339416503906 batch 1 Loaded 59 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 18054 TO DO : save crop sub photo not yet done ! save time : 1.1787545680999756 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 11.24018383026123 time for calcul the mask position with numpy : 1.2242512702941895 nb_pixel_total : 6474604 time to create 1 rle with new method : 0.7092759609222412 time for calcul the mask position with numpy : 0.03457498550415039 nb_pixel_total : 3847 time to create 1 rle with old method : 0.004370927810668945 time for calcul the mask position with numpy : 0.03585457801818848 nb_pixel_total : 99309 time to create 1 rle with old method : 0.10976624488830566 time for calcul the mask position with numpy : 0.03466486930847168 nb_pixel_total : 40937 time to create 1 rle with old method : 0.04666543006896973 time for calcul the mask position with numpy : 0.0346834659576416 nb_pixel_total : 15737 time to create 1 rle with old method : 0.017731428146362305 time for calcul the mask position with numpy : 0.03581714630126953 nb_pixel_total : 15533 time to create 1 rle with old method : 0.01951122283935547 time for calcul the mask position with numpy : 0.03686714172363281 nb_pixel_total : 50298 time to create 1 rle with old method : 0.05828380584716797 time for calcul the mask position with numpy : 0.0360565185546875 nb_pixel_total : 29504 time to create 1 rle with old method : 0.03406929969787598 time for calcul the mask position with numpy : 0.03720998764038086 nb_pixel_total : 26143 time to create 1 rle with old method : 0.03012871742248535 time for calcul the mask position with numpy : 0.03598213195800781 nb_pixel_total : 23946 time to create 1 rle with old method : 0.027964115142822266 time for calcul the mask position with numpy : 0.03590846061706543 nb_pixel_total : 28716 time to create 1 rle with old method : 0.03700852394104004 time for calcul the mask position with numpy : 0.036805152893066406 nb_pixel_total : 7306 time to create 1 rle with old method : 0.008513927459716797 time for calcul the mask position with numpy : 0.03717660903930664 nb_pixel_total : 75689 time to create 1 rle with old method : 0.08682703971862793 time for calcul the mask position with numpy : 0.022528409957885742 nb_pixel_total : 21284 time to create 1 rle with old method : 0.02455615997314453 time for calcul the mask position with numpy : 0.022298812866210938 nb_pixel_total : 12739 time to create 1 rle with old method : 0.014902353286743164 time for calcul the mask position with numpy : 0.022069215774536133 nb_pixel_total : 95259 time to create 1 rle with old method : 0.10960698127746582 time for calcul the mask position with numpy : 0.02303314208984375 nb_pixel_total : 10559 time to create 1 rle with old method : 0.012295722961425781 time for calcul the mask position with numpy : 0.023123502731323242 nb_pixel_total : 18830 time to create 1 rle with old method : 0.02187967300415039 create new chi : 3.179227113723755 time to delete rle : 0.001445770263671875 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 9728 TO DO : save crop sub photo not yet done ! save time : 0.6656484603881836 nb_obj : 21 nb_hashtags : 2 time to prepare the origin masks : 10.186199426651001 time for calcul the mask position with numpy : 0.39800548553466797 nb_pixel_total : 6335458 time to create 1 rle with new method : 0.5264508724212646 time for calcul the mask position with numpy : 0.03712606430053711 nb_pixel_total : 74942 time to create 1 rle with old method : 0.08804869651794434 time for calcul the mask position with numpy : 0.0385286808013916 nb_pixel_total : 17587 time to create 1 rle with old method : 0.02123737335205078 time for calcul the mask position with numpy : 0.037485599517822266 nb_pixel_total : 14272 time to create 1 rle with old method : 0.016499996185302734 time for calcul the mask position with numpy : 0.03652453422546387 nb_pixel_total : 49902 time to create 1 rle with old method : 0.05758810043334961 time for calcul the mask position with numpy : 0.03754377365112305 nb_pixel_total : 6189 time to create 1 rle with old method : 0.0075113773345947266 time for calcul the mask position with numpy : 0.04288029670715332 nb_pixel_total : 13594 time to create 1 rle with old method : 0.0158843994140625 time for calcul the mask position with numpy : 0.03645968437194824 nb_pixel_total : 25279 time to create 1 rle with old method : 0.029663562774658203 time for calcul the mask position with numpy : 0.03685355186462402 nb_pixel_total : 23413 time to create 1 rle with old method : 0.02779841423034668 time for calcul the mask position with numpy : 0.03658413887023926 nb_pixel_total : 10322 time to create 1 rle with old method : 0.012723445892333984 time for calcul the mask position with numpy : 0.03818774223327637 nb_pixel_total : 18310 time to create 1 rle with old method : 0.021439790725708008 time for calcul the mask position with numpy : 0.032883644104003906 nb_pixel_total : 30284 time to create 1 rle with old method : 0.03746366500854492 time for calcul the mask position with numpy : 0.02490687370300293 nb_pixel_total : 17318 time to create 1 rle with old method : 0.02055954933166504 time for calcul the mask position with numpy : 0.026018619537353516 nb_pixel_total : 20916 time to create 1 rle with old method : 0.025912761688232422 time for calcul the mask position with numpy : 0.024023056030273438 nb_pixel_total : 9975 time to create 1 rle with old method : 0.011690616607666016 time for calcul the mask position with numpy : 0.025385618209838867 nb_pixel_total : 11372 time to create 1 rle with old method : 0.01372385025024414 time for calcul the mask position with numpy : 0.030445098876953125 nb_pixel_total : 70520 time to create 1 rle with old method : 0.0855875015258789 time for calcul the mask position with numpy : 0.024423837661743164 nb_pixel_total : 83554 time to create 1 rle with old method : 0.09598326683044434 time for calcul the mask position with numpy : 0.022973060607910156 nb_pixel_total : 7528 time to create 1 rle with old method : 0.008754253387451172 time for calcul the mask position with numpy : 0.03351402282714844 nb_pixel_total : 12731 time to create 1 rle with old method : 0.014868736267089844 time for calcul the mask position with numpy : 0.03675246238708496 nb_pixel_total : 113510 time to create 1 rle with old method : 0.13134217262268066 time for calcul the mask position with numpy : 0.03628134727478027 nb_pixel_total : 83264 time to create 1 rle with old method : 0.14749836921691895 create new chi : 2.5572926998138428 time to delete rle : 0.0021512508392333984 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 12618 TO DO : save crop sub photo not yet done ! save time : 0.8382914066314697 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 5.768815994262695 time for calcul the mask position with numpy : 0.5092260837554932 nb_pixel_total : 5558774 time to create 1 rle with new method : 0.7589316368103027 time for calcul the mask position with numpy : 0.037958383560180664 nb_pixel_total : 192077 time to create 1 rle with new method : 1.4090487957000732 time for calcul the mask position with numpy : 0.0495452880859375 nb_pixel_total : 556246 time to create 1 rle with new method : 0.5494735240936279 time for calcul the mask position with numpy : 0.03646039962768555 nb_pixel_total : 35528 time to create 1 rle with old method : 0.051824331283569336 time for calcul the mask position with numpy : 0.026723861694335938 nb_pixel_total : 367724 time to create 1 rle with new method : 0.9691262245178223 time for calcul the mask position with numpy : 0.027367591857910156 nb_pixel_total : 20375 time to create 1 rle with old method : 0.02685999870300293 time for calcul the mask position with numpy : 0.024384260177612305 nb_pixel_total : 115607 time to create 1 rle with old method : 0.13411951065063477 time for calcul the mask position with numpy : 0.022439002990722656 nb_pixel_total : 19223 time to create 1 rle with old method : 0.022321701049804688 time for calcul the mask position with numpy : 0.02442169189453125 nb_pixel_total : 168935 time to create 1 rle with new method : 1.0732271671295166 time for calcul the mask position with numpy : 0.023091554641723633 nb_pixel_total : 15751 time to create 1 rle with old method : 0.018163681030273438 create new chi : 5.954941987991333 time to delete rle : 0.002155780792236328 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 10440 TO DO : save crop sub photo not yet done ! save time : 0.6954898834228516 nb_obj : 14 nb_hashtags : 4 time to prepare the origin masks : 10.219221591949463 time for calcul the mask position with numpy : 0.40865588188171387 nb_pixel_total : 6363953 time to create 1 rle with new method : 2.1303484439849854 time for calcul the mask position with numpy : 0.03870224952697754 nb_pixel_total : 20649 time to create 1 rle with old method : 0.024024009704589844 time for calcul the mask position with numpy : 0.034661054611206055 nb_pixel_total : 14604 time to create 1 rle with old method : 0.019469022750854492 time for calcul the mask position with numpy : 0.036118507385253906 nb_pixel_total : 17273 time to create 1 rle with old method : 0.020541906356811523 time for calcul the mask position with numpy : 0.03528881072998047 nb_pixel_total : 12165 time to create 1 rle with old method : 0.014428853988647461 time for calcul the mask position with numpy : 0.03767800331115723 nb_pixel_total : 12088 time to create 1 rle with old method : 0.014342069625854492 time for calcul the mask position with numpy : 0.0395050048828125 nb_pixel_total : 31400 time to create 1 rle with old method : 0.03697848320007324 time for calcul the mask position with numpy : 0.038190603256225586 nb_pixel_total : 9674 time to create 1 rle with old method : 0.011431217193603516 time for calcul the mask position with numpy : 0.0392298698425293 nb_pixel_total : 14991 time to create 1 rle with old method : 0.017961740493774414 time for calcul the mask position with numpy : 0.04129838943481445 nb_pixel_total : 56604 time to create 1 rle with old method : 0.06583166122436523 time for calcul the mask position with numpy : 0.035927534103393555 nb_pixel_total : 33465 time to create 1 rle with old method : 0.03905296325683594 time for calcul the mask position with numpy : 0.036002397537231445 nb_pixel_total : 12384 time to create 1 rle with old method : 0.014027595520019531 time for calcul the mask position with numpy : 0.04136204719543457 nb_pixel_total : 421446 time to create 1 rle with new method : 0.4018087387084961 time for calcul the mask position with numpy : 0.03496432304382324 nb_pixel_total : 15745 time to create 1 rle with old method : 0.018154621124267578 time for calcul the mask position with numpy : 0.036304473876953125 nb_pixel_total : 13799 time to create 1 rle with old method : 0.016288042068481445 create new chi : 3.85355281829834 time to delete rle : 0.0021698474884033203 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 8606 TO DO : save crop sub photo not yet done ! save time : 0.6155245304107666 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 8.94670295715332 time for calcul the mask position with numpy : 1.300278663635254 nb_pixel_total : 6129675 time to create 1 rle with new method : 0.5669028759002686 time for calcul the mask position with numpy : 0.04228544235229492 nb_pixel_total : 19988 time to create 1 rle with old method : 0.024281978607177734 time for calcul the mask position with numpy : 0.037839412689208984 nb_pixel_total : 16613 time to create 1 rle with old method : 0.019253015518188477 time for calcul the mask position with numpy : 0.03542804718017578 nb_pixel_total : 25853 time to create 1 rle with old method : 0.029632568359375 time for calcul the mask position with numpy : 0.03555417060852051 nb_pixel_total : 117305 time to create 1 rle with old method : 0.15084576606750488 time for calcul the mask position with numpy : 0.037039756774902344 nb_pixel_total : 13426 time to create 1 rle with old method : 0.01616692543029785 time for calcul the mask position with numpy : 0.023802757263183594 nb_pixel_total : 18372 time to create 1 rle with old method : 0.022507905960083008 time for calcul the mask position with numpy : 0.02842116355895996 nb_pixel_total : 5933 time to create 1 rle with old method : 0.007115602493286133 time for calcul the mask position with numpy : 0.026300430297851562 nb_pixel_total : 143833 time to create 1 rle with old method : 0.1672046184539795 time for calcul the mask position with numpy : 0.030112266540527344 nb_pixel_total : 381393 time to create 1 rle with new method : 0.6175885200500488 time for calcul the mask position with numpy : 0.023198366165161133 nb_pixel_total : 48252 time to create 1 rle with old method : 0.05570554733276367 time for calcul the mask position with numpy : 0.027561426162719727 nb_pixel_total : 62674 time to create 1 rle with old method : 0.07243084907531738 time for calcul the mask position with numpy : 0.03594970703125 nb_pixel_total : 12839 time to create 1 rle with old method : 0.014934301376342773 time for calcul the mask position with numpy : 0.03654360771179199 nb_pixel_total : 23862 time to create 1 rle with old method : 0.028077125549316406 time for calcul the mask position with numpy : 0.047728538513183594 nb_pixel_total : 30222 time to create 1 rle with old method : 0.040395259857177734 create new chi : 3.6681854724884033 time to delete rle : 0.0020685195922851562 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 10336 TO DO : save crop sub photo not yet done ! save time : 0.816525936126709 map_output_result : {1356156889: (0.0, 'Should be the crop_list due to order', 0), 1356156774: (0.0, 'Should be the crop_list due to order', 0), 1356156750: (0.0, 'Should be the crop_list due to order', 0), 1356156746: (0.0, 'Should be the crop_list due to order', 0), 1356156189: (0.0, 'Should be the crop_list due to order', 0), 1356156167: (0.0, 'Should be the crop_list due to order', 0), 1356156155: (0.0, 'Should be the crop_list due to order', 0), 1356156137: (0.0, 'Should be the crop_list due to order', 0), 1356156111: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1356156889, 1356156774, 1356156750, 1356156746, 1356156189, 1356156167, 1356156155, 1356156137, 1356156111] Looping around the photos to save general results len do output : 9 /1356156889.Didn't retrieve data . /1356156774.Didn't retrieve data . /1356156750.Didn't retrieve data . /1356156746.Didn't retrieve data . /1356156189.Didn't retrieve data . /1356156167.Didn't retrieve data . /1356156155.Didn't retrieve data . /1356156137.Didn't retrieve data . /1356156111.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156889', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156774', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156750', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156746', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156189', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156167', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156155', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156137', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156111', None, None, None, None, None, '2794465') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.020279645919799805 save_final save missing photos in datou_result : time spend for datou_step_exec : 115.07509207725525 time spend to save output : 0.02081465721130371 total time spend for step 3 : 115.09590673446655 step4:ventilate_hashtags_in_portfolio Mon May 5 20:15:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22693112 get user id for portfolio 22693112 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22693112 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pehd','papier','flou','pet_fonce','environnement','carton','mal_croppe','background','autre','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22693112 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pehd','papier','flou','pet_fonce','environnement','carton','mal_croppe','background','autre','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22693112 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','pehd','papier','flou','pet_fonce','environnement','carton','mal_croppe','background','autre','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22693664,22693665,22693666,22693667,22693668,22693669,22693670,22693671,22693672,22693673,22693674?tags=metal,pehd,papier,flou,pet_fonce,environnement,carton,mal_croppe,background,autre,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1356156889, 1356156774, 1356156750, 1356156746, 1356156189, 1356156167, 1356156155, 1356156137, 1356156111] Looping around the photos to save general results len do output : 1 /22693112. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156889', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156774', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156750', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156746', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156189', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156167', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156155', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156137', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156111', None, None, None, None, None, '2794465') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.01821136474609375 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.8202829360961914 time spend to save output : 0.018566131591796875 total time spend for step 4 : 1.8388490676879883 step5:final Mon May 5 20:15:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1356156889: ('0.19012396110707647',), 1356156774: ('0.19012396110707647',), 1356156750: ('0.19012396110707647',), 1356156746: ('0.19012396110707647',), 1356156189: ('0.19012396110707647',), 1356156167: ('0.19012396110707647',), 1356156155: ('0.19012396110707647',), 1356156137: ('0.19012396110707647',), 1356156111: ('0.19012396110707647',)} new output for save of step final : {1356156889: ('0.19012396110707647',), 1356156774: ('0.19012396110707647',), 1356156750: ('0.19012396110707647',), 1356156746: ('0.19012396110707647',), 1356156189: ('0.19012396110707647',), 1356156167: ('0.19012396110707647',), 1356156155: ('0.19012396110707647',), 1356156137: ('0.19012396110707647',), 1356156111: ('0.19012396110707647',)} [1356156889, 1356156774, 1356156750, 1356156746, 1356156189, 1356156167, 1356156155, 1356156137, 1356156111] Looping around the photos to save general results len do output : 9 /1356156889.Didn't retrieve data . /1356156774.Didn't retrieve data . /1356156750.Didn't retrieve data . /1356156746.Didn't retrieve data . /1356156189.Didn't retrieve data . /1356156167.Didn't retrieve data . /1356156155.Didn't retrieve data . /1356156137.Didn't retrieve data . /1356156111.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156889', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156774', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156750', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156746', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156189', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156167', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156155', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156137', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156111', None, None, None, None, None, '2794465') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.015971899032592773 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.16740083694458008 time spend to save output : 0.016487598419189453 total time spend for step 5 : 0.18388843536376953 step6:blur_detection Mon May 5 20:15:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685.jpg resize: (2160, 3264) 1356156889 -0.13007571754665478 treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3.jpg resize: (2160, 3264) 1356156774 -1.6220869001857017 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3.jpg resize: (2160, 3264) 1356156750 -2.8676932006001183 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6.jpg resize: (2160, 3264) 1356156746 -2.7761936799735816 treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c.jpg resize: (2160, 3264) 1356156189 -3.80987090611064 treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535.jpg resize: (2160, 3264) 1356156167 -1.4953095011901818 treat image : temp/1746468630_2127457_1356156155_bb62c46f6160fad8482807d83d7c4019.jpg resize: (2160, 3264) 1356156155 -0.6383127903485825 treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff.jpg resize: (2160, 3264) 1356156137 -0.9335209440602251 treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038.jpg resize: (2160, 3264) 1356156111 -1.3206757639576485 treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685_rle_crop_3785509451_0.png resize: (1137, 361) 1356188045 -1.2760996119604153 treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685_rle_crop_3785509445_0.png resize: (320, 167) 1356188048 0.8874284762459257 treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685_rle_crop_3785509452_0.png resize: (237, 127) 1356188050 0.18907030729867208 treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685_rle_crop_3785509456_0.png resize: (236, 224) 1356188052 -2.1562900323998284 treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685_rle_crop_3785509449_0.png resize: (236, 632) 1356188055 -0.004343906386299779 treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685_rle_crop_3785509450_0.png resize: (1363, 1447) 1356188056 -2.148519597006075 treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685_rle_crop_3785509448_0.png resize: (138, 160) 1356188058 -0.47917492006016427 treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509457_0.png resize: (483, 311) 1356188061 0.2412855669188229 treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509462_0.png resize: (487, 298) 1356188062 -1.010135843593514 treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509465_0.png resize: (835, 788) 1356188064 -1.4564879701032816 treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509464_0.png resize: (246, 209) 1356188067 -1.1668266052358767 treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509459_0.png resize: (439, 347) 1356188068 -1.4394532750888078 treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509461_0.png resize: (346, 236) 1356188070 -1.8393088934797388 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509491_0.png resize: (275, 188) 1356188073 -1.2007589186035077 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509498_0.png resize: (301, 249) 1356188074 -1.819080804550244 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509494_0.png resize: (342, 340) 1356188076 -2.8361838589519035 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509480_0.png resize: (122, 129) 1356188079 -1.2968623199782778 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509504_0.png resize: (162, 160) 1356188080 -1.0023518628472154 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509489_0.png resize: (170, 177) 1356188082 -2.3154611431486534 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509497_0.png resize: (145, 165) 1356188085 -2.2564589001178827 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509496_0.png resize: (103, 83) 1356188086 -0.6833813262704351 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509485_0.png resize: (142, 194) 1356188088 -0.9678608926041898 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509478_0.png resize: (239, 205) 1356188091 -1.5805802052017963 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509482_0.png resize: (196, 142) 1356188092 -1.0655466899792407 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509493_0.png resize: (163, 144) 1356188094 -0.42619653455216167 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509500_0.png resize: (113, 146) 1356188097 -1.2772076032524766 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509475_0.png resize: (251, 301) 1356188099 -1.5547000636226085 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509472_0.png resize: (136, 139) 1356188102 -1.600296831475872 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509490_0.png resize: (350, 1049) 1356188103 -0.16068170921500663 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509474_0.png resize: (260, 387) 1356188105 -0.8815239180908837 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509484_0.png resize: (107, 166) 1356188108 -1.1033807342535122 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509487_0.png resize: (142, 93) 1356188109 -1.1651240556538132 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509477_0.png resize: (203, 318) 1356188111 -2.011395002365713 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509502_0.png resize: (113, 99) 1356188114 -1.7893940446413739 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509476_0.png resize: (299, 234) 1356188115 -1.5520599020216395 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509473_0.png resize: (136, 151) 1356188117 -1.1125409189510336 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509503_0.png resize: (171, 100) 1356188120 -1.137076702553091 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509531_0.png resize: (979, 861) 1356188121 -1.1320819919245169 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509506_0.png resize: (142, 232) 1356188123 -1.380835999737328 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509517_0.png resize: (302, 358) 1356188126 -2.4982704027832288 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509524_0.png resize: (149, 135) 1356188127 -2.3424597290581923 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509514_0.png resize: (138, 230) 1356188130 -1.3628488063492168 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509527_0.png resize: (95, 106) 1356188132 -0.22018646764762423 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509533_0.png resize: (162, 196) 1356188133 -1.422190068704473 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509519_0.png resize: (370, 325) 1356188136 -1.6179049948856257 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509532_0.png resize: (184, 171) 1356188138 -1.7134290752462602 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509525_0.png resize: (207, 260) 1356188139 -1.3474521248060967 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509534_0.png resize: (92, 34) 1356188142 -1.0627977534173128 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509508_0.png resize: (116, 181) 1356188144 -2.4730091063826083 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509516_0.png resize: (209, 149) 1356188145 -2.7668362072493693 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509521_0.png resize: (249, 259) 1356188148 -0.24350579175863443 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509513_0.png resize: (114, 107) 1356188150 -0.5720264715696223 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509530_0.png resize: (146, 185) 1356188151 -0.9276693046009981 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509512_0.png resize: (304, 261) 1356188155 -1.3656671211495293 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509515_0.png resize: (230, 317) 1356188156 -3.0732295208793805 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509518_0.png resize: (258, 260) 1356188157 -1.3419916770722287 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509507_0.png resize: (471, 342) 1356188161 -0.17379120669621698 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509529_0.png resize: (174, 130) 1356188162 -2.2015170311242964 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509509_0.png resize: (305, 225) 1356188163 -1.8256841582828707 treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509551_0.png resize: (80, 62) 1356188167 0.46750942786838834 treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509538_0.png resize: (135, 156) 1356188168 -1.8068606838463632 treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509549_0.png resize: (306, 214) 1356188169 -1.3569073859574592 treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509543_0.png resize: (203, 185) 1356188173 -1.2022391105261143 treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509540_0.png resize: (431, 334) 1356188174 -1.2677760819174337 treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509548_0.png resize: (135, 172) 1356188176 -2.169478183917151 treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509535_0.png resize: (148, 166) 1356188179 -0.7881916643002256 treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509547_0.png resize: (137, 253) 1356188180 -1.8503523576786272 treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509537_0.png resize: (326, 409) 1356188182 -3.7152096689928724 treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509545_0.png resize: (179, 213) 1356188185 -3.305591677218777 treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509536_0.png resize: (211, 60) 1356188186 1.9332970686155801 treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509569_0.png resize: (367, 169) 1356188188 -0.5850948216903341 treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509572_0.png resize: (541, 272) 1356188191 -1.8718925708731378 treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509568_0.png resize: (183, 67) 1356188192 -2.219638122127783 treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509564_0.png resize: (169, 121) 1356188194 -2.4352045273809924 treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509561_0.png resize: (158, 221) 1356188197 -1.418829578747979 treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509567_0.png resize: (173, 238) 1356188198 -1.7890212465010036 treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509553_0.png resize: (415, 386) 1356188200 -1.1569525785973085 treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509571_0.png resize: (171, 196) 1356188203 -1.6656101138662116 treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509559_0.png resize: (110, 123) 1356188204 -0.4497968645929016 treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509563_0.png resize: (199, 128) 1356188206 -1.1423570488062202 treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509555_0.png resize: (152, 88) 1356188209 -2.2920863614346247 treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509558_0.png resize: (113, 141) 1356188210 -1.209077970089546 treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509570_0.png resize: (170, 148) 1356188213 -1.2164181113321533 treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509552_0.png resize: (311, 416) 1356188215 -0.29592797816399075 treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509565_0.png resize: (159, 208) 1356188216 -0.33811778999065134 treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509562_0.png resize: (212, 209) 1356188218 -0.7405177956402258 treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509554_0.png resize: (193, 107) 1356188221 -1.075623980655356 treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509560_0.png resize: (189, 163) 1356188222 -0.9833669922332966 treat image : temp/1746468630_2127457_1356156155_bb62c46f6160fad8482807d83d7c4019_rle_crop_3785509573_0.png resize: (153, 133) 1356188225 -0.24073552477871324 treat image : temp/1746468630_2127457_1356156155_bb62c46f6160fad8482807d83d7c4019_rle_crop_3785509577_0.png resize: (209, 142) 1356188227 -0.7219081932485517 treat image : temp/1746468630_2127457_1356156155_bb62c46f6160fad8482807d83d7c4019_rle_crop_3785509576_0.png resize: (406, 366) 1356188228 0.26663101662398664 treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509586_0.png resize: (218, 227) 1356188231 -0.1909144177340556 treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509585_0.png resize: (143, 137) 1356188233 -1.8878345736425433 treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509589_0.png resize: (131, 99) 1356188234 -1.5966377642106782 treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509583_0.png resize: (135, 157) 1356188237 -0.8116592062646484 treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509591_0.png resize: (158, 145) 1356188239 -1.6756188408218151 treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509590_0.png resize: (213, 227) 1356188241 -2.6833616447317366 treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509595_0.png resize: (160, 169) 1356188244 -0.01174138864560613 treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509594_0.png resize: (245, 142) 1356188245 -2.3988597125641515 treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509582_0.png resize: (113, 147) 1356188247 1.393461689825828 treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509592_0.png resize: (162, 119) 1356188250 -0.46240165623160434 treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509593_0.png resize: (154, 158) 1356188251 -1.2279476426295384 treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509605_0.png resize: (149, 107) 1356188253 0.41106614590650836 treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509609_0.png resize: (185, 196) 1356188256 -2.879554349070439 treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509600_0.png resize: (290, 322) 1356188257 -2.001865692368853 treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509598_0.png resize: (122, 174) 1356188259 -0.6369591995947932 treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509607_0.png resize: (238, 166) 1356188262 0.1736060812834732 treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509604_0.png resize: (158, 193) 1356188263 -0.8989001063024561 treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509603_0.png resize: (87, 101) 1356188265 -0.5252729942383738 treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685_rle_crop_3785509455_0.png resize: (1014, 1412) 1356188509 -1.6613573284699032 treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685_rle_crop_3785509454_0.png resize: (549, 664) 1356188510 -0.9513085686260805 treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685_rle_crop_3785509447_0.png resize: (432, 320) 1356188511 -1.0049431992444924 treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509458_0.png resize: (129, 312) 1356188514 -0.7419552644903231 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509492_0.png resize: (133, 162) 1356188515 -3.046393215717282 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509486_0.png resize: (126, 258) 1356188517 -1.0294722677359212 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509479_0.png resize: (336, 572) 1356188519 -2.425090409104354 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509510_0.png resize: (195, 184) 1356188520 -1.6867110665805924 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509511_0.png resize: (205, 145) 1356188522 -1.4622210726100122 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509522_0.png resize: (187, 240) 1356188524 -0.6059013633406171 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509528_0.png resize: (62, 149) 1356188526 -1.032530555349407 treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509546_0.png resize: (139, 418) 1356188528 -0.07838911556018593 treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509539_0.png resize: (147, 212) 1356188530 -2.234927029856467 treat image : temp/1746468630_2127457_1356156155_bb62c46f6160fad8482807d83d7c4019_rle_crop_3785509580_0.png resize: (816, 781) 1356188531 0.32787437139009323 treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509584_0.png resize: (994, 651) 1356188533 -0.777424904517542 treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509596_0.png resize: (314, 130) 1356188535 -1.6237809685211277 treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509597_0.png resize: (165, 185) 1356188536 -1.5669013904635491 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509501_0.png resize: (129, 141) 1356188571 -0.8180992371949688 treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685_rle_crop_3785509453_0.png resize: (264, 444) 1356188874 -0.8196764725881325 treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509469_0.png resize: (198, 165) 1356188876 -4.25792023866378 treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509471_0.png resize: (275, 361) 1356188877 -3.0380538708148506 treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509470_0.png resize: (401, 430) 1356188879 -2.883834313726391 treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509460_0.png resize: (198, 584) 1356188880 -0.5730516549341786 treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509468_0.png resize: (723, 452) 1356188881 -0.5317308625654409 treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509467_0.png resize: (500, 397) 1356188883 -1.55291758584985 treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509463_0.png resize: (408, 579) 1356188884 -2.09843608698754 treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509466_0.png resize: (514, 368) 1356188885 -0.8299778386828622 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509505_0.png resize: (231, 333) 1356188887 -1.9408222505616843 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509481_0.png resize: (278, 542) 1356188888 -1.1027588143442475 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509488_0.png resize: (318, 496) 1356188889 -1.104007690488773 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509499_0.png resize: (161, 246) 1356188890 -0.8941874943902783 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509483_0.png resize: (352, 156) 1356188893 -1.6414057797588435 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509523_0.png resize: (309, 199) 1356188894 -2.8029948946222927 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509520_0.png resize: (246, 305) 1356188895 -3.917366997813525 treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509541_0.png resize: (77, 119) 1356188897 -3.693173687982601 treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509544_0.png resize: (140, 266) 1356188898 -3.1727357200159396 treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509542_0.png resize: (248, 173) 1356188899 -2.31922943878485 treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509550_0.png resize: (413, 315) 1356188901 -1.88734651399535 treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509566_0.png resize: (153, 217) 1356188903 -1.0830807841793852 treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509557_0.png resize: (387, 256) 1356188904 -1.3504996542882959 treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509556_0.png resize: (541, 201) 1356188906 -1.7093499555581189 treat image : temp/1746468630_2127457_1356156155_bb62c46f6160fad8482807d83d7c4019_rle_crop_3785509574_0.png resize: (619, 665) 1356188907 -1.2431547793816569 treat image : temp/1746468630_2127457_1356156155_bb62c46f6160fad8482807d83d7c4019_rle_crop_3785509575_0.png resize: (328, 115) 1356188908 -2.4239898093479275 treat image : temp/1746468630_2127457_1356156155_bb62c46f6160fad8482807d83d7c4019_rle_crop_3785509581_0.png resize: (406, 821) 1356188910 0.35056302014736623 treat image : temp/1746468630_2127457_1356156155_bb62c46f6160fad8482807d83d7c4019_rle_crop_3785509579_0.png resize: (268, 241) 1356188911 -1.791470811464215 treat image : temp/1746468630_2127457_1356156155_bb62c46f6160fad8482807d83d7c4019_rle_crop_3785509578_0.png resize: (758, 651) 1356188912 1.9784375677199781 treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509587_0.png resize: (199, 492) 1356188914 -1.7457808806172663 treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509602_0.png resize: (516, 437) 1356188915 -1.5132038182498382 treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509601_0.png resize: (879, 606) 1356188916 -0.3488407627049687 treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509606_0.png resize: (287, 509) 1356188918 -0.6609179046776508 treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509608_0.png resize: (148, 138) 1356188919 -1.3912214493081618 treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509599_0.png resize: (345, 241) 1356188920 -0.8880472114742235 treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685_rle_crop_3785509446_0.png resize: (481, 366) 1356188943 -0.8670816115749956 treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509526_0.png resize: (307, 203) 1356188945 -2.0172046089108946 treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509588_0.png resize: (152, 139) 1356188946 -2.2995377913719026 treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509495_0.png resize: (375, 252) 1356188962 -1.0661565490034801 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 174 time used for this insertion : 0.020912885665893555 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 174 time used for this insertion : 4.852023363113403 save missing photos in datou_result : time spend for datou_step_exec : 39.60744643211365 time spend to save output : 4.880300521850586 total time spend for step 6 : 44.48774695396423 step7:brightness Mon May 5 20:16:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685.jpg treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3.jpg treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3.jpg treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6.jpg treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c.jpg treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535.jpg treat image : temp/1746468630_2127457_1356156155_bb62c46f6160fad8482807d83d7c4019.jpg treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff.jpg treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038.jpg treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685_rle_crop_3785509451_0.png treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685_rle_crop_3785509445_0.png treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685_rle_crop_3785509452_0.png treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685_rle_crop_3785509456_0.png treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685_rle_crop_3785509449_0.png treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685_rle_crop_3785509450_0.png treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685_rle_crop_3785509448_0.png treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509457_0.png treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509462_0.png treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509465_0.png treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509464_0.png treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509459_0.png treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509461_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509491_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509498_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509494_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509480_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509504_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509489_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509497_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509496_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509485_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509478_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509482_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509493_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509500_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509475_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509472_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509490_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509474_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509484_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509487_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509477_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509502_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509476_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509473_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509503_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509531_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509506_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509517_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509524_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509514_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509527_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509533_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509519_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509532_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509525_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509534_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509508_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509516_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509521_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509513_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509530_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509512_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509515_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509518_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509507_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509529_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509509_0.png treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509551_0.png treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509538_0.png treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509549_0.png treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509543_0.png treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509540_0.png treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509548_0.png treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509535_0.png treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509547_0.png treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509537_0.png treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509545_0.png treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509536_0.png treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509569_0.png treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509572_0.png treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509568_0.png treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509564_0.png treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509561_0.png treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509567_0.png treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509553_0.png treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509571_0.png treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509559_0.png treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509563_0.png treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509555_0.png treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509558_0.png treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509570_0.png treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509552_0.png treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509565_0.png treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509562_0.png treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509554_0.png treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509560_0.png treat image : temp/1746468630_2127457_1356156155_bb62c46f6160fad8482807d83d7c4019_rle_crop_3785509573_0.png treat image : temp/1746468630_2127457_1356156155_bb62c46f6160fad8482807d83d7c4019_rle_crop_3785509577_0.png treat image : temp/1746468630_2127457_1356156155_bb62c46f6160fad8482807d83d7c4019_rle_crop_3785509576_0.png treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509586_0.png treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509585_0.png treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509589_0.png treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509583_0.png treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509591_0.png treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509590_0.png treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509595_0.png treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509594_0.png treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509582_0.png treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509592_0.png treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509593_0.png treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509605_0.png treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509609_0.png treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509600_0.png treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509598_0.png treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509607_0.png treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509604_0.png treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509603_0.png treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685_rle_crop_3785509455_0.png treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685_rle_crop_3785509454_0.png treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685_rle_crop_3785509447_0.png treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509458_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509492_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509486_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509479_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509510_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509511_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509522_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509528_0.png treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509546_0.png treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509539_0.png treat image : temp/1746468630_2127457_1356156155_bb62c46f6160fad8482807d83d7c4019_rle_crop_3785509580_0.png treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509584_0.png treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509596_0.png treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509597_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509501_0.png treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685_rle_crop_3785509453_0.png treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509469_0.png treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509471_0.png treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509470_0.png treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509460_0.png treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509468_0.png treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509467_0.png treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509463_0.png treat image : temp/1746468630_2127457_1356156774_b08b269cde82fe6a31d0ec83ab8b7fd3_rle_crop_3785509466_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509505_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509481_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509488_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509499_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509483_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509523_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509520_0.png treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509541_0.png treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509544_0.png treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509542_0.png treat image : temp/1746468630_2127457_1356156189_f9523795608562725b044b0db8ca611c_rle_crop_3785509550_0.png treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509566_0.png treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509557_0.png treat image : temp/1746468630_2127457_1356156167_93692cbf02018d5d22c4a92a25c31535_rle_crop_3785509556_0.png treat image : temp/1746468630_2127457_1356156155_bb62c46f6160fad8482807d83d7c4019_rle_crop_3785509574_0.png treat image : temp/1746468630_2127457_1356156155_bb62c46f6160fad8482807d83d7c4019_rle_crop_3785509575_0.png treat image : temp/1746468630_2127457_1356156155_bb62c46f6160fad8482807d83d7c4019_rle_crop_3785509581_0.png treat image : temp/1746468630_2127457_1356156155_bb62c46f6160fad8482807d83d7c4019_rle_crop_3785509579_0.png treat image : temp/1746468630_2127457_1356156155_bb62c46f6160fad8482807d83d7c4019_rle_crop_3785509578_0.png treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509587_0.png treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509602_0.png treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509601_0.png treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509606_0.png treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509608_0.png treat image : temp/1746468630_2127457_1356156111_39abfbb7c8fcad0937d3dc587f4a2038_rle_crop_3785509599_0.png treat image : temp/1746468630_2127457_1356156889_79e9217e3522e263f7ebaa51f2d4e685_rle_crop_3785509446_0.png treat image : temp/1746468630_2127457_1356156746_c0669beb89b2b86f24c116bc6c1fcde6_rle_crop_3785509526_0.png treat image : temp/1746468630_2127457_1356156137_f7977df4a12636d627e0e0a1aae3d9ff_rle_crop_3785509588_0.png treat image : temp/1746468630_2127457_1356156750_9edd196cb8838f9068437d6a7dea03c3_rle_crop_3785509495_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 174 time used for this insertion : 0.017873764038085938 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 174 time used for this insertion : 9.370460987091064 save missing photos in datou_result : time spend for datou_step_exec : 9.001479148864746 time spend to save output : 9.394022226333618 total time spend for step 7 : 18.395501375198364 step8:velours_tree Mon May 5 20:16:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.261641263961792 time spend to save output : 6.008148193359375e-05 total time spend for step 8 : 0.2617013454437256 step9:send_mail_cod Mon May 5 20:16:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22693112_05-05-2025_20_16_55.pdf 22693664 change filename to text .imagette226936641746469015 22693665 change filename to text .imagette226936651746469015 22693666 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette226936661746469015 22693667 imagette226936671746469016 22693668 imagette226936681746469016 22693670 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette226936701746469016 22693671 imagette226936711746469017 22693672 imagette226936721746469017 22693673 change filename to text .change filename to text .change filename to text .imagette226936731746469017 22693674 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette226936741746469018 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22693112 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22693664,22693665,22693666,22693667,22693668,22693669,22693670,22693671,22693672,22693673,22693674?tags=metal,pehd,papier,flou,pet_fonce,environnement,carton,mal_croppe,background,autre,pet_clair args[1356156889] : ((1356156889, -0.13007571754665478, 492688767), (1356156889, 0.08198310862264091, 2107752395), '0.19012396110707647') We are sending mail with results at report@fotonower.com args[1356156774] : ((1356156774, -1.6220869001857017, 492688767), (1356156774, 0.0036269016824829543, 2107752395), '0.19012396110707647') We are sending mail with results at report@fotonower.com args[1356156750] : ((1356156750, -2.8676932006001183, 492609224), (1356156750, 0.09858806858252442, 2107752395), '0.19012396110707647') We are sending mail with results at report@fotonower.com args[1356156746] : ((1356156746, -2.7761936799735816, 492609224), (1356156746, 0.1277083229436864, 2107752395), '0.19012396110707647') We are sending mail with results at report@fotonower.com args[1356156189] : ((1356156189, -3.80987090611064, 492609224), (1356156189, 0.07261117481898072, 2107752395), '0.19012396110707647') We are sending mail with results at report@fotonower.com args[1356156167] : ((1356156167, -1.4953095011901818, 492688767), (1356156167, 0.018147797399383613, 2107752395), '0.19012396110707647') We are sending mail with results at report@fotonower.com args[1356156155] : ((1356156155, -0.6383127903485825, 492688767), (1356156155, 0.20670716203944334, 2107752395), '0.19012396110707647') We are sending mail with results at report@fotonower.com args[1356156137] : ((1356156137, -0.9335209440602251, 492688767), (1356156137, 0.214814774802482, 2107752395), '0.19012396110707647') We are sending mail with results at report@fotonower.com args[1356156111] : ((1356156111, -1.3206757639576485, 492688767), (1356156111, -0.05016093159428101, 2107752395), '0.19012396110707647') We are sending mail with results at report@fotonower.com refus_total : 0.19012396110707647 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22693112 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22693112_05-05-2025_20_16_55.pdf results_Auto_P22693112_05-05-2025_20_16_55.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22693112_05-05-2025_20_16_55.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22693112','results_Auto_P22693112_05-05-2025_20_16_55.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22693112_05-05-2025_20_16_55.pdf','pdf','','1.12','0.19012396110707647') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22693112

https://www.fotonower.com/image?json=false&list_photos_id=1356156889
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356156774
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356156750
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356156746
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356156189
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356156167
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356156155
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356156137
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1356156111
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 19.01%
Veuillez trouver les photos des contaminants.

exemples de contaminants: metal: https://www.fotonower.com/view/22693664?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/22693665?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22693666?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22693670?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22693673?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22693674?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22693112_05-05-2025_20_16_55.pdf.

Lien vers velours :https://www.fotonower.com/velours/22693664,22693665,22693666,22693667,22693668,22693669,22693670,22693671,22693672,22693673,22693674?tags=metal,pehd,papier,flou,pet_fonce,environnement,carton,mal_croppe,background,autre,pet_clair.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 05 May 2025 18:17:03 GMT Content-Length: 0 Connection: close X-Message-Id: x0VlzPaOQMShphbRdViMKA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1356156889, 1356156774, 1356156750, 1356156746, 1356156189, 1356156167, 1356156155, 1356156137, 1356156111] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156889', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156774', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156750', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156746', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156189', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156167', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156155', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156137', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156111', None, None, None, None, None, '2794465') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.04615473747253418 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.35532832145691 time spend to save output : 0.046387434005737305 total time spend for step 9 : 8.401715755462646 step10:split_time_score Mon May 5 20:17:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 9),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 05052025 22693112 Nombre de photos uploadées : 9 / 23040 (0%) 05052025 22693112 Nombre de photos taguées (types de déchets): 0 / 9 (0%) 05052025 22693112 Nombre de photos taguées (volume) : 0 / 9 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ????????? elapsed_time : fill_and_build_computed_from_old_data 0.0004901885986328125 elapsed_time : insert_dashboard_record_day_entry 0.022300004959106445 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22665577 order by id desc limit 1 Qualite : 0.1154510393782547 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22665578_05-05-2025_10_32_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22665578 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22665578 AND mptpi.`type`=3726 To do Qualite : 0.1367117136127342 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22665580_05-05-2025_10_03_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22665580 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22665580 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22693050 order by id desc limit 1 Qualite : 0.03367098560088278 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22665582_05-05-2025_09_50_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22665582 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22665582 AND mptpi.`type`=3726 To do Qualite : 0.12861591172138048 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22665584_05-05-2025_10_07_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22665584 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22665584 AND mptpi.`type`=3594 To do Qualite : 0.21952639910130706 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22668130_05-05-2025_10_58_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22668130 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22668130 AND mptpi.`type`=3594 To do Qualite : 0.14740190202238304 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22681570_05-05-2025_16_18_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22681570 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22681570 AND mptpi.`type`=3594 To do Qualite : 0.1483229648919753 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22681571_05-05-2025_16_30_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22681571 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22681571 AND mptpi.`type`=3594 To do Qualite : 0.03398469992757866 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22674313_05-05-2025_13_22_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22674313 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22674313 AND mptpi.`type`=3726 To do Qualite : 0.10720160269213415 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22681585_05-05-2025_16_22_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22681585 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22681585 AND mptpi.`type`=3726 To do Qualite : 0.12522235607092008 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22681586_05-05-2025_16_14_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22681586 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22681586 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22693079 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22693083 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22693096 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22693110 order by id desc limit 1 Qualite : 0.19012396110707647 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22693112_05-05-2025_20_16_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22693112 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22693112 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'05052025': {'nb_upload': 9, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1356156889, 1356156774, 1356156750, 1356156746, 1356156189, 1356156167, 1356156155, 1356156137, 1356156111] Looping around the photos to save general results len do output : 1 /22693112Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156889', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156774', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156750', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156746', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156189', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156167', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156155', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156137', None, None, None, None, None, '2794465') ('3318', None, None, None, None, None, None, None, '2794465') ('3318', '22693112', '1356156111', None, None, None, None, None, '2794465') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.01320505142211914 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.065690994262695 time spend to save output : 0.013404369354248047 total time spend for step 10 : 6.079095363616943 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 9 set_done_treatment 177.73user 149.54system 6:43.79elapsed 81%CPU (0avgtext+0avgdata 4425884maxresident)k 1016968inputs+122368outputs (20399major+14284232minor)pagefaults 0swaps