python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 702926 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2930431'] with mtr_portfolio_ids : ['23236829'] and first list_photo_ids : [] new path : /proc/702926/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 11 ; length of list_pids : 11 ; length of list_args : 11 time to download the photos : 2.0421106815338135 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu May 22 00:50:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3823 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-22 00:50:32.724950: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-22 00:50:32.751065: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-22 00:50:32.752602: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fb7cc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-22 00:50:32.752664: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-22 00:50:32.755238: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-22 00:50:32.987987: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x35ddb040 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-22 00:50:32.988026: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-22 00:50:32.988760: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-22 00:50:32.989076: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-22 00:50:32.991202: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-22 00:50:32.993204: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-22 00:50:32.993512: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-22 00:50:32.995687: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-22 00:50:32.996688: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-22 00:50:33.001088: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-22 00:50:33.002245: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-22 00:50:33.002335: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-22 00:50:33.002981: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-22 00:50:33.002999: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-22 00:50:33.003008: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-22 00:50:33.003981: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3371 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-22 00:50:33.254682: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-22 00:50:33.254795: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-22 00:50:33.254812: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-22 00:50:33.254827: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-22 00:50:33.254840: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-22 00:50:33.254854: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-22 00:50:33.254867: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-22 00:50:33.254881: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-22 00:50:33.255709: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-22 00:50:33.256598: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-22 00:50:33.256626: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-22 00:50:33.256640: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-22 00:50:33.256653: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-22 00:50:33.256665: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-22 00:50:33.256678: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-22 00:50:33.256690: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-22 00:50:33.256702: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-22 00:50:33.257487: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-22 00:50:33.257521: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-22 00:50:33.257529: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-22 00:50:33.257537: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-22 00:50:33.258361: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3371 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-22 00:50:42.935681: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-22 00:50:43.124495: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-22 00:50:44.470700: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.471347: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.51G (2699860224 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.471982: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.26G (2429874176 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.472010: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-22 00:50:44.472686: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.472704: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-22 00:50:44.482267: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.482287: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-22 00:50:44.482837: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.482851: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-22 00:50:44.491813: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.491835: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-22 00:50:44.492428: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.492444: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-22 00:50:44.534262: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.534295: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-22 00:50:44.535056: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.535079: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-22 00:50:44.541803: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.541822: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-22 00:50:44.542370: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.542385: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-22 00:50:44.579838: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.580443: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.583327: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.583929: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.631183: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.631793: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.633901: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.634499: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.664648: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.665254: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.666925: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.667527: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.673518: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.674121: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.675939: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.676538: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.682743: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.683366: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.685021: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.685619: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.715161: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.715768: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.716362: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.716956: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.720728: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.721280: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.737162: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.737718: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.738272: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.738819: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.751112: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.751716: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.752304: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.752850: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.757103: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.757666: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.762181: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.762778: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.774552: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.775134: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.779193: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.779792: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.780368: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.780914: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.781591: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.782143: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.792813: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.793364: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.793936: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.794530: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.795142: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.795740: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.796334: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.796928: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.811713: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.812266: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.862968: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.863569: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.864184: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.864734: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.874226: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.874815: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.890684: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.891329: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.891929: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.892501: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.896483: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.897020: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.897551: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.898082: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.899006: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.899023: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-05-22 00:50:44.909247: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.909797: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.918682: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.919243: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.919787: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.920318: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.920858: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-22 00:50:44.921390: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.79G (2999844864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 43 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 13.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 28 Detection mask done ! Trying to reset tf kernel 703545 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2411 tf kernel not reseted sub process len(results) : 11 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 11 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3604 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0010995864868164062 nb_pixel_total : 26737 time to create 1 rle with old method : 0.03300881385803223 length of segment : 210 time for calcul the mask position with numpy : 0.0007998943328857422 nb_pixel_total : 41738 time to create 1 rle with old method : 0.04543042182922363 length of segment : 303 time for calcul the mask position with numpy : 0.00022339820861816406 nb_pixel_total : 11109 time to create 1 rle with old method : 0.012336254119873047 length of segment : 122 time for calcul the mask position with numpy : 0.003674030303955078 nb_pixel_total : 125793 time to create 1 rle with old method : 0.1362297534942627 length of segment : 502 time for calcul the mask position with numpy : 0.00030303001403808594 nb_pixel_total : 15283 time to create 1 rle with old method : 0.016773462295532227 length of segment : 171 time for calcul the mask position with numpy : 0.00013518333435058594 nb_pixel_total : 5391 time to create 1 rle with old method : 0.006119489669799805 length of segment : 94 time for calcul the mask position with numpy : 0.00043392181396484375 nb_pixel_total : 18263 time to create 1 rle with old method : 0.020250797271728516 length of segment : 206 time for calcul the mask position with numpy : 0.0003719329833984375 nb_pixel_total : 16533 time to create 1 rle with old method : 0.018555164337158203 length of segment : 134 time for calcul the mask position with numpy : 0.003053426742553711 nb_pixel_total : 140190 time to create 1 rle with old method : 0.1519477367401123 length of segment : 781 time for calcul the mask position with numpy : 0.00030493736267089844 nb_pixel_total : 16597 time to create 1 rle with old method : 0.018472671508789062 length of segment : 121 time for calcul the mask position with numpy : 0.003566741943359375 nb_pixel_total : 164081 time to create 1 rle with new method : 0.016417264938354492 length of segment : 760 time for calcul the mask position with numpy : 0.00020742416381835938 nb_pixel_total : 8969 time to create 1 rle with old method : 0.01019597053527832 length of segment : 91 time for calcul the mask position with numpy : 0.0005161762237548828 nb_pixel_total : 26333 time to create 1 rle with old method : 0.03278183937072754 length of segment : 248 time for calcul the mask position with numpy : 0.0008947849273681641 nb_pixel_total : 28997 time to create 1 rle with old method : 0.03924703598022461 length of segment : 240 time for calcul the mask position with numpy : 0.0005428791046142578 nb_pixel_total : 23173 time to create 1 rle with old method : 0.025649070739746094 length of segment : 166 time for calcul the mask position with numpy : 0.0024328231811523438 nb_pixel_total : 118543 time to create 1 rle with old method : 0.12901949882507324 length of segment : 322 time for calcul the mask position with numpy : 0.0027213096618652344 nb_pixel_total : 113639 time to create 1 rle with old method : 0.12201619148254395 length of segment : 333 time for calcul the mask position with numpy : 0.006757259368896484 nb_pixel_total : 217703 time to create 1 rle with new method : 0.01723504066467285 length of segment : 829 time for calcul the mask position with numpy : 0.0034821033477783203 nb_pixel_total : 120789 time to create 1 rle with old method : 0.13028860092163086 length of segment : 410 time for calcul the mask position with numpy : 0.00039196014404296875 nb_pixel_total : 14571 time to create 1 rle with old method : 0.016580581665039062 length of segment : 168 time for calcul the mask position with numpy : 0.0014083385467529297 nb_pixel_total : 48230 time to create 1 rle with old method : 0.05425620079040527 length of segment : 382 time for calcul the mask position with numpy : 0.0004837512969970703 nb_pixel_total : 19593 time to create 1 rle with old method : 0.021932601928710938 length of segment : 198 time for calcul the mask position with numpy : 0.0013988018035888672 nb_pixel_total : 62906 time to create 1 rle with old method : 0.0711207389831543 length of segment : 273 time for calcul the mask position with numpy : 0.0011625289916992188 nb_pixel_total : 42337 time to create 1 rle with old method : 0.048018455505371094 length of segment : 396 time for calcul the mask position with numpy : 0.0020439624786376953 nb_pixel_total : 87271 time to create 1 rle with old method : 0.09760785102844238 length of segment : 336 time for calcul the mask position with numpy : 0.0005354881286621094 nb_pixel_total : 23555 time to create 1 rle with old method : 0.027019977569580078 length of segment : 151 time for calcul the mask position with numpy : 0.0004825592041015625 nb_pixel_total : 20659 time to create 1 rle with old method : 0.023203611373901367 length of segment : 153 time for calcul the mask position with numpy : 0.0017170906066894531 nb_pixel_total : 79845 time to create 1 rle with old method : 0.08824396133422852 length of segment : 760 time for calcul the mask position with numpy : 0.0004477500915527344 nb_pixel_total : 18526 time to create 1 rle with old method : 0.020600557327270508 length of segment : 143 time for calcul the mask position with numpy : 0.0016107559204101562 nb_pixel_total : 81176 time to create 1 rle with old method : 0.10922598838806152 length of segment : 262 time for calcul the mask position with numpy : 0.0013263225555419922 nb_pixel_total : 85842 time to create 1 rle with old method : 0.09677433967590332 length of segment : 172 time for calcul the mask position with numpy : 0.023372650146484375 nb_pixel_total : 499039 time to create 1 rle with new method : 0.04711174964904785 length of segment : 1150 time for calcul the mask position with numpy : 0.0006964206695556641 nb_pixel_total : 37198 time to create 1 rle with old method : 0.04161977767944336 length of segment : 198 time for calcul the mask position with numpy : 0.004770994186401367 nb_pixel_total : 292294 time to create 1 rle with new method : 0.01656198501586914 length of segment : 788 time for calcul the mask position with numpy : 0.0010058879852294922 nb_pixel_total : 58626 time to create 1 rle with old method : 0.0657815933227539 length of segment : 310 time for calcul the mask position with numpy : 0.0024912357330322266 nb_pixel_total : 154615 time to create 1 rle with new method : 0.008011102676391602 length of segment : 379 time for calcul the mask position with numpy : 0.01640462875366211 nb_pixel_total : 305849 time to create 1 rle with new method : 0.6592063903808594 length of segment : 1199 time for calcul the mask position with numpy : 0.0004119873046875 nb_pixel_total : 24403 time to create 1 rle with old method : 0.027353525161743164 length of segment : 175 time for calcul the mask position with numpy : 0.0007276535034179688 nb_pixel_total : 50496 time to create 1 rle with old method : 0.05644083023071289 length of segment : 260 time for calcul the mask position with numpy : 0.0021505355834960938 nb_pixel_total : 120970 time to create 1 rle with old method : 0.13222956657409668 length of segment : 573 time for calcul the mask position with numpy : 0.0005769729614257812 nb_pixel_total : 26121 time to create 1 rle with old method : 0.029712915420532227 length of segment : 255 time for calcul the mask position with numpy : 0.005436420440673828 nb_pixel_total : 406508 time to create 1 rle with new method : 0.012052774429321289 length of segment : 617 time for calcul the mask position with numpy : 0.003478527069091797 nb_pixel_total : 182745 time to create 1 rle with new method : 0.009639263153076172 length of segment : 658 time for calcul the mask position with numpy : 0.00693058967590332 nb_pixel_total : 400335 time to create 1 rle with new method : 0.02799677848815918 length of segment : 557 time for calcul the mask position with numpy : 0.0002167224884033203 nb_pixel_total : 9817 time to create 1 rle with old method : 0.011279821395874023 length of segment : 119 time for calcul the mask position with numpy : 0.0002357959747314453 nb_pixel_total : 12261 time to create 1 rle with old method : 0.014937639236450195 length of segment : 126 time for calcul the mask position with numpy : 0.0003478527069091797 nb_pixel_total : 18470 time to create 1 rle with old method : 0.022275924682617188 length of segment : 182 time for calcul the mask position with numpy : 0.0005829334259033203 nb_pixel_total : 26685 time to create 1 rle with old method : 0.030055999755859375 length of segment : 237 time for calcul the mask position with numpy : 0.0012805461883544922 nb_pixel_total : 79864 time to create 1 rle with old method : 0.09167075157165527 length of segment : 277 time for calcul the mask position with numpy : 0.0014605522155761719 nb_pixel_total : 92118 time to create 1 rle with old method : 0.1012575626373291 length of segment : 399 time for calcul the mask position with numpy : 0.0003056526184082031 nb_pixel_total : 16577 time to create 1 rle with old method : 0.01840066909790039 length of segment : 142 time for calcul the mask position with numpy : 0.003184080123901367 nb_pixel_total : 224787 time to create 1 rle with new method : 0.008279800415039062 length of segment : 486 time for calcul the mask position with numpy : 0.0006237030029296875 nb_pixel_total : 31411 time to create 1 rle with old method : 0.03946828842163086 length of segment : 176 time for calcul the mask position with numpy : 0.0011930465698242188 nb_pixel_total : 71511 time to create 1 rle with old method : 0.08107542991638184 length of segment : 244 time for calcul the mask position with numpy : 0.003108978271484375 nb_pixel_total : 240444 time to create 1 rle with new method : 0.008147239685058594 length of segment : 607 time for calcul the mask position with numpy : 0.00019550323486328125 nb_pixel_total : 9203 time to create 1 rle with old method : 0.010369062423706055 length of segment : 74 time for calcul the mask position with numpy : 0.00018024444580078125 nb_pixel_total : 6850 time to create 1 rle with old method : 0.007514238357543945 length of segment : 107 time for calcul the mask position with numpy : 0.0003666877746582031 nb_pixel_total : 18640 time to create 1 rle with old method : 0.020445585250854492 length of segment : 177 time for calcul the mask position with numpy : 0.00020241737365722656 nb_pixel_total : 10837 time to create 1 rle with old method : 0.011821269989013672 length of segment : 131 time for calcul the mask position with numpy : 0.00029087066650390625 nb_pixel_total : 18905 time to create 1 rle with old method : 0.02109551429748535 length of segment : 106 time for calcul the mask position with numpy : 0.003299236297607422 nb_pixel_total : 209010 time to create 1 rle with new method : 0.008707046508789062 length of segment : 690 time for calcul the mask position with numpy : 0.0006346702575683594 nb_pixel_total : 19765 time to create 1 rle with old method : 0.021921873092651367 length of segment : 227 time for calcul the mask position with numpy : 0.0006306171417236328 nb_pixel_total : 35209 time to create 1 rle with old method : 0.037985801696777344 length of segment : 230 time for calcul the mask position with numpy : 0.004719972610473633 nb_pixel_total : 306764 time to create 1 rle with new method : 0.013367891311645508 length of segment : 774 time for calcul the mask position with numpy : 0.0008046627044677734 nb_pixel_total : 43564 time to create 1 rle with old method : 0.048033714294433594 length of segment : 284 time for calcul the mask position with numpy : 0.0004477500915527344 nb_pixel_total : 19241 time to create 1 rle with old method : 0.02217864990234375 length of segment : 156 time for calcul the mask position with numpy : 0.007759571075439453 nb_pixel_total : 469479 time to create 1 rle with new method : 0.01834702491760254 length of segment : 746 time for calcul the mask position with numpy : 0.006792545318603516 nb_pixel_total : 396364 time to create 1 rle with new method : 0.015636682510375977 length of segment : 839 time for calcul the mask position with numpy : 0.0007891654968261719 nb_pixel_total : 51971 time to create 1 rle with old method : 0.0796506404876709 length of segment : 211 time for calcul the mask position with numpy : 0.004022836685180664 nb_pixel_total : 312381 time to create 1 rle with new method : 0.008690834045410156 length of segment : 677 time for calcul the mask position with numpy : 0.003145456314086914 nb_pixel_total : 207562 time to create 1 rle with new method : 0.00709843635559082 length of segment : 646 time for calcul the mask position with numpy : 0.002829313278198242 nb_pixel_total : 109837 time to create 1 rle with old method : 0.12223339080810547 length of segment : 252 time for calcul the mask position with numpy : 0.0012581348419189453 nb_pixel_total : 23626 time to create 1 rle with old method : 0.02724289894104004 length of segment : 194 time for calcul the mask position with numpy : 0.0006115436553955078 nb_pixel_total : 18087 time to create 1 rle with old method : 0.02430105209350586 length of segment : 182 time for calcul the mask position with numpy : 0.0014879703521728516 nb_pixel_total : 48415 time to create 1 rle with old method : 0.05345344543457031 length of segment : 333 time for calcul the mask position with numpy : 0.0005660057067871094 nb_pixel_total : 14985 time to create 1 rle with old method : 0.016565799713134766 length of segment : 121 time for calcul the mask position with numpy : 0.0009760856628417969 nb_pixel_total : 26743 time to create 1 rle with old method : 0.029471397399902344 length of segment : 218 time for calcul the mask position with numpy : 0.0006954669952392578 nb_pixel_total : 26683 time to create 1 rle with old method : 0.029824495315551758 length of segment : 127 time for calcul the mask position with numpy : 0.001340627670288086 nb_pixel_total : 26066 time to create 1 rle with old method : 0.030610322952270508 length of segment : 393 time for calcul the mask position with numpy : 0.0007622241973876953 nb_pixel_total : 24004 time to create 1 rle with old method : 0.02841782569885254 length of segment : 223 time for calcul the mask position with numpy : 0.0006992816925048828 nb_pixel_total : 22134 time to create 1 rle with old method : 0.026401519775390625 length of segment : 188 time for calcul the mask position with numpy : 0.0014035701751708984 nb_pixel_total : 40013 time to create 1 rle with old method : 0.04783010482788086 length of segment : 398 time for calcul the mask position with numpy : 0.0033376216888427734 nb_pixel_total : 126119 time to create 1 rle with old method : 0.1468207836151123 length of segment : 470 time for calcul the mask position with numpy : 0.0006577968597412109 nb_pixel_total : 13681 time to create 1 rle with old method : 0.01651763916015625 length of segment : 171 time for calcul the mask position with numpy : 0.0005435943603515625 nb_pixel_total : 13794 time to create 1 rle with old method : 0.016789674758911133 length of segment : 157 time for calcul the mask position with numpy : 0.0007376670837402344 nb_pixel_total : 23974 time to create 1 rle with old method : 0.02897500991821289 length of segment : 272 time for calcul the mask position with numpy : 0.0012600421905517578 nb_pixel_total : 25373 time to create 1 rle with old method : 0.030004262924194336 length of segment : 230 time for calcul the mask position with numpy : 0.003549814224243164 nb_pixel_total : 82759 time to create 1 rle with old method : 0.09733772277832031 length of segment : 449 time for calcul the mask position with numpy : 0.0015864372253417969 nb_pixel_total : 40965 time to create 1 rle with old method : 0.048126935958862305 length of segment : 342 time for calcul the mask position with numpy : 0.009154796600341797 nb_pixel_total : 236999 time to create 1 rle with new method : 0.015044212341308594 length of segment : 408 time for calcul the mask position with numpy : 0.002940654754638672 nb_pixel_total : 71935 time to create 1 rle with old method : 0.08439493179321289 length of segment : 374 time for calcul the mask position with numpy : 0.0008442401885986328 nb_pixel_total : 20637 time to create 1 rle with old method : 0.024857282638549805 length of segment : 174 time for calcul the mask position with numpy : 0.0005929470062255859 nb_pixel_total : 13171 time to create 1 rle with old method : 0.0158693790435791 length of segment : 151 time for calcul the mask position with numpy : 0.0011143684387207031 nb_pixel_total : 18288 time to create 1 rle with old method : 0.02219843864440918 length of segment : 226 time for calcul the mask position with numpy : 0.00044798851013183594 nb_pixel_total : 9629 time to create 1 rle with old method : 0.011683940887451172 length of segment : 85 time for calcul the mask position with numpy : 0.0007879734039306641 nb_pixel_total : 17264 time to create 1 rle with old method : 0.02069568634033203 length of segment : 171 time for calcul the mask position with numpy : 0.0013148784637451172 nb_pixel_total : 28516 time to create 1 rle with old method : 0.03380274772644043 length of segment : 198 time for calcul the mask position with numpy : 0.0021178722381591797 nb_pixel_total : 57053 time to create 1 rle with old method : 0.06793689727783203 length of segment : 302 time for calcul the mask position with numpy : 0.0006563663482666016 nb_pixel_total : 13798 time to create 1 rle with old method : 0.016489267349243164 length of segment : 148 time for calcul the mask position with numpy : 0.0016102790832519531 nb_pixel_total : 33563 time to create 1 rle with old method : 0.040132761001586914 length of segment : 316 time for calcul the mask position with numpy : 0.00039577484130859375 nb_pixel_total : 7773 time to create 1 rle with old method : 0.009539604187011719 length of segment : 65 time for calcul the mask position with numpy : 0.0005829334259033203 nb_pixel_total : 10658 time to create 1 rle with old method : 0.013002157211303711 length of segment : 193 time for calcul the mask position with numpy : 0.001073598861694336 nb_pixel_total : 28652 time to create 1 rle with old method : 0.033579111099243164 length of segment : 306 time for calcul the mask position with numpy : 0.0013699531555175781 nb_pixel_total : 44957 time to create 1 rle with old method : 0.053298234939575195 length of segment : 409 time for calcul the mask position with numpy : 0.0006411075592041016 nb_pixel_total : 15599 time to create 1 rle with old method : 0.018697500228881836 length of segment : 158 time for calcul the mask position with numpy : 0.0008783340454101562 nb_pixel_total : 22320 time to create 1 rle with old method : 0.026651620864868164 length of segment : 208 time for calcul the mask position with numpy : 0.001065969467163086 nb_pixel_total : 37183 time to create 1 rle with old method : 0.04410409927368164 length of segment : 209 time for calcul the mask position with numpy : 0.0006425380706787109 nb_pixel_total : 16512 time to create 1 rle with old method : 0.0203554630279541 length of segment : 130 time for calcul the mask position with numpy : 0.00022935867309570312 nb_pixel_total : 6323 time to create 1 rle with old method : 0.007783651351928711 length of segment : 111 time for calcul the mask position with numpy : 0.0008442401885986328 nb_pixel_total : 17265 time to create 1 rle with old method : 0.02043008804321289 length of segment : 258 time for calcul the mask position with numpy : 0.0010058879852294922 nb_pixel_total : 27687 time to create 1 rle with old method : 0.032987117767333984 length of segment : 189 time for calcul the mask position with numpy : 0.0017952919006347656 nb_pixel_total : 58481 time to create 1 rle with old method : 0.07026553153991699 length of segment : 248 time for calcul the mask position with numpy : 0.001280069351196289 nb_pixel_total : 40386 time to create 1 rle with old method : 0.04788637161254883 length of segment : 278 time for calcul the mask position with numpy : 0.0031833648681640625 nb_pixel_total : 52602 time to create 1 rle with old method : 0.06257104873657227 length of segment : 406 time for calcul the mask position with numpy : 0.0006251335144042969 nb_pixel_total : 12532 time to create 1 rle with old method : 0.015352487564086914 length of segment : 90 time for calcul the mask position with numpy : 0.0020499229431152344 nb_pixel_total : 49040 time to create 1 rle with old method : 0.05751848220825195 length of segment : 436 time for calcul the mask position with numpy : 0.0029735565185546875 nb_pixel_total : 59517 time to create 1 rle with old method : 0.07144308090209961 length of segment : 391 time for calcul the mask position with numpy : 0.0008480548858642578 nb_pixel_total : 18498 time to create 1 rle with old method : 0.02250218391418457 length of segment : 121 time for calcul the mask position with numpy : 0.000637054443359375 nb_pixel_total : 11932 time to create 1 rle with old method : 0.014407873153686523 length of segment : 110 time for calcul the mask position with numpy : 0.0021927356719970703 nb_pixel_total : 52493 time to create 1 rle with old method : 0.06259965896606445 length of segment : 337 time for calcul the mask position with numpy : 0.0013890266418457031 nb_pixel_total : 23281 time to create 1 rle with old method : 0.027820348739624023 length of segment : 231 time for calcul the mask position with numpy : 0.0009827613830566406 nb_pixel_total : 33428 time to create 1 rle with old method : 0.03983497619628906 length of segment : 276 time for calcul the mask position with numpy : 0.0014195442199707031 nb_pixel_total : 46417 time to create 1 rle with old method : 0.05478334426879883 length of segment : 176 time for calcul the mask position with numpy : 0.0016794204711914062 nb_pixel_total : 47589 time to create 1 rle with old method : 0.0726480484008789 length of segment : 213 time for calcul the mask position with numpy : 0.0005080699920654297 nb_pixel_total : 11768 time to create 1 rle with old method : 0.014398336410522461 length of segment : 115 time for calcul the mask position with numpy : 0.0010602474212646484 nb_pixel_total : 18942 time to create 1 rle with old method : 0.022586345672607422 length of segment : 220 time for calcul the mask position with numpy : 0.0007741451263427734 nb_pixel_total : 17773 time to create 1 rle with old method : 0.02124333381652832 length of segment : 170 time for calcul the mask position with numpy : 0.0015687942504882812 nb_pixel_total : 30883 time to create 1 rle with old method : 0.037259578704833984 length of segment : 306 time for calcul the mask position with numpy : 0.0007069110870361328 nb_pixel_total : 20193 time to create 1 rle with old method : 0.02438664436340332 length of segment : 109 time for calcul the mask position with numpy : 0.0008935928344726562 nb_pixel_total : 16753 time to create 1 rle with old method : 0.02027153968811035 length of segment : 174 time for calcul the mask position with numpy : 0.0014545917510986328 nb_pixel_total : 19613 time to create 1 rle with old method : 0.02297377586364746 length of segment : 359 time for calcul the mask position with numpy : 0.0011467933654785156 nb_pixel_total : 31255 time to create 1 rle with old method : 0.037914276123046875 length of segment : 181 time for calcul the mask position with numpy : 0.0016160011291503906 nb_pixel_total : 50247 time to create 1 rle with old method : 0.05945301055908203 length of segment : 304 time for calcul the mask position with numpy : 0.0018258094787597656 nb_pixel_total : 50900 time to create 1 rle with old method : 0.060610294342041016 length of segment : 264 time for calcul the mask position with numpy : 0.0004603862762451172 nb_pixel_total : 8620 time to create 1 rle with old method : 0.010352134704589844 length of segment : 172 time for calcul the mask position with numpy : 0.00061798095703125 nb_pixel_total : 14687 time to create 1 rle with old method : 0.0177762508392334 length of segment : 139 time for calcul the mask position with numpy : 0.0016324520111083984 nb_pixel_total : 49305 time to create 1 rle with old method : 0.058255672454833984 length of segment : 156 time for calcul the mask position with numpy : 0.0013339519500732422 nb_pixel_total : 27877 time to create 1 rle with old method : 0.03364229202270508 length of segment : 362 time for calcul the mask position with numpy : 0.00067901611328125 nb_pixel_total : 15266 time to create 1 rle with old method : 0.018561840057373047 length of segment : 151 time for calcul the mask position with numpy : 0.004652261734008789 nb_pixel_total : 142175 time to create 1 rle with old method : 0.16701626777648926 length of segment : 432 time for calcul the mask position with numpy : 0.016737937927246094 nb_pixel_total : 239073 time to create 1 rle with new method : 0.042054176330566406 length of segment : 1645 time for calcul the mask position with numpy : 0.00090789794921875 nb_pixel_total : 28252 time to create 1 rle with old method : 0.03337836265563965 length of segment : 197 time for calcul the mask position with numpy : 0.0005748271942138672 nb_pixel_total : 13669 time to create 1 rle with old method : 0.01663804054260254 length of segment : 105 time for calcul the mask position with numpy : 0.0012903213500976562 nb_pixel_total : 32179 time to create 1 rle with old method : 0.03807687759399414 length of segment : 194 time for calcul the mask position with numpy : 0.0006661415100097656 nb_pixel_total : 24873 time to create 1 rle with old method : 0.029545068740844727 length of segment : 209 time for calcul the mask position with numpy : 0.004338741302490234 nb_pixel_total : 173218 time to create 1 rle with new method : 0.005557537078857422 length of segment : 477 time for calcul the mask position with numpy : 0.001546621322631836 nb_pixel_total : 41847 time to create 1 rle with old method : 0.04993844032287598 length of segment : 454 time for calcul the mask position with numpy : 0.0013391971588134766 nb_pixel_total : 40808 time to create 1 rle with old method : 0.047965288162231445 length of segment : 203 time for calcul the mask position with numpy : 0.001750946044921875 nb_pixel_total : 44947 time to create 1 rle with old method : 0.05358171463012695 length of segment : 383 time for calcul the mask position with numpy : 0.0003600120544433594 nb_pixel_total : 14416 time to create 1 rle with old method : 0.017718791961669922 length of segment : 171 time for calcul the mask position with numpy : 0.0007598400115966797 nb_pixel_total : 31800 time to create 1 rle with old method : 0.038858652114868164 length of segment : 192 time spent for convertir_results : 14.249240636825562 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 151 chid ids of type : 3594 Number RLEs to save : 46292 save missing photos in datou_result : time spend for datou_step_exec : 74.7633912563324 time spend to save output : 8.357715606689453 total time spend for step 1 : 83.12110686302185 step2:crop_condition Thu May 22 00:51:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 11 ! batch 1 Loaded 151 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 90 About to insert : list_path_to_insert length 90 new photo from crops ! About to upload 90 photos upload in portfolio : 3736932 init cache_photo without model_param we have 90 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747867941_702926 we have uploaded 90 photos in the portfolio 3736932 time of upload the photos Elapsed time : 27.380677223205566 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 3736932 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747867976_702926 we have uploaded 21 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.054418563842773 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 37 About to insert : list_path_to_insert length 37 new photo from crops ! About to upload 37 photos upload in portfolio : 3736932 init cache_photo without model_param we have 37 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747867997_702926 we have uploaded 37 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.618426084518433 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747868010_702926 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8439347743988037 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747868012_702926 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5097813606262207 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1359053705, 1359053701, 1359053646, 1359053611, 1359053581, 1359053557, 1359053550, 1359053394, 1359053363, 1359053336, 1359053332] Looping around the photos to save general results len do output : 151 /1360266241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360266839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053705', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053701', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053646', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053611', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053581', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053557', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053550', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053394', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053363', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053336', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053332', None, None, None, None, None, '2930431') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 464 time used for this insertion : 0.3085203170776367 save_final save missing photos in datou_result : time spend for datou_step_exec : 99.25242900848389 time spend to save output : 0.31383514404296875 total time spend for step 2 : 99.56626415252686 step3:rle_unique_nms_with_priority Thu May 22 00:53:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 151 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 10.750374555587769 time for calcul the mask position with numpy : 2.124546766281128 nb_pixel_total : 6433223 time to create 1 rle with new method : 1.9059135913848877 time for calcul the mask position with numpy : 0.0201873779296875 nb_pixel_total : 26333 time to create 1 rle with old method : 0.029592275619506836 time for calcul the mask position with numpy : 0.02212834358215332 nb_pixel_total : 8969 time to create 1 rle with old method : 0.010036706924438477 time for calcul the mask position with numpy : 0.026666641235351562 nb_pixel_total : 164081 time to create 1 rle with new method : 1.6638615131378174 time for calcul the mask position with numpy : 0.021405458450317383 nb_pixel_total : 16597 time to create 1 rle with old method : 0.01867508888244629 time for calcul the mask position with numpy : 0.021608591079711914 nb_pixel_total : 140190 time to create 1 rle with old method : 0.18359804153442383 time for calcul the mask position with numpy : 0.020923852920532227 nb_pixel_total : 16533 time to create 1 rle with old method : 0.018538236618041992 time for calcul the mask position with numpy : 0.021265268325805664 nb_pixel_total : 18263 time to create 1 rle with old method : 0.0206143856048584 time for calcul the mask position with numpy : 0.020809412002563477 nb_pixel_total : 5391 time to create 1 rle with old method : 0.006415367126464844 time for calcul the mask position with numpy : 0.020756244659423828 nb_pixel_total : 15283 time to create 1 rle with old method : 0.017567873001098633 time for calcul the mask position with numpy : 0.022666454315185547 nb_pixel_total : 125793 time to create 1 rle with old method : 0.1407790184020996 time for calcul the mask position with numpy : 0.021059274673461914 nb_pixel_total : 11109 time to create 1 rle with old method : 0.012855291366577148 time for calcul the mask position with numpy : 0.021991252899169922 nb_pixel_total : 41738 time to create 1 rle with old method : 0.04700636863708496 time for calcul the mask position with numpy : 0.02063894271850586 nb_pixel_total : 26737 time to create 1 rle with old method : 0.029651641845703125 create new chi : 6.565432071685791 time to delete rle : 0.021842241287231445 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 9646 TO DO : save crop sub photo not yet done ! save time : 0.9476535320281982 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 11.031038761138916 time for calcul the mask position with numpy : 1.8431649208068848 nb_pixel_total : 6009903 time to create 1 rle with new method : 1.2364583015441895 time for calcul the mask position with numpy : 0.034676551818847656 nb_pixel_total : 18526 time to create 1 rle with old method : 0.0211794376373291 time for calcul the mask position with numpy : 0.03488612174987793 nb_pixel_total : 79845 time to create 1 rle with old method : 0.0941610336303711 time for calcul the mask position with numpy : 0.03306174278259277 nb_pixel_total : 20659 time to create 1 rle with old method : 0.02402186393737793 time for calcul the mask position with numpy : 0.03610491752624512 nb_pixel_total : 23555 time to create 1 rle with old method : 0.027310848236083984 time for calcul the mask position with numpy : 0.032208919525146484 nb_pixel_total : 87271 time to create 1 rle with old method : 0.10142016410827637 time for calcul the mask position with numpy : 0.0331425666809082 nb_pixel_total : 42337 time to create 1 rle with old method : 0.049350738525390625 time for calcul the mask position with numpy : 0.03277158737182617 nb_pixel_total : 62906 time to create 1 rle with old method : 0.07592964172363281 time for calcul the mask position with numpy : 0.03421831130981445 nb_pixel_total : 19593 time to create 1 rle with old method : 0.022838354110717773 time for calcul the mask position with numpy : 0.037190914154052734 nb_pixel_total : 48230 time to create 1 rle with old method : 0.0552675724029541 time for calcul the mask position with numpy : 0.03345179557800293 nb_pixel_total : 14571 time to create 1 rle with old method : 0.016437768936157227 time for calcul the mask position with numpy : 0.03373456001281738 nb_pixel_total : 120789 time to create 1 rle with old method : 0.13850831985473633 time for calcul the mask position with numpy : 0.03508949279785156 nb_pixel_total : 217703 time to create 1 rle with new method : 3.2855465412139893 time for calcul the mask position with numpy : 0.03431415557861328 nb_pixel_total : 113639 time to create 1 rle with old method : 0.1302638053894043 time for calcul the mask position with numpy : 0.033394813537597656 nb_pixel_total : 118543 time to create 1 rle with old method : 0.13228797912597656 time for calcul the mask position with numpy : 0.03277277946472168 nb_pixel_total : 23173 time to create 1 rle with old method : 0.026010513305664062 time for calcul the mask position with numpy : 0.031261444091796875 nb_pixel_total : 28997 time to create 1 rle with old method : 0.03289294242858887 create new chi : 7.9176716804504395 time to delete rle : 0.0017104148864746094 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 12680 TO DO : save crop sub photo not yet done ! save time : 1.381439447402954 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 6.3599748611450195 time for calcul the mask position with numpy : 0.7846624851226807 nb_pixel_total : 5520536 time to create 1 rle with new method : 5.216527462005615 time for calcul the mask position with numpy : 0.03375673294067383 nb_pixel_total : 15065 time to create 1 rle with old method : 0.017302513122558594 time for calcul the mask position with numpy : 0.036982059478759766 nb_pixel_total : 305849 time to create 1 rle with new method : 0.9450507164001465 time for calcul the mask position with numpy : 0.03490185737609863 nb_pixel_total : 154615 time to create 1 rle with new method : 1.377943992614746 time for calcul the mask position with numpy : 0.044645071029663086 nb_pixel_total : 58626 time to create 1 rle with old method : 0.10664081573486328 time for calcul the mask position with numpy : 0.04044985771179199 nb_pixel_total : 292294 time to create 1 rle with new method : 1.1505722999572754 time for calcul the mask position with numpy : 0.022533655166625977 nb_pixel_total : 37198 time to create 1 rle with old method : 0.04111337661743164 time for calcul the mask position with numpy : 0.02348160743713379 nb_pixel_total : 499039 time to create 1 rle with new method : 2.100522518157959 time for calcul the mask position with numpy : 0.022322893142700195 nb_pixel_total : 85842 time to create 1 rle with old method : 0.09507107734680176 time for calcul the mask position with numpy : 0.021701335906982422 nb_pixel_total : 81176 time to create 1 rle with old method : 0.09396839141845703 create new chi : 12.346391439437866 time to delete rle : 0.002842426300048828 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 11264 TO DO : save crop sub photo not yet done ! save time : 0.9685587882995605 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 9.122334241867065 time for calcul the mask position with numpy : 2.7916758060455322 nb_pixel_total : 5840987 time to create 1 rle with new method : 1.2683899402618408 time for calcul the mask position with numpy : 0.03313040733337402 nb_pixel_total : 12261 time to create 1 rle with old method : 0.013793468475341797 time for calcul the mask position with numpy : 0.03284430503845215 nb_pixel_total : 9817 time to create 1 rle with old method : 0.011238574981689453 time for calcul the mask position with numpy : 0.0369412899017334 nb_pixel_total : 400335 time to create 1 rle with new method : 1.1520202159881592 time for calcul the mask position with numpy : 0.02510857582092285 nb_pixel_total : 182745 time to create 1 rle with new method : 1.4074649810791016 time for calcul the mask position with numpy : 0.026927471160888672 nb_pixel_total : 406508 time to create 1 rle with new method : 7.346108913421631 time for calcul the mask position with numpy : 0.03302884101867676 nb_pixel_total : 26121 time to create 1 rle with old method : 0.028410911560058594 time for calcul the mask position with numpy : 0.03403663635253906 nb_pixel_total : 120970 time to create 1 rle with old method : 0.1342461109161377 time for calcul the mask position with numpy : 0.03222966194152832 nb_pixel_total : 50496 time to create 1 rle with old method : 0.05700969696044922 create new chi : 14.566091775894165 time to delete rle : 0.0013039112091064453 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++++Number RLEs to save : 8490 TO DO : save crop sub photo not yet done ! save time : 0.8520021438598633 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 8.365418195724487 time for calcul the mask position with numpy : 0.7393801212310791 nb_pixel_total : 6248373 time to create 1 rle with new method : 1.2241129875183105 time for calcul the mask position with numpy : 0.03561854362487793 nb_pixel_total : 240444 time to create 1 rle with new method : 0.609328031539917 time for calcul the mask position with numpy : 0.021263837814331055 nb_pixel_total : 71511 time to create 1 rle with old method : 0.07952618598937988 time for calcul the mask position with numpy : 0.021412372589111328 nb_pixel_total : 31411 time to create 1 rle with old method : 0.03528022766113281 time for calcul the mask position with numpy : 0.02238178253173828 nb_pixel_total : 224787 time to create 1 rle with new method : 0.695648193359375 time for calcul the mask position with numpy : 0.021495819091796875 nb_pixel_total : 16577 time to create 1 rle with old method : 0.019097328186035156 time for calcul the mask position with numpy : 0.020816326141357422 nb_pixel_total : 92118 time to create 1 rle with old method : 0.10383319854736328 time for calcul the mask position with numpy : 0.02071380615234375 nb_pixel_total : 79864 time to create 1 rle with old method : 0.09006714820861816 time for calcul the mask position with numpy : 0.02064800262451172 nb_pixel_total : 26685 time to create 1 rle with old method : 0.030331850051879883 time for calcul the mask position with numpy : 0.021020889282226562 nb_pixel_total : 18470 time to create 1 rle with old method : 0.0213010311126709 create new chi : 3.9347317218780518 time to delete rle : 0.0010898113250732422 batch 1 Loaded 19 chid ids of type : 3594 +++++++++Number RLEs to save : 7660 TO DO : save crop sub photo not yet done ! save time : 0.7453527450561523 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 17.79791021347046 time for calcul the mask position with numpy : 0.6147594451904297 nb_pixel_total : 4806951 time to create 1 rle with new method : 0.8956248760223389 time for calcul the mask position with numpy : 0.03430986404418945 nb_pixel_total : 109837 time to create 1 rle with old method : 0.11910867691040039 time for calcul the mask position with numpy : 0.03433823585510254 nb_pixel_total : 207562 time to create 1 rle with new method : 0.8434662818908691 time for calcul the mask position with numpy : 0.03562426567077637 nb_pixel_total : 312381 time to create 1 rle with new method : 0.9380972385406494 time for calcul the mask position with numpy : 0.034340620040893555 nb_pixel_total : 51971 time to create 1 rle with old method : 0.05940437316894531 time for calcul the mask position with numpy : 0.03582310676574707 nb_pixel_total : 396364 time to create 1 rle with new method : 0.703599214553833 time for calcul the mask position with numpy : 0.03656458854675293 nb_pixel_total : 468853 time to create 1 rle with new method : 0.94342041015625 time for calcul the mask position with numpy : 0.03223824501037598 nb_pixel_total : 19241 time to create 1 rle with old method : 0.02232837677001953 time for calcul the mask position with numpy : 0.020615577697753906 nb_pixel_total : 43564 time to create 1 rle with old method : 0.049640655517578125 time for calcul the mask position with numpy : 0.023221254348754883 nb_pixel_total : 305097 time to create 1 rle with new method : 1.0350565910339355 time for calcul the mask position with numpy : 0.025914907455444336 nb_pixel_total : 35209 time to create 1 rle with old method : 0.03819990158081055 time for calcul the mask position with numpy : 0.032112836837768555 nb_pixel_total : 19765 time to create 1 rle with old method : 0.02173018455505371 time for calcul the mask position with numpy : 0.03347158432006836 nb_pixel_total : 209010 time to create 1 rle with new method : 1.1933515071868896 time for calcul the mask position with numpy : 0.033254384994506836 nb_pixel_total : 18905 time to create 1 rle with old method : 0.021391868591308594 time for calcul the mask position with numpy : 0.0327451229095459 nb_pixel_total : 10837 time to create 1 rle with old method : 0.011948585510253906 time for calcul the mask position with numpy : 0.02946186065673828 nb_pixel_total : 18640 time to create 1 rle with old method : 0.021332979202270508 time for calcul the mask position with numpy : 0.027494192123413086 nb_pixel_total : 6850 time to create 1 rle with old method : 0.007966995239257812 time for calcul the mask position with numpy : 0.024990081787109375 nb_pixel_total : 9203 time to create 1 rle with old method : 0.010805130004882812 create new chi : 8.25623345375061 time to delete rle : 0.002406597137451172 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 14633 TO DO : save crop sub photo not yet done ! save time : 1.429372787475586 nb_obj : 14 nb_hashtags : 2 time to prepare the origin masks : 8.486077547073364 time for calcul the mask position with numpy : 0.5013501644134521 nb_pixel_total : 6623738 time to create 1 rle with new method : 0.5886273384094238 time for calcul the mask position with numpy : 0.02407670021057129 nb_pixel_total : 23974 time to create 1 rle with old method : 0.0799560546875 time for calcul the mask position with numpy : 0.0208284854888916 nb_pixel_total : 13794 time to create 1 rle with old method : 0.01607680320739746 time for calcul the mask position with numpy : 0.02203083038330078 nb_pixel_total : 13681 time to create 1 rle with old method : 0.01614093780517578 time for calcul the mask position with numpy : 0.023434877395629883 nb_pixel_total : 126119 time to create 1 rle with old method : 0.14545893669128418 time for calcul the mask position with numpy : 0.022446870803833008 nb_pixel_total : 18191 time to create 1 rle with old method : 0.021770477294921875 time for calcul the mask position with numpy : 0.022251129150390625 nb_pixel_total : 22134 time to create 1 rle with old method : 0.026552915573120117 time for calcul the mask position with numpy : 0.022428035736083984 nb_pixel_total : 24004 time to create 1 rle with old method : 0.028471708297729492 time for calcul the mask position with numpy : 0.02295684814453125 nb_pixel_total : 26066 time to create 1 rle with old method : 0.03362441062927246 time for calcul the mask position with numpy : 0.026456356048583984 nb_pixel_total : 26683 time to create 1 rle with old method : 0.03231191635131836 time for calcul the mask position with numpy : 0.023777008056640625 nb_pixel_total : 26743 time to create 1 rle with old method : 0.03623032569885254 time for calcul the mask position with numpy : 0.023746490478515625 nb_pixel_total : 14985 time to create 1 rle with old method : 0.019293785095214844 time for calcul the mask position with numpy : 0.024850130081176758 nb_pixel_total : 48415 time to create 1 rle with old method : 0.0560917854309082 time for calcul the mask position with numpy : 0.023357391357421875 nb_pixel_total : 18087 time to create 1 rle with old method : 0.021452665328979492 time for calcul the mask position with numpy : 0.02250051498413086 nb_pixel_total : 23626 time to create 1 rle with old method : 0.029187440872192383 create new chi : 2.0173184871673584 time to delete rle : 0.00152587890625 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 8870 TO DO : save crop sub photo not yet done ! save time : 1.142221450805664 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 15.276150703430176 time for calcul the mask position with numpy : 0.6760454177856445 nb_pixel_total : 6361859 time to create 1 rle with new method : 1.0164084434509277 time for calcul the mask position with numpy : 0.020155906677246094 nb_pixel_total : 10658 time to create 1 rle with old method : 0.01203608512878418 time for calcul the mask position with numpy : 0.021006345748901367 nb_pixel_total : 7773 time to create 1 rle with old method : 0.008764266967773438 time for calcul the mask position with numpy : 0.021326780319213867 nb_pixel_total : 33563 time to create 1 rle with old method : 0.03820228576660156 time for calcul the mask position with numpy : 0.021380186080932617 nb_pixel_total : 13798 time to create 1 rle with old method : 0.016028881072998047 time for calcul the mask position with numpy : 0.02166008949279785 nb_pixel_total : 57053 time to create 1 rle with old method : 0.07416892051696777 time for calcul the mask position with numpy : 0.022003889083862305 nb_pixel_total : 28516 time to create 1 rle with old method : 0.03211092948913574 time for calcul the mask position with numpy : 0.02051234245300293 nb_pixel_total : 17264 time to create 1 rle with old method : 0.01956486701965332 time for calcul the mask position with numpy : 0.020685672760009766 nb_pixel_total : 9629 time to create 1 rle with old method : 0.012706995010375977 time for calcul the mask position with numpy : 0.020572423934936523 nb_pixel_total : 18288 time to create 1 rle with old method : 0.02016139030456543 time for calcul the mask position with numpy : 0.02046060562133789 nb_pixel_total : 13171 time to create 1 rle with old method : 0.014495611190795898 time for calcul the mask position with numpy : 0.021210670471191406 nb_pixel_total : 20637 time to create 1 rle with old method : 0.022788286209106445 time for calcul the mask position with numpy : 0.02003026008605957 nb_pixel_total : 71935 time to create 1 rle with old method : 0.07840490341186523 time for calcul the mask position with numpy : 0.021610021591186523 nb_pixel_total : 236999 time to create 1 rle with new method : 1.2175416946411133 time for calcul the mask position with numpy : 0.021442651748657227 nb_pixel_total : 40965 time to create 1 rle with old method : 0.04602336883544922 time for calcul the mask position with numpy : 0.02100658416748047 nb_pixel_total : 82759 time to create 1 rle with old method : 0.09104657173156738 time for calcul the mask position with numpy : 0.020904064178466797 nb_pixel_total : 25373 time to create 1 rle with old method : 0.028943777084350586 create new chi : 3.8230581283569336 time to delete rle : 0.0015282630920410156 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 9824 TO DO : save crop sub photo not yet done ! save time : 1.3138720989227295 nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 16.34540295600891 time for calcul the mask position with numpy : 1.2675549983978271 nb_pixel_total : 6734875 time to create 1 rle with new method : 1.176520824432373 time for calcul the mask position with numpy : 0.033550262451171875 nb_pixel_total : 40386 time to create 1 rle with old method : 0.04524040222167969 time for calcul the mask position with numpy : 0.02145981788635254 nb_pixel_total : 58481 time to create 1 rle with old method : 0.06515002250671387 time for calcul the mask position with numpy : 0.02095341682434082 nb_pixel_total : 27687 time to create 1 rle with old method : 0.031851768493652344 time for calcul the mask position with numpy : 0.020714521408081055 nb_pixel_total : 17265 time to create 1 rle with old method : 0.019906044006347656 time for calcul the mask position with numpy : 0.023481130599975586 nb_pixel_total : 6323 time to create 1 rle with old method : 0.010586261749267578 time for calcul the mask position with numpy : 0.023723840713500977 nb_pixel_total : 16512 time to create 1 rle with old method : 0.024600744247436523 time for calcul the mask position with numpy : 0.02333664894104004 nb_pixel_total : 37183 time to create 1 rle with old method : 0.0428776741027832 time for calcul the mask position with numpy : 0.02221822738647461 nb_pixel_total : 22320 time to create 1 rle with old method : 0.026007652282714844 time for calcul the mask position with numpy : 0.024279356002807617 nb_pixel_total : 15599 time to create 1 rle with old method : 0.01801133155822754 time for calcul the mask position with numpy : 0.022922754287719727 nb_pixel_total : 44957 time to create 1 rle with old method : 0.05201363563537598 time for calcul the mask position with numpy : 0.021909475326538086 nb_pixel_total : 28652 time to create 1 rle with old method : 0.032221078872680664 create new chi : 3.1101016998291016 time to delete rle : 0.0010967254638671875 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7168 TO DO : save crop sub photo not yet done ! save time : 1.131068468093872 nb_obj : 23 nb_hashtags : 4 time to prepare the origin masks : 18.90247392654419 time for calcul the mask position with numpy : 1.980708360671997 nb_pixel_total : 6351277 time to create 1 rle with new method : 1.5118443965911865 time for calcul the mask position with numpy : 0.019668102264404297 nb_pixel_total : 14687 time to create 1 rle with old method : 0.016062498092651367 time for calcul the mask position with numpy : 0.019962310791015625 nb_pixel_total : 8620 time to create 1 rle with old method : 0.009913444519042969 time for calcul the mask position with numpy : 0.020701885223388672 nb_pixel_total : 50900 time to create 1 rle with old method : 0.05757284164428711 time for calcul the mask position with numpy : 0.020174741744995117 nb_pixel_total : 50247 time to create 1 rle with old method : 0.0556340217590332 time for calcul the mask position with numpy : 0.02105116844177246 nb_pixel_total : 31255 time to create 1 rle with old method : 0.03542780876159668 time for calcul the mask position with numpy : 0.020474910736083984 nb_pixel_total : 19613 time to create 1 rle with old method : 0.022077083587646484 time for calcul the mask position with numpy : 0.02040386199951172 nb_pixel_total : 16753 time to create 1 rle with old method : 0.01864004135131836 time for calcul the mask position with numpy : 0.02051854133605957 nb_pixel_total : 20193 time to create 1 rle with old method : 0.022312164306640625 time for calcul the mask position with numpy : 0.020958900451660156 nb_pixel_total : 30883 time to create 1 rle with old method : 0.03387570381164551 time for calcul the mask position with numpy : 0.02111029624938965 nb_pixel_total : 17773 time to create 1 rle with old method : 0.019385576248168945 time for calcul the mask position with numpy : 0.020342588424682617 nb_pixel_total : 18942 time to create 1 rle with old method : 0.020565509796142578 time for calcul the mask position with numpy : 0.01979827880859375 nb_pixel_total : 11768 time to create 1 rle with old method : 0.01268768310546875 time for calcul the mask position with numpy : 0.021445751190185547 nb_pixel_total : 47589 time to create 1 rle with old method : 0.05214381217956543 time for calcul the mask position with numpy : 0.020847797393798828 nb_pixel_total : 46417 time to create 1 rle with old method : 0.05080461502075195 time for calcul the mask position with numpy : 0.020674467086791992 nb_pixel_total : 33428 time to create 1 rle with old method : 0.03690624237060547 time for calcul the mask position with numpy : 0.021136999130249023 nb_pixel_total : 23281 time to create 1 rle with old method : 0.025968551635742188 time for calcul the mask position with numpy : 0.02026844024658203 nb_pixel_total : 52493 time to create 1 rle with old method : 0.06181669235229492 time for calcul the mask position with numpy : 0.022475481033325195 nb_pixel_total : 11932 time to create 1 rle with old method : 0.013336420059204102 time for calcul the mask position with numpy : 0.020807981491088867 nb_pixel_total : 18498 time to create 1 rle with old method : 0.02051520347595215 time for calcul the mask position with numpy : 0.020590782165527344 nb_pixel_total : 59517 time to create 1 rle with old method : 0.06381416320800781 time for calcul the mask position with numpy : 0.020473241806030273 nb_pixel_total : 49040 time to create 1 rle with old method : 0.05332612991333008 time for calcul the mask position with numpy : 0.020961761474609375 nb_pixel_total : 12532 time to create 1 rle with old method : 0.013524293899536133 time for calcul the mask position with numpy : 0.0208127498626709 nb_pixel_total : 52602 time to create 1 rle with old method : 0.05704641342163086 create new chi : 4.778210163116455 time to delete rle : 0.0019431114196777344 batch 1 Loaded 47 chid ids of type : 3594 +++++++++++++++++++++++++++++Number RLEs to save : 12760 TO DO : save crop sub photo not yet done ! save time : 1.632554054260254 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 9.627736806869507 time for calcul the mask position with numpy : 0.845923900604248 nb_pixel_total : 6132887 time to create 1 rle with new method : 1.7532837390899658 time for calcul the mask position with numpy : 0.02280426025390625 nb_pixel_total : 31800 time to create 1 rle with old method : 0.036431312561035156 time for calcul the mask position with numpy : 0.021164417266845703 nb_pixel_total : 12064 time to create 1 rle with old method : 0.013855457305908203 time for calcul the mask position with numpy : 0.02132701873779297 nb_pixel_total : 44947 time to create 1 rle with old method : 0.05058908462524414 time for calcul the mask position with numpy : 0.020184040069580078 nb_pixel_total : 40808 time to create 1 rle with old method : 0.04618239402770996 time for calcul the mask position with numpy : 0.021015405654907227 nb_pixel_total : 41847 time to create 1 rle with old method : 0.046710968017578125 time for calcul the mask position with numpy : 0.021666765213012695 nb_pixel_total : 173218 time to create 1 rle with new method : 0.8805654048919678 time for calcul the mask position with numpy : 0.020798921585083008 nb_pixel_total : 24873 time to create 1 rle with old method : 0.027200698852539062 time for calcul the mask position with numpy : 0.021114349365234375 nb_pixel_total : 32179 time to create 1 rle with old method : 0.04279804229736328 time for calcul the mask position with numpy : 0.024374723434448242 nb_pixel_total : 13669 time to create 1 rle with old method : 0.02274346351623535 time for calcul the mask position with numpy : 0.022690296173095703 nb_pixel_total : 28252 time to create 1 rle with old method : 0.030813932418823242 time for calcul the mask position with numpy : 0.021666765213012695 nb_pixel_total : 239073 time to create 1 rle with new method : 1.6420834064483643 time for calcul the mask position with numpy : 0.020463228225708008 nb_pixel_total : 142175 time to create 1 rle with old method : 0.16011786460876465 time for calcul the mask position with numpy : 0.019610881805419922 nb_pixel_total : 15266 time to create 1 rle with old method : 0.016266584396362305 time for calcul the mask position with numpy : 0.02050161361694336 nb_pixel_total : 27877 time to create 1 rle with old method : 0.030264854431152344 time for calcul the mask position with numpy : 0.020856142044067383 nb_pixel_total : 49305 time to create 1 rle with old method : 0.05205702781677246 create new chi : 6.097458362579346 time to delete rle : 0.0019655227661132812 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 12707 TO DO : save crop sub photo not yet done ! save time : 2.0992772579193115 map_output_result : {1359053705: (0.0, 'Should be the crop_list due to order', 0), 1359053701: (0.0, 'Should be the crop_list due to order', 0), 1359053646: (0.0, 'Should be the crop_list due to order', 0), 1359053611: (0.0, 'Should be the crop_list due to order', 0), 1359053581: (0.0, 'Should be the crop_list due to order', 0), 1359053557: (0.0, 'Should be the crop_list due to order', 0), 1359053550: (0.0, 'Should be the crop_list due to order', 0), 1359053394: (0.0, 'Should be the crop_list due to order', 0), 1359053363: (0.0, 'Should be the crop_list due to order', 0), 1359053336: (0.0, 'Should be the crop_list due to order', 0), 1359053332: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1359053705, 1359053701, 1359053646, 1359053611, 1359053581, 1359053557, 1359053550, 1359053394, 1359053363, 1359053336, 1359053332] Looping around the photos to save general results len do output : 11 /1359053705.Didn't retrieve data . /1359053701.Didn't retrieve data . /1359053646.Didn't retrieve data . /1359053611.Didn't retrieve data . /1359053581.Didn't retrieve data . /1359053557.Didn't retrieve data . /1359053550.Didn't retrieve data . /1359053394.Didn't retrieve data . /1359053363.Didn't retrieve data . /1359053336.Didn't retrieve data . /1359053332.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053705', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053701', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053646', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053611', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053581', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053557', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053550', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053394', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053363', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053336', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053332', None, None, None, None, None, '2930431') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.12691831588745117 save_final save missing photos in datou_result : time spend for datou_step_exec : 220.25955367088318 time spend to save output : 0.12753510475158691 total time spend for step 3 : 220.38708877563477 step4:ventilate_hashtags_in_portfolio Thu May 22 00:57:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23236829 get user id for portfolio 23236829 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23236829 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pehd','pet_fonce','autre','carton','pet_clair','metal','flou','background','mal_croppe','environnement')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23236829 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pehd','pet_fonce','autre','carton','pet_clair','metal','flou','background','mal_croppe','environnement')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23236829 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pehd','pet_fonce','autre','carton','pet_clair','metal','flou','background','mal_croppe','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23237467,23237468,23237469,23237470,23237471,23237472,23237473,23237474,23237475,23237476,23237477?tags=papier,pehd,pet_fonce,autre,carton,pet_clair,metal,flou,background,mal_croppe,environnement Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1359053705, 1359053701, 1359053646, 1359053611, 1359053581, 1359053557, 1359053550, 1359053394, 1359053363, 1359053336, 1359053332] Looping around the photos to save general results len do output : 1 /23236829. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053705', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053701', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053646', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053611', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053581', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053557', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053550', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053394', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053363', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053336', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053332', None, None, None, None, None, '2930431') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.20392513275146484 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.9738938808441162 time spend to save output : 0.20424818992614746 total time spend for step 4 : 2.1781420707702637 step5:final Thu May 22 00:57:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1359053705: ('0.1352375754068462',), 1359053701: ('0.1352375754068462',), 1359053646: ('0.1352375754068462',), 1359053611: ('0.1352375754068462',), 1359053581: ('0.1352375754068462',), 1359053557: ('0.1352375754068462',), 1359053550: ('0.1352375754068462',), 1359053394: ('0.1352375754068462',), 1359053363: ('0.1352375754068462',), 1359053336: ('0.1352375754068462',), 1359053332: ('0.1352375754068462',)} new output for save of step final : {1359053705: ('0.1352375754068462',), 1359053701: ('0.1352375754068462',), 1359053646: ('0.1352375754068462',), 1359053611: ('0.1352375754068462',), 1359053581: ('0.1352375754068462',), 1359053557: ('0.1352375754068462',), 1359053550: ('0.1352375754068462',), 1359053394: ('0.1352375754068462',), 1359053363: ('0.1352375754068462',), 1359053336: ('0.1352375754068462',), 1359053332: ('0.1352375754068462',)} [1359053705, 1359053701, 1359053646, 1359053611, 1359053581, 1359053557, 1359053550, 1359053394, 1359053363, 1359053336, 1359053332] Looping around the photos to save general results len do output : 11 /1359053705.Didn't retrieve data . /1359053701.Didn't retrieve data . /1359053646.Didn't retrieve data . /1359053611.Didn't retrieve data . /1359053581.Didn't retrieve data . /1359053557.Didn't retrieve data . /1359053550.Didn't retrieve data . /1359053394.Didn't retrieve data . /1359053363.Didn't retrieve data . /1359053336.Didn't retrieve data . /1359053332.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053705', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053701', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053646', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053611', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053581', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053557', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053550', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053394', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053363', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053336', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053332', None, None, None, None, None, '2930431') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.05241966247558594 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.17995333671569824 time spend to save output : 0.05297398567199707 total time spend for step 5 : 0.2329273223876953 step6:blur_detection Thu May 22 00:57:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d.jpg resize: (2160, 3264) 1359053705 -1.5416000308714533 treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a.jpg resize: (2160, 3264) 1359053701 -0.558340225154428 treat image : temp/1747867828_702926_1359053646_01444cc4b952196d2ccfc4668312cc20.jpg resize: (2160, 3264) 1359053646 -2.417512099247254 treat image : temp/1747867828_702926_1359053611_f1eb9b7ff97a0acd5ee6c8b5b84d6f6f.jpg resize: (2160, 3264) 1359053611 -1.7025490703089332 treat image : temp/1747867828_702926_1359053581_0373abb339acc7031d1e94632cd61248.jpg resize: (2160, 3264) 1359053581 -0.14530639099473025 treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975.jpg resize: (2160, 3264) 1359053557 0.8368518117647569 treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1.jpg resize: (2160, 3264) 1359053550 -1.082078472161776 treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66.jpg resize: (2160, 3264) 1359053394 -2.236678417008599 treat image : temp/1747867828_702926_1359053363_1c415108cd3391ec2800ee96d2255815.jpg resize: (2160, 3264) 1359053363 -2.272046465087971 treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903.jpg resize: (2160, 3264) 1359053336 -3.040034814300198 treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07.jpg resize: (2160, 3264) 1359053332 -0.7869687074566625 treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811813_0.png resize: (94, 74) 1360266241 0.07508412655148114 treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811809_0.png resize: (303, 226) 1360266242 -1.7346491136695827 treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811810_0.png resize: (122, 122) 1360266243 -1.059236093214379 treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811811_0.png resize: (498, 391) 1360266245 -1.06356061487268 treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811817_0.png resize: (120, 187) 1360266246 -0.19009883204152525 treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811816_0.png resize: (781, 276) 1360266247 -1.3282259140694768 treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811820_0.png resize: (232, 161) 1360266249 -1.5123206145100614 treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811815_0.png resize: (131, 196) 1360266250 0.2164212493569467 treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811812_0.png resize: (171, 108) 1360266251 0.0027015323132457128 treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811828_0.png resize: (223, 407) 1360266253 -2.109202348192861 treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811827_0.png resize: (168, 145) 1360266254 -1.792582292009459 treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811823_0.png resize: (249, 726) 1360266255 -1.0180936050647782 treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811821_0.png resize: (240, 220) 1360266257 -1.2808362521029975 treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811826_0.png resize: (299, 557) 1360266258 -1.060888010831564 treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811832_0.png resize: (293, 419) 1360266259 -1.5212694090888628 treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811829_0.png resize: (198, 165) 1360266261 -0.7866400351324313 treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811830_0.png resize: (255, 326) 1360266262 -1.6141554611953761 treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811834_0.png resize: (153, 151) 1360266263 -0.7254260321334333 treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811822_0.png resize: (163, 213) 1360266265 -0.3203963772521396 treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811835_0.png resize: (596, 195) 1360266266 -1.2629574634890048 treat image : temp/1747867828_702926_1359053646_01444cc4b952196d2ccfc4668312cc20_rle_crop_3808811844_0.png resize: (1019, 1463) 1360266268 -0.46873594785332423 treat image : temp/1747867828_702926_1359053646_01444cc4b952196d2ccfc4668312cc20_rle_crop_3808811838_0.png resize: (168, 618) 1360266269 -0.5806560754541066 treat image : temp/1747867828_702926_1359053646_01444cc4b952196d2ccfc4668312cc20_rle_crop_3808811837_0.png resize: (218, 631) 1360266270 -1.2810927710040925 treat image : temp/1747867828_702926_1359053646_01444cc4b952196d2ccfc4668312cc20_rle_crop_3808811839_0.png resize: (865, 861) 1360266272 -3.750227743183796 treat image : temp/1747867828_702926_1359053646_01444cc4b952196d2ccfc4668312cc20_rle_crop_3808811843_0.png resize: (372, 490) 1360266274 -1.8764584479338304 treat image : temp/1747867828_702926_1359053611_f1eb9b7ff97a0acd5ee6c8b5b84d6f6f_rle_crop_3808811852_0.png resize: (110, 144) 1360266275 -2.3128976762248215 treat image : temp/1747867828_702926_1359053611_f1eb9b7ff97a0acd5ee6c8b5b84d6f6f_rle_crop_3808811853_0.png resize: (126, 141) 1360266277 -2.3299802166281434 treat image : temp/1747867828_702926_1359053611_f1eb9b7ff97a0acd5ee6c8b5b84d6f6f_rle_crop_3808811847_0.png resize: (350, 660) 1360266278 -0.5583581662539427 treat image : temp/1747867828_702926_1359053611_f1eb9b7ff97a0acd5ee6c8b5b84d6f6f_rle_crop_3808811849_0.png resize: (579, 794) 1360266279 -0.24135549664345823 treat image : temp/1747867828_702926_1359053611_f1eb9b7ff97a0acd5ee6c8b5b84d6f6f_rle_crop_3808811846_0.png resize: (190, 396) 1360266281 -2.114474223673644 treat image : temp/1747867828_702926_1359053581_0373abb339acc7031d1e94632cd61248_rle_crop_3808811855_0.png resize: (230, 190) 1360266282 -1.8797917347834368 treat image : temp/1747867828_702926_1359053581_0373abb339acc7031d1e94632cd61248_rle_crop_3808811856_0.png resize: (272, 480) 1360266283 -1.4219981997581497 treat image : temp/1747867828_702926_1359053581_0373abb339acc7031d1e94632cd61248_rle_crop_3808811857_0.png resize: (389, 365) 1360266285 -1.5546316005838663 treat image : temp/1747867828_702926_1359053581_0373abb339acc7031d1e94632cd61248_rle_crop_3808811858_0.png resize: (142, 168) 1360266286 -1.4303140335781321 treat image : temp/1747867828_702926_1359053581_0373abb339acc7031d1e94632cd61248_rle_crop_3808811854_0.png resize: (182, 180) 1360266287 -1.5207544287329864 treat image : temp/1747867828_702926_1359053581_0373abb339acc7031d1e94632cd61248_rle_crop_3808811861_0.png resize: (243, 491) 1360266289 -0.7952325824987533 treat image : temp/1747867828_702926_1359053581_0373abb339acc7031d1e94632cd61248_rle_crop_3808811860_0.png resize: (173, 319) 1360266290 -1.1378096949715943 treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811864_0.png resize: (107, 100) 1360266291 -1.6771411355401227 treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811871_0.png resize: (774, 557) 1360266293 -0.6427966241614035 treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811877_0.png resize: (660, 601) 1360266294 -0.6651444756922866 treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811863_0.png resize: (73, 159) 1360266295 -0.018390032888279277 treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811866_0.png resize: (131, 111) 1360266297 -0.5377687188943413 treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811873_0.png resize: (156, 266) 1360266298 -0.7542274490792312 treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811865_0.png resize: (177, 190) 1360266299 0.22918893407729793 treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811869_0.png resize: (239, 230) 1360266301 -0.8653889189985682 treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811870_0.png resize: (229, 243) 1360266302 0.6428146680809661 treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811880_0.png resize: (194, 248) 1360266303 -1.4339175621297546 treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811891_0.png resize: (171, 199) 1360266305 -1.9728957994775227 treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811884_0.png resize: (204, 232) 1360266306 -1.1378062823362032 treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811882_0.png resize: (333, 236) 1360266307 -1.2260213927938757 treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811893_0.png resize: (253, 165) 1360266309 -0.7842585723708252 treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811888_0.png resize: (188, 181) 1360266311 -0.9615518361735189 treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811881_0.png resize: (179, 115) 1360266313 1.8207005872713062 treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811885_0.png resize: (125, 264) 1360266316 -0.8606931126376134 treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811883_0.png resize: (119, 178) 1360266318 -1.1998543512891655 treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811895_0.png resize: (444, 304) 1360266320 -1.474241333536858 treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811903_0.png resize: (155, 147) 1360266323 -1.5433287023227702 treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811900_0.png resize: (151, 126) 1360266325 -1.1888769448282899 treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811898_0.png resize: (314, 353) 1360266327 -0.481374484201553 treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811904_0.png resize: (191, 226) 1360266329 -2.3568784038042283 treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811897_0.png resize: (398, 765) 1360266332 -2.6356457180281 treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811901_0.png resize: (159, 170) 1360266334 -1.8979543398902863 treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811906_0.png resize: (143, 133) 1360266337 1.2608436277987707 treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811894_0.png resize: (230, 197) 1360266339 -0.677540169224824 treat image : temp/1747867828_702926_1359053363_1c415108cd3391ec2800ee96d2255815_rle_crop_3808811915_0.png resize: (122, 200) 1360266341 -1.5737441228233158 treat image : temp/1747867828_702926_1359053363_1c415108cd3391ec2800ee96d2255815_rle_crop_3808811913_0.png resize: (208, 201) 1360266344 -0.887421107814416 treat image : temp/1747867828_702926_1359053363_1c415108cd3391ec2800ee96d2255815_rle_crop_3808811910_0.png resize: (306, 134) 1360266346 -2.2629689571805445 treat image : temp/1747867828_702926_1359053363_1c415108cd3391ec2800ee96d2255815_rle_crop_3808811920_0.png resize: (244, 197) 1360266348 -1.0621691973923757 treat image : temp/1747867828_702926_1359053363_1c415108cd3391ec2800ee96d2255815_rle_crop_3808811911_0.png resize: (408, 148) 1360266351 -1.526595409044219 treat image : temp/1747867828_702926_1359053363_1c415108cd3391ec2800ee96d2255815_rle_crop_3808811916_0.png resize: (108, 80) 1360266353 0.19330079732856492 treat image : temp/1747867828_702926_1359053363_1c415108cd3391ec2800ee96d2255815_rle_crop_3808811912_0.png resize: (158, 162) 1360266355 -1.2884191488983083 treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811929_0.png resize: (233, 228) 1360266358 -1.7771361468590292 treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811921_0.png resize: (374, 317) 1360266360 -1.5720487338614906 treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811943_0.png resize: (131, 155) 1360266362 -0.5888547616025872 treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811935_0.png resize: (284, 209) 1360266365 -2.01861762175555 treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811924_0.png resize: (292, 421) 1360266367 -4.282485978060657 treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811922_0.png resize: (90, 220) 1360266369 -2.647324695934282 treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811930_0.png resize: (168, 351) 1360266372 -2.1312492979863653 treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811937_0.png resize: (153, 187) 1360266374 -2.1474980849108216 treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811928_0.png resize: (231, 214) 1360266376 -0.8416693074684077 treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811934_0.png resize: (165, 139) 1360266379 -0.885581658506062 treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811936_0.png resize: (103, 224) 1360266381 1.4670958017374818 treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811938_0.png resize: (354, 126) 1360266383 -1.9202186282120217 treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811956_0.png resize: (359, 242) 1360266386 -1.4506081683281629 treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811951_0.png resize: (193, 282) 1360266388 -0.29859915760950123 treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811950_0.png resize: (105, 184) 1360266391 -0.6110152295714268 treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811952_0.png resize: (203, 181) 1360266393 -1.0818901800954983 treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811946_0.png resize: (151, 160) 1360266395 -1.1161853124780923 treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811945_0.png resize: (349, 148) 1360266398 -0.28110470639238694 treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811949_0.png resize: (197, 203) 1360266400 0.6069941399053999 treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811808_0.png resize: (210, 194) 1360266626 -1.6081215438451106 treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811825_0.png resize: (822, 406) 1360266627 -0.9017441701752215 treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811836_0.png resize: (143, 165) 1360266628 0.14544425371482564 treat image : temp/1747867828_702926_1359053646_01444cc4b952196d2ccfc4668312cc20_rle_crop_3808811841_0.png resize: (626, 679) 1360266629 -0.8464324187810006 treat image : temp/1747867828_702926_1359053611_f1eb9b7ff97a0acd5ee6c8b5b84d6f6f_rle_crop_3808811848_0.png resize: (244, 184) 1360266630 -1.1154121920744904 treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811875_0.png resize: (749, 680) 1360266631 -0.5768531109688101 treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811872_0.png resize: (274, 248) 1360266632 0.05291894665439139 treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811867_0.png resize: (104, 234) 1360266633 1.535875620766957 treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811907_0.png resize: (238, 210) 1360266634 -1.8324682639211087 treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811905_0.png resize: (297, 271) 1360266635 -0.8859452585960592 treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811909_0.png resize: (150, 120) 1360266636 -2.1090012960269644 treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811899_0.png resize: (174, 156) 1360266637 -0.8227164775089221 treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811896_0.png resize: (278, 225) 1360266638 -1.5533837379498219 treat image : temp/1747867828_702926_1359053363_1c415108cd3391ec2800ee96d2255815_rle_crop_3808811917_0.png resize: (258, 115) 1360266639 -0.7797183384399394 treat image : temp/1747867828_702926_1359053363_1c415108cd3391ec2800ee96d2255815_rle_crop_3808811918_0.png resize: (186, 245) 1360266640 -0.10337945874199478 treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811926_0.png resize: (109, 175) 1360266641 -1.443867282048465 treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811939_0.png resize: (175, 220) 1360266642 0.57179207155953 treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811940_0.png resize: (186, 380) 1360266643 -1.9575736916064128 treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811925_0.png resize: (120, 237) 1360266644 -0.8908703980577537 treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811927_0.png resize: (332, 221) 1360266645 -1.0842739625189601 treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811942_0.png resize: (172, 59) 1360266646 -0.8139437461769297 treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811818_0.png resize: (543, 616) 1360266726 -1.4180895554939386 treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811814_0.png resize: (204, 152) 1360266729 -1.6710557847181973 treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811819_0.png resize: (91, 130) 1360266731 -2.9244804583934156 treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811833_0.png resize: (149, 247) 1360266733 -1.267289502275963 treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811824_0.png resize: (316, 601) 1360266736 -2.5089039361713006 treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811831_0.png resize: (314, 249) 1360266738 -1.5183104714532096 treat image : temp/1747867828_702926_1359053646_01444cc4b952196d2ccfc4668312cc20_rle_crop_3808811845_0.png resize: (174, 199) 1360266740 -1.9302622396612659 treat image : temp/1747867828_702926_1359053646_01444cc4b952196d2ccfc4668312cc20_rle_crop_3808811842_0.png resize: (191, 425) 1360266743 -1.9279980813386313 treat image : temp/1747867828_702926_1359053646_01444cc4b952196d2ccfc4668312cc20_rle_crop_3808811840_0.png resize: (198, 267) 1360266745 -1.7203141294677455 treat image : temp/1747867828_702926_1359053611_f1eb9b7ff97a0acd5ee6c8b5b84d6f6f_rle_crop_3808811850_0.png resize: (563, 592) 1360266747 -1.9476606480053649 treat image : temp/1747867828_702926_1359053611_f1eb9b7ff97a0acd5ee6c8b5b84d6f6f_rle_crop_3808811851_0.png resize: (556, 1168) 1360266750 -2.0267577472905933 treat image : temp/1747867828_702926_1359053581_0373abb339acc7031d1e94632cd61248_rle_crop_3808811859_0.png resize: (480, 643) 1360266752 -0.0650725385735687 treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811876_0.png resize: (211, 348) 1360266754 -1.0201681695525584 treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811874_0.png resize: (735, 849) 1360266758 0.6274529634266945 treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811868_0.png resize: (686, 453) 1360266760 -0.8578110782162467 treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811879_0.png resize: (249, 582) 1360266762 0.7175527013842586 treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811878_0.png resize: (630, 519) 1360266765 0.6596811446028881 treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811886_0.png resize: (316, 120) 1360266767 -2.737334396630989 treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811887_0.png resize: (223, 140) 1360266769 -1.3498745997314905 treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811889_0.png resize: (259, 454) 1360266772 -2.8953706872875444 treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811890_0.png resize: (466, 353) 1360266774 -1.562212722770625 treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811892_0.png resize: (156, 113) 1360266776 -1.8609203965408705 treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811902_0.png resize: (85, 137) 1360266779 -2.1676055161457763 treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811908_0.png resize: (63, 156) 1360266781 -0.4942998913599953 treat image : temp/1747867828_702926_1359053363_1c415108cd3391ec2800ee96d2255815_rle_crop_3808811914_0.png resize: (207, 231) 1360266783 -1.5995177715146207 treat image : temp/1747867828_702926_1359053363_1c415108cd3391ec2800ee96d2255815_rle_crop_3808811919_0.png resize: (225, 371) 1360266786 -1.147760917226335 treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811933_0.png resize: (214, 199) 1360266788 -1.8155232483725974 treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811941_0.png resize: (248, 319) 1360266790 -1.0491924937437747 treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811923_0.png resize: (313, 240) 1360266793 -2.0663970634041875 treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811931_0.png resize: (206, 293) 1360266795 -1.361246621898579 treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811948_0.png resize: (1551, 658) 1360266797 -0.8606254501483783 treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811944_0.png resize: (152, 450) 1360266800 -1.1051749794852215 treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811955_0.png resize: (201, 267) 1360266802 -0.7847206674474012 treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811954_0.png resize: (288, 237) 1360266804 -2.410099400347416 treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811957_0.png resize: (168, 200) 1360266807 -1.4566164094581893 treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811947_0.png resize: (326, 600) 1360266809 -0.4774456169449707 treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811953_0.png resize: (476, 433) 1360266811 0.29464381897809666 treat image : temp/1747867828_702926_1359053581_0373abb339acc7031d1e94632cd61248_rle_crop_3808811862_0.png resize: (604, 513) 1360266828 -0.062085704122311604 treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811932_0.png resize: (115, 130) 1360266829 0.21817130440680538 treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811958_0.png resize: (190, 218) 1360266839 -0.4225703248058786 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 162 time used for this insertion : 0.023077726364135742 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 162 time used for this insertion : 0.04211878776550293 save missing photos in datou_result : time spend for datou_step_exec : 47.16367983818054 time spend to save output : 0.07031106948852539 total time spend for step 6 : 47.23399090766907 step7:brightness Thu May 22 00:58:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d.jpg treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a.jpg treat image : temp/1747867828_702926_1359053646_01444cc4b952196d2ccfc4668312cc20.jpg treat image : temp/1747867828_702926_1359053611_f1eb9b7ff97a0acd5ee6c8b5b84d6f6f.jpg treat image : temp/1747867828_702926_1359053581_0373abb339acc7031d1e94632cd61248.jpg treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975.jpg treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1.jpg treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66.jpg treat image : temp/1747867828_702926_1359053363_1c415108cd3391ec2800ee96d2255815.jpg treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903.jpg treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07.jpg treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811813_0.png treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811809_0.png treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811810_0.png treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811811_0.png treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811817_0.png treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811816_0.png treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811820_0.png treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811815_0.png treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811812_0.png treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811828_0.png treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811827_0.png treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811823_0.png treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811821_0.png treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811826_0.png treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811832_0.png treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811829_0.png treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811830_0.png treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811834_0.png treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811822_0.png treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811835_0.png treat image : temp/1747867828_702926_1359053646_01444cc4b952196d2ccfc4668312cc20_rle_crop_3808811844_0.png treat image : temp/1747867828_702926_1359053646_01444cc4b952196d2ccfc4668312cc20_rle_crop_3808811838_0.png treat image : temp/1747867828_702926_1359053646_01444cc4b952196d2ccfc4668312cc20_rle_crop_3808811837_0.png treat image : temp/1747867828_702926_1359053646_01444cc4b952196d2ccfc4668312cc20_rle_crop_3808811839_0.png treat image : temp/1747867828_702926_1359053646_01444cc4b952196d2ccfc4668312cc20_rle_crop_3808811843_0.png treat image : temp/1747867828_702926_1359053611_f1eb9b7ff97a0acd5ee6c8b5b84d6f6f_rle_crop_3808811852_0.png treat image : temp/1747867828_702926_1359053611_f1eb9b7ff97a0acd5ee6c8b5b84d6f6f_rle_crop_3808811853_0.png treat image : temp/1747867828_702926_1359053611_f1eb9b7ff97a0acd5ee6c8b5b84d6f6f_rle_crop_3808811847_0.png treat image : temp/1747867828_702926_1359053611_f1eb9b7ff97a0acd5ee6c8b5b84d6f6f_rle_crop_3808811849_0.png treat image : temp/1747867828_702926_1359053611_f1eb9b7ff97a0acd5ee6c8b5b84d6f6f_rle_crop_3808811846_0.png treat image : temp/1747867828_702926_1359053581_0373abb339acc7031d1e94632cd61248_rle_crop_3808811855_0.png treat image : temp/1747867828_702926_1359053581_0373abb339acc7031d1e94632cd61248_rle_crop_3808811856_0.png treat image : temp/1747867828_702926_1359053581_0373abb339acc7031d1e94632cd61248_rle_crop_3808811857_0.png treat image : temp/1747867828_702926_1359053581_0373abb339acc7031d1e94632cd61248_rle_crop_3808811858_0.png treat image : temp/1747867828_702926_1359053581_0373abb339acc7031d1e94632cd61248_rle_crop_3808811854_0.png treat image : temp/1747867828_702926_1359053581_0373abb339acc7031d1e94632cd61248_rle_crop_3808811861_0.png treat image : temp/1747867828_702926_1359053581_0373abb339acc7031d1e94632cd61248_rle_crop_3808811860_0.png treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811864_0.png treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811871_0.png treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811877_0.png treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811863_0.png treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811866_0.png treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811873_0.png treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811865_0.png treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811869_0.png treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811870_0.png treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811880_0.png treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811891_0.png treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811884_0.png treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811882_0.png treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811893_0.png treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811888_0.png treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811881_0.png treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811885_0.png treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811883_0.png treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811895_0.png treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811903_0.png treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811900_0.png treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811898_0.png treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811904_0.png treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811897_0.png treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811901_0.png treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811906_0.png treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811894_0.png treat image : temp/1747867828_702926_1359053363_1c415108cd3391ec2800ee96d2255815_rle_crop_3808811915_0.png treat image : temp/1747867828_702926_1359053363_1c415108cd3391ec2800ee96d2255815_rle_crop_3808811913_0.png treat image : temp/1747867828_702926_1359053363_1c415108cd3391ec2800ee96d2255815_rle_crop_3808811910_0.png treat image : temp/1747867828_702926_1359053363_1c415108cd3391ec2800ee96d2255815_rle_crop_3808811920_0.png treat image : temp/1747867828_702926_1359053363_1c415108cd3391ec2800ee96d2255815_rle_crop_3808811911_0.png treat image : temp/1747867828_702926_1359053363_1c415108cd3391ec2800ee96d2255815_rle_crop_3808811916_0.png treat image : temp/1747867828_702926_1359053363_1c415108cd3391ec2800ee96d2255815_rle_crop_3808811912_0.png treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811929_0.png treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811921_0.png treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811943_0.png treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811935_0.png treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811924_0.png treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811922_0.png treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811930_0.png treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811937_0.png treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811928_0.png treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811934_0.png treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811936_0.png treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811938_0.png treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811956_0.png treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811951_0.png treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811950_0.png treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811952_0.png treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811946_0.png treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811945_0.png treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811949_0.png treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811808_0.png treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811825_0.png treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811836_0.png treat image : temp/1747867828_702926_1359053646_01444cc4b952196d2ccfc4668312cc20_rle_crop_3808811841_0.png treat image : temp/1747867828_702926_1359053611_f1eb9b7ff97a0acd5ee6c8b5b84d6f6f_rle_crop_3808811848_0.png treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811875_0.png treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811872_0.png treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811867_0.png treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811907_0.png treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811905_0.png treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811909_0.png treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811899_0.png treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811896_0.png treat image : temp/1747867828_702926_1359053363_1c415108cd3391ec2800ee96d2255815_rle_crop_3808811917_0.png treat image : temp/1747867828_702926_1359053363_1c415108cd3391ec2800ee96d2255815_rle_crop_3808811918_0.png treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811926_0.png treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811939_0.png treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811940_0.png treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811925_0.png treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811927_0.png treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811942_0.png treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811818_0.png treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811814_0.png treat image : temp/1747867828_702926_1359053705_3617c722849b42bba5a95aab4952929d_rle_crop_3808811819_0.png treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811833_0.png treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811824_0.png treat image : temp/1747867828_702926_1359053701_61035f362fe649539216258dfdd8ff6a_rle_crop_3808811831_0.png treat image : temp/1747867828_702926_1359053646_01444cc4b952196d2ccfc4668312cc20_rle_crop_3808811845_0.png treat image : temp/1747867828_702926_1359053646_01444cc4b952196d2ccfc4668312cc20_rle_crop_3808811842_0.png treat image : temp/1747867828_702926_1359053646_01444cc4b952196d2ccfc4668312cc20_rle_crop_3808811840_0.png treat image : temp/1747867828_702926_1359053611_f1eb9b7ff97a0acd5ee6c8b5b84d6f6f_rle_crop_3808811850_0.png treat image : temp/1747867828_702926_1359053611_f1eb9b7ff97a0acd5ee6c8b5b84d6f6f_rle_crop_3808811851_0.png treat image : temp/1747867828_702926_1359053581_0373abb339acc7031d1e94632cd61248_rle_crop_3808811859_0.png treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811876_0.png treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811874_0.png treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811868_0.png treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811879_0.png treat image : temp/1747867828_702926_1359053557_f640c6e12607fc91abb4df2d5fae4975_rle_crop_3808811878_0.png treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811886_0.png treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811887_0.png treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811889_0.png treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811890_0.png treat image : temp/1747867828_702926_1359053550_59ac811f2cc5b64df4cffa6224c2c2f1_rle_crop_3808811892_0.png treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811902_0.png treat image : temp/1747867828_702926_1359053394_635cd7029ff761292af39affe221ea66_rle_crop_3808811908_0.png treat image : temp/1747867828_702926_1359053363_1c415108cd3391ec2800ee96d2255815_rle_crop_3808811914_0.png treat image : temp/1747867828_702926_1359053363_1c415108cd3391ec2800ee96d2255815_rle_crop_3808811919_0.png treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811933_0.png treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811941_0.png treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811923_0.png treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811931_0.png treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811948_0.png treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811944_0.png treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811955_0.png treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811954_0.png treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811957_0.png treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811947_0.png treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811953_0.png treat image : temp/1747867828_702926_1359053581_0373abb339acc7031d1e94632cd61248_rle_crop_3808811862_0.png treat image : temp/1747867828_702926_1359053336_ee926bb646bcbed559c771d975c4f903_rle_crop_3808811932_0.png treat image : temp/1747867828_702926_1359053332_f2c81bb439a9476865ad5e26b0fefc07_rle_crop_3808811958_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 162 time used for this insertion : 0.022815704345703125 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 162 time used for this insertion : 0.04128384590148926 save missing photos in datou_result : time spend for datou_step_exec : 9.891530990600586 time spend to save output : 0.06922245025634766 total time spend for step 7 : 9.960753440856934 step8:velours_tree Thu May 22 00:58:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.15700531005859375 time spend to save output : 5.6743621826171875e-05 total time spend for step 8 : 0.15706205368041992 step9:send_mail_cod Thu May 22 00:58:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23236829_22-05-2025_00_58_12.pdf 23237467 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232374671747868292 23237468 imagette232374681747868294 23237469 change filename to text .imagette232374691747868294 23237470 change filename to text .change filename to text .imagette232374701747868294 23237471 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232374711747868294 23237472 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232374721747868296 23237473 imagette232374731747868297 23237474 imagette232374741747868297 23237475 imagette232374751747868297 23237476 imagette232374761747868297 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23236829 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23237467,23237468,23237469,23237470,23237471,23237472,23237473,23237474,23237475,23237476,23237477?tags=papier,pehd,pet_fonce,autre,carton,pet_clair,metal,flou,background,mal_croppe,environnement args[1359053705] : ((1359053705, -1.5416000308714533, 492688767), (1359053705, 0.061108663572172484, 2107752395), '0.1352375754068462') We are sending mail with results at report@fotonower.com args[1359053701] : ((1359053701, -0.558340225154428, 492688767), (1359053701, 0.24254942548819206, 2107752395), '0.1352375754068462') We are sending mail with results at report@fotonower.com args[1359053646] : ((1359053646, -2.417512099247254, 492609224), (1359053646, -0.09039095572975132, 496442774), '0.1352375754068462') We are sending mail with results at report@fotonower.com args[1359053611] : ((1359053611, -1.7025490703089332, 492688767), (1359053611, 0.24055284495018803, 2107752395), '0.1352375754068462') We are sending mail with results at report@fotonower.com args[1359053581] : ((1359053581, -0.14530639099473025, 492688767), (1359053581, 0.011047483090865689, 2107752395), '0.1352375754068462') We are sending mail with results at report@fotonower.com args[1359053557] : ((1359053557, 0.8368518117647569, 492688767), (1359053557, 0.23390123775808175, 2107752395), '0.1352375754068462') We are sending mail with results at report@fotonower.com args[1359053550] : ((1359053550, -1.082078472161776, 492688767), (1359053550, -0.0651186744976144, 2107752395), '0.1352375754068462') We are sending mail with results at report@fotonower.com args[1359053394] : ((1359053394, -2.236678417008599, 492609224), (1359053394, 0.10754108907048299, 2107752395), '0.1352375754068462') We are sending mail with results at report@fotonower.com args[1359053363] : ((1359053363, -2.272046465087971, 492609224), (1359053363, 0.41323426581735645, 2107752395), '0.1352375754068462') We are sending mail with results at report@fotonower.com args[1359053336] : ((1359053336, -3.040034814300198, 492609224), (1359053336, 0.16586885928230952, 2107752395), '0.1352375754068462') We are sending mail with results at report@fotonower.com args[1359053332] : ((1359053332, -0.7869687074566625, 492688767), (1359053332, 0.15605075014331665, 2107752395), '0.1352375754068462') We are sending mail with results at report@fotonower.com refus_total : 0.1352375754068462 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23236829 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23236829_22-05-2025_00_58_12.pdf results_Auto_P23236829_22-05-2025_00_58_12.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23236829_22-05-2025_00_58_12.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23236829','results_Auto_P23236829_22-05-2025_00_58_12.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23236829_22-05-2025_00_58_12.pdf','pdf','','0.69','0.1352375754068462') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23236829

https://www.fotonower.com/image?json=false&list_photos_id=1359053705
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359053701
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359053646
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359053611
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359053581
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359053557
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359053550
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359053394
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359053363
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359053336
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359053332
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 13.52%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/23237467?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/23237469?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23237470?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23237471?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23237472?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23236829_22-05-2025_00_58_12.pdf.

Lien vers velours :https://www.fotonower.com/velours/23237467,23237468,23237469,23237470,23237471,23237472,23237473,23237474,23237475,23237476,23237477?tags=papier,pehd,pet_fonce,autre,carton,pet_clair,metal,flou,background,mal_croppe,environnement.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 21 May 2025 22:58:20 GMT Content-Length: 0 Connection: close X-Message-Id: iK1hjLrAQxu_QNZdYU-ghw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1359053705, 1359053701, 1359053646, 1359053611, 1359053581, 1359053557, 1359053550, 1359053394, 1359053363, 1359053336, 1359053332] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053705', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053701', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053646', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053611', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053581', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053557', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053550', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053394', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053363', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053336', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053332', None, None, None, None, None, '2930431') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.10879135131835938 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.38956880569458 time spend to save output : 0.10909032821655273 total time spend for step 9 : 7.498659133911133 step10:split_time_score Thu May 22 00:58:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('20', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 16052025 23236829 Nombre de photos uploadées : 11 / 23040 (0%) 16052025 23236829 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 16052025 23236829 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 1.1920928955078125e-06 elapsed_time : order_list_meta_photo_and_scores 9.5367431640625e-06 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.0016913414001464844 elapsed_time : insert_dashboard_record_day_entry 0.027894020080566406 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.14479838468426087 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23051725_16-05-2025_08_40_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23051725 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23051725 AND mptpi.`type`=3594 To do Qualite : 0.13390745090474465 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23054180_16-05-2025_09_19_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23054180 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23054180 AND mptpi.`type`=3594 To do Qualite : 0.07546453419112656 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23055818_17-05-2025_12_56_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23055818 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23055818 AND mptpi.`type`=3726 To do Qualite : 0.08740406277947545 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23054189_17-05-2025_11_33_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23054189 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23054189 AND mptpi.`type`=3726 To do Qualite : 0.15347928196928026 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23054191_16-05-2025_09_14_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23054191 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23054191 AND mptpi.`type`=3726 To do Qualite : 0.02967704052376263 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23063142_19-05-2025_14_25_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23063142 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23063142 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23236822 order by id desc limit 1 Qualite : 0.08834570576963167 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23077270_18-05-2025_03_31_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23077270 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23077270 AND mptpi.`type`=3726 To do Qualite : 0.21766098421007624 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23077275_18-05-2025_03_43_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23077275 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23077275 AND mptpi.`type`=3726 To do Qualite : 0.11777007402588692 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23077279_18-05-2025_03_53_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23077279 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23077279 AND mptpi.`type`=3726 To do Qualite : 0.16052945457433812 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23077284_16-05-2025_19_09_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23077284 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23077284 AND mptpi.`type`=3594 To do Qualite : 0.10575585925999524 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23077287_16-05-2025_19_14_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23077287 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23077287 AND mptpi.`type`=3594 To do Qualite : 0.02617926954068449 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23082890_19-05-2025_23_24_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23082890 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23082890 AND mptpi.`type`=3726 To do Qualite : 0.12590134047446142 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23082895_16-05-2025_22_25_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23082895 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23082895 AND mptpi.`type`=3594 To do Qualite : 0.09525452493404507 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23084349_18-05-2025_22_39_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23084349 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23084349 AND mptpi.`type`=3726 To do Qualite : 0.1352375754068462 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23236829_22-05-2025_00_58_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23236829 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23236829 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'16052025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1359053705, 1359053701, 1359053646, 1359053611, 1359053581, 1359053557, 1359053550, 1359053394, 1359053363, 1359053336, 1359053332] Looping around the photos to save general results len do output : 1 /23236829Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053705', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053701', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053646', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053611', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053581', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053557', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053550', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053394', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053363', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053336', None, None, None, None, None, '2930431') ('3318', None, None, None, None, None, None, None, '2930431') ('3318', '23236829', '1359053332', None, None, None, None, None, '2930431') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.01877427101135254 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.2846970558166504 time spend to save output : 0.019003868103027344 total time spend for step 10 : 2.3037009239196777 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 152.41user 252.10system 7:57.63elapsed 84%CPU (0avgtext+0avgdata 5333760maxresident)k 89056inputs+94440outputs (1856major+14589331minor)pagefaults 0swaps