python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3071092 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3736477'] with mtr_portfolio_ids : ['26955635'] and first list_photo_ids : [] new path : /proc/3071092/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 6 ; length of list_pids : 6 ; length of list_args : 6 time to download the photos : 1.3017816543579102 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Sep 17 17:00:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10366 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-17 17:00:34.068792: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-17 17:00:34.096708: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-17 17:00:34.098729: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f9d54000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-17 17:00:34.098793: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-17 17:00:34.102703: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-17 17:00:34.237065: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2a8e6e50 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-17 17:00:34.237137: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-17 17:00:34.238408: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-17 17:00:34.238870: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-17 17:00:34.241580: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-17 17:00:34.244043: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-17 17:00:34.244493: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-17 17:00:34.247395: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-17 17:00:34.248795: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-17 17:00:34.254663: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-17 17:00:34.296513: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-17 17:00:34.296710: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-17 17:00:34.297786: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-17 17:00:34.297805: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-17 17:00:34.297819: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-17 17:00:34.302193: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9592 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-17 17:00:34.711695: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-17 17:00:34.711816: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-17 17:00:34.711839: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-17 17:00:34.711859: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-17 17:00:34.711877: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-17 17:00:34.711895: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-17 17:00:34.711913: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-17 17:00:34.711932: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-17 17:00:34.713470: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-17 17:00:34.714934: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-17 17:00:34.714977: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-17 17:00:34.714998: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-17 17:00:34.715018: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-17 17:00:34.715038: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-17 17:00:34.715058: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-17 17:00:34.715077: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-17 17:00:34.715097: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-17 17:00:34.716635: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-17 17:00:34.716680: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-17 17:00:34.716690: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-17 17:00:34.716700: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-17 17:00:34.718160: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9592 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-17 17:00:46.565091: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-17 17:00:46.779204: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 6 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 Detection mask done ! Trying to reset tf kernel 3071561 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 107 tf kernel not reseted sub process len(results) : 6 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 6 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6810 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.003470897674560547 nb_pixel_total : 85981 time to create 1 rle with old method : 0.09286689758300781 length of segment : 367 time for calcul the mask position with numpy : 0.0007636547088623047 nb_pixel_total : 20048 time to create 1 rle with old method : 0.023349285125732422 length of segment : 184 time for calcul the mask position with numpy : 0.0008270740509033203 nb_pixel_total : 20940 time to create 1 rle with old method : 0.022838592529296875 length of segment : 166 time for calcul the mask position with numpy : 0.0016312599182128906 nb_pixel_total : 50335 time to create 1 rle with old method : 0.0555577278137207 length of segment : 277 time for calcul the mask position with numpy : 0.0004050731658935547 nb_pixel_total : 4682 time to create 1 rle with old method : 0.005412578582763672 length of segment : 95 time for calcul the mask position with numpy : 0.0018308162689208984 nb_pixel_total : 48037 time to create 1 rle with old method : 0.053946733474731445 length of segment : 306 time for calcul the mask position with numpy : 0.0005927085876464844 nb_pixel_total : 11451 time to create 1 rle with old method : 0.012513160705566406 length of segment : 261 time for calcul the mask position with numpy : 0.002185821533203125 nb_pixel_total : 37509 time to create 1 rle with old method : 0.04187202453613281 length of segment : 429 time for calcul the mask position with numpy : 0.0009143352508544922 nb_pixel_total : 18566 time to create 1 rle with old method : 0.02116107940673828 length of segment : 239 time for calcul the mask position with numpy : 0.005954265594482422 nb_pixel_total : 134206 time to create 1 rle with old method : 0.15171027183532715 length of segment : 483 time for calcul the mask position with numpy : 0.002151012420654297 nb_pixel_total : 33016 time to create 1 rle with old method : 0.03903841972351074 length of segment : 186 time for calcul the mask position with numpy : 0.0009713172912597656 nb_pixel_total : 20987 time to create 1 rle with old method : 0.02368617057800293 length of segment : 230 time for calcul the mask position with numpy : 0.0016269683837890625 nb_pixel_total : 51661 time to create 1 rle with old method : 0.05844378471374512 length of segment : 282 time for calcul the mask position with numpy : 0.002211332321166992 nb_pixel_total : 65413 time to create 1 rle with old method : 0.07426261901855469 length of segment : 352 time for calcul the mask position with numpy : 0.00061798095703125 nb_pixel_total : 13523 time to create 1 rle with old method : 0.017204999923706055 length of segment : 117 time for calcul the mask position with numpy : 0.001967906951904297 nb_pixel_total : 55129 time to create 1 rle with old method : 0.06552386283874512 length of segment : 430 time for calcul the mask position with numpy : 0.0018312931060791016 nb_pixel_total : 26465 time to create 1 rle with old method : 0.04043316841125488 length of segment : 265 time for calcul the mask position with numpy : 0.0041277408599853516 nb_pixel_total : 88089 time to create 1 rle with old method : 0.13966012001037598 length of segment : 383 time for calcul the mask position with numpy : 0.0013401508331298828 nb_pixel_total : 39298 time to create 1 rle with old method : 0.047832489013671875 length of segment : 141 time for calcul the mask position with numpy : 0.0011241436004638672 nb_pixel_total : 36834 time to create 1 rle with old method : 0.04168128967285156 length of segment : 294 time for calcul the mask position with numpy : 0.004187107086181641 nb_pixel_total : 83851 time to create 1 rle with old method : 0.09586048126220703 length of segment : 355 time for calcul the mask position with numpy : 0.00160980224609375 nb_pixel_total : 30304 time to create 1 rle with old method : 0.035254478454589844 length of segment : 194 time for calcul the mask position with numpy : 0.0008592605590820312 nb_pixel_total : 15164 time to create 1 rle with old method : 0.017663002014160156 length of segment : 213 time for calcul the mask position with numpy : 0.0035932064056396484 nb_pixel_total : 85396 time to create 1 rle with old method : 0.09801506996154785 length of segment : 478 time for calcul the mask position with numpy : 0.0022950172424316406 nb_pixel_total : 47514 time to create 1 rle with old method : 0.054424285888671875 length of segment : 311 time for calcul the mask position with numpy : 0.0008099079132080078 nb_pixel_total : 19421 time to create 1 rle with old method : 0.02252984046936035 length of segment : 156 time for calcul the mask position with numpy : 0.002740621566772461 nb_pixel_total : 63758 time to create 1 rle with old method : 0.0728156566619873 length of segment : 456 time for calcul the mask position with numpy : 0.001504659652709961 nb_pixel_total : 35402 time to create 1 rle with old method : 0.04200577735900879 length of segment : 238 time for calcul the mask position with numpy : 0.0012061595916748047 nb_pixel_total : 33606 time to create 1 rle with old method : 0.039339542388916016 length of segment : 224 time for calcul the mask position with numpy : 0.001821756362915039 nb_pixel_total : 42455 time to create 1 rle with old method : 0.04931926727294922 length of segment : 287 time for calcul the mask position with numpy : 0.0026628971099853516 nb_pixel_total : 73065 time to create 1 rle with old method : 0.08428454399108887 length of segment : 271 time for calcul the mask position with numpy : 0.0006015300750732422 nb_pixel_total : 12027 time to create 1 rle with old method : 0.014124631881713867 length of segment : 232 time for calcul the mask position with numpy : 0.001512765884399414 nb_pixel_total : 29659 time to create 1 rle with old method : 0.04007434844970703 length of segment : 183 time for calcul the mask position with numpy : 0.002723217010498047 nb_pixel_total : 59081 time to create 1 rle with old method : 0.06679034233093262 length of segment : 467 time for calcul the mask position with numpy : 0.0008606910705566406 nb_pixel_total : 23050 time to create 1 rle with old method : 0.026132583618164062 length of segment : 286 time for calcul the mask position with numpy : 0.0012390613555908203 nb_pixel_total : 27570 time to create 1 rle with old method : 0.03233456611633301 length of segment : 211 time for calcul the mask position with numpy : 0.0016522407531738281 nb_pixel_total : 52642 time to create 1 rle with old method : 0.060707807540893555 length of segment : 181 time for calcul the mask position with numpy : 0.000896453857421875 nb_pixel_total : 20830 time to create 1 rle with old method : 0.027225017547607422 length of segment : 143 time for calcul the mask position with numpy : 0.0011446475982666016 nb_pixel_total : 35497 time to create 1 rle with old method : 0.04084420204162598 length of segment : 284 time for calcul the mask position with numpy : 0.0025529861450195312 nb_pixel_total : 70469 time to create 1 rle with old method : 0.08022904396057129 length of segment : 382 time for calcul the mask position with numpy : 0.005999326705932617 nb_pixel_total : 126307 time to create 1 rle with old method : 0.15747570991516113 length of segment : 652 time for calcul the mask position with numpy : 0.0012509822845458984 nb_pixel_total : 44846 time to create 1 rle with old method : 0.05070304870605469 length of segment : 286 time for calcul the mask position with numpy : 0.0040760040283203125 nb_pixel_total : 105758 time to create 1 rle with old method : 0.11693501472473145 length of segment : 913 time for calcul the mask position with numpy : 0.001264810562133789 nb_pixel_total : 40605 time to create 1 rle with old method : 0.05044984817504883 length of segment : 258 time for calcul the mask position with numpy : 0.007016181945800781 nb_pixel_total : 217721 time to create 1 rle with new method : 0.011171102523803711 length of segment : 582 time for calcul the mask position with numpy : 0.0015859603881835938 nb_pixel_total : 42455 time to create 1 rle with old method : 0.046750783920288086 length of segment : 301 time for calcul the mask position with numpy : 0.0017910003662109375 nb_pixel_total : 84668 time to create 1 rle with old method : 0.0962686538696289 length of segment : 265 time for calcul the mask position with numpy : 0.0008244514465332031 nb_pixel_total : 19809 time to create 1 rle with old method : 0.022341251373291016 length of segment : 210 time for calcul the mask position with numpy : 0.0010020732879638672 nb_pixel_total : 22806 time to create 1 rle with old method : 0.0263369083404541 length of segment : 194 time for calcul the mask position with numpy : 0.04352235794067383 nb_pixel_total : 926198 time to create 1 rle with new method : 0.6528198719024658 length of segment : 1081 time for calcul the mask position with numpy : 0.001108407974243164 nb_pixel_total : 33312 time to create 1 rle with old method : 0.040643930435180664 length of segment : 200 time for calcul the mask position with numpy : 0.0005462169647216797 nb_pixel_total : 14638 time to create 1 rle with old method : 0.0245668888092041 length of segment : 84 time for calcul the mask position with numpy : 0.0011606216430664062 nb_pixel_total : 35596 time to create 1 rle with old method : 0.05447196960449219 length of segment : 283 time for calcul the mask position with numpy : 0.002933502197265625 nb_pixel_total : 75463 time to create 1 rle with old method : 0.08530735969543457 length of segment : 687 time for calcul the mask position with numpy : 0.019787073135375977 nb_pixel_total : 701287 time to create 1 rle with new method : 0.10713529586791992 length of segment : 938 time for calcul the mask position with numpy : 0.0011081695556640625 nb_pixel_total : 42268 time to create 1 rle with old method : 0.049835920333862305 length of segment : 191 time for calcul the mask position with numpy : 0.006830453872680664 nb_pixel_total : 180894 time to create 1 rle with new method : 0.016717195510864258 length of segment : 946 time for calcul the mask position with numpy : 0.0015530586242675781 nb_pixel_total : 69095 time to create 1 rle with old method : 0.08506608009338379 length of segment : 280 time for calcul the mask position with numpy : 0.0013775825500488281 nb_pixel_total : 52787 time to create 1 rle with old method : 0.06264591217041016 length of segment : 183 time for calcul the mask position with numpy : 0.002241849899291992 nb_pixel_total : 64244 time to create 1 rle with old method : 0.07708406448364258 length of segment : 262 time for calcul the mask position with numpy : 0.0014677047729492188 nb_pixel_total : 66037 time to create 1 rle with old method : 0.08073902130126953 length of segment : 400 time for calcul the mask position with numpy : 0.006787538528442383 nb_pixel_total : 191779 time to create 1 rle with new method : 0.010876893997192383 length of segment : 499 time for calcul the mask position with numpy : 0.0012621879577636719 nb_pixel_total : 45635 time to create 1 rle with old method : 0.053575754165649414 length of segment : 275 time for calcul the mask position with numpy : 0.00021314620971679688 nb_pixel_total : 3827 time to create 1 rle with old method : 0.004655599594116211 length of segment : 64 time for calcul the mask position with numpy : 0.00727081298828125 nb_pixel_total : 204915 time to create 1 rle with new method : 0.013492822647094727 length of segment : 587 time for calcul the mask position with numpy : 0.0010058879852294922 nb_pixel_total : 25393 time to create 1 rle with old method : 0.02893805503845215 length of segment : 347 time for calcul the mask position with numpy : 0.0011603832244873047 nb_pixel_total : 26013 time to create 1 rle with old method : 0.04134988784790039 length of segment : 264 time for calcul the mask position with numpy : 0.0009286403656005859 nb_pixel_total : 33419 time to create 1 rle with old method : 0.03982067108154297 length of segment : 238 time for calcul the mask position with numpy : 0.0009014606475830078 nb_pixel_total : 35767 time to create 1 rle with old method : 0.04120755195617676 length of segment : 175 time for calcul the mask position with numpy : 0.00017952919006347656 nb_pixel_total : 3677 time to create 1 rle with old method : 0.004484653472900391 length of segment : 53 time for calcul the mask position with numpy : 0.00046181678771972656 nb_pixel_total : 23859 time to create 1 rle with old method : 0.02761554718017578 length of segment : 181 time for calcul the mask position with numpy : 0.0012481212615966797 nb_pixel_total : 56987 time to create 1 rle with old method : 0.06309342384338379 length of segment : 541 time for calcul the mask position with numpy : 0.0014154911041259766 nb_pixel_total : 50826 time to create 1 rle with old method : 0.05704092979431152 length of segment : 399 time for calcul the mask position with numpy : 0.0011374950408935547 nb_pixel_total : 41570 time to create 1 rle with old method : 0.04986715316772461 length of segment : 192 time for calcul the mask position with numpy : 0.0013124942779541016 nb_pixel_total : 30931 time to create 1 rle with old method : 0.03539252281188965 length of segment : 468 time for calcul the mask position with numpy : 0.00045561790466308594 nb_pixel_total : 12809 time to create 1 rle with old method : 0.015088319778442383 length of segment : 146 time for calcul the mask position with numpy : 0.0006365776062011719 nb_pixel_total : 19222 time to create 1 rle with old method : 0.02198481559753418 length of segment : 238 time for calcul the mask position with numpy : 0.0003037452697753906 nb_pixel_total : 9505 time to create 1 rle with old method : 0.011304378509521484 length of segment : 99 time for calcul the mask position with numpy : 0.001148223876953125 nb_pixel_total : 51036 time to create 1 rle with old method : 0.058661460876464844 length of segment : 241 time for calcul the mask position with numpy : 0.0007627010345458984 nb_pixel_total : 20678 time to create 1 rle with old method : 0.024588346481323242 length of segment : 135 time for calcul the mask position with numpy : 0.003041982650756836 nb_pixel_total : 113814 time to create 1 rle with old method : 0.12981700897216797 length of segment : 484 time for calcul the mask position with numpy : 0.001186370849609375 nb_pixel_total : 38685 time to create 1 rle with old method : 0.043820858001708984 length of segment : 251 time for calcul the mask position with numpy : 0.0008456707000732422 nb_pixel_total : 32098 time to create 1 rle with old method : 0.03623557090759277 length of segment : 217 time for calcul the mask position with numpy : 0.0010755062103271484 nb_pixel_total : 33842 time to create 1 rle with old method : 0.03862786293029785 length of segment : 323 time for calcul the mask position with numpy : 0.0005731582641601562 nb_pixel_total : 20073 time to create 1 rle with old method : 0.02335643768310547 length of segment : 217 time for calcul the mask position with numpy : 0.0008630752563476562 nb_pixel_total : 29338 time to create 1 rle with old method : 0.04967045783996582 length of segment : 300 time for calcul the mask position with numpy : 0.0015416145324707031 nb_pixel_total : 45117 time to create 1 rle with old method : 0.051473140716552734 length of segment : 381 time for calcul the mask position with numpy : 0.001249074935913086 nb_pixel_total : 44178 time to create 1 rle with old method : 0.05015969276428223 length of segment : 226 time for calcul the mask position with numpy : 0.0005621910095214844 nb_pixel_total : 15179 time to create 1 rle with old method : 0.017651081085205078 length of segment : 335 time for calcul the mask position with numpy : 0.001199483871459961 nb_pixel_total : 49986 time to create 1 rle with old method : 0.055989742279052734 length of segment : 313 time spent for convertir_results : 11.059936761856079 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 90 chid ids of type : 3594 Number RLEs to save : 28424 save missing photos in datou_result : time spend for datou_step_exec : 59.29973769187927 time spend to save output : 1.7732782363891602 total time spend for step 1 : 61.07301592826843 step2:crop_condition Wed Sep 17 17:01:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 6 ! batch 1 Loaded 90 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 77 About to insert : list_path_to_insert length 77 new photo from crops ! About to upload 77 photos upload in portfolio : 3736932 init cache_photo without model_param we have 77 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758121319_3071092 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 77 photos in the portfolio 3736932 time of upload the photos Elapsed time : 21.67918634414673 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758121343_3071092 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.9414007663726807 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758121348_3071092 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.7963581085205078 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1384275520, 1384275361, 1384275177, 1384274825, 1384274664, 1384272964] Looping around the photos to save general results len do output : 90 /1384311211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384311465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384275520', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384275361', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384275177', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384274825', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384274664', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384272964', None, None, None, None, None, '3736477') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 276 time used for this insertion : 0.03886604309082031 save_final save missing photos in datou_result : time spend for datou_step_exec : 57.658374071121216 time spend to save output : 0.04171490669250488 total time spend for step 2 : 57.70008897781372 step3:rle_unique_nms_with_priority Wed Sep 17 17:02:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 90 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 15 nb_hashtags : 2 time to prepare the origin masks : 5.656267404556274 time for calcul the mask position with numpy : 0.5261566638946533 nb_pixel_total : 7678045 time to create 1 rle with new method : 1.0046634674072266 time for calcul the mask position with numpy : 0.027556896209716797 nb_pixel_total : 13523 time to create 1 rle with old method : 0.02087092399597168 time for calcul the mask position with numpy : 0.02657008171081543 nb_pixel_total : 65413 time to create 1 rle with old method : 0.07213711738586426 time for calcul the mask position with numpy : 0.02523207664489746 nb_pixel_total : 51661 time to create 1 rle with old method : 0.05693769454956055 time for calcul the mask position with numpy : 0.026395320892333984 nb_pixel_total : 20987 time to create 1 rle with old method : 0.023395299911499023 time for calcul the mask position with numpy : 0.02699589729309082 nb_pixel_total : 33016 time to create 1 rle with old method : 0.037195444107055664 time for calcul the mask position with numpy : 0.025409460067749023 nb_pixel_total : 134206 time to create 1 rle with old method : 0.14675021171569824 time for calcul the mask position with numpy : 0.024554014205932617 nb_pixel_total : 18566 time to create 1 rle with old method : 0.020472049713134766 time for calcul the mask position with numpy : 0.02591991424560547 nb_pixel_total : 37509 time to create 1 rle with old method : 0.04288935661315918 time for calcul the mask position with numpy : 0.027064800262451172 nb_pixel_total : 11451 time to create 1 rle with old method : 0.012957334518432617 time for calcul the mask position with numpy : 0.025646686553955078 nb_pixel_total : 48037 time to create 1 rle with old method : 0.053435564041137695 time for calcul the mask position with numpy : 0.025266170501708984 nb_pixel_total : 4682 time to create 1 rle with old method : 0.005440711975097656 time for calcul the mask position with numpy : 0.026340484619140625 nb_pixel_total : 50335 time to create 1 rle with old method : 0.05636334419250488 time for calcul the mask position with numpy : 0.025356054306030273 nb_pixel_total : 20940 time to create 1 rle with old method : 0.022843122482299805 time for calcul the mask position with numpy : 0.02525496482849121 nb_pixel_total : 20048 time to create 1 rle with old method : 0.022976398468017578 time for calcul the mask position with numpy : 0.02722334861755371 nb_pixel_total : 85981 time to create 1 rle with old method : 0.10618853569030762 create new chi : 2.6681134700775146 time to delete rle : 0.031296730041503906 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 10108 TO DO : save crop sub photo not yet done ! save time : 0.6550991535186768 nb_obj : 21 nb_hashtags : 2 time to prepare the origin masks : 7.481158494949341 time for calcul the mask position with numpy : 0.5379006862640381 nb_pixel_total : 7367262 time to create 1 rle with new method : 0.9090151786804199 time for calcul the mask position with numpy : 0.025455951690673828 nb_pixel_total : 27570 time to create 1 rle with old method : 0.029181480407714844 time for calcul the mask position with numpy : 0.02523207664489746 nb_pixel_total : 23050 time to create 1 rle with old method : 0.024812936782836914 time for calcul the mask position with numpy : 0.023693323135375977 nb_pixel_total : 59081 time to create 1 rle with old method : 0.06066632270812988 time for calcul the mask position with numpy : 0.023540496826171875 nb_pixel_total : 29659 time to create 1 rle with old method : 0.031626224517822266 time for calcul the mask position with numpy : 0.024323225021362305 nb_pixel_total : 12027 time to create 1 rle with old method : 0.012649297714233398 time for calcul the mask position with numpy : 0.022918701171875 nb_pixel_total : 73065 time to create 1 rle with old method : 0.07498717308044434 time for calcul the mask position with numpy : 0.022761106491088867 nb_pixel_total : 42455 time to create 1 rle with old method : 0.04478287696838379 time for calcul the mask position with numpy : 0.02408742904663086 nb_pixel_total : 33606 time to create 1 rle with old method : 0.03556251525878906 time for calcul the mask position with numpy : 0.023754119873046875 nb_pixel_total : 35402 time to create 1 rle with old method : 0.03757596015930176 time for calcul the mask position with numpy : 0.02477550506591797 nb_pixel_total : 63758 time to create 1 rle with old method : 0.06708312034606934 time for calcul the mask position with numpy : 0.025275230407714844 nb_pixel_total : 19421 time to create 1 rle with old method : 0.021124601364135742 time for calcul the mask position with numpy : 0.024334192276000977 nb_pixel_total : 47514 time to create 1 rle with old method : 0.05136370658874512 time for calcul the mask position with numpy : 0.024867534637451172 nb_pixel_total : 85396 time to create 1 rle with old method : 0.09200477600097656 time for calcul the mask position with numpy : 0.024413347244262695 nb_pixel_total : 15164 time to create 1 rle with old method : 0.01640605926513672 time for calcul the mask position with numpy : 0.025011301040649414 nb_pixel_total : 30304 time to create 1 rle with old method : 0.033152103424072266 time for calcul the mask position with numpy : 0.02503800392150879 nb_pixel_total : 83851 time to create 1 rle with old method : 0.09923124313354492 time for calcul the mask position with numpy : 0.02505183219909668 nb_pixel_total : 36834 time to create 1 rle with old method : 0.041097402572631836 time for calcul the mask position with numpy : 0.024336576461791992 nb_pixel_total : 39298 time to create 1 rle with old method : 0.04364943504333496 time for calcul the mask position with numpy : 0.025767803192138672 nb_pixel_total : 88089 time to create 1 rle with old method : 0.09467172622680664 time for calcul the mask position with numpy : 0.023883819580078125 nb_pixel_total : 26465 time to create 1 rle with old method : 0.027163267135620117 time for calcul the mask position with numpy : 0.024378061294555664 nb_pixel_total : 55129 time to create 1 rle with old method : 0.05862283706665039 create new chi : 3.0007081031799316 time to delete rle : 0.0016107559204101562 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++++++++Number RLEs to save : 14302 TO DO : save crop sub photo not yet done ! save time : 0.8686389923095703 nb_obj : 15 nb_hashtags : 2 time to prepare the origin masks : 4.986289024353027 time for calcul the mask position with numpy : 0.569577693939209 nb_pixel_total : 6652599 time to create 1 rle with new method : 1.0322718620300293 time for calcul the mask position with numpy : 0.023897886276245117 nb_pixel_total : 33312 time to create 1 rle with old method : 0.03574204444885254 time for calcul the mask position with numpy : 0.027901649475097656 nb_pixel_total : 724076 time to create 1 rle with new method : 0.6492354869842529 time for calcul the mask position with numpy : 0.023871421813964844 nb_pixel_total : 22806 time to create 1 rle with old method : 0.024729251861572266 time for calcul the mask position with numpy : 0.023865461349487305 nb_pixel_total : 19809 time to create 1 rle with old method : 0.021848440170288086 time for calcul the mask position with numpy : 0.02456521987915039 nb_pixel_total : 84668 time to create 1 rle with old method : 0.09151339530944824 time for calcul the mask position with numpy : 0.024512290954589844 nb_pixel_total : 42455 time to create 1 rle with old method : 0.04546928405761719 time for calcul the mask position with numpy : 0.024381637573242188 nb_pixel_total : 217721 time to create 1 rle with new method : 0.6324915885925293 time for calcul the mask position with numpy : 0.024393081665039062 nb_pixel_total : 40605 time to create 1 rle with old method : 0.04448962211608887 time for calcul the mask position with numpy : 0.025245189666748047 nb_pixel_total : 105758 time to create 1 rle with old method : 0.11613893508911133 time for calcul the mask position with numpy : 0.025290727615356445 nb_pixel_total : 44846 time to create 1 rle with old method : 0.0488278865814209 time for calcul the mask position with numpy : 0.02565932273864746 nb_pixel_total : 126307 time to create 1 rle with old method : 0.13622665405273438 time for calcul the mask position with numpy : 0.025356769561767578 nb_pixel_total : 70469 time to create 1 rle with old method : 0.0758824348449707 time for calcul the mask position with numpy : 0.024207115173339844 nb_pixel_total : 35497 time to create 1 rle with old method : 0.03860950469970703 time for calcul the mask position with numpy : 0.024555206298828125 nb_pixel_total : 20830 time to create 1 rle with old method : 0.021865129470825195 time for calcul the mask position with numpy : 0.02356719970703125 nb_pixel_total : 52642 time to create 1 rle with old method : 0.05674457550048828 create new chi : 4.103537559509277 time to delete rle : 0.0015950202941894531 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 13504 TO DO : save crop sub photo not yet done ! save time : 0.8196146488189697 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 4.385417461395264 time for calcul the mask position with numpy : 0.5928661823272705 nb_pixel_total : 7064544 time to create 1 rle with new method : 0.8988051414489746 time for calcul the mask position with numpy : 0.026958703994750977 nb_pixel_total : 65393 time to create 1 rle with old method : 0.07344794273376465 time for calcul the mask position with numpy : 0.025254011154174805 nb_pixel_total : 64244 time to create 1 rle with old method : 0.0698542594909668 time for calcul the mask position with numpy : 0.025399208068847656 nb_pixel_total : 52787 time to create 1 rle with old method : 0.058269500732421875 time for calcul the mask position with numpy : 0.024268150329589844 nb_pixel_total : 69095 time to create 1 rle with old method : 0.0773618221282959 time for calcul the mask position with numpy : 0.029094934463500977 nb_pixel_total : 180894 time to create 1 rle with new method : 0.7019839286804199 time for calcul the mask position with numpy : 0.025437116622924805 nb_pixel_total : 42268 time to create 1 rle with old method : 0.045847415924072266 time for calcul the mask position with numpy : 0.029804468154907227 nb_pixel_total : 629478 time to create 1 rle with new method : 0.7523250579833984 time for calcul the mask position with numpy : 0.026244401931762695 nb_pixel_total : 75463 time to create 1 rle with old method : 0.08243799209594727 time for calcul the mask position with numpy : 0.024999380111694336 nb_pixel_total : 35596 time to create 1 rle with old method : 0.039150238037109375 time for calcul the mask position with numpy : 0.024259328842163086 nb_pixel_total : 14638 time to create 1 rle with old method : 0.016457080841064453 create new chi : 3.764866590499878 time to delete rle : 0.0013751983642578125 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++Number RLEs to save : 10227 TO DO : save crop sub photo not yet done ! save time : 0.5977518558502197 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 6.423228025436401 time for calcul the mask position with numpy : 0.5275161266326904 nb_pixel_total : 7482082 time to create 1 rle with new method : 0.8118903636932373 time for calcul the mask position with numpy : 0.02565622329711914 nb_pixel_total : 5689 time to create 1 rle with old method : 0.0066335201263427734 time for calcul the mask position with numpy : 0.026744842529296875 nb_pixel_total : 19222 time to create 1 rle with old method : 0.02162623405456543 time for calcul the mask position with numpy : 0.02553105354309082 nb_pixel_total : 12809 time to create 1 rle with old method : 0.014339447021484375 time for calcul the mask position with numpy : 0.025493383407592773 nb_pixel_total : 30931 time to create 1 rle with old method : 0.03418755531311035 time for calcul the mask position with numpy : 0.02434825897216797 nb_pixel_total : 41570 time to create 1 rle with old method : 0.04503154754638672 time for calcul the mask position with numpy : 0.02470541000366211 nb_pixel_total : 50826 time to create 1 rle with old method : 0.05483269691467285 time for calcul the mask position with numpy : 0.024123191833496094 nb_pixel_total : 56987 time to create 1 rle with old method : 0.06054425239562988 time for calcul the mask position with numpy : 0.023946523666381836 nb_pixel_total : 23859 time to create 1 rle with old method : 0.025103330612182617 time for calcul the mask position with numpy : 0.023554325103759766 nb_pixel_total : 3677 time to create 1 rle with old method : 0.004059791564941406 time for calcul the mask position with numpy : 0.025384902954101562 nb_pixel_total : 35767 time to create 1 rle with old method : 0.0405726432800293 time for calcul the mask position with numpy : 0.02901315689086914 nb_pixel_total : 33419 time to create 1 rle with old method : 0.0383608341217041 time for calcul the mask position with numpy : 0.026196002960205078 nb_pixel_total : 26013 time to create 1 rle with old method : 0.028780221939086914 time for calcul the mask position with numpy : 0.02851581573486328 nb_pixel_total : 25393 time to create 1 rle with old method : 0.030624866485595703 time for calcul the mask position with numpy : 0.02746438980102539 nb_pixel_total : 204915 time to create 1 rle with new method : 0.6713309288024902 time for calcul the mask position with numpy : 0.024585962295532227 nb_pixel_total : 3827 time to create 1 rle with old method : 0.00396275520324707 time for calcul the mask position with numpy : 0.023656368255615234 nb_pixel_total : 45635 time to create 1 rle with old method : 0.04767799377441406 time for calcul the mask position with numpy : 0.025265932083129883 nb_pixel_total : 191779 time to create 1 rle with new method : 0.644146203994751 create new chi : 3.6439528465270996 time to delete rle : 0.0014803409576416016 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 11687 TO DO : save crop sub photo not yet done ! save time : 0.6526412963867188 nb_obj : 12 nb_hashtags : 2 time to prepare the origin masks : 5.429199695587158 time for calcul the mask position with numpy : 0.7697081565856934 nb_pixel_total : 7800376 time to create 1 rle with new method : 1.4339408874511719 time for calcul the mask position with numpy : 0.02469468116760254 nb_pixel_total : 49986 time to create 1 rle with old method : 0.05508112907409668 time for calcul the mask position with numpy : 0.025104999542236328 nb_pixel_total : 15179 time to create 1 rle with old method : 0.016715288162231445 time for calcul the mask position with numpy : 0.026966333389282227 nb_pixel_total : 44178 time to create 1 rle with old method : 0.0492556095123291 time for calcul the mask position with numpy : 0.02531576156616211 nb_pixel_total : 45117 time to create 1 rle with old method : 0.05104947090148926 time for calcul the mask position with numpy : 0.030794382095336914 nb_pixel_total : 29338 time to create 1 rle with old method : 0.03284311294555664 time for calcul the mask position with numpy : 0.02801656723022461 nb_pixel_total : 20073 time to create 1 rle with old method : 0.022472381591796875 time for calcul the mask position with numpy : 0.02612614631652832 nb_pixel_total : 33842 time to create 1 rle with old method : 0.037474870681762695 time for calcul the mask position with numpy : 0.025853872299194336 nb_pixel_total : 32098 time to create 1 rle with old method : 0.03589057922363281 time for calcul the mask position with numpy : 0.025999069213867188 nb_pixel_total : 38685 time to create 1 rle with old method : 0.04692435264587402 time for calcul the mask position with numpy : 0.026950836181640625 nb_pixel_total : 113814 time to create 1 rle with old method : 0.14193272590637207 time for calcul the mask position with numpy : 0.0314481258392334 nb_pixel_total : 20678 time to create 1 rle with old method : 0.025792837142944336 time for calcul the mask position with numpy : 0.031456708908081055 nb_pixel_total : 51036 time to create 1 rle with old method : 0.06531214714050293 create new chi : 3.161783218383789 time to delete rle : 0.001321554183959961 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 9006 TO DO : save crop sub photo not yet done ! save time : 0.5236945152282715 map_output_result : {1384275520: (0.0, 'Should be the crop_list due to order', 0), 1384275361: (0.0, 'Should be the crop_list due to order', 0), 1384275177: (0.0, 'Should be the crop_list due to order', 0), 1384274825: (0.0, 'Should be the crop_list due to order', 0), 1384274664: (0.0, 'Should be the crop_list due to order', 0), 1384272964: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1384275520, 1384275361, 1384275177, 1384274825, 1384274664, 1384272964] Looping around the photos to save general results len do output : 6 /1384275520.Didn't retrieve data . /1384275361.Didn't retrieve data . /1384275177.Didn't retrieve data . /1384274825.Didn't retrieve data . /1384274664.Didn't retrieve data . /1384272964.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384275520', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384275361', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384275177', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384274825', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384274664', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384272964', None, None, None, None, None, '3736477') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.013446807861328125 save_final save missing photos in datou_result : time spend for datou_step_exec : 59.776371717453 time spend to save output : 0.017488718032836914 total time spend for step 3 : 59.79386043548584 step4:ventilate_hashtags_in_portfolio Wed Sep 17 17:03:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26955635 get user id for portfolio 26955635 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26955635 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','carton','pet_fonce','autre','flou','pet_clair','pehd','environnement','background','papier','metal')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26955635 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','carton','pet_fonce','autre','flou','pet_clair','pehd','environnement','background','papier','metal')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26955635 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','carton','pet_fonce','autre','flou','pet_clair','pehd','environnement','background','papier','metal')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26957128,26957129,26957130,26957131,26957132,26957133,26957134,26957135,26957136,26957137,26957138?tags=mal_croppe,carton,pet_fonce,autre,flou,pet_clair,pehd,environnement,background,papier,metal Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1384275520, 1384275361, 1384275177, 1384274825, 1384274664, 1384272964] Looping around the photos to save general results len do output : 1 /26955635. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384275520', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384275361', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384275177', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384274825', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384274664', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384272964', None, None, None, None, None, '3736477') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.012708425521850586 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6868512630462646 time spend to save output : 0.012939691543579102 total time spend for step 4 : 1.6997909545898438 step5:final Wed Sep 17 17:03:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1384275520: ('0.11496696566358026',), 1384275361: ('0.11496696566358026',), 1384275177: ('0.11496696566358026',), 1384274825: ('0.11496696566358026',), 1384274664: ('0.11496696566358026',), 1384272964: ('0.11496696566358026',)} new output for save of step final : {1384275520: ('0.11496696566358026',), 1384275361: ('0.11496696566358026',), 1384275177: ('0.11496696566358026',), 1384274825: ('0.11496696566358026',), 1384274664: ('0.11496696566358026',), 1384272964: ('0.11496696566358026',)} [1384275520, 1384275361, 1384275177, 1384274825, 1384274664, 1384272964] Looping around the photos to save general results len do output : 6 /1384275520.Didn't retrieve data . /1384275361.Didn't retrieve data . /1384275177.Didn't retrieve data . /1384274825.Didn't retrieve data . /1384274664.Didn't retrieve data . /1384272964.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384275520', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384275361', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384275177', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384274825', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384274664', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384272964', None, None, None, None, None, '3736477') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.013492584228515625 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13841485977172852 time spend to save output : 0.01384592056274414 total time spend for step 5 : 0.15226078033447266 step6:blur_detection Wed Sep 17 17:03:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f.jpg resize: (2160, 3840) 1384275520 -6.2334606469813 treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3.jpg resize: (2160, 3840) 1384275361 -6.9064153462211 treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63.jpg resize: (2160, 3840) 1384275177 -7.065968395316721 treat image : temp/1758121229_3071092_1384274825_8471a7e94033f7ef486bebca888eb68b.jpg resize: (2160, 3840) 1384274825 -7.080412014750419 treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9.jpg resize: (2160, 3840) 1384274664 -6.7520546405414645 treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5.jpg resize: (2160, 3840) 1384272964 -6.545555236289243 treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224724_0.png resize: (367, 419) 1384311211 1.8423791474308022 treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224725_0.png resize: (184, 126) 1384311212 -1.675706152393859 treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224726_0.png resize: (166, 208) 1384311213 -2.0117807610829708 treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224727_0.png resize: (277, 287) 1384311215 -3.5049433364367344 treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224728_0.png resize: (83, 111) 1384311216 0.1682328470210878 treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224729_0.png resize: (273, 320) 1384311217 -2.2705079167192452 treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224730_0.png resize: (170, 92) 1384311219 -0.8969900648554022 treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224731_0.png resize: (261, 305) 1384311220 -2.745856720006981 treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224732_0.png resize: (238, 182) 1384311221 -1.8031420872537367 treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224734_0.png resize: (181, 402) 1384311223 -1.5003697296381682 treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224735_0.png resize: (205, 138) 1384311224 -1.174904169327131 treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224737_0.png resize: (352, 249) 1384311225 0.908788687104539 treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224738_0.png resize: (114, 154) 1384311227 -1.6400323771459644 treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224739_0.png resize: (425, 153) 1384311229 -2.103997836182586 treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224740_0.png resize: (264, 131) 1384311230 -1.1764811773976778 treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224741_0.png resize: (327, 461) 1384311232 -4.883506081201585 treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224742_0.png resize: (120, 409) 1384311233 -4.995892000051844 treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224743_0.png resize: (294, 173) 1384311234 -5.084788430618815 treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224744_0.png resize: (352, 438) 1384311237 -2.849693649246347 treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224745_0.png resize: (179, 233) 1384311238 -2.1210111795281907 treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224747_0.png resize: (393, 370) 1384311239 -1.7794913440753046 treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224748_0.png resize: (320, 269) 1384311241 -4.214698324080873 treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224749_0.png resize: (153, 183) 1384311243 -2.353399068354615 treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224750_0.png resize: (365, 343) 1384311244 -2.476542949806368 treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224751_0.png resize: (188, 322) 1384311246 -3.939435974961436 treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224752_0.png resize: (204, 216) 1384311248 -3.2184489539673087 treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224753_0.png resize: (266, 275) 1384311249 -3.95539818310135 treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224754_0.png resize: (264, 444) 1384311251 -1.3913718027253565 treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224755_0.png resize: (171, 108) 1384311253 1.9396782587237473 treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224757_0.png resize: (437, 263) 1384311254 -2.9244351339578314 treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224758_0.png resize: (262, 117) 1384311256 -4.467713478335097 treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224759_0.png resize: (208, 202) 1384311258 -3.3371107077180215 treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224761_0.png resize: (137, 263) 1384311259 -1.1816702244149395 treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224762_0.png resize: (283, 167) 1384311261 0.1249848906876844 treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224763_0.png resize: (316, 448) 1384311263 -3.9084885706745283 treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224764_0.png resize: (543, 388) 1384311264 -2.9894903680066345 treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224765_0.png resize: (272, 282) 1384311266 -3.745898563886008 treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224766_0.png resize: (847, 195) 1384311268 -3.192139181409374 treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224767_0.png resize: (232, 303) 1384311269 -0.46827446874021583 treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224768_0.png resize: (399, 791) 1384311271 -3.5150606112972986 treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224769_0.png resize: (290, 258) 1384311273 -3.5241444350251663 treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224770_0.png resize: (251, 440) 1384311274 -4.860354192257415 treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224771_0.png resize: (208, 170) 1384311276 -3.8643325838723936 treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224772_0.png resize: (186, 243) 1384311278 -2.232969458833935 treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224773_0.png resize: (1038, 1138) 1384311279 -5.730775763795154 treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224774_0.png resize: (189, 297) 1384311280 -3.468094968204492 treat image : temp/1758121229_3071092_1384274825_8471a7e94033f7ef486bebca888eb68b_rle_crop_3962224775_0.png resize: (81, 214) 1384311283 3.362344927789581 treat image : temp/1758121229_3071092_1384274825_8471a7e94033f7ef486bebca888eb68b_rle_crop_3962224776_0.png resize: (283, 180) 1384311284 0.9471662958122616 treat image : temp/1758121229_3071092_1384274825_8471a7e94033f7ef486bebca888eb68b_rle_crop_3962224777_0.png resize: (641, 237) 1384311286 -2.6192326566935273 treat image : temp/1758121229_3071092_1384274825_8471a7e94033f7ef486bebca888eb68b_rle_crop_3962224778_0.png resize: (893, 1074) 1384311289 -5.379037033217493 treat image : temp/1758121229_3071092_1384274825_8471a7e94033f7ef486bebca888eb68b_rle_crop_3962224780_0.png resize: (801, 420) 1384311290 -3.762842239994214 treat image : temp/1758121229_3071092_1384274825_8471a7e94033f7ef486bebca888eb68b_rle_crop_3962224781_0.png resize: (262, 392) 1384311291 -3.3961622037525823 treat image : temp/1758121229_3071092_1384274825_8471a7e94033f7ef486bebca888eb68b_rle_crop_3962224784_0.png resize: (377, 274) 1384311294 -3.539386468668381 treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224785_0.png resize: (433, 727) 1384311295 -1.9001832484632122 treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224786_0.png resize: (273, 237) 1384311296 -1.3901188192423666 treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224787_0.png resize: (64, 70) 1384311299 -3.2334040068321266 treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224788_0.png resize: (587, 627) 1384311300 2.7845476951878907 treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224789_0.png resize: (345, 126) 1384311301 -3.1459354013055467 treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224790_0.png resize: (261, 198) 1384311304 -3.6949251260916944 treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224791_0.png resize: (207, 208) 1384311305 -2.566130470750145 treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224794_0.png resize: (165, 235) 1384311306 -4.1038852438886995 treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224795_0.png resize: (430, 194) 1384311309 -4.519378607876529 treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224798_0.png resize: (353, 147) 1384311310 -4.124823715973971 treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224799_0.png resize: (144, 135) 1384311311 -2.595256208571358 treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224800_0.png resize: (237, 122) 1384311314 -0.8194366551266407 treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224801_0.png resize: (81, 177) 1384311315 -3.3330770116900643 treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5_rle_crop_3962224802_0.png resize: (241, 300) 1384311316 0.5189950748636034 treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5_rle_crop_3962224803_0.png resize: (135, 318) 1384311319 -2.846002701192951 treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5_rle_crop_3962224804_0.png resize: (346, 671) 1384311320 -2.4532043064947917 treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5_rle_crop_3962224805_0.png resize: (244, 255) 1384311321 -1.016230980808344 treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5_rle_crop_3962224806_0.png resize: (216, 190) 1384311324 3.314599623451359 treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5_rle_crop_3962224808_0.png resize: (217, 142) 1384311325 -2.204153743472357 treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5_rle_crop_3962224809_0.png resize: (297, 147) 1384311326 -4.195001004298076 treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5_rle_crop_3962224810_0.png resize: (365, 208) 1384311329 -3.3370491250256085 treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5_rle_crop_3962224811_0.png resize: (226, 325) 1384311330 -0.5449423417510927 treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5_rle_crop_3962224812_0.png resize: (308, 74) 1384311331 -2.731463056168254 treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5_rle_crop_3962224813_0.png resize: (310, 241) 1384311334 -3.3019658762490858 treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224746_0.png resize: (205, 96) 1384311384 -3.6313734104546875 treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224756_0.png resize: (183, 204) 1384311385 -1.2969530995309206 treat image : temp/1758121229_3071092_1384274825_8471a7e94033f7ef486bebca888eb68b_rle_crop_3962224779_0.png resize: (190, 258) 1384311388 -3.8025983422818923 treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224792_0.png resize: (175, 272) 1384311389 -3.9145884226901795 treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224793_0.png resize: (50, 94) 1384311390 -3.62508587836333 treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224797_0.png resize: (182, 287) 1384311394 -1.0074027881848033 treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5_rle_crop_3962224807_0.png resize: (307, 173) 1384311395 -4.708486511196297 treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224733_0.png resize: (430, 515) 1384311457 -3.3081263311758105 treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224736_0.png resize: (282, 254) 1384311459 -2.537223052725882 treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224760_0.png resize: (167, 436) 1384311460 -1.8581443124838801 treat image : temp/1758121229_3071092_1384274825_8471a7e94033f7ef486bebca888eb68b_rle_crop_3962224782_0.png resize: (171, 407) 1384311463 -1.853108250852995 treat image : temp/1758121229_3071092_1384274825_8471a7e94033f7ef486bebca888eb68b_rle_crop_3962224783_0.png resize: (261, 419) 1384311464 -1.592623281587411 treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224796_0.png resize: (365, 302) 1384311465 -3.6526184810517046 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 96 time used for this insertion : 0.01731109619140625 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 96 time used for this insertion : 0.014982223510742188 save missing photos in datou_result : time spend for datou_step_exec : 24.957491874694824 time spend to save output : 0.03736567497253418 total time spend for step 6 : 24.99485754966736 step7:brightness Wed Sep 17 17:03:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f.jpg treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3.jpg treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63.jpg treat image : temp/1758121229_3071092_1384274825_8471a7e94033f7ef486bebca888eb68b.jpg treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9.jpg treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5.jpg treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224724_0.png treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224725_0.png treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224726_0.png treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224727_0.png treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224728_0.png treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224729_0.png treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224730_0.png treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224731_0.png treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224732_0.png treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224734_0.png treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224735_0.png treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224737_0.png treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224738_0.png treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224739_0.png treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224740_0.png treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224741_0.png treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224742_0.png treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224743_0.png treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224744_0.png treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224745_0.png treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224747_0.png treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224748_0.png treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224749_0.png treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224750_0.png treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224751_0.png treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224752_0.png treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224753_0.png treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224754_0.png treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224755_0.png treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224757_0.png treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224758_0.png treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224759_0.png treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224761_0.png treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224762_0.png treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224763_0.png treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224764_0.png treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224765_0.png treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224766_0.png treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224767_0.png treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224768_0.png treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224769_0.png treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224770_0.png treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224771_0.png treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224772_0.png treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224773_0.png treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224774_0.png treat image : temp/1758121229_3071092_1384274825_8471a7e94033f7ef486bebca888eb68b_rle_crop_3962224775_0.png treat image : temp/1758121229_3071092_1384274825_8471a7e94033f7ef486bebca888eb68b_rle_crop_3962224776_0.png treat image : temp/1758121229_3071092_1384274825_8471a7e94033f7ef486bebca888eb68b_rle_crop_3962224777_0.png treat image : temp/1758121229_3071092_1384274825_8471a7e94033f7ef486bebca888eb68b_rle_crop_3962224778_0.png treat image : temp/1758121229_3071092_1384274825_8471a7e94033f7ef486bebca888eb68b_rle_crop_3962224780_0.png treat image : temp/1758121229_3071092_1384274825_8471a7e94033f7ef486bebca888eb68b_rle_crop_3962224781_0.png treat image : temp/1758121229_3071092_1384274825_8471a7e94033f7ef486bebca888eb68b_rle_crop_3962224784_0.png treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224785_0.png treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224786_0.png treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224787_0.png treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224788_0.png treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224789_0.png treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224790_0.png treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224791_0.png treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224794_0.png treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224795_0.png treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224798_0.png treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224799_0.png treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224800_0.png treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224801_0.png treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5_rle_crop_3962224802_0.png treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5_rle_crop_3962224803_0.png treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5_rle_crop_3962224804_0.png treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5_rle_crop_3962224805_0.png treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5_rle_crop_3962224806_0.png treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5_rle_crop_3962224808_0.png treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5_rle_crop_3962224809_0.png treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5_rle_crop_3962224810_0.png treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5_rle_crop_3962224811_0.png treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5_rle_crop_3962224812_0.png treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5_rle_crop_3962224813_0.png treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224746_0.png treat image : temp/1758121229_3071092_1384275361_332adb407e38255daad621e39f7389f3_rle_crop_3962224756_0.png treat image : temp/1758121229_3071092_1384274825_8471a7e94033f7ef486bebca888eb68b_rle_crop_3962224779_0.png treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224792_0.png treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224793_0.png treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224797_0.png treat image : temp/1758121229_3071092_1384272964_4d869565f85904453a62dcc9a746d2a5_rle_crop_3962224807_0.png treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224733_0.png treat image : temp/1758121229_3071092_1384275520_1e45028a17c2e8c8af95ae4c051d944f_rle_crop_3962224736_0.png treat image : temp/1758121229_3071092_1384275177_074be07a99d3c853c363991c4b303e63_rle_crop_3962224760_0.png treat image : temp/1758121229_3071092_1384274825_8471a7e94033f7ef486bebca888eb68b_rle_crop_3962224782_0.png treat image : temp/1758121229_3071092_1384274825_8471a7e94033f7ef486bebca888eb68b_rle_crop_3962224783_0.png treat image : temp/1758121229_3071092_1384274664_aa967309efb80ffe4242226df94208d9_rle_crop_3962224796_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 96 time used for this insertion : 0.01622605323791504 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 96 time used for this insertion : 0.014072179794311523 save missing photos in datou_result : time spend for datou_step_exec : 6.328686714172363 time spend to save output : 0.03479433059692383 total time spend for step 7 : 6.363481044769287 step8:velours_tree Wed Sep 17 17:04:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.17446184158325195 time spend to save output : 4.7206878662109375e-05 total time spend for step 8 : 0.17450904846191406 step9:send_mail_cod Wed Sep 17 17:04:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26955635_17-09-2025_17_04_03.pdf 26957128 imagette269571281758121443 26957129 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette269571291758121443 26957130 imagette269571301758121443 26957131 imagette269571311758121443 26957132 imagette269571321758121443 26957133 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette269571331758121443 26957134 imagette269571341758121444 26957136 imagette269571361758121444 26957137 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette269571371758121444 26957138 imagette269571381758121446 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26955635 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26957128,26957129,26957130,26957131,26957132,26957133,26957134,26957135,26957136,26957137,26957138?tags=mal_croppe,carton,pet_fonce,autre,flou,pet_clair,pehd,environnement,background,papier,metal args[1384275520] : ((1384275520, -6.2334606469813, 492609224), (1384275520, 1.2852957303614612, 2107752395), '0.11496696566358026') We are sending mail with results at report@fotonower.com args[1384275361] : ((1384275361, -6.9064153462211, 492609224), (1384275361, 1.2158191145822341, 2107752395), '0.11496696566358026') We are sending mail with results at report@fotonower.com args[1384275177] : ((1384275177, -7.065968395316721, 492609224), (1384275177, 2.1622440928950577, 492649241), '0.11496696566358026') We are sending mail with results at report@fotonower.com args[1384274825] : ((1384274825, -7.080412014750419, 492609224), (1384274825, 2.1198492056174354, 492649241), '0.11496696566358026') We are sending mail with results at report@fotonower.com args[1384274664] : ((1384274664, -6.7520546405414645, 492609224), (1384274664, 1.8026032669534713, 2107752395), '0.11496696566358026') We are sending mail with results at report@fotonower.com args[1384272964] : ((1384272964, -6.545555236289243, 492609224), (1384272964, 2.03515416768449, 492649241), '0.11496696566358026') We are sending mail with results at report@fotonower.com refus_total : 0.11496696566358026 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26955635 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26955635_17-09-2025_17_04_03.pdf results_Auto_P26955635_17-09-2025_17_04_03.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26955635_17-09-2025_17_04_03.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26955635','results_Auto_P26955635_17-09-2025_17_04_03.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26955635_17-09-2025_17_04_03.pdf','pdf','','0.6','0.11496696566358026') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26955635

https://www.fotonower.com/image?json=false&list_photos_id=1384275520
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1384275361
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1384275177
La photo est trop lumineuse, merci de reprendre une photo.(avec le score = 2.1622440928950577,le score doit entre -2 et 2)
https://www.fotonower.com/image?json=false&list_photos_id=1384274825
La photo est trop lumineuse, merci de reprendre une photo.(avec le score = 2.1198492056174354,le score doit entre -2 et 2)
https://www.fotonower.com/image?json=false&list_photos_id=1384274664
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1384272964
La photo est trop lumineuse, merci de reprendre une photo.(avec le score = 2.03515416768449,le score doit entre -2 et 2)

Dans ces conditions,le taux de refus est: 11.50%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/26957129?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26957133?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26957137?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26955635_17-09-2025_17_04_03.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26957128,26957129,26957130,26957131,26957132,26957133,26957134,26957135,26957136,26957137,26957138?tags=mal_croppe,carton,pet_fonce,autre,flou,pet_clair,pehd,environnement,background,papier,metal.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 17 Sep 2025 15:04:08 GMT Content-Length: 0 Connection: close X-Message-Id: 9dJqrjW1Qy6cases2RYKaQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1384275520, 1384275361, 1384275177, 1384274825, 1384274664, 1384272964] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384275520', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384275361', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384275177', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384274825', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384274664', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384272964', None, None, None, None, None, '3736477') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.012382745742797852 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.667339563369751 time spend to save output : 0.012569189071655273 total time spend for step 9 : 5.679908752441406 step10:split_time_score Wed Sep 17 17:04:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 6),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 17092025 26955635 Nombre de photos uploadées : 6 / 23040 (0%) 17092025 26955635 Nombre de photos taguées (types de déchets): 0 / 6 (0%) 17092025 26955635 Nombre de photos taguées (volume) : 0 / 6 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.9604644775390625e-06 ?????? elapsed_time : fill_and_build_computed_from_old_data 0.0005726814270019531 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20959234237670898 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.043265578029359514 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26927347_17-09-2025_07_17_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26927347 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26927347 AND mptpi.`type`=3726 To do Qualite : 0.12164504008658424 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26930238_17-09-2025_08_03_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26930238 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26930238 AND mptpi.`type`=3726 To do Qualite : 0.02515507938213385 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26934345_17-09-2025_12_37_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26934345 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26934345 AND mptpi.`type`=3726 To do Qualite : 0.09147573750275577 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26939189_17-09-2025_11_18_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26939189 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26939189 AND mptpi.`type`=3594 To do Qualite : 0.04970439884947426 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26943053_17-09-2025_12_22_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26943053 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26943053 AND mptpi.`type`=3726 To do Qualite : 0.09689704663768993 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26955627_17-09-2025_16_37_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26955627 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26955627 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26955630 order by id desc limit 1 Qualite : 0.11496696566358026 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26955635_17-09-2025_17_04_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26955635 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26955635 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26957152 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'17092025': {'nb_upload': 6, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1384275520, 1384275361, 1384275177, 1384274825, 1384274664, 1384272964] Looping around the photos to save general results len do output : 1 /26955635Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384275520', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384275361', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384275177', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384274825', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384274664', None, None, None, None, None, '3736477') ('3318', None, None, None, None, None, None, None, '3736477') ('3318', '26955635', '1384272964', None, None, None, None, None, '3736477') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.013066291809082031 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.764181137084961 time spend to save output : 0.013264179229736328 total time spend for step 10 : 2.7774453163146973 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 6 set_done_treatment 100.27user 88.55system 3:45.45elapsed 83%CPU (0avgtext+0avgdata 4057560maxresident)k 811480inputs+98144outputs (12610major+9061759minor)pagefaults 0swaps