python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 4037402 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3653876'] with mtr_portfolio_ids : ['26453698'] and first list_photo_ids : [] new path : /proc/4037402/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 9 ; length of list_pids : 9 ; length of list_args : 9 time to download the photos : 1.9464478492736816 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Sep 2 20:40:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10376 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-02 20:40:34.460244: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-02 20:40:34.468412: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-02 20:40:34.470013: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fdc2c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-02 20:40:34.470059: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-02 20:40:34.472743: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-02 20:40:34.684843: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x30034f50 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-02 20:40:34.684890: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-02 20:40:34.686824: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-02 20:40:34.687104: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-02 20:40:34.688902: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-02 20:40:34.690704: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-02 20:40:34.691049: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-02 20:40:34.693259: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-02 20:40:34.694457: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-02 20:40:34.698736: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-02 20:40:34.700229: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-02 20:40:34.700304: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-02 20:40:34.701084: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-02 20:40:34.701101: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-02 20:40:34.701111: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-02 20:40:34.702490: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9467 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-02 20:40:34.982212: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-02 20:40:34.982356: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-02 20:40:34.982387: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-02 20:40:34.982412: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-02 20:40:34.982437: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-02 20:40:34.982462: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-02 20:40:34.982486: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-02 20:40:34.982509: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-02 20:40:34.984639: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-02 20:40:34.986011: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-02 20:40:34.986044: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-02 20:40:34.986059: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-02 20:40:34.986073: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-02 20:40:34.986087: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-02 20:40:34.986100: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-02 20:40:34.986113: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-02 20:40:34.986127: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-02 20:40:34.987362: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-02 20:40:34.987392: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-02 20:40:34.987400: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-02 20:40:34.987407: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-02 20:40:34.988676: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9467 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-02 20:40:45.435289: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-02 20:40:45.635004: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 9 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 Detection mask done ! Trying to reset tf kernel 4038036 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1310 tf kernel not reseted sub process len(results) : 9 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 9 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10376 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.000812530517578125 nb_pixel_total : 27191 time to create 1 rle with old method : 0.032442569732666016 length of segment : 227 time for calcul the mask position with numpy : 0.00021910667419433594 nb_pixel_total : 10236 time to create 1 rle with old method : 0.012226343154907227 length of segment : 107 time for calcul the mask position with numpy : 0.0012500286102294922 nb_pixel_total : 50642 time to create 1 rle with old method : 0.059171438217163086 length of segment : 296 time for calcul the mask position with numpy : 0.0005688667297363281 nb_pixel_total : 27126 time to create 1 rle with old method : 0.03291916847229004 length of segment : 231 time for calcul the mask position with numpy : 0.0006253719329833984 nb_pixel_total : 36542 time to create 1 rle with old method : 0.04356575012207031 length of segment : 171 time for calcul the mask position with numpy : 0.0004315376281738281 nb_pixel_total : 24652 time to create 1 rle with old method : 0.02964925765991211 length of segment : 131 time for calcul the mask position with numpy : 0.0007066726684570312 nb_pixel_total : 35307 time to create 1 rle with old method : 0.04539132118225098 length of segment : 339 time for calcul the mask position with numpy : 0.0005755424499511719 nb_pixel_total : 20454 time to create 1 rle with old method : 0.028682708740234375 length of segment : 183 time for calcul the mask position with numpy : 0.0009443759918212891 nb_pixel_total : 35038 time to create 1 rle with old method : 0.0498812198638916 length of segment : 284 time for calcul the mask position with numpy : 0.0005350112915039062 nb_pixel_total : 16343 time to create 1 rle with old method : 0.023850202560424805 length of segment : 214 time for calcul the mask position with numpy : 0.0007174015045166016 nb_pixel_total : 22111 time to create 1 rle with old method : 0.032297372817993164 length of segment : 273 time for calcul the mask position with numpy : 0.0005500316619873047 nb_pixel_total : 19108 time to create 1 rle with old method : 0.029468059539794922 length of segment : 181 time for calcul the mask position with numpy : 0.0007305145263671875 nb_pixel_total : 20594 time to create 1 rle with old method : 0.030784130096435547 length of segment : 241 time for calcul the mask position with numpy : 0.0005910396575927734 nb_pixel_total : 23807 time to create 1 rle with old method : 0.03553056716918945 length of segment : 120 time for calcul the mask position with numpy : 0.0045032501220703125 nb_pixel_total : 137577 time to create 1 rle with old method : 0.18236970901489258 length of segment : 582 time for calcul the mask position with numpy : 0.0002193450927734375 nb_pixel_total : 8552 time to create 1 rle with old method : 0.010476827621459961 length of segment : 119 time for calcul the mask position with numpy : 0.00040459632873535156 nb_pixel_total : 20744 time to create 1 rle with old method : 0.02460336685180664 length of segment : 175 time for calcul the mask position with numpy : 0.0005114078521728516 nb_pixel_total : 20794 time to create 1 rle with old method : 0.026381969451904297 length of segment : 189 time for calcul the mask position with numpy : 0.0006413459777832031 nb_pixel_total : 26733 time to create 1 rle with old method : 0.03212928771972656 length of segment : 227 time for calcul the mask position with numpy : 0.0006852149963378906 nb_pixel_total : 36838 time to create 1 rle with old method : 0.043767452239990234 length of segment : 178 time for calcul the mask position with numpy : 0.0003993511199951172 nb_pixel_total : 10398 time to create 1 rle with old method : 0.012793302536010742 length of segment : 110 time for calcul the mask position with numpy : 0.001462697982788086 nb_pixel_total : 58217 time to create 1 rle with old method : 0.06876587867736816 length of segment : 378 time for calcul the mask position with numpy : 0.0012869834899902344 nb_pixel_total : 45649 time to create 1 rle with old method : 0.059143781661987305 length of segment : 327 time for calcul the mask position with numpy : 0.0010101795196533203 nb_pixel_total : 37234 time to create 1 rle with old method : 0.04412102699279785 length of segment : 307 time for calcul the mask position with numpy : 0.0007841587066650391 nb_pixel_total : 27118 time to create 1 rle with old method : 0.03390789031982422 length of segment : 232 time for calcul the mask position with numpy : 0.0007760524749755859 nb_pixel_total : 20237 time to create 1 rle with old method : 0.02435898780822754 length of segment : 183 time for calcul the mask position with numpy : 0.0012362003326416016 nb_pixel_total : 57887 time to create 1 rle with old method : 0.0713202953338623 length of segment : 290 time for calcul the mask position with numpy : 0.0007197856903076172 nb_pixel_total : 15712 time to create 1 rle with old method : 0.018589496612548828 length of segment : 214 time for calcul the mask position with numpy : 0.0011017322540283203 nb_pixel_total : 35640 time to create 1 rle with old method : 0.04832291603088379 length of segment : 286 time for calcul the mask position with numpy : 0.0006721019744873047 nb_pixel_total : 17968 time to create 1 rle with old method : 0.0211179256439209 length of segment : 173 time for calcul the mask position with numpy : 0.0018019676208496094 nb_pixel_total : 35497 time to create 1 rle with old method : 0.04069805145263672 length of segment : 383 time for calcul the mask position with numpy : 0.0022878646850585938 nb_pixel_total : 78437 time to create 1 rle with old method : 0.09087514877319336 length of segment : 314 time for calcul the mask position with numpy : 0.0007739067077636719 nb_pixel_total : 25183 time to create 1 rle with old method : 0.029368162155151367 length of segment : 133 time for calcul the mask position with numpy : 0.0019054412841796875 nb_pixel_total : 44417 time to create 1 rle with old method : 0.05544328689575195 length of segment : 213 time for calcul the mask position with numpy : 0.0009305477142333984 nb_pixel_total : 32574 time to create 1 rle with old method : 0.05530738830566406 length of segment : 126 time for calcul the mask position with numpy : 0.000978231430053711 nb_pixel_total : 39817 time to create 1 rle with old method : 0.04833722114562988 length of segment : 174 time for calcul the mask position with numpy : 0.002238035202026367 nb_pixel_total : 61406 time to create 1 rle with old method : 0.07368278503417969 length of segment : 209 time for calcul the mask position with numpy : 0.0005896091461181641 nb_pixel_total : 13123 time to create 1 rle with old method : 0.015635013580322266 length of segment : 142 time for calcul the mask position with numpy : 0.0031642913818359375 nb_pixel_total : 79689 time to create 1 rle with old method : 0.09238553047180176 length of segment : 344 time for calcul the mask position with numpy : 0.0011854171752929688 nb_pixel_total : 32051 time to create 1 rle with old method : 0.03748631477355957 length of segment : 171 time for calcul the mask position with numpy : 0.0005958080291748047 nb_pixel_total : 16995 time to create 1 rle with old method : 0.020280122756958008 length of segment : 146 time for calcul the mask position with numpy : 0.0009658336639404297 nb_pixel_total : 24702 time to create 1 rle with old method : 0.028698205947875977 length of segment : 255 time for calcul the mask position with numpy : 0.0030372142791748047 nb_pixel_total : 126140 time to create 1 rle with old method : 0.149169921875 length of segment : 566 time for calcul the mask position with numpy : 0.005791425704956055 nb_pixel_total : 181708 time to create 1 rle with new method : 0.009231328964233398 length of segment : 698 time for calcul the mask position with numpy : 0.0008392333984375 nb_pixel_total : 26939 time to create 1 rle with old method : 0.03290605545043945 length of segment : 224 time for calcul the mask position with numpy : 0.0005717277526855469 nb_pixel_total : 12811 time to create 1 rle with old method : 0.015555620193481445 length of segment : 143 time for calcul the mask position with numpy : 0.0005292892456054688 nb_pixel_total : 10989 time to create 1 rle with old method : 0.013457298278808594 length of segment : 142 time for calcul the mask position with numpy : 0.0009591579437255859 nb_pixel_total : 28610 time to create 1 rle with old method : 0.03394007682800293 length of segment : 490 time for calcul the mask position with numpy : 0.0008504390716552734 nb_pixel_total : 24807 time to create 1 rle with old method : 0.029315948486328125 length of segment : 235 time for calcul the mask position with numpy : 0.0012340545654296875 nb_pixel_total : 43024 time to create 1 rle with old method : 0.05091404914855957 length of segment : 344 time for calcul the mask position with numpy : 0.004158973693847656 nb_pixel_total : 188779 time to create 1 rle with new method : 0.013573646545410156 length of segment : 564 time for calcul the mask position with numpy : 0.0014734268188476562 nb_pixel_total : 37240 time to create 1 rle with old method : 0.04984140396118164 length of segment : 222 time for calcul the mask position with numpy : 0.0013804435729980469 nb_pixel_total : 59205 time to create 1 rle with old method : 0.0712122917175293 length of segment : 375 time for calcul the mask position with numpy : 0.001135110855102539 nb_pixel_total : 52034 time to create 1 rle with old method : 0.06123065948486328 length of segment : 365 time for calcul the mask position with numpy : 0.0019800662994384766 nb_pixel_total : 84691 time to create 1 rle with old method : 0.10210514068603516 length of segment : 433 time for calcul the mask position with numpy : 0.0006563663482666016 nb_pixel_total : 21621 time to create 1 rle with old method : 0.027117013931274414 length of segment : 147 time for calcul the mask position with numpy : 0.0008537769317626953 nb_pixel_total : 29775 time to create 1 rle with old method : 0.03821563720703125 length of segment : 200 time for calcul the mask position with numpy : 0.0003974437713623047 nb_pixel_total : 10799 time to create 1 rle with old method : 0.013521194458007812 length of segment : 95 time for calcul the mask position with numpy : 0.003621339797973633 nb_pixel_total : 140130 time to create 1 rle with old method : 0.1692976951599121 length of segment : 399 time for calcul the mask position with numpy : 0.00036907196044921875 nb_pixel_total : 7218 time to create 1 rle with old method : 0.008824586868286133 length of segment : 93 time for calcul the mask position with numpy : 0.00040435791015625 nb_pixel_total : 8149 time to create 1 rle with old method : 0.012955665588378906 length of segment : 92 time for calcul the mask position with numpy : 0.0004494190216064453 nb_pixel_total : 15357 time to create 1 rle with old method : 0.01861286163330078 length of segment : 145 time for calcul the mask position with numpy : 0.0007424354553222656 nb_pixel_total : 18753 time to create 1 rle with old method : 0.022258281707763672 length of segment : 194 time for calcul the mask position with numpy : 0.0008311271667480469 nb_pixel_total : 19306 time to create 1 rle with old method : 0.034752607345581055 length of segment : 153 time for calcul the mask position with numpy : 0.002634763717651367 nb_pixel_total : 81290 time to create 1 rle with old method : 0.09606313705444336 length of segment : 414 time for calcul the mask position with numpy : 0.0007336139678955078 nb_pixel_total : 21627 time to create 1 rle with old method : 0.02705836296081543 length of segment : 147 time for calcul the mask position with numpy : 0.0011708736419677734 nb_pixel_total : 37119 time to create 1 rle with old method : 0.04661440849304199 length of segment : 244 time for calcul the mask position with numpy : 0.0030515193939208984 nb_pixel_total : 143922 time to create 1 rle with old method : 0.16866564750671387 length of segment : 359 time for calcul the mask position with numpy : 0.0007829666137695312 nb_pixel_total : 30269 time to create 1 rle with old method : 0.03742361068725586 length of segment : 193 time for calcul the mask position with numpy : 0.0007143020629882812 nb_pixel_total : 23415 time to create 1 rle with old method : 0.02832818031311035 length of segment : 162 time for calcul the mask position with numpy : 0.0004558563232421875 nb_pixel_total : 18768 time to create 1 rle with old method : 0.022440433502197266 length of segment : 206 time for calcul the mask position with numpy : 0.0005922317504882812 nb_pixel_total : 36343 time to create 1 rle with old method : 0.04478859901428223 length of segment : 134 time for calcul the mask position with numpy : 0.0003294944763183594 nb_pixel_total : 12418 time to create 1 rle with old method : 0.015362262725830078 length of segment : 93 time for calcul the mask position with numpy : 0.0004668235778808594 nb_pixel_total : 22066 time to create 1 rle with old method : 0.026890277862548828 length of segment : 141 time for calcul the mask position with numpy : 0.00044608116149902344 nb_pixel_total : 18767 time to create 1 rle with old method : 0.022725582122802734 length of segment : 151 time for calcul the mask position with numpy : 0.00026679039001464844 nb_pixel_total : 7293 time to create 1 rle with old method : 0.008998394012451172 length of segment : 78 time for calcul the mask position with numpy : 0.0020661354064941406 nb_pixel_total : 79292 time to create 1 rle with old method : 0.11184000968933105 length of segment : 742 time for calcul the mask position with numpy : 0.001407623291015625 nb_pixel_total : 49768 time to create 1 rle with old method : 0.059801578521728516 length of segment : 256 time for calcul the mask position with numpy : 0.0003159046173095703 nb_pixel_total : 9460 time to create 1 rle with old method : 0.010851144790649414 length of segment : 75 time for calcul the mask position with numpy : 0.0007381439208984375 nb_pixel_total : 24398 time to create 1 rle with old method : 0.028414011001586914 length of segment : 176 time for calcul the mask position with numpy : 0.0004940032958984375 nb_pixel_total : 13242 time to create 1 rle with old method : 0.015751361846923828 length of segment : 93 time for calcul the mask position with numpy : 0.001300811767578125 nb_pixel_total : 27141 time to create 1 rle with old method : 0.03161787986755371 length of segment : 268 time for calcul the mask position with numpy : 0.0027337074279785156 nb_pixel_total : 84402 time to create 1 rle with old method : 0.09756994247436523 length of segment : 794 time for calcul the mask position with numpy : 0.0011382102966308594 nb_pixel_total : 21363 time to create 1 rle with old method : 0.02586197853088379 length of segment : 204 time for calcul the mask position with numpy : 0.0016300678253173828 nb_pixel_total : 46729 time to create 1 rle with old method : 0.05517911911010742 length of segment : 279 time for calcul the mask position with numpy : 0.0006108283996582031 nb_pixel_total : 12013 time to create 1 rle with old method : 0.01440572738647461 length of segment : 187 time for calcul the mask position with numpy : 0.0009324550628662109 nb_pixel_total : 34460 time to create 1 rle with old method : 0.04147815704345703 length of segment : 188 time for calcul the mask position with numpy : 0.003011941909790039 nb_pixel_total : 67277 time to create 1 rle with old method : 0.07946395874023438 length of segment : 422 time spent for convertir_results : 7.666695833206177 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 88 chid ids of type : 3594 Number RLEs to save : 21903 save missing photos in datou_result : time spend for datou_step_exec : 62.21949791908264 time spend to save output : 1.4855282306671143 total time spend for step 1 : 63.705026149749756 step2:crop_condition Tue Sep 2 20:41:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 9 ! batch 1 Loaded 88 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 74 About to insert : list_path_to_insert length 74 new photo from crops ! About to upload 74 photos upload in portfolio : 3736932 init cache_photo without model_param we have 74 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756838510_4037402 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 74 photos in the portfolio 3736932 time of upload the photos Elapsed time : 20.391345500946045 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756838532_4037402 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.992821455001831 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3736932 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756838537_4037402 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 10 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.608588218688965 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756838542_4037402 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6084051132202148 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1380892558, 1380892556, 1380892554, 1380892553, 1380892539, 1380892537, 1380892519, 1380892507, 1380892504] Looping around the photos to save general results len do output : 88 /1380918863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380918960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892558', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892556', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892554', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892553', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892539', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892537', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892519', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892507', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892504', None, None, None, None, None, '3653876') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 273 time used for this insertion : 0.02778148651123047 save_final save missing photos in datou_result : time spend for datou_step_exec : 47.57770895957947 time spend to save output : 0.030759811401367188 total time spend for step 2 : 47.608468770980835 step3:rle_unique_nms_with_priority Tue Sep 2 20:42:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 88 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 18 nb_hashtags : 1 time to prepare the origin masks : 7.35865330696106 time for calcul the mask position with numpy : 0.5539531707763672 nb_pixel_total : 7738055 time to create 1 rle with new method : 1.1285061836242676 time for calcul the mask position with numpy : 0.025341272354125977 nb_pixel_total : 20794 time to create 1 rle with old method : 0.024060487747192383 time for calcul the mask position with numpy : 0.025734901428222656 nb_pixel_total : 20744 time to create 1 rle with old method : 0.023797988891601562 time for calcul the mask position with numpy : 0.02613353729248047 nb_pixel_total : 8552 time to create 1 rle with old method : 0.010135650634765625 time for calcul the mask position with numpy : 0.02846980094909668 nb_pixel_total : 137577 time to create 1 rle with old method : 0.17116761207580566 time for calcul the mask position with numpy : 0.025234222412109375 nb_pixel_total : 23807 time to create 1 rle with old method : 0.027718544006347656 time for calcul the mask position with numpy : 0.02824091911315918 nb_pixel_total : 20594 time to create 1 rle with old method : 0.023961305618286133 time for calcul the mask position with numpy : 0.029912233352661133 nb_pixel_total : 19108 time to create 1 rle with old method : 0.02229142189025879 time for calcul the mask position with numpy : 0.02663135528564453 nb_pixel_total : 21638 time to create 1 rle with old method : 0.025255918502807617 time for calcul the mask position with numpy : 0.0287020206451416 nb_pixel_total : 16343 time to create 1 rle with old method : 0.01926898956298828 time for calcul the mask position with numpy : 0.0275270938873291 nb_pixel_total : 35038 time to create 1 rle with old method : 0.04099392890930176 time for calcul the mask position with numpy : 0.025890111923217773 nb_pixel_total : 20454 time to create 1 rle with old method : 0.024039506912231445 time for calcul the mask position with numpy : 0.025459766387939453 nb_pixel_total : 35307 time to create 1 rle with old method : 0.040491342544555664 time for calcul the mask position with numpy : 0.024687767028808594 nb_pixel_total : 24652 time to create 1 rle with old method : 0.027760982513427734 time for calcul the mask position with numpy : 0.02584385871887207 nb_pixel_total : 36542 time to create 1 rle with old method : 0.04318594932556152 time for calcul the mask position with numpy : 0.02650141716003418 nb_pixel_total : 27126 time to create 1 rle with old method : 0.030863046646118164 time for calcul the mask position with numpy : 0.025605440139770508 nb_pixel_total : 50642 time to create 1 rle with old method : 0.05766916275024414 time for calcul the mask position with numpy : 0.026061058044433594 nb_pixel_total : 10236 time to create 1 rle with old method : 0.012021541595458984 time for calcul the mask position with numpy : 0.02713942527770996 nb_pixel_total : 27191 time to create 1 rle with old method : 0.03494977951049805 create new chi : 2.8615078926086426 time to delete rle : 0.0259549617767334 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 10253 TO DO : save crop sub photo not yet done ! save time : 0.7116072177886963 nb_obj : 19 nb_hashtags : 2 time to prepare the origin masks : 7.276286840438843 time for calcul the mask position with numpy : 0.6448564529418945 nb_pixel_total : 7587438 time to create 1 rle with new method : 0.796384334564209 time for calcul the mask position with numpy : 0.026612043380737305 nb_pixel_total : 61406 time to create 1 rle with old method : 0.07317972183227539 time for calcul the mask position with numpy : 0.02678203582763672 nb_pixel_total : 39817 time to create 1 rle with old method : 0.045769453048706055 time for calcul the mask position with numpy : 0.02571415901184082 nb_pixel_total : 32574 time to create 1 rle with old method : 0.03710150718688965 time for calcul the mask position with numpy : 0.026496171951293945 nb_pixel_total : 44417 time to create 1 rle with old method : 0.04978442192077637 time for calcul the mask position with numpy : 0.02835702896118164 nb_pixel_total : 25183 time to create 1 rle with old method : 0.03268623352050781 time for calcul the mask position with numpy : 0.027335405349731445 nb_pixel_total : 78437 time to create 1 rle with old method : 0.09104037284851074 time for calcul the mask position with numpy : 0.026601791381835938 nb_pixel_total : 35497 time to create 1 rle with old method : 0.04251599311828613 time for calcul the mask position with numpy : 0.026391267776489258 nb_pixel_total : 17968 time to create 1 rle with old method : 0.020229339599609375 time for calcul the mask position with numpy : 0.02509784698486328 nb_pixel_total : 35640 time to create 1 rle with old method : 0.03986334800720215 time for calcul the mask position with numpy : 0.02444767951965332 nb_pixel_total : 15712 time to create 1 rle with old method : 0.01749253273010254 time for calcul the mask position with numpy : 0.026346683502197266 nb_pixel_total : 57887 time to create 1 rle with old method : 0.06712722778320312 time for calcul the mask position with numpy : 0.026211977005004883 nb_pixel_total : 20237 time to create 1 rle with old method : 0.025666236877441406 time for calcul the mask position with numpy : 0.026982545852661133 nb_pixel_total : 27118 time to create 1 rle with old method : 0.03061079978942871 time for calcul the mask position with numpy : 0.027099132537841797 nb_pixel_total : 37234 time to create 1 rle with old method : 0.0476231575012207 time for calcul the mask position with numpy : 0.02925848960876465 nb_pixel_total : 45649 time to create 1 rle with old method : 0.052402496337890625 time for calcul the mask position with numpy : 0.030655860900878906 nb_pixel_total : 58217 time to create 1 rle with old method : 0.06593108177185059 time for calcul the mask position with numpy : 0.025447845458984375 nb_pixel_total : 10398 time to create 1 rle with old method : 0.011945962905883789 time for calcul the mask position with numpy : 0.024506568908691406 nb_pixel_total : 36838 time to create 1 rle with old method : 0.044754981994628906 time for calcul the mask position with numpy : 0.03386998176574707 nb_pixel_total : 26733 time to create 1 rle with old method : 0.03445243835449219 create new chi : 2.8315927982330322 time to delete rle : 0.0012166500091552734 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 11074 TO DO : save crop sub photo not yet done ! save time : 0.733147144317627 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 3.202242851257324 time for calcul the mask position with numpy : 0.7931196689605713 nb_pixel_total : 7819992 time to create 1 rle with new method : 1.2460997104644775 time for calcul the mask position with numpy : 0.024772167205810547 nb_pixel_total : 181708 time to create 1 rle with new method : 0.4595799446105957 time for calcul the mask position with numpy : 0.025716066360473633 nb_pixel_total : 126140 time to create 1 rle with old method : 0.14473485946655273 time for calcul the mask position with numpy : 0.025960445404052734 nb_pixel_total : 24702 time to create 1 rle with old method : 0.030553817749023438 time for calcul the mask position with numpy : 0.025056838989257812 nb_pixel_total : 16995 time to create 1 rle with old method : 0.019390344619750977 time for calcul the mask position with numpy : 0.026120662689208984 nb_pixel_total : 32051 time to create 1 rle with old method : 0.036000967025756836 time for calcul the mask position with numpy : 0.02730727195739746 nb_pixel_total : 79689 time to create 1 rle with old method : 0.08932232856750488 time for calcul the mask position with numpy : 0.024397850036621094 nb_pixel_total : 13123 time to create 1 rle with old method : 0.014786005020141602 create new chi : 3.0850720405578613 time to delete rle : 0.0009050369262695312 batch 1 Loaded 15 chid ids of type : 3594 +++++++++++Number RLEs to save : 6804 TO DO : save crop sub photo not yet done ! save time : 0.4343695640563965 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 2.2504916191101074 time for calcul the mask position with numpy : 0.4013659954071045 nb_pixel_total : 8147220 time to create 1 rle with new method : 1.1790540218353271 time for calcul the mask position with numpy : 0.024420976638793945 nb_pixel_total : 43024 time to create 1 rle with old method : 0.04890727996826172 time for calcul the mask position with numpy : 0.02473759651184082 nb_pixel_total : 24807 time to create 1 rle with old method : 0.028397560119628906 time for calcul the mask position with numpy : 0.024994373321533203 nb_pixel_total : 28610 time to create 1 rle with old method : 0.033246517181396484 time for calcul the mask position with numpy : 0.025694847106933594 nb_pixel_total : 10989 time to create 1 rle with old method : 0.012661457061767578 time for calcul the mask position with numpy : 0.025738000869750977 nb_pixel_total : 12811 time to create 1 rle with old method : 0.014756202697753906 time for calcul the mask position with numpy : 0.026187658309936523 nb_pixel_total : 26939 time to create 1 rle with old method : 0.037169694900512695 create new chi : 1.9517199993133545 time to delete rle : 0.0008218288421630859 batch 1 Loaded 13 chid ids of type : 3594 ++++++++Number RLEs to save : 5316 TO DO : save crop sub photo not yet done ! save time : 0.3779904842376709 nb_obj : 6 nb_hashtags : 1 time to prepare the origin masks : 2.1225855350494385 time for calcul the mask position with numpy : 0.5154097080230713 nb_pixel_total : 7850830 time to create 1 rle with new method : 0.9344608783721924 time for calcul the mask position with numpy : 0.024311065673828125 nb_pixel_total : 21621 time to create 1 rle with old method : 0.024405956268310547 time for calcul the mask position with numpy : 0.025265932083129883 nb_pixel_total : 84691 time to create 1 rle with old method : 0.10071873664855957 time for calcul the mask position with numpy : 0.02802252769470215 nb_pixel_total : 52034 time to create 1 rle with old method : 0.060855865478515625 time for calcul the mask position with numpy : 0.029184579849243164 nb_pixel_total : 59205 time to create 1 rle with old method : 0.07592320442199707 time for calcul the mask position with numpy : 0.03894615173339844 nb_pixel_total : 37240 time to create 1 rle with old method : 0.04347515106201172 time for calcul the mask position with numpy : 0.03651118278503418 nb_pixel_total : 188779 time to create 1 rle with new method : 0.7287521362304688 create new chi : 2.73210072517395 time to delete rle : 0.000942230224609375 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 6372 TO DO : save crop sub photo not yet done ! save time : 0.4393594264984131 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 2.726994037628174 time for calcul the mask position with numpy : 0.7690262794494629 nb_pixel_total : 8064219 time to create 1 rle with new method : 0.7109265327453613 time for calcul the mask position with numpy : 0.024266481399536133 nb_pixel_total : 18753 time to create 1 rle with old method : 0.02181529998779297 time for calcul the mask position with numpy : 0.02603936195373535 nb_pixel_total : 15357 time to create 1 rle with old method : 0.01960277557373047 time for calcul the mask position with numpy : 0.02487468719482422 nb_pixel_total : 8149 time to create 1 rle with old method : 0.009270668029785156 time for calcul the mask position with numpy : 0.02910780906677246 nb_pixel_total : 7218 time to create 1 rle with old method : 0.010614156723022461 time for calcul the mask position with numpy : 0.031049728393554688 nb_pixel_total : 140130 time to create 1 rle with old method : 0.15981054306030273 time for calcul the mask position with numpy : 0.02608513832092285 nb_pixel_total : 10799 time to create 1 rle with old method : 0.01268625259399414 time for calcul the mask position with numpy : 0.02581191062927246 nb_pixel_total : 29775 time to create 1 rle with old method : 0.03555488586425781 create new chi : 1.9804799556732178 time to delete rle : 0.0006661415100097656 batch 1 Loaded 15 chid ids of type : 3594 ++++++++++Number RLEs to save : 4596 TO DO : save crop sub photo not yet done ! save time : 0.357391357421875 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 2.0985193252563477 time for calcul the mask position with numpy : 0.9120771884918213 nb_pixel_total : 8135058 time to create 1 rle with new method : 1.2295188903808594 time for calcul the mask position with numpy : 0.04183506965637207 nb_pixel_total : 37119 time to create 1 rle with old method : 0.043506622314453125 time for calcul the mask position with numpy : 0.041101932525634766 nb_pixel_total : 21627 time to create 1 rle with old method : 0.025786399841308594 time for calcul the mask position with numpy : 0.040450096130371094 nb_pixel_total : 81290 time to create 1 rle with old method : 0.09262347221374512 time for calcul the mask position with numpy : 0.03488588333129883 nb_pixel_total : 19306 time to create 1 rle with old method : 0.0213773250579834 create new chi : 2.5247790813446045 time to delete rle : 0.0007145404815673828 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 4076 TO DO : save crop sub photo not yet done ! save time : 0.3117194175720215 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 4.048061847686768 time for calcul the mask position with numpy : 0.6879696846008301 nb_pixel_total : 7903263 time to create 1 rle with new method : 1.0020084381103516 time for calcul the mask position with numpy : 0.04829668998718262 nb_pixel_total : 79292 time to create 1 rle with old method : 0.09639477729797363 time for calcul the mask position with numpy : 0.04236721992492676 nb_pixel_total : 7293 time to create 1 rle with old method : 0.008224725723266602 time for calcul the mask position with numpy : 0.04166674613952637 nb_pixel_total : 17351 time to create 1 rle with old method : 0.023009777069091797 time for calcul the mask position with numpy : 0.041085004806518555 nb_pixel_total : 22066 time to create 1 rle with old method : 0.025725603103637695 time for calcul the mask position with numpy : 0.02694225311279297 nb_pixel_total : 12418 time to create 1 rle with old method : 0.014473676681518555 time for calcul the mask position with numpy : 0.026331186294555664 nb_pixel_total : 36343 time to create 1 rle with old method : 0.04123187065124512 time for calcul the mask position with numpy : 0.02579045295715332 nb_pixel_total : 18768 time to create 1 rle with old method : 0.023211956024169922 time for calcul the mask position with numpy : 0.026915311813354492 nb_pixel_total : 23415 time to create 1 rle with old method : 0.02629399299621582 time for calcul the mask position with numpy : 0.025286436080932617 nb_pixel_total : 30269 time to create 1 rle with old method : 0.03494858741760254 time for calcul the mask position with numpy : 0.029118776321411133 nb_pixel_total : 143922 time to create 1 rle with old method : 0.16882061958312988 create new chi : 2.534266471862793 time to delete rle : 0.00115966796875 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 6640 TO DO : save crop sub photo not yet done ! save time : 0.46994709968566895 nb_obj : 11 nb_hashtags : 2 time to prepare the origin masks : 4.284733772277832 time for calcul the mask position with numpy : 1.0435357093811035 nb_pixel_total : 7904147 time to create 1 rle with new method : 1.245805263519287 time for calcul the mask position with numpy : 0.04021620750427246 nb_pixel_total : 67277 time to create 1 rle with old method : 0.07656550407409668 time for calcul the mask position with numpy : 0.039285898208618164 nb_pixel_total : 34460 time to create 1 rle with old method : 0.0392453670501709 time for calcul the mask position with numpy : 0.04403209686279297 nb_pixel_total : 12013 time to create 1 rle with old method : 0.01566290855407715 time for calcul the mask position with numpy : 0.05303192138671875 nb_pixel_total : 46729 time to create 1 rle with old method : 0.06812810897827148 time for calcul the mask position with numpy : 0.04587578773498535 nb_pixel_total : 21363 time to create 1 rle with old method : 0.031223773956298828 time for calcul the mask position with numpy : 0.027564048767089844 nb_pixel_total : 84402 time to create 1 rle with old method : 0.10190391540527344 time for calcul the mask position with numpy : 0.02701282501220703 nb_pixel_total : 27141 time to create 1 rle with old method : 0.031089067459106445 time for calcul the mask position with numpy : 0.025345563888549805 nb_pixel_total : 13242 time to create 1 rle with old method : 0.015161991119384766 time for calcul the mask position with numpy : 0.02557849884033203 nb_pixel_total : 24398 time to create 1 rle with old method : 0.028374910354614258 time for calcul the mask position with numpy : 0.02538919448852539 nb_pixel_total : 9460 time to create 1 rle with old method : 0.011206388473510742 time for calcul the mask position with numpy : 0.027682065963745117 nb_pixel_total : 49768 time to create 1 rle with old method : 0.05687665939331055 create new chi : 3.190248489379883 time to delete rle : 0.001329660415649414 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 8044 TO DO : save crop sub photo not yet done ! save time : 0.5441272258758545 map_output_result : {1380892558: (0.0, 'Should be the crop_list due to order', 0), 1380892556: (0.0, 'Should be the crop_list due to order', 0), 1380892554: (0.0, 'Should be the crop_list due to order', 0), 1380892553: (0.0, 'Should be the crop_list due to order', 0), 1380892539: (0.0, 'Should be the crop_list due to order', 0), 1380892537: (0.0, 'Should be the crop_list due to order', 0), 1380892519: (0.0, 'Should be the crop_list due to order', 0), 1380892507: (0.0, 'Should be the crop_list due to order', 0), 1380892504: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1380892558, 1380892556, 1380892554, 1380892553, 1380892539, 1380892537, 1380892519, 1380892507, 1380892504] Looping around the photos to save general results len do output : 9 /1380892558.Didn't retrieve data . /1380892556.Didn't retrieve data . /1380892554.Didn't retrieve data . /1380892553.Didn't retrieve data . /1380892539.Didn't retrieve data . /1380892537.Didn't retrieve data . /1380892519.Didn't retrieve data . /1380892507.Didn't retrieve data . /1380892504.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892558', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892556', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892554', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892553', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892539', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892537', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892519', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892507', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892504', None, None, None, None, None, '3653876') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.013683080673217773 save_final save missing photos in datou_result : time spend for datou_step_exec : 64.76796865463257 time spend to save output : 0.017695188522338867 total time spend for step 3 : 64.78566384315491 step4:ventilate_hashtags_in_portfolio Tue Sep 2 20:43:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26453698 get user id for portfolio 26453698 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26453698 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','autre','flou','environnement','metal','carton','mal_croppe','background','papier','pehd','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26453698 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','autre','flou','environnement','metal','carton','mal_croppe','background','papier','pehd','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26453698 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','autre','flou','environnement','metal','carton','mal_croppe','background','papier','pehd','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26455548,26455549,26455550,26455551,26455552,26455553,26455554,26455555,26455556,26455557,26455558?tags=pet_fonce,autre,flou,environnement,metal,carton,mal_croppe,background,papier,pehd,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1380892558, 1380892556, 1380892554, 1380892553, 1380892539, 1380892537, 1380892519, 1380892507, 1380892504] Looping around the photos to save general results len do output : 1 /26453698. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892558', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892556', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892554', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892553', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892539', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892537', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892519', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892507', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892504', None, None, None, None, None, '3653876') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.017608165740966797 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.676649808883667 time spend to save output : 0.017873287200927734 total time spend for step 4 : 1.6945230960845947 step5:final Tue Sep 2 20:43:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1380892558: ('0.04687738447359397',), 1380892556: ('0.04687738447359397',), 1380892554: ('0.04687738447359397',), 1380892553: ('0.04687738447359397',), 1380892539: ('0.04687738447359397',), 1380892537: ('0.04687738447359397',), 1380892519: ('0.04687738447359397',), 1380892507: ('0.04687738447359397',), 1380892504: ('0.04687738447359397',)} new output for save of step final : {1380892558: ('0.04687738447359397',), 1380892556: ('0.04687738447359397',), 1380892554: ('0.04687738447359397',), 1380892553: ('0.04687738447359397',), 1380892539: ('0.04687738447359397',), 1380892537: ('0.04687738447359397',), 1380892519: ('0.04687738447359397',), 1380892507: ('0.04687738447359397',), 1380892504: ('0.04687738447359397',)} [1380892558, 1380892556, 1380892554, 1380892553, 1380892539, 1380892537, 1380892519, 1380892507, 1380892504] Looping around the photos to save general results len do output : 9 /1380892558.Didn't retrieve data . /1380892556.Didn't retrieve data . /1380892554.Didn't retrieve data . /1380892553.Didn't retrieve data . /1380892539.Didn't retrieve data . /1380892537.Didn't retrieve data . /1380892519.Didn't retrieve data . /1380892507.Didn't retrieve data . /1380892504.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892558', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892556', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892554', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892553', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892539', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892537', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892519', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892507', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892504', None, None, None, None, None, '3653876') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.015459060668945312 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.14943647384643555 time spend to save output : 0.01596808433532715 total time spend for step 5 : 0.1654045581817627 step6:blur_detection Tue Sep 2 20:43:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd.jpg resize: (2160, 3840) 1380892558 -7.046092702318658 treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57.jpg resize: (2160, 3840) 1380892556 -7.060474780778993 treat image : temp/1756838429_4037402_1380892554_eff3e775a228853d6a70a528546f36b3.jpg resize: (2160, 3840) 1380892554 -6.859327178393316 treat image : temp/1756838429_4037402_1380892553_c2fed355eef66eab9b4d209700150252.jpg resize: (2160, 3840) 1380892553 -6.913023895165234 treat image : temp/1756838429_4037402_1380892539_9d8ad992f7cdc3cb5f09e9b279c1cc33.jpg resize: (2160, 3840) 1380892539 -7.025690588879705 treat image : temp/1756838429_4037402_1380892537_2d119014eeef354ba73d10c5568d3af7.jpg resize: (2160, 3840) 1380892537 -6.173963615970864 treat image : temp/1756838429_4037402_1380892519_ff2e3274dc55cd92c82d2570898cd75e.jpg resize: (2160, 3840) 1380892519 -7.099328860658838 treat image : temp/1756838429_4037402_1380892507_3c2be311fb4c12e23be87eae509d665d.jpg resize: (2160, 3840) 1380892507 -5.855763811112482 treat image : temp/1756838429_4037402_1380892504_2006cd6eb45c611ed01df45cc4f88b74.jpg resize: (2160, 3840) 1380892504 -5.901501629352466 treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935207_0.png resize: (226, 155) 1380918863 -4.2637595503204695 treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935208_0.png resize: (107, 123) 1380918864 -3.4075082242802925 treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935209_0.png resize: (292, 240) 1380918865 -4.731194679770487 treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935210_0.png resize: (231, 172) 1380918866 -3.598264852477274 treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935211_0.png resize: (166, 260) 1380918867 -4.22178811597912 treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935212_0.png resize: (130, 249) 1380918868 -3.0337989964364804 treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935213_0.png resize: (335, 145) 1380918869 -2.4625405999066325 treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935214_0.png resize: (183, 170) 1380918870 -3.4009024361374034 treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935215_0.png resize: (284, 156) 1380918871 -4.354147627387111 treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935216_0.png resize: (214, 106) 1380918872 -3.589606523978849 treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935217_0.png resize: (190, 235) 1380918873 -4.161957747246455 treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935218_0.png resize: (181, 157) 1380918874 -2.8610778811954916 treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935219_0.png resize: (241, 146) 1380918875 -3.9681890257242567 treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935220_0.png resize: (119, 287) 1380918876 -5.394269039432493 treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935221_0.png resize: (505, 355) 1380918877 -4.687896322421686 treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935222_0.png resize: (118, 96) 1380918878 -4.347038691458439 treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935223_0.png resize: (170, 148) 1380918879 -3.3251462336771973 treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935224_0.png resize: (173, 178) 1380918880 -4.131821945854458 treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935225_0.png resize: (226, 154) 1380918881 -4.294343590945695 treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935226_0.png resize: (172, 261) 1380918882 -4.274045544830963 treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935227_0.png resize: (110, 119) 1380918883 -3.4370195943558395 treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935228_0.png resize: (368, 254) 1380918884 -2.545603048147634 treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935229_0.png resize: (291, 234) 1380918885 -4.575343062773613 treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935230_0.png resize: (304, 151) 1380918886 -2.2791481114068888 treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935231_0.png resize: (230, 177) 1380918887 -3.5612958970050848 treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935232_0.png resize: (183, 171) 1380918888 -3.1458585448893817 treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935234_0.png resize: (214, 106) 1380918889 -3.140936562314381 treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935235_0.png resize: (285, 156) 1380918890 -4.392358911501398 treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935236_0.png resize: (173, 151) 1380918891 -2.408914478412796 treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935237_0.png resize: (383, 233) 1380918892 -4.712886248960225 treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935239_0.png resize: (131, 256) 1380918893 -3.299912628865991 treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935240_0.png resize: (206, 441) 1380918894 -2.757054100430961 treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935242_0.png resize: (172, 252) 1380918895 -1.7492462532562876 treat image : temp/1756838429_4037402_1380892554_eff3e775a228853d6a70a528546f36b3_rle_crop_3940935244_0.png resize: (142, 139) 1380918896 -4.0160113460216005 treat image : temp/1756838429_4037402_1380892554_eff3e775a228853d6a70a528546f36b3_rle_crop_3940935245_0.png resize: (333, 479) 1380918897 -3.0517565936231588 treat image : temp/1756838429_4037402_1380892554_eff3e775a228853d6a70a528546f36b3_rle_crop_3940935246_0.png resize: (153, 349) 1380918898 -4.3094224741660145 treat image : temp/1756838429_4037402_1380892554_eff3e775a228853d6a70a528546f36b3_rle_crop_3940935247_0.png resize: (146, 169) 1380918899 -1.257562495730094 treat image : temp/1756838429_4037402_1380892554_eff3e775a228853d6a70a528546f36b3_rle_crop_3940935248_0.png resize: (232, 196) 1380918900 -3.144281469847162 treat image : temp/1756838429_4037402_1380892553_c2fed355eef66eab9b4d209700150252_rle_crop_3940935252_0.png resize: (139, 175) 1380918901 -2.741877617620627 treat image : temp/1756838429_4037402_1380892553_c2fed355eef66eab9b4d209700150252_rle_crop_3940935253_0.png resize: (134, 126) 1380918902 -3.3473817499285263 treat image : temp/1756838429_4037402_1380892553_c2fed355eef66eab9b4d209700150252_rle_crop_3940935254_0.png resize: (343, 117) 1380918903 -3.727736846156632 treat image : temp/1756838429_4037402_1380892553_c2fed355eef66eab9b4d209700150252_rle_crop_3940935255_0.png resize: (232, 167) 1380918904 -2.2824320656641857 treat image : temp/1756838429_4037402_1380892553_c2fed355eef66eab9b4d209700150252_rle_crop_3940935256_0.png resize: (315, 181) 1380918905 -2.0868173713718097 treat image : temp/1756838429_4037402_1380892539_9d8ad992f7cdc3cb5f09e9b279c1cc33_rle_crop_3940935257_0.png resize: (422, 798) 1380918906 -0.40268263559267437 treat image : temp/1756838429_4037402_1380892539_9d8ad992f7cdc3cb5f09e9b279c1cc33_rle_crop_3940935258_0.png resize: (222, 251) 1380918907 -3.2159246453649626 treat image : temp/1756838429_4037402_1380892539_9d8ad992f7cdc3cb5f09e9b279c1cc33_rle_crop_3940935259_0.png resize: (332, 273) 1380918908 -3.593616744263975 treat image : temp/1756838429_4037402_1380892539_9d8ad992f7cdc3cb5f09e9b279c1cc33_rle_crop_3940935260_0.png resize: (365, 211) 1380918909 -4.7871268245972685 treat image : temp/1756838429_4037402_1380892539_9d8ad992f7cdc3cb5f09e9b279c1cc33_rle_crop_3940935261_0.png resize: (409, 330) 1380918910 -3.774803164166873 treat image : temp/1756838429_4037402_1380892539_9d8ad992f7cdc3cb5f09e9b279c1cc33_rle_crop_3940935262_0.png resize: (145, 227) 1380918911 0.4536328546705557 treat image : temp/1756838429_4037402_1380892537_2d119014eeef354ba73d10c5568d3af7_rle_crop_3940935263_0.png resize: (199, 167) 1380918912 -3.339267670583307 treat image : temp/1756838429_4037402_1380892537_2d119014eeef354ba73d10c5568d3af7_rle_crop_3940935265_0.png resize: (326, 596) 1380918913 -4.691056491547885 treat image : temp/1756838429_4037402_1380892537_2d119014eeef354ba73d10c5568d3af7_rle_crop_3940935266_0.png resize: (93, 88) 1380918914 -2.6787624898389444 treat image : temp/1756838429_4037402_1380892537_2d119014eeef354ba73d10c5568d3af7_rle_crop_3940935267_0.png resize: (91, 129) 1380918915 -4.48666337487334 treat image : temp/1756838429_4037402_1380892537_2d119014eeef354ba73d10c5568d3af7_rle_crop_3940935268_0.png resize: (142, 167) 1380918916 -4.713996211865212 treat image : temp/1756838429_4037402_1380892519_ff2e3274dc55cd92c82d2570898cd75e_rle_crop_3940935270_0.png resize: (153, 202) 1380918917 -1.081800715055511 treat image : temp/1756838429_4037402_1380892519_ff2e3274dc55cd92c82d2570898cd75e_rle_crop_3940935271_0.png resize: (414, 285) 1380918918 -2.9971917954695066 treat image : temp/1756838429_4037402_1380892507_3c2be311fb4c12e23be87eae509d665d_rle_crop_3940935274_0.png resize: (359, 571) 1380918919 -4.170075496594574 treat image : temp/1756838429_4037402_1380892507_3c2be311fb4c12e23be87eae509d665d_rle_crop_3940935275_0.png resize: (175, 243) 1380918920 -3.9195445019405653 treat image : temp/1756838429_4037402_1380892507_3c2be311fb4c12e23be87eae509d665d_rle_crop_3940935276_0.png resize: (155, 263) 1380918921 -3.6539158153846545 treat image : temp/1756838429_4037402_1380892507_3c2be311fb4c12e23be87eae509d665d_rle_crop_3940935277_0.png resize: (206, 179) 1380918922 -3.951250994978241 treat image : temp/1756838429_4037402_1380892507_3c2be311fb4c12e23be87eae509d665d_rle_crop_3940935279_0.png resize: (93, 182) 1380918923 -4.673216261379362 treat image : temp/1756838429_4037402_1380892507_3c2be311fb4c12e23be87eae509d665d_rle_crop_3940935281_0.png resize: (151, 173) 1380918924 -3.7639965780608757 treat image : temp/1756838429_4037402_1380892507_3c2be311fb4c12e23be87eae509d665d_rle_crop_3940935282_0.png resize: (78, 134) 1380918925 -4.71130901706699 treat image : temp/1756838429_4037402_1380892507_3c2be311fb4c12e23be87eae509d665d_rle_crop_3940935283_0.png resize: (394, 451) 1380918926 -4.503752238442138 treat image : temp/1756838429_4037402_1380892504_2006cd6eb45c611ed01df45cc4f88b74_rle_crop_3940935284_0.png resize: (256, 254) 1380918927 -4.946774461295364 treat image : temp/1756838429_4037402_1380892504_2006cd6eb45c611ed01df45cc4f88b74_rle_crop_3940935285_0.png resize: (75, 143) 1380918928 -4.825185491776997 treat image : temp/1756838429_4037402_1380892504_2006cd6eb45c611ed01df45cc4f88b74_rle_crop_3940935286_0.png resize: (176, 181) 1380918929 -3.6266195047136685 treat image : temp/1756838429_4037402_1380892504_2006cd6eb45c611ed01df45cc4f88b74_rle_crop_3940935287_0.png resize: (93, 209) 1380918930 -4.9379949558375165 treat image : temp/1756838429_4037402_1380892504_2006cd6eb45c611ed01df45cc4f88b74_rle_crop_3940935288_0.png resize: (265, 234) 1380918931 -4.020752106041349 treat image : temp/1756838429_4037402_1380892504_2006cd6eb45c611ed01df45cc4f88b74_rle_crop_3940935289_0.png resize: (469, 321) 1380918932 -4.1495804740867435 treat image : temp/1756838429_4037402_1380892504_2006cd6eb45c611ed01df45cc4f88b74_rle_crop_3940935290_0.png resize: (197, 166) 1380918934 -4.684539632367067 treat image : temp/1756838429_4037402_1380892504_2006cd6eb45c611ed01df45cc4f88b74_rle_crop_3940935291_0.png resize: (277, 289) 1380918935 -4.397997356352036 treat image : temp/1756838429_4037402_1380892504_2006cd6eb45c611ed01df45cc4f88b74_rle_crop_3940935292_0.png resize: (187, 95) 1380918936 -4.485806154758637 treat image : temp/1756838429_4037402_1380892504_2006cd6eb45c611ed01df45cc4f88b74_rle_crop_3940935293_0.png resize: (177, 264) 1380918938 -3.4350733752164184 treat image : temp/1756838429_4037402_1380892553_c2fed355eef66eab9b4d209700150252_rle_crop_3940935251_0.png resize: (224, 162) 1380918946 -2.850112913913446 treat image : temp/1756838429_4037402_1380892507_3c2be311fb4c12e23be87eae509d665d_rle_crop_3940935280_0.png resize: (141, 195) 1380918947 -4.280586232343856 treat image : temp/1756838429_4037402_1380892504_2006cd6eb45c611ed01df45cc4f88b74_rle_crop_3940935294_0.png resize: (359, 444) 1380918948 -3.929448965021788 treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935233_0.png resize: (255, 315) 1380918950 -5.258856074677556 treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935238_0.png resize: (266, 456) 1380918951 -4.695816340495266 treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935241_0.png resize: (122, 367) 1380918952 -5.593480508985826 treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935243_0.png resize: (182, 502) 1380918953 -4.011279905428668 treat image : temp/1756838429_4037402_1380892554_eff3e775a228853d6a70a528546f36b3_rle_crop_3940935249_0.png resize: (482, 385) 1380918954 -5.029395612479706 treat image : temp/1756838429_4037402_1380892554_eff3e775a228853d6a70a528546f36b3_rle_crop_3940935250_0.png resize: (587, 421) 1380918955 -5.163988531848794 treat image : temp/1756838429_4037402_1380892537_2d119014eeef354ba73d10c5568d3af7_rle_crop_3940935264_0.png resize: (81, 178) 1380918956 -4.248764517774091 treat image : temp/1756838429_4037402_1380892537_2d119014eeef354ba73d10c5568d3af7_rle_crop_3940935269_0.png resize: (164, 181) 1380918957 -5.4108060131151055 treat image : temp/1756838429_4037402_1380892519_ff2e3274dc55cd92c82d2570898cd75e_rle_crop_3940935272_0.png resize: (143, 175) 1380918958 -4.353522379292734 treat image : temp/1756838429_4037402_1380892507_3c2be311fb4c12e23be87eae509d665d_rle_crop_3940935278_0.png resize: (127, 345) 1380918959 -4.307278775720761 treat image : temp/1756838429_4037402_1380892519_ff2e3274dc55cd92c82d2570898cd75e_rle_crop_3940935273_0.png resize: (244, 185) 1380918960 -3.016532904437996 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 97 time used for this insertion : 0.017077207565307617 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 97 time used for this insertion : 0.019877195358276367 save missing photos in datou_result : time spend for datou_step_exec : 33.748478412628174 time spend to save output : 0.04205060005187988 total time spend for step 6 : 33.790529012680054 step7:brightness Tue Sep 2 20:44:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd.jpg treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57.jpg treat image : temp/1756838429_4037402_1380892554_eff3e775a228853d6a70a528546f36b3.jpg treat image : temp/1756838429_4037402_1380892553_c2fed355eef66eab9b4d209700150252.jpg treat image : temp/1756838429_4037402_1380892539_9d8ad992f7cdc3cb5f09e9b279c1cc33.jpg treat image : temp/1756838429_4037402_1380892537_2d119014eeef354ba73d10c5568d3af7.jpg treat image : temp/1756838429_4037402_1380892519_ff2e3274dc55cd92c82d2570898cd75e.jpg treat image : temp/1756838429_4037402_1380892507_3c2be311fb4c12e23be87eae509d665d.jpg treat image : temp/1756838429_4037402_1380892504_2006cd6eb45c611ed01df45cc4f88b74.jpg treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935207_0.png treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935208_0.png treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935209_0.png treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935210_0.png treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935211_0.png treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935212_0.png treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935213_0.png treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935214_0.png treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935215_0.png treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935216_0.png treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935217_0.png treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935218_0.png treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935219_0.png treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935220_0.png treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935221_0.png treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935222_0.png treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935223_0.png treat image : temp/1756838429_4037402_1380892558_0e6bb4ba46f0ebf2ce490b0fb5d97dcd_rle_crop_3940935224_0.png treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935225_0.png treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935226_0.png treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935227_0.png treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935228_0.png treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935229_0.png treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935230_0.png treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935231_0.png treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935232_0.png treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935234_0.png treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935235_0.png treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935236_0.png treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935237_0.png treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935239_0.png treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935240_0.png treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935242_0.png treat image : temp/1756838429_4037402_1380892554_eff3e775a228853d6a70a528546f36b3_rle_crop_3940935244_0.png treat image : temp/1756838429_4037402_1380892554_eff3e775a228853d6a70a528546f36b3_rle_crop_3940935245_0.png treat image : temp/1756838429_4037402_1380892554_eff3e775a228853d6a70a528546f36b3_rle_crop_3940935246_0.png treat image : temp/1756838429_4037402_1380892554_eff3e775a228853d6a70a528546f36b3_rle_crop_3940935247_0.png treat image : temp/1756838429_4037402_1380892554_eff3e775a228853d6a70a528546f36b3_rle_crop_3940935248_0.png treat image : temp/1756838429_4037402_1380892553_c2fed355eef66eab9b4d209700150252_rle_crop_3940935252_0.png treat image : temp/1756838429_4037402_1380892553_c2fed355eef66eab9b4d209700150252_rle_crop_3940935253_0.png treat image : temp/1756838429_4037402_1380892553_c2fed355eef66eab9b4d209700150252_rle_crop_3940935254_0.png treat image : temp/1756838429_4037402_1380892553_c2fed355eef66eab9b4d209700150252_rle_crop_3940935255_0.png treat image : temp/1756838429_4037402_1380892553_c2fed355eef66eab9b4d209700150252_rle_crop_3940935256_0.png treat image : temp/1756838429_4037402_1380892539_9d8ad992f7cdc3cb5f09e9b279c1cc33_rle_crop_3940935257_0.png treat image : temp/1756838429_4037402_1380892539_9d8ad992f7cdc3cb5f09e9b279c1cc33_rle_crop_3940935258_0.png treat image : temp/1756838429_4037402_1380892539_9d8ad992f7cdc3cb5f09e9b279c1cc33_rle_crop_3940935259_0.png treat image : temp/1756838429_4037402_1380892539_9d8ad992f7cdc3cb5f09e9b279c1cc33_rle_crop_3940935260_0.png treat image : temp/1756838429_4037402_1380892539_9d8ad992f7cdc3cb5f09e9b279c1cc33_rle_crop_3940935261_0.png treat image : temp/1756838429_4037402_1380892539_9d8ad992f7cdc3cb5f09e9b279c1cc33_rle_crop_3940935262_0.png treat image : temp/1756838429_4037402_1380892537_2d119014eeef354ba73d10c5568d3af7_rle_crop_3940935263_0.png treat image : temp/1756838429_4037402_1380892537_2d119014eeef354ba73d10c5568d3af7_rle_crop_3940935265_0.png treat image : temp/1756838429_4037402_1380892537_2d119014eeef354ba73d10c5568d3af7_rle_crop_3940935266_0.png treat image : temp/1756838429_4037402_1380892537_2d119014eeef354ba73d10c5568d3af7_rle_crop_3940935267_0.png treat image : temp/1756838429_4037402_1380892537_2d119014eeef354ba73d10c5568d3af7_rle_crop_3940935268_0.png treat image : temp/1756838429_4037402_1380892519_ff2e3274dc55cd92c82d2570898cd75e_rle_crop_3940935270_0.png treat image : temp/1756838429_4037402_1380892519_ff2e3274dc55cd92c82d2570898cd75e_rle_crop_3940935271_0.png treat image : temp/1756838429_4037402_1380892507_3c2be311fb4c12e23be87eae509d665d_rle_crop_3940935274_0.png treat image : temp/1756838429_4037402_1380892507_3c2be311fb4c12e23be87eae509d665d_rle_crop_3940935275_0.png treat image : temp/1756838429_4037402_1380892507_3c2be311fb4c12e23be87eae509d665d_rle_crop_3940935276_0.png treat image : temp/1756838429_4037402_1380892507_3c2be311fb4c12e23be87eae509d665d_rle_crop_3940935277_0.png treat image : temp/1756838429_4037402_1380892507_3c2be311fb4c12e23be87eae509d665d_rle_crop_3940935279_0.png treat image : temp/1756838429_4037402_1380892507_3c2be311fb4c12e23be87eae509d665d_rle_crop_3940935281_0.png treat image : temp/1756838429_4037402_1380892507_3c2be311fb4c12e23be87eae509d665d_rle_crop_3940935282_0.png treat image : temp/1756838429_4037402_1380892507_3c2be311fb4c12e23be87eae509d665d_rle_crop_3940935283_0.png treat image : temp/1756838429_4037402_1380892504_2006cd6eb45c611ed01df45cc4f88b74_rle_crop_3940935284_0.png treat image : temp/1756838429_4037402_1380892504_2006cd6eb45c611ed01df45cc4f88b74_rle_crop_3940935285_0.png treat image : temp/1756838429_4037402_1380892504_2006cd6eb45c611ed01df45cc4f88b74_rle_crop_3940935286_0.png treat image : temp/1756838429_4037402_1380892504_2006cd6eb45c611ed01df45cc4f88b74_rle_crop_3940935287_0.png treat image : temp/1756838429_4037402_1380892504_2006cd6eb45c611ed01df45cc4f88b74_rle_crop_3940935288_0.png treat image : temp/1756838429_4037402_1380892504_2006cd6eb45c611ed01df45cc4f88b74_rle_crop_3940935289_0.png treat image : temp/1756838429_4037402_1380892504_2006cd6eb45c611ed01df45cc4f88b74_rle_crop_3940935290_0.png treat image : temp/1756838429_4037402_1380892504_2006cd6eb45c611ed01df45cc4f88b74_rle_crop_3940935291_0.png treat image : temp/1756838429_4037402_1380892504_2006cd6eb45c611ed01df45cc4f88b74_rle_crop_3940935292_0.png treat image : temp/1756838429_4037402_1380892504_2006cd6eb45c611ed01df45cc4f88b74_rle_crop_3940935293_0.png treat image : temp/1756838429_4037402_1380892553_c2fed355eef66eab9b4d209700150252_rle_crop_3940935251_0.png treat image : temp/1756838429_4037402_1380892507_3c2be311fb4c12e23be87eae509d665d_rle_crop_3940935280_0.png treat image : temp/1756838429_4037402_1380892504_2006cd6eb45c611ed01df45cc4f88b74_rle_crop_3940935294_0.png treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935233_0.png treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935238_0.png treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935241_0.png treat image : temp/1756838429_4037402_1380892556_2e247c7dca67dce6bc68fba1eb9d6b57_rle_crop_3940935243_0.png treat image : temp/1756838429_4037402_1380892554_eff3e775a228853d6a70a528546f36b3_rle_crop_3940935249_0.png treat image : temp/1756838429_4037402_1380892554_eff3e775a228853d6a70a528546f36b3_rle_crop_3940935250_0.png treat image : temp/1756838429_4037402_1380892537_2d119014eeef354ba73d10c5568d3af7_rle_crop_3940935264_0.png treat image : temp/1756838429_4037402_1380892537_2d119014eeef354ba73d10c5568d3af7_rle_crop_3940935269_0.png treat image : temp/1756838429_4037402_1380892519_ff2e3274dc55cd92c82d2570898cd75e_rle_crop_3940935272_0.png treat image : temp/1756838429_4037402_1380892507_3c2be311fb4c12e23be87eae509d665d_rle_crop_3940935278_0.png treat image : temp/1756838429_4037402_1380892519_ff2e3274dc55cd92c82d2570898cd75e_rle_crop_3940935273_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 97 time used for this insertion : 0.018214941024780273 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 97 time used for this insertion : 0.019626140594482422 save missing photos in datou_result : time spend for datou_step_exec : 8.503657817840576 time spend to save output : 0.04239392280578613 total time spend for step 7 : 8.546051740646362 step8:velours_tree Tue Sep 2 20:44:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.12793207168579102 time spend to save output : 4.458427429199219e-05 total time spend for step 8 : 0.127976655960083 step9:send_mail_cod Tue Sep 2 20:44:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26453698_02-09-2025_20_44_11.pdf 26455548 imagette264555481756838651 26455549 change filename to text .imagette264555491756838651 26455550 imagette264555501756838652 26455552 imagette264555521756838652 26455553 change filename to text .change filename to text .change filename to text .imagette264555531756838652 26455554 imagette264555541756838652 26455555 imagette264555551756838652 26455556 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette264555561756838652 26455557 imagette264555571756838653 26455558 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette264555581756838653 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26453698 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26455548,26455549,26455550,26455551,26455552,26455553,26455554,26455555,26455556,26455557,26455558?tags=pet_fonce,autre,flou,environnement,metal,carton,mal_croppe,background,papier,pehd,pet_clair args[1380892558] : ((1380892558, -7.046092702318658, 492609224), (1380892558, 0.5956353320977474, 2107752395), '0.04687738447359397') We are sending mail with results at report@fotonower.com args[1380892556] : ((1380892556, -7.060474780778993, 492609224), (1380892556, 0.6041979018496082, 2107752395), '0.04687738447359397') We are sending mail with results at report@fotonower.com args[1380892554] : ((1380892554, -6.859327178393316, 492609224), (1380892554, 0.4944177312560833, 2107752395), '0.04687738447359397') We are sending mail with results at report@fotonower.com args[1380892553] : ((1380892553, -6.913023895165234, 492609224), (1380892553, 0.6906364756996248, 2107752395), '0.04687738447359397') We are sending mail with results at report@fotonower.com args[1380892539] : ((1380892539, -7.025690588879705, 492609224), (1380892539, 1.2290505961726477, 2107752395), '0.04687738447359397') We are sending mail with results at report@fotonower.com args[1380892537] : ((1380892537, -6.173963615970864, 492609224), (1380892537, 0.01848622636256527, 2107752395), '0.04687738447359397') We are sending mail with results at report@fotonower.com args[1380892519] : ((1380892519, -7.099328860658838, 492609224), (1380892519, 0.7581148738596726, 2107752395), '0.04687738447359397') We are sending mail with results at report@fotonower.com args[1380892507] : ((1380892507, -5.855763811112482, 492609224), (1380892507, -0.24446596479288124, 496442774), '0.04687738447359397') We are sending mail with results at report@fotonower.com args[1380892504] : ((1380892504, -5.901501629352466, 492609224), (1380892504, -0.27849798351089206, 496442774), '0.04687738447359397') We are sending mail with results at report@fotonower.com refus_total : 0.04687738447359397 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26453698 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26453698_02-09-2025_20_44_11.pdf results_Auto_P26453698_02-09-2025_20_44_11.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26453698_02-09-2025_20_44_11.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26453698','results_Auto_P26453698_02-09-2025_20_44_11.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26453698_02-09-2025_20_44_11.pdf','pdf','','0.5','0.04687738447359397') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26453698

https://www.fotonower.com/image?json=false&list_photos_id=1380892558
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380892556
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380892554
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380892553
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380892539
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380892537
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380892519
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380892507
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1380892504
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 4.69%
Veuillez trouver les photos des contaminants.

exemples de contaminants: autre: https://www.fotonower.com/view/26455549?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26455553?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26455556?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26455558?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26453698_02-09-2025_20_44_11.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26455548,26455549,26455550,26455551,26455552,26455553,26455554,26455555,26455556,26455557,26455558?tags=pet_fonce,autre,flou,environnement,metal,carton,mal_croppe,background,papier,pehd,pet_clair.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 02 Sep 2025 18:44:17 GMT Content-Length: 0 Connection: close X-Message-Id: w5rZLshkQB2KtunDtJaI-g Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1380892558, 1380892556, 1380892554, 1380892553, 1380892539, 1380892537, 1380892519, 1380892507, 1380892504] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892558', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892556', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892554', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892553', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892539', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892537', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892519', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892507', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892504', None, None, None, None, None, '3653876') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.01473379135131836 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.567885875701904 time spend to save output : 0.01509237289428711 total time spend for step 9 : 5.582978248596191 step10:split_time_score Tue Sep 2 20:44:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 9),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 02092025 26453698 Nombre de photos uploadées : 9 / 23040 (0%) 02092025 26453698 Nombre de photos taguées (types de déchets): 0 / 9 (0%) 02092025 26453698 Nombre de photos taguées (volume) : 0 / 9 (0%) elapsed_time : load_data_split_time_score 1.1920928955078125e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ????????? elapsed_time : fill_and_build_computed_from_old_data 0.00037980079650878906 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2195136547088623 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.02432069988942329 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26425488_02-09-2025_07_08_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26425488 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26425488 AND mptpi.`type`=3726 To do Qualite : 0.021157948726549775 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26430556_02-09-2025_09_38_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26430556 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26430556 AND mptpi.`type`=3726 To do Qualite : 0.032583451421997985 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26430558_02-09-2025_11_07_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26430558 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26430558 AND mptpi.`type`=3726 To do Qualite : 0.02485930167790575 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26436213_02-09-2025_13_39_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26436213 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26436213 AND mptpi.`type`=3726 To do Qualite : 0.06457790128815158 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26445880_02-09-2025_17_30_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26445880 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26445880 AND mptpi.`type`=3594 To do Qualite : 0.049658133666773824 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26444771_02-09-2025_16_37_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26444771 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26444771 AND mptpi.`type`=3726 To do Qualite : 0.026828029744689945 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26445882_02-09-2025_17_07_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26445882 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26445882 AND mptpi.`type`=3726 To do Qualite : 0.07653652531292866 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26445902_02-09-2025_18_24_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26445902 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26445902 AND mptpi.`type`=3594 To do Qualite : 0.04687738447359397 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26453698_02-09-2025_20_44_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26453698 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26453698 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26453700 order by id desc limit 1 Qualite : 0.02047109016134995 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26452500_02-09-2025_19_41_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26452500 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26452500 AND mptpi.`type`=3726 To do Qualite : 0.01530067920304614 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26452501_02-09-2025_19_36_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26452501 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26452501 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'02092025': {'nb_upload': 9, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1380892558, 1380892556, 1380892554, 1380892553, 1380892539, 1380892537, 1380892519, 1380892507, 1380892504] Looping around the photos to save general results len do output : 1 /26453698Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892558', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892556', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892554', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892553', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892539', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892537', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892519', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892507', None, None, None, None, None, '3653876') ('3318', None, None, None, None, None, None, None, '3653876') ('3318', '26453698', '1380892504', None, None, None, None, None, '3653876') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.01691436767578125 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.0485541820526123 time spend to save output : 0.017167091369628906 total time spend for step 10 : 2.065721273422241 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 9 set_done_treatment 102.78user 94.13system 3:53.79elapsed 84%CPU (0avgtext+0avgdata 4369980maxresident)k 748448inputs+81032outputs (8513major+10098381minor)pagefaults 0swaps