python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1035281 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3337310'] with mtr_portfolio_ids : ['25266815'] and first list_photo_ids : [] new path : /proc/1035281/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 1.4418578147888184 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu Jul 24 10:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5223 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-07-24 10:20:32.064698: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-07-24 10:20:32.091460: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-07-24 10:20:32.093450: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f3a48000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-07-24 10:20:32.093497: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-07-24 10:20:32.097825: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-07-24 10:20:32.239296: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x22818800 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-07-24 10:20:32.239346: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-07-24 10:20:32.240430: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-24 10:20:32.240843: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-24 10:20:32.243652: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-24 10:20:32.257611: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-24 10:20:32.258094: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-24 10:20:32.262709: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-24 10:20:32.264681: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-24 10:20:32.270782: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-24 10:20:32.271932: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-24 10:20:32.272015: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-24 10:20:32.272632: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-24 10:20:32.272647: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-24 10:20:32.272656: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-24 10:20:32.274088: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4767 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-07-24 10:20:32.598410: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-24 10:20:32.598495: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-24 10:20:32.598516: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-24 10:20:32.598534: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-24 10:20:32.598548: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-24 10:20:32.598563: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-24 10:20:32.598576: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-24 10:20:32.598596: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-24 10:20:32.599604: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-24 10:20:32.600602: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-24 10:20:32.600632: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-24 10:20:32.600646: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-24 10:20:32.600659: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-24 10:20:32.600672: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-24 10:20:32.600685: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-24 10:20:32.600698: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-24 10:20:32.600711: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-24 10:20:32.601615: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-24 10:20:32.601646: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-24 10:20:32.601654: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-24 10:20:32.601661: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-24 10:20:32.602670: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4767 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-07-24 10:20:44.738209: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-24 10:20:44.972632: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-24 10:20:46.730712: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:46.732006: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:46.733189: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.608732: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-07-24 10:20:47.679989: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.680061: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 10:20:47.681726: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.681759: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 10:20:47.689013: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.689062: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 10:20:47.690251: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.690270: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 10:20:47.729508: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.729598: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 19.91MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 10:20:47.729614: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-07-24 10:20:47.730388: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.730411: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 10:20:47.731200: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.731224: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 10:20:47.738611: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.738661: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 10:20:47.739575: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.739601: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 10:20:47.740537: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.740567: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 10:20:47.741502: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.750065: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.750952: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.774671: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.775475: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.776210: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.776931: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.781350: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.782051: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.782753: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.783508: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.785793: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.795319: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.796174: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.806061: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.806813: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.807653: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.808399: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.809138: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:20:47.809877: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 46 Detection mask done ! Trying to reset tf kernel 1035890 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2837 tf kernel not reseted sub process len(results) : 5 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 5 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4030 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0008041858673095703 nb_pixel_total : 15391 time to create 1 rle with old method : 0.019018888473510742 length of segment : 136 time for calcul the mask position with numpy : 0.0009377002716064453 nb_pixel_total : 24771 time to create 1 rle with old method : 0.02916741371154785 length of segment : 418 time for calcul the mask position with numpy : 0.001100778579711914 nb_pixel_total : 26811 time to create 1 rle with old method : 0.031369686126708984 length of segment : 384 time for calcul the mask position with numpy : 0.0020515918731689453 nb_pixel_total : 70142 time to create 1 rle with old method : 0.08621621131896973 length of segment : 319 time for calcul the mask position with numpy : 0.012185096740722656 nb_pixel_total : 248570 time to create 1 rle with new method : 0.02797722816467285 length of segment : 750 time for calcul the mask position with numpy : 0.001726388931274414 nb_pixel_total : 52319 time to create 1 rle with old method : 0.06105470657348633 length of segment : 336 time for calcul the mask position with numpy : 0.0012204647064208984 nb_pixel_total : 37087 time to create 1 rle with old method : 0.042835235595703125 length of segment : 330 time for calcul the mask position with numpy : 0.0020444393157958984 nb_pixel_total : 65803 time to create 1 rle with old method : 0.07679915428161621 length of segment : 333 time for calcul the mask position with numpy : 0.003100156784057617 nb_pixel_total : 68605 time to create 1 rle with old method : 0.07802915573120117 length of segment : 403 time for calcul the mask position with numpy : 0.003951549530029297 nb_pixel_total : 113716 time to create 1 rle with old method : 0.129713773727417 length of segment : 563 time for calcul the mask position with numpy : 0.0026323795318603516 nb_pixel_total : 60817 time to create 1 rle with old method : 0.0714564323425293 length of segment : 343 time for calcul the mask position with numpy : 0.0005974769592285156 nb_pixel_total : 13264 time to create 1 rle with old method : 0.015671491622924805 length of segment : 201 time for calcul the mask position with numpy : 0.002218961715698242 nb_pixel_total : 59233 time to create 1 rle with old method : 0.06789636611938477 length of segment : 556 time for calcul the mask position with numpy : 0.003773927688598633 nb_pixel_total : 75355 time to create 1 rle with old method : 0.08559942245483398 length of segment : 421 time for calcul the mask position with numpy : 0.0020189285278320312 nb_pixel_total : 88201 time to create 1 rle with old method : 0.10087776184082031 length of segment : 336 time for calcul the mask position with numpy : 0.0005300045013427734 nb_pixel_total : 13745 time to create 1 rle with old method : 0.018431901931762695 length of segment : 204 time for calcul the mask position with numpy : 0.0005991458892822266 nb_pixel_total : 11242 time to create 1 rle with old method : 0.01315164566040039 length of segment : 184 time for calcul the mask position with numpy : 0.0018589496612548828 nb_pixel_total : 50054 time to create 1 rle with old method : 0.05723452568054199 length of segment : 430 time for calcul the mask position with numpy : 0.0009961128234863281 nb_pixel_total : 28552 time to create 1 rle with old method : 0.041399240493774414 length of segment : 195 time for calcul the mask position with numpy : 0.0012850761413574219 nb_pixel_total : 26836 time to create 1 rle with old method : 0.03759646415710449 length of segment : 242 time for calcul the mask position with numpy : 0.002895355224609375 nb_pixel_total : 105261 time to create 1 rle with old method : 0.11939716339111328 length of segment : 279 time for calcul the mask position with numpy : 0.0003943443298339844 nb_pixel_total : 5978 time to create 1 rle with old method : 0.008524417877197266 length of segment : 93 time for calcul the mask position with numpy : 0.0008924007415771484 nb_pixel_total : 21263 time to create 1 rle with old method : 0.026999235153198242 length of segment : 161 time for calcul the mask position with numpy : 0.000995635986328125 nb_pixel_total : 24076 time to create 1 rle with old method : 0.027676820755004883 length of segment : 289 time for calcul the mask position with numpy : 0.006964206695556641 nb_pixel_total : 107989 time to create 1 rle with old method : 0.12192034721374512 length of segment : 571 time for calcul the mask position with numpy : 0.0005991458892822266 nb_pixel_total : 15338 time to create 1 rle with old method : 0.01788043975830078 length of segment : 144 time for calcul the mask position with numpy : 0.0018160343170166016 nb_pixel_total : 34654 time to create 1 rle with old method : 0.11156654357910156 length of segment : 322 time for calcul the mask position with numpy : 0.0007870197296142578 nb_pixel_total : 25683 time to create 1 rle with old method : 0.02988910675048828 length of segment : 261 time for calcul the mask position with numpy : 0.0015933513641357422 nb_pixel_total : 74875 time to create 1 rle with old method : 0.08530664443969727 length of segment : 344 time for calcul the mask position with numpy : 0.0008931159973144531 nb_pixel_total : 18830 time to create 1 rle with old method : 0.022196054458618164 length of segment : 246 time for calcul the mask position with numpy : 0.0033593177795410156 nb_pixel_total : 97938 time to create 1 rle with old method : 0.1098332405090332 length of segment : 481 time for calcul the mask position with numpy : 0.0017626285552978516 nb_pixel_total : 53536 time to create 1 rle with old method : 0.06721854209899902 length of segment : 296 time for calcul the mask position with numpy : 0.0058863162994384766 nb_pixel_total : 103908 time to create 1 rle with old method : 0.12992501258850098 length of segment : 449 time for calcul the mask position with numpy : 0.0022695064544677734 nb_pixel_total : 63980 time to create 1 rle with old method : 0.07239961624145508 length of segment : 454 time for calcul the mask position with numpy : 0.0011675357818603516 nb_pixel_total : 32364 time to create 1 rle with old method : 0.03742051124572754 length of segment : 221 time for calcul the mask position with numpy : 0.0006096363067626953 nb_pixel_total : 13229 time to create 1 rle with old method : 0.01563739776611328 length of segment : 131 time for calcul the mask position with numpy : 0.00040793418884277344 nb_pixel_total : 14454 time to create 1 rle with old method : 0.016810894012451172 length of segment : 145 time for calcul the mask position with numpy : 0.001512289047241211 nb_pixel_total : 43996 time to create 1 rle with old method : 0.05021810531616211 length of segment : 442 time for calcul the mask position with numpy : 0.0010242462158203125 nb_pixel_total : 35220 time to create 1 rle with old method : 0.04052233695983887 length of segment : 220 time for calcul the mask position with numpy : 0.0017256736755371094 nb_pixel_total : 38049 time to create 1 rle with old method : 0.044641733169555664 length of segment : 208 time for calcul the mask position with numpy : 0.003084421157836914 nb_pixel_total : 96408 time to create 1 rle with old method : 0.11653828620910645 length of segment : 475 time for calcul the mask position with numpy : 0.0020940303802490234 nb_pixel_total : 65411 time to create 1 rle with old method : 0.07815098762512207 length of segment : 256 time for calcul the mask position with numpy : 0.00041985511779785156 nb_pixel_total : 9078 time to create 1 rle with old method : 0.010624885559082031 length of segment : 147 time for calcul the mask position with numpy : 0.0043163299560546875 nb_pixel_total : 153199 time to create 1 rle with new method : 0.009871959686279297 length of segment : 439 time for calcul the mask position with numpy : 0.0016431808471679688 nb_pixel_total : 49185 time to create 1 rle with old method : 0.05654454231262207 length of segment : 281 time for calcul the mask position with numpy : 0.0015683174133300781 nb_pixel_total : 48650 time to create 1 rle with old method : 0.05753922462463379 length of segment : 317 time for calcul the mask position with numpy : 0.0027191638946533203 nb_pixel_total : 154690 time to create 1 rle with new method : 0.007955074310302734 length of segment : 430 time for calcul the mask position with numpy : 0.0009016990661621094 nb_pixel_total : 23332 time to create 1 rle with old method : 0.027140140533447266 length of segment : 216 time for calcul the mask position with numpy : 0.0006682872772216797 nb_pixel_total : 17715 time to create 1 rle with old method : 0.02073526382446289 length of segment : 134 time for calcul the mask position with numpy : 0.0019428730010986328 nb_pixel_total : 64965 time to create 1 rle with old method : 0.08145785331726074 length of segment : 592 time for calcul the mask position with numpy : 0.002400636672973633 nb_pixel_total : 60803 time to create 1 rle with old method : 0.06891059875488281 length of segment : 394 time for calcul the mask position with numpy : 0.002877473831176758 nb_pixel_total : 59065 time to create 1 rle with old method : 0.06563735008239746 length of segment : 334 time for calcul the mask position with numpy : 0.0009365081787109375 nb_pixel_total : 18024 time to create 1 rle with old method : 0.02149224281311035 length of segment : 97 time for calcul the mask position with numpy : 0.00041294097900390625 nb_pixel_total : 7453 time to create 1 rle with old method : 0.008891105651855469 length of segment : 125 time for calcul the mask position with numpy : 0.0004901885986328125 nb_pixel_total : 16228 time to create 1 rle with old method : 0.019021987915039062 length of segment : 99 time for calcul the mask position with numpy : 0.007883548736572266 nb_pixel_total : 166162 time to create 1 rle with new method : 0.014585018157958984 length of segment : 536 time for calcul the mask position with numpy : 0.04553937911987305 nb_pixel_total : 381736 time to create 1 rle with new method : 0.05116605758666992 length of segment : 940 time for calcul the mask position with numpy : 0.00043129920959472656 nb_pixel_total : 11137 time to create 1 rle with old method : 0.017446517944335938 length of segment : 242 time for calcul the mask position with numpy : 0.003060579299926758 nb_pixel_total : 55291 time to create 1 rle with old method : 0.08411192893981934 length of segment : 443 time for calcul the mask position with numpy : 0.0007677078247070312 nb_pixel_total : 17349 time to create 1 rle with old method : 0.020223140716552734 length of segment : 172 time for calcul the mask position with numpy : 0.0011594295501708984 nb_pixel_total : 28449 time to create 1 rle with old method : 0.03240084648132324 length of segment : 249 time for calcul the mask position with numpy : 0.002179861068725586 nb_pixel_total : 45610 time to create 1 rle with old method : 0.054262399673461914 length of segment : 314 time for calcul the mask position with numpy : 0.002357959747314453 nb_pixel_total : 53720 time to create 1 rle with old method : 0.061028480529785156 length of segment : 366 time for calcul the mask position with numpy : 0.0013592243194580078 nb_pixel_total : 26569 time to create 1 rle with old method : 0.031180858612060547 length of segment : 152 time for calcul the mask position with numpy : 0.0015327930450439453 nb_pixel_total : 45460 time to create 1 rle with old method : 0.052617788314819336 length of segment : 187 time for calcul the mask position with numpy : 0.0010576248168945312 nb_pixel_total : 33359 time to create 1 rle with old method : 0.03764796257019043 length of segment : 401 time for calcul the mask position with numpy : 0.0011129379272460938 nb_pixel_total : 48446 time to create 1 rle with old method : 0.0561068058013916 length of segment : 184 time for calcul the mask position with numpy : 0.003114461898803711 nb_pixel_total : 80333 time to create 1 rle with old method : 0.09205079078674316 length of segment : 333 time for calcul the mask position with numpy : 0.0007426738739013672 nb_pixel_total : 10382 time to create 1 rle with old method : 0.012024402618408203 length of segment : 172 time for calcul the mask position with numpy : 0.000985860824584961 nb_pixel_total : 42230 time to create 1 rle with old method : 0.04851698875427246 length of segment : 334 time for calcul the mask position with numpy : 0.0034341812133789062 nb_pixel_total : 48281 time to create 1 rle with old method : 0.055055856704711914 length of segment : 427 time for calcul the mask position with numpy : 0.0016143321990966797 nb_pixel_total : 36202 time to create 1 rle with old method : 0.04177975654602051 length of segment : 185 time for calcul the mask position with numpy : 0.0008249282836914062 nb_pixel_total : 17092 time to create 1 rle with old method : 0.02157115936279297 length of segment : 119 time for calcul the mask position with numpy : 0.0008420944213867188 nb_pixel_total : 14537 time to create 1 rle with old method : 0.01734471321105957 length of segment : 179 time for calcul the mask position with numpy : 0.0006289482116699219 nb_pixel_total : 6478 time to create 1 rle with old method : 0.008499622344970703 length of segment : 150 time for calcul the mask position with numpy : 0.0038900375366210938 nb_pixel_total : 83234 time to create 1 rle with old method : 0.09683871269226074 length of segment : 328 time for calcul the mask position with numpy : 0.0033326148986816406 nb_pixel_total : 59643 time to create 1 rle with old method : 0.06668519973754883 length of segment : 357 time for calcul the mask position with numpy : 0.0014257431030273438 nb_pixel_total : 27982 time to create 1 rle with old method : 0.03271818161010742 length of segment : 153 time for calcul the mask position with numpy : 0.0007555484771728516 nb_pixel_total : 18116 time to create 1 rle with old method : 0.02120184898376465 length of segment : 169 time for calcul the mask position with numpy : 0.0007789134979248047 nb_pixel_total : 15946 time to create 1 rle with old method : 0.019331932067871094 length of segment : 83 time for calcul the mask position with numpy : 0.00037860870361328125 nb_pixel_total : 6507 time to create 1 rle with old method : 0.007547855377197266 length of segment : 137 time for calcul the mask position with numpy : 0.00036072731018066406 nb_pixel_total : 11440 time to create 1 rle with old method : 0.013137578964233398 length of segment : 178 time for calcul the mask position with numpy : 0.015865564346313477 nb_pixel_total : 350312 time to create 1 rle with new method : 0.039792776107788086 length of segment : 766 time for calcul the mask position with numpy : 0.004229307174682617 nb_pixel_total : 77096 time to create 1 rle with old method : 0.10799431800842285 length of segment : 498 time for calcul the mask position with numpy : 0.012897968292236328 nb_pixel_total : 284193 time to create 1 rle with new method : 0.03771710395812988 length of segment : 781 time for calcul the mask position with numpy : 0.0004801750183105469 nb_pixel_total : 17878 time to create 1 rle with old method : 0.020539045333862305 length of segment : 198 time for calcul the mask position with numpy : 0.0008146762847900391 nb_pixel_total : 15494 time to create 1 rle with old method : 0.01812577247619629 length of segment : 119 time for calcul the mask position with numpy : 0.002717733383178711 nb_pixel_total : 58700 time to create 1 rle with old method : 0.0662240982055664 length of segment : 429 time for calcul the mask position with numpy : 0.0017142295837402344 nb_pixel_total : 42366 time to create 1 rle with old method : 0.04806804656982422 length of segment : 337 time for calcul the mask position with numpy : 0.0021812915802001953 nb_pixel_total : 40386 time to create 1 rle with old method : 0.04637861251831055 length of segment : 214 time for calcul the mask position with numpy : 0.004717826843261719 nb_pixel_total : 65420 time to create 1 rle with old method : 0.074493408203125 length of segment : 387 time for calcul the mask position with numpy : 0.0003809928894042969 nb_pixel_total : 10348 time to create 1 rle with old method : 0.012132883071899414 length of segment : 171 time for calcul the mask position with numpy : 0.001405477523803711 nb_pixel_total : 39890 time to create 1 rle with old method : 0.046746015548706055 length of segment : 194 time for calcul the mask position with numpy : 0.0022788047790527344 nb_pixel_total : 32645 time to create 1 rle with old method : 0.03734421730041504 length of segment : 293 time for calcul the mask position with numpy : 0.0010399818420410156 nb_pixel_total : 16663 time to create 1 rle with old method : 0.019748687744140625 length of segment : 136 time for calcul the mask position with numpy : 0.000637054443359375 nb_pixel_total : 16157 time to create 1 rle with old method : 0.019298791885375977 length of segment : 94 time for calcul the mask position with numpy : 0.0016815662384033203 nb_pixel_total : 33283 time to create 1 rle with old method : 0.03811168670654297 length of segment : 213 time for calcul the mask position with numpy : 0.0005762577056884766 nb_pixel_total : 23535 time to create 1 rle with old method : 0.03189730644226074 length of segment : 201 time spent for convertir_results : 9.654464483261108 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 98 chid ids of type : 3594 Number RLEs to save : 29698 save missing photos in datou_result : time spend for datou_step_exec : 66.09662938117981 time spend to save output : 2.1770052909851074 total time spend for step 1 : 68.27363467216492 step2:crop_condition Thu Jul 24 10:21:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 98 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 77 About to insert : list_path_to_insert length 77 new photo from crops ! About to upload 77 photos upload in portfolio : 3736932 init cache_photo without model_param we have 77 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753345321_1035281 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 77 photos in the portfolio 3736932 time of upload the photos Elapsed time : 20.530033826828003 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 3736932 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753345344_1035281 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 11 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.7891459465026855 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753345350_1035281 This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6516604423522949 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3736932 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753345353_1035281 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 8 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.1928389072418213 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753345357_1035281 This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6873288154602051 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1373490079, 1373490076, 1373490073, 1373489832, 1373489800] Looping around the photos to save general results len do output : 98 /1373502809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373490079', None, None, None, None, None, '3337310') ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373490076', None, None, None, None, None, '3337310') ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373490073', None, None, None, None, None, '3337310') ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373489832', None, None, None, None, None, '3337310') ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373489800', None, None, None, None, None, '3337310') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 299 time used for this insertion : 0.29422760009765625 save_final save missing photos in datou_result : time spend for datou_step_exec : 60.45126128196716 time spend to save output : 0.29811954498291016 total time spend for step 2 : 60.74938082695007 step3:rle_unique_nms_with_priority Thu Jul 24 10:22:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 98 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 18 nb_hashtags : 4 time to prepare the origin masks : 10.731113195419312 time for calcul the mask position with numpy : 0.6110637187957764 nb_pixel_total : 7270148 time to create 1 rle with new method : 1.0152170658111572 time for calcul the mask position with numpy : 0.026351213455200195 nb_pixel_total : 50054 time to create 1 rle with old method : 0.05620980262756348 time for calcul the mask position with numpy : 0.04142570495605469 nb_pixel_total : 11242 time to create 1 rle with old method : 0.01288461685180664 time for calcul the mask position with numpy : 0.0405426025390625 nb_pixel_total : 13745 time to create 1 rle with old method : 0.01546168327331543 time for calcul the mask position with numpy : 0.04078793525695801 nb_pixel_total : 17975 time to create 1 rle with old method : 0.020238161087036133 time for calcul the mask position with numpy : 0.028442859649658203 nb_pixel_total : 74877 time to create 1 rle with old method : 0.08324170112609863 time for calcul the mask position with numpy : 0.026308298110961914 nb_pixel_total : 59233 time to create 1 rle with old method : 0.06599044799804688 time for calcul the mask position with numpy : 0.02530217170715332 nb_pixel_total : 13264 time to create 1 rle with old method : 0.014833927154541016 time for calcul the mask position with numpy : 0.02583909034729004 nb_pixel_total : 60817 time to create 1 rle with old method : 0.06821489334106445 time for calcul the mask position with numpy : 0.026062965393066406 nb_pixel_total : 113716 time to create 1 rle with old method : 0.12701010704040527 time for calcul the mask position with numpy : 0.024486780166625977 nb_pixel_total : 68605 time to create 1 rle with old method : 0.07708334922790527 time for calcul the mask position with numpy : 0.02568960189819336 nb_pixel_total : 65803 time to create 1 rle with old method : 0.07347416877746582 time for calcul the mask position with numpy : 0.024916887283325195 nb_pixel_total : 37087 time to create 1 rle with old method : 0.04294586181640625 time for calcul the mask position with numpy : 0.02725815773010254 nb_pixel_total : 52319 time to create 1 rle with old method : 0.07223033905029297 time for calcul the mask position with numpy : 0.02710103988647461 nb_pixel_total : 248400 time to create 1 rle with new method : 1.2287967205047607 time for calcul the mask position with numpy : 0.025218486785888672 nb_pixel_total : 70142 time to create 1 rle with old method : 0.0791482925415039 time for calcul the mask position with numpy : 0.026190519332885742 nb_pixel_total : 26811 time to create 1 rle with old method : 0.030081987380981445 time for calcul the mask position with numpy : 0.026311874389648438 nb_pixel_total : 24771 time to create 1 rle with old method : 0.02757120132446289 time for calcul the mask position with numpy : 0.026265859603881836 nb_pixel_total : 15391 time to create 1 rle with old method : 0.01728653907775879 create new chi : 4.317683696746826 time to delete rle : 0.022392749786376953 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++++++++++++++Number RLEs to save : 15025 TO DO : save crop sub photo not yet done ! save time : 1.2082960605621338 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 13.049916744232178 time for calcul the mask position with numpy : 1.2179450988769531 nb_pixel_total : 7805065 time to create 1 rle with new method : 1.1393730640411377 time for calcul the mask position with numpy : 0.03457784652709961 nb_pixel_total : 18830 time to create 1 rle with old method : 0.019774913787841797 time for calcul the mask position with numpy : 0.026660442352294922 nb_pixel_total : 74875 time to create 1 rle with old method : 0.08169865608215332 time for calcul the mask position with numpy : 0.02385401725769043 nb_pixel_total : 25683 time to create 1 rle with old method : 0.0272216796875 time for calcul the mask position with numpy : 0.02354884147644043 nb_pixel_total : 34654 time to create 1 rle with old method : 0.03691530227661133 time for calcul the mask position with numpy : 0.02435302734375 nb_pixel_total : 15338 time to create 1 rle with old method : 0.016925334930419922 time for calcul the mask position with numpy : 0.024979591369628906 nb_pixel_total : 107989 time to create 1 rle with old method : 0.11291742324829102 time for calcul the mask position with numpy : 0.025340557098388672 nb_pixel_total : 24076 time to create 1 rle with old method : 0.025307655334472656 time for calcul the mask position with numpy : 0.02532482147216797 nb_pixel_total : 21263 time to create 1 rle with old method : 0.022860288619995117 time for calcul the mask position with numpy : 0.02434706687927246 nb_pixel_total : 5978 time to create 1 rle with old method : 0.006606101989746094 time for calcul the mask position with numpy : 0.02579498291015625 nb_pixel_total : 105261 time to create 1 rle with old method : 0.12254714965820312 time for calcul the mask position with numpy : 0.02896881103515625 nb_pixel_total : 26836 time to create 1 rle with old method : 0.03437924385070801 time for calcul the mask position with numpy : 0.03314542770385742 nb_pixel_total : 28552 time to create 1 rle with old method : 0.03180265426635742 create new chi : 3.259840250015259 time to delete rle : 0.00110626220703125 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 8454 TO DO : save crop sub photo not yet done ! save time : 0.6901659965515137 nb_obj : 21 nb_hashtags : 4 time to prepare the origin masks : 14.041614294052124 time for calcul the mask position with numpy : 0.6724286079406738 nb_pixel_total : 7202187 time to create 1 rle with new method : 1.030480146408081 time for calcul the mask position with numpy : 0.027060747146606445 nb_pixel_total : 60803 time to create 1 rle with old method : 0.06869745254516602 time for calcul the mask position with numpy : 0.027459383010864258 nb_pixel_total : 64965 time to create 1 rle with old method : 0.10192561149597168 time for calcul the mask position with numpy : 0.026281356811523438 nb_pixel_total : 17715 time to create 1 rle with old method : 0.02011418342590332 time for calcul the mask position with numpy : 0.024819135665893555 nb_pixel_total : 23332 time to create 1 rle with old method : 0.025954008102416992 time for calcul the mask position with numpy : 0.025637388229370117 nb_pixel_total : 6793 time to create 1 rle with old method : 0.008254289627075195 time for calcul the mask position with numpy : 0.028176307678222656 nb_pixel_total : 48650 time to create 1 rle with old method : 0.05488729476928711 time for calcul the mask position with numpy : 0.02903461456298828 nb_pixel_total : 49185 time to create 1 rle with old method : 0.05435299873352051 time for calcul the mask position with numpy : 0.026285409927368164 nb_pixel_total : 153199 time to create 1 rle with new method : 1.017514705657959 time for calcul the mask position with numpy : 0.025920629501342773 nb_pixel_total : 9078 time to create 1 rle with old method : 0.010215044021606445 time for calcul the mask position with numpy : 0.026297330856323242 nb_pixel_total : 65411 time to create 1 rle with old method : 0.07617545127868652 time for calcul the mask position with numpy : 0.02890753746032715 nb_pixel_total : 96408 time to create 1 rle with old method : 0.10690069198608398 time for calcul the mask position with numpy : 0.025519132614135742 nb_pixel_total : 38049 time to create 1 rle with old method : 0.04246211051940918 time for calcul the mask position with numpy : 0.026308536529541016 nb_pixel_total : 35220 time to create 1 rle with old method : 0.041765689849853516 time for calcul the mask position with numpy : 0.026177406311035156 nb_pixel_total : 43996 time to create 1 rle with old method : 0.049417972564697266 time for calcul the mask position with numpy : 0.02480626106262207 nb_pixel_total : 14454 time to create 1 rle with old method : 0.016025781631469727 time for calcul the mask position with numpy : 0.025970935821533203 nb_pixel_total : 13229 time to create 1 rle with old method : 0.014771223068237305 time for calcul the mask position with numpy : 0.02951979637145996 nb_pixel_total : 32364 time to create 1 rle with old method : 0.035933732986450195 time for calcul the mask position with numpy : 0.02577066421508789 nb_pixel_total : 63980 time to create 1 rle with old method : 0.06985211372375488 time for calcul the mask position with numpy : 0.026087284088134766 nb_pixel_total : 103908 time to create 1 rle with old method : 0.11376118659973145 time for calcul the mask position with numpy : 0.025144338607788086 nb_pixel_total : 53536 time to create 1 rle with old method : 0.059215545654296875 time for calcul the mask position with numpy : 0.026228904724121094 nb_pixel_total : 97938 time to create 1 rle with old method : 0.10709309577941895 create new chi : 4.431084156036377 time to delete rle : 0.0019240379333496094 batch 1 Loaded 43 chid ids of type : 3594 +++++++++++++++++++++++++++++Number RLEs to save : 15147 TO DO : save crop sub photo not yet done ! save time : 1.190354347229004 nb_obj : 23 nb_hashtags : 3 time to prepare the origin masks : 13.882310390472412 time for calcul the mask position with numpy : 0.7521364688873291 nb_pixel_total : 7072272 time to create 1 rle with new method : 0.7938342094421387 time for calcul the mask position with numpy : 0.03860306739807129 nb_pixel_total : 6478 time to create 1 rle with old method : 0.007277011871337891 time for calcul the mask position with numpy : 0.04106402397155762 nb_pixel_total : 14537 time to create 1 rle with old method : 0.023702144622802734 time for calcul the mask position with numpy : 0.04553651809692383 nb_pixel_total : 17092 time to create 1 rle with old method : 0.02037501335144043 time for calcul the mask position with numpy : 0.04045701026916504 nb_pixel_total : 36202 time to create 1 rle with old method : 0.04062366485595703 time for calcul the mask position with numpy : 0.041023969650268555 nb_pixel_total : 48281 time to create 1 rle with old method : 0.05430793762207031 time for calcul the mask position with numpy : 0.04082322120666504 nb_pixel_total : 29417 time to create 1 rle with old method : 0.03599071502685547 time for calcul the mask position with numpy : 0.04073691368103027 nb_pixel_total : 10382 time to create 1 rle with old method : 0.011513948440551758 time for calcul the mask position with numpy : 0.04097890853881836 nb_pixel_total : 80333 time to create 1 rle with old method : 0.08734464645385742 time for calcul the mask position with numpy : 0.042421817779541016 nb_pixel_total : 48446 time to create 1 rle with old method : 0.05434441566467285 time for calcul the mask position with numpy : 0.044060468673706055 nb_pixel_total : 45460 time to create 1 rle with old method : 0.05024909973144531 time for calcul the mask position with numpy : 0.03967761993408203 nb_pixel_total : 26569 time to create 1 rle with old method : 0.029700040817260742 time for calcul the mask position with numpy : 0.04091048240661621 nb_pixel_total : 53720 time to create 1 rle with old method : 0.05935955047607422 time for calcul the mask position with numpy : 0.03948259353637695 nb_pixel_total : 45610 time to create 1 rle with old method : 0.049497127532958984 time for calcul the mask position with numpy : 0.03466010093688965 nb_pixel_total : 28449 time to create 1 rle with old method : 0.03112649917602539 time for calcul the mask position with numpy : 0.04184532165527344 nb_pixel_total : 17349 time to create 1 rle with old method : 0.019210100173950195 time for calcul the mask position with numpy : 0.04420876502990723 nb_pixel_total : 55291 time to create 1 rle with old method : 0.06032752990722656 time for calcul the mask position with numpy : 0.042101144790649414 nb_pixel_total : 9844 time to create 1 rle with old method : 0.01115727424621582 time for calcul the mask position with numpy : 0.057093143463134766 nb_pixel_total : 381736 time to create 1 rle with new method : 0.7880077362060547 time for calcul the mask position with numpy : 0.04116535186767578 nb_pixel_total : 166162 time to create 1 rle with new method : 0.9214725494384766 time for calcul the mask position with numpy : 0.03928637504577637 nb_pixel_total : 16228 time to create 1 rle with old method : 0.01833200454711914 time for calcul the mask position with numpy : 0.03692626953125 nb_pixel_total : 7453 time to create 1 rle with old method : 0.008521795272827148 time for calcul the mask position with numpy : 0.04041457176208496 nb_pixel_total : 18024 time to create 1 rle with old method : 0.020371675491333008 time for calcul the mask position with numpy : 0.03663349151611328 nb_pixel_total : 59065 time to create 1 rle with old method : 0.06449365615844727 create new chi : 5.058027982711792 time to delete rle : 0.0019850730895996094 batch 1 Loaded 48 chid ids of type : 3594 +++++++++++++++++++++++++++++++++Number RLEs to save : 14363 TO DO : save crop sub photo not yet done ! save time : 1.1966702938079834 nb_obj : 21 nb_hashtags : 3 time to prepare the origin masks : 18.293564796447754 time for calcul the mask position with numpy : 0.719104528427124 nb_pixel_total : 6988600 time to create 1 rle with new method : 1.0679912567138672 time for calcul the mask position with numpy : 0.052683353424072266 nb_pixel_total : 33283 time to create 1 rle with old method : 0.040018558502197266 time for calcul the mask position with numpy : 0.04584479331970215 nb_pixel_total : 16157 time to create 1 rle with old method : 0.018456697463989258 time for calcul the mask position with numpy : 0.04073762893676758 nb_pixel_total : 16663 time to create 1 rle with old method : 0.018440961837768555 time for calcul the mask position with numpy : 0.03311347961425781 nb_pixel_total : 32645 time to create 1 rle with old method : 0.03514266014099121 time for calcul the mask position with numpy : 0.025649070739746094 nb_pixel_total : 39890 time to create 1 rle with old method : 0.044466495513916016 time for calcul the mask position with numpy : 0.025908946990966797 nb_pixel_total : 10348 time to create 1 rle with old method : 0.011640548706054688 time for calcul the mask position with numpy : 0.0300900936126709 nb_pixel_total : 65420 time to create 1 rle with old method : 0.08218908309936523 time for calcul the mask position with numpy : 0.025280475616455078 nb_pixel_total : 40386 time to create 1 rle with old method : 0.04494476318359375 time for calcul the mask position with numpy : 0.0271148681640625 nb_pixel_total : 42366 time to create 1 rle with old method : 0.0462338924407959 time for calcul the mask position with numpy : 0.025992155075073242 nb_pixel_total : 58700 time to create 1 rle with old method : 0.06357145309448242 time for calcul the mask position with numpy : 0.024460554122924805 nb_pixel_total : 15494 time to create 1 rle with old method : 0.017379283905029297 time for calcul the mask position with numpy : 0.028140544891357422 nb_pixel_total : 284193 time to create 1 rle with new method : 0.6740920543670654 time for calcul the mask position with numpy : 0.026294231414794922 nb_pixel_total : 77096 time to create 1 rle with old method : 0.08434820175170898 time for calcul the mask position with numpy : 0.0302121639251709 nb_pixel_total : 350312 time to create 1 rle with new method : 0.7538073062896729 time for calcul the mask position with numpy : 0.024303913116455078 nb_pixel_total : 11419 time to create 1 rle with old method : 0.012758731842041016 time for calcul the mask position with numpy : 0.024739503860473633 nb_pixel_total : 6507 time to create 1 rle with old method : 0.0073359012603759766 time for calcul the mask position with numpy : 0.02527022361755371 nb_pixel_total : 15946 time to create 1 rle with old method : 0.017749309539794922 time for calcul the mask position with numpy : 0.02468562126159668 nb_pixel_total : 18116 time to create 1 rle with old method : 0.019994258880615234 time for calcul the mask position with numpy : 0.02544116973876953 nb_pixel_total : 27982 time to create 1 rle with old method : 0.031108379364013672 time for calcul the mask position with numpy : 0.02608966827392578 nb_pixel_total : 59643 time to create 1 rle with old method : 0.06545805931091309 time for calcul the mask position with numpy : 0.027838945388793945 nb_pixel_total : 83234 time to create 1 rle with old method : 0.08979344367980957 create new chi : 4.696774244308472 time to delete rle : 0.0018749237060546875 batch 1 Loaded 45 chid ids of type : 3594 ++++++++++++++++++++++++++++Number RLEs to save : 14209 TO DO : save crop sub photo not yet done ! save time : 1.0665605068206787 map_output_result : {1373490079: (0.0, 'Should be the crop_list due to order', 0), 1373490076: (0.0, 'Should be the crop_list due to order', 0), 1373490073: (0.0, 'Should be the crop_list due to order', 0), 1373489832: (0.0, 'Should be the crop_list due to order', 0), 1373489800: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1373490079, 1373490076, 1373490073, 1373489832, 1373489800] Looping around the photos to save general results len do output : 5 /1373490079.Didn't retrieve data . /1373490076.Didn't retrieve data . /1373490073.Didn't retrieve data . /1373489832.Didn't retrieve data . /1373489800.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373490079', None, None, None, None, None, '3337310') ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373490076', None, None, None, None, None, '3337310') ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373490073', None, None, None, None, None, '3337310') ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373489832', None, None, None, None, None, '3337310') ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373489800', None, None, None, None, None, '3337310') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.03625154495239258 save_final save missing photos in datou_result : time spend for datou_step_exec : 98.10445880889893 time spend to save output : 0.03662753105163574 total time spend for step 3 : 98.14108633995056 step4:ventilate_hashtags_in_portfolio Thu Jul 24 10:24:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25266815 get user id for portfolio 25266815 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25266815 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','carton','papier','pet_clair','mal_croppe','pehd','autre','environnement','background','metal','flou')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25266815 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','carton','papier','pet_clair','mal_croppe','pehd','autre','environnement','background','metal','flou')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25266815 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','carton','papier','pet_clair','mal_croppe','pehd','autre','environnement','background','metal','flou')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/25267789,25267790,25267791,25267793,25267794,25267795,25267797,25267798,25267799,25267800,25267801?tags=pet_fonce,carton,papier,pet_clair,mal_croppe,pehd,autre,environnement,background,metal,flou Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1373490079, 1373490076, 1373490073, 1373489832, 1373489800] Looping around the photos to save general results len do output : 1 /25266815. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373490079', None, None, None, None, None, '3337310') ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373490076', None, None, None, None, None, '3337310') ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373490073', None, None, None, None, None, '3337310') ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373489832', None, None, None, None, None, '3337310') ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373489800', None, None, None, None, None, '3337310') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.013054370880126953 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.1251626014709473 time spend to save output : 0.013279438018798828 total time spend for step 4 : 1.138442039489746 step5:final Thu Jul 24 10:24:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1373490079: ('0.12378780864197533',), 1373490076: ('0.12378780864197533',), 1373490073: ('0.12378780864197533',), 1373489832: ('0.12378780864197533',), 1373489800: ('0.12378780864197533',)} new output for save of step final : {1373490079: ('0.12378780864197533',), 1373490076: ('0.12378780864197533',), 1373490073: ('0.12378780864197533',), 1373489832: ('0.12378780864197533',), 1373489800: ('0.12378780864197533',)} [1373490079, 1373490076, 1373490073, 1373489832, 1373489800] Looping around the photos to save general results len do output : 5 /1373490079.Didn't retrieve data . /1373490076.Didn't retrieve data . /1373490073.Didn't retrieve data . /1373489832.Didn't retrieve data . /1373489800.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373490079', None, None, None, None, None, '3337310') ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373490076', None, None, None, None, None, '3337310') ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373490073', None, None, None, None, None, '3337310') ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373489832', None, None, None, None, None, '3337310') ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373489800', None, None, None, None, None, '3337310') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.05631732940673828 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.17551851272583008 time spend to save output : 0.05669593811035156 total time spend for step 5 : 0.23221445083618164 step6:blur_detection Thu Jul 24 10:24:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e.jpg resize: (2160, 3840) 1373490079 -7.715513356580853 treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21.jpg resize: (2160, 3840) 1373490076 -7.572600317586445 treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e.jpg resize: (2160, 3840) 1373490073 -6.985213184887491 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7.jpg resize: (2160, 3840) 1373489832 -7.751690388218032 treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283.jpg resize: (2160, 3840) 1373489800 -7.76056266874786 treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387853_0.png resize: (413, 100) 1373502809 -3.1993920461274974 treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387866_0.png resize: (331, 395) 1373502810 -4.513248949217818 treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387856_0.png resize: (499, 774) 1373502811 -5.437421867673618 treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387868_0.png resize: (184, 93) 1373502812 -4.129519597305379 treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387859_0.png resize: (326, 313) 1373502813 -4.378815246737917 treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387864_0.png resize: (420, 325) 1373502814 -2.5311882417147604 treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387854_0.png resize: (254, 148) 1373502815 -4.914804780778881 treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387861_0.png resize: (534, 301) 1373502816 -4.798576741062553 treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387857_0.png resize: (312, 287) 1373502817 -4.256346193936897 treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387862_0.png resize: (296, 340) 1373502818 -4.910796667802341 treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387867_0.png resize: (204, 93) 1373502819 -4.291203477885663 treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387852_0.png resize: (135, 210) 1373502820 -2.96777100030326 treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387860_0.png resize: (330, 368) 1373502821 -5.193201915778589 treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387863_0.png resize: (191, 120) 1373502822 -3.5608853263006734 treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21_rle_crop_3892387875_0.png resize: (242, 126) 1373502823 -4.818727825358977 treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21_rle_crop_3892387879_0.png resize: (243, 183) 1373502824 -4.137586409046242 treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21_rle_crop_3892387881_0.png resize: (246, 194) 1373502825 -4.271885364150647 treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21_rle_crop_3892387880_0.png resize: (294, 348) 1373502826 -4.8395492451716535 treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21_rle_crop_3892387876_0.png resize: (499, 479) 1373502827 -2.1193107731721432 treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21_rle_crop_3892387872_0.png resize: (279, 448) 1373502828 2.404850230590917 treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21_rle_crop_3892387870_0.png resize: (195, 214) 1373502829 -3.1488785928499934 treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387894_0.png resize: (147, 86) 1373502830 -4.37394484126259 treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387886_0.png resize: (221, 250) 1373502831 -4.802188694304623 treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387899_0.png resize: (183, 176) 1373502832 -4.956539841271083 treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387897_0.png resize: (308, 234) 1373502833 -2.4279627203166516 treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387887_0.png resize: (131, 153) 1373502834 -3.127398232946495 treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387889_0.png resize: (295, 274) 1373502836 -4.58621628620181 treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387888_0.png resize: (145, 128) 1373502837 -4.802773860516821 treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387901_0.png resize: (386, 326) 1373502838 -3.9030428209232593 treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387884_0.png resize: (449, 513) 1373502839 -3.6751754442382647 treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387892_0.png resize: (362, 431) 1373502840 -5.229876472664537 treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387896_0.png resize: (279, 251) 1373502841 -4.002310683900583 treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387885_0.png resize: (359, 337) 1373502842 -4.277002883097491 treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387898_0.png resize: (423, 493) 1373502843 -4.6912023578634825 treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387893_0.png resize: (213, 444) 1373502844 -4.562988776951378 treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387882_0.png resize: (459, 337) 1373502846 -4.692880478005004 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387908_0.png resize: (727, 748) 1373502847 -6.145009611656101 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387903_0.png resize: (334, 312) 1373502848 -1.9825278183311477 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387917_0.png resize: (400, 153) 1373502849 -4.747428150959807 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387907_0.png resize: (532, 627) 1373502850 -3.342428610218701 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387918_0.png resize: (177, 344) 1373502851 -3.505047420174601 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387912_0.png resize: (238, 159) 1373502852 -3.487160904634473 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387923_0.png resize: (172, 333) 1373502853 -1.1377173232686997 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387914_0.png resize: (350, 279) 1373502854 0.3931780151798578 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387922_0.png resize: (315, 318) 1373502855 -3.647706425808579 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387919_0.png resize: (329, 390) 1373502856 -2.5678420116006255 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387911_0.png resize: (145, 152) 1373502857 -3.07794536458091 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387920_0.png resize: (172, 103) 1373502858 -3.3135909338687584 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387910_0.png resize: (316, 298) 1373502859 -4.54716152168585 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387904_0.png resize: (76, 332) 1373502860 -1.1448800077095682 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387916_0.png resize: (186, 300) 1373502861 -2.181858901479232 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387909_0.png resize: (134, 113) 1373502862 -1.1038149724480582 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387905_0.png resize: (125, 71) 1373502863 -4.238964208123308 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387913_0.png resize: (310, 185) 1373502864 -4.249741436668153 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387925_0.png resize: (179, 116) 1373502865 -3.5668433066844476 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387926_0.png resize: (149, 59) 1373502866 -4.361805386709642 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387915_0.png resize: (152, 285) 1373502867 -3.1628839323815274 treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387934_0.png resize: (632, 701) 1373502868 -6.373029805096709 treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387928_0.png resize: (324, 321) 1373502869 -3.3163659533938707 treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387949_0.png resize: (177, 269) 1373502870 -4.018551478215144 treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387948_0.png resize: (210, 244) 1373502871 -4.464661461383238 treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387937_0.png resize: (196, 130) 1373502872 -4.021519539456267 treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387936_0.png resize: (781, 633) 1373502873 -3.906214946447861 treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387945_0.png resize: (248, 237) 1373502874 -4.374076657466378 treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387935_0.png resize: (365, 423) 1373502875 -1.6973258706516425 treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387942_0.png resize: (339, 369) 1373502876 -3.683305051315761 treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387927_0.png resize: (326, 396) 1373502877 -3.101270069841059 treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387930_0.png resize: (149, 158) 1373502878 -3.014522162002998 treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387943_0.png resize: (171, 108) 1373502879 -3.2371053748633263 treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387939_0.png resize: (384, 263) 1373502880 -4.353970360357756 treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387931_0.png resize: (74, 309) 1373502881 -1.244216931764175 treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387944_0.png resize: (183, 252) 1373502882 -2.1012974486329963 treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387933_0.png resize: (135, 100) 1373502883 2.1597875216033056 treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387932_0.png resize: (137, 57) 1373502884 -3.7808097414652018 treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387941_0.png resize: (214, 331) 1373502885 -0.04125238754755706 treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387940_0.png resize: (283, 177) 1373502886 -3.6094254752762955 treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387929_0.png resize: (150, 312) 1373502887 -1.5886409272033903 treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387858_0.png resize: (247, 243) 1373502891 -4.458533389249287 treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387869_0.png resize: (344, 236) 1373502892 -4.132433637475605 treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21_rle_crop_3892387871_0.png resize: (242, 152) 1373502893 -4.258667885799546 treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21_rle_crop_3892387878_0.png resize: (319, 166) 1373502895 -4.421312211212032 treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21_rle_crop_3892387874_0.png resize: (160, 201) 1373502897 -4.0490300665380685 treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387883_0.png resize: (296, 256) 1373502898 -5.331072780138046 treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387891_0.png resize: (199, 378) 1373502899 -3.564510362441826 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387906_0.png resize: (96, 221) 1373502900 -4.852313844258019 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387921_0.png resize: (193, 291) 1373502901 -4.586031867568183 treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387947_0.png resize: (87, 243) 1373502902 -4.750201154651346 treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387946_0.png resize: (133, 212) 1373502903 -3.11815589548932 treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387900_0.png resize: (134, 172) 1373502904 -4.882523272224072 treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387865_0.png resize: (307, 506) 1373502908 -4.616410231729425 treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21_rle_crop_3892387877_0.png resize: (141, 130) 1373502909 -4.367734353339074 treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21_rle_crop_3892387873_0.png resize: (91, 79) 1373502910 -4.013894848601671 treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387890_0.png resize: (216, 260) 1373502911 -5.280080364114147 treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387902_0.png resize: (328, 326) 1373502912 -4.1908700611075655 treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387895_0.png resize: (427, 471) 1373502913 -4.692042530231697 treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387924_0.png resize: (118, 171) 1373502914 -3.535925982848703 treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387938_0.png resize: (118, 163) 1373502915 -3.735583462322995 treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387855_0.png resize: (311, 284) 1373502918 -3.9397923980055563 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 103 time used for this insertion : 0.01806807518005371 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 103 time used for this insertion : 0.05422568321228027 save missing photos in datou_result : time spend for datou_step_exec : 26.056833267211914 time spend to save output : 0.07780241966247559 total time spend for step 6 : 26.13463568687439 step7:brightness Thu Jul 24 10:24:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e.jpg treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21.jpg treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e.jpg treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7.jpg treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283.jpg treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387853_0.png treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387866_0.png treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387856_0.png treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387868_0.png treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387859_0.png treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387864_0.png treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387854_0.png treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387861_0.png treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387857_0.png treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387862_0.png treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387867_0.png treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387852_0.png treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387860_0.png treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387863_0.png treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21_rle_crop_3892387875_0.png treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21_rle_crop_3892387879_0.png treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21_rle_crop_3892387881_0.png treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21_rle_crop_3892387880_0.png treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21_rle_crop_3892387876_0.png treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21_rle_crop_3892387872_0.png treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21_rle_crop_3892387870_0.png treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387894_0.png treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387886_0.png treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387899_0.png treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387897_0.png treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387887_0.png treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387889_0.png treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387888_0.png treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387901_0.png treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387884_0.png treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387892_0.png treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387896_0.png treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387885_0.png treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387898_0.png treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387893_0.png treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387882_0.png treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387908_0.png treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387903_0.png treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387917_0.png treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387907_0.png treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387918_0.png treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387912_0.png treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387923_0.png treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387914_0.png treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387922_0.png treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387919_0.png treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387911_0.png treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387920_0.png treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387910_0.png treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387904_0.png treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387916_0.png treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387909_0.png treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387905_0.png treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387913_0.png treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387925_0.png treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387926_0.png treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387915_0.png treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387934_0.png treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387928_0.png treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387949_0.png treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387948_0.png treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387937_0.png treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387936_0.png treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387945_0.png treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387935_0.png treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387942_0.png treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387927_0.png treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387930_0.png treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387943_0.png treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387939_0.png treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387931_0.png treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387944_0.png treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387933_0.png treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387932_0.png treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387941_0.png treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387940_0.png treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387929_0.png treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387858_0.png treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387869_0.png treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21_rle_crop_3892387871_0.png treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21_rle_crop_3892387878_0.png treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21_rle_crop_3892387874_0.png treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387883_0.png treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387891_0.png treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387906_0.png treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387921_0.png treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387947_0.png treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387946_0.png treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387900_0.png treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387865_0.png treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21_rle_crop_3892387877_0.png treat image : temp/1753345227_1035281_1373490076_4a3dd292e8713d998844041186567f21_rle_crop_3892387873_0.png treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387890_0.png treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387902_0.png treat image : temp/1753345227_1035281_1373490073_f3e2e6b4e3d2d0234a17408146ee396e_rle_crop_3892387895_0.png treat image : temp/1753345227_1035281_1373489832_05812cf73818019875ed8dc4f76d20c7_rle_crop_3892387924_0.png treat image : temp/1753345227_1035281_1373489800_73a2ddd14cdb1575578db599b23a9283_rle_crop_3892387938_0.png treat image : temp/1753345227_1035281_1373490079_c124ffe88c7a3f229ca0eb9672e8957e_rle_crop_3892387855_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 103 time used for this insertion : 0.019061803817749023 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 103 time used for this insertion : 0.03459501266479492 save missing photos in datou_result : time spend for datou_step_exec : 7.1879472732543945 time spend to save output : 0.058707237243652344 total time spend for step 7 : 7.246654510498047 step8:velours_tree Thu Jul 24 10:24:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.19281244277954102 time spend to save output : 4.673004150390625e-05 total time spend for step 8 : 0.19285917282104492 step9:send_mail_cod Thu Jul 24 10:24:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25266815_24-07-2025_10_24_51.pdf 25267789 imagette252677891753345491 25267790 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette252677901753345491 25267791 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette252677911753345492 25267793 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette252677931753345493 25267794 imagette252677941753345494 25267795 imagette252677951753345494 25267797 change filename to text .imagette252677971753345494 25267799 imagette252677991753345494 25267800 change filename to text .imagette252678001753345494 25267801 imagette252678011753345494 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25266815 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25267789,25267790,25267791,25267793,25267794,25267795,25267797,25267798,25267799,25267800,25267801?tags=pet_fonce,carton,papier,pet_clair,mal_croppe,pehd,autre,environnement,background,metal,flou args[1373490079] : ((1373490079, -7.715513356580853, 492609224), (1373490079, 0.8774912788945459, 2107752395), '0.12378780864197533') We are sending mail with results at report@fotonower.com args[1373490076] : ((1373490076, -7.572600317586445, 492609224), (1373490076, 0.8277400222617028, 2107752395), '0.12378780864197533') We are sending mail with results at report@fotonower.com args[1373490073] : ((1373490073, -6.985213184887491, 492609224), (1373490073, 0.20043674487641783, 2107752395), '0.12378780864197533') We are sending mail with results at report@fotonower.com args[1373489832] : ((1373489832, -7.751690388218032, 492609224), (1373489832, 1.4444251235599885, 2107752395), '0.12378780864197533') We are sending mail with results at report@fotonower.com args[1373489800] : ((1373489800, -7.76056266874786, 492609224), (1373489800, 1.4028141008900628, 2107752395), '0.12378780864197533') We are sending mail with results at report@fotonower.com refus_total : 0.12378780864197533 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=25266815 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25266815_24-07-2025_10_24_51.pdf results_Auto_P25266815_24-07-2025_10_24_51.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25266815_24-07-2025_10_24_51.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','25266815','results_Auto_P25266815_24-07-2025_10_24_51.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25266815_24-07-2025_10_24_51.pdf','pdf','','0.46','0.12378780864197533') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/25266815

https://www.fotonower.com/image?json=false&list_photos_id=1373490079
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373490076
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373490073
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373489832
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373489800
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 12.38%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/25267790?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/25267791?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/25267793?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/25267797?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/25267800?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25266815_24-07-2025_10_24_51.pdf.

Lien vers velours :https://www.fotonower.com/velours/25267789,25267790,25267791,25267793,25267794,25267795,25267797,25267798,25267799,25267800,25267801?tags=pet_fonce,carton,papier,pet_clair,mal_croppe,pehd,autre,environnement,background,metal,flou.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 24 Jul 2025 08:24:57 GMT Content-Length: 0 Connection: close X-Message-Id: 1hNOH9AQRtqMwoOybTgdWg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1373490079, 1373490076, 1373490073, 1373489832, 1373489800] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373490079', None, None, None, None, None, '3337310') ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373490076', None, None, None, None, None, '3337310') ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373490073', None, None, None, None, None, '3337310') ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373489832', None, None, None, None, None, '3337310') ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373489800', None, None, None, None, None, '3337310') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.012851715087890625 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.8490989208221436 time spend to save output : 0.013055801391601562 total time spend for step 9 : 5.862154722213745 step10:split_time_score Thu Jul 24 10:24:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('09', 5),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 24072025 25266815 Nombre de photos uploadées : 5 / 23040 (0%) 24072025 25266815 Nombre de photos taguées (types de déchets): 0 / 5 (0%) 24072025 25266815 Nombre de photos taguées (volume) : 0 / 5 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 6.67572021484375e-06 ????? elapsed_time : fill_and_build_computed_from_old_data 0.00033855438232421875 elapsed_time : insert_dashboard_record_day_entry 0.02870345115661621 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.03791742956327484 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25257554_24-07-2025_07_23_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25257554 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25257554 AND mptpi.`type`=3726 To do Qualite : 0.10505730774176954 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25259010_24-07-2025_07_44_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25259010 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25259010 AND mptpi.`type`=3594 To do Qualite : 0.043389295478997295 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25266810_24-07-2025_10_22_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25266810 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25266810 AND mptpi.`type`=3726 To do Qualite : 0.12378780864197533 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25266815_24-07-2025_10_24_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25266815 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25266815 AND mptpi.`type`=3594 To do Qualite : 0.12490388093171298 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25266836_24-07-2025_10_16_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25266836 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25266836 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'24072025': {'nb_upload': 5, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1373490079, 1373490076, 1373490073, 1373489832, 1373489800] Looping around the photos to save general results len do output : 1 /25266815Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373490079', None, None, None, None, None, '3337310') ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373490076', None, None, None, None, None, '3337310') ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373490073', None, None, None, None, None, '3337310') ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373489832', None, None, None, None, None, '3337310') ('3318', None, None, None, None, None, None, None, '3337310') ('3318', '25266815', '1373489800', None, None, None, None, None, '3337310') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.015796422958374023 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.5822036266326904 time spend to save output : 0.015998363494873047 total time spend for step 10 : 0.5982019901275635 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 5 set_done_treatment 99.92user 133.14system 4:33.16elapsed 85%CPU (0avgtext+0avgdata 4483656maxresident)k 700208inputs+94488outputs (5712major+9966275minor)pagefaults 0swaps