python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1306609 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2975873'] with mtr_portfolio_ids : ['23415307'] and first list_photo_ids : [] new path : /proc/1306609/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.1631789207458496 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed May 28 13:20:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-28 13:20:31.692999: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-28 13:20:31.719109: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-28 13:20:31.721302: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fd5d0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-28 13:20:31.721364: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-28 13:20:31.725501: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-28 13:20:32.019855: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x9c7ca20 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-28 13:20:32.019918: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-28 13:20:32.021503: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-28 13:20:32.021932: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-28 13:20:32.025223: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-28 13:20:32.028282: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-28 13:20:32.028800: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-28 13:20:32.032217: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-28 13:20:32.033228: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-28 13:20:32.037573: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-28 13:20:32.039017: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-28 13:20:32.039089: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-28 13:20:32.039839: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-28 13:20:32.039855: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-28 13:20:32.039864: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-28 13:20:32.041157: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-28 13:20:32.289759: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-28 13:20:32.289888: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-28 13:20:32.289915: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-28 13:20:32.289938: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-28 13:20:32.289962: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-28 13:20:32.289984: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-28 13:20:32.290006: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-28 13:20:32.290028: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-28 13:20:32.291820: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-28 13:20:32.293426: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-28 13:20:32.293504: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-28 13:20:32.293524: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-28 13:20:32.293541: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-28 13:20:32.293559: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-28 13:20:32.293579: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-28 13:20:32.293597: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-28 13:20:32.293615: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-28 13:20:32.295361: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-28 13:20:32.295406: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-28 13:20:32.295417: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-28 13:20:32.295427: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-28 13:20:32.296957: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-28 13:20:42.987460: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-28 13:20:43.188057: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 10.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 23 Detection mask done ! Trying to reset tf kernel 1307310 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2323 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 7218 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0009930133819580078 nb_pixel_total : 25651 time to create 1 rle with old method : 0.029811620712280273 length of segment : 225 time for calcul the mask position with numpy : 0.0018417835235595703 nb_pixel_total : 74084 time to create 1 rle with old method : 0.08314990997314453 length of segment : 385 time for calcul the mask position with numpy : 0.001070261001586914 nb_pixel_total : 57921 time to create 1 rle with old method : 0.06456279754638672 length of segment : 283 time for calcul the mask position with numpy : 0.0005545616149902344 nb_pixel_total : 20927 time to create 1 rle with old method : 0.023537158966064453 length of segment : 185 time for calcul the mask position with numpy : 0.0007176399230957031 nb_pixel_total : 36660 time to create 1 rle with old method : 0.040483713150024414 length of segment : 371 time for calcul the mask position with numpy : 0.0004413127899169922 nb_pixel_total : 26401 time to create 1 rle with old method : 0.028279781341552734 length of segment : 174 time for calcul the mask position with numpy : 0.00080108642578125 nb_pixel_total : 49530 time to create 1 rle with old method : 0.05413961410522461 length of segment : 255 time for calcul the mask position with numpy : 0.001111745834350586 nb_pixel_total : 70665 time to create 1 rle with old method : 0.08092069625854492 length of segment : 231 time for calcul the mask position with numpy : 0.0005714893341064453 nb_pixel_total : 26657 time to create 1 rle with old method : 0.029950380325317383 length of segment : 199 time for calcul the mask position with numpy : 0.0007412433624267578 nb_pixel_total : 41162 time to create 1 rle with old method : 0.04573178291320801 length of segment : 190 time for calcul the mask position with numpy : 0.00044417381286621094 nb_pixel_total : 23117 time to create 1 rle with old method : 0.026455163955688477 length of segment : 154 time for calcul the mask position with numpy : 0.00154876708984375 nb_pixel_total : 61413 time to create 1 rle with old method : 0.06623315811157227 length of segment : 365 time for calcul the mask position with numpy : 0.0006163120269775391 nb_pixel_total : 31088 time to create 1 rle with old method : 0.036522865295410156 length of segment : 195 time for calcul the mask position with numpy : 0.00034546852111816406 nb_pixel_total : 9474 time to create 1 rle with old method : 0.013586997985839844 length of segment : 200 time for calcul the mask position with numpy : 0.0006721019744873047 nb_pixel_total : 27297 time to create 1 rle with old method : 0.0319058895111084 length of segment : 190 time for calcul the mask position with numpy : 0.001628875732421875 nb_pixel_total : 87562 time to create 1 rle with old method : 0.09865498542785645 length of segment : 297 time for calcul the mask position with numpy : 0.0007557868957519531 nb_pixel_total : 26922 time to create 1 rle with old method : 0.0311582088470459 length of segment : 218 time for calcul the mask position with numpy : 0.0025823116302490234 nb_pixel_total : 109661 time to create 1 rle with old method : 0.12904977798461914 length of segment : 309 time for calcul the mask position with numpy : 0.0006861686706542969 nb_pixel_total : 29822 time to create 1 rle with old method : 0.03390622138977051 length of segment : 276 time for calcul the mask position with numpy : 0.0010640621185302734 nb_pixel_total : 63634 time to create 1 rle with old method : 0.07266092300415039 length of segment : 335 time for calcul the mask position with numpy : 0.0005307197570800781 nb_pixel_total : 29698 time to create 1 rle with old method : 0.03372454643249512 length of segment : 264 time for calcul the mask position with numpy : 0.0004596710205078125 nb_pixel_total : 23853 time to create 1 rle with old method : 0.029933691024780273 length of segment : 170 time for calcul the mask position with numpy : 0.00022840499877929688 nb_pixel_total : 11933 time to create 1 rle with old method : 0.013589859008789062 length of segment : 187 time for calcul the mask position with numpy : 0.0008196830749511719 nb_pixel_total : 37806 time to create 1 rle with old method : 0.04347825050354004 length of segment : 212 time for calcul the mask position with numpy : 0.0002834796905517578 nb_pixel_total : 15644 time to create 1 rle with old method : 0.017746686935424805 length of segment : 132 time for calcul the mask position with numpy : 0.0006923675537109375 nb_pixel_total : 33781 time to create 1 rle with old method : 0.05506467819213867 length of segment : 297 time for calcul the mask position with numpy : 0.001397848129272461 nb_pixel_total : 83034 time to create 1 rle with old method : 0.09789323806762695 length of segment : 303 time for calcul the mask position with numpy : 0.0009226799011230469 nb_pixel_total : 45797 time to create 1 rle with old method : 0.07537031173706055 length of segment : 209 time for calcul the mask position with numpy : 0.0010650157928466797 nb_pixel_total : 50739 time to create 1 rle with old method : 0.07873678207397461 length of segment : 438 time for calcul the mask position with numpy : 0.0005240440368652344 nb_pixel_total : 34113 time to create 1 rle with old method : 0.03847861289978027 length of segment : 233 time for calcul the mask position with numpy : 0.000335693359375 nb_pixel_total : 20090 time to create 1 rle with old method : 0.02320241928100586 length of segment : 158 time for calcul the mask position with numpy : 0.0003669261932373047 nb_pixel_total : 17089 time to create 1 rle with old method : 0.019846200942993164 length of segment : 157 time for calcul the mask position with numpy : 0.0003306865692138672 nb_pixel_total : 17504 time to create 1 rle with old method : 0.021341800689697266 length of segment : 161 time for calcul the mask position with numpy : 0.00023818016052246094 nb_pixel_total : 11760 time to create 1 rle with old method : 0.013858556747436523 length of segment : 116 time for calcul the mask position with numpy : 0.00018024444580078125 nb_pixel_total : 1965 time to create 1 rle with old method : 0.0025463104248046875 length of segment : 129 time for calcul the mask position with numpy : 0.0011262893676757812 nb_pixel_total : 27504 time to create 1 rle with old method : 0.03197813034057617 length of segment : 273 time for calcul the mask position with numpy : 0.0010077953338623047 nb_pixel_total : 33872 time to create 1 rle with old method : 0.03827309608459473 length of segment : 208 time for calcul the mask position with numpy : 0.0017614364624023438 nb_pixel_total : 40086 time to create 1 rle with old method : 0.04523158073425293 length of segment : 218 time for calcul the mask position with numpy : 0.0020313262939453125 nb_pixel_total : 42219 time to create 1 rle with old method : 0.046257972717285156 length of segment : 297 time for calcul the mask position with numpy : 0.0004906654357910156 nb_pixel_total : 13256 time to create 1 rle with old method : 0.015301227569580078 length of segment : 113 time for calcul the mask position with numpy : 0.0011692047119140625 nb_pixel_total : 31584 time to create 1 rle with old method : 0.035022735595703125 length of segment : 274 time for calcul the mask position with numpy : 0.001214742660522461 nb_pixel_total : 29388 time to create 1 rle with old method : 0.03414130210876465 length of segment : 236 time for calcul the mask position with numpy : 0.0005023479461669922 nb_pixel_total : 18887 time to create 1 rle with old method : 0.031197786331176758 length of segment : 145 time for calcul the mask position with numpy : 0.0017516613006591797 nb_pixel_total : 38775 time to create 1 rle with old method : 0.04746270179748535 length of segment : 228 time for calcul the mask position with numpy : 0.0008161067962646484 nb_pixel_total : 14688 time to create 1 rle with old method : 0.016538619995117188 length of segment : 243 time for calcul the mask position with numpy : 0.0007441043853759766 nb_pixel_total : 14499 time to create 1 rle with old method : 0.02085733413696289 length of segment : 147 time for calcul the mask position with numpy : 0.0009329319000244141 nb_pixel_total : 26352 time to create 1 rle with old method : 0.03013134002685547 length of segment : 302 time for calcul the mask position with numpy : 0.0007455348968505859 nb_pixel_total : 21883 time to create 1 rle with old method : 0.025221586227416992 length of segment : 105 time for calcul the mask position with numpy : 0.0010828971862792969 nb_pixel_total : 23783 time to create 1 rle with old method : 0.027695178985595703 length of segment : 268 time for calcul the mask position with numpy : 0.0003905296325683594 nb_pixel_total : 7662 time to create 1 rle with old method : 0.008787870407104492 length of segment : 115 time for calcul the mask position with numpy : 0.000751495361328125 nb_pixel_total : 13771 time to create 1 rle with old method : 0.01655292510986328 length of segment : 126 time for calcul the mask position with numpy : 0.0015141963958740234 nb_pixel_total : 37404 time to create 1 rle with old method : 0.07029247283935547 length of segment : 285 time for calcul the mask position with numpy : 0.0012090206146240234 nb_pixel_total : 19243 time to create 1 rle with old method : 0.03232121467590332 length of segment : 258 time for calcul the mask position with numpy : 0.0003459453582763672 nb_pixel_total : 6452 time to create 1 rle with old method : 0.00783395767211914 length of segment : 88 time for calcul the mask position with numpy : 0.0010843276977539062 nb_pixel_total : 23697 time to create 1 rle with old method : 0.03361701965332031 length of segment : 242 time for calcul the mask position with numpy : 0.002265453338623047 nb_pixel_total : 34023 time to create 1 rle with old method : 0.05432462692260742 length of segment : 143 time for calcul the mask position with numpy : 0.0007550716400146484 nb_pixel_total : 11786 time to create 1 rle with old method : 0.015027046203613281 length of segment : 201 time for calcul the mask position with numpy : 0.0020444393157958984 nb_pixel_total : 41397 time to create 1 rle with old method : 0.07768440246582031 length of segment : 455 time for calcul the mask position with numpy : 0.0011420249938964844 nb_pixel_total : 26394 time to create 1 rle with old method : 0.030427932739257812 length of segment : 198 time for calcul the mask position with numpy : 0.0013415813446044922 nb_pixel_total : 22674 time to create 1 rle with old method : 0.026406049728393555 length of segment : 194 time for calcul the mask position with numpy : 0.0007624626159667969 nb_pixel_total : 14716 time to create 1 rle with old method : 0.017623186111450195 length of segment : 123 time for calcul the mask position with numpy : 0.0029973983764648438 nb_pixel_total : 77245 time to create 1 rle with old method : 0.08936429023742676 length of segment : 353 time for calcul the mask position with numpy : 0.0023529529571533203 nb_pixel_total : 26491 time to create 1 rle with old method : 0.04935860633850098 length of segment : 227 time for calcul the mask position with numpy : 0.0009007453918457031 nb_pixel_total : 12866 time to create 1 rle with old method : 0.024136781692504883 length of segment : 169 time for calcul the mask position with numpy : 0.002404928207397461 nb_pixel_total : 41629 time to create 1 rle with old method : 0.07754755020141602 length of segment : 287 time for calcul the mask position with numpy : 0.00036644935607910156 nb_pixel_total : 12167 time to create 1 rle with old method : 0.01685643196105957 length of segment : 87 time for calcul the mask position with numpy : 0.0011446475982666016 nb_pixel_total : 30099 time to create 1 rle with old method : 0.034555673599243164 length of segment : 172 time for calcul the mask position with numpy : 0.0019197463989257812 nb_pixel_total : 52944 time to create 1 rle with old method : 0.059619903564453125 length of segment : 262 time for calcul the mask position with numpy : 0.001277923583984375 nb_pixel_total : 38066 time to create 1 rle with old method : 0.04403877258300781 length of segment : 169 time for calcul the mask position with numpy : 0.0025119781494140625 nb_pixel_total : 76959 time to create 1 rle with old method : 0.08725833892822266 length of segment : 352 time for calcul the mask position with numpy : 0.0015151500701904297 nb_pixel_total : 33624 time to create 1 rle with old method : 0.03710508346557617 length of segment : 206 time for calcul the mask position with numpy : 0.000946044921875 nb_pixel_total : 22438 time to create 1 rle with old method : 0.025818824768066406 length of segment : 238 time for calcul the mask position with numpy : 0.0012974739074707031 nb_pixel_total : 31025 time to create 1 rle with old method : 0.03545832633972168 length of segment : 295 time for calcul the mask position with numpy : 0.003795146942138672 nb_pixel_total : 95122 time to create 1 rle with old method : 0.10446333885192871 length of segment : 471 time for calcul the mask position with numpy : 0.0016050338745117188 nb_pixel_total : 72353 time to create 1 rle with old method : 0.08086872100830078 length of segment : 270 time for calcul the mask position with numpy : 0.00046634674072265625 nb_pixel_total : 11796 time to create 1 rle with old method : 0.013742446899414062 length of segment : 103 time for calcul the mask position with numpy : 0.0009152889251708984 nb_pixel_total : 23922 time to create 1 rle with old method : 0.029183626174926758 length of segment : 193 time for calcul the mask position with numpy : 0.0003662109375 nb_pixel_total : 6577 time to create 1 rle with old method : 0.0077321529388427734 length of segment : 101 time for calcul the mask position with numpy : 0.0013954639434814453 nb_pixel_total : 32910 time to create 1 rle with old method : 0.0372014045715332 length of segment : 199 time for calcul the mask position with numpy : 0.00480198860168457 nb_pixel_total : 97543 time to create 1 rle with old method : 0.11320614814758301 length of segment : 230 time for calcul the mask position with numpy : 0.0015225410461425781 nb_pixel_total : 26904 time to create 1 rle with old method : 0.030749797821044922 length of segment : 305 time for calcul the mask position with numpy : 0.002744913101196289 nb_pixel_total : 67389 time to create 1 rle with old method : 0.07386016845703125 length of segment : 362 time for calcul the mask position with numpy : 0.0014121532440185547 nb_pixel_total : 30982 time to create 1 rle with old method : 0.03575944900512695 length of segment : 167 time for calcul the mask position with numpy : 0.0006635189056396484 nb_pixel_total : 14018 time to create 1 rle with old method : 0.016070842742919922 length of segment : 189 time for calcul the mask position with numpy : 0.0009763240814208984 nb_pixel_total : 18078 time to create 1 rle with old method : 0.020660400390625 length of segment : 195 time for calcul the mask position with numpy : 0.0013718605041503906 nb_pixel_total : 17418 time to create 1 rle with old method : 0.020179033279418945 length of segment : 196 time for calcul the mask position with numpy : 0.003217935562133789 nb_pixel_total : 64113 time to create 1 rle with old method : 0.0720975399017334 length of segment : 390 time for calcul the mask position with numpy : 0.0006229877471923828 nb_pixel_total : 28246 time to create 1 rle with old method : 0.03158903121948242 length of segment : 154 time for calcul the mask position with numpy : 0.0009570121765136719 nb_pixel_total : 23554 time to create 1 rle with old method : 0.04497671127319336 length of segment : 214 time for calcul the mask position with numpy : 0.002059459686279297 nb_pixel_total : 39853 time to create 1 rle with old method : 0.045511484146118164 length of segment : 260 time for calcul the mask position with numpy : 0.0008876323699951172 nb_pixel_total : 23580 time to create 1 rle with old method : 0.028129100799560547 length of segment : 184 time for calcul the mask position with numpy : 0.0006747245788574219 nb_pixel_total : 11692 time to create 1 rle with old method : 0.013693809509277344 length of segment : 148 time for calcul the mask position with numpy : 0.0015349388122558594 nb_pixel_total : 31348 time to create 1 rle with old method : 0.035417795181274414 length of segment : 543 time for calcul the mask position with numpy : 0.0005986690521240234 nb_pixel_total : 10302 time to create 1 rle with old method : 0.011753559112548828 length of segment : 99 time for calcul the mask position with numpy : 0.0007004737854003906 nb_pixel_total : 22120 time to create 1 rle with old method : 0.02594137191772461 length of segment : 106 time for calcul the mask position with numpy : 0.0006029605865478516 nb_pixel_total : 15510 time to create 1 rle with old method : 0.028867721557617188 length of segment : 163 time for calcul the mask position with numpy : 0.0017023086547851562 nb_pixel_total : 38656 time to create 1 rle with old method : 0.05120205879211426 length of segment : 288 time for calcul the mask position with numpy : 0.0015676021575927734 nb_pixel_total : 42707 time to create 1 rle with old method : 0.050299644470214844 length of segment : 249 time for calcul the mask position with numpy : 0.0038700103759765625 nb_pixel_total : 76270 time to create 1 rle with old method : 0.08805108070373535 length of segment : 491 time for calcul the mask position with numpy : 0.0019016265869140625 nb_pixel_total : 62038 time to create 1 rle with old method : 0.07318854331970215 length of segment : 290 time for calcul the mask position with numpy : 0.0020089149475097656 nb_pixel_total : 64029 time to create 1 rle with old method : 0.07324433326721191 length of segment : 391 time for calcul the mask position with numpy : 0.0010526180267333984 nb_pixel_total : 25453 time to create 1 rle with old method : 0.03662610054016113 length of segment : 160 time for calcul the mask position with numpy : 0.0022482872009277344 nb_pixel_total : 48105 time to create 1 rle with old method : 0.0557398796081543 length of segment : 277 time for calcul the mask position with numpy : 0.004756927490234375 nb_pixel_total : 103307 time to create 1 rle with old method : 0.12078595161437988 length of segment : 425 time for calcul the mask position with numpy : 0.0017173290252685547 nb_pixel_total : 45453 time to create 1 rle with old method : 0.0507814884185791 length of segment : 390 time for calcul the mask position with numpy : 0.0006933212280273438 nb_pixel_total : 13561 time to create 1 rle with old method : 0.01577138900756836 length of segment : 128 time for calcul the mask position with numpy : 0.0006930828094482422 nb_pixel_total : 16342 time to create 1 rle with old method : 0.018930912017822266 length of segment : 169 time for calcul the mask position with numpy : 0.0009579658508300781 nb_pixel_total : 24525 time to create 1 rle with old method : 0.034726619720458984 length of segment : 334 time for calcul the mask position with numpy : 0.0007090568542480469 nb_pixel_total : 16576 time to create 1 rle with old method : 0.023707866668701172 length of segment : 231 time for calcul the mask position with numpy : 0.0004978179931640625 nb_pixel_total : 9367 time to create 1 rle with old method : 0.011141300201416016 length of segment : 128 time for calcul the mask position with numpy : 0.0007462501525878906 nb_pixel_total : 17460 time to create 1 rle with old method : 0.02248215675354004 length of segment : 104 time for calcul the mask position with numpy : 0.0006973743438720703 nb_pixel_total : 21620 time to create 1 rle with old method : 0.024976015090942383 length of segment : 163 time for calcul the mask position with numpy : 0.0011348724365234375 nb_pixel_total : 30278 time to create 1 rle with old method : 0.034241676330566406 length of segment : 231 time for calcul the mask position with numpy : 0.001071929931640625 nb_pixel_total : 38978 time to create 1 rle with old method : 0.043694496154785156 length of segment : 223 time for calcul the mask position with numpy : 0.0012733936309814453 nb_pixel_total : 54530 time to create 1 rle with old method : 0.05944180488586426 length of segment : 251 time for calcul the mask position with numpy : 0.0006723403930664062 nb_pixel_total : 20010 time to create 1 rle with old method : 0.02299046516418457 length of segment : 153 time for calcul the mask position with numpy : 0.002844095230102539 nb_pixel_total : 61749 time to create 1 rle with old method : 0.06960678100585938 length of segment : 337 time for calcul the mask position with numpy : 0.0010402202606201172 nb_pixel_total : 33969 time to create 1 rle with old method : 0.03827476501464844 length of segment : 258 time for calcul the mask position with numpy : 0.0009164810180664062 nb_pixel_total : 16666 time to create 1 rle with old method : 0.01896500587463379 length of segment : 276 time for calcul the mask position with numpy : 0.00089263916015625 nb_pixel_total : 23504 time to create 1 rle with old method : 0.03942704200744629 length of segment : 184 time for calcul the mask position with numpy : 0.0012364387512207031 nb_pixel_total : 29776 time to create 1 rle with old method : 0.034252166748046875 length of segment : 222 time spent for convertir_results : 9.675169467926025 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 121 chid ids of type : 3594 Number RLEs to save : 28100 save missing photos in datou_result : time spend for datou_step_exec : 61.65270709991455 time spend to save output : 1.707401990890503 total time spend for step 1 : 63.360109090805054 step2:crop_condition Wed May 28 13:21:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 121 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 66 About to insert : list_path_to_insert length 66 new photo from crops ! About to upload 66 photos upload in portfolio : 3736932 init cache_photo without model_param we have 66 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748431303_1306609 we have uploaded 66 photos in the portfolio 3736932 time of upload the photos Elapsed time : 16.359822034835815 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 19 About to insert : list_path_to_insert length 19 new photo from crops ! About to upload 19 photos upload in portfolio : 3736932 init cache_photo without model_param we have 19 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748431323_1306609 we have uploaded 19 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.180346727371216 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748431328_1306609 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.47919511795043945 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 33 About to insert : list_path_to_insert length 33 new photo from crops ! About to upload 33 photos upload in portfolio : 3736932 init cache_photo without model_param we have 33 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748431339_1306609 we have uploaded 33 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.060906887054443 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748431350_1306609 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7806565761566162 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1361485510, 1361485489, 1361485473, 1361485454, 1361472139, 1361472120, 1361472095, 1361472077] Looping around the photos to save general results len do output : 121 /1361491283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361491535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361485510', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361485489', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361485473', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361485454', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361472139', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361472120', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361472095', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361472077', None, None, None, None, None, '2975873') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 371 time used for this insertion : 0.03473997116088867 save_final save missing photos in datou_result : time spend for datou_step_exec : 59.07211518287659 time spend to save output : 0.03863048553466797 total time spend for step 2 : 59.110745668411255 step3:rle_unique_nms_with_priority Wed May 28 13:22:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 121 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 8.896423816680908 time for calcul the mask position with numpy : 0.5601053237915039 nb_pixel_total : 6353709 time to create 1 rle with new method : 1.0755748748779297 time for calcul the mask position with numpy : 0.021959543228149414 nb_pixel_total : 26922 time to create 1 rle with old method : 0.030655384063720703 time for calcul the mask position with numpy : 0.023143768310546875 nb_pixel_total : 87562 time to create 1 rle with old method : 0.10341405868530273 time for calcul the mask position with numpy : 0.023415565490722656 nb_pixel_total : 27297 time to create 1 rle with old method : 0.03020620346069336 time for calcul the mask position with numpy : 0.021699190139770508 nb_pixel_total : 9474 time to create 1 rle with old method : 0.010840892791748047 time for calcul the mask position with numpy : 0.02195882797241211 nb_pixel_total : 31088 time to create 1 rle with old method : 0.03422856330871582 time for calcul the mask position with numpy : 0.020675182342529297 nb_pixel_total : 61413 time to create 1 rle with old method : 0.06672382354736328 time for calcul the mask position with numpy : 0.020540952682495117 nb_pixel_total : 23117 time to create 1 rle with old method : 0.025272130966186523 time for calcul the mask position with numpy : 0.02130436897277832 nb_pixel_total : 41162 time to create 1 rle with old method : 0.04523587226867676 time for calcul the mask position with numpy : 0.021847248077392578 nb_pixel_total : 26657 time to create 1 rle with old method : 0.02925872802734375 time for calcul the mask position with numpy : 0.021856307983398438 nb_pixel_total : 70665 time to create 1 rle with old method : 0.08180117607116699 time for calcul the mask position with numpy : 0.035393714904785156 nb_pixel_total : 49530 time to create 1 rle with old method : 0.05814242362976074 time for calcul the mask position with numpy : 0.03643059730529785 nb_pixel_total : 26401 time to create 1 rle with old method : 0.0292510986328125 time for calcul the mask position with numpy : 0.03402233123779297 nb_pixel_total : 36660 time to create 1 rle with old method : 0.04073452949523926 time for calcul the mask position with numpy : 0.033841848373413086 nb_pixel_total : 20927 time to create 1 rle with old method : 0.02316451072692871 time for calcul the mask position with numpy : 0.03467130661010742 nb_pixel_total : 57921 time to create 1 rle with old method : 0.06375288963317871 time for calcul the mask position with numpy : 0.0343480110168457 nb_pixel_total : 74084 time to create 1 rle with old method : 0.07962274551391602 time for calcul the mask position with numpy : 0.03905773162841797 nb_pixel_total : 25651 time to create 1 rle with old method : 0.02799510955810547 create new chi : 2.9175000190734863 time to delete rle : 0.022629976272583008 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 10394 TO DO : save crop sub photo not yet done ! save time : 0.6272461414337158 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 5.711463451385498 time for calcul the mask position with numpy : 0.5263214111328125 nb_pixel_total : 6480725 time to create 1 rle with new method : 0.7755193710327148 time for calcul the mask position with numpy : 0.035178184509277344 nb_pixel_total : 34113 time to create 1 rle with old method : 0.03814554214477539 time for calcul the mask position with numpy : 0.03511333465576172 nb_pixel_total : 50739 time to create 1 rle with old method : 0.056691646575927734 time for calcul the mask position with numpy : 0.034501075744628906 nb_pixel_total : 45797 time to create 1 rle with old method : 0.05131816864013672 time for calcul the mask position with numpy : 0.03572893142700195 nb_pixel_total : 83034 time to create 1 rle with old method : 0.09256720542907715 time for calcul the mask position with numpy : 0.033319711685180664 nb_pixel_total : 33781 time to create 1 rle with old method : 0.0377802848815918 time for calcul the mask position with numpy : 0.021862506866455078 nb_pixel_total : 15644 time to create 1 rle with old method : 0.017545223236083984 time for calcul the mask position with numpy : 0.021583080291748047 nb_pixel_total : 37806 time to create 1 rle with old method : 0.04232645034790039 time for calcul the mask position with numpy : 0.021434783935546875 nb_pixel_total : 11933 time to create 1 rle with old method : 0.013410806655883789 time for calcul the mask position with numpy : 0.021844148635864258 nb_pixel_total : 23853 time to create 1 rle with old method : 0.02667546272277832 time for calcul the mask position with numpy : 0.022130250930786133 nb_pixel_total : 29698 time to create 1 rle with old method : 0.03300285339355469 time for calcul the mask position with numpy : 0.022160053253173828 nb_pixel_total : 63634 time to create 1 rle with old method : 0.07053375244140625 time for calcul the mask position with numpy : 0.023243427276611328 nb_pixel_total : 29822 time to create 1 rle with old method : 0.03326082229614258 time for calcul the mask position with numpy : 0.02303791046142578 nb_pixel_total : 109661 time to create 1 rle with old method : 0.1216135025024414 create new chi : 2.327237129211426 time to delete rle : 0.0013229846954345703 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 8890 TO DO : save crop sub photo not yet done ! save time : 0.7811925411224365 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 7.200627326965332 time for calcul the mask position with numpy : 0.4768342971801758 nb_pixel_total : 6745036 time to create 1 rle with new method : 0.708918571472168 time for calcul the mask position with numpy : 0.021030664443969727 nb_pixel_total : 18887 time to create 1 rle with old method : 0.021155834197998047 time for calcul the mask position with numpy : 0.02203989028930664 nb_pixel_total : 29388 time to create 1 rle with old method : 0.03339099884033203 time for calcul the mask position with numpy : 0.022037506103515625 nb_pixel_total : 31584 time to create 1 rle with old method : 0.03503131866455078 time for calcul the mask position with numpy : 0.022204875946044922 nb_pixel_total : 13256 time to create 1 rle with old method : 0.01607036590576172 time for calcul the mask position with numpy : 0.023526430130004883 nb_pixel_total : 42219 time to create 1 rle with old method : 0.046439170837402344 time for calcul the mask position with numpy : 0.021708011627197266 nb_pixel_total : 40086 time to create 1 rle with old method : 0.050177812576293945 time for calcul the mask position with numpy : 0.02368474006652832 nb_pixel_total : 33872 time to create 1 rle with old method : 0.038285255432128906 time for calcul the mask position with numpy : 0.02296614646911621 nb_pixel_total : 27504 time to create 1 rle with old method : 0.03139042854309082 time for calcul the mask position with numpy : 0.02220010757446289 nb_pixel_total : 1965 time to create 1 rle with old method : 0.0023276805877685547 time for calcul the mask position with numpy : 0.0228121280670166 nb_pixel_total : 11760 time to create 1 rle with old method : 0.013318538665771484 time for calcul the mask position with numpy : 0.021837472915649414 nb_pixel_total : 17504 time to create 1 rle with old method : 0.019790172576904297 time for calcul the mask position with numpy : 0.02226543426513672 nb_pixel_total : 17089 time to create 1 rle with old method : 0.01932525634765625 time for calcul the mask position with numpy : 0.02223944664001465 nb_pixel_total : 20090 time to create 1 rle with old method : 0.02285480499267578 create new chi : 1.8641645908355713 time to delete rle : 0.0011577606201171875 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 7130 TO DO : save crop sub photo not yet done ! save time : 0.46704864501953125 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 6.070865631103516 time for calcul the mask position with numpy : 0.49028706550598145 nb_pixel_total : 6722403 time to create 1 rle with new method : 0.5053737163543701 time for calcul the mask position with numpy : 0.021307945251464844 nb_pixel_total : 39462 time to create 1 rle with old method : 0.04415607452392578 time for calcul the mask position with numpy : 0.022183895111083984 nb_pixel_total : 11786 time to create 1 rle with old method : 0.014328718185424805 time for calcul the mask position with numpy : 0.023154258728027344 nb_pixel_total : 34023 time to create 1 rle with old method : 0.03743338584899902 time for calcul the mask position with numpy : 0.022080183029174805 nb_pixel_total : 23697 time to create 1 rle with old method : 0.025677919387817383 time for calcul the mask position with numpy : 0.021802902221679688 nb_pixel_total : 6452 time to create 1 rle with old method : 0.007035493850708008 time for calcul the mask position with numpy : 0.022113561630249023 nb_pixel_total : 19243 time to create 1 rle with old method : 0.022273778915405273 time for calcul the mask position with numpy : 0.02307295799255371 nb_pixel_total : 37404 time to create 1 rle with old method : 0.06004619598388672 time for calcul the mask position with numpy : 0.021409988403320312 nb_pixel_total : 13771 time to create 1 rle with old method : 0.015172243118286133 time for calcul the mask position with numpy : 0.021870136260986328 nb_pixel_total : 7662 time to create 1 rle with old method : 0.008413076400756836 time for calcul the mask position with numpy : 0.021561384201049805 nb_pixel_total : 23783 time to create 1 rle with old method : 0.02600717544555664 time for calcul the mask position with numpy : 0.023473024368286133 nb_pixel_total : 21883 time to create 1 rle with old method : 0.02608942985534668 time for calcul the mask position with numpy : 0.02229905128479004 nb_pixel_total : 20709 time to create 1 rle with old method : 0.023018836975097656 time for calcul the mask position with numpy : 0.023822784423828125 nb_pixel_total : 14499 time to create 1 rle with old method : 0.016206026077270508 time for calcul the mask position with numpy : 0.02319788932800293 nb_pixel_total : 14688 time to create 1 rle with old method : 0.016625642776489258 time for calcul the mask position with numpy : 0.023383378982543945 nb_pixel_total : 38775 time to create 1 rle with old method : 0.04281139373779297 create new chi : 1.7556805610656738 time to delete rle : 0.001224517822265625 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++++++++++Number RLEs to save : 8152 TO DO : save crop sub photo not yet done ! save time : 0.5165998935699463 nb_obj : 17 nb_hashtags : 4 time to prepare the origin masks : 6.634575605392456 time for calcul the mask position with numpy : 0.45806431770324707 nb_pixel_total : 6363428 time to create 1 rle with new method : 0.3835420608520508 time for calcul the mask position with numpy : 0.02153801918029785 nb_pixel_total : 72353 time to create 1 rle with old method : 0.08184218406677246 time for calcul the mask position with numpy : 0.021750450134277344 nb_pixel_total : 95122 time to create 1 rle with old method : 0.1073462963104248 time for calcul the mask position with numpy : 0.02088141441345215 nb_pixel_total : 31025 time to create 1 rle with old method : 0.03436017036437988 time for calcul the mask position with numpy : 0.021630525588989258 nb_pixel_total : 22438 time to create 1 rle with old method : 0.0245361328125 time for calcul the mask position with numpy : 0.02221822738647461 nb_pixel_total : 33624 time to create 1 rle with old method : 0.03732895851135254 time for calcul the mask position with numpy : 0.022806406021118164 nb_pixel_total : 76959 time to create 1 rle with old method : 0.08382964134216309 time for calcul the mask position with numpy : 0.022459745407104492 nb_pixel_total : 38066 time to create 1 rle with old method : 0.0413818359375 time for calcul the mask position with numpy : 0.021611452102661133 nb_pixel_total : 52944 time to create 1 rle with old method : 0.05736422538757324 time for calcul the mask position with numpy : 0.020269393920898438 nb_pixel_total : 30099 time to create 1 rle with old method : 0.03251457214355469 time for calcul the mask position with numpy : 0.020668506622314453 nb_pixel_total : 12167 time to create 1 rle with old method : 0.013291120529174805 time for calcul the mask position with numpy : 0.020635366439819336 nb_pixel_total : 41629 time to create 1 rle with old method : 0.04510974884033203 time for calcul the mask position with numpy : 0.020487308502197266 nb_pixel_total : 12866 time to create 1 rle with old method : 0.01687932014465332 time for calcul the mask position with numpy : 0.02254629135131836 nb_pixel_total : 26491 time to create 1 rle with old method : 0.04279685020446777 time for calcul the mask position with numpy : 0.024145126342773438 nb_pixel_total : 77245 time to create 1 rle with old method : 0.10979628562927246 time for calcul the mask position with numpy : 0.022207260131835938 nb_pixel_total : 14716 time to create 1 rle with old method : 0.016186237335205078 time for calcul the mask position with numpy : 0.022141456604003906 nb_pixel_total : 22674 time to create 1 rle with old method : 0.024540424346923828 time for calcul the mask position with numpy : 0.021655797958374023 nb_pixel_total : 26394 time to create 1 rle with old method : 0.029526233673095703 create new chi : 2.04982852935791 time to delete rle : 0.0027055740356445312 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 10306 TO DO : save crop sub photo not yet done ! save time : 0.624462366104126 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 5.870725631713867 time for calcul the mask position with numpy : 0.4444727897644043 nb_pixel_total : 6511665 time to create 1 rle with new method : 0.9277374744415283 time for calcul the mask position with numpy : 0.021459341049194336 nb_pixel_total : 11692 time to create 1 rle with old method : 0.012942075729370117 time for calcul the mask position with numpy : 0.021132946014404297 nb_pixel_total : 23580 time to create 1 rle with old method : 0.02592182159423828 time for calcul the mask position with numpy : 0.021193981170654297 nb_pixel_total : 39853 time to create 1 rle with old method : 0.044226646423339844 time for calcul the mask position with numpy : 0.02182173728942871 nb_pixel_total : 23554 time to create 1 rle with old method : 0.038297176361083984 time for calcul the mask position with numpy : 0.02224421501159668 nb_pixel_total : 28246 time to create 1 rle with old method : 0.035161733627319336 time for calcul the mask position with numpy : 0.021060943603515625 nb_pixel_total : 64113 time to create 1 rle with old method : 0.07003402709960938 time for calcul the mask position with numpy : 0.0224764347076416 nb_pixel_total : 17418 time to create 1 rle with old method : 0.0195462703704834 time for calcul the mask position with numpy : 0.02212667465209961 nb_pixel_total : 18078 time to create 1 rle with old method : 0.02011895179748535 time for calcul the mask position with numpy : 0.035268545150756836 nb_pixel_total : 14018 time to create 1 rle with old method : 0.02313399314880371 time for calcul the mask position with numpy : 0.024393796920776367 nb_pixel_total : 30982 time to create 1 rle with old method : 0.051226139068603516 time for calcul the mask position with numpy : 0.024736404418945312 nb_pixel_total : 67389 time to create 1 rle with old method : 0.07815432548522949 time for calcul the mask position with numpy : 0.022246360778808594 nb_pixel_total : 26904 time to create 1 rle with old method : 0.029605388641357422 time for calcul the mask position with numpy : 0.02144765853881836 nb_pixel_total : 97543 time to create 1 rle with old method : 0.10812664031982422 time for calcul the mask position with numpy : 0.02545952796936035 nb_pixel_total : 32910 time to create 1 rle with old method : 0.03897213935852051 time for calcul the mask position with numpy : 0.027957916259765625 nb_pixel_total : 6577 time to create 1 rle with old method : 0.008620738983154297 time for calcul the mask position with numpy : 0.027187585830688477 nb_pixel_total : 23922 time to create 1 rle with old method : 0.03308868408203125 time for calcul the mask position with numpy : 0.028986215591430664 nb_pixel_total : 11796 time to create 1 rle with old method : 0.013690948486328125 create new chi : 2.4753665924072266 time to delete rle : 0.0013265609741210938 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 9339 TO DO : save crop sub photo not yet done ! save time : 0.5622127056121826 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 6.540454864501953 time for calcul the mask position with numpy : 0.7854287624359131 nb_pixel_total : 6367111 time to create 1 rle with new method : 0.6359710693359375 time for calcul the mask position with numpy : 0.021002531051635742 nb_pixel_total : 17460 time to create 1 rle with old method : 0.019616365432739258 time for calcul the mask position with numpy : 0.021286964416503906 nb_pixel_total : 9367 time to create 1 rle with old method : 0.010462045669555664 time for calcul the mask position with numpy : 0.021799087524414062 nb_pixel_total : 16576 time to create 1 rle with old method : 0.018483638763427734 time for calcul the mask position with numpy : 0.02103900909423828 nb_pixel_total : 24525 time to create 1 rle with old method : 0.02735161781311035 time for calcul the mask position with numpy : 0.021056652069091797 nb_pixel_total : 16342 time to create 1 rle with old method : 0.017951488494873047 time for calcul the mask position with numpy : 0.02147078514099121 nb_pixel_total : 13561 time to create 1 rle with old method : 0.015039682388305664 time for calcul the mask position with numpy : 0.022418737411499023 nb_pixel_total : 45453 time to create 1 rle with old method : 0.04996776580810547 time for calcul the mask position with numpy : 0.03404402732849121 nb_pixel_total : 103307 time to create 1 rle with old method : 0.11148762702941895 time for calcul the mask position with numpy : 0.02845025062561035 nb_pixel_total : 48105 time to create 1 rle with old method : 0.05047869682312012 time for calcul the mask position with numpy : 0.02453017234802246 nb_pixel_total : 25453 time to create 1 rle with old method : 0.042032480239868164 time for calcul the mask position with numpy : 0.02480626106262207 nb_pixel_total : 64029 time to create 1 rle with old method : 0.06887245178222656 time for calcul the mask position with numpy : 0.02104043960571289 nb_pixel_total : 62038 time to create 1 rle with old method : 0.06580805778503418 time for calcul the mask position with numpy : 0.021770000457763672 nb_pixel_total : 76270 time to create 1 rle with old method : 0.08039188385009766 time for calcul the mask position with numpy : 0.02222442626953125 nb_pixel_total : 42707 time to create 1 rle with old method : 0.04574322700500488 time for calcul the mask position with numpy : 0.021271944046020508 nb_pixel_total : 38656 time to create 1 rle with old method : 0.04122328758239746 time for calcul the mask position with numpy : 0.020972728729248047 nb_pixel_total : 15510 time to create 1 rle with old method : 0.01681995391845703 time for calcul the mask position with numpy : 0.0203554630279541 nb_pixel_total : 22120 time to create 1 rle with old method : 0.02270197868347168 time for calcul the mask position with numpy : 0.019497156143188477 nb_pixel_total : 10302 time to create 1 rle with old method : 0.010916471481323242 time for calcul the mask position with numpy : 0.01999354362487793 nb_pixel_total : 31348 time to create 1 rle with old method : 0.03319740295410156 create new chi : 2.6377758979797363 time to delete rle : 0.0014476776123046875 batch 1 Loaded 39 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 12092 TO DO : save crop sub photo not yet done ! save time : 0.7136843204498291 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 3.7887825965881348 time for calcul the mask position with numpy : 0.5940699577331543 nb_pixel_total : 6719160 time to create 1 rle with new method : 1.1572306156158447 time for calcul the mask position with numpy : 0.03387928009033203 nb_pixel_total : 29776 time to create 1 rle with old method : 0.032540321350097656 time for calcul the mask position with numpy : 0.02059340476989746 nb_pixel_total : 23504 time to create 1 rle with old method : 0.026131391525268555 time for calcul the mask position with numpy : 0.021200180053710938 nb_pixel_total : 16666 time to create 1 rle with old method : 0.018164396286010742 time for calcul the mask position with numpy : 0.020421266555786133 nb_pixel_total : 33969 time to create 1 rle with old method : 0.037021636962890625 time for calcul the mask position with numpy : 0.020877599716186523 nb_pixel_total : 61749 time to create 1 rle with old method : 0.07015848159790039 time for calcul the mask position with numpy : 0.02089667320251465 nb_pixel_total : 20010 time to create 1 rle with old method : 0.021679401397705078 time for calcul the mask position with numpy : 0.021134138107299805 nb_pixel_total : 54530 time to create 1 rle with old method : 0.059368133544921875 time for calcul the mask position with numpy : 0.02054309844970703 nb_pixel_total : 38978 time to create 1 rle with old method : 0.042592525482177734 time for calcul the mask position with numpy : 0.02121257781982422 nb_pixel_total : 30278 time to create 1 rle with old method : 0.032212018966674805 time for calcul the mask position with numpy : 0.02169060707092285 nb_pixel_total : 21620 time to create 1 rle with old method : 0.023724079132080078 create new chi : 2.3739871978759766 time to delete rle : 0.001027822494506836 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++Number RLEs to save : 6756 TO DO : save crop sub photo not yet done ! save time : 0.4559824466705322 map_output_result : {1361485510: (0.0, 'Should be the crop_list due to order', 0), 1361485489: (0.0, 'Should be the crop_list due to order', 0), 1361485473: (0.0, 'Should be the crop_list due to order', 0), 1361485454: (0.0, 'Should be the crop_list due to order', 0), 1361472139: (0.0, 'Should be the crop_list due to order', 0), 1361472120: (0.0, 'Should be the crop_list due to order', 0), 1361472095: (0.0, 'Should be the crop_list due to order', 0), 1361472077: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1361485510, 1361485489, 1361485473, 1361485454, 1361472139, 1361472120, 1361472095, 1361472077] Looping around the photos to save general results len do output : 8 /1361485510.Didn't retrieve data . /1361485489.Didn't retrieve data . /1361485473.Didn't retrieve data . /1361485454.Didn't retrieve data . /1361472139.Didn't retrieve data . /1361472120.Didn't retrieve data . /1361472095.Didn't retrieve data . /1361472077.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361485510', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361485489', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361485473', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361485454', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361472139', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361472120', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361472095', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361472077', None, None, None, None, None, '2975873') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.012436151504516602 save_final save missing photos in datou_result : time spend for datou_step_exec : 75.14995431900024 time spend to save output : 0.012862443923950195 total time spend for step 3 : 75.1628167629242 step4:ventilate_hashtags_in_portfolio Wed May 28 13:23:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23415307 get user id for portfolio 23415307 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23415307 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','mal_croppe','metal','background','carton','papier','environnement','flou','autre','pet_clair','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23415307 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','mal_croppe','metal','background','carton','papier','environnement','flou','autre','pet_clair','pet_fonce')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23415307 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','mal_croppe','metal','background','carton','papier','environnement','flou','autre','pet_clair','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23415336,23415337,23415338,23415339,23415340,23415341,23415342,23415343,23415344,23415345,23415346?tags=pehd,mal_croppe,metal,background,carton,papier,environnement,flou,autre,pet_clair,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1361485510, 1361485489, 1361485473, 1361485454, 1361472139, 1361472120, 1361472095, 1361472077] Looping around the photos to save general results len do output : 1 /23415307. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361485510', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361485489', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361485473', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361485454', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361472139', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361472120', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361472095', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361472077', None, None, None, None, None, '2975873') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.013825178146362305 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5743508338928223 time spend to save output : 0.014109134674072266 total time spend for step 4 : 1.5884599685668945 step5:final Wed May 28 13:23:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1361485510: ('0.0733784062670207',), 1361485489: ('0.0733784062670207',), 1361485473: ('0.0733784062670207',), 1361485454: ('0.0733784062670207',), 1361472139: ('0.0733784062670207',), 1361472120: ('0.0733784062670207',), 1361472095: ('0.0733784062670207',), 1361472077: ('0.0733784062670207',)} new output for save of step final : {1361485510: ('0.0733784062670207',), 1361485489: ('0.0733784062670207',), 1361485473: ('0.0733784062670207',), 1361485454: ('0.0733784062670207',), 1361472139: ('0.0733784062670207',), 1361472120: ('0.0733784062670207',), 1361472095: ('0.0733784062670207',), 1361472077: ('0.0733784062670207',)} [1361485510, 1361485489, 1361485473, 1361485454, 1361472139, 1361472120, 1361472095, 1361472077] Looping around the photos to save general results len do output : 8 /1361485510.Didn't retrieve data . /1361485489.Didn't retrieve data . /1361485473.Didn't retrieve data . /1361485454.Didn't retrieve data . /1361472139.Didn't retrieve data . /1361472120.Didn't retrieve data . /1361472095.Didn't retrieve data . /1361472077.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361485510', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361485489', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361485473', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361485454', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361472139', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361472120', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361472095', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361472077', None, None, None, None, None, '2975873') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.012714147567749023 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1115407943725586 time spend to save output : 0.013203620910644531 total time spend for step 5 : 0.12474441528320312 step6:blur_detection Wed May 28 13:23:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20.jpg resize: (2160, 3264) 1361485510 -2.53831400479089 treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3.jpg resize: (2160, 3264) 1361485489 -2.304618368406611 treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb.jpg resize: (2160, 3264) 1361485473 -1.367485664229697 treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6.jpg resize: (2160, 3264) 1361485454 -1.7565271628439176 treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8.jpg resize: (2160, 3264) 1361472139 -0.791135454197802 treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c.jpg resize: (2160, 3264) 1361472120 -1.7952878837854955 treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4.jpg resize: (2160, 3264) 1361472095 -2.641925279747406 treat image : temp/1748431227_1306609_1361472077_7d63a47322d62dd157310634e53276ff.jpg resize: (2160, 3264) 1361472077 0.1984135816546183 treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795961_0.png resize: (154, 240) 1361491283 -1.5257021366928423 treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795951_0.png resize: (223, 159) 1361491285 -0.30621716446742214 treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795952_0.png resize: (281, 408) 1361491286 -1.8845409503278487 treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795957_0.png resize: (241, 318) 1361491287 -1.584955977742644 treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795967_0.png resize: (215, 191) 1361491288 -0.917109146084954 treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795955_0.png resize: (246, 250) 1361491289 -1.4061236339718692 treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795954_0.png resize: (177, 316) 1361491290 -2.4230206522543134 treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795964_0.png resize: (151, 114) 1361491291 -1.9060417457933632 treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795969_0.png resize: (276, 253) 1361491292 -1.4972379334234025 treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795968_0.png resize: (305, 553) 1361491293 -1.460123989646386 treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795972_0.png resize: (168, 207) 1361491294 -2.3679144506469076 treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795976_0.png resize: (280, 157) 1361491295 -1.3097361691538636 treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795973_0.png resize: (176, 85) 1361491296 0.3667394217484019 treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795984_0.png resize: (116, 131) 1361491297 -0.7813070432124734 treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795986_0.png resize: (266, 144) 1361491298 -1.5094075459614131 treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795990_0.png resize: (112, 140) 1361491299 0.9140165741660924 treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795989_0.png resize: (296, 180) 1361491300 -0.8286160448354826 treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795981_0.png resize: (158, 183) 1361491301 -1.6235910129413802 treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795985_0.png resize: (129, 83) 1361491302 -1.743957617729964 treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795987_0.png resize: (208, 204) 1361491303 0.8786077141785 treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795983_0.png resize: (161, 153) 1361491304 -0.7426960289916865 treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795992_0.png resize: (221, 230) 1361491305 -2.7978952782883555 treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814795994_0.png resize: (228, 257) 1361491306 -1.2084506771876067 treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814795999_0.png resize: (194, 206) 1361491307 -1.8899809393936733 treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814796005_0.png resize: (220, 163) 1361491308 -1.157975655279171 treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814795996_0.png resize: (147, 125) 1361491309 -0.4800128337648783 treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814796002_0.png resize: (285, 206) 1361491310 -0.6026447824380692 treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814796001_0.png resize: (126, 188) 1361491311 -1.2801276929087226 treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814796004_0.png resize: (87, 106) 1361491312 -0.3211529370468993 treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814796008_0.png resize: (376, 258) 1361491313 0.3347213942840268 treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814795995_0.png resize: (163, 160) 1361491314 -0.2917115245298291 treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814795997_0.png resize: (261, 177) 1361491315 -0.3000523218569927 treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814796003_0.png resize: (251, 119) 1361491316 -0.30394157705798247 treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796022_0.png resize: (237, 126) 1361491318 -0.7037452739158501 treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796024_0.png resize: (454, 376) 1361491320 -0.9561164614103397 treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796017_0.png resize: (170, 251) 1361491322 -0.3059838338225574 treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796014_0.png resize: (169, 115) 1361491324 -0.4641899758894706 treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796021_0.png resize: (203, 255) 1361491326 -1.226676415393856 treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796016_0.png resize: (85, 178) 1361491328 0.22271141733601138 treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796009_0.png resize: (198, 198) 1361491329 -0.2056639428989642 treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796027_0.png resize: (193, 150) 1361491330 -0.5013729307991567 treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796036_0.png resize: (155, 296) 1361491331 -1.4691079037872494 treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796035_0.png resize: (161, 193) 1361491332 -2.0881798632804913 treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796042_0.png resize: (148, 137) 1361491333 -1.632525626698093 treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796041_0.png resize: (169, 216) 1361491334 -1.056078747629918 treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796037_0.png resize: (360, 346) 1361491335 -0.5618918251531103 treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796031_0.png resize: (185, 279) 1361491336 -2.5288134679762697 treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796026_0.png resize: (96, 142) 1361491337 3.7749865204835493 treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796033_0.png resize: (147, 326) 1361491338 -3.1645333919745102 treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796040_0.png resize: (260, 257) 1361491339 0.6007150354941365 treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796028_0.png resize: (97, 79) 1361491340 0.9523838936839714 treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796032_0.png resize: (330, 288) 1361491341 -1.271899066542163 treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796044_0.png resize: (99, 145) 1361491342 -1.0356973121414776 treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796048_0.png resize: (247, 295) 1361491343 -0.5903469775215495 treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796059_0.png resize: (173, 179) 1361491344 -2.561974555849145 treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796053_0.png resize: (271, 260) 1361491346 -1.3835043132084213 treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796060_0.png resize: (125, 155) 1361491347 -0.9982250406417714 treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796043_0.png resize: (462, 134) 1361491348 -1.730693218458381 treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796055_0.png resize: (390, 219) 1361491349 -0.4603783715700578 treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796047_0.png resize: (286, 229) 1361491350 -2.525327052970717 treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796045_0.png resize: (96, 302) 1361491351 -1.0705754722245913 treat image : temp/1748431227_1306609_1361472077_7d63a47322d62dd157310634e53276ff_rle_crop_3814796068_0.png resize: (256, 167) 1361491352 -1.1189508810057551 treat image : temp/1748431227_1306609_1361472077_7d63a47322d62dd157310634e53276ff_rle_crop_3814796063_0.png resize: (230, 199) 1361491353 -1.8511815508880252 treat image : temp/1748431227_1306609_1361472077_7d63a47322d62dd157310634e53276ff_rle_crop_3814796070_0.png resize: (181, 184) 1361491354 -1.170148157145387 treat image : temp/1748431227_1306609_1361472077_7d63a47322d62dd157310634e53276ff_rle_crop_3814796069_0.png resize: (275, 92) 1361491355 -1.7818221450419252 treat image : temp/1748431227_1306609_1361472077_7d63a47322d62dd157310634e53276ff_rle_crop_3814796071_0.png resize: (222, 199) 1361491356 -0.9196863364468167 treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795956_0.png resize: (174, 210) 1361491384 -1.0061001609889715 treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795971_0.png resize: (264, 166) 1361491385 -1.387662970829059 treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795982_0.png resize: (157, 171) 1361491386 -1.2084481378239809 treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795988_0.png resize: (210, 335) 1361491387 -0.8134517157485973 treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814796007_0.png resize: (201, 66) 1361491388 5.913843985326124 treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814796006_0.png resize: (137, 377) 1361491389 -0.5354058058579636 treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814795998_0.png resize: (101, 299) 1361491390 -0.2064208657178204 treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796011_0.png resize: (123, 173) 1361491391 -1.4620440002022799 treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796010_0.png resize: (193, 209) 1361491392 -1.2639872687080127 treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796015_0.png resize: (285, 204) 1361491393 -0.23061839051055727 treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796039_0.png resize: (214, 167) 1361491394 -1.0787554218930324 treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796038_0.png resize: (152, 256) 1361491395 -0.7017517358645092 treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796057_0.png resize: (169, 132) 1361491396 -0.6693858344002148 treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796056_0.png resize: (128, 150) 1361491397 -0.9450588842974931 treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796052_0.png resize: (151, 246) 1361491398 -1.1223486452623284 treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796058_0.png resize: (298, 121) 1361491399 -1.8885738323082564 treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796046_0.png resize: (113, 183) 1361491401 -1.082867009026234 treat image : temp/1748431227_1306609_1361472077_7d63a47322d62dd157310634e53276ff_rle_crop_3814796067_0.png resize: (285, 439) 1361491403 -0.9243767491493747 treat image : temp/1748431227_1306609_1361472077_7d63a47322d62dd157310634e53276ff_rle_crop_3814796062_0.png resize: (163, 181) 1361491406 0.08862362232726824 treat image : temp/1748431227_1306609_1361472077_7d63a47322d62dd157310634e53276ff_rle_crop_3814796066_0.png resize: (153, 172) 1361491410 -1.7290189716391935 treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795953_0.png resize: (271, 273) 1361491476 -1.7699581871212533 treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795960_0.png resize: (189, 296) 1361491477 -2.8901442103419677 treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795963_0.png resize: (165, 267) 1361491478 -2.392169341211549 treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795959_0.png resize: (199, 219) 1361491479 -3.3159318550253936 treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795958_0.png resize: (193, 534) 1361491480 -3.7285515564124525 treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795966_0.png resize: (276, 481) 1361491482 -1.1214376168049283 treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795962_0.png resize: (365, 260) 1361491484 -2.005229817945258 treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795965_0.png resize: (190, 204) 1361491486 -2.550537361139181 treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795980_0.png resize: (233, 174) 1361491488 -1.9765206578171175 treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795978_0.png resize: (207, 287) 1361491491 -1.033560600636505 treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795977_0.png resize: (303, 487) 1361491493 -2.0863273224007735 treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795975_0.png resize: (132, 164) 1361491494 -1.2773112367378634 treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795974_0.png resize: (212, 299) 1361491495 -2.4079286386247087 treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795970_0.png resize: (299, 294) 1361491497 -1.4589221743454461 treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795979_0.png resize: (320, 262) 1361491498 -3.038335623006548 treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795991_0.png resize: (273, 172) 1361491499 -0.34644683470663495 treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795993_0.png resize: (122, 229) 1361491500 -2.5329515810334247 treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796025_0.png resize: (269, 339) 1361491501 -1.377246716538282 treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796020_0.png resize: (343, 329) 1361491502 -1.7312384672752708 treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796019_0.png resize: (161, 334) 1361491503 -1.6088230257610574 treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796013_0.png resize: (185, 246) 1361491504 -1.911836432732152 treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796023_0.png resize: (180, 303) 1361491505 -1.7569546028309546 treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796018_0.png resize: (262, 284) 1361491507 -2.163869048391954 treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796030_0.png resize: (173, 887) 1361491509 -1.7603209172154437 treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796029_0.png resize: (199, 236) 1361491510 -2.5700837033184514 treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796034_0.png resize: (169, 103) 1361491511 -0.6089133610011737 treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796061_0.png resize: (95, 262) 1361491512 -3.418414028128407 treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796051_0.png resize: (299, 292) 1361491513 -2.6062394959650703 treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796049_0.png resize: (279, 379) 1361491514 -2.879445040387315 treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796050_0.png resize: (235, 473) 1361491515 -1.919154579412009 treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796054_0.png resize: (424, 341) 1361491516 -1.1643986909471409 treat image : temp/1748431227_1306609_1361472077_7d63a47322d62dd157310634e53276ff_rle_crop_3814796064_0.png resize: (223, 220) 1361491517 -2.1641359091765877 treat image : temp/1748431227_1306609_1361472077_7d63a47322d62dd157310634e53276ff_rle_crop_3814796065_0.png resize: (246, 269) 1361491518 -1.002554869331738 treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814796000_0.png resize: (115, 81) 1361491534 0.5228296175761126 treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796012_0.png resize: (353, 321) 1361491535 -0.2067906543965188 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 129 time used for this insertion : 0.017963886260986328 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 129 time used for this insertion : 0.030170679092407227 save missing photos in datou_result : time spend for datou_step_exec : 28.830787420272827 time spend to save output : 0.05303812026977539 total time spend for step 6 : 28.883825540542603 step7:brightness Wed May 28 13:24:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20.jpg treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3.jpg treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb.jpg treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6.jpg treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8.jpg treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c.jpg treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4.jpg treat image : temp/1748431227_1306609_1361472077_7d63a47322d62dd157310634e53276ff.jpg treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795961_0.png treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795951_0.png treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795952_0.png treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795957_0.png treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795967_0.png treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795955_0.png treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795954_0.png treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795964_0.png treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795969_0.png treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795968_0.png treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795972_0.png treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795976_0.png treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795973_0.png treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795984_0.png treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795986_0.png treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795990_0.png treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795989_0.png treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795981_0.png treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795985_0.png treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795987_0.png treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795983_0.png treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795992_0.png treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814795994_0.png treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814795999_0.png treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814796005_0.png treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814795996_0.png treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814796002_0.png treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814796001_0.png treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814796004_0.png treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814796008_0.png treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814795995_0.png treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814795997_0.png treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814796003_0.png treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796022_0.png treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796024_0.png treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796017_0.png treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796014_0.png treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796021_0.png treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796016_0.png treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796009_0.png treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796027_0.png treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796036_0.png treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796035_0.png treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796042_0.png treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796041_0.png treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796037_0.png treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796031_0.png treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796026_0.png treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796033_0.png treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796040_0.png treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796028_0.png treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796032_0.png treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796044_0.png treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796048_0.png treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796059_0.png treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796053_0.png treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796060_0.png treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796043_0.png treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796055_0.png treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796047_0.png treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796045_0.png treat image : temp/1748431227_1306609_1361472077_7d63a47322d62dd157310634e53276ff_rle_crop_3814796068_0.png treat image : temp/1748431227_1306609_1361472077_7d63a47322d62dd157310634e53276ff_rle_crop_3814796063_0.png treat image : temp/1748431227_1306609_1361472077_7d63a47322d62dd157310634e53276ff_rle_crop_3814796070_0.png treat image : temp/1748431227_1306609_1361472077_7d63a47322d62dd157310634e53276ff_rle_crop_3814796069_0.png treat image : temp/1748431227_1306609_1361472077_7d63a47322d62dd157310634e53276ff_rle_crop_3814796071_0.png treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795956_0.png treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795971_0.png treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795982_0.png treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795988_0.png treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814796007_0.png treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814796006_0.png treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814795998_0.png treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796011_0.png treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796010_0.png treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796015_0.png treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796039_0.png treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796038_0.png treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796057_0.png treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796056_0.png treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796052_0.png treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796058_0.png treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796046_0.png treat image : temp/1748431227_1306609_1361472077_7d63a47322d62dd157310634e53276ff_rle_crop_3814796067_0.png treat image : temp/1748431227_1306609_1361472077_7d63a47322d62dd157310634e53276ff_rle_crop_3814796062_0.png treat image : temp/1748431227_1306609_1361472077_7d63a47322d62dd157310634e53276ff_rle_crop_3814796066_0.png treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795953_0.png treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795960_0.png treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795963_0.png treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795959_0.png treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795958_0.png treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795966_0.png treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795962_0.png treat image : temp/1748431227_1306609_1361485510_0ee217d54d61ebe214e5fd09a6a00d20_rle_crop_3814795965_0.png treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795980_0.png treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795978_0.png treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795977_0.png treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795975_0.png treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795974_0.png treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795970_0.png treat image : temp/1748431227_1306609_1361485489_391179250819a1327e544f938578f1d3_rle_crop_3814795979_0.png treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795991_0.png treat image : temp/1748431227_1306609_1361485473_6d35b75c9e39a2197c6f3825b4c77dfb_rle_crop_3814795993_0.png treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796025_0.png treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796020_0.png treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796019_0.png treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796013_0.png treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796023_0.png treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796018_0.png treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796030_0.png treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796029_0.png treat image : temp/1748431227_1306609_1361472120_d1e7e5e020ae038c0c1dd0c573c5436c_rle_crop_3814796034_0.png treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796061_0.png treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796051_0.png treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796049_0.png treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796050_0.png treat image : temp/1748431227_1306609_1361472095_a3b448c0cd8edb4e0519d3f4f677e6f4_rle_crop_3814796054_0.png treat image : temp/1748431227_1306609_1361472077_7d63a47322d62dd157310634e53276ff_rle_crop_3814796064_0.png treat image : temp/1748431227_1306609_1361472077_7d63a47322d62dd157310634e53276ff_rle_crop_3814796065_0.png treat image : temp/1748431227_1306609_1361485454_99adb1f1c4a6a89ac4b7ab10e2392ea6_rle_crop_3814796000_0.png treat image : temp/1748431227_1306609_1361472139_4df27be9b3c62b59c90fa5cc0e83a9a8_rle_crop_3814796012_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 129 time used for this insertion : 0.021218061447143555 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 129 time used for this insertion : 0.030330419540405273 save missing photos in datou_result : time spend for datou_step_exec : 7.358566045761108 time spend to save output : 0.05627775192260742 total time spend for step 7 : 7.414843797683716 step8:velours_tree Wed May 28 13:24:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.15476107597351074 time spend to save output : 4.267692565917969e-05 total time spend for step 8 : 0.15480375289916992 step9:send_mail_cod Wed May 28 13:24:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23415307_28-05-2025_13_24_24.pdf 23415336 imagette234153361748431464 23415337 imagette234153371748431464 23415338 change filename to text .imagette234153381748431464 23415339 imagette234153391748431464 23415340 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette234153401748431464 23415341 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette234153411748431466 23415343 imagette234153431748431467 23415344 change filename to text .change filename to text .imagette234153441748431467 23415345 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette234153451748431467 23415346 imagette234153461748431468 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23415307 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23415336,23415337,23415338,23415339,23415340,23415341,23415342,23415343,23415344,23415345,23415346?tags=pehd,mal_croppe,metal,background,carton,papier,environnement,flou,autre,pet_clair,pet_fonce args[1361485510] : ((1361485510, -2.53831400479089, 492609224), (1361485510, 0.2427912323708921, 2107752395), '0.0733784062670207') We are sending mail with results at report@fotonower.com args[1361485489] : ((1361485489, -2.304618368406611, 492609224), (1361485489, 0.3243210133248891, 2107752395), '0.0733784062670207') We are sending mail with results at report@fotonower.com args[1361485473] : ((1361485473, -1.367485664229697, 492688767), (1361485473, -0.014765260728124913, 2107752395), '0.0733784062670207') We are sending mail with results at report@fotonower.com args[1361485454] : ((1361485454, -1.7565271628439176, 492688767), (1361485454, 0.2402268321880147, 2107752395), '0.0733784062670207') We are sending mail with results at report@fotonower.com args[1361472139] : ((1361472139, -0.791135454197802, 492688767), (1361472139, 0.18264077754035685, 2107752395), '0.0733784062670207') We are sending mail with results at report@fotonower.com args[1361472120] : ((1361472120, -1.7952878837854955, 492688767), (1361472120, 0.19710716167965506, 2107752395), '0.0733784062670207') We are sending mail with results at report@fotonower.com args[1361472095] : ((1361472095, -2.641925279747406, 492609224), (1361472095, 0.16621616826200683, 2107752395), '0.0733784062670207') We are sending mail with results at report@fotonower.com args[1361472077] : ((1361472077, 0.1984135816546183, 492688767), (1361472077, 0.24224496419454658, 2107752395), '0.0733784062670207') We are sending mail with results at report@fotonower.com refus_total : 0.0733784062670207 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23415307 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23415307_28-05-2025_13_24_24.pdf results_Auto_P23415307_28-05-2025_13_24_24.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23415307_28-05-2025_13_24_24.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23415307','results_Auto_P23415307_28-05-2025_13_24_24.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23415307_28-05-2025_13_24_24.pdf','pdf','','0.5','0.0733784062670207') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23415307

https://www.fotonower.com/image?json=false&list_photos_id=1361485510
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361485489
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361485473
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361485454
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361472139
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361472120
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361472095
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361472077
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 7.34%
Veuillez trouver les photos des contaminants.

exemples de contaminants: metal: https://www.fotonower.com/view/23415338?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23415340?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23415341?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23415344?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23415345?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23415307_28-05-2025_13_24_24.pdf.

Lien vers velours :https://www.fotonower.com/velours/23415336,23415337,23415338,23415339,23415340,23415341,23415342,23415343,23415344,23415345,23415346?tags=pehd,mal_croppe,metal,background,carton,papier,environnement,flou,autre,pet_clair,pet_fonce.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 28 May 2025 11:24:31 GMT Content-Length: 0 Connection: close X-Message-Id: A1hUGk8WRj2_06Jv8gU3aw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1361485510, 1361485489, 1361485473, 1361485454, 1361472139, 1361472120, 1361472095, 1361472077] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361485510', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361485489', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361485473', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361485454', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361472139', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361472120', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361472095', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361472077', None, None, None, None, None, '2975873') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.013798236846923828 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.583399772644043 time spend to save output : 0.014090299606323242 total time spend for step 9 : 6.597490072250366 step10:split_time_score Wed May 28 13:24:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('12', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 28052025 23415307 Nombre de photos uploadées : 8 / 23040 (0%) 28052025 23415307 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 28052025 23415307 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 5.7220458984375e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.00044918060302734375 elapsed_time : insert_dashboard_record_day_entry 0.02237677574157715 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23412052 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23409912 order by id desc limit 1 Qualite : 0.09322079815722585 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23412055_28-05-2025_12_13_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23412055 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23412055 AND mptpi.`type`=3594 To do Qualite : 0.0733784062670207 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23415307_28-05-2025_13_24_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23415307 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23415307 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'28052025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1361485510, 1361485489, 1361485473, 1361485454, 1361472139, 1361472120, 1361472095, 1361472077] Looping around the photos to save general results len do output : 1 /23415307Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361485510', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361485489', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361485473', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361485454', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361472139', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361472120', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361472095', None, None, None, None, None, '2975873') ('3318', None, None, None, None, None, None, None, '2975873') ('3318', '23415307', '1361472077', None, None, None, None, None, '2975873') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.013298273086547852 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.0215866565704346 time spend to save output : 0.013476371765136719 total time spend for step 10 : 2.0350630283355713 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 101.34user 104.49system 4:08.39elapsed 82%CPU (0avgtext+0avgdata 5055184maxresident)k 609352inputs+55144outputs (3005major+10807954minor)pagefaults 0swaps