python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2451742 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2726919'] with mtr_portfolio_ids : ['22089282'] and first list_photo_ids : [] new path : /proc/2451742/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 1.4626328945159912 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Apr 16 17:30:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-04-16 17:30:33.793589: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-04-16 17:30:33.823081: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-04-16 17:30:33.825276: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f8974000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-04-16 17:30:33.825323: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-04-16 17:30:33.830387: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-04-16 17:30:34.133328: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x226eb5c0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-04-16 17:30:34.133384: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-04-16 17:30:34.134973: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-16 17:30:34.135678: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-16 17:30:34.139555: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-16 17:30:34.143548: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-16 17:30:34.143969: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-16 17:30:34.146670: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-16 17:30:34.148182: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-16 17:30:34.154237: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-16 17:30:34.155767: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-16 17:30:34.155875: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-16 17:30:34.156773: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-16 17:30:34.156791: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-16 17:30:34.156800: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-16 17:30:34.158643: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9879 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-04-16 17:30:34.538479: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-16 17:30:34.538706: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-16 17:30:34.538762: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-16 17:30:34.538802: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-16 17:30:34.538838: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-16 17:30:34.538870: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-16 17:30:34.538915: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-16 17:30:34.538956: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-16 17:30:34.540722: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-16 17:30:34.542373: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-16 17:30:34.542446: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-16 17:30:34.542489: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-16 17:30:34.542536: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-16 17:30:34.542579: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-16 17:30:34.542620: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-16 17:30:34.542652: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-16 17:30:34.542693: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-16 17:30:34.544441: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-16 17:30:34.544503: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-16 17:30:34.544523: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-16 17:30:34.544537: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-16 17:30:34.546391: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9879 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-04-16 17:30:47.219479: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-16 17:30:47.479169: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 42 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 57 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 50 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 35 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 60 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 11.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 31 Detection mask done ! Trying to reset tf kernel 2452639 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 579 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9400 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0009622573852539062 nb_pixel_total : 20836 time to create 1 rle with old method : 0.026039838790893555 length of segment : 153 time for calcul the mask position with numpy : 0.0012180805206298828 nb_pixel_total : 30568 time to create 1 rle with old method : 0.035511016845703125 length of segment : 174 time for calcul the mask position with numpy : 0.008167505264282227 nb_pixel_total : 205280 time to create 1 rle with new method : 0.01413106918334961 length of segment : 790 time for calcul the mask position with numpy : 0.0015645027160644531 nb_pixel_total : 42701 time to create 1 rle with old method : 0.0494387149810791 length of segment : 592 time for calcul the mask position with numpy : 0.0028693675994873047 nb_pixel_total : 100273 time to create 1 rle with old method : 0.11959671974182129 length of segment : 473 time for calcul the mask position with numpy : 0.0029985904693603516 nb_pixel_total : 96900 time to create 1 rle with old method : 0.13703656196594238 length of segment : 423 time for calcul the mask position with numpy : 0.0027751922607421875 nb_pixel_total : 90365 time to create 1 rle with old method : 0.11380743980407715 length of segment : 472 time for calcul the mask position with numpy : 0.0039789676666259766 nb_pixel_total : 77930 time to create 1 rle with old method : 0.09342384338378906 length of segment : 543 time for calcul the mask position with numpy : 0.0032415390014648438 nb_pixel_total : 73901 time to create 1 rle with old method : 0.08674907684326172 length of segment : 358 time for calcul the mask position with numpy : 0.0015289783477783203 nb_pixel_total : 66447 time to create 1 rle with old method : 0.07975578308105469 length of segment : 255 time for calcul the mask position with numpy : 0.0024721622467041016 nb_pixel_total : 130700 time to create 1 rle with old method : 0.15279531478881836 length of segment : 442 time for calcul the mask position with numpy : 0.00017523765563964844 nb_pixel_total : 3097 time to create 1 rle with old method : 0.0035927295684814453 length of segment : 68 time for calcul the mask position with numpy : 0.059514522552490234 nb_pixel_total : 1126948 time to create 1 rle with new method : 0.1315469741821289 length of segment : 2096 time for calcul the mask position with numpy : 0.008520364761352539 nb_pixel_total : 445944 time to create 1 rle with new method : 0.15938806533813477 length of segment : 1135 time for calcul the mask position with numpy : 0.0013551712036132812 nb_pixel_total : 62670 time to create 1 rle with old method : 0.0705404281616211 length of segment : 388 time for calcul the mask position with numpy : 0.0013587474822998047 nb_pixel_total : 56705 time to create 1 rle with old method : 0.06488895416259766 length of segment : 408 time for calcul the mask position with numpy : 0.0010073184967041016 nb_pixel_total : 47877 time to create 1 rle with old method : 0.055829763412475586 length of segment : 222 time for calcul the mask position with numpy : 0.005741596221923828 nb_pixel_total : 249093 time to create 1 rle with new method : 0.014415979385375977 length of segment : 744 time for calcul the mask position with numpy : 0.0013723373413085938 nb_pixel_total : 41955 time to create 1 rle with old method : 0.048245906829833984 length of segment : 448 time for calcul the mask position with numpy : 0.001649618148803711 nb_pixel_total : 82398 time to create 1 rle with old method : 0.0952754020690918 length of segment : 251 time for calcul the mask position with numpy : 0.0027740001678466797 nb_pixel_total : 142591 time to create 1 rle with old method : 0.1789395809173584 length of segment : 379 time for calcul the mask position with numpy : 0.002198457717895508 nb_pixel_total : 103443 time to create 1 rle with old method : 0.1172785758972168 length of segment : 343 time for calcul the mask position with numpy : 0.00033283233642578125 nb_pixel_total : 11805 time to create 1 rle with old method : 0.016321420669555664 length of segment : 109 time for calcul the mask position with numpy : 0.004125118255615234 nb_pixel_total : 205944 time to create 1 rle with new method : 0.009966135025024414 length of segment : 431 time for calcul the mask position with numpy : 0.001355886459350586 nb_pixel_total : 50408 time to create 1 rle with old method : 0.06784558296203613 length of segment : 202 time for calcul the mask position with numpy : 0.0011317729949951172 nb_pixel_total : 33220 time to create 1 rle with old method : 0.03860068321228027 length of segment : 141 time for calcul the mask position with numpy : 0.0027294158935546875 nb_pixel_total : 92565 time to create 1 rle with old method : 0.10622119903564453 length of segment : 528 time for calcul the mask position with numpy : 0.001764535903930664 nb_pixel_total : 74336 time to create 1 rle with old method : 0.08475208282470703 length of segment : 308 time for calcul the mask position with numpy : 0.0020377635955810547 nb_pixel_total : 84389 time to create 1 rle with old method : 0.09880185127258301 length of segment : 397 time for calcul the mask position with numpy : 0.00037097930908203125 nb_pixel_total : 12011 time to create 1 rle with old method : 0.014076709747314453 length of segment : 114 time for calcul the mask position with numpy : 0.0008733272552490234 nb_pixel_total : 26746 time to create 1 rle with old method : 0.0332036018371582 length of segment : 245 time for calcul the mask position with numpy : 0.0025627613067626953 nb_pixel_total : 67576 time to create 1 rle with old method : 0.0850365161895752 length of segment : 391 time for calcul the mask position with numpy : 0.0008246898651123047 nb_pixel_total : 22849 time to create 1 rle with old method : 0.027372360229492188 length of segment : 209 time for calcul the mask position with numpy : 0.0020089149475097656 nb_pixel_total : 77270 time to create 1 rle with old method : 0.08969807624816895 length of segment : 307 time for calcul the mask position with numpy : 0.0021741390228271484 nb_pixel_total : 56861 time to create 1 rle with old method : 0.0687563419342041 length of segment : 433 time for calcul the mask position with numpy : 0.0012676715850830078 nb_pixel_total : 37698 time to create 1 rle with old method : 0.04459881782531738 length of segment : 409 time for calcul the mask position with numpy : 0.0026378631591796875 nb_pixel_total : 92539 time to create 1 rle with old method : 0.10510015487670898 length of segment : 580 time for calcul the mask position with numpy : 0.001043081283569336 nb_pixel_total : 29980 time to create 1 rle with old method : 0.037055253982543945 length of segment : 111 time for calcul the mask position with numpy : 0.0008802413940429688 nb_pixel_total : 26335 time to create 1 rle with old method : 0.04400277137756348 length of segment : 184 time for calcul the mask position with numpy : 0.0005066394805908203 nb_pixel_total : 13349 time to create 1 rle with old method : 0.01744246482849121 length of segment : 309 time for calcul the mask position with numpy : 0.0006499290466308594 nb_pixel_total : 24579 time to create 1 rle with old method : 0.02858901023864746 length of segment : 206 time for calcul the mask position with numpy : 0.0035834312438964844 nb_pixel_total : 156232 time to create 1 rle with new method : 0.008957386016845703 length of segment : 314 time for calcul the mask position with numpy : 0.0003762245178222656 nb_pixel_total : 11009 time to create 1 rle with old method : 0.018802642822265625 length of segment : 113 time for calcul the mask position with numpy : 0.0022125244140625 nb_pixel_total : 51786 time to create 1 rle with old method : 0.06705069541931152 length of segment : 348 time for calcul the mask position with numpy : 0.0014519691467285156 nb_pixel_total : 42399 time to create 1 rle with old method : 0.04957270622253418 length of segment : 388 time for calcul the mask position with numpy : 0.0007793903350830078 nb_pixel_total : 19087 time to create 1 rle with old method : 0.02371072769165039 length of segment : 159 time for calcul the mask position with numpy : 0.0011763572692871094 nb_pixel_total : 29630 time to create 1 rle with old method : 0.0347597599029541 length of segment : 243 time for calcul the mask position with numpy : 0.0007259845733642578 nb_pixel_total : 23492 time to create 1 rle with old method : 0.02804398536682129 length of segment : 222 time for calcul the mask position with numpy : 0.00020194053649902344 nb_pixel_total : 5946 time to create 1 rle with old method : 0.007331132888793945 length of segment : 98 time for calcul the mask position with numpy : 0.0006811618804931641 nb_pixel_total : 19580 time to create 1 rle with old method : 0.02299356460571289 length of segment : 189 time for calcul the mask position with numpy : 0.0012507438659667969 nb_pixel_total : 37557 time to create 1 rle with old method : 0.04639434814453125 length of segment : 265 time for calcul the mask position with numpy : 0.0009241104125976562 nb_pixel_total : 24918 time to create 1 rle with old method : 0.041065216064453125 length of segment : 147 time for calcul the mask position with numpy : 0.0014891624450683594 nb_pixel_total : 54333 time to create 1 rle with old method : 0.06257414817810059 length of segment : 286 time for calcul the mask position with numpy : 0.0008461475372314453 nb_pixel_total : 25820 time to create 1 rle with old method : 0.030193328857421875 length of segment : 286 time for calcul the mask position with numpy : 0.0003523826599121094 nb_pixel_total : 8646 time to create 1 rle with old method : 0.010302543640136719 length of segment : 143 time for calcul the mask position with numpy : 0.0011608600616455078 nb_pixel_total : 35821 time to create 1 rle with old method : 0.043729305267333984 length of segment : 321 time for calcul the mask position with numpy : 0.00012159347534179688 nb_pixel_total : 4196 time to create 1 rle with old method : 0.005182981491088867 length of segment : 53 time for calcul the mask position with numpy : 0.0016646385192871094 nb_pixel_total : 44690 time to create 1 rle with old method : 0.0530397891998291 length of segment : 330 time for calcul the mask position with numpy : 0.0004973411560058594 nb_pixel_total : 18171 time to create 1 rle with old method : 0.02173471450805664 length of segment : 142 time for calcul the mask position with numpy : 0.0013530254364013672 nb_pixel_total : 45972 time to create 1 rle with old method : 0.054746150970458984 length of segment : 373 time for calcul the mask position with numpy : 0.0004200935363769531 nb_pixel_total : 17105 time to create 1 rle with old method : 0.020031213760375977 length of segment : 196 time for calcul the mask position with numpy : 0.001211404800415039 nb_pixel_total : 65347 time to create 1 rle with old method : 0.07549548149108887 length of segment : 317 time for calcul the mask position with numpy : 0.0013370513916015625 nb_pixel_total : 50356 time to create 1 rle with old method : 0.05717182159423828 length of segment : 417 time for calcul the mask position with numpy : 0.0009765625 nb_pixel_total : 38643 time to create 1 rle with old method : 0.04432106018066406 length of segment : 387 time for calcul the mask position with numpy : 0.0019230842590332031 nb_pixel_total : 78467 time to create 1 rle with old method : 0.08993220329284668 length of segment : 323 time for calcul the mask position with numpy : 0.005529165267944336 nb_pixel_total : 182159 time to create 1 rle with new method : 0.015557050704956055 length of segment : 584 time for calcul the mask position with numpy : 0.0004525184631347656 nb_pixel_total : 14346 time to create 1 rle with old method : 0.016610145568847656 length of segment : 158 time for calcul the mask position with numpy : 0.0011851787567138672 nb_pixel_total : 45873 time to create 1 rle with old method : 0.053234100341796875 length of segment : 168 time for calcul the mask position with numpy : 0.0003769397735595703 nb_pixel_total : 15234 time to create 1 rle with old method : 0.018227338790893555 length of segment : 137 time for calcul the mask position with numpy : 0.0008902549743652344 nb_pixel_total : 37501 time to create 1 rle with old method : 0.04511904716491699 length of segment : 273 time for calcul the mask position with numpy : 0.00039887428283691406 nb_pixel_total : 14200 time to create 1 rle with old method : 0.016755104064941406 length of segment : 132 time for calcul the mask position with numpy : 0.0006642341613769531 nb_pixel_total : 27209 time to create 1 rle with old method : 0.031116724014282227 length of segment : 270 time for calcul the mask position with numpy : 0.0005037784576416016 nb_pixel_total : 20170 time to create 1 rle with old method : 0.02343273162841797 length of segment : 170 time for calcul the mask position with numpy : 0.0028297901153564453 nb_pixel_total : 75543 time to create 1 rle with old method : 0.08673596382141113 length of segment : 518 time for calcul the mask position with numpy : 0.003779888153076172 nb_pixel_total : 77095 time to create 1 rle with old method : 0.08735847473144531 length of segment : 669 time for calcul the mask position with numpy : 0.0008325576782226562 nb_pixel_total : 37342 time to create 1 rle with old method : 0.04335737228393555 length of segment : 254 time for calcul the mask position with numpy : 0.0008988380432128906 nb_pixel_total : 37581 time to create 1 rle with old method : 0.04372668266296387 length of segment : 247 time for calcul the mask position with numpy : 0.00196075439453125 nb_pixel_total : 96081 time to create 1 rle with old method : 0.10989856719970703 length of segment : 613 time for calcul the mask position with numpy : 0.0004241466522216797 nb_pixel_total : 13284 time to create 1 rle with old method : 0.016064167022705078 length of segment : 130 time for calcul the mask position with numpy : 0.0005288124084472656 nb_pixel_total : 16565 time to create 1 rle with old method : 0.019413232803344727 length of segment : 159 time for calcul the mask position with numpy : 0.0003371238708496094 nb_pixel_total : 17866 time to create 1 rle with old method : 0.0209805965423584 length of segment : 102 time for calcul the mask position with numpy : 0.0017681121826171875 nb_pixel_total : 98335 time to create 1 rle with old method : 0.11040806770324707 length of segment : 424 time for calcul the mask position with numpy : 0.0013430118560791016 nb_pixel_total : 63203 time to create 1 rle with old method : 0.07304596900939941 length of segment : 240 time for calcul the mask position with numpy : 0.005918264389038086 nb_pixel_total : 245719 time to create 1 rle with new method : 0.014983177185058594 length of segment : 983 time for calcul the mask position with numpy : 0.0003261566162109375 nb_pixel_total : 8952 time to create 1 rle with old method : 0.010639429092407227 length of segment : 105 time for calcul the mask position with numpy : 0.0002799034118652344 nb_pixel_total : 8515 time to create 1 rle with old method : 0.010393381118774414 length of segment : 106 time for calcul the mask position with numpy : 0.0003991127014160156 nb_pixel_total : 10765 time to create 1 rle with old method : 0.013226985931396484 length of segment : 157 time for calcul the mask position with numpy : 0.003432035446166992 nb_pixel_total : 143880 time to create 1 rle with old method : 0.16684961318969727 length of segment : 344 time for calcul the mask position with numpy : 0.0005116462707519531 nb_pixel_total : 21493 time to create 1 rle with old method : 0.02499079704284668 length of segment : 156 time for calcul the mask position with numpy : 0.0009806156158447266 nb_pixel_total : 42677 time to create 1 rle with old method : 0.0521697998046875 length of segment : 201 time for calcul the mask position with numpy : 0.0023927688598632812 nb_pixel_total : 120979 time to create 1 rle with old method : 0.13723444938659668 length of segment : 356 time for calcul the mask position with numpy : 0.0012218952178955078 nb_pixel_total : 33440 time to create 1 rle with old method : 0.05456066131591797 length of segment : 212 time for calcul the mask position with numpy : 0.00016307830810546875 nb_pixel_total : 7182 time to create 1 rle with old method : 0.008650779724121094 length of segment : 82 time for calcul the mask position with numpy : 0.005384206771850586 nb_pixel_total : 235916 time to create 1 rle with new method : 0.016660451889038086 length of segment : 719 time for calcul the mask position with numpy : 0.0025696754455566406 nb_pixel_total : 120150 time to create 1 rle with old method : 0.18480658531188965 length of segment : 524 time for calcul the mask position with numpy : 0.0005505084991455078 nb_pixel_total : 15788 time to create 1 rle with old method : 0.01865983009338379 length of segment : 161 time for calcul the mask position with numpy : 0.0004684925079345703 nb_pixel_total : 16078 time to create 1 rle with old method : 0.026413679122924805 length of segment : 173 time for calcul the mask position with numpy : 0.003519773483276367 nb_pixel_total : 100974 time to create 1 rle with old method : 0.11894893646240234 length of segment : 530 time for calcul the mask position with numpy : 0.0009505748748779297 nb_pixel_total : 27186 time to create 1 rle with old method : 0.03120899200439453 length of segment : 265 time for calcul the mask position with numpy : 0.0007398128509521484 nb_pixel_total : 39598 time to create 1 rle with old method : 0.04600381851196289 length of segment : 189 time for calcul the mask position with numpy : 0.0017104148864746094 nb_pixel_total : 51624 time to create 1 rle with old method : 0.06323027610778809 length of segment : 340 time for calcul the mask position with numpy : 0.0027408599853515625 nb_pixel_total : 88114 time to create 1 rle with old method : 0.11081981658935547 length of segment : 338 time for calcul the mask position with numpy : 0.016950130462646484 nb_pixel_total : 582902 time to create 1 rle with new method : 0.044185638427734375 length of segment : 1124 time for calcul the mask position with numpy : 0.0006835460662841797 nb_pixel_total : 20174 time to create 1 rle with old method : 0.02351975440979004 length of segment : 168 time for calcul the mask position with numpy : 0.00038623809814453125 nb_pixel_total : 13968 time to create 1 rle with old method : 0.021764755249023438 length of segment : 125 time for calcul the mask position with numpy : 0.00027751922607421875 nb_pixel_total : 11075 time to create 1 rle with old method : 0.01852869987487793 length of segment : 130 time for calcul the mask position with numpy : 0.0009567737579345703 nb_pixel_total : 43535 time to create 1 rle with old method : 0.05242919921875 length of segment : 387 time for calcul the mask position with numpy : 0.0007953643798828125 nb_pixel_total : 23314 time to create 1 rle with old method : 0.02717423439025879 length of segment : 335 time for calcul the mask position with numpy : 0.0005016326904296875 nb_pixel_total : 24909 time to create 1 rle with old method : 0.028956890106201172 length of segment : 174 time for calcul the mask position with numpy : 0.0004563331604003906 nb_pixel_total : 19952 time to create 1 rle with old method : 0.023924827575683594 length of segment : 182 time for calcul the mask position with numpy : 0.00048828125 nb_pixel_total : 22245 time to create 1 rle with old method : 0.02718663215637207 length of segment : 174 time for calcul the mask position with numpy : 0.0017719268798828125 nb_pixel_total : 52781 time to create 1 rle with old method : 0.06204795837402344 length of segment : 309 time for calcul the mask position with numpy : 0.0007042884826660156 nb_pixel_total : 27930 time to create 1 rle with old method : 0.03279423713684082 length of segment : 220 time for calcul the mask position with numpy : 0.0003666877746582031 nb_pixel_total : 20448 time to create 1 rle with old method : 0.024201631546020508 length of segment : 194 time for calcul the mask position with numpy : 0.0006244182586669922 nb_pixel_total : 25814 time to create 1 rle with old method : 0.03092813491821289 length of segment : 171 time for calcul the mask position with numpy : 0.00018978118896484375 nb_pixel_total : 7063 time to create 1 rle with old method : 0.00837254524230957 length of segment : 119 time for calcul the mask position with numpy : 0.00033402442932128906 nb_pixel_total : 14691 time to create 1 rle with old method : 0.017155885696411133 length of segment : 190 time for calcul the mask position with numpy : 0.0007727146148681641 nb_pixel_total : 33915 time to create 1 rle with old method : 0.03922843933105469 length of segment : 281 time for calcul the mask position with numpy : 0.0003399848937988281 nb_pixel_total : 18416 time to create 1 rle with old method : 0.021987199783325195 length of segment : 105 time for calcul the mask position with numpy : 0.0001533031463623047 nb_pixel_total : 4350 time to create 1 rle with old method : 0.005328178405761719 length of segment : 89 time for calcul the mask position with numpy : 0.0010466575622558594 nb_pixel_total : 16303 time to create 1 rle with old method : 0.01936650276184082 length of segment : 138 time for calcul the mask position with numpy : 0.003663301467895508 nb_pixel_total : 73801 time to create 1 rle with old method : 0.08239364624023438 length of segment : 462 time for calcul the mask position with numpy : 0.009433269500732422 nb_pixel_total : 221556 time to create 1 rle with new method : 0.01906561851501465 length of segment : 1053 time for calcul the mask position with numpy : 0.0016655921936035156 nb_pixel_total : 24649 time to create 1 rle with old method : 0.02904343605041504 length of segment : 218 time for calcul the mask position with numpy : 0.0009183883666992188 nb_pixel_total : 19266 time to create 1 rle with old method : 0.023739337921142578 length of segment : 174 time for calcul the mask position with numpy : 0.0012607574462890625 nb_pixel_total : 25902 time to create 1 rle with old method : 0.029788732528686523 length of segment : 226 time for calcul the mask position with numpy : 0.0010874271392822266 nb_pixel_total : 16280 time to create 1 rle with old method : 0.02077174186706543 length of segment : 164 time for calcul the mask position with numpy : 0.007405281066894531 nb_pixel_total : 71146 time to create 1 rle with old method : 0.08446574211120605 length of segment : 697 time for calcul the mask position with numpy : 0.0022950172424316406 nb_pixel_total : 34693 time to create 1 rle with old method : 0.04337048530578613 length of segment : 204 time for calcul the mask position with numpy : 0.004014015197753906 nb_pixel_total : 53014 time to create 1 rle with old method : 0.0609738826751709 length of segment : 316 time for calcul the mask position with numpy : 0.0034110546112060547 nb_pixel_total : 56866 time to create 1 rle with old method : 0.06337571144104004 length of segment : 419 time for calcul the mask position with numpy : 0.0015022754669189453 nb_pixel_total : 13604 time to create 1 rle with old method : 0.016148805618286133 length of segment : 336 time for calcul the mask position with numpy : 0.0021457672119140625 nb_pixel_total : 41189 time to create 1 rle with old method : 0.0483548641204834 length of segment : 164 time for calcul the mask position with numpy : 0.0008845329284667969 nb_pixel_total : 15966 time to create 1 rle with old method : 0.019130229949951172 length of segment : 154 time for calcul the mask position with numpy : 0.002458333969116211 nb_pixel_total : 40795 time to create 1 rle with old method : 0.047539710998535156 length of segment : 301 time for calcul the mask position with numpy : 0.0010924339294433594 nb_pixel_total : 20883 time to create 1 rle with old method : 0.02481865882873535 length of segment : 151 time for calcul the mask position with numpy : 0.001538991928100586 nb_pixel_total : 33654 time to create 1 rle with old method : 0.03969526290893555 length of segment : 203 time for calcul the mask position with numpy : 0.00212860107421875 nb_pixel_total : 32788 time to create 1 rle with old method : 0.03793764114379883 length of segment : 308 time for calcul the mask position with numpy : 0.006356477737426758 nb_pixel_total : 129343 time to create 1 rle with old method : 0.14635801315307617 length of segment : 550 time for calcul the mask position with numpy : 0.0015053749084472656 nb_pixel_total : 19287 time to create 1 rle with old method : 0.022374868392944336 length of segment : 236 time for calcul the mask position with numpy : 0.0007910728454589844 nb_pixel_total : 16309 time to create 1 rle with old method : 0.01929616928100586 length of segment : 129 time for calcul the mask position with numpy : 0.0003056526184082031 nb_pixel_total : 6776 time to create 1 rle with old method : 0.008344650268554688 length of segment : 77 time for calcul the mask position with numpy : 0.000690460205078125 nb_pixel_total : 11409 time to create 1 rle with old method : 0.01604151725769043 length of segment : 143 time for calcul the mask position with numpy : 0.0006456375122070312 nb_pixel_total : 29988 time to create 1 rle with old method : 0.03521013259887695 length of segment : 198 time for calcul the mask position with numpy : 0.0018131732940673828 nb_pixel_total : 60527 time to create 1 rle with old method : 0.0854043960571289 length of segment : 342 time for calcul the mask position with numpy : 0.0021491050720214844 nb_pixel_total : 107954 time to create 1 rle with old method : 0.12230944633483887 length of segment : 480 time for calcul the mask position with numpy : 0.0005674362182617188 nb_pixel_total : 27174 time to create 1 rle with old method : 0.032065391540527344 length of segment : 197 time for calcul the mask position with numpy : 0.0007519721984863281 nb_pixel_total : 40045 time to create 1 rle with old method : 0.0563504695892334 length of segment : 209 time for calcul the mask position with numpy : 0.002134561538696289 nb_pixel_total : 96965 time to create 1 rle with old method : 0.14269709587097168 length of segment : 353 time for calcul the mask position with numpy : 0.0002276897430419922 nb_pixel_total : 8083 time to create 1 rle with old method : 0.009580850601196289 length of segment : 151 time for calcul the mask position with numpy : 0.0013475418090820312 nb_pixel_total : 58144 time to create 1 rle with old method : 0.0878140926361084 length of segment : 511 time for calcul the mask position with numpy : 0.00047087669372558594 nb_pixel_total : 21583 time to create 1 rle with old method : 0.025498151779174805 length of segment : 168 time for calcul the mask position with numpy : 0.0004410743713378906 nb_pixel_total : 20429 time to create 1 rle with old method : 0.024598360061645508 length of segment : 110 time for calcul the mask position with numpy : 0.0006155967712402344 nb_pixel_total : 31132 time to create 1 rle with old method : 0.03565406799316406 length of segment : 194 time for calcul the mask position with numpy : 0.0005676746368408203 nb_pixel_total : 24544 time to create 1 rle with old method : 0.028847455978393555 length of segment : 159 time for calcul the mask position with numpy : 0.0013153553009033203 nb_pixel_total : 72466 time to create 1 rle with old method : 0.08170938491821289 length of segment : 368 time for calcul the mask position with numpy : 0.0005342960357666016 nb_pixel_total : 18788 time to create 1 rle with old method : 0.021816492080688477 length of segment : 201 time for calcul the mask position with numpy : 0.0010979175567626953 nb_pixel_total : 67490 time to create 1 rle with old method : 0.07926392555236816 length of segment : 315 time for calcul the mask position with numpy : 0.0009875297546386719 nb_pixel_total : 48042 time to create 1 rle with old method : 0.05493974685668945 length of segment : 261 time for calcul the mask position with numpy : 0.0006444454193115234 nb_pixel_total : 26204 time to create 1 rle with old method : 0.030326128005981445 length of segment : 188 time for calcul the mask position with numpy : 0.00045037269592285156 nb_pixel_total : 22331 time to create 1 rle with old method : 0.026463031768798828 length of segment : 120 time for calcul the mask position with numpy : 0.0007472038269042969 nb_pixel_total : 33057 time to create 1 rle with old method : 0.03794074058532715 length of segment : 233 time for calcul the mask position with numpy : 0.001392364501953125 nb_pixel_total : 53598 time to create 1 rle with old method : 0.061986446380615234 length of segment : 332 time for calcul the mask position with numpy : 0.0006763935089111328 nb_pixel_total : 24051 time to create 1 rle with old method : 0.028253793716430664 length of segment : 202 time for calcul the mask position with numpy : 0.0009396076202392578 nb_pixel_total : 50034 time to create 1 rle with old method : 0.05838322639465332 length of segment : 210 time for calcul the mask position with numpy : 0.0003085136413574219 nb_pixel_total : 11501 time to create 1 rle with old method : 0.013899564743041992 length of segment : 103 time for calcul the mask position with numpy : 0.0022470951080322266 nb_pixel_total : 118968 time to create 1 rle with old method : 0.13775920867919922 length of segment : 419 time for calcul the mask position with numpy : 0.0022552013397216797 nb_pixel_total : 99219 time to create 1 rle with old method : 0.11428070068359375 length of segment : 409 time for calcul the mask position with numpy : 0.0005221366882324219 nb_pixel_total : 24620 time to create 1 rle with old method : 0.028922319412231445 length of segment : 182 time for calcul the mask position with numpy : 0.004450082778930664 nb_pixel_total : 252280 time to create 1 rle with new method : 0.014159679412841797 length of segment : 1133 time for calcul the mask position with numpy : 0.0018236637115478516 nb_pixel_total : 80698 time to create 1 rle with old method : 0.09228110313415527 length of segment : 623 time for calcul the mask position with numpy : 0.0035419464111328125 nb_pixel_total : 204948 time to create 1 rle with new method : 0.010297536849975586 length of segment : 427 time for calcul the mask position with numpy : 0.002093076705932617 nb_pixel_total : 78829 time to create 1 rle with old method : 0.09765481948852539 length of segment : 475 time for calcul the mask position with numpy : 0.0025033950805664062 nb_pixel_total : 149500 time to create 1 rle with old method : 0.17063069343566895 length of segment : 452 time for calcul the mask position with numpy : 0.0057795047760009766 nb_pixel_total : 261957 time to create 1 rle with new method : 0.017583370208740234 length of segment : 757 time for calcul the mask position with numpy : 0.0005357265472412109 nb_pixel_total : 4966 time to create 1 rle with old method : 0.00619816780090332 length of segment : 108 time for calcul the mask position with numpy : 0.0007791519165039062 nb_pixel_total : 33098 time to create 1 rle with old method : 0.04240918159484863 length of segment : 144 time for calcul the mask position with numpy : 0.0014595985412597656 nb_pixel_total : 62518 time to create 1 rle with old method : 0.08022308349609375 length of segment : 332 time for calcul the mask position with numpy : 0.0030524730682373047 nb_pixel_total : 38342 time to create 1 rle with old method : 0.059157371520996094 length of segment : 755 time for calcul the mask position with numpy : 0.0012705326080322266 nb_pixel_total : 56141 time to create 1 rle with old method : 0.06576013565063477 length of segment : 206 time for calcul the mask position with numpy : 0.00036406517028808594 nb_pixel_total : 10780 time to create 1 rle with old method : 0.012931585311889648 length of segment : 119 time for calcul the mask position with numpy : 0.0013818740844726562 nb_pixel_total : 67501 time to create 1 rle with old method : 0.07964158058166504 length of segment : 321 time for calcul the mask position with numpy : 0.002974987030029297 nb_pixel_total : 136594 time to create 1 rle with old method : 0.1619584560394287 length of segment : 551 time for calcul the mask position with numpy : 0.0011951923370361328 nb_pixel_total : 68544 time to create 1 rle with old method : 0.09864497184753418 length of segment : 331 time for calcul the mask position with numpy : 0.000682830810546875 nb_pixel_total : 36006 time to create 1 rle with old method : 0.04093647003173828 length of segment : 216 time for calcul the mask position with numpy : 0.0027875900268554688 nb_pixel_total : 172099 time to create 1 rle with new method : 0.008893251419067383 length of segment : 468 time for calcul the mask position with numpy : 0.00030612945556640625 nb_pixel_total : 13987 time to create 1 rle with old method : 0.016636133193969727 length of segment : 127 time for calcul the mask position with numpy : 0.00037169456481933594 nb_pixel_total : 15738 time to create 1 rle with old method : 0.019338130950927734 length of segment : 165 time for calcul the mask position with numpy : 0.0008130073547363281 nb_pixel_total : 34559 time to create 1 rle with old method : 0.05689501762390137 length of segment : 355 time for calcul the mask position with numpy : 0.003239870071411133 nb_pixel_total : 157127 time to create 1 rle with new method : 0.008836507797241211 length of segment : 628 time for calcul the mask position with numpy : 0.00040531158447265625 nb_pixel_total : 7801 time to create 1 rle with old method : 0.011977910995483398 length of segment : 203 time for calcul the mask position with numpy : 0.0014085769653320312 nb_pixel_total : 70066 time to create 1 rle with old method : 0.08030462265014648 length of segment : 466 time for calcul the mask position with numpy : 0.0002453327178955078 nb_pixel_total : 10475 time to create 1 rle with old method : 0.012727975845336914 length of segment : 99 time for calcul the mask position with numpy : 0.0021517276763916016 nb_pixel_total : 138733 time to create 1 rle with old method : 0.19289541244506836 length of segment : 369 time for calcul the mask position with numpy : 0.0007913112640380859 nb_pixel_total : 36417 time to create 1 rle with old method : 0.04980039596557617 length of segment : 274 time for calcul the mask position with numpy : 0.00031876564025878906 nb_pixel_total : 19437 time to create 1 rle with old method : 0.022331714630126953 length of segment : 174 time for calcul the mask position with numpy : 0.0004799365997314453 nb_pixel_total : 12903 time to create 1 rle with old method : 0.01685357093811035 length of segment : 272 time for calcul the mask position with numpy : 0.0005533695220947266 nb_pixel_total : 20319 time to create 1 rle with old method : 0.027434825897216797 length of segment : 262 time for calcul the mask position with numpy : 0.04739665985107422 nb_pixel_total : 1142853 time to create 1 rle with new method : 0.08052277565002441 length of segment : 1082 time for calcul the mask position with numpy : 0.0003829002380371094 nb_pixel_total : 14903 time to create 1 rle with old method : 0.017159461975097656 length of segment : 276 time for calcul the mask position with numpy : 0.0004820823669433594 nb_pixel_total : 22298 time to create 1 rle with old method : 0.02586984634399414 length of segment : 210 time for calcul the mask position with numpy : 0.0003693103790283203 nb_pixel_total : 13067 time to create 1 rle with old method : 0.015214204788208008 length of segment : 121 time spent for convertir_results : 23.522557258605957 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 202 chid ids of type : 3594 Number RLEs to save : 64436 save missing photos in datou_result : time spend for datou_step_exec : 109.95301461219788 time spend to save output : 4.435750484466553 total time spend for step 1 : 114.38876509666443 step2:crop_condition Wed Apr 16 17:32:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 202 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 144 About to insert : list_path_to_insert length 144 new photo from crops ! About to upload 144 photos upload in portfolio : 3736932 init cache_photo without model_param we have 144 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744817589_2451742 we have uploaded 144 photos in the portfolio 3736932 time of upload the photos Elapsed time : 34.86611080169678 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 20 About to insert : list_path_to_insert length 20 new photo from crops ! About to upload 20 photos upload in portfolio : 3736932 init cache_photo without model_param we have 20 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744817630_2451742 we have uploaded 20 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.90756893157959 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 33 About to insert : list_path_to_insert length 33 new photo from crops ! About to upload 33 photos upload in portfolio : 3736932 init cache_photo without model_param we have 33 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744817653_2451742 we have uploaded 33 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.150482416152954 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744817665_2451742 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2571122646331787 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744817668_2451742 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5917820930480957 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744817671_2451742 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5769846439361572 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1350312993, 1350312514, 1350312482, 1350312461, 1350312457, 1350312455, 1350312452, 1350310491, 1350309439, 1350309398] Looping around the photos to save general results len do output : 202 /1350348389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1350348754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312993', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312514', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312482', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312461', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312457', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312455', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312452', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350310491', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350309439', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350309398', None, None, None, None, None, '2726919') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 616 time used for this insertion : 0.03495311737060547 save_final save missing photos in datou_result : time spend for datou_step_exec : 127.06147623062134 time spend to save output : 0.053102731704711914 total time spend for step 2 : 127.11457896232605 step3:rle_unique_nms_with_priority Wed Apr 16 17:34:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 202 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 8.530654907226562 time for calcul the mask position with numpy : 0.9710385799407959 nb_pixel_total : 5074111 time to create 1 rle with new method : 1.240933895111084 time for calcul the mask position with numpy : 0.0488588809967041 nb_pixel_total : 1126374 time to create 1 rle with new method : 1.224998950958252 time for calcul the mask position with numpy : 0.03810691833496094 nb_pixel_total : 3097 time to create 1 rle with old method : 0.005187511444091797 time for calcul the mask position with numpy : 0.035888671875 nb_pixel_total : 130700 time to create 1 rle with old method : 0.1468043327331543 time for calcul the mask position with numpy : 0.03446078300476074 nb_pixel_total : 66447 time to create 1 rle with old method : 0.07496261596679688 time for calcul the mask position with numpy : 0.03433728218078613 nb_pixel_total : 73901 time to create 1 rle with old method : 0.0832667350769043 time for calcul the mask position with numpy : 0.03510642051696777 nb_pixel_total : 77930 time to create 1 rle with old method : 0.09908914566040039 time for calcul the mask position with numpy : 0.03838610649108887 nb_pixel_total : 1122 time to create 1 rle with old method : 0.002201557159423828 time for calcul the mask position with numpy : 0.03818464279174805 nb_pixel_total : 96900 time to create 1 rle with old method : 0.11356210708618164 time for calcul the mask position with numpy : 0.0343782901763916 nb_pixel_total : 100273 time to create 1 rle with old method : 0.11757087707519531 time for calcul the mask position with numpy : 0.034644365310668945 nb_pixel_total : 42701 time to create 1 rle with old method : 0.05064988136291504 time for calcul the mask position with numpy : 0.034281253814697266 nb_pixel_total : 205280 time to create 1 rle with new method : 0.3666718006134033 time for calcul the mask position with numpy : 0.03323626518249512 nb_pixel_total : 30568 time to create 1 rle with old method : 0.034874916076660156 time for calcul the mask position with numpy : 0.034705400466918945 nb_pixel_total : 20836 time to create 1 rle with old method : 0.02809309959411621 create new chi : 5.12284255027771 time to delete rle : 0.021139144897460938 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 15150 TO DO : save crop sub photo not yet done ! save time : 0.9377021789550781 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 5.149448394775391 time for calcul the mask position with numpy : 1.0750477313995361 nb_pixel_total : 5879318 time to create 1 rle with new method : 1.665511131286621 time for calcul the mask position with numpy : 0.032915592193603516 nb_pixel_total : 11805 time to create 1 rle with old method : 0.013373136520385742 time for calcul the mask position with numpy : 0.028338193893432617 nb_pixel_total : 103443 time to create 1 rle with old method : 0.12288403511047363 time for calcul the mask position with numpy : 0.02853989601135254 nb_pixel_total : 142591 time to create 1 rle with old method : 0.18419551849365234 time for calcul the mask position with numpy : 0.02357959747314453 nb_pixel_total : 82398 time to create 1 rle with old method : 0.09140181541442871 time for calcul the mask position with numpy : 0.028898954391479492 nb_pixel_total : 249093 time to create 1 rle with new method : 1.1889746189117432 time for calcul the mask position with numpy : 0.0245819091796875 nb_pixel_total : 47877 time to create 1 rle with old method : 0.053862810134887695 time for calcul the mask position with numpy : 0.026829957962036133 nb_pixel_total : 25101 time to create 1 rle with old method : 0.031842708587646484 time for calcul the mask position with numpy : 0.026048898696899414 nb_pixel_total : 62670 time to create 1 rle with old method : 0.07219791412353516 time for calcul the mask position with numpy : 0.033086538314819336 nb_pixel_total : 445944 time to create 1 rle with new method : 1.7600736618041992 create new chi : 6.603856801986694 time to delete rle : 0.0022377967834472656 batch 1 Loaded 20 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 9753 TO DO : save crop sub photo not yet done ! save time : 0.6033508777618408 nb_obj : 26 nb_hashtags : 3 time to prepare the origin masks : 4.1582043170928955 time for calcul the mask position with numpy : 1.0966851711273193 nb_pixel_total : 5685891 time to create 1 rle with new method : 0.5667717456817627 time for calcul the mask position with numpy : 0.031027793884277344 nb_pixel_total : 33220 time to create 1 rle with old method : 0.038374900817871094 time for calcul the mask position with numpy : 0.02933502197265625 nb_pixel_total : 24579 time to create 1 rle with old method : 0.02773284912109375 time for calcul the mask position with numpy : 0.029341936111450195 nb_pixel_total : 29980 time to create 1 rle with old method : 0.03402066230773926 time for calcul the mask position with numpy : 0.030231952667236328 nb_pixel_total : 77270 time to create 1 rle with old method : 0.08679413795471191 time for calcul the mask position with numpy : 0.029572010040283203 nb_pixel_total : 92539 time to create 1 rle with old method : 0.10349035263061523 time for calcul the mask position with numpy : 0.029348373413085938 nb_pixel_total : 50408 time to create 1 rle with old method : 0.05782890319824219 time for calcul the mask position with numpy : 0.02918529510498047 nb_pixel_total : 56861 time to create 1 rle with old method : 0.06398296356201172 time for calcul the mask position with numpy : 0.029250621795654297 nb_pixel_total : 2059 time to create 1 rle with old method : 0.0023992061614990234 time for calcul the mask position with numpy : 0.030211925506591797 nb_pixel_total : 84389 time to create 1 rle with old method : 0.09606099128723145 time for calcul the mask position with numpy : 0.029761791229248047 nb_pixel_total : 19087 time to create 1 rle with old method : 0.03151583671569824 time for calcul the mask position with numpy : 0.03331327438354492 nb_pixel_total : 23492 time to create 1 rle with old method : 0.03126883506774902 time for calcul the mask position with numpy : 0.02907419204711914 nb_pixel_total : 26746 time to create 1 rle with old method : 0.0302431583404541 time for calcul the mask position with numpy : 0.029819250106811523 nb_pixel_total : 74336 time to create 1 rle with old method : 0.08351945877075195 time for calcul the mask position with numpy : 0.029757261276245117 nb_pixel_total : 11009 time to create 1 rle with old method : 0.012790203094482422 time for calcul the mask position with numpy : 0.0333867073059082 nb_pixel_total : 13349 time to create 1 rle with old method : 0.021661996841430664 time for calcul the mask position with numpy : 0.03327298164367676 nb_pixel_total : 26335 time to create 1 rle with old method : 0.030088186264038086 time for calcul the mask position with numpy : 0.03070378303527832 nb_pixel_total : 51786 time to create 1 rle with old method : 0.06348538398742676 time for calcul the mask position with numpy : 0.03329038619995117 nb_pixel_total : 22849 time to create 1 rle with old method : 0.02594470977783203 time for calcul the mask position with numpy : 0.02949357032775879 nb_pixel_total : 92565 time to create 1 rle with old method : 0.10370254516601562 time for calcul the mask position with numpy : 0.029273509979248047 nb_pixel_total : 37698 time to create 1 rle with old method : 0.0606386661529541 time for calcul the mask position with numpy : 0.03309512138366699 nb_pixel_total : 67576 time to create 1 rle with old method : 0.07596778869628906 time for calcul the mask position with numpy : 0.029529809951782227 nb_pixel_total : 12011 time to create 1 rle with old method : 0.013875722885131836 time for calcul the mask position with numpy : 0.03114461898803711 nb_pixel_total : 42399 time to create 1 rle with old method : 0.04800128936767578 time for calcul the mask position with numpy : 0.03058648109436035 nb_pixel_total : 205944 time to create 1 rle with new method : 0.7552382946014404 time for calcul the mask position with numpy : 0.029459476470947266 nb_pixel_total : 156232 time to create 1 rle with new method : 0.34763407707214355 time for calcul the mask position with numpy : 0.029624223709106445 nb_pixel_total : 29630 time to create 1 rle with old method : 0.03570270538330078 create new chi : 4.830145597457886 time to delete rle : 0.004938840866088867 batch 1 Loaded 53 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 16840 TO DO : save crop sub photo not yet done ! save time : 1.0603814125061035 nb_obj : 28 nb_hashtags : 3 time to prepare the origin masks : 4.006118297576904 time for calcul the mask position with numpy : 0.964040994644165 nb_pixel_total : 5903149 time to create 1 rle with new method : 0.6594178676605225 time for calcul the mask position with numpy : 0.03316903114318848 nb_pixel_total : 14343 time to create 1 rle with old method : 0.023928403854370117 time for calcul the mask position with numpy : 0.029547929763793945 nb_pixel_total : 18171 time to create 1 rle with old method : 0.0206453800201416 time for calcul the mask position with numpy : 0.030050039291381836 nb_pixel_total : 54333 time to create 1 rle with old method : 0.07153940200805664 time for calcul the mask position with numpy : 0.030275821685791016 nb_pixel_total : 24918 time to create 1 rle with old method : 0.028063297271728516 time for calcul the mask position with numpy : 0.029828310012817383 nb_pixel_total : 37557 time to create 1 rle with old method : 0.04240226745605469 time for calcul the mask position with numpy : 0.03359079360961914 nb_pixel_total : 50356 time to create 1 rle with old method : 0.05876636505126953 time for calcul the mask position with numpy : 0.029769182205200195 nb_pixel_total : 19580 time to create 1 rle with old method : 0.022530555725097656 time for calcul the mask position with numpy : 0.0323793888092041 nb_pixel_total : 71279 time to create 1 rle with old method : 0.08123970031738281 time for calcul the mask position with numpy : 0.03003668785095215 nb_pixel_total : 27209 time to create 1 rle with old method : 0.03046727180480957 time for calcul the mask position with numpy : 0.030002355575561523 nb_pixel_total : 75543 time to create 1 rle with old method : 0.0847616195678711 time for calcul the mask position with numpy : 0.029836416244506836 nb_pixel_total : 25820 time to create 1 rle with old method : 0.02871227264404297 time for calcul the mask position with numpy : 0.029546260833740234 nb_pixel_total : 45873 time to create 1 rle with old method : 0.05391645431518555 time for calcul the mask position with numpy : 0.02962946891784668 nb_pixel_total : 44690 time to create 1 rle with old method : 0.05081319808959961 time for calcul the mask position with numpy : 0.029419422149658203 nb_pixel_total : 15234 time to create 1 rle with old method : 0.01724982261657715 time for calcul the mask position with numpy : 0.030633926391601562 nb_pixel_total : 78467 time to create 1 rle with old method : 0.08928251266479492 time for calcul the mask position with numpy : 0.029310226440429688 nb_pixel_total : 17105 time to create 1 rle with old method : 0.019571781158447266 time for calcul the mask position with numpy : 0.030932188034057617 nb_pixel_total : 182159 time to create 1 rle with new method : 0.31384849548339844 time for calcul the mask position with numpy : 0.029886245727539062 nb_pixel_total : 14200 time to create 1 rle with old method : 0.01920032501220703 time for calcul the mask position with numpy : 0.030286312103271484 nb_pixel_total : 37342 time to create 1 rle with old method : 0.043082237243652344 time for calcul the mask position with numpy : 0.029657602310180664 nb_pixel_total : 65347 time to create 1 rle with old method : 0.07938981056213379 time for calcul the mask position with numpy : 0.029668569564819336 nb_pixel_total : 37581 time to create 1 rle with old method : 0.04285883903503418 time for calcul the mask position with numpy : 0.02951359748840332 nb_pixel_total : 37678 time to create 1 rle with old method : 0.041930437088012695 time for calcul the mask position with numpy : 0.029986143112182617 nb_pixel_total : 45972 time to create 1 rle with old method : 0.05273008346557617 time for calcul the mask position with numpy : 0.029234886169433594 nb_pixel_total : 20170 time to create 1 rle with old method : 0.02318406105041504 time for calcul the mask position with numpy : 0.03141903877258301 nb_pixel_total : 8646 time to create 1 rle with old method : 0.011458158493041992 time for calcul the mask position with numpy : 0.030251741409301758 nb_pixel_total : 35821 time to create 1 rle with old method : 0.04096865653991699 time for calcul the mask position with numpy : 0.02897953987121582 nb_pixel_total : 37501 time to create 1 rle with old method : 0.04249215126037598 time for calcul the mask position with numpy : 0.03336000442504883 nb_pixel_total : 4196 time to create 1 rle with old method : 0.0072438716888427734 create new chi : 3.9808855056762695 time to delete rle : 0.005154609680175781 batch 1 Loaded 57 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++Number RLEs to save : 17216 TO DO : save crop sub photo not yet done ! save time : 1.0093410015106201 nb_obj : 25 nb_hashtags : 5 time to prepare the origin masks : 11.449510335922241 time for calcul the mask position with numpy : 0.7058131694793701 nb_pixel_total : 5532759 time to create 1 rle with new method : 0.7199652194976807 time for calcul the mask position with numpy : 0.039185523986816406 nb_pixel_total : 87109 time to create 1 rle with old method : 0.09950661659240723 time for calcul the mask position with numpy : 0.03679466247558594 nb_pixel_total : 51624 time to create 1 rle with old method : 0.057924509048461914 time for calcul the mask position with numpy : 0.03790116310119629 nb_pixel_total : 39598 time to create 1 rle with old method : 0.04448556900024414 time for calcul the mask position with numpy : 0.03697061538696289 nb_pixel_total : 27186 time to create 1 rle with old method : 0.0316309928894043 time for calcul the mask position with numpy : 0.03828859329223633 nb_pixel_total : 98639 time to create 1 rle with old method : 0.11107420921325684 time for calcul the mask position with numpy : 0.03654742240905762 nb_pixel_total : 16078 time to create 1 rle with old method : 0.018243789672851562 time for calcul the mask position with numpy : 0.03685188293457031 nb_pixel_total : 15788 time to create 1 rle with old method : 0.018210411071777344 time for calcul the mask position with numpy : 0.03633618354797363 nb_pixel_total : 2549 time to create 1 rle with old method : 0.0030825138092041016 time for calcul the mask position with numpy : 0.04033708572387695 nb_pixel_total : 235916 time to create 1 rle with new method : 1.7013115882873535 time for calcul the mask position with numpy : 0.03802895545959473 nb_pixel_total : 3207 time to create 1 rle with old method : 0.0037839412689208984 time for calcul the mask position with numpy : 0.0439763069152832 nb_pixel_total : 33427 time to create 1 rle with old method : 0.06199169158935547 time for calcul the mask position with numpy : 0.04132866859436035 nb_pixel_total : 119334 time to create 1 rle with old method : 0.14282584190368652 time for calcul the mask position with numpy : 0.03693675994873047 nb_pixel_total : 42368 time to create 1 rle with old method : 0.05112719535827637 time for calcul the mask position with numpy : 0.04117250442504883 nb_pixel_total : 21493 time to create 1 rle with old method : 0.03539609909057617 time for calcul the mask position with numpy : 0.044443607330322266 nb_pixel_total : 143880 time to create 1 rle with old method : 0.16917157173156738 time for calcul the mask position with numpy : 0.04064512252807617 nb_pixel_total : 10765 time to create 1 rle with old method : 0.016035079956054688 time for calcul the mask position with numpy : 0.039861202239990234 nb_pixel_total : 8515 time to create 1 rle with old method : 0.009747982025146484 time for calcul the mask position with numpy : 0.04205441474914551 nb_pixel_total : 8952 time to create 1 rle with old method : 0.010246515274047852 time for calcul the mask position with numpy : 0.05187392234802246 nb_pixel_total : 245719 time to create 1 rle with new method : 1.0372164249420166 time for calcul the mask position with numpy : 0.03951597213745117 nb_pixel_total : 63203 time to create 1 rle with old method : 0.07066631317138672 time for calcul the mask position with numpy : 0.03801274299621582 nb_pixel_total : 98335 time to create 1 rle with old method : 0.11107707023620605 time for calcul the mask position with numpy : 0.03689861297607422 nb_pixel_total : 17866 time to create 1 rle with old method : 0.020087718963623047 time for calcul the mask position with numpy : 0.036835432052612305 nb_pixel_total : 16565 time to create 1 rle with old method : 0.01917719841003418 time for calcul the mask position with numpy : 0.03576469421386719 nb_pixel_total : 13284 time to create 1 rle with old method : 0.0163114070892334 time for calcul the mask position with numpy : 0.037581682205200195 nb_pixel_total : 96081 time to create 1 rle with old method : 0.10808539390563965 create new chi : 6.469549894332886 time to delete rle : 0.005549907684326172 batch 1 Loaded 51 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++Number RLEs to save : 16132 TO DO : save crop sub photo not yet done ! save time : 1.0694830417633057 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 11.372663021087646 time for calcul the mask position with numpy : 0.31545400619506836 nb_pixel_total : 6082758 time to create 1 rle with new method : 0.3159520626068115 time for calcul the mask position with numpy : 0.034921884536743164 nb_pixel_total : 4350 time to create 1 rle with old method : 0.004748344421386719 time for calcul the mask position with numpy : 0.03509712219238281 nb_pixel_total : 18416 time to create 1 rle with old method : 0.020788192749023438 time for calcul the mask position with numpy : 0.03809189796447754 nb_pixel_total : 33915 time to create 1 rle with old method : 0.038126230239868164 time for calcul the mask position with numpy : 0.03627824783325195 nb_pixel_total : 14691 time to create 1 rle with old method : 0.019739389419555664 time for calcul the mask position with numpy : 0.026103734970092773 nb_pixel_total : 7063 time to create 1 rle with old method : 0.008167505264282227 time for calcul the mask position with numpy : 0.02414536476135254 nb_pixel_total : 25814 time to create 1 rle with old method : 0.029401540756225586 time for calcul the mask position with numpy : 0.02515411376953125 nb_pixel_total : 20448 time to create 1 rle with old method : 0.02523636817932129 time for calcul the mask position with numpy : 0.023862838745117188 nb_pixel_total : 27930 time to create 1 rle with old method : 0.03152871131896973 time for calcul the mask position with numpy : 0.030643224716186523 nb_pixel_total : 52781 time to create 1 rle with old method : 0.060671091079711914 time for calcul the mask position with numpy : 0.03675222396850586 nb_pixel_total : 22245 time to create 1 rle with old method : 0.025959014892578125 time for calcul the mask position with numpy : 0.03573727607727051 nb_pixel_total : 19952 time to create 1 rle with old method : 0.02256011962890625 time for calcul the mask position with numpy : 0.04122471809387207 nb_pixel_total : 24909 time to create 1 rle with old method : 0.02825164794921875 time for calcul the mask position with numpy : 0.03313422203063965 nb_pixel_total : 23314 time to create 1 rle with old method : 0.02905869483947754 time for calcul the mask position with numpy : 0.023417234420776367 nb_pixel_total : 43535 time to create 1 rle with old method : 0.04892301559448242 time for calcul the mask position with numpy : 0.021695852279663086 nb_pixel_total : 11075 time to create 1 rle with old method : 0.012679338455200195 time for calcul the mask position with numpy : 0.02221202850341797 nb_pixel_total : 13968 time to create 1 rle with old method : 0.015781164169311523 time for calcul the mask position with numpy : 0.022367000579833984 nb_pixel_total : 20174 time to create 1 rle with old method : 0.022905349731445312 time for calcul the mask position with numpy : 0.030030012130737305 nb_pixel_total : 582902 time to create 1 rle with new method : 0.43666505813598633 create new chi : 2.1205806732177734 time to delete rle : 0.0019545555114746094 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 11114 TO DO : save crop sub photo not yet done ! save time : 0.7648437023162842 nb_obj : 23 nb_hashtags : 3 time to prepare the origin masks : 7.281989574432373 time for calcul the mask position with numpy : 0.494762659072876 nb_pixel_total : 6091528 time to create 1 rle with new method : 0.41965389251708984 time for calcul the mask position with numpy : 0.04021048545837402 nb_pixel_total : 11409 time to create 1 rle with old method : 0.014007091522216797 time for calcul the mask position with numpy : 0.039459943771362305 nb_pixel_total : 6776 time to create 1 rle with old method : 0.007979869842529297 time for calcul the mask position with numpy : 0.03872537612915039 nb_pixel_total : 16309 time to create 1 rle with old method : 0.018916845321655273 time for calcul the mask position with numpy : 0.03641510009765625 nb_pixel_total : 19287 time to create 1 rle with old method : 0.021587848663330078 time for calcul the mask position with numpy : 0.0386662483215332 nb_pixel_total : 129343 time to create 1 rle with old method : 0.15036273002624512 time for calcul the mask position with numpy : 0.041309356689453125 nb_pixel_total : 32788 time to create 1 rle with old method : 0.04602408409118652 time for calcul the mask position with numpy : 0.03642463684082031 nb_pixel_total : 33654 time to create 1 rle with old method : 0.03827166557312012 time for calcul the mask position with numpy : 0.03697514533996582 nb_pixel_total : 20883 time to create 1 rle with old method : 0.03433632850646973 time for calcul the mask position with numpy : 0.03761601448059082 nb_pixel_total : 40795 time to create 1 rle with old method : 0.04744577407836914 time for calcul the mask position with numpy : 0.03799557685852051 nb_pixel_total : 15966 time to create 1 rle with old method : 0.018846988677978516 time for calcul the mask position with numpy : 0.03335738182067871 nb_pixel_total : 41189 time to create 1 rle with old method : 0.04843020439147949 time for calcul the mask position with numpy : 0.02804422378540039 nb_pixel_total : 13604 time to create 1 rle with old method : 0.016319751739501953 time for calcul the mask position with numpy : 0.023634910583496094 nb_pixel_total : 56866 time to create 1 rle with old method : 0.06448173522949219 time for calcul the mask position with numpy : 0.0231931209564209 nb_pixel_total : 53014 time to create 1 rle with old method : 0.059831857681274414 time for calcul the mask position with numpy : 0.023380041122436523 nb_pixel_total : 34693 time to create 1 rle with old method : 0.039388418197631836 time for calcul the mask position with numpy : 0.023977994918823242 nb_pixel_total : 71146 time to create 1 rle with old method : 0.08086800575256348 time for calcul the mask position with numpy : 0.02178192138671875 nb_pixel_total : 16280 time to create 1 rle with old method : 0.018583059310913086 time for calcul the mask position with numpy : 0.021672964096069336 nb_pixel_total : 25902 time to create 1 rle with old method : 0.02980780601501465 time for calcul the mask position with numpy : 0.022096633911132812 nb_pixel_total : 19266 time to create 1 rle with old method : 0.022058486938476562 time for calcul the mask position with numpy : 0.02154374122619629 nb_pixel_total : 24649 time to create 1 rle with old method : 0.02787017822265625 time for calcul the mask position with numpy : 0.023838043212890625 nb_pixel_total : 184789 time to create 1 rle with new method : 0.46079444885253906 time for calcul the mask position with numpy : 0.035065412521362305 nb_pixel_total : 73801 time to create 1 rle with old method : 0.1160883903503418 time for calcul the mask position with numpy : 0.025702953338623047 nb_pixel_total : 16303 time to create 1 rle with old method : 0.018477201461791992 create new chi : 3.108428716659546 time to delete rle : 0.002728700637817383 batch 1 Loaded 47 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++Number RLEs to save : 14902 TO DO : save crop sub photo not yet done ! save time : 1.1162209510803223 nb_obj : 19 nb_hashtags : 4 time to prepare the origin masks : 8.52382516860962 time for calcul the mask position with numpy : 0.3367321491241455 nb_pixel_total : 6235294 time to create 1 rle with new method : 1.0972254276275635 time for calcul the mask position with numpy : 0.04337310791015625 nb_pixel_total : 33057 time to create 1 rle with old method : 0.04217219352722168 time for calcul the mask position with numpy : 0.038960933685302734 nb_pixel_total : 22331 time to create 1 rle with old method : 0.02686905860900879 time for calcul the mask position with numpy : 0.03650522232055664 nb_pixel_total : 26204 time to create 1 rle with old method : 0.03034663200378418 time for calcul the mask position with numpy : 0.03975987434387207 nb_pixel_total : 48042 time to create 1 rle with old method : 0.05401110649108887 time for calcul the mask position with numpy : 0.03662300109863281 nb_pixel_total : 67490 time to create 1 rle with old method : 0.08054351806640625 time for calcul the mask position with numpy : 0.04256319999694824 nb_pixel_total : 18788 time to create 1 rle with old method : 0.031298160552978516 time for calcul the mask position with numpy : 0.04353976249694824 nb_pixel_total : 72466 time to create 1 rle with old method : 0.08298349380493164 time for calcul the mask position with numpy : 0.03664064407348633 nb_pixel_total : 24544 time to create 1 rle with old method : 0.027813434600830078 time for calcul the mask position with numpy : 0.03836941719055176 nb_pixel_total : 31132 time to create 1 rle with old method : 0.03631949424743652 time for calcul the mask position with numpy : 0.03977489471435547 nb_pixel_total : 20429 time to create 1 rle with old method : 0.027956247329711914 time for calcul the mask position with numpy : 0.03627586364746094 nb_pixel_total : 21583 time to create 1 rle with old method : 0.024847745895385742 time for calcul the mask position with numpy : 0.03802800178527832 nb_pixel_total : 58144 time to create 1 rle with old method : 0.07256627082824707 time for calcul the mask position with numpy : 0.03834056854248047 nb_pixel_total : 8083 time to create 1 rle with old method : 0.009567737579345703 time for calcul the mask position with numpy : 0.0402219295501709 nb_pixel_total : 96965 time to create 1 rle with old method : 0.12291455268859863 time for calcul the mask position with numpy : 0.04593324661254883 nb_pixel_total : 40045 time to create 1 rle with old method : 0.04709291458129883 time for calcul the mask position with numpy : 0.04196667671203613 nb_pixel_total : 27174 time to create 1 rle with old method : 0.030779361724853516 time for calcul the mask position with numpy : 0.03802084922790527 nb_pixel_total : 107954 time to create 1 rle with old method : 0.14931106567382812 time for calcul the mask position with numpy : 0.03660249710083008 nb_pixel_total : 60527 time to create 1 rle with old method : 0.07852435111999512 time for calcul the mask position with numpy : 0.04103875160217285 nb_pixel_total : 29988 time to create 1 rle with old method : 0.03403925895690918 create new chi : 3.2469468116760254 time to delete rle : 0.002040386199951172 batch 1 Loaded 39 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 11676 TO DO : save crop sub photo not yet done ! save time : 0.8053696155548096 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 11.263614892959595 time for calcul the mask position with numpy : 0.3679988384246826 nb_pixel_total : 5455960 time to create 1 rle with new method : 0.8560030460357666 time for calcul the mask position with numpy : 0.03989219665527344 nb_pixel_total : 10780 time to create 1 rle with old method : 0.012537479400634766 time for calcul the mask position with numpy : 0.04011988639831543 nb_pixel_total : 56141 time to create 1 rle with old method : 0.06554985046386719 time for calcul the mask position with numpy : 0.04215431213378906 nb_pixel_total : 34780 time to create 1 rle with old method : 0.04022789001464844 time for calcul the mask position with numpy : 0.037841081619262695 nb_pixel_total : 62518 time to create 1 rle with old method : 0.07289457321166992 time for calcul the mask position with numpy : 0.040094852447509766 nb_pixel_total : 33073 time to create 1 rle with old method : 0.038361310958862305 time for calcul the mask position with numpy : 0.044823408126831055 nb_pixel_total : 4099 time to create 1 rle with old method : 0.004886627197265625 time for calcul the mask position with numpy : 0.04309582710266113 nb_pixel_total : 261957 time to create 1 rle with new method : 0.7696311473846436 time for calcul the mask position with numpy : 0.022657155990600586 nb_pixel_total : 149500 time to create 1 rle with old method : 0.16741609573364258 time for calcul the mask position with numpy : 0.02526712417602539 nb_pixel_total : 78829 time to create 1 rle with old method : 0.08942317962646484 time for calcul the mask position with numpy : 0.02358841896057129 nb_pixel_total : 204948 time to create 1 rle with new method : 0.554297685623169 time for calcul the mask position with numpy : 0.02742791175842285 nb_pixel_total : 80698 time to create 1 rle with old method : 0.09110188484191895 time for calcul the mask position with numpy : 0.022966623306274414 nb_pixel_total : 234966 time to create 1 rle with new method : 0.5355477333068848 time for calcul the mask position with numpy : 0.02713918685913086 nb_pixel_total : 24620 time to create 1 rle with old method : 0.02785205841064453 time for calcul the mask position with numpy : 0.023662328720092773 nb_pixel_total : 99219 time to create 1 rle with old method : 0.17821669578552246 time for calcul the mask position with numpy : 0.026534557342529297 nb_pixel_total : 118968 time to create 1 rle with old method : 0.15236783027648926 time for calcul the mask position with numpy : 0.02468705177307129 nb_pixel_total : 11501 time to create 1 rle with old method : 0.018941164016723633 time for calcul the mask position with numpy : 0.026952743530273438 nb_pixel_total : 50034 time to create 1 rle with old method : 0.06450247764587402 time for calcul the mask position with numpy : 0.023650169372558594 nb_pixel_total : 24051 time to create 1 rle with old method : 0.027213335037231445 time for calcul the mask position with numpy : 0.02300715446472168 nb_pixel_total : 53598 time to create 1 rle with old method : 0.06352019309997559 create new chi : 4.921114921569824 time to delete rle : 0.003325939178466797 batch 1 Loaded 39 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 16344 TO DO : save crop sub photo not yet done ! save time : 1.0808746814727783 nb_obj : 21 nb_hashtags : 3 time to prepare the origin masks : 12.035715341567993 time for calcul the mask position with numpy : 0.39623475074768066 nb_pixel_total : 4912761 time to create 1 rle with new method : 1.476494550704956 time for calcul the mask position with numpy : 0.039022207260131836 nb_pixel_total : 13067 time to create 1 rle with old method : 0.01563239097595215 time for calcul the mask position with numpy : 0.03842592239379883 nb_pixel_total : 22298 time to create 1 rle with old method : 0.026708126068115234 time for calcul the mask position with numpy : 0.0377960205078125 nb_pixel_total : 14903 time to create 1 rle with old method : 0.01841259002685547 time for calcul the mask position with numpy : 0.05103182792663574 nb_pixel_total : 1074091 time to create 1 rle with new method : 1.386763334274292 time for calcul the mask position with numpy : 0.036626577377319336 nb_pixel_total : 15197 time to create 1 rle with old method : 0.019774198532104492 time for calcul the mask position with numpy : 0.03764939308166504 nb_pixel_total : 12903 time to create 1 rle with old method : 0.014760494232177734 time for calcul the mask position with numpy : 0.03355050086975098 nb_pixel_total : 19437 time to create 1 rle with old method : 0.022022008895874023 time for calcul the mask position with numpy : 0.03265047073364258 nb_pixel_total : 36417 time to create 1 rle with old method : 0.04128694534301758 time for calcul the mask position with numpy : 0.024178504943847656 nb_pixel_total : 138733 time to create 1 rle with old method : 0.15634751319885254 time for calcul the mask position with numpy : 0.02292943000793457 nb_pixel_total : 10475 time to create 1 rle with old method : 0.011978864669799805 time for calcul the mask position with numpy : 0.028479337692260742 nb_pixel_total : 70066 time to create 1 rle with old method : 0.07912373542785645 time for calcul the mask position with numpy : 0.02655506134033203 nb_pixel_total : 7801 time to create 1 rle with old method : 0.009072065353393555 time for calcul the mask position with numpy : 0.029122352600097656 nb_pixel_total : 157127 time to create 1 rle with new method : 1.7977960109710693 time for calcul the mask position with numpy : 0.03699779510498047 nb_pixel_total : 34495 time to create 1 rle with old method : 0.0418543815612793 time for calcul the mask position with numpy : 0.03773045539855957 nb_pixel_total : 15738 time to create 1 rle with old method : 0.01869964599609375 time for calcul the mask position with numpy : 0.037184715270996094 nb_pixel_total : 13987 time to create 1 rle with old method : 0.015946626663208008 time for calcul the mask position with numpy : 0.038352012634277344 nb_pixel_total : 172099 time to create 1 rle with new method : 0.8301315307617188 time for calcul the mask position with numpy : 0.03580522537231445 nb_pixel_total : 36006 time to create 1 rle with old method : 0.041213035583496094 time for calcul the mask position with numpy : 0.03630471229553223 nb_pixel_total : 68544 time to create 1 rle with old method : 0.08810210227966309 time for calcul the mask position with numpy : 0.056772470474243164 nb_pixel_total : 136594 time to create 1 rle with old method : 0.17710351943969727 time for calcul the mask position with numpy : 0.036392927169799805 nb_pixel_total : 67501 time to create 1 rle with old method : 0.08006167411804199 create new chi : 7.635914087295532 time to delete rle : 0.002992868423461914 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 15424 TO DO : save crop sub photo not yet done ! save time : 1.0665283203125 map_output_result : {1350312993: (0.0, 'Should be the crop_list due to order', 0), 1350312514: (0.0, 'Should be the crop_list due to order', 0), 1350312482: (0.0, 'Should be the crop_list due to order', 0), 1350312461: (0.0, 'Should be the crop_list due to order', 0), 1350312457: (0.0, 'Should be the crop_list due to order', 0), 1350312455: (0.0, 'Should be the crop_list due to order', 0), 1350312452: (0.0, 'Should be the crop_list due to order', 0), 1350310491: (0.0, 'Should be the crop_list due to order', 0), 1350309439: (0.0, 'Should be the crop_list due to order', 0), 1350309398: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1350312993, 1350312514, 1350312482, 1350312461, 1350312457, 1350312455, 1350312452, 1350310491, 1350309439, 1350309398] Looping around the photos to save general results len do output : 10 /1350312993.Didn't retrieve data . /1350312514.Didn't retrieve data . /1350312482.Didn't retrieve data . /1350312461.Didn't retrieve data . /1350312457.Didn't retrieve data . /1350312455.Didn't retrieve data . /1350312452.Didn't retrieve data . /1350310491.Didn't retrieve data . /1350309439.Didn't retrieve data . /1350309398.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312993', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312514', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312482', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312461', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312457', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312455', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312452', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350310491', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350309439', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350309398', None, None, None, None, None, '2726919') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.01598334312438965 save_final save missing photos in datou_result : time spend for datou_step_exec : 142.95417094230652 time spend to save output : 0.018124103546142578 total time spend for step 3 : 142.97229504585266 step4:ventilate_hashtags_in_portfolio Wed Apr 16 17:36:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22089282 get user id for portfolio 22089282 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22089282 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','environnement','pet_fonce','carton','autre','pet_clair','metal','pehd','flou','background','mal_croppe')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22089282 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','environnement','pet_fonce','carton','autre','pet_clair','metal','pehd','flou','background','mal_croppe')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22089282 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','environnement','pet_fonce','carton','autre','pet_clair','metal','pehd','flou','background','mal_croppe')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22090271,22090272,22090273,22090274,22090275,22090276,22090277,22090278,22090279,22090280,22090281?tags=papier,environnement,pet_fonce,carton,autre,pet_clair,metal,pehd,flou,background,mal_croppe Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1350312993, 1350312514, 1350312482, 1350312461, 1350312457, 1350312455, 1350312452, 1350310491, 1350309439, 1350309398] Looping around the photos to save general results len do output : 1 /22089282. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312993', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312514', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312482', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312461', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312457', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312455', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312452', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350310491', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350309439', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350309398', None, None, None, None, None, '2726919') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.01659083366394043 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6976313591003418 time spend to save output : 0.016840696334838867 total time spend for step 4 : 1.7144720554351807 step5:final Wed Apr 16 17:36:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1350312993: ('0.19359441664397245',), 1350312514: ('0.19359441664397245',), 1350312482: ('0.19359441664397245',), 1350312461: ('0.19359441664397245',), 1350312457: ('0.19359441664397245',), 1350312455: ('0.19359441664397245',), 1350312452: ('0.19359441664397245',), 1350310491: ('0.19359441664397245',), 1350309439: ('0.19359441664397245',), 1350309398: ('0.19359441664397245',)} new output for save of step final : {1350312993: ('0.19359441664397245',), 1350312514: ('0.19359441664397245',), 1350312482: ('0.19359441664397245',), 1350312461: ('0.19359441664397245',), 1350312457: ('0.19359441664397245',), 1350312455: ('0.19359441664397245',), 1350312452: ('0.19359441664397245',), 1350310491: ('0.19359441664397245',), 1350309439: ('0.19359441664397245',), 1350309398: ('0.19359441664397245',)} [1350312993, 1350312514, 1350312482, 1350312461, 1350312457, 1350312455, 1350312452, 1350310491, 1350309439, 1350309398] Looping around the photos to save general results len do output : 10 /1350312993.Didn't retrieve data . /1350312514.Didn't retrieve data . /1350312482.Didn't retrieve data . /1350312461.Didn't retrieve data . /1350312457.Didn't retrieve data . /1350312455.Didn't retrieve data . /1350312452.Didn't retrieve data . /1350310491.Didn't retrieve data . /1350309439.Didn't retrieve data . /1350309398.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312993', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312514', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312482', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312461', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312457', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312455', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312452', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350310491', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350309439', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350309398', None, None, None, None, None, '2726919') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.014862060546875 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11728286743164062 time spend to save output : 0.01552438735961914 total time spend for step 5 : 0.13280725479125977 step6:blur_detection Wed Apr 16 17:36:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c.jpg resize: (2160, 3264) 1350312993 -5.4139630974903525 treat image : temp/1744817428_2451742_1350312514_e221a39eda5a7641785de81b39555dfe.jpg resize: (2160, 3264) 1350312514 -0.7746336364673522 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6.jpg resize: (2160, 3264) 1350312482 -3.083030838310986 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4.jpg resize: (2160, 3264) 1350312461 -4.003611872347516 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e.jpg resize: (2160, 3264) 1350312457 -3.993170537406092 treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29.jpg resize: (2160, 3264) 1350312455 -6.439365312742162 treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f.jpg resize: (2160, 3264) 1350312452 -3.778051101631929 treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0.jpg resize: (2160, 3264) 1350310491 -1.7904250461770326 treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4.jpg resize: (2160, 3264) 1350309439 -2.5275130007193884 treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04.jpg resize: (2160, 3264) 1350309398 -2.0375559877557463 treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507440_0.png resize: (472, 287) 1350348389 -1.3412061039060519 treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507441_0.png resize: (476, 458) 1350348390 -2.2034890904784783 treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507437_0.png resize: (418, 247) 1350348391 -3.0281521940744 treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507444_0.png resize: (361, 510) 1350348392 -3.190846678036056 treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507434_0.png resize: (151, 191) 1350348393 -1.6493286919397805 treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507439_0.png resize: (389, 386) 1350348394 -3.6277972971010852 treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507445_0.png resize: (67, 60) 1350348395 0.19130994511018284 treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507446_0.png resize: (1357, 1281) 1350348396 -5.626197995187922 treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507443_0.png resize: (212, 458) 1350348397 -4.6763229288399 treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507436_0.png resize: (741, 392) 1350348398 -4.335753472189231 treat image : temp/1744817428_2451742_1350312514_e221a39eda5a7641785de81b39555dfe_rle_crop_3749507447_0.png resize: (1111, 566) 1350348399 -0.5835455960865515 treat image : temp/1744817428_2451742_1350312514_e221a39eda5a7641785de81b39555dfe_rle_crop_3749507452_0.png resize: (339, 304) 1350348400 -1.6543692381531776 treat image : temp/1744817428_2451742_1350312514_e221a39eda5a7641785de81b39555dfe_rle_crop_3749507449_0.png resize: (408, 239) 1350348402 -0.6931570586377315 treat image : temp/1744817428_2451742_1350312514_e221a39eda5a7641785de81b39555dfe_rle_crop_3749507448_0.png resize: (346, 307) 1350348403 -0.9088590505069046 treat image : temp/1744817428_2451742_1350312514_e221a39eda5a7641785de81b39555dfe_rle_crop_3749507455_0.png resize: (309, 465) 1350348406 -2.272270901452667 treat image : temp/1744817428_2451742_1350312514_e221a39eda5a7641785de81b39555dfe_rle_crop_3749507454_0.png resize: (373, 570) 1350348407 -0.3148808580332925 treat image : temp/1744817428_2451742_1350312514_e221a39eda5a7641785de81b39555dfe_rle_crop_3749507450_0.png resize: (208, 329) 1350348408 -2.0239422052155374 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507459_0.png resize: (138, 339) 1350348409 -0.7547389365570254 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507457_0.png resize: (408, 683) 1350348410 -0.36519644111319194 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507468_0.png resize: (377, 280) 1350348411 -2.442420966940538 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507476_0.png resize: (113, 128) 1350348413 -1.2428061668049089 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507482_0.png resize: (96, 87) 1350348416 -0.8444231469044167 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507477_0.png resize: (347, 269) 1350348417 -0.8408546494970693 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507469_0.png resize: (346, 236) 1350348419 -1.0861742218291428 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507466_0.png resize: (209, 172) 1350348420 -0.9020924878935902 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507473_0.png resize: (210, 104) 1350348421 -3.1017011247877684 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507480_0.png resize: (204, 239) 1350348423 -2.6081059993068574 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507465_0.png resize: (316, 435) 1350348424 -2.2467489311701896 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507479_0.png resize: (157, 183) 1350348425 -0.6624148997304795 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507481_0.png resize: (213, 162) 1350348427 -0.509626007914172 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507460_0.png resize: (484, 333) 1350348428 -2.0066194846567504 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507472_0.png resize: (180, 193) 1350348429 -1.3952128770819634 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507464_0.png resize: (214, 239) 1350348430 -1.9989542750366052 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507474_0.png resize: (205, 165) 1350348432 -1.002492907074888 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507467_0.png resize: (303, 316) 1350348433 -1.1611753686467485 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507494_0.png resize: (182, 134) 1350348435 -2.0130224510398818 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507509_0.png resize: (230, 217) 1350348436 -2.353699290096592 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507487_0.png resize: (286, 148) 1350348438 -1.653731719251298 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507490_0.png resize: (53, 97) 1350348439 0.26282539425199253 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507489_0.png resize: (276, 219) 1350348440 -2.1092297249445635 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507486_0.png resize: (286, 285) 1350348442 -2.0107625446381645 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507506_0.png resize: (169, 189) 1350348443 -2.081082503186057 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507504_0.png resize: (107, 234) 1350348444 -2.151223391331679 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507484_0.png resize: (265, 251) 1350348446 -1.3217403932012184 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507502_0.png resize: (134, 161) 1350348447 -2.2323755945437362 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507508_0.png resize: (503, 470) 1350348448 -0.9746553961324439 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507485_0.png resize: (147, 262) 1350348450 -2.6298792077848083 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507496_0.png resize: (417, 210) 1350348451 -2.272896929873196 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507488_0.png resize: (143, 135) 1350348452 -1.6642247322516837 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507503_0.png resize: (157, 332) 1350348454 -3.0710193418434537 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507491_0.png resize: (292, 311) 1350348455 -3.030497296862953 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507510_0.png resize: (229, 287) 1350348456 -2.6083831767036827 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507511_0.png resize: (606, 262) 1350348457 -1.2603380196193814 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507528_0.png resize: (417, 520) 1350348459 -2.2863704864517436 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507516_0.png resize: (218, 415) 1350348460 -1.640889801940055 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507523_0.png resize: (162, 340) 1350348461 -1.4145569432199283 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507531_0.png resize: (420, 439) 1350348463 -2.876594337341174 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507518_0.png resize: (105, 109) 1350348464 0.17793525175870528 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507520_0.png resize: (155, 106) 1350348465 -2.8385780471181246 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507522_0.png resize: (149, 188) 1350348467 -2.2321286456891403 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507517_0.png resize: (542, 772) 1350348468 -2.3033265203646565 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507513_0.png resize: (148, 245) 1350348469 -2.3605036034297964 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507529_0.png resize: (160, 170) 1350348471 -2.5929240772600255 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507530_0.png resize: (172, 117) 1350348472 -0.35228691571837945 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507534_0.png resize: (302, 344) 1350348473 -1.99678120704117 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507512_0.png resize: (126, 168) 1350348474 -1.7897447795101131 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507519_0.png resize: (106, 126) 1350348476 -3.0292401733570813 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507525_0.png resize: (212, 222) 1350348477 -3.9754663375943116 treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507551_0.png resize: (278, 241) 1350348478 -1.937467395165957 treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507548_0.png resize: (131, 290) 1350348480 -3.633446012707525 treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507547_0.png resize: (191, 136) 1350348481 -1.7211133430364103 treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507550_0.png resize: (188, 109) 1350348482 -0.8962394598439262 treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507545_0.png resize: (259, 367) 1350348484 -3.4163687742753486 treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507538_0.png resize: (122, 145) 1350348485 -2.3773094170805913 treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507546_0.png resize: (220, 204) 1350348486 -3.68169242720532 treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507543_0.png resize: (157, 198) 1350348487 -3.4193141617865805 treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507544_0.png resize: (174, 181) 1350348489 -3.15455593575491 treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507541_0.png resize: (253, 253) 1350348490 -3.588227518041876 treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507540_0.png resize: (324, 247) 1350348491 -3.060584471855983 treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507549_0.png resize: (117, 89) 1350348493 -2.3541631531986016 treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507539_0.png resize: (130, 105) 1350348494 -1.396203415653587 treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507536_0.png resize: (911, 908) 1350348495 -2.765119217882608 treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507552_0.png resize: (103, 206) 1350348497 -3.04307022546111 treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507555_0.png resize: (398, 284) 1350348499 -1.7199569718073338 treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507556_0.png resize: (723, 542) 1350348500 -2.405181823200309 treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507564_0.png resize: (341, 272) 1350348502 -2.321046107519684 treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507576_0.png resize: (142, 109) 1350348503 -1.1109554169728733 treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507561_0.png resize: (311, 577) 1350348504 -3.079560603238761 treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507570_0.png resize: (203, 257) 1350348505 -2.0192893341853555 treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507563_0.png resize: (272, 366) 1350348507 -2.7047247715631566 treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507575_0.png resize: (77, 116) 1350348508 -1.0456247480846201 treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507559_0.png resize: (220, 164) 1350348510 -2.0152628496343072 treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507567_0.png resize: (154, 149) 1350348513 -1.9843626472518208 treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507566_0.png resize: (144, 430) 1350348514 -2.9034394344513372 treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507560_0.png resize: (164, 159) 1350348515 -1.3588375627421012 treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507573_0.png resize: (228, 160) 1350348517 -2.6357045771415852 treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507557_0.png resize: (206, 202) 1350348518 -2.2271237984097554 treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507558_0.png resize: (174, 169) 1350348519 -2.1466286703431847 treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507568_0.png resize: (300, 228) 1350348520 -2.688973766362606 treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507571_0.png resize: (240, 213) 1350348522 -2.429425459475676 treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507572_0.png resize: (445, 383) 1350348523 -2.7515458723611137 treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507569_0.png resize: (148, 183) 1350348524 -0.15010866362307837 treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507574_0.png resize: (129, 158) 1350348526 -0.9794765389999277 treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507565_0.png resize: (282, 134) 1350348527 -3.105029653099457 treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507581_0.png resize: (194, 313) 1350348528 -1.857737524728581 treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507584_0.png resize: (388, 225) 1350348530 -1.5446376305644163 treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507583_0.png resize: (151, 91) 1350348531 -1.4719304190330922 treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507587_0.png resize: (178, 239) 1350348532 -0.35879284743916695 treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507580_0.png resize: (196, 186) 1350348533 -1.1584548670879207 treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507592_0.png resize: (232, 311) 1350348535 -1.6652262868215713 treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507578_0.png resize: (284, 298) 1350348536 -0.9585670177597422 treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507585_0.png resize: (165, 184) 1350348537 0.2852747168532844 treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507577_0.png resize: (198, 213) 1350348540 -1.3253646923092337 treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507579_0.png resize: (474, 366) 1350348541 -2.8081230293551824 treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507590_0.png resize: (201, 135) 1350348542 -1.2231324045004952 treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507612_0.png resize: (680, 331) 1350348544 -1.2062899147476174 treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507602_0.png resize: (182, 208) 1350348545 -0.9160948551473903 treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507596_0.png resize: (332, 414) 1350348546 -1.1421314463049614 treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507614_0.png resize: (118, 128) 1350348547 -1.139531081512388 treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507603_0.png resize: (757, 559) 1350348549 -1.3074869411719723 treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507598_0.png resize: (209, 312) 1350348550 -1.761542637071036 treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507610_0.png resize: (144, 344) 1350348551 -1.8310105953277311 treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507608_0.png resize: (611, 627) 1350348552 -1.737258245630916 treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507600_0.png resize: (401, 453) 1350348553 -2.6067435242393797 treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507599_0.png resize: (103, 170) 1350348554 -1.4905836281938782 treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507611_0.png resize: (326, 296) 1350348555 -2.0787374660697333 treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507601_0.png resize: (458, 422) 1350348556 -1.2345663427395936 treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507609_0.png resize: (106, 171) 1350348557 -1.7487862786324362 treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507597_0.png resize: (200, 190) 1350348558 -1.9113663888667125 treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507629_0.png resize: (173, 136) 1350348559 -0.5806273619979048 treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507616_0.png resize: (551, 409) 1350348560 -0.8754107327835896 treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507622_0.png resize: (318, 187) 1350348561 -2.1270867892838212 treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507621_0.png resize: (165, 197) 1350348562 -1.7299017222204127 treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507620_0.png resize: (127, 158) 1350348563 -1.665356605067452 treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507634_0.png resize: (207, 198) 1350348564 -1.8988167084944847 treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507623_0.png resize: (628, 389) 1350348565 -0.7809576945716659 treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507631_0.png resize: (180, 237) 1350348566 -2.7133224146165156 treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507626_0.png resize: (75, 215) 1350348567 -2.5517183144603335 treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507627_0.png resize: (364, 483) 1350348568 0.35678451808844314 treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507617_0.png resize: (330, 326) 1350348570 -1.0667822034433085 treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507615_0.png resize: (321, 294) 1350348571 -0.1954001892513632 treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507625_0.png resize: (430, 269) 1350348572 -0.633255976782603 treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507624_0.png resize: (183, 84) 1350348573 -1.3139043990166566 treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507633_0.png resize: (276, 81) 1350348574 -0.8074855684507958 treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507438_0.png resize: (473, 312) 1350348595 -1.3953385403005782 treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507442_0.png resize: (304, 510) 1350348596 -2.2131822373259684 treat image : temp/1744817428_2451742_1350312514_e221a39eda5a7641785de81b39555dfe_rle_crop_3749507451_0.png resize: (740, 579) 1350348597 -1.1630571214084313 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507492_0.png resize: (133, 232) 1350348598 -2.019390222919433 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507505_0.png resize: (261, 184) 1350348599 -1.9421382376504603 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507483_0.png resize: (189, 166) 1350348601 -0.6656575566332376 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507507_0.png resize: (518, 515) 1350348602 -0.6073398898409014 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507500_0.png resize: (156, 140) 1350348603 -0.8171679217710851 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507515_0.png resize: (414, 331) 1350348604 -1.0920000194027721 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507532_0.png resize: (264, 201) 1350348605 -1.3323025226678202 treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507537_0.png resize: (168, 188) 1350348606 -2.2038121462489353 treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507542_0.png resize: (173, 181) 1350348607 -0.47457472285132135 treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507554_0.png resize: (138, 188) 1350348608 -1.4426252110420834 treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507594_0.png resize: (120, 277) 1350348609 -1.0346365914493705 treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507591_0.png resize: (297, 291) 1350348610 0.6904281321427881 treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507595_0.png resize: (233, 201) 1350348611 -0.4782995620800386 treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507613_0.png resize: (205, 349) 1350348612 -0.8203689212087544 treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507630_0.png resize: (272, 118) 1350348613 -1.910154387479859 treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507628_0.png resize: (237, 221) 1350348614 -2.1924813703450843 treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507618_0.png resize: (209, 252) 1350348615 -1.172215311326788 treat image : temp/1744817428_2451742_1350312514_e221a39eda5a7641785de81b39555dfe_rle_crop_3749507456_0.png resize: (108, 156) 1350348705 -2.310793377177546 treat image : temp/1744817428_2451742_1350312514_e221a39eda5a7641785de81b39555dfe_rle_crop_3749507453_0.png resize: (239, 441) 1350348707 -1.4356112150861267 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507478_0.png resize: (273, 327) 1350348709 -2.803372352708588 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507462_0.png resize: (301, 434) 1350348710 -3.0629215266879264 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507461_0.png resize: (292, 359) 1350348711 -2.206949595295608 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507458_0.png resize: (151, 497) 1350348713 -2.425766913752005 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507471_0.png resize: (86, 518) 1350348714 -2.363370934508207 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507470_0.png resize: (579, 235) 1350348715 -3.199190895275872 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507475_0.png resize: (304, 641) 1350348716 0.33982465661267336 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507495_0.png resize: (314, 260) 1350348718 -2.5518189794170354 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507498_0.png resize: (301, 416) 1350348719 -1.916138427169513 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507501_0.png resize: (153, 421) 1350348720 -3.225717698939703 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507499_0.png resize: (494, 640) 1350348721 -3.1198876816007046 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507497_0.png resize: (368, 157) 1350348722 -3.405852854584934 treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507493_0.png resize: (339, 235) 1350348723 -3.0418915186097357 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507524_0.png resize: (304, 528) 1350348724 -2.3523050034743105 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507514_0.png resize: (102, 224) 1350348725 -1.979638453548969 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507521_0.png resize: (340, 593) 1350348727 -1.469779901932851 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507527_0.png resize: (552, 641) 1350348728 -2.831148900755611 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507535_0.png resize: (262, 616) 1350348729 -1.1270008050167508 treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507553_0.png resize: (89, 63) 1350348730 -2.8354231524535782 treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507562_0.png resize: (188, 312) 1350348731 -1.7677647064833921 treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507593_0.png resize: (188, 210) 1350348732 -0.7503363791053312 treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507586_0.png resize: (108, 245) 1350348733 -1.6309036303393147 treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507582_0.png resize: (300, 452) 1350348734 -2.9026935336738005 treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507588_0.png resize: (159, 215) 1350348735 -0.57303051366149 treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507607_0.png resize: (438, 515) 1350348736 -1.324212357845344 treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507605_0.png resize: (423, 678) 1350348737 -2.09306876263006 treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507606_0.png resize: (475, 327) 1350348738 -1.8897009253116628 treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507604_0.png resize: (617, 194) 1350348739 -0.8339380863783263 treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507635_0.png resize: (121, 154) 1350348740 -2.1271210821851763 treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507632_0.png resize: (971, 1469) 1350348741 -3.3663064885411 treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507619_0.png resize: (402, 603) 1350348742 -1.8705711566430792 treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507435_0.png resize: (150, 289) 1350348745 -3.8913234539043327 treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507463_0.png resize: (114, 129) 1350348746 -0.04419896397362164 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507526_0.png resize: (80, 105) 1350348747 0.06969381349172972 treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507589_0.png resize: (368, 274) 1350348752 -1.9886939599415687 treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507533_0.png resize: (189, 274) 1350348754 -2.2056610145412066 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 212 time used for this insertion : 0.02645397186279297 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 212 time used for this insertion : 0.06982564926147461 save missing photos in datou_result : time spend for datou_step_exec : 43.95322370529175 time spend to save output : 0.1027977466583252 total time spend for step 6 : 44.05602145195007 step7:brightness Wed Apr 16 17:37:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c.jpg treat image : temp/1744817428_2451742_1350312514_e221a39eda5a7641785de81b39555dfe.jpg treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6.jpg treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4.jpg treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e.jpg treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29.jpg treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f.jpg treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0.jpg treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4.jpg treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04.jpg treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507440_0.png treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507441_0.png treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507437_0.png treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507444_0.png treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507434_0.png treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507439_0.png treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507445_0.png treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507446_0.png treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507443_0.png treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507436_0.png treat image : temp/1744817428_2451742_1350312514_e221a39eda5a7641785de81b39555dfe_rle_crop_3749507447_0.png treat image : temp/1744817428_2451742_1350312514_e221a39eda5a7641785de81b39555dfe_rle_crop_3749507452_0.png treat image : temp/1744817428_2451742_1350312514_e221a39eda5a7641785de81b39555dfe_rle_crop_3749507449_0.png treat image : temp/1744817428_2451742_1350312514_e221a39eda5a7641785de81b39555dfe_rle_crop_3749507448_0.png treat image : temp/1744817428_2451742_1350312514_e221a39eda5a7641785de81b39555dfe_rle_crop_3749507455_0.png treat image : temp/1744817428_2451742_1350312514_e221a39eda5a7641785de81b39555dfe_rle_crop_3749507454_0.png treat image : temp/1744817428_2451742_1350312514_e221a39eda5a7641785de81b39555dfe_rle_crop_3749507450_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507459_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507457_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507468_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507476_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507482_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507477_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507469_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507466_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507473_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507480_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507465_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507479_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507481_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507460_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507472_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507464_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507474_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507467_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507494_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507509_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507487_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507490_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507489_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507486_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507506_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507504_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507484_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507502_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507508_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507485_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507496_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507488_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507503_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507491_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507510_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507511_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507528_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507516_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507523_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507531_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507518_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507520_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507522_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507517_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507513_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507529_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507530_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507534_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507512_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507519_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507525_0.png treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507551_0.png treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507548_0.png treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507547_0.png treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507550_0.png treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507545_0.png treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507538_0.png treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507546_0.png treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507543_0.png treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507544_0.png treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507541_0.png treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507540_0.png treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507549_0.png treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507539_0.png treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507536_0.png treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507552_0.png treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507555_0.png treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507556_0.png treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507564_0.png treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507576_0.png treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507561_0.png treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507570_0.png treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507563_0.png treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507575_0.png treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507559_0.png treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507567_0.png treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507566_0.png treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507560_0.png treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507573_0.png treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507557_0.png treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507558_0.png treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507568_0.png treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507571_0.png treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507572_0.png treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507569_0.png treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507574_0.png treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507565_0.png treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507581_0.png treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507584_0.png treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507583_0.png treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507587_0.png treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507580_0.png treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507592_0.png treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507578_0.png treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507585_0.png treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507577_0.png treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507579_0.png treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507590_0.png treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507612_0.png treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507602_0.png treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507596_0.png treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507614_0.png treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507603_0.png treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507598_0.png treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507610_0.png treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507608_0.png treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507600_0.png treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507599_0.png treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507611_0.png treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507601_0.png treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507609_0.png treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507597_0.png treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507629_0.png treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507616_0.png treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507622_0.png treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507621_0.png treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507620_0.png treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507634_0.png treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507623_0.png treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507631_0.png treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507626_0.png treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507627_0.png treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507617_0.png treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507615_0.png treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507625_0.png treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507624_0.png treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507633_0.png treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507438_0.png treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507442_0.png treat image : temp/1744817428_2451742_1350312514_e221a39eda5a7641785de81b39555dfe_rle_crop_3749507451_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507492_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507505_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507483_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507507_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507500_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507515_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507532_0.png treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507537_0.png treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507542_0.png treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507554_0.png treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507594_0.png treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507591_0.png treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507595_0.png treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507613_0.png treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507630_0.png treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507628_0.png treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507618_0.png treat image : temp/1744817428_2451742_1350312514_e221a39eda5a7641785de81b39555dfe_rle_crop_3749507456_0.png treat image : temp/1744817428_2451742_1350312514_e221a39eda5a7641785de81b39555dfe_rle_crop_3749507453_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507478_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507462_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507461_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507458_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507471_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507470_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507475_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507495_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507498_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507501_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507499_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507497_0.png treat image : temp/1744817428_2451742_1350312461_44e6ced90c13c997b4603ba58537cac4_rle_crop_3749507493_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507524_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507514_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507521_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507527_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507535_0.png treat image : temp/1744817428_2451742_1350312455_c2bd2ec19e56449f2af0e5536fa12d29_rle_crop_3749507553_0.png treat image : temp/1744817428_2451742_1350312452_1bb77eee89b5d37f45eb4d2f446f1b3f_rle_crop_3749507562_0.png treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507593_0.png treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507586_0.png treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507582_0.png treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507588_0.png treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507607_0.png treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507605_0.png treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507606_0.png treat image : temp/1744817428_2451742_1350309439_2c0d479923b56ce0931c874b706a3bd4_rle_crop_3749507604_0.png treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507635_0.png treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507632_0.png treat image : temp/1744817428_2451742_1350309398_28d17b6f136ca0884a4eddc8cd002f04_rle_crop_3749507619_0.png treat image : temp/1744817428_2451742_1350312993_1d8cafd0b6feebe853047522a859bb6c_rle_crop_3749507435_0.png treat image : temp/1744817428_2451742_1350312482_77d4bbb49e530ffb15752fa43572a8d6_rle_crop_3749507463_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507526_0.png treat image : temp/1744817428_2451742_1350310491_d14d80c4e165c36d01aff2036361edc0_rle_crop_3749507589_0.png treat image : temp/1744817428_2451742_1350312457_e9826206bdd7431674b6040af21d0c9e_rle_crop_3749507533_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 212 time used for this insertion : 0.022614240646362305 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 212 time used for this insertion : 0.04893660545349121 save missing photos in datou_result : time spend for datou_step_exec : 10.727712392807007 time spend to save output : 0.07770013809204102 total time spend for step 7 : 10.805412530899048 step8:velours_tree Wed Apr 16 17:37:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 1.7376716136932373 time spend to save output : 3.695487976074219e-05 total time spend for step 8 : 1.737708568572998 step9:send_mail_cod Wed Apr 16 17:37:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22089282_16-04-2025_17_37_52.pdf 22090271 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette220902711744817872 22090273 change filename to text .imagette220902731744817874 22090274 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette220902741744817874 22090275 change filename to text .change filename to text .change filename to text .imagette220902751744817876 22090276 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette220902761744817876 22090277 imagette220902771744817878 22090278 change filename to text .imagette220902781744817878 22090279 imagette220902791744817878 22090280 imagette220902801744817878 22090281 imagette220902811744817878 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22089282 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22090271,22090272,22090273,22090274,22090275,22090276,22090277,22090278,22090279,22090280,22090281?tags=papier,environnement,pet_fonce,carton,autre,pet_clair,metal,pehd,flou,background,mal_croppe args[1350312993] : ((1350312993, -5.4139630974903525, 492609224), (1350312993, 0.001571061394065061, 2107752395), '0.19359441664397245') We are sending mail with results at report@fotonower.com args[1350312514] : ((1350312514, -0.7746336364673522, 492688767), (1350312514, 0.1276989500416026, 2107752395), '0.19359441664397245') We are sending mail with results at report@fotonower.com args[1350312482] : ((1350312482, -3.083030838310986, 492609224), (1350312482, 0.21723452827488593, 2107752395), '0.19359441664397245') We are sending mail with results at report@fotonower.com args[1350312461] : ((1350312461, -4.003611872347516, 492609224), (1350312461, 0.13621888016266953, 2107752395), '0.19359441664397245') We are sending mail with results at report@fotonower.com args[1350312457] : ((1350312457, -3.993170537406092, 492609224), (1350312457, -0.1266334609660137, 496442774), '0.19359441664397245') We are sending mail with results at report@fotonower.com args[1350312455] : ((1350312455, -6.439365312742162, 492609224), (1350312455, 0.024799353147863572, 2107752395), '0.19359441664397245') We are sending mail with results at report@fotonower.com args[1350312452] : ((1350312452, -3.778051101631929, 492609224), (1350312452, 0.21002716149099251, 2107752395), '0.19359441664397245') We are sending mail with results at report@fotonower.com args[1350310491] : ((1350310491, -1.7904250461770326, 492688767), (1350310491, 0.16423269435320745, 2107752395), '0.19359441664397245') We are sending mail with results at report@fotonower.com args[1350309439] : ((1350309439, -2.5275130007193884, 492609224), (1350309439, 0.1793199935863954, 2107752395), '0.19359441664397245') We are sending mail with results at report@fotonower.com args[1350309398] : ((1350309398, -2.0375559877557463, 492609224), (1350309398, 0.1986959399752992, 2107752395), '0.19359441664397245') We are sending mail with results at report@fotonower.com refus_total : 0.19359441664397245 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22089282 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1350312514,1350312993,1350310491,1350312452,1350309398,1350309439,1350312455,1350312457,1350312461,1350312482) Found this number of photos: 10 begin to download photo : 1350312514 begin to download photo : 1350312452 begin to download photo : 1350312455 begin to download photo : 1350312482 download finish for photo 1350312514 begin to download photo : 1350312993 download finish for photo 1350312455 begin to download photo : 1350312457 download finish for photo 1350312482 download finish for photo 1350312452 begin to download photo : 1350309398 download finish for photo 1350312993 begin to download photo : 1350310491 download finish for photo 1350309398 begin to download photo : 1350309439 download finish for photo 1350312457 begin to download photo : 1350312461 download finish for photo 1350310491 download finish for photo 1350312461 download finish for photo 1350309439 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22089282_16-04-2025_17_37_52.pdf results_Auto_P22089282_16-04-2025_17_37_52.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22089282_16-04-2025_17_37_52.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22089282','results_Auto_P22089282_16-04-2025_17_37_52.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22089282_16-04-2025_17_37_52.pdf','pdf','','1.12','0.19359441664397245') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22089282

https://www.fotonower.com/image?json=false&list_photos_id=1350312993
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1350312514
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1350312482
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1350312461
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1350312457
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1350312455
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1350312452
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1350310491
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1350309439
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1350309398
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 19.36%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/22090271?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/22090273?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22090274?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22090275?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22090276?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/22090278?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22089282_16-04-2025_17_37_52.pdf.

Lien vers velours :https://www.fotonower.com/velours/22090271,22090272,22090273,22090274,22090275,22090276,22090277,22090278,22090279,22090280,22090281?tags=papier,environnement,pet_fonce,carton,autre,pet_clair,metal,pehd,flou,background,mal_croppe.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 16 Apr 2025 15:38:01 GMT Content-Length: 0 Connection: close X-Message-Id: 441cn9ZvR2GIZSsaPwm-gg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1350312993, 1350312514, 1350312482, 1350312461, 1350312457, 1350312455, 1350312452, 1350310491, 1350309439, 1350309398] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312993', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312514', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312482', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312461', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312457', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312455', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312452', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350310491', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350309439', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350309398', None, None, None, None, None, '2726919') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.015035629272460938 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.639896154403687 time spend to save output : 0.015287160873413086 total time spend for step 9 : 8.6551833152771 step10:split_time_score Wed Apr 16 17:38:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 16042025 22089282 Nombre de photos uploadées : 10 / 23040 (0%) 16042025 22089282 Nombre de photos taguées (types de déchets): 0 / 10 (0%) 16042025 22089282 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 2.6226043701171875e-06 elapsed_time : order_list_meta_photo_and_scores 6.4373016357421875e-06 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.0007693767547607422 elapsed_time : insert_dashboard_record_day_entry 0.027010679244995117 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.05629389033215374 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22067057_16-04-2025_08_46_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22067057 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22067057 AND mptpi.`type`=3726 To do Qualite : 0.1481707613600996 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22067060_16-04-2025_08_59_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22067060 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22067060 AND mptpi.`type`=3594 To do Qualite : 0.14357084625160607 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22075421_16-04-2025_12_41_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22075421 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22075421 AND mptpi.`type`=3594 To do Qualite : 0.04703204159453052 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22075450_16-04-2025_12_23_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22075450 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22075450 AND mptpi.`type`=3726 To do Qualite : 0.15418995912072556 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22075451_16-04-2025_12_37_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22075451 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22075451 AND mptpi.`type`=3594 To do Qualite : 0.18649599950576945 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22085460_16-04-2025_16_47_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22085460 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22085460 AND mptpi.`type`=3594 To do Qualite : 0.15787395503234966 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22085462_16-04-2025_16_38_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22085462 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22085462 AND mptpi.`type`=3594 To do Qualite : 0.19359441664397245 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22089282_16-04-2025_17_37_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22089282 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22089282 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22089283 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'16042025': {'nb_upload': 10, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1350312993, 1350312514, 1350312482, 1350312461, 1350312457, 1350312455, 1350312452, 1350310491, 1350309439, 1350309398] Looping around the photos to save general results len do output : 1 /22089282Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312993', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312514', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312482', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312461', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312457', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312455', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350312452', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350310491', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350309439', None, None, None, None, None, '2726919') ('3318', None, None, None, None, None, None, None, '2726919') ('3318', '22089282', '1350309398', None, None, None, None, None, '2726919') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.013594865798950195 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6664032936096191 time spend to save output : 0.013843059539794922 total time spend for step 10 : 1.680246353149414 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 10 set_done_treatment 213.46user 170.47system 7:38.12elapsed 83%CPU (0avgtext+0avgdata 5106412maxresident)k 2043184inputs+185544outputs (54317major+18294273minor)pagefaults 0swaps