python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2639583 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3592270'] with mtr_portfolio_ids : ['26211842'] and first list_photo_ids : [] new path : /proc/2639583/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 9 ; length of list_pids : 9 ; length of list_args : 9 time to download the photos : 1.6808693408966064 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Aug 25 19:40:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10387 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-25 19:40:33.065800: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-25 19:40:33.092573: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-25 19:40:33.094234: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f8854000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-25 19:40:33.094278: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-25 19:40:33.097033: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-25 19:40:33.236221: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x608b6d0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-25 19:40:33.236263: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-25 19:40:33.237534: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-25 19:40:33.237916: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-25 19:40:33.243145: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-25 19:40:33.245741: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-25 19:40:33.246647: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-25 19:40:33.249239: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-25 19:40:33.250470: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-25 19:40:33.255331: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-25 19:40:33.256780: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-25 19:40:33.256850: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-25 19:40:33.257613: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-25 19:40:33.257627: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-25 19:40:33.257636: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-25 19:40:33.259003: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9621 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-25 19:40:33.538519: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-25 19:40:33.538603: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-25 19:40:33.538623: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-25 19:40:33.538642: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-25 19:40:33.538659: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-25 19:40:33.538677: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-25 19:40:33.538693: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-25 19:40:33.538711: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-25 19:40:33.540253: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-25 19:40:33.541622: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-25 19:40:33.541664: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-25 19:40:33.541686: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-25 19:40:33.541705: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-25 19:40:33.541725: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-25 19:40:33.541745: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-25 19:40:33.541765: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-25 19:40:33.541784: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-25 19:40:33.543317: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-25 19:40:33.543347: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-25 19:40:33.543357: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-25 19:40:33.543366: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-25 19:40:33.545001: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9621 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-25 19:40:44.384664: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-25 19:40:44.609399: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 9 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 55 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 Detection mask done ! Trying to reset tf kernel 2640270 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 128 tf kernel not reseted sub process len(results) : 9 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 9 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5437 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.004491329193115234 nb_pixel_total : 122131 time to create 1 rle with old method : 0.17621397972106934 length of segment : 373 time for calcul the mask position with numpy : 0.0034694671630859375 nb_pixel_total : 101002 time to create 1 rle with old method : 0.12688851356506348 length of segment : 296 time for calcul the mask position with numpy : 0.0009243488311767578 nb_pixel_total : 43826 time to create 1 rle with old method : 0.049751996994018555 length of segment : 235 time for calcul the mask position with numpy : 0.0050470829010009766 nb_pixel_total : 166537 time to create 1 rle with new method : 0.010898828506469727 length of segment : 393 time for calcul the mask position with numpy : 0.001758575439453125 nb_pixel_total : 66361 time to create 1 rle with old method : 0.08198738098144531 length of segment : 320 time for calcul the mask position with numpy : 0.0013954639434814453 nb_pixel_total : 62694 time to create 1 rle with old method : 0.07724475860595703 length of segment : 409 time for calcul the mask position with numpy : 0.0007936954498291016 nb_pixel_total : 19777 time to create 1 rle with old method : 0.023029565811157227 length of segment : 213 time for calcul the mask position with numpy : 0.0008406639099121094 nb_pixel_total : 27960 time to create 1 rle with old method : 0.03184199333190918 length of segment : 289 time for calcul the mask position with numpy : 0.0007612705230712891 nb_pixel_total : 17535 time to create 1 rle with old method : 0.020212411880493164 length of segment : 225 time for calcul the mask position with numpy : 0.002331256866455078 nb_pixel_total : 85530 time to create 1 rle with old method : 0.09667134284973145 length of segment : 522 time for calcul the mask position with numpy : 0.0002205371856689453 nb_pixel_total : 7395 time to create 1 rle with old method : 0.00850057601928711 length of segment : 116 time for calcul the mask position with numpy : 0.0013942718505859375 nb_pixel_total : 25980 time to create 1 rle with old method : 0.030138015747070312 length of segment : 211 time for calcul the mask position with numpy : 0.0006854534149169922 nb_pixel_total : 19992 time to create 1 rle with old method : 0.02346181869506836 length of segment : 124 time for calcul the mask position with numpy : 0.002062082290649414 nb_pixel_total : 104868 time to create 1 rle with old method : 0.12868428230285645 length of segment : 293 time for calcul the mask position with numpy : 0.0010502338409423828 nb_pixel_total : 41997 time to create 1 rle with old method : 0.049698829650878906 length of segment : 336 time for calcul the mask position with numpy : 0.0009753704071044922 nb_pixel_total : 45193 time to create 1 rle with old method : 0.05143618583679199 length of segment : 300 time for calcul the mask position with numpy : 0.001348733901977539 nb_pixel_total : 64316 time to create 1 rle with old method : 0.0859839916229248 length of segment : 373 time for calcul the mask position with numpy : 0.002913236618041992 nb_pixel_total : 98520 time to create 1 rle with old method : 0.1104898452758789 length of segment : 413 time for calcul the mask position with numpy : 0.00045680999755859375 nb_pixel_total : 20971 time to create 1 rle with old method : 0.024225711822509766 length of segment : 250 time for calcul the mask position with numpy : 0.0009224414825439453 nb_pixel_total : 35440 time to create 1 rle with old method : 0.04131793975830078 length of segment : 252 time for calcul the mask position with numpy : 0.0007500648498535156 nb_pixel_total : 21824 time to create 1 rle with old method : 0.02538776397705078 length of segment : 268 time for calcul the mask position with numpy : 0.0007574558258056641 nb_pixel_total : 25223 time to create 1 rle with old method : 0.03395676612854004 length of segment : 199 time for calcul the mask position with numpy : 0.0011534690856933594 nb_pixel_total : 41552 time to create 1 rle with old method : 0.04863929748535156 length of segment : 326 time for calcul the mask position with numpy : 0.0010502338409423828 nb_pixel_total : 40543 time to create 1 rle with old method : 0.04604983329772949 length of segment : 401 time for calcul the mask position with numpy : 0.001306772232055664 nb_pixel_total : 69403 time to create 1 rle with old method : 0.0797727108001709 length of segment : 284 time for calcul the mask position with numpy : 0.001194000244140625 nb_pixel_total : 56111 time to create 1 rle with old method : 0.06425070762634277 length of segment : 476 time for calcul the mask position with numpy : 0.00020813941955566406 nb_pixel_total : 7462 time to create 1 rle with old method : 0.01235818862915039 length of segment : 149 time for calcul the mask position with numpy : 0.002106189727783203 nb_pixel_total : 62225 time to create 1 rle with old method : 0.07206583023071289 length of segment : 757 time for calcul the mask position with numpy : 0.0007910728454589844 nb_pixel_total : 20310 time to create 1 rle with old method : 0.02374553680419922 length of segment : 177 time for calcul the mask position with numpy : 0.0005304813385009766 nb_pixel_total : 19647 time to create 1 rle with old method : 0.023176193237304688 length of segment : 165 time for calcul the mask position with numpy : 0.0008327960968017578 nb_pixel_total : 26760 time to create 1 rle with old method : 0.03048229217529297 length of segment : 300 time for calcul the mask position with numpy : 0.005091190338134766 nb_pixel_total : 135434 time to create 1 rle with old method : 0.15108036994934082 length of segment : 679 time for calcul the mask position with numpy : 0.004777431488037109 nb_pixel_total : 75715 time to create 1 rle with old method : 0.08928513526916504 length of segment : 380 time for calcul the mask position with numpy : 0.0031824111938476562 nb_pixel_total : 83753 time to create 1 rle with old method : 0.09926939010620117 length of segment : 291 time for calcul the mask position with numpy : 0.0012331008911132812 nb_pixel_total : 44783 time to create 1 rle with old method : 0.050707101821899414 length of segment : 254 time for calcul the mask position with numpy : 0.005652189254760742 nb_pixel_total : 157243 time to create 1 rle with new method : 0.012093782424926758 length of segment : 501 time for calcul the mask position with numpy : 0.0009245872497558594 nb_pixel_total : 20632 time to create 1 rle with old method : 0.023656368255615234 length of segment : 182 time for calcul the mask position with numpy : 0.0007431507110595703 nb_pixel_total : 16372 time to create 1 rle with old method : 0.019526958465576172 length of segment : 184 time for calcul the mask position with numpy : 0.0008196830749511719 nb_pixel_total : 14034 time to create 1 rle with old method : 0.020157575607299805 length of segment : 179 time for calcul the mask position with numpy : 0.0013971328735351562 nb_pixel_total : 29027 time to create 1 rle with old method : 0.03283238410949707 length of segment : 289 time for calcul the mask position with numpy : 0.0009474754333496094 nb_pixel_total : 25829 time to create 1 rle with old method : 0.031777381896972656 length of segment : 268 time for calcul the mask position with numpy : 0.002745389938354492 nb_pixel_total : 57137 time to create 1 rle with old method : 0.06466102600097656 length of segment : 369 time for calcul the mask position with numpy : 0.0012745857238769531 nb_pixel_total : 28705 time to create 1 rle with old method : 0.0328214168548584 length of segment : 304 time for calcul the mask position with numpy : 0.0020813941955566406 nb_pixel_total : 56327 time to create 1 rle with old method : 0.061608314514160156 length of segment : 403 time for calcul the mask position with numpy : 0.0008192062377929688 nb_pixel_total : 17206 time to create 1 rle with old method : 0.02315974235534668 length of segment : 117 time for calcul the mask position with numpy : 0.0018227100372314453 nb_pixel_total : 20647 time to create 1 rle with old method : 0.024094104766845703 length of segment : 185 time for calcul the mask position with numpy : 0.0011630058288574219 nb_pixel_total : 35853 time to create 1 rle with old method : 0.04601454734802246 length of segment : 210 time for calcul the mask position with numpy : 0.0006556510925292969 nb_pixel_total : 14444 time to create 1 rle with old method : 0.018126964569091797 length of segment : 151 time for calcul the mask position with numpy : 0.0012607574462890625 nb_pixel_total : 25219 time to create 1 rle with old method : 0.04242515563964844 length of segment : 216 time for calcul the mask position with numpy : 0.0016548633575439453 nb_pixel_total : 37136 time to create 1 rle with old method : 0.042282819747924805 length of segment : 255 time for calcul the mask position with numpy : 0.0011379718780517578 nb_pixel_total : 22060 time to create 1 rle with old method : 0.028644084930419922 length of segment : 347 time for calcul the mask position with numpy : 0.0008618831634521484 nb_pixel_total : 26108 time to create 1 rle with old method : 0.030084848403930664 length of segment : 156 time for calcul the mask position with numpy : 0.0009024143218994141 nb_pixel_total : 40901 time to create 1 rle with old method : 0.046720027923583984 length of segment : 288 time for calcul the mask position with numpy : 0.0008251667022705078 nb_pixel_total : 17423 time to create 1 rle with old method : 0.01982402801513672 length of segment : 242 time for calcul the mask position with numpy : 0.002076864242553711 nb_pixel_total : 67066 time to create 1 rle with old method : 0.08087778091430664 length of segment : 305 time for calcul the mask position with numpy : 0.0033960342407226562 nb_pixel_total : 118657 time to create 1 rle with old method : 0.14057207107543945 length of segment : 470 time for calcul the mask position with numpy : 0.002315521240234375 nb_pixel_total : 63110 time to create 1 rle with old method : 0.07218718528747559 length of segment : 168 time for calcul the mask position with numpy : 0.002200603485107422 nb_pixel_total : 41066 time to create 1 rle with old method : 0.04790663719177246 length of segment : 232 time for calcul the mask position with numpy : 0.002412557601928711 nb_pixel_total : 41568 time to create 1 rle with old method : 0.050040245056152344 length of segment : 340 time for calcul the mask position with numpy : 0.001954317092895508 nb_pixel_total : 32066 time to create 1 rle with old method : 0.03686690330505371 length of segment : 238 time for calcul the mask position with numpy : 0.0011763572692871094 nb_pixel_total : 59439 time to create 1 rle with old method : 0.06920289993286133 length of segment : 170 time for calcul the mask position with numpy : 0.0010259151458740234 nb_pixel_total : 23599 time to create 1 rle with old method : 0.027301788330078125 length of segment : 215 time for calcul the mask position with numpy : 0.006050825119018555 nb_pixel_total : 126139 time to create 1 rle with old method : 0.14586639404296875 length of segment : 574 time for calcul the mask position with numpy : 0.0038437843322753906 nb_pixel_total : 54806 time to create 1 rle with old method : 0.07991838455200195 length of segment : 336 time for calcul the mask position with numpy : 0.0037300586700439453 nb_pixel_total : 27803 time to create 1 rle with old method : 0.0320591926574707 length of segment : 321 time for calcul the mask position with numpy : 0.0012509822845458984 nb_pixel_total : 19730 time to create 1 rle with old method : 0.022673368453979492 length of segment : 197 time for calcul the mask position with numpy : 0.006253719329833984 nb_pixel_total : 99664 time to create 1 rle with old method : 0.12395167350769043 length of segment : 399 time for calcul the mask position with numpy : 0.0008053779602050781 nb_pixel_total : 12838 time to create 1 rle with old method : 0.014790773391723633 length of segment : 204 time for calcul the mask position with numpy : 0.0016160011291503906 nb_pixel_total : 40348 time to create 1 rle with old method : 0.046326398849487305 length of segment : 207 time for calcul the mask position with numpy : 0.0026252269744873047 nb_pixel_total : 37084 time to create 1 rle with old method : 0.043793439865112305 length of segment : 291 time for calcul the mask position with numpy : 0.002987384796142578 nb_pixel_total : 44257 time to create 1 rle with old method : 0.050398826599121094 length of segment : 294 time for calcul the mask position with numpy : 0.025236845016479492 nb_pixel_total : 326653 time to create 1 rle with new method : 0.19794774055480957 length of segment : 900 time for calcul the mask position with numpy : 0.0023317337036132812 nb_pixel_total : 66147 time to create 1 rle with old method : 0.08144068717956543 length of segment : 375 time for calcul the mask position with numpy : 0.0004475116729736328 nb_pixel_total : 13331 time to create 1 rle with old method : 0.015682697296142578 length of segment : 145 time for calcul the mask position with numpy : 0.0012307167053222656 nb_pixel_total : 18428 time to create 1 rle with old method : 0.02190256118774414 length of segment : 305 time for calcul the mask position with numpy : 0.0016293525695800781 nb_pixel_total : 38170 time to create 1 rle with old method : 0.04579734802246094 length of segment : 146 time for calcul the mask position with numpy : 0.0019068717956542969 nb_pixel_total : 41196 time to create 1 rle with old method : 0.047215938568115234 length of segment : 286 time for calcul the mask position with numpy : 0.0008223056793212891 nb_pixel_total : 17179 time to create 1 rle with old method : 0.019975900650024414 length of segment : 284 time for calcul the mask position with numpy : 0.00601959228515625 nb_pixel_total : 210511 time to create 1 rle with new method : 0.012109756469726562 length of segment : 563 time for calcul the mask position with numpy : 0.0021178722381591797 nb_pixel_total : 58369 time to create 1 rle with old method : 0.0704796314239502 length of segment : 247 time for calcul the mask position with numpy : 0.0012378692626953125 nb_pixel_total : 23104 time to create 1 rle with old method : 0.028177261352539062 length of segment : 210 time for calcul the mask position with numpy : 0.0008165836334228516 nb_pixel_total : 15635 time to create 1 rle with old method : 0.018024921417236328 length of segment : 194 time for calcul the mask position with numpy : 0.0006520748138427734 nb_pixel_total : 17711 time to create 1 rle with old method : 0.02089977264404297 length of segment : 180 time for calcul the mask position with numpy : 0.0005767345428466797 nb_pixel_total : 7428 time to create 1 rle with old method : 0.008689641952514648 length of segment : 175 time for calcul the mask position with numpy : 0.005125761032104492 nb_pixel_total : 125056 time to create 1 rle with old method : 0.14351487159729004 length of segment : 410 time for calcul the mask position with numpy : 0.0006470680236816406 nb_pixel_total : 10700 time to create 1 rle with old method : 0.01229095458984375 length of segment : 121 time for calcul the mask position with numpy : 0.0008113384246826172 nb_pixel_total : 14688 time to create 1 rle with old method : 0.017152786254882812 length of segment : 148 time for calcul the mask position with numpy : 0.0015645027160644531 nb_pixel_total : 47316 time to create 1 rle with old method : 0.05382966995239258 length of segment : 234 time for calcul the mask position with numpy : 0.0014264583587646484 nb_pixel_total : 25085 time to create 1 rle with old method : 0.028945207595825195 length of segment : 339 time for calcul the mask position with numpy : 0.0017652511596679688 nb_pixel_total : 22566 time to create 1 rle with old method : 0.0260922908782959 length of segment : 292 time for calcul the mask position with numpy : 0.0010221004486083984 nb_pixel_total : 18316 time to create 1 rle with old method : 0.02180004119873047 length of segment : 147 time for calcul the mask position with numpy : 0.001766204833984375 nb_pixel_total : 46037 time to create 1 rle with old method : 0.05249285697937012 length of segment : 321 time for calcul the mask position with numpy : 0.004617452621459961 nb_pixel_total : 50416 time to create 1 rle with old method : 0.0575251579284668 length of segment : 254 time for calcul the mask position with numpy : 0.001963376998901367 nb_pixel_total : 43039 time to create 1 rle with old method : 0.0501401424407959 length of segment : 281 time for calcul the mask position with numpy : 0.0021562576293945312 nb_pixel_total : 62822 time to create 1 rle with old method : 0.07134056091308594 length of segment : 250 time for calcul the mask position with numpy : 0.003580808639526367 nb_pixel_total : 103826 time to create 1 rle with old method : 0.11860203742980957 length of segment : 515 time for calcul the mask position with numpy : 0.002226591110229492 nb_pixel_total : 50566 time to create 1 rle with old method : 0.05529427528381348 length of segment : 343 time for calcul the mask position with numpy : 0.004895210266113281 nb_pixel_total : 116137 time to create 1 rle with old method : 0.12625741958618164 length of segment : 473 time for calcul the mask position with numpy : 0.001699686050415039 nb_pixel_total : 41839 time to create 1 rle with old method : 0.04899287223815918 length of segment : 313 time for calcul the mask position with numpy : 0.001567840576171875 nb_pixel_total : 32588 time to create 1 rle with old method : 0.036879539489746094 length of segment : 248 time for calcul the mask position with numpy : 0.0002987384796142578 nb_pixel_total : 7958 time to create 1 rle with old method : 0.009509563446044922 length of segment : 94 time for calcul the mask position with numpy : 0.0011553764343261719 nb_pixel_total : 28678 time to create 1 rle with old method : 0.03224515914916992 length of segment : 294 time for calcul the mask position with numpy : 0.0005643367767333984 nb_pixel_total : 11646 time to create 1 rle with old method : 0.013049125671386719 length of segment : 161 time for calcul the mask position with numpy : 0.0023615360260009766 nb_pixel_total : 78079 time to create 1 rle with old method : 0.08644413948059082 length of segment : 395 time for calcul the mask position with numpy : 0.001581430435180664 nb_pixel_total : 27022 time to create 1 rle with old method : 0.030349254608154297 length of segment : 320 time for calcul the mask position with numpy : 0.00278472900390625 nb_pixel_total : 91611 time to create 1 rle with old method : 0.10181593894958496 length of segment : 358 time for calcul the mask position with numpy : 0.002084970474243164 nb_pixel_total : 31815 time to create 1 rle with old method : 0.03976845741271973 length of segment : 236 time for calcul the mask position with numpy : 0.002353191375732422 nb_pixel_total : 69547 time to create 1 rle with old method : 0.07735395431518555 length of segment : 399 time for calcul the mask position with numpy : 0.002605915069580078 nb_pixel_total : 63691 time to create 1 rle with old method : 0.07443857192993164 length of segment : 253 time for calcul the mask position with numpy : 0.0020987987518310547 nb_pixel_total : 29655 time to create 1 rle with old method : 0.037355661392211914 length of segment : 264 time for calcul the mask position with numpy : 0.0009319782257080078 nb_pixel_total : 17046 time to create 1 rle with old method : 0.020598411560058594 length of segment : 136 time for calcul the mask position with numpy : 0.0015075206756591797 nb_pixel_total : 40907 time to create 1 rle with old method : 0.049735069274902344 length of segment : 231 time for calcul the mask position with numpy : 0.004204273223876953 nb_pixel_total : 118762 time to create 1 rle with old method : 0.13408136367797852 length of segment : 468 time for calcul the mask position with numpy : 0.002772808074951172 nb_pixel_total : 84305 time to create 1 rle with old method : 0.0944831371307373 length of segment : 633 time for calcul the mask position with numpy : 0.0006723403930664062 nb_pixel_total : 10695 time to create 1 rle with old method : 0.012546539306640625 length of segment : 112 time for calcul the mask position with numpy : 0.0019178390502929688 nb_pixel_total : 39312 time to create 1 rle with old method : 0.06157279014587402 length of segment : 314 time for calcul the mask position with numpy : 0.0009415149688720703 nb_pixel_total : 17875 time to create 1 rle with old method : 0.021288156509399414 length of segment : 134 time for calcul the mask position with numpy : 0.001064300537109375 nb_pixel_total : 26181 time to create 1 rle with old method : 0.03173971176147461 length of segment : 158 time for calcul the mask position with numpy : 0.0039441585540771484 nb_pixel_total : 69400 time to create 1 rle with old method : 0.07857084274291992 length of segment : 291 time for calcul the mask position with numpy : 0.007033348083496094 nb_pixel_total : 132408 time to create 1 rle with old method : 0.14687180519104004 length of segment : 960 time for calcul the mask position with numpy : 0.002401113510131836 nb_pixel_total : 28198 time to create 1 rle with old method : 0.03246879577636719 length of segment : 207 time for calcul the mask position with numpy : 0.0024547576904296875 nb_pixel_total : 46755 time to create 1 rle with old method : 0.05276608467102051 length of segment : 393 time for calcul the mask position with numpy : 0.004338979721069336 nb_pixel_total : 169716 time to create 1 rle with new method : 0.012508153915405273 length of segment : 658 time for calcul the mask position with numpy : 0.006561756134033203 nb_pixel_total : 162730 time to create 1 rle with new method : 0.01619720458984375 length of segment : 594 time for calcul the mask position with numpy : 0.0028858184814453125 nb_pixel_total : 57579 time to create 1 rle with old method : 0.06520438194274902 length of segment : 309 time for calcul the mask position with numpy : 0.0014944076538085938 nb_pixel_total : 34572 time to create 1 rle with old method : 0.04046130180358887 length of segment : 161 time for calcul the mask position with numpy : 0.0011966228485107422 nb_pixel_total : 28785 time to create 1 rle with old method : 0.033032894134521484 length of segment : 193 time for calcul the mask position with numpy : 0.0008897781372070312 nb_pixel_total : 20746 time to create 1 rle with old method : 0.023667573928833008 length of segment : 185 time for calcul the mask position with numpy : 0.0029630661010742188 nb_pixel_total : 85365 time to create 1 rle with old method : 0.09687089920043945 length of segment : 494 time for calcul the mask position with numpy : 0.0014607906341552734 nb_pixel_total : 39593 time to create 1 rle with old method : 0.045296430587768555 length of segment : 254 time for calcul the mask position with numpy : 0.006310224533081055 nb_pixel_total : 152686 time to create 1 rle with new method : 0.012985706329345703 length of segment : 491 time for calcul the mask position with numpy : 0.0022628307342529297 nb_pixel_total : 83312 time to create 1 rle with old method : 0.09439969062805176 length of segment : 372 time for calcul the mask position with numpy : 0.0014166831970214844 nb_pixel_total : 29724 time to create 1 rle with old method : 0.0347900390625 length of segment : 265 time for calcul the mask position with numpy : 0.0023343563079833984 nb_pixel_total : 60520 time to create 1 rle with old method : 0.06931734085083008 length of segment : 434 time for calcul the mask position with numpy : 0.0009181499481201172 nb_pixel_total : 26744 time to create 1 rle with old method : 0.03099203109741211 length of segment : 153 time for calcul the mask position with numpy : 0.0006422996520996094 nb_pixel_total : 13693 time to create 1 rle with old method : 0.016072988510131836 length of segment : 177 time for calcul the mask position with numpy : 0.0011203289031982422 nb_pixel_total : 28397 time to create 1 rle with old method : 0.03302145004272461 length of segment : 187 time for calcul the mask position with numpy : 0.0008535385131835938 nb_pixel_total : 27240 time to create 1 rle with old method : 0.03213787078857422 length of segment : 128 time for calcul the mask position with numpy : 0.0012907981872558594 nb_pixel_total : 25106 time to create 1 rle with old method : 0.03162789344787598 length of segment : 200 time for calcul the mask position with numpy : 0.001024484634399414 nb_pixel_total : 35486 time to create 1 rle with old method : 0.03997302055358887 length of segment : 230 time for calcul the mask position with numpy : 0.0033452510833740234 nb_pixel_total : 90466 time to create 1 rle with old method : 0.10206079483032227 length of segment : 438 time for calcul the mask position with numpy : 0.001608133316040039 nb_pixel_total : 59331 time to create 1 rle with old method : 0.06607508659362793 length of segment : 342 time for calcul the mask position with numpy : 0.0036859512329101562 nb_pixel_total : 63494 time to create 1 rle with old method : 0.07192301750183105 length of segment : 380 time for calcul the mask position with numpy : 0.0008561611175537109 nb_pixel_total : 41854 time to create 1 rle with old method : 0.048101186752319336 length of segment : 246 time for calcul the mask position with numpy : 0.0021674633026123047 nb_pixel_total : 88137 time to create 1 rle with old method : 0.0999288558959961 length of segment : 480 time for calcul the mask position with numpy : 0.0005068778991699219 nb_pixel_total : 11345 time to create 1 rle with old method : 0.012870311737060547 length of segment : 157 time for calcul the mask position with numpy : 0.0014922618865966797 nb_pixel_total : 50135 time to create 1 rle with old method : 0.0578916072845459 length of segment : 266 time for calcul the mask position with numpy : 0.0018010139465332031 nb_pixel_total : 81031 time to create 1 rle with old method : 0.09207606315612793 length of segment : 609 time for calcul the mask position with numpy : 0.0020470619201660156 nb_pixel_total : 98534 time to create 1 rle with old method : 0.11133766174316406 length of segment : 257 time for calcul the mask position with numpy : 0.0003154277801513672 nb_pixel_total : 14583 time to create 1 rle with old method : 0.017603397369384766 length of segment : 129 time for calcul the mask position with numpy : 0.0007498264312744141 nb_pixel_total : 35594 time to create 1 rle with old method : 0.04074573516845703 length of segment : 270 time for calcul the mask position with numpy : 0.3461775779724121 nb_pixel_total : 4387535 time to create 1 rle with new method : 0.692638635635376 length of segment : 2498 time for calcul the mask position with numpy : 0.0007977485656738281 nb_pixel_total : 39802 time to create 1 rle with old method : 0.04801750183105469 length of segment : 235 time spent for convertir_results : 17.93691658973694 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 153 chid ids of type : 3594 Number RLEs to save : 48158 save missing photos in datou_result : time spend for datou_step_exec : 90.22969222068787 time spend to save output : 3.048251152038574 total time spend for step 1 : 93.27794337272644 step2:crop_condition Mon Aug 25 19:42:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 9 ! batch 1 Loaded 153 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 127 About to insert : list_path_to_insert length 127 new photo from crops ! About to upload 127 photos upload in portfolio : 3736932 init cache_photo without model_param we have 127 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756143758_2639583 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 127 photos in the portfolio 3736932 time of upload the photos Elapsed time : 43.325756788253784 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3736932 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756143805_2639583 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 10 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.3655173778533936 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756143810_2639583 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0255913734436035 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 13 About to insert : list_path_to_insert length 13 new photo from crops ! About to upload 13 photos upload in portfolio : 3736932 init cache_photo without model_param we have 13 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756143834_2639583 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 13 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.339327573776245 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756143840_2639583 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6413486003875732 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1379270196, 1379270191, 1379270182, 1379270180, 1379270148, 1379270117, 1379270097, 1379270095, 1379270076] Looping around the photos to save general results len do output : 153 /1379284337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1379284537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270196', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270191', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270182', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270180', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270148', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270117', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270097', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270095', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270076', None, None, None, None, None, '3592270') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 468 time used for this insertion : 0.05941963195800781 save_final save missing photos in datou_result : time spend for datou_step_exec : 117.45439720153809 time spend to save output : 0.06415653228759766 total time spend for step 2 : 117.51855373382568 step3:rle_unique_nms_with_priority Mon Aug 25 19:44:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 153 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 13 nb_hashtags : 1 time to prepare the origin masks : 5.486682891845703 time for calcul the mask position with numpy : 0.5809187889099121 nb_pixel_total : 7530311 time to create 1 rle with new method : 1.1404500007629395 time for calcul the mask position with numpy : 0.04437851905822754 nb_pixel_total : 19992 time to create 1 rle with old method : 0.02250385284423828 time for calcul the mask position with numpy : 0.041939735412597656 nb_pixel_total : 25980 time to create 1 rle with old method : 0.028961181640625 time for calcul the mask position with numpy : 0.04348564147949219 nb_pixel_total : 4764 time to create 1 rle with old method : 0.00547480583190918 time for calcul the mask position with numpy : 0.04185962677001953 nb_pixel_total : 85530 time to create 1 rle with old method : 0.09991645812988281 time for calcul the mask position with numpy : 0.040463924407958984 nb_pixel_total : 17535 time to create 1 rle with old method : 0.020003795623779297 time for calcul the mask position with numpy : 0.03889012336730957 nb_pixel_total : 27960 time to create 1 rle with old method : 0.03191518783569336 time for calcul the mask position with numpy : 0.03591656684875488 nb_pixel_total : 19777 time to create 1 rle with old method : 0.02975153923034668 time for calcul the mask position with numpy : 0.028962135314941406 nb_pixel_total : 62694 time to create 1 rle with old method : 0.07738924026489258 time for calcul the mask position with numpy : 0.027585983276367188 nb_pixel_total : 66361 time to create 1 rle with old method : 0.0746157169342041 time for calcul the mask position with numpy : 0.04304933547973633 nb_pixel_total : 166537 time to create 1 rle with new method : 0.7809762954711914 time for calcul the mask position with numpy : 0.04150819778442383 nb_pixel_total : 43826 time to create 1 rle with old method : 0.04890918731689453 time for calcul the mask position with numpy : 0.04096055030822754 nb_pixel_total : 101002 time to create 1 rle with old method : 0.11873912811279297 time for calcul the mask position with numpy : 0.04170489311218262 nb_pixel_total : 122131 time to create 1 rle with old method : 0.1365814208984375 create new chi : 3.777594566345215 time to delete rle : 0.023127079010009766 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 9531 TO DO : save crop sub photo not yet done ! save time : 0.5960190296173096 nb_obj : 19 nb_hashtags : 1 time to prepare the origin masks : 8.068828821182251 time for calcul the mask position with numpy : 1.1771152019500732 nb_pixel_total : 7356601 time to create 1 rle with new method : 1.4970886707305908 time for calcul the mask position with numpy : 0.03086996078491211 nb_pixel_total : 135434 time to create 1 rle with old method : 0.16379809379577637 time for calcul the mask position with numpy : 0.029000520706176758 nb_pixel_total : 26760 time to create 1 rle with old method : 0.031144380569458008 time for calcul the mask position with numpy : 0.02787613868713379 nb_pixel_total : 19647 time to create 1 rle with old method : 0.022575855255126953 time for calcul the mask position with numpy : 0.030566692352294922 nb_pixel_total : 20310 time to create 1 rle with old method : 0.0274045467376709 time for calcul the mask position with numpy : 0.033829450607299805 nb_pixel_total : 62225 time to create 1 rle with old method : 0.07963943481445312 time for calcul the mask position with numpy : 0.033303260803222656 nb_pixel_total : 7462 time to create 1 rle with old method : 0.009654998779296875 time for calcul the mask position with numpy : 0.030299901962280273 nb_pixel_total : 56111 time to create 1 rle with old method : 0.06476688385009766 time for calcul the mask position with numpy : 0.03652310371398926 nb_pixel_total : 69403 time to create 1 rle with old method : 0.08829522132873535 time for calcul the mask position with numpy : 0.04868936538696289 nb_pixel_total : 40543 time to create 1 rle with old method : 0.04725170135498047 time for calcul the mask position with numpy : 0.050925493240356445 nb_pixel_total : 41552 time to create 1 rle with old method : 0.059432268142700195 time for calcul the mask position with numpy : 0.05320167541503906 nb_pixel_total : 25223 time to create 1 rle with old method : 0.029137611389160156 time for calcul the mask position with numpy : 0.04382967948913574 nb_pixel_total : 21824 time to create 1 rle with old method : 0.02707195281982422 time for calcul the mask position with numpy : 0.042566776275634766 nb_pixel_total : 35440 time to create 1 rle with old method : 0.039980173110961914 time for calcul the mask position with numpy : 0.04789233207702637 nb_pixel_total : 20971 time to create 1 rle with old method : 0.026576757431030273 time for calcul the mask position with numpy : 0.03971576690673828 nb_pixel_total : 98520 time to create 1 rle with old method : 0.13313913345336914 time for calcul the mask position with numpy : 0.02776503562927246 nb_pixel_total : 64316 time to create 1 rle with old method : 0.0733332633972168 time for calcul the mask position with numpy : 0.02973031997680664 nb_pixel_total : 45193 time to create 1 rle with old method : 0.06811666488647461 time for calcul the mask position with numpy : 0.029050111770629883 nb_pixel_total : 41997 time to create 1 rle with old method : 0.04750990867614746 time for calcul the mask position with numpy : 0.029703140258789062 nb_pixel_total : 104868 time to create 1 rle with old method : 0.14406061172485352 create new chi : 4.611681938171387 time to delete rle : 0.0023136138916015625 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 14956 TO DO : save crop sub photo not yet done ! save time : 0.980778694152832 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 6.807560682296753 time for calcul the mask position with numpy : 0.49730801582336426 nb_pixel_total : 7647304 time to create 1 rle with new method : 1.0876975059509277 time for calcul the mask position with numpy : 0.04605579376220703 nb_pixel_total : 20647 time to create 1 rle with old method : 0.023126840591430664 time for calcul the mask position with numpy : 0.0426182746887207 nb_pixel_total : 17206 time to create 1 rle with old method : 0.020656347274780273 time for calcul the mask position with numpy : 0.04348349571228027 nb_pixel_total : 56327 time to create 1 rle with old method : 0.06726574897766113 time for calcul the mask position with numpy : 0.04462885856628418 nb_pixel_total : 28705 time to create 1 rle with old method : 0.03218507766723633 time for calcul the mask position with numpy : 0.0422055721282959 nb_pixel_total : 57137 time to create 1 rle with old method : 0.06571435928344727 time for calcul the mask position with numpy : 0.04400229454040527 nb_pixel_total : 25515 time to create 1 rle with old method : 0.028844833374023438 time for calcul the mask position with numpy : 0.04464602470397949 nb_pixel_total : 29027 time to create 1 rle with old method : 0.03344845771789551 time for calcul the mask position with numpy : 0.04061460494995117 nb_pixel_total : 14034 time to create 1 rle with old method : 0.01588726043701172 time for calcul the mask position with numpy : 0.0427556037902832 nb_pixel_total : 16372 time to create 1 rle with old method : 0.0183866024017334 time for calcul the mask position with numpy : 0.04154253005981445 nb_pixel_total : 20632 time to create 1 rle with old method : 0.023143529891967773 time for calcul the mask position with numpy : 0.04737257957458496 nb_pixel_total : 157243 time to create 1 rle with new method : 0.8351984024047852 time for calcul the mask position with numpy : 0.0422210693359375 nb_pixel_total : 44783 time to create 1 rle with old method : 0.050299882888793945 time for calcul the mask position with numpy : 0.04121518135070801 nb_pixel_total : 83753 time to create 1 rle with old method : 0.09346675872802734 time for calcul the mask position with numpy : 0.0341029167175293 nb_pixel_total : 75715 time to create 1 rle with old method : 0.08566641807556152 create new chi : 3.6549642086029053 time to delete rle : 0.002544403076171875 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 9880 TO DO : save crop sub photo not yet done ! save time : 0.5658082962036133 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 6.792193651199341 time for calcul the mask position with numpy : 0.4551072120666504 nb_pixel_total : 7687610 time to create 1 rle with new method : 0.8255417346954346 time for calcul the mask position with numpy : 0.026845216751098633 nb_pixel_total : 23599 time to create 1 rle with old method : 0.03282952308654785 time for calcul the mask position with numpy : 0.031433820724487305 nb_pixel_total : 920 time to create 1 rle with old method : 0.0015387535095214844 time for calcul the mask position with numpy : 0.03762245178222656 nb_pixel_total : 32066 time to create 1 rle with old method : 0.0369112491607666 time for calcul the mask position with numpy : 0.050273895263671875 nb_pixel_total : 41568 time to create 1 rle with old method : 0.04752707481384277 time for calcul the mask position with numpy : 0.04185914993286133 nb_pixel_total : 41066 time to create 1 rle with old method : 0.04646468162536621 time for calcul the mask position with numpy : 0.04117631912231445 nb_pixel_total : 63110 time to create 1 rle with old method : 0.07160186767578125 time for calcul the mask position with numpy : 0.05267977714538574 nb_pixel_total : 118657 time to create 1 rle with old method : 0.13782024383544922 time for calcul the mask position with numpy : 0.05192399024963379 nb_pixel_total : 67066 time to create 1 rle with old method : 0.0869145393371582 time for calcul the mask position with numpy : 0.06234407424926758 nb_pixel_total : 17423 time to create 1 rle with old method : 0.026250123977661133 time for calcul the mask position with numpy : 0.03791046142578125 nb_pixel_total : 40495 time to create 1 rle with old method : 0.04637789726257324 time for calcul the mask position with numpy : 0.0267181396484375 nb_pixel_total : 26108 time to create 1 rle with old method : 0.029895305633544922 time for calcul the mask position with numpy : 0.026923418045043945 nb_pixel_total : 22060 time to create 1 rle with old method : 0.034883737564086914 time for calcul the mask position with numpy : 0.03211498260498047 nb_pixel_total : 37136 time to create 1 rle with old method : 0.056124210357666016 time for calcul the mask position with numpy : 0.0316624641418457 nb_pixel_total : 25219 time to create 1 rle with old method : 0.03745436668395996 time for calcul the mask position with numpy : 0.03222775459289551 nb_pixel_total : 14444 time to create 1 rle with old method : 0.01627373695373535 time for calcul the mask position with numpy : 0.03202462196350098 nb_pixel_total : 35853 time to create 1 rle with old method : 0.04192352294921875 create new chi : 2.7016751766204834 time to delete rle : 0.0018568038940429688 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 9900 TO DO : save crop sub photo not yet done ! save time : 0.5719678401947021 nb_obj : 27 nb_hashtags : 3 time to prepare the origin masks : 4.985510349273682 time for calcul the mask position with numpy : 0.7902388572692871 nb_pixel_total : 6767441 time to create 1 rle with new method : 0.6020455360412598 time for calcul the mask position with numpy : 0.033967018127441406 nb_pixel_total : 38170 time to create 1 rle with old method : 0.04242348670959473 time for calcul the mask position with numpy : 0.0337672233581543 nb_pixel_total : 23104 time to create 1 rle with old method : 0.025665283203125 time for calcul the mask position with numpy : 0.03405618667602539 nb_pixel_total : 18428 time to create 1 rle with old method : 0.020525217056274414 time for calcul the mask position with numpy : 0.03375124931335449 nb_pixel_total : 41196 time to create 1 rle with old method : 0.045137643814086914 time for calcul the mask position with numpy : 0.033716440200805664 nb_pixel_total : 25085 time to create 1 rle with old method : 0.028020858764648438 time for calcul the mask position with numpy : 0.03406858444213867 nb_pixel_total : 7428 time to create 1 rle with old method : 0.00823831558227539 time for calcul the mask position with numpy : 0.03562188148498535 nb_pixel_total : 210511 time to create 1 rle with new method : 0.8168964385986328 time for calcul the mask position with numpy : 0.03436851501464844 nb_pixel_total : 126139 time to create 1 rle with old method : 0.13678622245788574 time for calcul the mask position with numpy : 0.033921241760253906 nb_pixel_total : 125056 time to create 1 rle with old method : 0.13634753227233887 time for calcul the mask position with numpy : 0.03360486030578613 nb_pixel_total : 15635 time to create 1 rle with old method : 0.01715254783630371 time for calcul the mask position with numpy : 0.0332341194152832 nb_pixel_total : 14498 time to create 1 rle with old method : 0.016115903854370117 time for calcul the mask position with numpy : 0.036278724670410156 nb_pixel_total : 326653 time to create 1 rle with new method : 0.6340579986572266 time for calcul the mask position with numpy : 0.03430318832397461 nb_pixel_total : 12838 time to create 1 rle with old method : 0.014441967010498047 time for calcul the mask position with numpy : 0.034209251403808594 nb_pixel_total : 17711 time to create 1 rle with old method : 0.019925355911254883 time for calcul the mask position with numpy : 0.034271240234375 nb_pixel_total : 40336 time to create 1 rle with old method : 0.04556155204772949 time for calcul the mask position with numpy : 0.034532785415649414 nb_pixel_total : 66147 time to create 1 rle with old method : 0.07258343696594238 time for calcul the mask position with numpy : 0.03387928009033203 nb_pixel_total : 27803 time to create 1 rle with old method : 0.030661582946777344 time for calcul the mask position with numpy : 0.03368544578552246 nb_pixel_total : 37084 time to create 1 rle with old method : 0.04110527038574219 time for calcul the mask position with numpy : 0.03360319137573242 nb_pixel_total : 13289 time to create 1 rle with old method : 0.01482701301574707 time for calcul the mask position with numpy : 0.03401541709899902 nb_pixel_total : 58369 time to create 1 rle with old method : 0.06383919715881348 time for calcul the mask position with numpy : 0.03374457359313965 nb_pixel_total : 44257 time to create 1 rle with old method : 0.04914593696594238 time for calcul the mask position with numpy : 0.033875465393066406 nb_pixel_total : 47316 time to create 1 rle with old method : 0.052805423736572266 time for calcul the mask position with numpy : 0.03388333320617676 nb_pixel_total : 10700 time to create 1 rle with old method : 0.011937618255615234 time for calcul the mask position with numpy : 0.03475546836853027 nb_pixel_total : 99664 time to create 1 rle with old method : 0.10903620719909668 time for calcul the mask position with numpy : 0.03404808044433594 nb_pixel_total : 54806 time to create 1 rle with old method : 0.059693336486816406 time for calcul the mask position with numpy : 0.03400707244873047 nb_pixel_total : 5006 time to create 1 rle with old method : 0.00567173957824707 time for calcul the mask position with numpy : 0.03358340263366699 nb_pixel_total : 19730 time to create 1 rle with old method : 0.022049427032470703 create new chi : 4.951066493988037 time to delete rle : 0.002521991729736328 batch 1 Loaded 55 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++Number RLEs to save : 17964 TO DO : save crop sub photo not yet done ! save time : 0.9543337821960449 nb_obj : 20 nb_hashtags : 4 time to prepare the origin masks : 10.095333099365234 time for calcul the mask position with numpy : 0.6546812057495117 nb_pixel_total : 7310702 time to create 1 rle with new method : 0.9451661109924316 time for calcul the mask position with numpy : 0.036496639251708984 nb_pixel_total : 63691 time to create 1 rle with old method : 0.0740213394165039 time for calcul the mask position with numpy : 0.03946518898010254 nb_pixel_total : 69547 time to create 1 rle with old method : 0.07880568504333496 time for calcul the mask position with numpy : 0.026116371154785156 nb_pixel_total : 31815 time to create 1 rle with old method : 0.035588979721069336 time for calcul the mask position with numpy : 0.02701091766357422 nb_pixel_total : 91611 time to create 1 rle with old method : 0.10208249092102051 time for calcul the mask position with numpy : 0.027184009552001953 nb_pixel_total : 27022 time to create 1 rle with old method : 0.030313491821289062 time for calcul the mask position with numpy : 0.028725385665893555 nb_pixel_total : 78079 time to create 1 rle with old method : 0.08678078651428223 time for calcul the mask position with numpy : 0.02639913558959961 nb_pixel_total : 11646 time to create 1 rle with old method : 0.013250589370727539 time for calcul the mask position with numpy : 0.027915000915527344 nb_pixel_total : 28678 time to create 1 rle with old method : 0.03238701820373535 time for calcul the mask position with numpy : 0.026538848876953125 nb_pixel_total : 7958 time to create 1 rle with old method : 0.009163618087768555 time for calcul the mask position with numpy : 0.029490947723388672 nb_pixel_total : 32588 time to create 1 rle with old method : 0.03864717483520508 time for calcul the mask position with numpy : 0.025583267211914062 nb_pixel_total : 41839 time to create 1 rle with old method : 0.04663372039794922 time for calcul the mask position with numpy : 0.0289154052734375 nb_pixel_total : 116137 time to create 1 rle with old method : 0.13048315048217773 time for calcul the mask position with numpy : 0.028577089309692383 nb_pixel_total : 50566 time to create 1 rle with old method : 0.05884361267089844 time for calcul the mask position with numpy : 0.030002832412719727 nb_pixel_total : 89325 time to create 1 rle with old method : 0.10142707824707031 time for calcul the mask position with numpy : 0.02617049217224121 nb_pixel_total : 62822 time to create 1 rle with old method : 0.07042384147644043 time for calcul the mask position with numpy : 0.02618694305419922 nb_pixel_total : 43039 time to create 1 rle with old method : 0.04925966262817383 time for calcul the mask position with numpy : 0.02803516387939453 nb_pixel_total : 50416 time to create 1 rle with old method : 0.05612826347351074 time for calcul the mask position with numpy : 0.02795124053955078 nb_pixel_total : 46037 time to create 1 rle with old method : 0.05135178565979004 time for calcul the mask position with numpy : 0.0245816707611084 nb_pixel_total : 18316 time to create 1 rle with old method : 0.020728588104248047 time for calcul the mask position with numpy : 0.0266265869140625 nb_pixel_total : 22566 time to create 1 rle with old method : 0.025222301483154297 create new chi : 3.3215384483337402 time to delete rle : 0.0023179054260253906 batch 1 Loaded 41 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 13913 TO DO : save crop sub photo not yet done ! save time : 0.7684595584869385 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 5.767661809921265 time for calcul the mask position with numpy : 0.7369070053100586 nb_pixel_total : 7500030 time to create 1 rle with new method : 1.307887315750122 time for calcul the mask position with numpy : 0.029713153839111328 nb_pixel_total : 153282 time to create 1 rle with new method : 1.0467884540557861 time for calcul the mask position with numpy : 0.02582573890686035 nb_pixel_total : 46755 time to create 1 rle with old method : 0.052002668380737305 time for calcul the mask position with numpy : 0.02554798126220703 nb_pixel_total : 28198 time to create 1 rle with old method : 0.03170156478881836 time for calcul the mask position with numpy : 0.026232481002807617 nb_pixel_total : 111997 time to create 1 rle with old method : 0.12481403350830078 time for calcul the mask position with numpy : 0.02597355842590332 nb_pixel_total : 69400 time to create 1 rle with old method : 0.07819008827209473 time for calcul the mask position with numpy : 0.025472402572631836 nb_pixel_total : 26181 time to create 1 rle with old method : 0.029465436935424805 time for calcul the mask position with numpy : 0.025102615356445312 nb_pixel_total : 17875 time to create 1 rle with old method : 0.020099639892578125 time for calcul the mask position with numpy : 0.02597212791442871 nb_pixel_total : 39312 time to create 1 rle with old method : 0.04435276985168457 time for calcul the mask position with numpy : 0.03045487403869629 nb_pixel_total : 10695 time to create 1 rle with old method : 0.014536619186401367 time for calcul the mask position with numpy : 0.0301516056060791 nb_pixel_total : 84305 time to create 1 rle with old method : 0.09489178657531738 time for calcul the mask position with numpy : 0.028107881546020508 nb_pixel_total : 118762 time to create 1 rle with old method : 0.13637447357177734 time for calcul the mask position with numpy : 0.028879642486572266 nb_pixel_total : 40907 time to create 1 rle with old method : 0.04567360877990723 time for calcul the mask position with numpy : 0.029227495193481445 nb_pixel_total : 17046 time to create 1 rle with old method : 0.01927328109741211 time for calcul the mask position with numpy : 0.04022550582885742 nb_pixel_total : 29655 time to create 1 rle with old method : 0.03338909149169922 create new chi : 4.293301820755005 time to delete rle : 0.001947164535522461 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++++++++++++Number RLEs to save : 11462 TO DO : save crop sub photo not yet done ! save time : 0.6208946704864502 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 8.71251368522644 time for calcul the mask position with numpy : 0.670264720916748 nb_pixel_total : 7294966 time to create 1 rle with new method : 1.251286506652832 time for calcul the mask position with numpy : 0.05115938186645508 nb_pixel_total : 87242 time to create 1 rle with old method : 0.10364699363708496 time for calcul the mask position with numpy : 0.047454833984375 nb_pixel_total : 35400 time to create 1 rle with old method : 0.04579019546508789 time for calcul the mask position with numpy : 0.04400444030761719 nb_pixel_total : 25106 time to create 1 rle with old method : 0.028257369995117188 time for calcul the mask position with numpy : 0.03577828407287598 nb_pixel_total : 27240 time to create 1 rle with old method : 0.031134843826293945 time for calcul the mask position with numpy : 0.030918598175048828 nb_pixel_total : 28397 time to create 1 rle with old method : 0.03203916549682617 time for calcul the mask position with numpy : 0.02840280532836914 nb_pixel_total : 13693 time to create 1 rle with old method : 0.015433549880981445 time for calcul the mask position with numpy : 0.025568008422851562 nb_pixel_total : 26744 time to create 1 rle with old method : 0.03392982482910156 time for calcul the mask position with numpy : 0.030815839767456055 nb_pixel_total : 60520 time to create 1 rle with old method : 0.08355474472045898 time for calcul the mask position with numpy : 0.02581954002380371 nb_pixel_total : 29724 time to create 1 rle with old method : 0.056982994079589844 time for calcul the mask position with numpy : 0.04853940010070801 nb_pixel_total : 83312 time to create 1 rle with old method : 0.10580086708068848 time for calcul the mask position with numpy : 0.02860283851623535 nb_pixel_total : 152686 time to create 1 rle with new method : 1.2362098693847656 time for calcul the mask position with numpy : 0.04624748229980469 nb_pixel_total : 39593 time to create 1 rle with old method : 0.05042147636413574 time for calcul the mask position with numpy : 0.04337716102600098 nb_pixel_total : 85365 time to create 1 rle with old method : 0.09776663780212402 time for calcul the mask position with numpy : 0.043958187103271484 nb_pixel_total : 20746 time to create 1 rle with old method : 0.02356266975402832 time for calcul the mask position with numpy : 0.04160714149475098 nb_pixel_total : 28785 time to create 1 rle with old method : 0.0325627326965332 time for calcul the mask position with numpy : 0.04706096649169922 nb_pixel_total : 34572 time to create 1 rle with old method : 0.04102611541748047 time for calcul the mask position with numpy : 0.04641366004943848 nb_pixel_total : 57579 time to create 1 rle with old method : 0.07166457176208496 time for calcul the mask position with numpy : 0.04583096504211426 nb_pixel_total : 162730 time to create 1 rle with new method : 0.8986072540283203 create new chi : 5.740396499633789 time to delete rle : 0.003441333770751953 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 12571 TO DO : save crop sub photo not yet done ! save time : 0.6629562377929688 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 6.0138773918151855 time for calcul the mask position with numpy : 1.0044686794281006 nb_pixel_total : 3610508 time to create 1 rle with new method : 1.822892427444458 time for calcul the mask position with numpy : 0.025910377502441406 nb_pixel_total : 72 time to create 1 rle with old method : 0.00015234947204589844 time for calcul the mask position with numpy : 0.2849256992340088 nb_pixel_total : 4151024 time to create 1 rle with new method : 0.8286135196685791 time for calcul the mask position with numpy : 0.02966022491455078 nb_pixel_total : 35594 time to create 1 rle with old method : 0.03963637351989746 time for calcul the mask position with numpy : 0.029316186904907227 nb_pixel_total : 3341 time to create 1 rle with old method : 0.0039517879486083984 time for calcul the mask position with numpy : 0.02866649627685547 nb_pixel_total : 98534 time to create 1 rle with old method : 0.10943365097045898 time for calcul the mask position with numpy : 0.025554418563842773 nb_pixel_total : 81031 time to create 1 rle with old method : 0.0934593677520752 time for calcul the mask position with numpy : 0.030278444290161133 nb_pixel_total : 50135 time to create 1 rle with old method : 0.055526018142700195 time for calcul the mask position with numpy : 0.03623175621032715 nb_pixel_total : 11345 time to create 1 rle with old method : 0.01265573501586914 time for calcul the mask position with numpy : 0.04143357276916504 nb_pixel_total : 88137 time to create 1 rle with old method : 0.09706854820251465 time for calcul the mask position with numpy : 0.04179739952087402 nb_pixel_total : 41854 time to create 1 rle with old method : 0.05040717124938965 time for calcul the mask position with numpy : 0.04626107215881348 nb_pixel_total : 63494 time to create 1 rle with old method : 0.07807397842407227 time for calcul the mask position with numpy : 0.04180645942687988 nb_pixel_total : 59331 time to create 1 rle with old method : 0.06680178642272949 create new chi : 5.003345012664795 time to delete rle : 0.002150297164916992 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 12752 TO DO : save crop sub photo not yet done ! save time : 0.7070596218109131 map_output_result : {1379270196: (0.0, 'Should be the crop_list due to order', 0), 1379270191: (0.0, 'Should be the crop_list due to order', 0), 1379270182: (0.0, 'Should be the crop_list due to order', 0), 1379270180: (0.0, 'Should be the crop_list due to order', 0), 1379270148: (0.0, 'Should be the crop_list due to order', 0), 1379270117: (0.0, 'Should be the crop_list due to order', 0), 1379270097: (0.0, 'Should be the crop_list due to order', 0), 1379270095: (0.0, 'Should be the crop_list due to order', 0), 1379270076: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1379270196, 1379270191, 1379270182, 1379270180, 1379270148, 1379270117, 1379270097, 1379270095, 1379270076] Looping around the photos to save general results len do output : 9 /1379270196.Didn't retrieve data . /1379270191.Didn't retrieve data . /1379270182.Didn't retrieve data . /1379270180.Didn't retrieve data . /1379270148.Didn't retrieve data . /1379270117.Didn't retrieve data . /1379270097.Didn't retrieve data . /1379270095.Didn't retrieve data . /1379270076.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270196', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270191', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270182', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270180', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270148', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270117', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270097', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270095', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270076', None, None, None, None, None, '3592270') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.014349699020385742 save_final save missing photos in datou_result : time spend for datou_step_exec : 108.91366124153137 time spend to save output : 0.015033960342407227 total time spend for step 3 : 108.92869520187378 step4:ventilate_hashtags_in_portfolio Mon Aug 25 19:45:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26211842 get user id for portfolio 26211842 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26211842 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pet_fonce','mal_croppe','carton','pehd','background','metal','flou','autre','environnement','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26211842 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pet_fonce','mal_croppe','carton','pehd','background','metal','flou','autre','environnement','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26211842 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pet_fonce','mal_croppe','carton','pehd','background','metal','flou','autre','environnement','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/26212177,26212178,26212179,26212180,26212181,26212182,26212183,26212184,26212185,26212186,26212187?tags=papier,pet_fonce,mal_croppe,carton,pehd,background,metal,flou,autre,environnement,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1379270196, 1379270191, 1379270182, 1379270180, 1379270148, 1379270117, 1379270097, 1379270095, 1379270076] Looping around the photos to save general results len do output : 1 /26211842. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270196', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270191', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270182', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270180', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270148', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270117', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270097', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270095', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270076', None, None, None, None, None, '3592270') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.017062902450561523 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7721023559570312 time spend to save output : 0.017377138137817383 total time spend for step 4 : 1.7894794940948486 step5:final Mon Aug 25 19:45:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1379270196: ('0.16000255862054186',), 1379270191: ('0.16000255862054186',), 1379270182: ('0.16000255862054186',), 1379270180: ('0.16000255862054186',), 1379270148: ('0.16000255862054186',), 1379270117: ('0.16000255862054186',), 1379270097: ('0.16000255862054186',), 1379270095: ('0.16000255862054186',), 1379270076: ('0.16000255862054186',)} new output for save of step final : {1379270196: ('0.16000255862054186',), 1379270191: ('0.16000255862054186',), 1379270182: ('0.16000255862054186',), 1379270180: ('0.16000255862054186',), 1379270148: ('0.16000255862054186',), 1379270117: ('0.16000255862054186',), 1379270097: ('0.16000255862054186',), 1379270095: ('0.16000255862054186',), 1379270076: ('0.16000255862054186',)} [1379270196, 1379270191, 1379270182, 1379270180, 1379270148, 1379270117, 1379270097, 1379270095, 1379270076] Looping around the photos to save general results len do output : 9 /1379270196.Didn't retrieve data . /1379270191.Didn't retrieve data . /1379270182.Didn't retrieve data . /1379270180.Didn't retrieve data . /1379270148.Didn't retrieve data . /1379270117.Didn't retrieve data . /1379270097.Didn't retrieve data . /1379270095.Didn't retrieve data . /1379270076.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270196', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270191', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270182', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270180', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270148', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270117', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270097', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270095', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270076', None, None, None, None, None, '3592270') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.014067888259887695 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12449288368225098 time spend to save output : 0.014457464218139648 total time spend for step 5 : 0.13895034790039062 step6:blur_detection Mon Aug 25 19:45:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229.jpg resize: (2160, 3840) 1379270196 -7.623411913070365 treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db.jpg resize: (2160, 3840) 1379270191 -7.694725555519008 treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff.jpg resize: (2160, 3840) 1379270182 -7.176857437752643 treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6.jpg resize: (2160, 3840) 1379270180 -7.1569841113192725 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e.jpg resize: (2160, 3840) 1379270148 -7.216822940377507 treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603.jpg resize: (2160, 3840) 1379270117 -7.282778210799159 treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154.jpg resize: (2160, 3840) 1379270097 -7.184586717140341 treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197.jpg resize: (2160, 3840) 1379270095 -6.959607361937827 treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599.jpg resize: (2160, 3840) 1379270076 -5.713390769408832 treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062808_0.png resize: (370, 453) 1379284337 -2.8729865994351704 treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062809_0.png resize: (292, 493) 1379284338 0.7508441395557474 treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062810_0.png resize: (233, 239) 1379284339 0.64344730146804 treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062811_0.png resize: (377, 659) 1379284340 -2.4597413075325263 treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062812_0.png resize: (305, 329) 1379284341 -3.487702065257914 treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062813_0.png resize: (383, 249) 1379284343 -4.289984166974239 treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062814_0.png resize: (213, 117) 1379284344 -1.4191562357966505 treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062815_0.png resize: (311, 198) 1379284345 -3.5244523999692148 treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062816_0.png resize: (216, 142) 1379284346 -4.37791486829386 treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062817_0.png resize: (471, 269) 1379284348 -4.967980131864546 treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062818_0.png resize: (114, 83) 1379284349 -3.548063719249874 treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062819_0.png resize: (275, 200) 1379284350 -4.1901283506927784 treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062820_0.png resize: (124, 248) 1379284352 -2.214143787424177 treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062821_0.png resize: (293, 558) 1379284353 -0.2165562747516186 treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062822_0.png resize: (316, 256) 1379284354 -2.8882162260194875 treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062823_0.png resize: (294, 225) 1379284356 -4.941026515050386 treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062824_0.png resize: (360, 299) 1379284357 -2.714580318345027 treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062825_0.png resize: (371, 379) 1379284358 -4.5229026791477605 treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062826_0.png resize: (250, 142) 1379284360 -4.064934793477843 treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062827_0.png resize: (251, 272) 1379284361 -4.309808770982012 treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062828_0.png resize: (268, 248) 1379284362 -3.717276596943331 treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062829_0.png resize: (185, 231) 1379284364 -2.0814686101893183 treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062830_0.png resize: (290, 412) 1379284365 -4.026327675800997 treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062831_0.png resize: (337, 214) 1379284366 -3.1954048808770135 treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062832_0.png resize: (284, 359) 1379284367 -5.283410487221634 treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062833_0.png resize: (457, 184) 1379284368 -4.243213548963267 treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062834_0.png resize: (115, 87) 1379284369 -3.4441518179382213 treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062835_0.png resize: (402, 421) 1379284370 -2.7962005359963022 treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062836_0.png resize: (173, 145) 1379284371 -4.5168123776742855 treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062837_0.png resize: (162, 169) 1379284372 -4.279779103674526 treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062838_0.png resize: (300, 126) 1379284373 -3.9671903504286123 treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062839_0.png resize: (679, 258) 1379284374 -1.8743904895648416 treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062841_0.png resize: (291, 412) 1379284375 -5.20703507694696 treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062842_0.png resize: (242, 296) 1379284376 -4.312039108656966 treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062843_0.png resize: (450, 514) 1379284377 0.4227897042765246 treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062845_0.png resize: (184, 127) 1379284378 0.19363465515751105 treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062846_0.png resize: (167, 140) 1379284379 -4.965667208591238 treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062847_0.png resize: (276, 132) 1379284380 -5.12063742761554 treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062848_0.png resize: (213, 180) 1379284381 -1.5587617596487753 treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062849_0.png resize: (318, 405) 1379284382 -3.8639467080581555 treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062850_0.png resize: (297, 151) 1379284383 -4.667278633766292 treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062853_0.png resize: (185, 164) 1379284384 -4.4401797219383266 treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062854_0.png resize: (210, 195) 1379284385 -1.8197905732396542 treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062855_0.png resize: (151, 135) 1379284386 -2.1468699637227737 treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062856_0.png resize: (216, 178) 1379284387 -3.7200054858076124 treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062857_0.png resize: (255, 248) 1379284388 -4.397197085772144 treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062858_0.png resize: (295, 115) 1379284389 -4.031189417756949 treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062860_0.png resize: (265, 219) 1379284390 -4.490073718577979 treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062861_0.png resize: (223, 150) 1379284391 -3.9886435966823712 treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062862_0.png resize: (273, 370) 1379284392 -4.51548629632639 treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062863_0.png resize: (444, 408) 1379284393 -5.006794374935463 treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062865_0.png resize: (193, 424) 1379284394 -2.5994292907360776 treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062866_0.png resize: (298, 357) 1379284395 -4.236512540122338 treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062868_0.png resize: (168, 510) 1379284396 -4.879961818969689 treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062869_0.png resize: (215, 182) 1379284397 -4.573458410781195 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062870_0.png resize: (564, 346) 1379284398 -3.4534866648381577 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062871_0.png resize: (321, 292) 1379284399 -4.910602021715842 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062872_0.png resize: (321, 193) 1379284400 -2.4740015763116707 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062873_0.png resize: (197, 142) 1379284401 -3.676462352972862 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062874_0.png resize: (352, 498) 1379284402 -4.36893854168295 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062875_0.png resize: (204, 82) 1379284403 -3.695898598399026 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062876_0.png resize: (202, 296) 1379284404 -4.244566154341774 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062877_0.png resize: (290, 267) 1379284405 -4.141191601086579 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062878_0.png resize: (282, 256) 1379284406 -4.346420720536367 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062879_0.png resize: (808, 733) 1379284407 -5.371128721399342 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062880_0.png resize: (349, 293) 1379284408 -4.181554235878298 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062881_0.png resize: (145, 142) 1379284409 -2.7899194787880393 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062882_0.png resize: (271, 120) 1379284410 -3.854593623405291 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062884_0.png resize: (264, 261) 1379284411 -3.116538948952188 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062885_0.png resize: (284, 174) 1379284412 -4.349724627008292 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062886_0.png resize: (552, 536) 1379284413 -4.693941463625909 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062887_0.png resize: (220, 367) 1379284414 -4.529798588151833 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062890_0.png resize: (180, 171) 1379284415 -4.0958234299212375 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062892_0.png resize: (394, 425) 1379284416 -5.089545698097609 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062893_0.png resize: (120, 111) 1379284417 -4.5387650569781455 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062894_0.png resize: (145, 165) 1379284418 -3.916740200142624 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062896_0.png resize: (248, 165) 1379284419 -3.098724733502451 treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062897_0.png resize: (292, 160) 1379284420 -3.1384270519174775 treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062898_0.png resize: (146, 219) 1379284421 -3.5753505735436284 treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062899_0.png resize: (250, 308) 1379284422 -3.527994690103962 treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062900_0.png resize: (189, 398) 1379284423 -4.988074023234073 treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062901_0.png resize: (277, 238) 1379284424 -2.8016371874697867 treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062902_0.png resize: (212, 417) 1379284425 -4.12056881286104 treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062903_0.png resize: (491, 363) 1379284426 -4.897245385315616 treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062904_0.png resize: (340, 246) 1379284427 -3.8912616592551337 treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062905_0.png resize: (467, 409) 1379284428 -5.4504182876742115 treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062906_0.png resize: (313, 221) 1379284429 -2.4310838619473505 treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062907_0.png resize: (248, 171) 1379284430 0.5695109217732951 treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062908_0.png resize: (84, 144) 1379284432 -4.268261208277011 treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062909_0.png resize: (234, 173) 1379284433 -3.9275301664105693 treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062910_0.png resize: (161, 100) 1379284434 -3.923027551992277 treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062912_0.png resize: (275, 200) 1379284435 -3.5945939808306204 treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062914_0.png resize: (234, 189) 1379284436 -2.152364658617446 treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062916_0.png resize: (235, 375) 1379284437 -4.69584373596798 treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062917_0.png resize: (234, 265) 1379284438 -3.7761576019376752 treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062918_0.png resize: (135, 209) 1379284439 -2.955595948200742 treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062919_0.png resize: (224, 257) 1379284440 -2.590887463784928 treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062920_0.png resize: (291, 580) 1379284441 -5.108535281658134 treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062921_0.png resize: (612, 173) 1379284442 -4.463686413957952 treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062922_0.png resize: (92, 146) 1379284443 -3.3769506281621204 treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062923_0.png resize: (275, 264) 1379284444 -4.3524542280630225 treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062924_0.png resize: (132, 201) 1379284445 -3.708578963477975 treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062925_0.png resize: (154, 218) 1379284446 -0.9445017826550421 treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062927_0.png resize: (646, 465) 1379284447 -4.462197826984164 treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062928_0.png resize: (207, 191) 1379284448 -2.66061822941248 treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062930_0.png resize: (425, 699) 1379284449 -3.732561690886338 treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062931_0.png resize: (536, 645) 1379284450 -4.405871367941232 treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062932_0.png resize: (301, 412) 1379284451 -3.92434018850583 treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062933_0.png resize: (159, 331) 1379284452 -3.541786046835667 treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062934_0.png resize: (193, 243) 1379284453 -5.572932058934525 treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062935_0.png resize: (185, 143) 1379284454 -4.357952323207007 treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062936_0.png resize: (492, 261) 1379284455 -4.445754026653395 treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062937_0.png resize: (238, 231) 1379284456 -2.011420454032037 treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062938_0.png resize: (458, 535) 1379284457 -4.849172397764251 treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062939_0.png resize: (371, 332) 1379284458 -4.8501541864902835 treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062940_0.png resize: (210, 236) 1379284459 -4.061264694810406 treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062941_0.png resize: (350, 316) 1379284460 -4.956805551971236 treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062943_0.png resize: (176, 119) 1379284461 -3.76150434516768 treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062948_0.png resize: (434, 424) 1379284462 -3.7357469244202814 treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599_rle_crop_3930062949_0.png resize: (342, 270) 1379284463 -4.404194320325552 treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599_rle_crop_3930062950_0.png resize: (370, 308) 1379284464 -4.812222882017567 treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599_rle_crop_3930062952_0.png resize: (417, 281) 1379284465 -5.541378704906036 treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599_rle_crop_3930062953_0.png resize: (157, 103) 1379284466 -5.04995021713217 treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599_rle_crop_3930062954_0.png resize: (264, 313) 1379284467 -4.9671298996484525 treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599_rle_crop_3930062957_0.png resize: (129, 181) 1379284468 -3.59392968510475 treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599_rle_crop_3930062958_0.png resize: (270, 179) 1379284469 -4.969925660762661 treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599_rle_crop_3930062960_0.png resize: (212, 250) 1379284470 -5.7565032305800905 treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062844_0.png resize: (182, 160) 1379284475 -3.733337128922763 treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062859_0.png resize: (149, 207) 1379284476 -3.43033998140166 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062888_0.png resize: (186, 183) 1379284477 -2.6160630541549454 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062889_0.png resize: (194, 123) 1379284478 -4.6357617710093475 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062891_0.png resize: (139, 88) 1379284480 -2.9833156632272315 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062895_0.png resize: (222, 261) 1379284482 -5.2262688601643665 treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062915_0.png resize: (387, 227) 1379284483 -2.8996787329566867 treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062929_0.png resize: (316, 287) 1379284484 -4.443540309585471 treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599_rle_crop_3930062951_0.png resize: (220, 262) 1379284486 -5.773453096887343 treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599_rle_crop_3930062955_0.png resize: (491, 261) 1379284487 -3.7269271637698385 treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062942_0.png resize: (153, 215) 1379284489 -5.2698954977885535 treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062944_0.png resize: (187, 198) 1379284490 -5.4820831508009835 treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062840_0.png resize: (300, 608) 1379284524 -4.349787585261695 treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062851_0.png resize: (387, 194) 1379284525 -4.963782492765051 treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062852_0.png resize: (117, 202) 1379284526 -3.795710265872622 treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062864_0.png resize: (165, 523) 1379284527 -5.011495240402747 treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062867_0.png resize: (235, 274) 1379284528 -3.586251721470905 treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062883_0.png resize: (145, 322) 1379284529 -3.933614498402789 treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062913_0.png resize: (357, 373) 1379284530 -4.833869461015957 treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062926_0.png resize: (288, 356) 1379284531 -4.531026003914411 treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062945_0.png resize: (127, 269) 1379284532 -4.581857533188528 treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062946_0.png resize: (199, 174) 1379284533 -5.427666218957426 treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062947_0.png resize: (229, 241) 1379284534 -5.213941794687223 treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599_rle_crop_3930062956_0.png resize: (243, 533) 1379284535 -6.06066488891402 treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599_rle_crop_3930062959_0.png resize: (1965, 2501) 1379284536 -4.577037042690723 treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062911_0.png resize: (395, 237) 1379284537 -4.3168970382077445 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 162 time used for this insertion : 0.01941227912902832 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 162 time used for this insertion : 0.031148433685302734 save missing photos in datou_result : time spend for datou_step_exec : 47.03183722496033 time spend to save output : 0.05671572685241699 total time spend for step 6 : 47.088552951812744 step7:brightness Mon Aug 25 19:46:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229.jpg treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db.jpg treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff.jpg treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6.jpg treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e.jpg treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603.jpg treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154.jpg treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197.jpg treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599.jpg treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062808_0.png treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062809_0.png treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062810_0.png treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062811_0.png treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062812_0.png treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062813_0.png treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062814_0.png treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062815_0.png treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062816_0.png treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062817_0.png treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062818_0.png treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062819_0.png treat image : temp/1756143628_2639583_1379270196_026575712027e9bbe86b23b19ef81229_rle_crop_3930062820_0.png treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062821_0.png treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062822_0.png treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062823_0.png treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062824_0.png treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062825_0.png treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062826_0.png treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062827_0.png treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062828_0.png treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062829_0.png treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062830_0.png treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062831_0.png treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062832_0.png treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062833_0.png treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062834_0.png treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062835_0.png treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062836_0.png treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062837_0.png treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062838_0.png treat image : temp/1756143628_2639583_1379270191_6475bdcd8b4ffe36f5db288be48400db_rle_crop_3930062839_0.png treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062841_0.png treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062842_0.png treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062843_0.png treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062845_0.png treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062846_0.png treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062847_0.png treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062848_0.png treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062849_0.png treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062850_0.png treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062853_0.png treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062854_0.png treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062855_0.png treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062856_0.png treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062857_0.png treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062858_0.png treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062860_0.png treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062861_0.png treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062862_0.png treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062863_0.png treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062865_0.png treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062866_0.png treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062868_0.png treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062869_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062870_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062871_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062872_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062873_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062874_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062875_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062876_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062877_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062878_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062879_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062880_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062881_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062882_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062884_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062885_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062886_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062887_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062890_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062892_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062893_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062894_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062896_0.png treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062897_0.png treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062898_0.png treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062899_0.png treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062900_0.png treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062901_0.png treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062902_0.png treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062903_0.png treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062904_0.png treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062905_0.png treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062906_0.png treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062907_0.png treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062908_0.png treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062909_0.png treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062910_0.png treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062912_0.png treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062914_0.png treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062916_0.png treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062917_0.png treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062918_0.png treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062919_0.png treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062920_0.png treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062921_0.png treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062922_0.png treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062923_0.png treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062924_0.png treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062925_0.png treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062927_0.png treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062928_0.png treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062930_0.png treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062931_0.png treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062932_0.png treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062933_0.png treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062934_0.png treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062935_0.png treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062936_0.png treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062937_0.png treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062938_0.png treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062939_0.png treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062940_0.png treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062941_0.png treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062943_0.png treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062948_0.png treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599_rle_crop_3930062949_0.png treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599_rle_crop_3930062950_0.png treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599_rle_crop_3930062952_0.png treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599_rle_crop_3930062953_0.png treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599_rle_crop_3930062954_0.png treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599_rle_crop_3930062957_0.png treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599_rle_crop_3930062958_0.png treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599_rle_crop_3930062960_0.png treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062844_0.png treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062859_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062888_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062889_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062891_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062895_0.png treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062915_0.png treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062929_0.png treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599_rle_crop_3930062951_0.png treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599_rle_crop_3930062955_0.png treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062942_0.png treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062944_0.png treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062840_0.png treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062851_0.png treat image : temp/1756143628_2639583_1379270182_700879b46a4a7525e2ab4d7b7b95b2ff_rle_crop_3930062852_0.png treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062864_0.png treat image : temp/1756143628_2639583_1379270180_3c06523e06c2cadbfff78e64fd0e08e6_rle_crop_3930062867_0.png treat image : temp/1756143628_2639583_1379270148_7335e7a858333a5a3af0ae05b97ac14e_rle_crop_3930062883_0.png treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062913_0.png treat image : temp/1756143628_2639583_1379270097_b61c5560e54e14eb340bf4dca1ed3154_rle_crop_3930062926_0.png treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062945_0.png treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062946_0.png treat image : temp/1756143628_2639583_1379270095_52fb01a92d531a5d7469be2eeab94197_rle_crop_3930062947_0.png treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599_rle_crop_3930062956_0.png treat image : temp/1756143628_2639583_1379270076_1af326b2f6d4fa65d361bbf90c6e9599_rle_crop_3930062959_0.png treat image : temp/1756143628_2639583_1379270117_4fdf403514544ca1c2dcecefa9bce603_rle_crop_3930062911_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 162 time used for this insertion : 0.023006677627563477 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 162 time used for this insertion : 0.03680610656738281 save missing photos in datou_result : time spend for datou_step_exec : 12.285740613937378 time spend to save output : 0.06479954719543457 total time spend for step 7 : 12.350540161132812 step8:velours_tree Mon Aug 25 19:46:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 1.710573434829712 time spend to save output : 4.267692565917969e-05 total time spend for step 8 : 1.710616111755371 step9:send_mail_cod Mon Aug 25 19:46:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26211842_25-08-2025_19_46_53.pdf 26212177 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262121771756144013 26212178 imagette262121781756144014 26212179 imagette262121791756144014 26212180 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262121801756144014 26212181 imagette262121811756144015 26212182 imagette262121821756144015 26212183 change filename to text .change filename to text .imagette262121831756144015 26212184 imagette262121841756144016 26212185 change filename to text .imagette262121851756144016 26212187 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette262121871756144016 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26211842 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/26212177,26212178,26212179,26212180,26212181,26212182,26212183,26212184,26212185,26212186,26212187?tags=papier,pet_fonce,mal_croppe,carton,pehd,background,metal,flou,autre,environnement,pet_clair args[1379270196] : ((1379270196, -7.623411913070365, 492609224), (1379270196, 0.9162078862807592, 2107752395), '0.16000255862054186') We are sending mail with results at report@fotonower.com args[1379270191] : ((1379270191, -7.694725555519008, 492609224), (1379270191, 1.0103036841287842, 2107752395), '0.16000255862054186') We are sending mail with results at report@fotonower.com args[1379270182] : ((1379270182, -7.176857437752643, 492609224), (1379270182, 0.7926179197284219, 2107752395), '0.16000255862054186') We are sending mail with results at report@fotonower.com args[1379270180] : ((1379270180, -7.1569841113192725, 492609224), (1379270180, 0.3667058482818908, 2107752395), '0.16000255862054186') We are sending mail with results at report@fotonower.com args[1379270148] : ((1379270148, -7.216822940377507, 492609224), (1379270148, 0.5753666200795183, 2107752395), '0.16000255862054186') We are sending mail with results at report@fotonower.com args[1379270117] : ((1379270117, -7.282778210799159, 492609224), (1379270117, 0.5717500476013103, 2107752395), '0.16000255862054186') We are sending mail with results at report@fotonower.com args[1379270097] : ((1379270097, -7.184586717140341, 492609224), (1379270097, 0.6956713904997319, 2107752395), '0.16000255862054186') We are sending mail with results at report@fotonower.com args[1379270095] : ((1379270095, -6.959607361937827, 492609224), (1379270095, 0.2095048622324827, 2107752395), '0.16000255862054186') We are sending mail with results at report@fotonower.com args[1379270076] : ((1379270076, -5.713390769408832, 492609224), (1379270076, -0.8219370196506561, 501862349), '0.16000255862054186') We are sending mail with results at report@fotonower.com refus_total : 0.16000255862054186 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26211842 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26211842_25-08-2025_19_46_53.pdf results_Auto_P26211842_25-08-2025_19_46_53.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26211842_25-08-2025_19_46_53.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26211842','results_Auto_P26211842_25-08-2025_19_46_53.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26211842_25-08-2025_19_46_53.pdf','pdf','','1.04','0.16000255862054186') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26211842

https://www.fotonower.com/image?json=false&list_photos_id=1379270196
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379270191
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379270182
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379270180
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379270148
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379270117
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379270097
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379270095
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379270076
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 16.00%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/26212177?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26212180?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/26212183?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/26212185?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26212187?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26211842_25-08-2025_19_46_53.pdf.

Lien vers velours :https://www.fotonower.com/velours/26212177,26212178,26212179,26212180,26212181,26212182,26212183,26212184,26212185,26212186,26212187?tags=papier,pet_fonce,mal_croppe,carton,pehd,background,metal,flou,autre,environnement,pet_clair.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 25 Aug 2025 17:47:00 GMT Content-Length: 0 Connection: close X-Message-Id: zZZeIL00RNSQ7HzxljGngw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1379270196, 1379270191, 1379270182, 1379270180, 1379270148, 1379270117, 1379270097, 1379270095, 1379270076] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270196', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270191', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270182', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270180', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270148', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270117', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270097', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270095', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270076', None, None, None, None, None, '3592270') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014276742935180664 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.608378887176514 time spend to save output : 0.014565229415893555 total time spend for step 9 : 7.622944116592407 step10:split_time_score Mon Aug 25 19:47:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 9),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 25082025 26211842 Nombre de photos uploadées : 9 / 23040 (0%) 25082025 26211842 Nombre de photos taguées (types de déchets): 0 / 9 (0%) 25082025 26211842 Nombre de photos taguées (volume) : 0 / 9 (0%) elapsed_time : load_data_split_time_score 2.86102294921875e-06 elapsed_time : order_list_meta_photo_and_scores 7.867813110351562e-06 ????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005269050598144531 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20854759216308594 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.06581901039961773 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26194420_25-08-2025_09_06_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26194420 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26194420 AND mptpi.`type`=3726 To do Qualite : 0.03156193207671507 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26200337_25-08-2025_12_11_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26200337 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26200337 AND mptpi.`type`=3726 To do Qualite : 0.03423689956716759 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26207142_25-08-2025_16_41_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26207142 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26207142 AND mptpi.`type`=3726 To do Qualite : 0.041122592838859495 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26204306_25-08-2025_15_16_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26204306 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26204306 AND mptpi.`type`=3726 To do Qualite : 0.14374278747957514 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26207198_25-08-2025_16_52_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26207198 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26207198 AND mptpi.`type`=3594 To do Qualite : 0.16000255862054186 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26211842_25-08-2025_19_46_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26211842 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26211842 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'25082025': {'nb_upload': 9, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1379270196, 1379270191, 1379270182, 1379270180, 1379270148, 1379270117, 1379270097, 1379270095, 1379270076] Looping around the photos to save general results len do output : 1 /26211842Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270196', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270191', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270182', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270180', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270148', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270117', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270097', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270095', None, None, None, None, None, '3592270') ('3318', None, None, None, None, None, None, None, '3592270') ('3318', '26211842', '1379270076', None, None, None, None, None, '3592270') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.013056278228759766 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.7525818347930908 time spend to save output : 0.013323545455932617 total time spend for step 10 : 0.7659053802490234 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 9 set_done_treatment 182.85user 146.72system 6:37.37elapsed 82%CPU (0avgtext+0avgdata 4651648maxresident)k 1391312inputs+198720outputs (37078major+16516507minor)pagefaults 0swaps